Stack Overflow
Stack Overflow

Questions tagged [raid]

RAID (Redundant Array of Independent Disks) is a technology that provides increased storage functions and reliability through redundancy.

RAID (Redundant Array of Independent Disks) is a technology that provides increased storage functions and reliability through redundancy.

38 questions
10
votes
1 answer

Get size of volume on Windows

I'm writing a library to extract information about physical disks, partitions, and volumes on a Windows system (XP or later). I'm trying to get the capacity of a volume. Here are the approaches I know about and the reason each…
Ben Voigt
  • 277,958
  • 43
  • 419
  • 720
7
votes
1 answer

kafka disks hault writes during massive reads and cause "queue full" errors in the kafka producer

we have 6 X kafka brokers with 256GB RAM, 24c/48T and they host 20 X 1.8TB SAS 10K rpm disks configured in raid10. There are two spark streaming apps that start their batches every 10 minutes once they start, their first job is reading from the…
Elad Eldor
  • 803
  • 1
  • 12
  • 22
6
votes
1 answer

cassandra replication or raid

With traditional RDBMS we are used to RAID10 in most cases but if using cassandra RF=2 then we exactly have one copy as backup then in this case why not or why to use RAID10. I think it will reduce overhead from cassandra for replication.. Moreover…
Gary Lindahl
  • 5,341
  • 2
  • 19
  • 18
6
votes
7 answers

Improve write speed for high speed file copy?

I've been trying to find out the fastest way to code a file copy routine to copy a large file onto a RAID 5 hardware. The average file size is around 2 GB. There are 2 windows boxes (both running win2k3). The first box is the source, where is the…
ring0
  • 791
  • 2
  • 7
  • 5
5
votes
3 answers

What causes Silent Data Corruption on HDDs?

Some landmark studies a number of years ago now showed that silent corruption in large datasets was far more widespread than previously anticipated (and today I guess you'd say it's more than commonly realized). Assuming that the application and…
JDługosz
  • 5,592
  • 3
  • 24
  • 45
5
votes
2 answers

What kind of JBOD in hadoop? and COW with hadoop?

New to hadoop, only setup a 3 debian server cluster for practice. I was researching best practices on hadoop and came across: JBOD no RAID Filesystem: ext3, ext4, xfs - none of that fancy COW stuff you see with zfs and btrfs So I raise these…
kossboss
  • 69
  • 1
  • 6
4
votes
1 answer

PAGEIOLATCH_SH related to partial drive failure?

Relevant Technology: SQL Server 2008 R2 RAID 5 (4 disk) Windows Server 2008 To preface, our RAID 5 array had a disk partially fail. No failure was detected, but the drive light flashed amber periodically (solid amber indicates drive failure) after…
Merennulli
  • 73
  • 2
  • 10
4
votes
1 answer

SCSI read capacity (10) reports wrong LBA and sector size

I've been trying to test my AHCI driver for my hobby OS on bare metal. Before that, I tested my driver in QEMU with the parameters: qemu-system-i386 -boot d -cdrom elfboot.iso -machine q35 -m 2G -hda hda.img -serial stdio The output is something…
CRoemheld
  • 889
  • 7
  • 26
4
votes
3 answers

How do I monitor the status of a RAID array on an Intel controller from a Windows application?

I need to check the status of a RAID array on an Intel controller from my Windows application periodically (or be notified about a status change). Specifically, what I need is to find out whether a RAID 5 array is healthy or one of its disks is…
Helgi
  • 5,428
  • 1
  • 31
  • 48
4
votes
4 answers

Powershell to wake up multiple media drives simultaneously

I have a server with lots of media drives ~43TB. An areca 1882ix-16 is set to spin the drives down after 30 minutes of inactivity since most days an individual drive is not even used. This works nicely to prevent unnecessary power and heat. In…
Dan
  • 223
  • 1
  • 5
  • 14
3
votes
2 answers

scripting mdadm when a component device may contain ext2 file system already

I want to script the striping of the two ephemeral storage devices on m1.large EC2 instances using mdadm (apparently amis don't always include device information, so i can't just create a new ami once the array is started). The problem is, ephemeral…
Johnny C
  • 1,799
  • 1
  • 16
  • 27
3
votes
2 answers

Programming a loopback-device consisting of several files in Linux

Hej, it is relatively easy to use a file for emulating a block-device using losetup in Linux: http://www.walkernews.net/2007/07/01/create-linux-loopback-file-system-on-disk-file/ Can anyone please give me a hint on what to look for in case I want…
dubbaluga
  • 2,223
  • 5
  • 29
  • 38
2
votes
1 answer

Improving performance of git repo with hundreds of thousands of small files

I'm trying to improve performance of a git repository that is being used almost exclusively by me to version a scientific computing project. The project's simulation software blasts teeny (less than 100KB) plaintext files into fairly deep…
LGS
  • 110
  • 8
2
votes
2 answers

Scylla fails to mount RAID volume after restarting EC2 instance

I am new to Scylla. I have followed the installation steps on the Scylla website to setup a small 4 node Scylla cluster in my AWS account. I am using the Scylla ami on my EC2 instances. If I stop one of the EC2 instances and then start it up again.…
Freid001
  • 2,580
  • 3
  • 29
  • 60
2
votes
1 answer

How to calculate RAID 5 parity for even disc count?

When I come to RAID 5 explanations I very often see pictures showing 4 discs with three data blocks and one parity block. As example calculation (on same sites, sometimes) I always see only 3 discs. Most likely because it makes more sense: I can XOR…
AyJayKay
  • 103
  • 6
1
2 3