Linux RAID subsystem development
 help / color / mirror / Atom feed
* single RAID slower than aggregate multi-RAID?
@ 2008-08-15 13:55 Jan Wagner
  2008-08-15 19:35 ` Justin Piszcz
  2008-08-15 22:02 ` Neil Brown
  0 siblings, 2 replies; 10+ messages in thread
From: Jan Wagner @ 2008-08-15 13:55 UTC (permalink / raw)
  To: linux-raid

Hi,

at work we have been experimenting with SATA-II port multipliers and SATA 
controllers (FIS-based). For some reason the RAID-0 performance is 
relatively awful.

We have one 4xeSATA controller card ADSA3GPX8-4E, twelve SpinPoint F1 
disks that handle ~110MB/sec, and four port Addonics port multiplier 
boxes. Ubuntu, kernel 2.6.24-19-generic x86_64, 2 x AMD2212 Opteron on an 
Asus L1N64-SLI WS.

We did two sequential writing tests. One test with all 12 disks 
behind the controller placed into one mdadm RAID-0, 512k..2048k 
chunksize. We get ~475 MB/s.

The second test used four "mdadm --create"'s to reassign the 12 drives 
into four RAID-0 with 3 disks in each. All four raids were simultaneously 
written to. We get ~250 MB/s/raid and 1000 MB/s aggregate.

So the controller can handle at least 1000 MB/s.

My question is why is the single RAID setup more than half slower? Any 
ideas?

Is there some kernel per-device bandwidth throttling?

I already tried: O_DIRECT, posix_fadvise(), madvise(), pdflush tuning, 
different test programs, using a raw /dev/md{0,1,2,3} vs testing 
the xfs filesystem. None of them get the single RAID performance over 475 
MB/s. CPU load isn't a likely problem either. To check I wrote a threaded 
program[1] that has threads writing in-sequence into the same output file. 
All 4 cores loaded very evenly and are >=60% idle. But the rate is still 
475 MB/s. Puzzling and frustrating :-)

Is there still something that a desperate person could try to tune to get 
this lousy mdadm raid throughput improved?? :-)

Thanks in advance,

  - Jan

[1] http://www.metsahovi.fi/~jwagner/tmp/wr-nexgen-threaded.c


^ permalink raw reply	[flat|nested] 10+ messages in thread

end of thread, other threads:[~2008-08-26  8:27 UTC | newest]

Thread overview: 10+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2008-08-15 13:55 single RAID slower than aggregate multi-RAID? Jan Wagner
2008-08-15 19:35 ` Justin Piszcz
2008-08-15 21:53   ` Richard Scobie
2008-08-15 22:02 ` Neil Brown
2008-08-18 10:48   ` Jan Wagner
2008-08-18 11:54     ` Neil Brown
2008-08-18 12:27       ` Jan Wagner
2008-08-20 12:24         ` Jan Wagner
2008-08-21  7:34           ` Peter Grandi
2008-08-26  8:27             ` Jan Wagner

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox