Re: XFS: Abysmal write performance because of excessive seeking (allocation groups to blame?)

[Stan Hoeppner <stan@hardwarefreak.com>]

On 4/9/2012 9:21 AM, Geoffrey Wehrman wrote:
> On Fri, Apr 06, 2012 at 06:28:37PM -0500, Stan Hoeppner wrote:
> | So while the XFS AG architecture may not be perfectly suited to your
> | single 6 drive RAID6 array, it still gives rather remarkable performance
> | given that the same architecture can scale pretty linearly to the
> | heights above, and far beyond.  Something EXTx and others could never
> | dream of.  Some of the SGI guys might be able to confirm deployed single
> | XFS filesystems spanning 1000+ drives in the past.  Today we'd probably
> | only see that scale with CXFS.

Good to hear from you Geoffrey.

> With an SGI IS16000 array which supports up to 1,200 drives, filesystems
> with large numbers of drives isn't difficult.  Most configurations
> using the IS16000 have 8+2 RAID6 luns.  

Is the concatenation of all these RAID6 LUNs performed within the
IS16000, or with md/lvm, or?

> I've seen sustained 15 GB/s to
> a single filesystem on one of the arrays with a 600 drive configuration.

To be clear, this is a single Linux XFS filesystem on a single host, not
multiple CXFS clients, correct?  If so, out of curiosity, is the host in
this case an old Itanium Altix or the newer Xeon based Altix UV?  And
finally, is this example system using FC or Infiniband connectivity?
How many ports?

> The scalability of XFS is impressive.

Quite impressive.  And there's nothing in XFS itself preventing
scalability of a single filesystem over 4 IS16000s w/4800 total drives,
although one might run into some limitations when attempting to
concatenate that many LUNs.  I've never attempted that scale with md or
lvm, and I've never had my hands on an IS16000.

-- 
Stan

_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs