From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from relay.sgi.com (relay2.corp.sgi.com [137.38.102.29]) by oss.sgi.com (Postfix) with ESMTP id 3DF297F4E for ; Mon, 25 Nov 2013 21:58:30 -0600 (CST) Received: from cuda.sgi.com (cuda3.sgi.com [192.48.176.15]) by relay2.corp.sgi.com (Postfix) with ESMTP id 2954F304048 for ; Mon, 25 Nov 2013 19:58:27 -0800 (PST) Received: from greer.hardwarefreak.com (mo-65-41-216-221.sta.embarqhsd.net [65.41.216.221]) by cuda.sgi.com with ESMTP id pvkyhv4D5VQla7QI for ; Mon, 25 Nov 2013 19:58:26 -0800 (PST) Message-ID: <52941C5D.1000305@hardwarefreak.com> Date: Mon, 25 Nov 2013 21:58:21 -0600 From: Stan Hoeppner MIME-Version: 1.0 Subject: Re: ARC-1120 and MD very sloooow References: <1385118796.8091.31.camel@bews002.euractiv.com> <528FBBE5.80404@hardwarefreak.com> <1385369796.2076.16.camel@bews002.euractiv.com> <5293EF32.9090301@hardwarefreak.com> <20131126025210.GL8803@dastard> In-Reply-To: <20131126025210.GL8803@dastard> Reply-To: stan@hardwarefreak.com List-Id: XFS Filesystem from SGI List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: xfs-bounces@oss.sgi.com Sender: xfs-bounces@oss.sgi.com To: Dave Chinner Cc: Jimmy Thrasibule , Linux RAID , "xfs@oss.sgi.com" On 11/25/2013 8:52 PM, Dave Chinner wrote: ... > sunit/swidth is in filesystem blocks, not sectors. Hence > sunit is 1MB, swidth = 2MB. While it's not quite correct > (su=512k,sw=1m), it's not actually a problem... Well that's what I thought as well, and I was puzzled by the 8 blocks value for the log sunit. So I double checked before posting, and 'man mkfs.xfs' told me sunit=value This is used to specify the stripe unit for a RAID device or a logical volume. The value has to be specified in 512-byte block units. So apparently the units of 'sunit' are different depending on which XFS tool one is using. That's a bit confusing. And 'man xfs_info' (xfs_growfs) doesn't tell us that sunit is given in filesystem blocks. I'm using xfsprogs 3.1.4 so maybe these have been corrected since. > Well, mkfs.xfs just uses what it gets from the kernel, so it > might have been told the wrong thing by MD itself. However, you can > modify sunit/swidth by mount options, so you can't directly trust > what is reported from xfs_info to be what mkfs actually set > originally. Got it. > Again, lsunit is in filesystem blocks, so it is 32k, not 4k. And > yes, the default lsunit when the sunit > 256k is 32k. So, nothing > wrong there, either. So where should I have looked to confirm sunit reported by xfs_info is in fs block (4KB) multiples, not the in the 512B multiples of mkfs.xfs? > The usual: "iostat -x -d -m 5" output while the test is running. > Also, you are using buffered IO, so changing it to use direct IO > will tell us exactly what the disks are doing when Io is issued. > blktrace is your friend here.... It'll be interesting to see where this troubleshooting leads. Buffered single stream write speed is ~6x slower than read w/RAID10. That makes me wonder if the controller and drive write caches have been disabled. That could explain this. -- Stan _______________________________________________ xfs mailing list xfs@oss.sgi.com http://oss.sgi.com/mailman/listinfo/xfs