* Re: Performance issues with Areca 1680 SAS Controllers [not found] <492403B8.5090007@fuckner.net> @ 2008-11-20 1:18 ` Andrew Morton 2008-11-20 7:39 ` Nick Cheng 0 siblings, 1 reply; 12+ messages in thread From: Andrew Morton @ 2008-11-20 1:18 UTC (permalink / raw) To: Michael Fuckner; +Cc: linux-kernel, linux-scsi, Nick Cheng, Erich Chen (cc's added) On Wed, 19 Nov 2008 13:16:56 +0100 Michael Fuckner <michael@fuckner.net> wrote: > Hi, > > I am using an Areca 1680-SAS-Controller with 16 SAS-HDD (Seagate 1TB > ST31000640SS). I set up a Raid6 with all 16 disks and formatted it with > XFS. The Controller has 512MB RAM and a BBU. The OS is installed to > another disk attached to the onboard AHCI controller. > > After doing some IO, the areca raidset is slower compared to the rate > directly > after boot. > > > [root@storage ~]# dd if=/dev/sdb1 of=/dev/null bs=1M count=50k iflag=direct > 51200+0 records in > 51200+0 records out > 53687091200 bytes (54 GB) copied, 59.6494 seconds, 900 MB/s > [root@storage ~]# mount /dev/sdb1 /data > [root@storage ~]# cd /data/ > [root@storage data]# ./iozone -i 0 -i 1 -s 32g -r 16m -S 6144 -t 8 -+r > -o >raid6_sync_t8.log > [root@storage data]# cd > [root@storage ~]# umount /data/ > [root@storage ~]# dd if=/dev/sdb1 of=/dev/null bs=1M count=50k iflag=direct > 51200+0 records in > 51200+0 records out > 53687091200 bytes (54 GB) copied, 76.4036 seconds, 703 MB/s > > I tested different Versions of Linux (Centos 5.2, OpenSUSE 11, Debian > Lenny) and Vanilla kernels 2.6.22-2.6.27, all show this behaviour. > > Idea why the device slows down after IO- or better: how to keep the high > rate? Is this reproducible foer Areca SATA Controllers (Type 11XX and 12XX) > > Regards, > Michael! ^ permalink raw reply [flat|nested] 12+ messages in thread
* RE: Performance issues with Areca 1680 SAS Controllers 2008-11-20 1:18 ` Performance issues with Areca 1680 SAS Controllers Andrew Morton @ 2008-11-20 7:39 ` Nick Cheng 2009-08-19 14:08 ` Pasi Kärkkäinen 0 siblings, 1 reply; 12+ messages in thread From: Nick Cheng @ 2008-11-20 7:39 UTC (permalink / raw) To: 'Andrew Morton', 'Michael Fuckner' Cc: linux-kernel, linux-scsi, 'Erich Chen' Hi Michael, I will get around handling your issue. Thanks for your kindly patience, -----Original Message----- From: Andrew Morton [mailto:akpm@linux-foundation.org] Sent: Thursday, November 20, 2008 9:18 AM To: Michael Fuckner Cc: linux-kernel@vger.kernel.org; linux-scsi@vger.kernel.org; Nick Cheng; Erich Chen Subject: Re: Performance issues with Areca 1680 SAS Controllers (cc's added) On Wed, 19 Nov 2008 13:16:56 +0100 Michael Fuckner <michael@fuckner.net> wrote: > Hi, > > I am using an Areca 1680-SAS-Controller with 16 SAS-HDD (Seagate 1TB > ST31000640SS). I set up a Raid6 with all 16 disks and formatted it with > XFS. The Controller has 512MB RAM and a BBU. The OS is installed to > another disk attached to the onboard AHCI controller. > > After doing some IO, the areca raidset is slower compared to the rate > directly > after boot. > > > [root@storage ~]# dd if=/dev/sdb1 of=/dev/null bs=1M count=50k iflag=direct > 51200+0 records in > 51200+0 records out > 53687091200 bytes (54 GB) copied, 59.6494 seconds, 900 MB/s > [root@storage ~]# mount /dev/sdb1 /data > [root@storage ~]# cd /data/ > [root@storage data]# ./iozone -i 0 -i 1 -s 32g -r 16m -S 6144 -t 8 -+r > -o >raid6_sync_t8.log > [root@storage data]# cd > [root@storage ~]# umount /data/ > [root@storage ~]# dd if=/dev/sdb1 of=/dev/null bs=1M count=50k iflag=direct > 51200+0 records in > 51200+0 records out > 53687091200 bytes (54 GB) copied, 76.4036 seconds, 703 MB/s > > I tested different Versions of Linux (Centos 5.2, OpenSUSE 11, Debian > Lenny) and Vanilla kernels 2.6.22-2.6.27, all show this behaviour. > > Idea why the device slows down after IO- or better: how to keep the high > rate? Is this reproducible foer Areca SATA Controllers (Type 11XX and 12XX) > > Regards, > Michael! ^ permalink raw reply [flat|nested] 12+ messages in thread
* Re: Performance issues with Areca 1680 SAS Controllers 2008-11-20 7:39 ` Nick Cheng @ 2009-08-19 14:08 ` Pasi Kärkkäinen [not found] ` <200908192247543597389@usish.com> [not found] ` <SERVER-ARECA8ldpyzy000025bc@areca.com.tw> 0 siblings, 2 replies; 12+ messages in thread From: Pasi Kärkkäinen @ 2009-08-19 14:08 UTC (permalink / raw) To: Nick Cheng Cc: 'Andrew Morton', 'Michael Fuckner', linux-kernel, linux-scsi, 'Erich Chen' On Thu, Nov 20, 2008 at 03:39:40PM +0800, Nick Cheng wrote: > Hi Michael, > I will get around handling your issue. > Thanks for your kindly patience, > Hello, Was this issue resolved? I'm seeing similar behaviour.. I think it's related to flushing the controller cache? Waiting a while (after the disk leds stop blinking) performance is back to normal.. -- Pasi > -----Original Message----- > From: Andrew Morton [mailto:akpm@linux-foundation.org] > Sent: Thursday, November 20, 2008 9:18 AM > To: Michael Fuckner > Cc: linux-kernel@vger.kernel.org; linux-scsi@vger.kernel.org; Nick Cheng; > Erich Chen > Subject: Re: Performance issues with Areca 1680 SAS Controllers > > (cc's added) > > On Wed, 19 Nov 2008 13:16:56 +0100 > Michael Fuckner <michael@fuckner.net> wrote: > > > Hi, > > > > I am using an Areca 1680-SAS-Controller with 16 SAS-HDD (Seagate 1TB > > ST31000640SS). I set up a Raid6 with all 16 disks and formatted it with > > XFS. The Controller has 512MB RAM and a BBU. The OS is installed to > > another disk attached to the onboard AHCI controller. > > > > After doing some IO, the areca raidset is slower compared to the rate > > directly > > after boot. > > > > > > [root@storage ~]# dd if=/dev/sdb1 of=/dev/null bs=1M count=50k > iflag=direct > > 51200+0 records in > > 51200+0 records out > > 53687091200 bytes (54 GB) copied, 59.6494 seconds, 900 MB/s > > [root@storage ~]# mount /dev/sdb1 /data > > [root@storage ~]# cd /data/ > > [root@storage data]# ./iozone -i 0 -i 1 -s 32g -r 16m -S 6144 -t 8 -+r > > -o >raid6_sync_t8.log > > [root@storage data]# cd > > [root@storage ~]# umount /data/ > > [root@storage ~]# dd if=/dev/sdb1 of=/dev/null bs=1M count=50k > iflag=direct > > 51200+0 records in > > 51200+0 records out > > 53687091200 bytes (54 GB) copied, 76.4036 seconds, 703 MB/s > > > > I tested different Versions of Linux (Centos 5.2, OpenSUSE 11, Debian > > Lenny) and Vanilla kernels 2.6.22-2.6.27, all show this behaviour. > > > > Idea why the device slows down after IO- or better: how to keep the high > > rate? Is this reproducible foer Areca SATA Controllers (Type 11XX and > 12XX) > > > > Regards, > > Michael! > > -- > To unsubscribe from this list: send the line "unsubscribe linux-kernel" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html > Please read the FAQ at http://www.tux.org/lkml/ ^ permalink raw reply [flat|nested] 12+ messages in thread
[parent not found: <200908192247543597389@usish.com>]
* Re: Re: Performance issues with Areca 1680 SAS Controllers [not found] ` <200908192247543597389@usish.com> @ 2009-08-19 16:40 ` Pasi Kärkkäinen 2009-08-20 0:56 ` 答复: " jack wang 2009-08-20 2:29 ` Drew 0 siblings, 2 replies; 12+ messages in thread From: Pasi Kärkkäinen @ 2009-08-19 16:40 UTC (permalink / raw) To: Wang Jinpu Cc: Nick Cheng, 'Andrew Morton', 'Michael Fuckner', linux-kernel, linux-scsi, 'Erich Chen' On Wed, Aug 19, 2009 at 10:48:00PM +0800, Wang Jinpu wrote: > > > > > > > ???????? Pasi K?rkk?inen > ?????????? 2009-08-19 22:34:28 > ???????? Nick Cheng > ?????? 'Andrew Morton'; 'Michael Fuckner'; linux-kernel; linux-scsi; 'Erich Chen' > ?????? Re: Performance issues with Areca 1680 SAS Controllers > > On Thu, Nov 20, 2008 at 03:39:40PM +0800, Nick Cheng wrote: > > Hi Michael, > > I will get around handling your issue. > > Thanks for your kindly patience, > > > Hello, > Was this issue resolved? I'm seeing similar behaviour.. I think it's related > to flushing the controller cache? > Waiting a while (after the disk leds stop blinking) performance is back to > normal.. > -- Pasi > > In my memory ??It's because the write cache is not enable??You can verify > it using sdparm I'm using battery backed write-back write cache on Areca controller, and it's enabled. Or did you mean caches in each harddisk? More information about my setup: - Areca 1680 24-port SAS RAID controller - Physical disks 1-4 are raid-10 for the OS (boot volume, /dev/sda) - Physical disks 5-18 are raid-60 for the data (/dev/sdb) I downloaded ltp-base-20090731.tgz from http://ltp.sf.net and compiled it. from testcases/kernel/io/disktest/ I run: # echo 3 > /proc/sys/vm/drop_caches # ./disktest -w -K16 -B 4k -T 60 -pr -Ibd -PA /dev/sdb (sdb is the raid-60 data array). So the disktest benchmark is running 4 kB random writes using 16 threads and direct-IO (bypassing kernel caches) for 60 seconds. The test completes after 60 seconds, just like it should, but the disk leds will keep blinking for many minutes more.. So basicly Areca controller is first caching the random write IOs and then flushing them from the cache (2 GB) to the disks.. The problem is while Areca is doing the flushing _all_ IOs are really slow, including the other raid-10 array for the OS, which uses totally separate physical disks. Opening another shell in screen takes at least 30 seconds, starting "top" takes forever etc.. While Areca is flushing the caches (and all the IOs are slow), "iostat 1" doesn't show any "leftover" IOs from the benchmark. So the benchmark was really using direct IO, bypassing kernel caches. I tried with different io-schedulers (cfq,deadline,noop) but they didn't have big effect.. which makes sense, since the OS/kernel is not doing any big IO when the 'stalling' happens. Is there some way to make Areca NOT use all cpu-power for cache flushing? OS is CentOS 5.3 x86_64 with linux-2.6.18-128 kernel. -- Pasi > 2009-08-19 > > > > Wang Jinpu > > -----Original Message----- > > From: Andrew Morton [mailto:akpm@linux-foundation.org] > > Sent: Thursday, November 20, 2008 9:18 AM > > To: Michael Fuckner > > Cc: linux-kernel@vger.kernel.org; linux-scsi@vger.kernel.org; Nick Cheng; > > Erich Chen > > Subject: Re: Performance issues with Areca 1680 SAS Controllers > > > > (cc's added) > > > > On Wed, 19 Nov 2008 13:16:56 +0100 > > Michael Fuckner <michael@fuckner.net> wrote: > > > > > Hi, > > > > > > I am using an Areca 1680-SAS-Controller with 16 SAS-HDD (Seagate 1TB > > > ST31000640SS). I set up a Raid6 with all 16 disks and formatted it with > > > XFS. The Controller has 512MB RAM and a BBU. The OS is installed to > > > another disk attached to the onboard AHCI controller. > > > > > > After doing some IO, the areca raidset is slower compared to the rate > > > directly > > > after boot. > > > > > > > > > [root@storage ~]# dd if=/dev/sdb1 of=/dev/null bs=1M count=50k > > iflag=direct > > > 51200+0 records in > > > 51200+0 records out > > > 53687091200 bytes (54 GB) copied, 59.6494 seconds, 900 MB/s > > > [root@storage ~]# mount /dev/sdb1 /data > > > [root@storage ~]# cd /data/ > > > [root@storage data]# ./iozone -i 0 -i 1 -s 32g -r 16m -S 6144 -t 8 -+r > > > -o >raid6_sync_t8.log > > > [root@storage data]# cd > > > [root@storage ~]# umount /data/ > > > [root@storage ~]# dd if=/dev/sdb1 of=/dev/null bs=1M count=50k > > iflag=direct > > > 51200+0 records in > > > 51200+0 records out > > > 53687091200 bytes (54 GB) copied, 76.4036 seconds, 703 MB/s > > > > > > I tested different Versions of Linux (Centos 5.2, OpenSUSE 11, Debian > > > Lenny) and Vanilla kernels 2.6.22-2.6.27, all show this behaviour. > > > > > > Idea why the device slows down after IO- or better: how to keep the high > > > rate? Is this reproducible foer Areca SATA Controllers (Type 11XX and > > 12XX) > > > > > > Regards, > > > Michael! > > > > -- > > To unsubscribe from this list: send the line "unsubscribe linux-kernel" in > > the body of a message to majordomo@vger.kernel.org > > More majordomo info at http://vger.kernel.org/majordomo-info.html > > Please read the FAQ at http://www.tux.org/lkml/ > -- > To unsubscribe from this list: send the line "unsubscribe linux-scsi" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html > __________ Information from ESET NOD32 Antivirus, version of virus signature database 4347 (20090819) __________ > The message was checked by ESET NOD32 Antivirus. > http://www.eset.com ^ permalink raw reply [flat|nested] 12+ messages in thread
* 答复: Re: Performance issues with Areca 1680 SAS Controllers 2009-08-19 16:40 ` Pasi Kärkkäinen @ 2009-08-20 0:56 ` jack wang 2009-08-20 2:29 ` Drew 1 sibling, 0 replies; 12+ messages in thread From: jack wang @ 2009-08-20 0:56 UTC (permalink / raw) To: 'Pasi Kärkkäinen' Cc: 'Nick Cheng', 'Andrew Morton', 'Michael Fuckner', 'linux-kernel', 'linux-scsi', 'Erich Chen' > On Thu, Nov 20, 2008 at 03:39:40PM +0800, Nick Cheng wrote: > > Hi Michael, > > I will get around handling your issue. > > Thanks for your kindly patience, > > > Hello, > Was this issue resolved? I'm seeing similar behaviour.. I think it's related > to flushing the controller cache? > Waiting a while (after the disk leds stop blinking) performance is back to > normal.. > -- Pasi > > In my memory ??It's because the write cache is not enable??You can verify > it using sdparm I'm using battery backed write-back write cache on Areca controller, and it's enabled. Or did you mean caches in each harddisk? [Jack] Yes , I mean the write cache of each HD. More information about my setup: - Areca 1680 24-port SAS RAID controller - Physical disks 1-4 are raid-10 for the OS (boot volume, /dev/sda) - Physical disks 5-18 are raid-60 for the data (/dev/sdb) I downloaded ltp-base-20090731.tgz from http://ltp.sf.net and compiled it. from testcases/kernel/io/disktest/ I run: # echo 3 > /proc/sys/vm/drop_caches # ./disktest -w -K16 -B 4k -T 60 -pr -Ibd -PA /dev/sdb (sdb is the raid-60 data array). So the disktest benchmark is running 4 kB random writes using 16 threads and direct-IO (bypassing kernel caches) for 60 seconds. The test completes after 60 seconds, just like it should, but the disk leds will keep blinking for many minutes more.. So basicly Areca controller is first caching the random write IOs and then flushing them from the cache (2 GB) to the disks.. The problem is while Areca is doing the flushing _all_ IOs are really slow, including the other raid-10 array for the OS, which uses totally separate physical disks. Opening another shell in screen takes at least 30 seconds, starting "top" takes forever etc.. While Areca is flushing the caches (and all the IOs are slow), "iostat 1" doesn't show any "leftover" IOs from the benchmark. So the benchmark was really using direct IO, bypassing kernel caches. I tried with different io-schedulers (cfq,deadline,noop) but they didn't have big effect.. which makes sense, since the OS/kernel is not doing any big IO when the 'stalling' happens. Is there some way to make Areca NOT use all cpu-power for cache flushing? OS is CentOS 5.3 x86_64 with linux-2.6.18-128 kernel. -- Pasi > 2009-08-19 > > > > Wang Jinpu > > -----Original Message----- > > From: Andrew Morton [mailto:akpm@linux-foundation.org] > > Sent: Thursday, November 20, 2008 9:18 AM > > To: Michael Fuckner > > Cc: linux-kernel@vger.kernel.org; linux-scsi@vger.kernel.org; Nick Cheng; > > Erich Chen > > Subject: Re: Performance issues with Areca 1680 SAS Controllers > > > > (cc's added) > > > > On Wed, 19 Nov 2008 13:16:56 +0100 > > Michael Fuckner <michael@fuckner.net> wrote: > > > > > Hi, > > > > > > I am using an Areca 1680-SAS-Controller with 16 SAS-HDD (Seagate 1TB > > > ST31000640SS). I set up a Raid6 with all 16 disks and formatted it with > > > XFS. The Controller has 512MB RAM and a BBU. The OS is installed to > > > another disk attached to the onboard AHCI controller. > > > > > > After doing some IO, the areca raidset is slower compared to the rate > > > directly > > > after boot. > > > > > > > > > [root@storage ~]# dd if=/dev/sdb1 of=/dev/null bs=1M count=50k > > iflag=direct > > > 51200+0 records in > > > 51200+0 records out > > > 53687091200 bytes (54 GB) copied, 59.6494 seconds, 900 MB/s > > > [root@storage ~]# mount /dev/sdb1 /data > > > [root@storage ~]# cd /data/ > > > [root@storage data]# ./iozone -i 0 -i 1 -s 32g -r 16m -S 6144 -t 8 -+r > > > -o >raid6_sync_t8.log > > > [root@storage data]# cd > > > [root@storage ~]# umount /data/ > > > [root@storage ~]# dd if=/dev/sdb1 of=/dev/null bs=1M count=50k > > iflag=direct > > > 51200+0 records in > > > 51200+0 records out > > > 53687091200 bytes (54 GB) copied, 76.4036 seconds, 703 MB/s > > > > > > I tested different Versions of Linux (Centos 5.2, OpenSUSE 11, Debian > > > Lenny) and Vanilla kernels 2.6.22-2.6.27, all show this behaviour. > > > > > > Idea why the device slows down after IO- or better: how to keep the high > > > rate? Is this reproducible foer Areca SATA Controllers (Type 11XX and > > 12XX) > > > > > > Regards, > > > Michael! > > > > -- > > To unsubscribe from this list: send the line "unsubscribe linux-kernel" in > > the body of a message to majordomo@vger.kernel.org > > More majordomo info at http://vger.kernel.org/majordomo-info.html > > Please read the FAQ at http://www.tux.org/lkml/ > -- > To unsubscribe from this list: send the line "unsubscribe linux-scsi" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html > __________ Information from ESET NOD32 Antivirus, version of virus signature database 4347 (20090819) __________ > The message was checked by ESET NOD32 Antivirus. > http://www.eset.com ^ permalink raw reply [flat|nested] 12+ messages in thread
* Re: Re: Performance issues with Areca 1680 SAS Controllers 2009-08-19 16:40 ` Pasi Kärkkäinen 2009-08-20 0:56 ` 答复: " jack wang @ 2009-08-20 2:29 ` Drew 2009-08-20 8:00 ` Pasi Kärkkäinen 1 sibling, 1 reply; 12+ messages in thread From: Drew @ 2009-08-20 2:29 UTC (permalink / raw) To: Pasi Kärkkäinen Cc: Wang Jinpu, Nick Cheng, Andrew Morton, Michael Fuckner, linux-kernel, linux-scsi, Erich Chen > The problem is while Areca is doing the flushing _all_ IOs are really slow, > including the other raid-10 array for the OS, which uses totally separate physical disks. > > Opening another shell in screen takes at least 30 seconds, starting "top" > takes forever etc.. > > While Areca is flushing the caches (and all the IOs are slow), "iostat 1" > doesn't show any "leftover" IOs from the benchmark. So the benchmark was > really using direct IO, bypassing kernel caches. > > I tried with different io-schedulers (cfq,deadline,noop) but they didn't > have big effect.. which makes sense, since the OS/kernel is not doing any > big IO when the 'stalling' happens. > > Is there some way to make Areca NOT use all cpu-power for cache flushing? Is top showing 100% cpu usage? It wouldn't surprise me if the Areca's internal bus / processor is getting swamped. With the RAID60 chewing through two PQ calculations over 14 disks I'd expect the performance of other arrays on the controller would take a hit I've seen similar symptoms when moving massive amounts of data between disks on my servers. IO maxes out the bus, system responsiveness goes down as evidenced by slowly loading apps, and top still shows minimal CPU usage. -- Drew "Nothing in life is to be feared. It is only to be understood." --Marie Curie ^ permalink raw reply [flat|nested] 12+ messages in thread
* Re: Re: Performance issues with Areca 1680 SAS Controllers 2009-08-20 2:29 ` Drew @ 2009-08-20 8:00 ` Pasi Kärkkäinen 0 siblings, 0 replies; 12+ messages in thread From: Pasi Kärkkäinen @ 2009-08-20 8:00 UTC (permalink / raw) To: Drew Cc: Wang Jinpu, Nick Cheng, Andrew Morton, Michael Fuckner, linux-kernel, linux-scsi, Erich Chen On Wed, Aug 19, 2009 at 07:29:07PM -0700, Drew wrote: > > The problem is while Areca is doing the flushing _all_ IOs are really slow, > > including the other raid-10 array for the OS, which uses totally separate physical disks. > > > > Opening another shell in screen takes at least 30 seconds, starting "top" > > takes forever etc.. > > > > While Areca is flushing the caches (and all the IOs are slow), "iostat 1" > > doesn't show any "leftover" IOs from the benchmark. So the benchmark was > > really using direct IO, bypassing kernel caches. > > > > I tried with different io-schedulers (cfq,deadline,noop) but they didn't > > have big effect.. which makes sense, since the OS/kernel is not doing any > > big IO when the 'stalling' happens. > > > > Is there some way to make Areca NOT use all cpu-power for cache flushing? > > Is top showing 100% cpu usage? > No, cpu usage is almost 0%. I was talking about cpu-usage of _Areca_ controller. When the disktest-benchmark ends, Linux cpu usage goes to 0%, and there's no IO anymore (checked with "iostat 1"). But _Areca_ is still flushing it's caches, and all the IO will be slow, even when there's no load in _Linux_. -- Pasi > It wouldn't surprise me if the Areca's internal bus / processor is > getting swamped. With the RAID60 chewing through two PQ calculations > over 14 disks I'd expect the performance of other arrays on the > controller would take a hit > > I've seen similar symptoms when moving massive amounts of data between > disks on my servers. IO maxes out the bus, system responsiveness goes > down as evidenced by slowly loading apps, and top still shows minimal > CPU usage. > > > -- > Drew > > "Nothing in life is to be feared. It is only to be understood." > --Marie Curie ^ permalink raw reply [flat|nested] 12+ messages in thread
[parent not found: <SERVER-ARECA8ldpyzy000025bc@areca.com.tw>]
* Re: Performance issues with Areca 1680 SAS Controllers [not found] ` <SERVER-ARECA8ldpyzy000025bc@areca.com.tw> @ 2009-08-20 9:56 ` Pasi Kärkkäinen 2009-08-20 12:16 ` Pasi Kärkkäinen 0 siblings, 1 reply; 12+ messages in thread From: Pasi Kärkkäinen @ 2009-08-20 9:56 UTC (permalink / raw) To: Nick Cheng Cc: 'Andrew Morton', 'Michael Fuckner', linux-kernel, linux-scsi On Thu, Aug 20, 2009 at 09:54:27AM +0800, Nick Cheng wrote: > Hi Gentlemen, > We have worked it out with new firmware and driver. > You can download the latest F/W from > ftp://ftp.areca.com.tw/RaidCards/BIOS_Firmware/ARC1680/ and use the attached > driver. > Please have a try. > Any comments are welcome. Thanks! I'll give it a try today and report back. -- Pasi > Thank you, > -----Original Message----- > From: Pasi Kärkkäinen [mailto:pasik@iki.fi] > Sent: Wednesday, August 19, 2009 10:09 PM > To: Nick Cheng > Cc: 'Andrew Morton'; 'Michael Fuckner'; linux-kernel@vger.kernel.org; > linux-scsi@vger.kernel.org; 'Erich Chen' > Subject: Re: Performance issues with Areca 1680 SAS Controllers > > On Thu, Nov 20, 2008 at 03:39:40PM +0800, Nick Cheng wrote: > > Hi Michael, > > I will get around handling your issue. > > Thanks for your kindly patience, > > > > Hello, > > Was this issue resolved? I'm seeing similar behaviour.. I think it's related > to flushing the controller cache? > > Waiting a while (after the disk leds stop blinking) performance is back to > normal.. > > -- Pasi > > > -----Original Message----- > > From: Andrew Morton [mailto:akpm@linux-foundation.org] > > Sent: Thursday, November 20, 2008 9:18 AM > > To: Michael Fuckner > > Cc: linux-kernel@vger.kernel.org; linux-scsi@vger.kernel.org; Nick Cheng; > > Erich Chen > > Subject: Re: Performance issues with Areca 1680 SAS Controllers > > > > (cc's added) > > > > On Wed, 19 Nov 2008 13:16:56 +0100 > > Michael Fuckner <michael@fuckner.net> wrote: > > > > > Hi, > > > > > > I am using an Areca 1680-SAS-Controller with 16 SAS-HDD (Seagate 1TB > > > ST31000640SS). I set up a Raid6 with all 16 disks and formatted it with > > > XFS. The Controller has 512MB RAM and a BBU. The OS is installed to > > > another disk attached to the onboard AHCI controller. > > > > > > After doing some IO, the areca raidset is slower compared to the rate > > > directly > > > after boot. > > > > > > > > > [root@storage ~]# dd if=/dev/sdb1 of=/dev/null bs=1M count=50k > > iflag=direct > > > 51200+0 records in > > > 51200+0 records out > > > 53687091200 bytes (54 GB) copied, 59.6494 seconds, 900 MB/s > > > [root@storage ~]# mount /dev/sdb1 /data > > > [root@storage ~]# cd /data/ > > > [root@storage data]# ./iozone -i 0 -i 1 -s 32g -r 16m -S 6144 -t 8 -+r > > > -o >raid6_sync_t8.log > > > [root@storage data]# cd > > > [root@storage ~]# umount /data/ > > > [root@storage ~]# dd if=/dev/sdb1 of=/dev/null bs=1M count=50k > > iflag=direct > > > 51200+0 records in > > > 51200+0 records out > > > 53687091200 bytes (54 GB) copied, 76.4036 seconds, 703 MB/s > > > > > > I tested different Versions of Linux (Centos 5.2, OpenSUSE 11, Debian > > > Lenny) and Vanilla kernels 2.6.22-2.6.27, all show this behaviour. > > > > > > Idea why the device slows down after IO- or better: how to keep the high > > > rate? Is this reproducible foer Areca SATA Controllers (Type 11XX and > > 12XX) > > > > > > Regards, > > > Michael! > > > > -- > > To unsubscribe from this list: send the line "unsubscribe linux-kernel" in > > the body of a message to majordomo@vger.kernel.org > > More majordomo info at http://vger.kernel.org/majordomo-info.html > > Please read the FAQ at http://www.tux.org/lkml/ -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 12+ messages in thread
* Re: Performance issues with Areca 1680 SAS Controllers 2009-08-20 9:56 ` Pasi Kärkkäinen @ 2009-08-20 12:16 ` Pasi Kärkkäinen 2009-08-20 12:18 ` Nick Cheng 2009-08-20 12:19 ` Pasi Kärkkäinen 0 siblings, 2 replies; 12+ messages in thread From: Pasi Kärkkäinen @ 2009-08-20 12:16 UTC (permalink / raw) To: Nick Cheng Cc: 'Andrew Morton', 'Michael Fuckner', linux-kernel, linux-scsi On Thu, Aug 20, 2009 at 12:56:04PM +0300, Pasi Kärkkäinen wrote: > On Thu, Aug 20, 2009 at 09:54:27AM +0800, Nick Cheng wrote: > > Hi Gentlemen, > > We have worked it out with new firmware and driver. > > You can download the latest F/W from > > ftp://ftp.areca.com.tw/RaidCards/BIOS_Firmware/ARC1680/ and use the attached > > driver. > > Please have a try. > > Any comments are welcome. > > Thanks! I'll give it a try today and report back. > v1.47 firmware seems to fix this problem! The system behaves _much_ better now even when Areca is busy flushing it's cache! I didn't update the driver, only Areca firmware. Is there something imported fixed in the latest driver? I'm using the default driver included in RHEL/CentOS 5.3. # modinfo arcmsr.ko filename: arcmsr.ko version: Driver Version 1.20.00.15.RH1 2008/02/27 -- Pasi > > > Thank you, > > -----Original Message----- > > From: Pasi Kärkkäinen [mailto:pasik@iki.fi] > > Sent: Wednesday, August 19, 2009 10:09 PM > > To: Nick Cheng > > Cc: 'Andrew Morton'; 'Michael Fuckner'; linux-kernel@vger.kernel.org; > > linux-scsi@vger.kernel.org; 'Erich Chen' > > Subject: Re: Performance issues with Areca 1680 SAS Controllers > > > > On Thu, Nov 20, 2008 at 03:39:40PM +0800, Nick Cheng wrote: > > > Hi Michael, > > > I will get around handling your issue. > > > Thanks for your kindly patience, > > > > > > > Hello, > > > > Was this issue resolved? I'm seeing similar behaviour.. I think it's related > > to flushing the controller cache? > > > > Waiting a while (after the disk leds stop blinking) performance is back to > > normal.. > > > > -- Pasi > > > > > -----Original Message----- > > > From: Andrew Morton [mailto:akpm@linux-foundation.org] > > > Sent: Thursday, November 20, 2008 9:18 AM > > > To: Michael Fuckner > > > Cc: linux-kernel@vger.kernel.org; linux-scsi@vger.kernel.org; Nick Cheng; > > > Erich Chen > > > Subject: Re: Performance issues with Areca 1680 SAS Controllers > > > > > > (cc's added) > > > > > > On Wed, 19 Nov 2008 13:16:56 +0100 > > > Michael Fuckner <michael@fuckner.net> wrote: > > > > > > > Hi, > > > > > > > > I am using an Areca 1680-SAS-Controller with 16 SAS-HDD (Seagate 1TB > > > > ST31000640SS). I set up a Raid6 with all 16 disks and formatted it with > > > > XFS. The Controller has 512MB RAM and a BBU. The OS is installed to > > > > another disk attached to the onboard AHCI controller. > > > > > > > > After doing some IO, the areca raidset is slower compared to the rate > > > > directly > > > > after boot. > > > > > > > > > > > > [root@storage ~]# dd if=/dev/sdb1 of=/dev/null bs=1M count=50k > > > iflag=direct > > > > 51200+0 records in > > > > 51200+0 records out > > > > 53687091200 bytes (54 GB) copied, 59.6494 seconds, 900 MB/s > > > > [root@storage ~]# mount /dev/sdb1 /data > > > > [root@storage ~]# cd /data/ > > > > [root@storage data]# ./iozone -i 0 -i 1 -s 32g -r 16m -S 6144 -t 8 -+r > > > > -o >raid6_sync_t8.log > > > > [root@storage data]# cd > > > > [root@storage ~]# umount /data/ > > > > [root@storage ~]# dd if=/dev/sdb1 of=/dev/null bs=1M count=50k > > > iflag=direct > > > > 51200+0 records in > > > > 51200+0 records out > > > > 53687091200 bytes (54 GB) copied, 76.4036 seconds, 703 MB/s > > > > > > > > I tested different Versions of Linux (Centos 5.2, OpenSUSE 11, Debian > > > > Lenny) and Vanilla kernels 2.6.22-2.6.27, all show this behaviour. > > > > > > > > Idea why the device slows down after IO- or better: how to keep the high > > > > rate? Is this reproducible foer Areca SATA Controllers (Type 11XX and > > > 12XX) > > > > > > > > Regards, > > > > Michael! > > > > > > -- > > > To unsubscribe from this list: send the line "unsubscribe linux-kernel" in > > > the body of a message to majordomo@vger.kernel.org > > > More majordomo info at http://vger.kernel.org/majordomo-info.html > > > Please read the FAQ at http://www.tux.org/lkml/ > > > -- > To unsubscribe from this list: send the line "unsubscribe linux-kernel" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html > Please read the FAQ at http://www.tux.org/lkml/ ^ permalink raw reply [flat|nested] 12+ messages in thread
* RE: Performance issues with Areca 1680 SAS Controllers 2009-08-20 12:16 ` Pasi Kärkkäinen @ 2009-08-20 12:18 ` Nick Cheng 2009-08-20 12:20 ` Pasi Kärkkäinen 2009-08-20 12:19 ` Pasi Kärkkäinen 1 sibling, 1 reply; 12+ messages in thread From: Nick Cheng @ 2009-08-20 12:18 UTC (permalink / raw) To: 'Pasi Kärkkäinen' Cc: 'Andrew Morton', 'Michael Fuckner', linux-kernel, linux-scsi It could improve the performance with F/W v1.47. -----Original Message----- From: Pasi Kärkkäinen [mailto:pasik@iki.fi] Sent: Thursday, August 20, 2009 8:16 PM To: Nick Cheng Cc: 'Andrew Morton'; 'Michael Fuckner'; linux-kernel@vger.kernel.org; linux-scsi@vger.kernel.org Subject: Re: Performance issues with Areca 1680 SAS Controllers On Thu, Aug 20, 2009 at 12:56:04PM +0300, Pasi Kärkkäinen wrote: > On Thu, Aug 20, 2009 at 09:54:27AM +0800, Nick Cheng wrote: > > Hi Gentlemen, > > We have worked it out with new firmware and driver. > > You can download the latest F/W from > > ftp://ftp.areca.com.tw/RaidCards/BIOS_Firmware/ARC1680/ and use the attached > > driver. > > Please have a try. > > Any comments are welcome. > > Thanks! I'll give it a try today and report back. > v1.47 firmware seems to fix this problem! The system behaves _much_ better now even when Areca is busy flushing it's cache! I didn't update the driver, only Areca firmware. Is there something imported fixed in the latest driver? I'm using the default driver included in RHEL/CentOS 5.3. # modinfo arcmsr.ko filename: arcmsr.ko version: Driver Version 1.20.00.15.RH1 2008/02/27 -- Pasi > > > Thank you, > > -----Original Message----- > > From: Pasi Kärkkäinen [mailto:pasik@iki.fi] > > Sent: Wednesday, August 19, 2009 10:09 PM > > To: Nick Cheng > > Cc: 'Andrew Morton'; 'Michael Fuckner'; linux-kernel@vger.kernel.org; > > linux-scsi@vger.kernel.org; 'Erich Chen' > > Subject: Re: Performance issues with Areca 1680 SAS Controllers > > > > On Thu, Nov 20, 2008 at 03:39:40PM +0800, Nick Cheng wrote: > > > Hi Michael, > > > I will get around handling your issue. > > > Thanks for your kindly patience, > > > > > > > Hello, > > > > Was this issue resolved? I'm seeing similar behaviour.. I think it's related > > to flushing the controller cache? > > > > Waiting a while (after the disk leds stop blinking) performance is back to > > normal.. > > > > -- Pasi > > > > > -----Original Message----- > > > From: Andrew Morton [mailto:akpm@linux-foundation.org] > > > Sent: Thursday, November 20, 2008 9:18 AM > > > To: Michael Fuckner > > > Cc: linux-kernel@vger.kernel.org; linux-scsi@vger.kernel.org; Nick Cheng; > > > Erich Chen > > > Subject: Re: Performance issues with Areca 1680 SAS Controllers > > > > > > (cc's added) > > > > > > On Wed, 19 Nov 2008 13:16:56 +0100 > > > Michael Fuckner <michael@fuckner.net> wrote: > > > > > > > Hi, > > > > > > > > I am using an Areca 1680-SAS-Controller with 16 SAS-HDD (Seagate 1TB > > > > ST31000640SS). I set up a Raid6 with all 16 disks and formatted it with > > > > XFS. The Controller has 512MB RAM and a BBU. The OS is installed to > > > > another disk attached to the onboard AHCI controller. > > > > > > > > After doing some IO, the areca raidset is slower compared to the rate > > > > directly > > > > after boot. > > > > > > > > > > > > [root@storage ~]# dd if=/dev/sdb1 of=/dev/null bs=1M count=50k > > > iflag=direct > > > > 51200+0 records in > > > > 51200+0 records out > > > > 53687091200 bytes (54 GB) copied, 59.6494 seconds, 900 MB/s > > > > [root@storage ~]# mount /dev/sdb1 /data > > > > [root@storage ~]# cd /data/ > > > > [root@storage data]# ./iozone -i 0 -i 1 -s 32g -r 16m -S 6144 -t 8 -+r > > > > -o >raid6_sync_t8.log > > > > [root@storage data]# cd > > > > [root@storage ~]# umount /data/ > > > > [root@storage ~]# dd if=/dev/sdb1 of=/dev/null bs=1M count=50k > > > iflag=direct > > > > 51200+0 records in > > > > 51200+0 records out > > > > 53687091200 bytes (54 GB) copied, 76.4036 seconds, 703 MB/s > > > > > > > > I tested different Versions of Linux (Centos 5.2, OpenSUSE 11, Debian > > > > Lenny) and Vanilla kernels 2.6.22-2.6.27, all show this behaviour. > > > > > > > > Idea why the device slows down after IO- or better: how to keep the high > > > > rate? Is this reproducible foer Areca SATA Controllers (Type 11XX and > > > 12XX) > > > > > > > > Regards, > > > > Michael! > > > > > > -- > > > To unsubscribe from this list: send the line "unsubscribe linux-kernel" in > > > the body of a message to majordomo@vger.kernel.org > > > More majordomo info at http://vger.kernel.org/majordomo-info.html > > > Please read the FAQ at http://www.tux.org/lkml/ > > > -- > To unsubscribe from this list: send the line "unsubscribe linux-kernel" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html > Please read the FAQ at http://www.tux.org/lkml/ -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 12+ messages in thread
* Re: Performance issues with Areca 1680 SAS Controllers 2009-08-20 12:18 ` Nick Cheng @ 2009-08-20 12:20 ` Pasi Kärkkäinen 0 siblings, 0 replies; 12+ messages in thread From: Pasi Kärkkäinen @ 2009-08-20 12:20 UTC (permalink / raw) To: Nick Cheng Cc: 'Andrew Morton', 'Michael Fuckner', linux-kernel, linux-scsi On Thu, Aug 20, 2009 at 08:18:44PM +0800, Nick Cheng wrote: > It could improve the performance with F/W v1.47. > Ok. Thanks! -- Pasi > -----Original Message----- > From: Pasi Kärkkäinen [mailto:pasik@iki.fi] > Sent: Thursday, August 20, 2009 8:16 PM > To: Nick Cheng > Cc: 'Andrew Morton'; 'Michael Fuckner'; linux-kernel@vger.kernel.org; > linux-scsi@vger.kernel.org > Subject: Re: Performance issues with Areca 1680 SAS Controllers > > On Thu, Aug 20, 2009 at 12:56:04PM +0300, Pasi Kärkkäinen wrote: > > On Thu, Aug 20, 2009 at 09:54:27AM +0800, Nick Cheng wrote: > > > Hi Gentlemen, > > > We have worked it out with new firmware and driver. > > > You can download the latest F/W from > > > ftp://ftp.areca.com.tw/RaidCards/BIOS_Firmware/ARC1680/ and use the > attached > > > driver. > > > Please have a try. > > > Any comments are welcome. > > > > Thanks! I'll give it a try today and report back. > > > > v1.47 firmware seems to fix this problem! The system behaves _much_ better > now even when Areca is busy flushing it's cache! > > I didn't update the driver, only Areca firmware. > > Is there something imported fixed in the latest driver? I'm using the > default driver included in RHEL/CentOS 5.3. > > # modinfo arcmsr.ko > filename: arcmsr.ko > version: Driver Version 1.20.00.15.RH1 2008/02/27 > > -- Pasi > > > > > > Thank you, > > > -----Original Message----- > > > From: Pasi Kärkkäinen [mailto:pasik@iki.fi] > > > Sent: Wednesday, August 19, 2009 10:09 PM > > > To: Nick Cheng > > > Cc: 'Andrew Morton'; 'Michael Fuckner'; linux-kernel@vger.kernel.org; > > > linux-scsi@vger.kernel.org; 'Erich Chen' > > > Subject: Re: Performance issues with Areca 1680 SAS Controllers > > > > > > On Thu, Nov 20, 2008 at 03:39:40PM +0800, Nick Cheng wrote: > > > > Hi Michael, > > > > I will get around handling your issue. > > > > Thanks for your kindly patience, > > > > > > > > > > Hello, > > > > > > Was this issue resolved? I'm seeing similar behaviour.. I think it's > related > > > to flushing the controller cache? > > > > > > Waiting a while (after the disk leds stop blinking) performance is back > to > > > normal.. > > > > > > -- Pasi > > > > > > > -----Original Message----- > > > > From: Andrew Morton [mailto:akpm@linux-foundation.org] > > > > Sent: Thursday, November 20, 2008 9:18 AM > > > > To: Michael Fuckner > > > > Cc: linux-kernel@vger.kernel.org; linux-scsi@vger.kernel.org; Nick > Cheng; > > > > Erich Chen > > > > Subject: Re: Performance issues with Areca 1680 SAS Controllers > > > > > > > > (cc's added) > > > > > > > > On Wed, 19 Nov 2008 13:16:56 +0100 > > > > Michael Fuckner <michael@fuckner.net> wrote: > > > > > > > > > Hi, > > > > > > > > > > I am using an Areca 1680-SAS-Controller with 16 SAS-HDD (Seagate 1TB > > > > > ST31000640SS). I set up a Raid6 with all 16 disks and formatted it > with > > > > > XFS. The Controller has 512MB RAM and a BBU. The OS is installed to > > > > > another disk attached to the onboard AHCI controller. > > > > > > > > > > After doing some IO, the areca raidset is slower compared to the > rate > > > > > directly > > > > > after boot. > > > > > > > > > > > > > > > [root@storage ~]# dd if=/dev/sdb1 of=/dev/null bs=1M count=50k > > > > iflag=direct > > > > > 51200+0 records in > > > > > 51200+0 records out > > > > > 53687091200 bytes (54 GB) copied, 59.6494 seconds, 900 MB/s > > > > > [root@storage ~]# mount /dev/sdb1 /data > > > > > [root@storage ~]# cd /data/ > > > > > [root@storage data]# ./iozone -i 0 -i 1 -s 32g -r 16m -S 6144 -t 8 > -+r > > > > > -o >raid6_sync_t8.log > > > > > [root@storage data]# cd > > > > > [root@storage ~]# umount /data/ > > > > > [root@storage ~]# dd if=/dev/sdb1 of=/dev/null bs=1M count=50k > > > > iflag=direct > > > > > 51200+0 records in > > > > > 51200+0 records out > > > > > 53687091200 bytes (54 GB) copied, 76.4036 seconds, 703 MB/s > > > > > > > > > > I tested different Versions of Linux (Centos 5.2, OpenSUSE 11, > Debian > > > > > Lenny) and Vanilla kernels 2.6.22-2.6.27, all show this behaviour. > > > > > > > > > > Idea why the device slows down after IO- or better: how to keep the > high > > > > > rate? Is this reproducible foer Areca SATA Controllers (Type 11XX > and > > > > 12XX) > > > > > > > > > > Regards, > > > > > Michael! > > > > > > > > -- > > > > To unsubscribe from this list: send the line "unsubscribe > linux-kernel" in > > > > the body of a message to majordomo@vger.kernel.org > > > > More majordomo info at http://vger.kernel.org/majordomo-info.html > > > > Please read the FAQ at http://www.tux.org/lkml/ > > > > > > -- > > To unsubscribe from this list: send the line "unsubscribe linux-kernel" in > > the body of a message to majordomo@vger.kernel.org > > More majordomo info at http://vger.kernel.org/majordomo-info.html > > Please read the FAQ at http://www.tux.org/lkml/ > > -- > To unsubscribe from this list: send the line "unsubscribe linux-kernel" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html > Please read the FAQ at http://www.tux.org/lkml/ -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 12+ messages in thread
* Re: Performance issues with Areca 1680 SAS Controllers 2009-08-20 12:16 ` Pasi Kärkkäinen 2009-08-20 12:18 ` Nick Cheng @ 2009-08-20 12:19 ` Pasi Kärkkäinen 1 sibling, 0 replies; 12+ messages in thread From: Pasi Kärkkäinen @ 2009-08-20 12:19 UTC (permalink / raw) To: Nick Cheng Cc: 'Andrew Morton', 'Michael Fuckner', linux-kernel, linux-scsi On Thu, Aug 20, 2009 at 03:16:02PM +0300, Pasi Kärkkäinen wrote: > On Thu, Aug 20, 2009 at 12:56:04PM +0300, Pasi Kärkkäinen wrote: > > On Thu, Aug 20, 2009 at 09:54:27AM +0800, Nick Cheng wrote: > > > Hi Gentlemen, > > > We have worked it out with new firmware and driver. > > > You can download the latest F/W from > > > ftp://ftp.areca.com.tw/RaidCards/BIOS_Firmware/ARC1680/ and use the attached > > > driver. > > > Please have a try. > > > Any comments are welcome. > > > > Thanks! I'll give it a try today and report back. > > > > v1.47 firmware seems to fix this problem! The system behaves _much_ better > now even when Areca is busy flushing it's cache! > > I didn't update the driver, only Areca firmware. > > Is there something imported fixed in the latest driver? I'm using the ^^^^^^^^ .. That should have been important :) -- Pasi > default driver included in RHEL/CentOS 5.3. > > # modinfo arcmsr.ko > filename: arcmsr.ko > version: Driver Version 1.20.00.15.RH1 2008/02/27 > > -- Pasi > > > > > > Thank you, > > > -----Original Message----- > > > From: Pasi Kärkkäinen [mailto:pasik@iki.fi] > > > Sent: Wednesday, August 19, 2009 10:09 PM > > > To: Nick Cheng > > > Cc: 'Andrew Morton'; 'Michael Fuckner'; linux-kernel@vger.kernel.org; > > > linux-scsi@vger.kernel.org; 'Erich Chen' > > > Subject: Re: Performance issues with Areca 1680 SAS Controllers > > > > > > On Thu, Nov 20, 2008 at 03:39:40PM +0800, Nick Cheng wrote: > > > > Hi Michael, > > > > I will get around handling your issue. > > > > Thanks for your kindly patience, > > > > > > > > > > Hello, > > > > > > Was this issue resolved? I'm seeing similar behaviour.. I think it's related > > > to flushing the controller cache? > > > > > > Waiting a while (after the disk leds stop blinking) performance is back to > > > normal.. > > > > > > -- Pasi > > > > > > > -----Original Message----- > > > > From: Andrew Morton [mailto:akpm@linux-foundation.org] > > > > Sent: Thursday, November 20, 2008 9:18 AM > > > > To: Michael Fuckner > > > > Cc: linux-kernel@vger.kernel.org; linux-scsi@vger.kernel.org; Nick Cheng; > > > > Erich Chen > > > > Subject: Re: Performance issues with Areca 1680 SAS Controllers > > > > > > > > (cc's added) > > > > > > > > On Wed, 19 Nov 2008 13:16:56 +0100 > > > > Michael Fuckner <michael@fuckner.net> wrote: > > > > > > > > > Hi, > > > > > > > > > > I am using an Areca 1680-SAS-Controller with 16 SAS-HDD (Seagate 1TB > > > > > ST31000640SS). I set up a Raid6 with all 16 disks and formatted it with > > > > > XFS. The Controller has 512MB RAM and a BBU. The OS is installed to > > > > > another disk attached to the onboard AHCI controller. > > > > > > > > > > After doing some IO, the areca raidset is slower compared to the rate > > > > > directly > > > > > after boot. > > > > > > > > > > > > > > > [root@storage ~]# dd if=/dev/sdb1 of=/dev/null bs=1M count=50k > > > > iflag=direct > > > > > 51200+0 records in > > > > > 51200+0 records out > > > > > 53687091200 bytes (54 GB) copied, 59.6494 seconds, 900 MB/s > > > > > [root@storage ~]# mount /dev/sdb1 /data > > > > > [root@storage ~]# cd /data/ > > > > > [root@storage data]# ./iozone -i 0 -i 1 -s 32g -r 16m -S 6144 -t 8 -+r > > > > > -o >raid6_sync_t8.log > > > > > [root@storage data]# cd > > > > > [root@storage ~]# umount /data/ > > > > > [root@storage ~]# dd if=/dev/sdb1 of=/dev/null bs=1M count=50k > > > > iflag=direct > > > > > 51200+0 records in > > > > > 51200+0 records out > > > > > 53687091200 bytes (54 GB) copied, 76.4036 seconds, 703 MB/s > > > > > > > > > > I tested different Versions of Linux (Centos 5.2, OpenSUSE 11, Debian > > > > > Lenny) and Vanilla kernels 2.6.22-2.6.27, all show this behaviour. > > > > > > > > > > Idea why the device slows down after IO- or better: how to keep the high > > > > > rate? Is this reproducible foer Areca SATA Controllers (Type 11XX and > > > > 12XX) > > > > > > > > > > Regards, > > > > > Michael! > > > > > > > > -- > > > > To unsubscribe from this list: send the line "unsubscribe linux-kernel" in > > > > the body of a message to majordomo@vger.kernel.org > > > > More majordomo info at http://vger.kernel.org/majordomo-info.html > > > > Please read the FAQ at http://www.tux.org/lkml/ > > > > > > -- > > To unsubscribe from this list: send the line "unsubscribe linux-kernel" in > > the body of a message to majordomo@vger.kernel.org > > More majordomo info at http://vger.kernel.org/majordomo-info.html > > Please read the FAQ at http://www.tux.org/lkml/ > -- > To unsubscribe from this list: send the line "unsubscribe linux-kernel" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html > Please read the FAQ at http://www.tux.org/lkml/ -- To unsubscribe from this list: send the line "unsubscribe linux-scsi" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 12+ messages in thread
end of thread, other threads:[~2009-08-20 12:20 UTC | newest]
Thread overview: 12+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
[not found] <492403B8.5090007@fuckner.net>
2008-11-20 1:18 ` Performance issues with Areca 1680 SAS Controllers Andrew Morton
2008-11-20 7:39 ` Nick Cheng
2009-08-19 14:08 ` Pasi Kärkkäinen
[not found] ` <200908192247543597389@usish.com>
2009-08-19 16:40 ` Pasi Kärkkäinen
2009-08-20 0:56 ` 答复: " jack wang
2009-08-20 2:29 ` Drew
2009-08-20 8:00 ` Pasi Kärkkäinen
[not found] ` <SERVER-ARECA8ldpyzy000025bc@areca.com.tw>
2009-08-20 9:56 ` Pasi Kärkkäinen
2009-08-20 12:16 ` Pasi Kärkkäinen
2009-08-20 12:18 ` Nick Cheng
2009-08-20 12:20 ` Pasi Kärkkäinen
2009-08-20 12:19 ` Pasi Kärkkäinen
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox