* caviar black + mpt2sas horrific performance
@ 2011-03-30 8:01 Louis-David Mitterrand
[not found] ` <4565AEA676113A449269C2F3A549520F8086471A@cosmail03.lsi.com>
0 siblings, 1 reply; 8+ messages in thread
From: Louis-David Mitterrand @ 2011-03-30 8:01 UTC (permalink / raw)
To: linux-scsi
Hi,
I am seeing horrific performance on a Dell T610 with a LSISAS2008 (Dell
H200) card and 8 WD1002FAEX Caviar Black 1TB configured in mdadm raid6.
The LSI card is upgraded to the latest 9.00 firmware:
http://www.lsi.com/storage_home/products_home/host_bus_adapters/sas_hbas/internal/sas9211-8i/index.html
and the 2.6.38.2 kernel uses the newer mpt2sas driver.
On the T610 this command takes 20 minutes:
tar -I pbzip2 -xvf linux-2.6.37.tar.bz2 22.64s user 3.34s system 2% cpu 20:00.69 total
where on a lower spec'ed Poweredge 2900 III server (LSI Logic MegaRAID
SAS 1078 + 8 x Hitachi Ultrastar 7K1000 in mdadm raid6) it takes 22
_seconds_:
tar -I pbzip2 -xvf linux-2.6.37.tar.bz2 16.40s user 3.22s system 86% cpu 22.773 total
Besides hardware, the other difference between servers is that the
PE2900's MegaRAID has no JBOD mode so each disk must be configured as a
"raid0" vdisk unit. On the T610 no configuration was necessary for the
disks to "appear" in the OS. Would configuring them as raid0 vdisks
change anything?
Thanks in advance for any suggestion,
^ permalink raw reply [flat|nested] 8+ messages in thread[parent not found: <4565AEA676113A449269C2F3A549520F8086471A@cosmail03.lsi.com>]
* Re: caviar black + mpt2sas horrific performance [not found] ` <4565AEA676113A449269C2F3A549520F8086471A@cosmail03.lsi.com> @ 2011-03-30 20:17 ` Louis-David Mitterrand 2011-03-31 15:07 ` Moore, Eric 0 siblings, 1 reply; 8+ messages in thread From: Louis-David Mitterrand @ 2011-03-30 20:17 UTC (permalink / raw) To: Moore, Eric; +Cc: Desai, Kashyap, Prakash, Sathya, linux-scsi On Wed, Mar 30, 2011 at 02:02:12PM -0600, Moore, Eric wrote: > Hi Louis, can you send me your /var/log/messages and dmesg output? > Please capture after you've run your test. Hi, My test produces no specific output through dmesg or /var/log/messages as there is no apparent error from the controller. However I can send you the syslog startup output. Let me know if I can run any further tests or provide more information. Thanks, Mar 28 08:19:40 zenon kernel: mpt2sas 0000:02:00.0: PCI INT A -> GSI 41 (level, low) -> IRQ 41 Mar 28 08:19:40 zenon kernel: mpt2sas0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (16423628 kB) Mar 28 08:19:40 zenon kernel: mpt2sas0: IO-APIC enabled: IRQ 41 Mar 28 08:19:40 zenon kernel: mpt2sas0: iomem(0x00000000df2b0000), mapped(0xffffc90000040000), size(65536) Mar 28 08:19:40 zenon kernel: mpt2sas0: ioport(0x000000000000fc00), size(256) Mar 28 08:19:40 zenon kernel: mpt2sas0: sending diag reset !! Mar 28 08:19:40 zenon kernel: mpt2sas0: diag reset: SUCCESS Mar 28 08:19:40 zenon kernel: mpt2sas0: Allocated physical memory: size(3971 kB) Mar 28 08:19:40 zenon kernel: mpt2sas0: Current Controller Queue Depth(1739), Max Controller Queue Depth(2000) Mar 28 08:19:40 zenon kernel: mpt2sas0: Scatter Gather Elements per IO(128) Mar 28 08:19:40 zenon kernel: mpt2sas0: LSISAS2008: FWVersion(09.00.00.00), ChipRevision(0x02), BiosVersion(07.17.00.00) Mar 28 08:19:40 zenon kernel: mpt2sas0: Dell PERC H200 Integrated: Vendor(0x1000), Device(0x0072), SSVID(0x1028), SSDID(0x1F1E) Mar 28 08:19:40 zenon kernel: mpt2sas0: Protocol=(Initiator,Target), Capabilities=(Raid,TLR,EEDP,Snapshot Buffer,Diag Trace Buffer,Task Set Full,NCQ) Mar 28 08:19:40 zenon kernel: mpt2sas0: sending port enable !! Mar 28 08:19:40 zenon kernel: mpt2sas0: host_add: handle(0x0001), sas_addr(0x5842b2b05020c600), phys(8) Mar 28 08:19:40 zenon kernel: mpt2sas0: port enable: SUCCESS Mar 28 08:19:40 zenon kernel: scsi 0:0:0:0: Direct-Access ATA WDC WD1002FAEX-0 1D05 PQ: 0 ANSI: 5 Mar 28 08:19:40 zenon kernel: scsi 0:0:0:0: SATA: handle(0x0009), sas_addr(0x4433221103000000), phy(3), device_name(0x4ee25001f42e5a40) Mar 28 08:19:40 zenon kernel: scsi 0:0:0:0: SATA: enclosure_logical_id(0x5842b2b05020c600), slot(0) Mar 28 08:19:40 zenon kernel: scsi 0:0:0:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y) Mar 28 08:19:40 zenon kernel: scsi 0:0:0:0: qdepth(32), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Mar 28 08:19:40 zenon kernel: scsi 0:0:1:0: Direct-Access ATA WDC WD1002FAEX-0 1D05 PQ: 0 ANSI: 5 Mar 28 08:19:40 zenon kernel: scsi 0:0:1:0: SATA: handle(0x000a), sas_addr(0x4433221102000000), phy(2), device_name(0x4ee25001be5f04eb) Mar 28 08:19:40 zenon kernel: scsi 0:0:1:0: SATA: enclosure_logical_id(0x5842b2b05020c600), slot(1) Mar 28 08:19:40 zenon kernel: scsi 0:0:1:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y) Mar 28 08:19:40 zenon kernel: scsi 0:0:1:0: qdepth(32), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Mar 28 08:19:40 zenon kernel: scsi 0:0:2:0: Direct-Access ATA WDC WD1002FAEX-0 1D05 PQ: 0 ANSI: 5 Mar 28 08:19:40 zenon kernel: scsi 0:0:2:0: SATA: handle(0x000b), sas_addr(0x4433221101000000), phy(1), device_name(0x4ee250019791af96) Mar 28 08:19:40 zenon kernel: scsi 0:0:2:0: SATA: enclosure_logical_id(0x5842b2b05020c600), slot(2) Mar 28 08:19:40 zenon kernel: scsi 0:0:2:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y) Mar 28 08:19:40 zenon kernel: scsi 0:0:2:0: qdepth(32), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Mar 28 08:19:40 zenon kernel: scsi 0:0:3:0: Direct-Access ATA WDC WD1002FAEX-0 1D05 PQ: 0 ANSI: 5 Mar 28 08:19:40 zenon kernel: scsi 0:0:3:0: SATA: handle(0x000c), sas_addr(0x4433221100000000), phy(0), device_name(0x4ee25001beeb04eb) Mar 28 08:19:40 zenon kernel: scsi 0:0:3:0: SATA: enclosure_logical_id(0x5842b2b05020c600), slot(3) Mar 28 08:19:40 zenon kernel: scsi 0:0:3:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y) Mar 28 08:19:40 zenon kernel: scsi 0:0:3:0: qdepth(32), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Mar 28 08:19:40 zenon kernel: scsi 0:0:4:0: Direct-Access ATA WDC WD1002FAEX-0 1D05 PQ: 0 ANSI: 5 Mar 28 08:19:40 zenon kernel: scsi 0:0:4:0: SATA: handle(0x000d), sas_addr(0x4433221104000000), phy(4), device_name(0x4ee25001d9b104eb) Mar 28 08:19:40 zenon kernel: scsi 0:0:4:0: SATA: enclosure_logical_id(0x5842b2b05020c600), slot(7) Mar 28 08:19:40 zenon kernel: scsi 0:0:4:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y) Mar 28 08:19:40 zenon kernel: scsi 0:0:4:0: qdepth(32), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Mar 28 08:19:40 zenon kernel: scsi 0:0:5:0: Direct-Access ATA WDC WD1002FAEX-0 1D05 PQ: 0 ANSI: 5 Mar 28 08:19:40 zenon kernel: scsi 0:0:5:0: SATA: handle(0x000e), sas_addr(0x4433221107000000), phy(7), device_name(0x4ee25001c38204eb) Mar 28 08:19:40 zenon kernel: scsi 0:0:5:0: SATA: enclosure_logical_id(0x5842b2b05020c600), slot(4) Mar 28 08:19:40 zenon kernel: scsi 0:0:5:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y) Mar 28 08:19:40 zenon kernel: scsi 0:0:5:0: qdepth(32), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Mar 28 08:19:40 zenon kernel: scsi 0:0:6:0: Direct-Access ATA WDC WD1002FAEX-0 1D05 PQ: 0 ANSI: 5 Mar 28 08:19:40 zenon kernel: scsi 0:0:6:0: SATA: handle(0x000f), sas_addr(0x4433221106000000), phy(6), device_name(0x4ee250019a1baf96) Mar 28 08:19:40 zenon kernel: scsi 0:0:6:0: SATA: enclosure_logical_id(0x5842b2b05020c600), slot(5) Mar 28 08:19:40 zenon kernel: scsi 0:0:6:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y) Mar 28 08:19:40 zenon kernel: scsi 0:0:6:0: qdepth(32), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Mar 28 08:19:40 zenon kernel: scsi 0:0:7:0: Direct-Access ATA WDC WD1002FAEX-0 1D05 PQ: 0 ANSI: 5 Mar 28 08:19:40 zenon kernel: scsi 0:0:7:0: SATA: handle(0x0010), sas_addr(0x4433221105000000), phy(5), device_name(0x4ee2500136d4af96) Mar 28 08:19:40 zenon kernel: scsi 0:0:7:0: SATA: enclosure_logical_id(0x5842b2b05020c600), slot(6) Mar 28 08:19:40 zenon kernel: scsi 0:0:7:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y) Mar 28 08:19:40 zenon kernel: scsi 0:0:7:0: qdepth(32), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) Mar 28 08:19:40 zenon kernel: sd 0:0:0:0: Attached scsi generic sg0 type 0 Mar 28 08:19:40 zenon kernel: sd 0:0:1:0: Attached scsi generic sg1 type 0 Mar 28 08:19:40 zenon kernel: sd 0:0:2:0: Attached scsi generic sg2 type 0 Mar 28 08:19:40 zenon kernel: sd 0:0:3:0: Attached scsi generic sg3 type 0 Mar 28 08:19:40 zenon kernel: sd 0:0:4:0: Attached scsi generic sg4 type 0 Mar 28 08:19:40 zenon kernel: sd 0:0:5:0: Attached scsi generic sg5 type 0 Mar 28 08:19:40 zenon kernel: sd 0:0:6:0: Attached scsi generic sg6 type 0 Mar 28 08:19:40 zenon kernel: sd 0:0:7:0: Attached scsi generic sg7 type 0 Mar 28 08:19:40 zenon kernel: ata_piix 0000:00:1f.2: PCI INT C -> GSI 23 (level, low) -> IRQ 23 Mar 28 08:19:40 zenon kernel: ata_piix 0000:00:1f.2: MAP [ P0 -- P1 -- ] Mar 28 08:19:40 zenon kernel: sd 0:0:6:0: [sdg] 1953525168 512-byte logical blocks: (1.00 TB/931 GiB) Mar 28 08:19:40 zenon kernel: sd 0:0:5:0: [sdf] 1953525168 512-byte logical blocks: (1.00 TB/931 GiB) Mar 28 08:19:40 zenon kernel: sd 0:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/931 GiB) Mar 28 08:19:40 zenon kernel: sd 0:0:2:0: [sdc] 1953525168 512-byte logical blocks: (1.00 TB/931 GiB) Mar 28 08:19:40 zenon kernel: sd 0:0:1:0: [sdb] 1953525168 512-byte logical blocks: (1.00 TB/931 GiB) Mar 28 08:19:40 zenon kernel: sd 0:0:3:0: [sdd] 1953525168 512-byte logical blocks: (1.00 TB/931 GiB) Mar 28 08:19:40 zenon kernel: sd 0:0:4:0: [sde] 1953525168 512-byte logical blocks: (1.00 TB/931 GiB) Mar 28 08:19:40 zenon kernel: sd 0:0:7:0: [sdh] 1953525168 512-byte logical blocks: (1.00 TB/931 GiB) Mar 28 08:19:40 zenon kernel: sd 0:0:6:0: [sdg] Write Protect is off Mar 28 08:19:40 zenon kernel: sd 0:0:5:0: [sdf] Write Protect is off Mar 28 08:19:40 zenon kernel: sd 0:0:0:0: [sda] Write Protect is off Mar 28 08:19:40 zenon kernel: sd 0:0:2:0: [sdc] Write Protect is off Mar 28 08:19:40 zenon kernel: sd 0:0:6:0: [sdg] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA Mar 28 08:19:40 zenon kernel: sd 0:0:5:0: [sdf] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA Mar 28 08:19:40 zenon kernel: sd 0:0:4:0: [sde] Write Protect is off Mar 28 08:19:40 zenon kernel: sd 0:0:3:0: [sdd] Write Protect is off Mar 28 08:19:40 zenon kernel: sd 0:0:1:0: [sdb] Write Protect is off Mar 28 08:19:40 zenon kernel: sd 0:0:7:0: [sdh] Write Protect is off Mar 28 08:19:40 zenon kernel: sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA Mar 28 08:19:40 zenon kernel: sd 0:0:2:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA Mar 28 08:19:40 zenon kernel: sd 0:0:3:0: [sdd] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA Mar 28 08:19:40 zenon kernel: sd 0:0:1:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA Mar 28 08:19:40 zenon kernel: sd 0:0:7:0: [sdh] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA Mar 28 08:19:40 zenon kernel: sd 0:0:4:0: [sde] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA Mar 28 08:19:40 zenon kernel: sdg: sdg1 sdg2 sdg3 Mar 28 08:19:40 zenon kernel: sdf: sdf1 sdf2 sdf3 Mar 28 08:19:40 zenon kernel: sdc: sdc1 sdc2 sdc3 Mar 28 08:19:40 zenon kernel: sde: sde1 sde2 sde3 Mar 28 08:19:40 zenon kernel: sda: sda1 sda2 sda3 Mar 28 08:19:40 zenon kernel: sdb: sdb1 sdb2 sdb3 Mar 28 08:19:40 zenon kernel: sdd: sdd1 sdd2 sdd3 Mar 28 08:19:40 zenon kernel: sdh: sdh1 sdh2 sdh3 > Eric Moore > > > -----Original Message----- > > From: linux-scsi-owner@vger.kernel.org [mailto:linux-scsi- > > owner@vger.kernel.org] On Behalf Of Louis-David Mitterrand > > Sent: Wednesday, March 30, 2011 2:01 AM > > To: linux-scsi@vger.kernel.org > > Subject: caviar black + mpt2sas horrific performance > > > > Hi, > > > > I am seeing horrific performance on a Dell T610 with a LSISAS2008 (Dell > > H200) card and 8 WD1002FAEX Caviar Black 1TB configured in mdadm raid6. > > > > The LSI card is upgraded to the latest 9.00 firmware: > > http://www.lsi.com/storage_home/products_home/host_bus_adapters/sas_hbas/in > > ternal/sas9211-8i/index.html > > and the 2.6.38.2 kernel uses the newer mpt2sas driver. > > > > On the T610 this command takes 20 minutes: > > > > tar -I pbzip2 -xvf linux-2.6.37.tar.bz2 22.64s user 3.34s system 2% > > cpu 20:00.69 total > > > > where on a lower spec'ed Poweredge 2900 III server (LSI Logic MegaRAID > > SAS 1078 + 8 x Hitachi Ultrastar 7K1000 in mdadm raid6) it takes 22 > > _seconds_: > > > > tar -I pbzip2 -xvf linux-2.6.37.tar.bz2 16.40s user 3.22s system 86% > > cpu 22.773 total > > > > Besides hardware, the other difference between servers is that the > > PE2900's MegaRAID has no JBOD mode so each disk must be configured as a > > "raid0" vdisk unit. On the T610 no configuration was necessary for the > > disks to "appear" in the OS. Would configuring them as raid0 vdisks > > change anything? > > > > Thanks in advance for any suggestion, > > -- > > To unsubscribe from this list: send the line "unsubscribe linux-scsi" in > > the body of a message to majordomo@vger.kernel.org > > More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 8+ messages in thread
* RE: caviar black + mpt2sas horrific performance 2011-03-30 20:17 ` Louis-David Mitterrand @ 2011-03-31 15:07 ` Moore, Eric 2011-03-31 15:34 ` Louis-David Mitterrand 0 siblings, 1 reply; 8+ messages in thread From: Moore, Eric @ 2011-03-31 15:07 UTC (permalink / raw) To: Louis-David Mitterrand Cc: Desai, Kashyap, Prakash, Sathya, linux-scsi@vger.kernel.org On Wednesday, March 30, 2011 2:17 PM, Louis-David Mitterrand wrote: > On Wed, Mar 30, 2011 at 02:02:12PM -0600, Moore, Eric wrote: > > Hi Louis, can you send me your /var/log/messages and dmesg output? > > Please capture after you've run your test. > > Hi, > > My test produces no specific output through dmesg or /var/log/messages > as there is no apparent error from the controller. > > However I can send you the syslog startup output. Let me know if I can > run any further tests or provide more information. > need you to set the mpt2sas logging level to 0x310 just before you run you test, then capture the logs after. Please make sure your syslog level is set to capture all KERN_XXX levels to include KERN_DEBUG. Example: # echo 0x310 > /sys/module/mpt2sas/parameters/logging_level ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: caviar black + mpt2sas horrific performance 2011-03-31 15:07 ` Moore, Eric @ 2011-03-31 15:34 ` Louis-David Mitterrand 2011-04-02 4:51 ` Moore, Eric 0 siblings, 1 reply; 8+ messages in thread From: Louis-David Mitterrand @ 2011-03-31 15:34 UTC (permalink / raw) To: Moore, Eric; +Cc: Desai, Kashyap, Prakash, Sathya, linux-scsi@vger.kernel.org On Thu, Mar 31, 2011 at 09:07:05AM -0600, Moore, Eric wrote: > On Wednesday, March 30, 2011 2:17 PM, Louis-David Mitterrand wrote: > > On Wed, Mar 30, 2011 at 02:02:12PM -0600, Moore, Eric wrote: > > > Hi Louis, can you send me your /var/log/messages and dmesg output? > > > Please capture after you've run your test. > > > > Hi, > > > > My test produces no specific output through dmesg or /var/log/messages > > as there is no apparent error from the controller. > > > > However I can send you the syslog startup output. Let me know if I can > > run any further tests or provide more information. > > > > need you to set the mpt2sas logging level to 0x310 just before you run you test, then capture the logs after. > Please make sure your syslog level is set to capture all KERN_XXX levels to include KERN_DEBUG. > > Example: > # echo 0x310 > /sys/module/mpt2sas/parameters/logging_level Hi, Here is the output: Mar 31 17:07:50 zenon kernel: setting logging_level(0x00000310) Mar 31 17:24:29 zenon kernel: sd 0:0:0:0: [sda] CDB: ATA command pass through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 Mar 31 17:24:29 zenon kernel: mpt2sas0: sas_address(0x4433221103000000), phy(3) Mar 31 17:24:29 zenon kernel: mpt2sas0: enclosure_logical_id(0x5842b2b05020c600), slot(0) Mar 31 17:24:29 zenon kernel: mpt2sas0: handle(0x0009), ioc_status(success)(0x0000), smid(1344) Mar 31 17:24:29 zenon kernel: mpt2sas0: request_len(0), underflow(0), resid(0) Mar 31 17:24:29 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc->result(0x00000002) Mar 31 17:24:29 zenon kernel: mpt2sas0: scsi_status(check condition)(0x02), scsi_state(autosense valid )(0x01) Mar 31 17:24:29 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: [0x01,0x00,0x1d], count(22) Mar 31 17:24:29 zenon kernel: sd 0:0:0:0: [sda] CDB: ATA command pass through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 Mar 31 17:24:29 zenon kernel: mpt2sas0: sas_address(0x4433221103000000), phy(3) Mar 31 17:24:29 zenon kernel: mpt2sas0: enclosure_logical_id(0x5842b2b05020c600), slot(0) Mar 31 17:24:29 zenon kernel: mpt2sas0: handle(0x0009), ioc_status(success)(0x0000), smid(884) Mar 31 17:24:29 zenon kernel: mpt2sas0: request_len(0), underflow(0), resid(0) Mar 31 17:24:29 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc->result(0x00000002) Mar 31 17:24:29 zenon kernel: mpt2sas0: scsi_status(check condition)(0x02), scsi_state(autosense valid )(0x01) Mar 31 17:24:29 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: [0x01,0x00,0x1d], count(22) Mar 31 17:24:30 zenon kernel: sd 0:0:1:0: [sdb] CDB: ATA command pass through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 Mar 31 17:24:30 zenon kernel: mpt2sas0: sas_address(0x4433221102000000), phy(2) Mar 31 17:24:30 zenon kernel: mpt2sas0: enclosure_logical_id(0x5842b2b05020c600), slot(1) Mar 31 17:24:30 zenon kernel: mpt2sas0: handle(0x000a), ioc_status(success)(0x0000), smid(100) Mar 31 17:24:30 zenon kernel: mpt2sas0: request_len(0), underflow(0), resid(0) Mar 31 17:24:30 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc->result(0x00000002) Mar 31 17:24:30 zenon kernel: mpt2sas0: scsi_status(check condition)(0x02), scsi_state(autosense valid )(0x01) Mar 31 17:24:30 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: [0x01,0x00,0x1d], count(22) Mar 31 17:24:30 zenon kernel: sd 0:0:1:0: [sdb] CDB: ATA command pass through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 Mar 31 17:24:30 zenon kernel: mpt2sas0: sas_address(0x4433221102000000), phy(2) Mar 31 17:24:30 zenon kernel: mpt2sas0: enclosure_logical_id(0x5842b2b05020c600), slot(1) Mar 31 17:24:30 zenon kernel: mpt2sas0: handle(0x000a), ioc_status(success)(0x0000), smid(510) Mar 31 17:24:30 zenon kernel: mpt2sas0: request_len(0), underflow(0), resid(0) Mar 31 17:24:30 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc->result(0x00000002) Mar 31 17:24:30 zenon kernel: mpt2sas0: scsi_status(check condition)(0x02), scsi_state(autosense valid )(0x01) Mar 31 17:24:30 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: [0x01,0x00,0x1d], count(22) Mar 31 17:24:30 zenon kernel: sd 0:0:2:0: [sdc] CDB: ATA command pass through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 Mar 31 17:24:30 zenon kernel: mpt2sas0: sas_address(0x4433221101000000), phy(1) Mar 31 17:24:30 zenon kernel: mpt2sas0: enclosure_logical_id(0x5842b2b05020c600), slot(2) Mar 31 17:24:30 zenon kernel: mpt2sas0: handle(0x000b), ioc_status(success)(0x0000), smid(1455) Mar 31 17:24:30 zenon kernel: mpt2sas0: request_len(0), underflow(0), resid(0) Mar 31 17:24:30 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc->result(0x00000002) Mar 31 17:24:30 zenon kernel: mpt2sas0: scsi_status(check condition)(0x02), scsi_state(autosense valid )(0x01) Mar 31 17:24:30 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: [0x01,0x00,0x1d], count(22) Mar 31 17:24:31 zenon kernel: sd 0:0:2:0: [sdc] CDB: ATA command pass through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 Mar 31 17:24:31 zenon kernel: mpt2sas0: sas_address(0x4433221101000000), phy(1) Mar 31 17:24:31 zenon kernel: mpt2sas0: enclosure_logical_id(0x5842b2b05020c600), slot(2) Mar 31 17:24:31 zenon kernel: mpt2sas0: handle(0x000b), ioc_status(success)(0x0000), smid(966) Mar 31 17:24:31 zenon kernel: mpt2sas0: request_len(0), underflow(0), resid(0) Mar 31 17:24:31 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc->result(0x00000002) Mar 31 17:24:31 zenon kernel: mpt2sas0: scsi_status(check condition)(0x02), scsi_state(autosense valid )(0x01) Mar 31 17:24:31 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: [0x01,0x00,0x1d], count(22) Mar 31 17:24:31 zenon kernel: sd 0:0:3:0: [sdd] CDB: ATA command pass through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 Mar 31 17:24:31 zenon kernel: mpt2sas0: sas_address(0x4433221100000000), phy(0) Mar 31 17:24:31 zenon kernel: mpt2sas0: enclosure_logical_id(0x5842b2b05020c600), slot(3) Mar 31 17:24:31 zenon kernel: mpt2sas0: handle(0x000c), ioc_status(success)(0x0000), smid(519) Mar 31 17:24:31 zenon kernel: mpt2sas0: request_len(0), underflow(0), resid(0) Mar 31 17:24:31 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc->result(0x00000002) Mar 31 17:24:31 zenon kernel: mpt2sas0: scsi_status(check condition)(0x02), scsi_state(autosense valid )(0x01) Mar 31 17:24:31 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: [0x01,0x00,0x1d], count(22) Mar 31 17:24:32 zenon kernel: sd 0:0:3:0: [sdd] CDB: ATA command pass through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 Mar 31 17:24:32 zenon kernel: mpt2sas0: sas_address(0x4433221100000000), phy(0) Mar 31 17:24:32 zenon kernel: mpt2sas0: enclosure_logical_id(0x5842b2b05020c600), slot(3) Mar 31 17:24:32 zenon kernel: mpt2sas0: handle(0x000c), ioc_status(success)(0x0000), smid(1125) Mar 31 17:24:32 zenon kernel: mpt2sas0: request_len(0), underflow(0), resid(0) Mar 31 17:24:32 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc->result(0x00000002) Mar 31 17:24:32 zenon kernel: mpt2sas0: scsi_status(check condition)(0x02), scsi_state(autosense valid )(0x01) Mar 31 17:24:32 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: [0x01,0x00,0x1d], count(22) Mar 31 17:24:32 zenon kernel: sd 0:0:4:0: [sde] CDB: ATA command pass through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 Mar 31 17:24:32 zenon kernel: mpt2sas0: sas_address(0x4433221104000000), phy(4) Mar 31 17:24:32 zenon kernel: mpt2sas0: enclosure_logical_id(0x5842b2b05020c600), slot(7) Mar 31 17:24:32 zenon kernel: mpt2sas0: handle(0x000d), ioc_status(success)(0x0000), smid(570) Mar 31 17:24:32 zenon kernel: mpt2sas0: request_len(0), underflow(0), resid(0) Mar 31 17:24:32 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc->result(0x00000002) Mar 31 17:24:32 zenon kernel: mpt2sas0: scsi_status(check condition)(0x02), scsi_state(autosense valid )(0x01) Mar 31 17:24:32 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: [0x01,0x00,0x1d], count(22) Mar 31 17:24:32 zenon kernel: sd 0:0:4:0: [sde] CDB: ATA command pass through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 Mar 31 17:24:32 zenon kernel: mpt2sas0: sas_address(0x4433221104000000), phy(4) Mar 31 17:24:32 zenon kernel: mpt2sas0: enclosure_logical_id(0x5842b2b05020c600), slot(7) Mar 31 17:24:32 zenon kernel: mpt2sas0: handle(0x000d), ioc_status(success)(0x0000), smid(28) Mar 31 17:24:32 zenon kernel: mpt2sas0: request_len(0), underflow(0), resid(0) Mar 31 17:24:32 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc->result(0x00000002) Mar 31 17:24:32 zenon kernel: mpt2sas0: scsi_status(check condition)(0x02), scsi_state(autosense valid )(0x01) Mar 31 17:24:32 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: [0x01,0x00,0x1d], count(22) Mar 31 17:24:33 zenon kernel: sd 0:0:5:0: [sdf] CDB: ATA command pass through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 Mar 31 17:24:33 zenon kernel: mpt2sas0: sas_address(0x4433221107000000), phy(7) Mar 31 17:24:33 zenon kernel: mpt2sas0: enclosure_logical_id(0x5842b2b05020c600), slot(4) Mar 31 17:24:33 zenon kernel: mpt2sas0: handle(0x000e), ioc_status(success)(0x0000), smid(471) Mar 31 17:24:33 zenon kernel: mpt2sas0: request_len(0), underflow(0), resid(0) Mar 31 17:24:33 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc->result(0x00000002) Mar 31 17:24:33 zenon kernel: mpt2sas0: scsi_status(check condition)(0x02), scsi_state(autosense valid )(0x01) Mar 31 17:24:33 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: [0x01,0x00,0x1d], count(22) Mar 31 17:24:33 zenon kernel: sd 0:0:5:0: [sdf] CDB: ATA command pass through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 Mar 31 17:24:33 zenon kernel: mpt2sas0: sas_address(0x4433221107000000), phy(7) Mar 31 17:24:33 zenon kernel: mpt2sas0: enclosure_logical_id(0x5842b2b05020c600), slot(4) Mar 31 17:24:33 zenon kernel: mpt2sas0: handle(0x000e), ioc_status(success)(0x0000), smid(789) Mar 31 17:24:33 zenon kernel: mpt2sas0: request_len(0), underflow(0), resid(0) Mar 31 17:24:33 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc->result(0x00000002) Mar 31 17:24:33 zenon kernel: mpt2sas0: scsi_status(check condition)(0x02), scsi_state(autosense valid )(0x01) Mar 31 17:24:33 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: [0x01,0x00,0x1d], count(22) Mar 31 17:24:34 zenon kernel: sd 0:0:6:0: [sdg] CDB: ATA command pass through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 Mar 31 17:24:34 zenon kernel: mpt2sas0: sas_address(0x4433221106000000), phy(6) Mar 31 17:24:34 zenon kernel: mpt2sas0: enclosure_logical_id(0x5842b2b05020c600), slot(5) Mar 31 17:24:34 zenon kernel: mpt2sas0: handle(0x000f), ioc_status(success)(0x0000), smid(594) Mar 31 17:24:34 zenon kernel: mpt2sas0: request_len(0), underflow(0), resid(0) Mar 31 17:24:34 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc->result(0x00000002) Mar 31 17:24:34 zenon kernel: mpt2sas0: scsi_status(check condition)(0x02), scsi_state(autosense valid )(0x01) Mar 31 17:24:34 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: [0x01,0x00,0x1d], count(22) Mar 31 17:24:34 zenon kernel: sd 0:0:6:0: [sdg] CDB: ATA command pass through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 Mar 31 17:24:34 zenon kernel: mpt2sas0: sas_address(0x4433221106000000), phy(6) Mar 31 17:24:34 zenon kernel: mpt2sas0: enclosure_logical_id(0x5842b2b05020c600), slot(5) Mar 31 17:24:34 zenon kernel: mpt2sas0: handle(0x000f), ioc_status(success)(0x0000), smid(761) Mar 31 17:24:34 zenon kernel: mpt2sas0: request_len(0), underflow(0), resid(0) Mar 31 17:24:34 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc->result(0x00000002) Mar 31 17:24:34 zenon kernel: mpt2sas0: scsi_status(check condition)(0x02), scsi_state(autosense valid )(0x01) Mar 31 17:24:34 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: [0x01,0x00,0x1d], count(22) Mar 31 17:24:35 zenon kernel: sd 0:0:7:0: [sdh] CDB: ATA command pass through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 Mar 31 17:24:35 zenon kernel: mpt2sas0: sas_address(0x4433221105000000), phy(5) Mar 31 17:24:35 zenon kernel: mpt2sas0: enclosure_logical_id(0x5842b2b05020c600), slot(6) Mar 31 17:24:35 zenon kernel: mpt2sas0: handle(0x0010), ioc_status(success)(0x0000), smid(1127) Mar 31 17:24:35 zenon kernel: mpt2sas0: request_len(0), underflow(0), resid(0) Mar 31 17:24:35 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc->result(0x00000002) Mar 31 17:24:35 zenon kernel: mpt2sas0: scsi_status(check condition)(0x02), scsi_state(autosense valid )(0x01) Mar 31 17:24:35 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: [0x01,0x00,0x1d], count(22) Mar 31 17:24:35 zenon kernel: sd 0:0:7:0: [sdh] CDB: ATA command pass through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 Mar 31 17:24:35 zenon kernel: mpt2sas0: sas_address(0x4433221105000000), phy(5) Mar 31 17:24:35 zenon kernel: mpt2sas0: enclosure_logical_id(0x5842b2b05020c600), slot(6) Mar 31 17:24:35 zenon kernel: mpt2sas0: handle(0x0010), ioc_status(success)(0x0000), smid(1583) Mar 31 17:24:35 zenon kernel: mpt2sas0: request_len(0), underflow(0), resid(0) Mar 31 17:24:35 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc->result(0x00000002) Mar 31 17:24:35 zenon kernel: mpt2sas0: scsi_status(check condition)(0x02), scsi_state(autosense valid )(0x01) Mar 31 17:24:35 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: [0x01,0x00,0x1d], count(22) ^ permalink raw reply [flat|nested] 8+ messages in thread
* RE: caviar black + mpt2sas horrific performance 2011-03-31 15:34 ` Louis-David Mitterrand @ 2011-04-02 4:51 ` Moore, Eric 2011-04-03 17:35 ` Douglas Gilbert 0 siblings, 1 reply; 8+ messages in thread From: Moore, Eric @ 2011-04-02 4:51 UTC (permalink / raw) To: Louis-David Mitterrand Cc: Desai, Kashyap, Prakash, Sathya, linux-scsi@vger.kernel.org On Thursday, March 31, 2011 9:35 AM, Louis-David Mitterrand wrote: > On Thu, Mar 31, 2011 at 09:07:05AM -0600, Moore, Eric wrote: > > On Wednesday, March 30, 2011 2:17 PM, Louis-David Mitterrand wrote: > > > On Wed, Mar 30, 2011 at 02:02:12PM -0600, Moore, Eric wrote: > > > > Hi Louis, can you send me your /var/log/messages and dmesg output? > > > > Please capture after you've run your test. > > > > > > Hi, > > > > > > My test produces no specific output through dmesg or /var/log/messages > > > as there is no apparent error from the controller. > > > > > > However I can send you the syslog startup output. Let me know if I can > > > run any further tests or provide more information. > > > > > > > need you to set the mpt2sas logging level to 0x310 just before you run > you test, then capture the logs after. > > Please make sure your syslog level is set to capture all KERN_XXX levels > to include KERN_DEBUG. > > > > Example: > > # echo 0x310 > /sys/module/mpt2sas/parameters/logging_level > > Hi, > > Here is the output: > > Mar 31 17:07:50 zenon kernel: setting logging_level(0x00000310) > Mar 31 17:24:29 zenon kernel: sd 0:0:0:0: [sda] CDB: ATA command pass > through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 > Mar 31 17:24:29 zenon kernel: mpt2sas0: > sas_address(0x4433221103000000), phy(3) > Mar 31 17:24:29 zenon kernel: mpt2sas0: > enclosure_logical_id(0x5842b2b05020c600), slot(0) > Mar 31 17:24:29 zenon kernel: mpt2sas0: handle(0x0009), > ioc_status(success)(0x0000), smid(1344) > Mar 31 17:24:29 zenon kernel: mpt2sas0: request_len(0), underflow(0), > resid(0) > Mar 31 17:24:29 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- > >result(0x00000002) > Mar 31 17:24:29 zenon kernel: mpt2sas0: scsi_status(check > condition)(0x02), scsi_state(autosense valid )(0x01) > Mar 31 17:24:29 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: > [0x01,0x00,0x1d], count(22) > Mar 31 17:24:29 zenon kernel: sd 0:0:0:0: [sda] CDB: ATA command pass > through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 > Mar 31 17:24:29 zenon kernel: mpt2sas0: > sas_address(0x4433221103000000), phy(3) > Mar 31 17:24:29 zenon kernel: mpt2sas0: > enclosure_logical_id(0x5842b2b05020c600), slot(0) > Mar 31 17:24:29 zenon kernel: mpt2sas0: handle(0x0009), > ioc_status(success)(0x0000), smid(884) > Mar 31 17:24:29 zenon kernel: mpt2sas0: request_len(0), underflow(0), > resid(0) > Mar 31 17:24:29 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- > >result(0x00000002) > Mar 31 17:24:29 zenon kernel: mpt2sas0: scsi_status(check > condition)(0x02), scsi_state(autosense valid )(0x01) > Mar 31 17:24:29 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: > [0x01,0x00,0x1d], count(22) > Mar 31 17:24:30 zenon kernel: sd 0:0:1:0: [sdb] CDB: ATA command pass > through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 > Mar 31 17:24:30 zenon kernel: mpt2sas0: > sas_address(0x4433221102000000), phy(2) > Mar 31 17:24:30 zenon kernel: mpt2sas0: > enclosure_logical_id(0x5842b2b05020c600), slot(1) > Mar 31 17:24:30 zenon kernel: mpt2sas0: handle(0x000a), > ioc_status(success)(0x0000), smid(100) > Mar 31 17:24:30 zenon kernel: mpt2sas0: request_len(0), underflow(0), > resid(0) > Mar 31 17:24:30 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- > >result(0x00000002) > Mar 31 17:24:30 zenon kernel: mpt2sas0: scsi_status(check > condition)(0x02), scsi_state(autosense valid )(0x01) > Mar 31 17:24:30 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: > [0x01,0x00,0x1d], count(22) > Mar 31 17:24:30 zenon kernel: sd 0:0:1:0: [sdb] CDB: ATA command pass > through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 > Mar 31 17:24:30 zenon kernel: mpt2sas0: > sas_address(0x4433221102000000), phy(2) > Mar 31 17:24:30 zenon kernel: mpt2sas0: > enclosure_logical_id(0x5842b2b05020c600), slot(1) > Mar 31 17:24:30 zenon kernel: mpt2sas0: handle(0x000a), > ioc_status(success)(0x0000), smid(510) > Mar 31 17:24:30 zenon kernel: mpt2sas0: request_len(0), underflow(0), > resid(0) > Mar 31 17:24:30 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- > >result(0x00000002) > Mar 31 17:24:30 zenon kernel: mpt2sas0: scsi_status(check > condition)(0x02), scsi_state(autosense valid )(0x01) > Mar 31 17:24:30 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: > [0x01,0x00,0x1d], count(22) > Mar 31 17:24:30 zenon kernel: sd 0:0:2:0: [sdc] CDB: ATA command pass > through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 > Mar 31 17:24:30 zenon kernel: mpt2sas0: > sas_address(0x4433221101000000), phy(1) > Mar 31 17:24:30 zenon kernel: mpt2sas0: > enclosure_logical_id(0x5842b2b05020c600), slot(2) > Mar 31 17:24:30 zenon kernel: mpt2sas0: handle(0x000b), > ioc_status(success)(0x0000), smid(1455) > Mar 31 17:24:30 zenon kernel: mpt2sas0: request_len(0), underflow(0), > resid(0) > Mar 31 17:24:30 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- > >result(0x00000002) > Mar 31 17:24:30 zenon kernel: mpt2sas0: scsi_status(check > condition)(0x02), scsi_state(autosense valid )(0x01) > Mar 31 17:24:30 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: > [0x01,0x00,0x1d], count(22) > Mar 31 17:24:31 zenon kernel: sd 0:0:2:0: [sdc] CDB: ATA command pass > through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 > Mar 31 17:24:31 zenon kernel: mpt2sas0: > sas_address(0x4433221101000000), phy(1) > Mar 31 17:24:31 zenon kernel: mpt2sas0: > enclosure_logical_id(0x5842b2b05020c600), slot(2) > Mar 31 17:24:31 zenon kernel: mpt2sas0: handle(0x000b), > ioc_status(success)(0x0000), smid(966) > Mar 31 17:24:31 zenon kernel: mpt2sas0: request_len(0), underflow(0), > resid(0) > Mar 31 17:24:31 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- > >result(0x00000002) > Mar 31 17:24:31 zenon kernel: mpt2sas0: scsi_status(check > condition)(0x02), scsi_state(autosense valid )(0x01) > Mar 31 17:24:31 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: > [0x01,0x00,0x1d], count(22) > Mar 31 17:24:31 zenon kernel: sd 0:0:3:0: [sdd] CDB: ATA command pass > through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 > Mar 31 17:24:31 zenon kernel: mpt2sas0: > sas_address(0x4433221100000000), phy(0) > Mar 31 17:24:31 zenon kernel: mpt2sas0: > enclosure_logical_id(0x5842b2b05020c600), slot(3) > Mar 31 17:24:31 zenon kernel: mpt2sas0: handle(0x000c), > ioc_status(success)(0x0000), smid(519) > Mar 31 17:24:31 zenon kernel: mpt2sas0: request_len(0), underflow(0), > resid(0) > Mar 31 17:24:31 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- > >result(0x00000002) > Mar 31 17:24:31 zenon kernel: mpt2sas0: scsi_status(check > condition)(0x02), scsi_state(autosense valid )(0x01) > Mar 31 17:24:31 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: > [0x01,0x00,0x1d], count(22) > Mar 31 17:24:32 zenon kernel: sd 0:0:3:0: [sdd] CDB: ATA command pass > through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 > Mar 31 17:24:32 zenon kernel: mpt2sas0: > sas_address(0x4433221100000000), phy(0) > Mar 31 17:24:32 zenon kernel: mpt2sas0: > enclosure_logical_id(0x5842b2b05020c600), slot(3) > Mar 31 17:24:32 zenon kernel: mpt2sas0: handle(0x000c), > ioc_status(success)(0x0000), smid(1125) > Mar 31 17:24:32 zenon kernel: mpt2sas0: request_len(0), underflow(0), > resid(0) > Mar 31 17:24:32 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- > >result(0x00000002) > Mar 31 17:24:32 zenon kernel: mpt2sas0: scsi_status(check > condition)(0x02), scsi_state(autosense valid )(0x01) > Mar 31 17:24:32 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: > [0x01,0x00,0x1d], count(22) > Mar 31 17:24:32 zenon kernel: sd 0:0:4:0: [sde] CDB: ATA command pass > through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 > Mar 31 17:24:32 zenon kernel: mpt2sas0: > sas_address(0x4433221104000000), phy(4) > Mar 31 17:24:32 zenon kernel: mpt2sas0: > enclosure_logical_id(0x5842b2b05020c600), slot(7) > Mar 31 17:24:32 zenon kernel: mpt2sas0: handle(0x000d), > ioc_status(success)(0x0000), smid(570) > Mar 31 17:24:32 zenon kernel: mpt2sas0: request_len(0), underflow(0), > resid(0) > Mar 31 17:24:32 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- > >result(0x00000002) > Mar 31 17:24:32 zenon kernel: mpt2sas0: scsi_status(check > condition)(0x02), scsi_state(autosense valid )(0x01) > Mar 31 17:24:32 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: > [0x01,0x00,0x1d], count(22) > Mar 31 17:24:32 zenon kernel: sd 0:0:4:0: [sde] CDB: ATA command pass > through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 > Mar 31 17:24:32 zenon kernel: mpt2sas0: > sas_address(0x4433221104000000), phy(4) > Mar 31 17:24:32 zenon kernel: mpt2sas0: > enclosure_logical_id(0x5842b2b05020c600), slot(7) > Mar 31 17:24:32 zenon kernel: mpt2sas0: handle(0x000d), > ioc_status(success)(0x0000), smid(28) > Mar 31 17:24:32 zenon kernel: mpt2sas0: request_len(0), underflow(0), > resid(0) > Mar 31 17:24:32 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- > >result(0x00000002) > Mar 31 17:24:32 zenon kernel: mpt2sas0: scsi_status(check > condition)(0x02), scsi_state(autosense valid )(0x01) > Mar 31 17:24:32 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: > [0x01,0x00,0x1d], count(22) > Mar 31 17:24:33 zenon kernel: sd 0:0:5:0: [sdf] CDB: ATA command pass > through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 > Mar 31 17:24:33 zenon kernel: mpt2sas0: > sas_address(0x4433221107000000), phy(7) > Mar 31 17:24:33 zenon kernel: mpt2sas0: > enclosure_logical_id(0x5842b2b05020c600), slot(4) > Mar 31 17:24:33 zenon kernel: mpt2sas0: handle(0x000e), > ioc_status(success)(0x0000), smid(471) > Mar 31 17:24:33 zenon kernel: mpt2sas0: request_len(0), underflow(0), > resid(0) > Mar 31 17:24:33 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- > >result(0x00000002) > Mar 31 17:24:33 zenon kernel: mpt2sas0: scsi_status(check > condition)(0x02), scsi_state(autosense valid )(0x01) > Mar 31 17:24:33 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: > [0x01,0x00,0x1d], count(22) > Mar 31 17:24:33 zenon kernel: sd 0:0:5:0: [sdf] CDB: ATA command pass > through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 > Mar 31 17:24:33 zenon kernel: mpt2sas0: > sas_address(0x4433221107000000), phy(7) > Mar 31 17:24:33 zenon kernel: mpt2sas0: > enclosure_logical_id(0x5842b2b05020c600), slot(4) > Mar 31 17:24:33 zenon kernel: mpt2sas0: handle(0x000e), > ioc_status(success)(0x0000), smid(789) > Mar 31 17:24:33 zenon kernel: mpt2sas0: request_len(0), underflow(0), > resid(0) > Mar 31 17:24:33 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- > >result(0x00000002) > Mar 31 17:24:33 zenon kernel: mpt2sas0: scsi_status(check > condition)(0x02), scsi_state(autosense valid )(0x01) > Mar 31 17:24:33 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: > [0x01,0x00,0x1d], count(22) > Mar 31 17:24:34 zenon kernel: sd 0:0:6:0: [sdg] CDB: ATA command pass > through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 > Mar 31 17:24:34 zenon kernel: mpt2sas0: > sas_address(0x4433221106000000), phy(6) > Mar 31 17:24:34 zenon kernel: mpt2sas0: > enclosure_logical_id(0x5842b2b05020c600), slot(5) > Mar 31 17:24:34 zenon kernel: mpt2sas0: handle(0x000f), > ioc_status(success)(0x0000), smid(594) > Mar 31 17:24:34 zenon kernel: mpt2sas0: request_len(0), underflow(0), > resid(0) > Mar 31 17:24:34 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- > >result(0x00000002) > Mar 31 17:24:34 zenon kernel: mpt2sas0: scsi_status(check > condition)(0x02), scsi_state(autosense valid )(0x01) > Mar 31 17:24:34 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: > [0x01,0x00,0x1d], count(22) > Mar 31 17:24:34 zenon kernel: sd 0:0:6:0: [sdg] CDB: ATA command pass > through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 > Mar 31 17:24:34 zenon kernel: mpt2sas0: > sas_address(0x4433221106000000), phy(6) > Mar 31 17:24:34 zenon kernel: mpt2sas0: > enclosure_logical_id(0x5842b2b05020c600), slot(5) > Mar 31 17:24:34 zenon kernel: mpt2sas0: handle(0x000f), > ioc_status(success)(0x0000), smid(761) > Mar 31 17:24:34 zenon kernel: mpt2sas0: request_len(0), underflow(0), > resid(0) > Mar 31 17:24:34 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- > >result(0x00000002) > Mar 31 17:24:34 zenon kernel: mpt2sas0: scsi_status(check > condition)(0x02), scsi_state(autosense valid )(0x01) > Mar 31 17:24:34 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: > [0x01,0x00,0x1d], count(22) > Mar 31 17:24:35 zenon kernel: sd 0:0:7:0: [sdh] CDB: ATA command pass > through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 > Mar 31 17:24:35 zenon kernel: mpt2sas0: > sas_address(0x4433221105000000), phy(5) > Mar 31 17:24:35 zenon kernel: mpt2sas0: > enclosure_logical_id(0x5842b2b05020c600), slot(6) > Mar 31 17:24:35 zenon kernel: mpt2sas0: handle(0x0010), > ioc_status(success)(0x0000), smid(1127) > Mar 31 17:24:35 zenon kernel: mpt2sas0: request_len(0), underflow(0), > resid(0) > Mar 31 17:24:35 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- > >result(0x00000002) > Mar 31 17:24:35 zenon kernel: mpt2sas0: scsi_status(check > condition)(0x02), scsi_state(autosense valid )(0x01) > Mar 31 17:24:35 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: > [0x01,0x00,0x1d], count(22) > Mar 31 17:24:35 zenon kernel: sd 0:0:7:0: [sdh] CDB: ATA command pass > through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 > Mar 31 17:24:35 zenon kernel: mpt2sas0: > sas_address(0x4433221105000000), phy(5) > Mar 31 17:24:35 zenon kernel: mpt2sas0: > enclosure_logical_id(0x5842b2b05020c600), slot(6) > Mar 31 17:24:35 zenon kernel: mpt2sas0: handle(0x0010), > ioc_status(success)(0x0000), smid(1583) > Mar 31 17:24:35 zenon kernel: mpt2sas0: request_len(0), underflow(0), > resid(0) > Mar 31 17:24:35 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- > >result(0x00000002) > Mar 31 17:24:35 zenon kernel: mpt2sas0: scsi_status(check > condition)(0x02), scsi_state(autosense valid )(0x01) > Mar 31 17:24:35 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: > [0x01,0x00,0x1d], count(22) Well you've got a load of SATA passthru request with RECOVERED_ERROR sense key is probably effecting your performance. Any chance you could try shutdown the daemons that are sending those request? I doubt its coming via the filesystem and the test your running. Eric ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: caviar black + mpt2sas horrific performance 2011-04-02 4:51 ` Moore, Eric @ 2011-04-03 17:35 ` Douglas Gilbert 2011-04-03 23:05 ` Moore, Eric 0 siblings, 1 reply; 8+ messages in thread From: Douglas Gilbert @ 2011-04-03 17:35 UTC (permalink / raw) To: Moore, Eric Cc: Louis-David Mitterrand, Desai, Kashyap, Prakash, Sathya, linux-scsi@vger.kernel.org On 11-04-02 12:51 AM, Moore, Eric wrote: > On Thursday, March 31, 2011 9:35 AM, Louis-David Mitterrand wrote: >> On Thu, Mar 31, 2011 at 09:07:05AM -0600, Moore, Eric wrote: >>> On Wednesday, March 30, 2011 2:17 PM, Louis-David Mitterrand wrote: >>>> On Wed, Mar 30, 2011 at 02:02:12PM -0600, Moore, Eric wrote: >>>>> Hi Louis, can you send me your /var/log/messages and dmesg output? >>>>> Please capture after you've run your test. >>>> >>>> Hi, >>>> >>>> My test produces no specific output through dmesg or /var/log/messages >>>> as there is no apparent error from the controller. >>>> >>>> However I can send you the syslog startup output. Let me know if I can >>>> run any further tests or provide more information. >>>> >>> >>> need you to set the mpt2sas logging level to 0x310 just before you run >> you test, then capture the logs after. >>> Please make sure your syslog level is set to capture all KERN_XXX levels >> to include KERN_DEBUG. >>> >>> Example: >>> # echo 0x310> /sys/module/mpt2sas/parameters/logging_level >> >> Hi, >> >> Here is the output: >> >> Mar 31 17:07:50 zenon kernel: setting logging_level(0x00000310) >> Mar 31 17:24:29 zenon kernel: sd 0:0:0:0: [sda] CDB: ATA command pass >> through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 >> Mar 31 17:24:29 zenon kernel: mpt2sas0: >> sas_address(0x4433221103000000), phy(3) >> Mar 31 17:24:29 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(0) >> Mar 31 17:24:29 zenon kernel: mpt2sas0: handle(0x0009), >> ioc_status(success)(0x0000), smid(1344) >> Mar 31 17:24:29 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:29 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:29 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:29 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) >> Mar 31 17:24:29 zenon kernel: sd 0:0:0:0: [sda] CDB: ATA command pass >> through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 >> Mar 31 17:24:29 zenon kernel: mpt2sas0: >> sas_address(0x4433221103000000), phy(3) >> Mar 31 17:24:29 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(0) >> Mar 31 17:24:29 zenon kernel: mpt2sas0: handle(0x0009), >> ioc_status(success)(0x0000), smid(884) >> Mar 31 17:24:29 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:29 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:29 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:29 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) >> Mar 31 17:24:30 zenon kernel: sd 0:0:1:0: [sdb] CDB: ATA command pass >> through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 >> Mar 31 17:24:30 zenon kernel: mpt2sas0: >> sas_address(0x4433221102000000), phy(2) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(1) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: handle(0x000a), >> ioc_status(success)(0x0000), smid(100) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) >> Mar 31 17:24:30 zenon kernel: sd 0:0:1:0: [sdb] CDB: ATA command pass >> through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 >> Mar 31 17:24:30 zenon kernel: mpt2sas0: >> sas_address(0x4433221102000000), phy(2) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(1) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: handle(0x000a), >> ioc_status(success)(0x0000), smid(510) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) >> Mar 31 17:24:30 zenon kernel: sd 0:0:2:0: [sdc] CDB: ATA command pass >> through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 >> Mar 31 17:24:30 zenon kernel: mpt2sas0: >> sas_address(0x4433221101000000), phy(1) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(2) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: handle(0x000b), >> ioc_status(success)(0x0000), smid(1455) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) >> Mar 31 17:24:31 zenon kernel: sd 0:0:2:0: [sdc] CDB: ATA command pass >> through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 >> Mar 31 17:24:31 zenon kernel: mpt2sas0: >> sas_address(0x4433221101000000), phy(1) >> Mar 31 17:24:31 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(2) >> Mar 31 17:24:31 zenon kernel: mpt2sas0: handle(0x000b), >> ioc_status(success)(0x0000), smid(966) >> Mar 31 17:24:31 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:31 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:31 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:31 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) >> Mar 31 17:24:31 zenon kernel: sd 0:0:3:0: [sdd] CDB: ATA command pass >> through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 >> Mar 31 17:24:31 zenon kernel: mpt2sas0: >> sas_address(0x4433221100000000), phy(0) >> Mar 31 17:24:31 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(3) >> Mar 31 17:24:31 zenon kernel: mpt2sas0: handle(0x000c), >> ioc_status(success)(0x0000), smid(519) >> Mar 31 17:24:31 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:31 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:31 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:31 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) >> Mar 31 17:24:32 zenon kernel: sd 0:0:3:0: [sdd] CDB: ATA command pass >> through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 >> Mar 31 17:24:32 zenon kernel: mpt2sas0: >> sas_address(0x4433221100000000), phy(0) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(3) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: handle(0x000c), >> ioc_status(success)(0x0000), smid(1125) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) >> Mar 31 17:24:32 zenon kernel: sd 0:0:4:0: [sde] CDB: ATA command pass >> through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 >> Mar 31 17:24:32 zenon kernel: mpt2sas0: >> sas_address(0x4433221104000000), phy(4) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(7) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: handle(0x000d), >> ioc_status(success)(0x0000), smid(570) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) >> Mar 31 17:24:32 zenon kernel: sd 0:0:4:0: [sde] CDB: ATA command pass >> through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 >> Mar 31 17:24:32 zenon kernel: mpt2sas0: >> sas_address(0x4433221104000000), phy(4) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(7) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: handle(0x000d), >> ioc_status(success)(0x0000), smid(28) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) >> Mar 31 17:24:33 zenon kernel: sd 0:0:5:0: [sdf] CDB: ATA command pass >> through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 >> Mar 31 17:24:33 zenon kernel: mpt2sas0: >> sas_address(0x4433221107000000), phy(7) >> Mar 31 17:24:33 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(4) >> Mar 31 17:24:33 zenon kernel: mpt2sas0: handle(0x000e), >> ioc_status(success)(0x0000), smid(471) >> Mar 31 17:24:33 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:33 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:33 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:33 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) >> Mar 31 17:24:33 zenon kernel: sd 0:0:5:0: [sdf] CDB: ATA command pass >> through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 >> Mar 31 17:24:33 zenon kernel: mpt2sas0: >> sas_address(0x4433221107000000), phy(7) >> Mar 31 17:24:33 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(4) >> Mar 31 17:24:33 zenon kernel: mpt2sas0: handle(0x000e), >> ioc_status(success)(0x0000), smid(789) >> Mar 31 17:24:33 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:33 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:33 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:33 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) >> Mar 31 17:24:34 zenon kernel: sd 0:0:6:0: [sdg] CDB: ATA command pass >> through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 >> Mar 31 17:24:34 zenon kernel: mpt2sas0: >> sas_address(0x4433221106000000), phy(6) >> Mar 31 17:24:34 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(5) >> Mar 31 17:24:34 zenon kernel: mpt2sas0: handle(0x000f), >> ioc_status(success)(0x0000), smid(594) >> Mar 31 17:24:34 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:34 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:34 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:34 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) >> Mar 31 17:24:34 zenon kernel: sd 0:0:6:0: [sdg] CDB: ATA command pass >> through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 >> Mar 31 17:24:34 zenon kernel: mpt2sas0: >> sas_address(0x4433221106000000), phy(6) >> Mar 31 17:24:34 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(5) >> Mar 31 17:24:34 zenon kernel: mpt2sas0: handle(0x000f), >> ioc_status(success)(0x0000), smid(761) >> Mar 31 17:24:34 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:34 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:34 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:34 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) >> Mar 31 17:24:35 zenon kernel: sd 0:0:7:0: [sdh] CDB: ATA command pass >> through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 >> Mar 31 17:24:35 zenon kernel: mpt2sas0: >> sas_address(0x4433221105000000), phy(5) >> Mar 31 17:24:35 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(6) >> Mar 31 17:24:35 zenon kernel: mpt2sas0: handle(0x0010), >> ioc_status(success)(0x0000), smid(1127) >> Mar 31 17:24:35 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:35 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:35 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:35 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) >> Mar 31 17:24:35 zenon kernel: sd 0:0:7:0: [sdh] CDB: ATA command pass >> through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 >> Mar 31 17:24:35 zenon kernel: mpt2sas0: >> sas_address(0x4433221105000000), phy(5) >> Mar 31 17:24:35 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(6) >> Mar 31 17:24:35 zenon kernel: mpt2sas0: handle(0x0010), >> ioc_status(success)(0x0000), smid(1583) >> Mar 31 17:24:35 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:35 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:35 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:35 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) > > > Well you've got a load of SATA passthru request with RECOVERED_ERROR sense key is probably effecting your performance. > > Any chance you could try shutdown the daemons that are sending those request? I doubt its coming via the filesystem and the test your running. The daemon in question is probably smartd. And RECOVERED ERROR is the expected sense key when the CK_COND bit is set in the SCSI ATA PASS-THROUGH command. It requests the ATA registers after the ATA device has executed the related command. And if that causes a significant delay in the mpt2sas driver then IMO that is a bug in the driver. One piece of additional information that may be useful is whether fixed or descriptor format sense data is returned. With SAT-1 only descriptor format was allowed. In SAT-2 (now a standard) it can be fixed or descriptor format with the preference seeming to be with the former. My tools and smartmontools (smartd) cannot handle fixed format sense data from SCSI ATA PASS-THROUGH commands. Doug Gilbert ^ permalink raw reply [flat|nested] 8+ messages in thread
* RE: caviar black + mpt2sas horrific performance 2011-04-03 17:35 ` Douglas Gilbert @ 2011-04-03 23:05 ` Moore, Eric 2011-04-29 14:06 ` Louis-David Mitterrand 0 siblings, 1 reply; 8+ messages in thread From: Moore, Eric @ 2011-04-03 23:05 UTC (permalink / raw) To: dgilbert@interlog.com Cc: Louis-David Mitterrand, Desai, Kashyap, Prakash, Sathya, linux-scsi@vger.kernel.org Doug, the SATL is implemented in controller FW, not the mpt2sas driver. What I should of probably said is my theory that firmware might be blocking the IO queues when its in recovery mode due to the ATA Passthru SMART commands that are failing.. In other words,maybe firmware is turning off NCQ when ata passthru is sent, and that is effecting the normal IO path, and the IO benchmark test the customer is running which is taking 20 minutes (which it should be 20 seconds).. I will have to ask the SATA experts when I'm back in the office later in the week. The delay would not be in the driver because its merely passing the command thru. ________________________________________ From: Douglas Gilbert [dgilbert@interlog.com] Sent: Sunday, April 03, 2011 11:35 AM To: Moore, Eric Cc: Louis-David Mitterrand; Desai, Kashyap; Prakash, Sathya; linux-scsi@vger.kernel.org Subject: Re: caviar black + mpt2sas horrific performance On 11-04-02 12:51 AM, Moore, Eric wrote: > On Thursday, March 31, 2011 9:35 AM, Louis-David Mitterrand wrote: >> On Thu, Mar 31, 2011 at 09:07:05AM -0600, Moore, Eric wrote: >>> On Wednesday, March 30, 2011 2:17 PM, Louis-David Mitterrand wrote: >>>> On Wed, Mar 30, 2011 at 02:02:12PM -0600, Moore, Eric wrote: >>>>> Hi Louis, can you send me your /var/log/messages and dmesg output? >>>>> Please capture after you've run your test. >>>> >>>> Hi, >>>> >>>> My test produces no specific output through dmesg or /var/log/messages >>>> as there is no apparent error from the controller. >>>> >>>> However I can send you the syslog startup output. Let me know if I can >>>> run any further tests or provide more information. >>>> >>> >>> need you to set the mpt2sas logging level to 0x310 just before you run >> you test, then capture the logs after. >>> Please make sure your syslog level is set to capture all KERN_XXX levels >> to include KERN_DEBUG. >>> >>> Example: >>> # echo 0x310> /sys/module/mpt2sas/parameters/logging_level >> >> Hi, >> >> Here is the output: >> >> Mar 31 17:07:50 zenon kernel: setting logging_level(0x00000310) >> Mar 31 17:24:29 zenon kernel: sd 0:0:0:0: [sda] CDB: ATA command pass >> through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 >> Mar 31 17:24:29 zenon kernel: mpt2sas0: >> sas_address(0x4433221103000000), phy(3) >> Mar 31 17:24:29 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(0) >> Mar 31 17:24:29 zenon kernel: mpt2sas0: handle(0x0009), >> ioc_status(success)(0x0000), smid(1344) >> Mar 31 17:24:29 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:29 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:29 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:29 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) >> Mar 31 17:24:29 zenon kernel: sd 0:0:0:0: [sda] CDB: ATA command pass >> through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 >> Mar 31 17:24:29 zenon kernel: mpt2sas0: >> sas_address(0x4433221103000000), phy(3) >> Mar 31 17:24:29 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(0) >> Mar 31 17:24:29 zenon kernel: mpt2sas0: handle(0x0009), >> ioc_status(success)(0x0000), smid(884) >> Mar 31 17:24:29 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:29 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:29 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:29 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) >> Mar 31 17:24:30 zenon kernel: sd 0:0:1:0: [sdb] CDB: ATA command pass >> through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 >> Mar 31 17:24:30 zenon kernel: mpt2sas0: >> sas_address(0x4433221102000000), phy(2) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(1) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: handle(0x000a), >> ioc_status(success)(0x0000), smid(100) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) >> Mar 31 17:24:30 zenon kernel: sd 0:0:1:0: [sdb] CDB: ATA command pass >> through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 >> Mar 31 17:24:30 zenon kernel: mpt2sas0: >> sas_address(0x4433221102000000), phy(2) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(1) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: handle(0x000a), >> ioc_status(success)(0x0000), smid(510) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) >> Mar 31 17:24:30 zenon kernel: sd 0:0:2:0: [sdc] CDB: ATA command pass >> through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 >> Mar 31 17:24:30 zenon kernel: mpt2sas0: >> sas_address(0x4433221101000000), phy(1) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(2) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: handle(0x000b), >> ioc_status(success)(0x0000), smid(1455) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:30 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) >> Mar 31 17:24:31 zenon kernel: sd 0:0:2:0: [sdc] CDB: ATA command pass >> through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 >> Mar 31 17:24:31 zenon kernel: mpt2sas0: >> sas_address(0x4433221101000000), phy(1) >> Mar 31 17:24:31 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(2) >> Mar 31 17:24:31 zenon kernel: mpt2sas0: handle(0x000b), >> ioc_status(success)(0x0000), smid(966) >> Mar 31 17:24:31 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:31 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:31 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:31 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) >> Mar 31 17:24:31 zenon kernel: sd 0:0:3:0: [sdd] CDB: ATA command pass >> through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 >> Mar 31 17:24:31 zenon kernel: mpt2sas0: >> sas_address(0x4433221100000000), phy(0) >> Mar 31 17:24:31 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(3) >> Mar 31 17:24:31 zenon kernel: mpt2sas0: handle(0x000c), >> ioc_status(success)(0x0000), smid(519) >> Mar 31 17:24:31 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:31 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:31 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:31 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) >> Mar 31 17:24:32 zenon kernel: sd 0:0:3:0: [sdd] CDB: ATA command pass >> through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 >> Mar 31 17:24:32 zenon kernel: mpt2sas0: >> sas_address(0x4433221100000000), phy(0) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(3) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: handle(0x000c), >> ioc_status(success)(0x0000), smid(1125) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) >> Mar 31 17:24:32 zenon kernel: sd 0:0:4:0: [sde] CDB: ATA command pass >> through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 >> Mar 31 17:24:32 zenon kernel: mpt2sas0: >> sas_address(0x4433221104000000), phy(4) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(7) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: handle(0x000d), >> ioc_status(success)(0x0000), smid(570) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) >> Mar 31 17:24:32 zenon kernel: sd 0:0:4:0: [sde] CDB: ATA command pass >> through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 >> Mar 31 17:24:32 zenon kernel: mpt2sas0: >> sas_address(0x4433221104000000), phy(4) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(7) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: handle(0x000d), >> ioc_status(success)(0x0000), smid(28) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:32 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) >> Mar 31 17:24:33 zenon kernel: sd 0:0:5:0: [sdf] CDB: ATA command pass >> through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 >> Mar 31 17:24:33 zenon kernel: mpt2sas0: >> sas_address(0x4433221107000000), phy(7) >> Mar 31 17:24:33 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(4) >> Mar 31 17:24:33 zenon kernel: mpt2sas0: handle(0x000e), >> ioc_status(success)(0x0000), smid(471) >> Mar 31 17:24:33 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:33 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:33 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:33 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) >> Mar 31 17:24:33 zenon kernel: sd 0:0:5:0: [sdf] CDB: ATA command pass >> through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 >> Mar 31 17:24:33 zenon kernel: mpt2sas0: >> sas_address(0x4433221107000000), phy(7) >> Mar 31 17:24:33 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(4) >> Mar 31 17:24:33 zenon kernel: mpt2sas0: handle(0x000e), >> ioc_status(success)(0x0000), smid(789) >> Mar 31 17:24:33 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:33 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:33 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:33 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) >> Mar 31 17:24:34 zenon kernel: sd 0:0:6:0: [sdg] CDB: ATA command pass >> through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 >> Mar 31 17:24:34 zenon kernel: mpt2sas0: >> sas_address(0x4433221106000000), phy(6) >> Mar 31 17:24:34 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(5) >> Mar 31 17:24:34 zenon kernel: mpt2sas0: handle(0x000f), >> ioc_status(success)(0x0000), smid(594) >> Mar 31 17:24:34 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:34 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:34 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:34 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) >> Mar 31 17:24:34 zenon kernel: sd 0:0:6:0: [sdg] CDB: ATA command pass >> through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 >> Mar 31 17:24:34 zenon kernel: mpt2sas0: >> sas_address(0x4433221106000000), phy(6) >> Mar 31 17:24:34 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(5) >> Mar 31 17:24:34 zenon kernel: mpt2sas0: handle(0x000f), >> ioc_status(success)(0x0000), smid(761) >> Mar 31 17:24:34 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:34 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:34 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:34 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) >> Mar 31 17:24:35 zenon kernel: sd 0:0:7:0: [sdh] CDB: ATA command pass >> through(16): 85 06 2c 00 00 00 00 00 00 00 00 00 00 00 e5 00 >> Mar 31 17:24:35 zenon kernel: mpt2sas0: >> sas_address(0x4433221105000000), phy(5) >> Mar 31 17:24:35 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(6) >> Mar 31 17:24:35 zenon kernel: mpt2sas0: handle(0x0010), >> ioc_status(success)(0x0000), smid(1127) >> Mar 31 17:24:35 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:35 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:35 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:35 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) >> Mar 31 17:24:35 zenon kernel: sd 0:0:7:0: [sdh] CDB: ATA command pass >> through(16): 85 06 2c 00 da 00 00 00 00 00 4f 00 c2 00 b0 00 >> Mar 31 17:24:35 zenon kernel: mpt2sas0: >> sas_address(0x4433221105000000), phy(5) >> Mar 31 17:24:35 zenon kernel: mpt2sas0: >> enclosure_logical_id(0x5842b2b05020c600), slot(6) >> Mar 31 17:24:35 zenon kernel: mpt2sas0: handle(0x0010), >> ioc_status(success)(0x0000), smid(1583) >> Mar 31 17:24:35 zenon kernel: mpt2sas0: request_len(0), underflow(0), >> resid(0) >> Mar 31 17:24:35 zenon kernel: mpt2sas0: tag(0), transfer_count(0), sc- >>> result(0x00000002) >> Mar 31 17:24:35 zenon kernel: mpt2sas0: scsi_status(check >> condition)(0x02), scsi_state(autosense valid )(0x01) >> Mar 31 17:24:35 zenon kernel: mpt2sas0: [sense_key,asc,ascq]: >> [0x01,0x00,0x1d], count(22) > > > Well you've got a load of SATA passthru request with RECOVERED_ERROR sense key is probably effecting your performance. > > Any chance you could try shutdown the daemons that are sending those request? I doubt its coming via the filesystem and the test your running. The daemon in question is probably smartd. And RECOVERED ERROR is the expected sense key when the CK_COND bit is set in the SCSI ATA PASS-THROUGH command. It requests the ATA registers after the ATA device has executed the related command. And if that causes a significant delay in the mpt2sas driver then IMO that is a bug in the driver. One piece of additional information that may be useful is whether fixed or descriptor format sense data is returned. With SAT-1 only descriptor format was allowed. In SAT-2 (now a standard) it can be fixed or descriptor format with the preference seeming to be with the former. My tools and smartmontools (smartd) cannot handle fixed format sense data from SCSI ATA PASS-THROUGH commands. Doug Gilbert ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: caviar black + mpt2sas horrific performance 2011-04-03 23:05 ` Moore, Eric @ 2011-04-29 14:06 ` Louis-David Mitterrand 0 siblings, 0 replies; 8+ messages in thread From: Louis-David Mitterrand @ 2011-04-29 14:06 UTC (permalink / raw) To: Moore, Eric Cc: dgilbert@interlog.com, Desai, Kashyap, Prakash, Sathya, linux-scsi@vger.kernel.org [-- Attachment #1: Type: text/plain, Size: 1077 bytes --] On Sun, Apr 03, 2011 at 05:05:53PM -0600, Moore, Eric wrote: > Doug, the SATL is implemented in controller FW, not the mpt2sas > driver. What I should of probably said is my theory that firmware > might be blocking the IO queues when its in recovery mode due to the > ATA Passthru SMART commands that are failing.. In other words,maybe > firmware is turning off NCQ when ata passthru is sent, and that is > effecting the normal IO path, and the IO benchmark test the customer > is running which is taking 20 minutes (which it should be 20 > seconds).. I will have to ask the SATA experts when I'm back in the > office later in the week. The delay would not be in the driver > because its merely passing the command thru. Hi, I tried flashing the IT firmware on top of the IR firmware as suggestion on this LSI page: http://kb.lsi.com/KnowledgebaseArticle16266.aspx I followed exactly the instructions but when trying to flash the fw I get this error: "Failed to validate MfgPage2 !" See the attached screen capture. Any help would be much appreciated, thanks [-- Attachment #2: badflash.jpg --] [-- Type: image/jpeg, Size: 61356 bytes --] ^ permalink raw reply [flat|nested] 8+ messages in thread
![[-- Attachment #2: badflash.jpg --] [-- Type: image/jpeg, Size: 61356 bytes --]](../../20110429140604.GA14626@apartia.fr/2-badflash.jpg){kind=link}
end of thread, other threads:[~2011-04-29 14:06 UTC | newest]
Thread overview: 8+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2011-03-30 8:01 caviar black + mpt2sas horrific performance Louis-David Mitterrand
[not found] ` <4565AEA676113A449269C2F3A549520F8086471A@cosmail03.lsi.com>
2011-03-30 20:17 ` Louis-David Mitterrand
2011-03-31 15:07 ` Moore, Eric
2011-03-31 15:34 ` Louis-David Mitterrand
2011-04-02 4:51 ` Moore, Eric
2011-04-03 17:35 ` Douglas Gilbert
2011-04-03 23:05 ` Moore, Eric
2011-04-29 14:06 ` Louis-David Mitterrand
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox