Norco DS-1220 (sil3726+sil3124) / libata-tj bug report

Norco DS-1220 (sil3726+sil3124) / libata-tj bug report

[Brad Fitzpatrick]

Tejun, et al,

Hardware:
   Norco DS-1220 SATA enclosure (sil2134 card w/ 4 PMP/direct ports,
   enclosure is 2x sil3726 (5 disks each), and then 2 direct SATA ports.

   (also have 2x SATA internal, on ata_piix, md raid1, that's working fine...
    those are sd[ab], ata[12].nn, scsi[01])

Kernel:
   2.6.18.6 + libata-tj-2.6.18.1-20061020.

Issue:

Disks in DS-1220 show up, kinda, but don't work.  Errors reading /
writing blocks.  Tried a single disk in both a PMP port and a direct
(non-sil3726) port.

Full dmesg:
  http://bradfitz.com/temp/libata-norco-timeout-dmesg.txt

.config:
  http://bradfitz.com/temp/libata-norco-config.txt

Snippet of dmesg:

....
18:29:45 ata3.15: exception Emask 0x100 SAct 0x0 SErr 0x0 action 0x1
18:29:45 ata3.15: (irq_stat 0x08000800, SDB notify)
18:29:45 ata3.01: exception Emask 0x10 SAct 0x0 SErr 0x4050000 action 0x43
18:29:46 ata3.01: waiting for device to spin up (8 secs)
18:29:53 ata3.01: hard resetting port
18:29:54 ata3.01: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
18:29:54 ata3.01: ATA-6, max UDMA/100, 488397168 sectors: LBA48
18:29:54 ata3.01: ata3: dev 0 multi count 0
18:29:54 ata3.01: applying bridge limits
18:29:54 ata3.01: configured for UDMA/100
18:29:54 ata3: EH complete
18:29:55   Vendor: ATA       Model: WDC WD2500JD-00G  Rev: 02.0
18:29:55   Type:   Direct-Access                      ANSI SCSI revision: 05
18:29:55 SCSI device sdd: 488397168 512-byte hdwr sectors (250059 MB)
18:29:55 sdd: Write Protect is off
18:29:55 sdd: Mode Sense: 00 3a 00 00
18:29:55 SCSI device sdd: drive cache: write back
18:29:55 SCSI device sdd: 488397168 512-byte hdwr sectors (250059 MB)
18:29:55 sdd: Write Protect is off
18:29:55 sdd: Mode Sense: 00 3a 00 00
18:29:55 SCSI device sdd: drive cache: write back
18:29:55  sdd:<3>ata3.01: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x0
18:29:55 ata3.01: (irq_stat 0x00020002, device error via D2H FIS)
18:29:55 ata3.01: tag 0 cmd 0xc8 Emask 0x1 stat 0x50 err 0x0 (device error)
18:29:55 ata3: EH complete
18:29:55 ata3.01: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x0
18:29:55 ata3.01: (irq_stat 0x00060002, device error via D2H FIS)
18:29:55 ata3.01: tag 0 cmd 0xc8 Emask 0x1 stat 0x50 err 0x0 (device error)
18:29:55 ata3: EH complete
18:29:55 ata3.01: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x0
18:29:55 ata3.01: (irq_stat 0x00060002, device error via D2H FIS)
18:29:55 ata3.01: tag 0 cmd 0xc8 Emask 0x1 stat 0x50 err 0x0 (device error)
18:29:55 ata3: EH complete
18:29:55 ata3.01: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x0
18:29:55 ata3.01: (irq_stat 0x00060002, device error via D2H FIS)
18:29:55 ata3.01: tag 0 cmd 0xc8 Emask 0x1 stat 0x50 err 0x0 (device error)
18:29:55 ata3: EH complete
18:29:56 ata3.01: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x0
18:29:56 ata3.01: (irq_stat 0x00060002, device error via D2H FIS)
18:29:56 ata3.01: tag 0 cmd 0xc8 Emask 0x1 stat 0x50 err 0x0 (device error)
18:29:56 ata3: EH complete
18:29:56 ata3.01: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x0
18:29:56 ata3.01: (irq_stat 0x00060002, device error via D2H FIS)
18:29:56 ata3.01: tag 0 cmd 0xc8 Emask 0x1 stat 0x50 err 0x0 (device error)
18:29:56 sd 2:0:1:0: SCSI error: return code = 0x08000002
18:29:56 sdd: Current: sense key: Aborted Command
18:29:56     Additional sense: No additional sense information
18:29:56 end_request: I/O error, dev sdd, sector 0
18:29:56 Buffer I/O error on device sdd, logical block 0
18:29:56 ata3: EH complete
18:29:56 ata3.01: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x0
18:29:56 ata3.01: (irq_stat 0x00060002, device error via D2H FIS)
....

lspci:

0000:03:01.0 Mass storage controller: Silicon Image, Inc. SiI 3124 PCI-X Serial ATA Controller (rev 01)
        Subsystem: Silicon Image, Inc. SiI 3124 PCI-X Serial ATA Controller
        Flags: bus master, stepping, 66MHz, medium devsel, latency 32, IRQ 21
        Memory at ff9ffc00 (64-bit, non-prefetchable) [size=128]
        Memory at ff9f0000 (64-bit, non-prefetchable) [size=32K]
        I/O ports at bc00 [size=16]
        Expansion ROM at f6a00000 [disabled] [size=512K]
        Capabilities: [64] Power Management version 2
        Capabilities: [40] PCI-X non-bridge device.
        Capabilities: [54] Message Signalled Interrupts: 64bit+ Queue=0/0 Enable-

0000:00:00.0 Host bridge: Intel Corporation 82865G/PE/P DRAM Controller/Host-Hub Interface (rev 02)
0000:00:01.0 PCI bridge: Intel Corporation 82865G/PE/P PCI to AGP Controller (rev 02)
0000:00:03.0 PCI bridge: Intel Corporation 82865G/PE/P PCI to CSA Bridge (rev 02)
0000:00:1d.0 USB Controller: Intel Corporation 82801EB/ER (ICH5/ICH5R) USB UHCI Controller #1 (rev 02)
0000:00:1d.1 USB Controller: Intel Corporation 82801EB/ER (ICH5/ICH5R) USB UHCI Controller #2 (rev 02)
0000:00:1d.2 USB Controller: Intel Corporation 82801EB/ER (ICH5/ICH5R) USB UHCI Controller #3 (rev 02)
0000:00:1d.3 USB Controller: Intel Corporation 82801EB/ER (ICH5/ICH5R) USB UHCI Controller #4 (rev 02)
0000:00:1d.7 USB Controller: Intel Corporation 82801EB/ER (ICH5/ICH5R) USB2 EHCI Controller (rev 02)
0000:00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev c2)
0000:00:1f.0 ISA bridge: Intel Corporation 82801EB/ER (ICH5/ICH5R) LPC Interface Bridge (rev 02)
0000:00:1f.1 IDE interface: Intel Corporation 82801EB/ER (ICH5/ICH5R) IDE Controller (rev 02)
0000:00:1f.2 RAID bus controller: Intel Corporation 82801ER (ICH5R) SATA Controller (rev 02)
0000:00:1f.3 SMBus: Intel Corporation 82801EB/ER (ICH5/ICH5R) SMBus Controller (rev 02)
0000:00:1f.5 Multimedia audio controller: Intel Corporation 82801EB/ER (ICH5/ICH5R) AC'97 Audio Controller (rev 02)
0000:01:00.0 VGA compatible controller: ATI Technologies Inc RV280 [Radeon 9200] (rev 01)
0000:01:00.1 Display controller: ATI Technologies Inc RV280 [Radeon 9200] (Secondary) (rev 01)
0000:02:01.0 Ethernet controller: Intel Corporation 82547EI Gigabit Ethernet Controller (LOM)
** 0000:03:01.0 Mass storage controller: Silicon Image, Inc. SiI 3124 PCI-X Serial ATA Controller (rev 01)
0000:03:02.0 Communication controller: Tiger Jet Network Inc. Tiger3XX Modem/ISDN interface
0000:03:03.0 Communication controller: Tiger Jet Network Inc. Tiger3XX Modem/ISDN interface
0000:03:04.0 Ethernet controller: Intel Corporation 82557/8/9 [Ethernet Pro 100] (rev 05)
0000:03:07.0 FireWire (IEEE 1394): Agere Systems FW323 (rev 61)

lsmod:

Module                  Size  Used by
af_packet              23944  2
ip_conntrack_ftp        8860  0
ip_conntrack           48676  1 ip_conntrack_ftp
ide_scsi               19076  0
loop                   17416  0
bridge                 58780  0
llc                     9236  1 bridge
aes_i586               34292  0
dm_crypt               13192  0
dm_mod                 56340  4 dm_crypt
usb_storage            65984  1
sd_mod                 21120  8
snd_intel8x0           34076  0
snd_ac97_codec         95776  1 snd_intel8x0
snd_ac97_bus            3584  1 snd_ac97_codec
snd_pcm_oss            44704  0
snd_mixer_oss          18176  1 snd_pcm_oss
snd_pcm                79492  3 snd_intel8x0,snd_ac97_codec,snd_pcm_oss
sata_sil24             20356  0
snd_timer              24580  1 snd_pcm
snd                    52992  6 snd_intel8x0,snd_ac97_codec,snd_pcm_oss,snd_mixer_oss,snd_pcm,snd_timer
soundcore              11104  1 snd
e1000                 123200  0
ata_piix               17672  4
libata                131092  2 sata_sil24,ata_piix
snd_page_alloc         11528  2 snd_intel8x0,snd_pcm
e100                   37000  0
mii                     7168  1 e100
evdev                  11264  1
i2c_i801                9228  0
pcspkr                  4352  0
scsi_mod              136684  4 ide_scsi,usb_storage,sd_mod,libata
ehci_hcd               30728  0
uhci_hcd               24716  0
i2c_core               22656  1 i2c_i801
unix                   29456  254

....


I'm more than willing to be your guinea pig, testing whatever.  Would
love this wonderful hardware to work well for others eventually with
less pain.

Thanks!
Brad

Re: Norco DS-1220 (sil3726+sil3124) / libata-tj bug report

[Jim Paris]

Hi Brad,

> Hardware:
>    Norco DS-1220 SATA enclosure (sil2134 card w/ 4 PMP/direct ports,
>    enclosure is 2x sil3726 (5 disks each), and then 2 direct SATA ports.
> 
>    (also have 2x SATA internal, on ata_piix, md raid1, that's working fine...
>     those are sd[ab], ata[12].nn, scsi[01])
> 
> Kernel:
>    2.6.18.6 + libata-tj-2.6.18.1-20061020.
> 
> Issue:
> 
> Disks in DS-1220 show up, kinda, but don't work.  Errors reading /
> writing blocks.  Tried a single disk in both a PMP port and a direct
> (non-sil3726) port.

Just FYI:

I am using the same enclosure and card with no problems at all on
2.6.17.4 + libata-tj-2.6.17.4-20060710.  The card is plugged into a
PCI slot, not PCI-X.  My disks are Seagate ST3300822AS in all 12 bays.

-jim

Re: Norco DS-1220 (sil3726+sil3124) / libata-tj bug report

[Tejun Heo]

Brad Fitzpatrick wrote:
> Tejun,
> 
> (I wanted to send this to linux-ide, but vger's majordomo isn't replying
> to me.  Feel free to cc: the list...)

Just cc'ing linux-ide@vger.kernel.org is enough.  (done)

> Disks in DS-1220 show up, kinda, but don't work.  Errors reading /
> writing blocks.  Tried a single disk in both a PMP port and a direct
> (non-sil3726) port.

>From full dmesg...

The following is when the drive is attached via PMP.

18:29:55 ata3.01: (irq_stat 0x00020002, device error via D2H FIS)
18:29:55 ata3.01: tag 0 cmd 0xc8 Emask 0x1 stat 0x50 err 0x0 (device error)

And directly.

19:30:23 ata6.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x0
19:30:23 ata6.00: (irq_stat 0x00060002, device error via D2H FIS)
19:30:23 ata6.00: tag 0 cmd 0xc4 Emask 0x1 stat 0x50 err 0x0 (device error)
19:30:23 ata6: EH complete

Looks like a dead drive to me.  Care to post the result of 'smartctl -d
ata -a /dev/sdX' and test other drives?

-- 
tejun

Re: Norco DS-1220 (sil3726+sil3124) / libata-tj bug report

[Brad Fitzpatrick]

Tejun,

On Mon, 8 Jan 2007, Tejun Heo wrote:

> > Disks in DS-1220 show up, kinda, but don't work.  Errors reading /
> > writing blocks.  Tried a single disk in both a PMP port and a direct
> > (non-sil3726) port.
>
> From full dmesg...
>
> The following is when the drive is attached via PMP.
>
> 18:29:55 ata3.01: (irq_stat 0x00020002, device error via D2H FIS)
> 18:29:55 ata3.01: tag 0 cmd 0xc8 Emask 0x1 stat 0x50 err 0x0 (device error)
>
> And directly.
>
> 19:30:23 ata6.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x0
> 19:30:23 ata6.00: (irq_stat 0x00060002, device error via D2H FIS)
> 19:30:23 ata6.00: tag 0 cmd 0xc4 Emask 0x1 stat 0x50 err 0x0 (device error)
> 19:30:23 ata6: EH complete
>
> Looks like a dead drive to me.  Care to post the result of 'smartctl -d
> ata -a /dev/sdX' and test other drives?

I tried another disk (but of the same type), and got the same results both
direct and via PMP.

Are these disks too old to be hot-plugged?  (but I recall the
identical errors happening on boot after I power-cycled the enclosure
and the host...)

Smartctl says:

smartctl -d ata -a /dev/sdd
smartctl version 5.34 [i686-pc-linux-gnu] Copyright (C) 2002-5 Bruce Allen
Home page is http://smartmontools.sourceforge.net/

=== START OF INFORMATION SECTION ===
Model Family:     Western Digital Caviar SE (Serial ATA) family
Device Model:     WDC WD2500JD-00GBB0
Serial Number:    WD-WMAEP2562042
Firmware Version: 02.05D02
User Capacity:    250,059,350,016 bytes
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   6
ATA Standard is:  Exact ATA specification draft version not indicated
Local Time is:    Tue Jan  9 09:24:43 2007 PST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x82) Offline data collection activity
                                        was completed without error.
                                        Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0) The previous self-test routine completed
                                        without error or no self-test has ever
                                        been run.
Total time to complete Offline
data collection:                 (7599) seconds.
Offline data collection
capabilities:                    (0x79) SMART execute Offline immediate.
                                        No Auto Offline data collection support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        No General Purpose Logging support.
Short self-test routine
recommended polling time:        (   2) minutes.
Extended self-test routine
recommended polling time:        (  95) minutes.
Conveyance self-test routine
recommended polling time:        (   5) minutes.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000b   200   200   051    Pre-fail  Always       -       0
  3 Spin_Up_Time            0x0007   120   116   021    Pre-fail  Always       -       4533
  4 Start_Stop_Count        0x0032   100   100   040    Old_age   Always       -       36
  5 Reallocated_Sector_Ct   0x0033   200   200   140    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x000b   200   200   051    Pre-fail  Always       -       0
  9 Power_On_Hours          0x0032   081   081   000    Old_age   Always       -       14040
 10 Spin_Retry_Count        0x0013   100   253   051    Pre-fail  Always       -       0
 11 Calibration_Retry_Count 0x0013   100   253   051    Pre-fail  Always       -       0
 12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       36
194 Temperature_Celsius     0x0022   121   253   000    Old_age   Always       -       29
196 Reallocated_Event_Count 0x0032   200   200   000    Old_age   Always       -       0
197 Current_Pending_Sector  0x0012   200   200   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0012   200   200   000    Old_age   Always       -       0
199 UDMA_CRC_Error_Count    0x000a   200   200   000    Old_age   Always       -       0
200 Multi_Zone_Error_Rate   0x0009   200   155   051    Pre-fail  Offline      -       0

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
No self-tests have been logged.  [To run self-tests, use: smartctl -t]

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

========


Sorry for the delay.

Let me know if I can test anything else.... different versions, etc.

I'll buy a new disk this weekend and try that out as well.

- Brad

Re: Norco DS-1220 (sil3726+sil3124) / libata-tj bug report

[Brad Fitzpatrick]

On Sat, 13 Jan 2007, Brad Fitzpatrick wrote:

> I tried another disk (but of the same type), and got the same results both
> direct and via PMP.
>
> Are these disks too old to be hot-plugged?  (but I recall the
> identical errors happening on boot after I power-cycled the enclosure
> and the host...)

Conclusion to this story, for posterity:

Seems to be the disk type.

I have six Western Digital WD2500JD-00GBB0.  Tried two both direct and
PMP, no success.

Went and bought a new Segate ST3500630AS 500GB and it hotplugged both
direct and PMP without problems.

So I guess the old WD2500JD-00GBB0 aren't compatible?

- Brad

Re: Norco DS-1220 (sil3726+sil3124) / libata-tj bug report

[Tejun Heo]

Brad Fitzpatrick wrote:
> On Sat, 13 Jan 2007, Brad Fitzpatrick wrote:
> 
>> I tried another disk (but of the same type), and got the same results both
>> direct and via PMP.
>>
>> Are these disks too old to be hot-plugged?  (but I recall the
>> identical errors happening on boot after I power-cycled the enclosure
>> and the host...)
> 
> Conclusion to this story, for posterity:
> 
> Seems to be the disk type.
> 
> I have six Western Digital WD2500JD-00GBB0.  Tried two both direct and
> PMP, no success.
> 
> Went and bought a new Segate ST3500630AS 500GB and it hotplugged both
> direct and PMP without problems.
> 
> So I guess the old WD2500JD-00GBB0 aren't compatible?

I'll have to ask other people about this.  Don't have that particular drive.

-- 
tejun

Re: Norco DS-1220 (sil3726+sil3124) / libata-tj bug report

[Jim Paris]

Brad Fitzpatrick wrote:
> Conclusion to this story, for posterity:
> 
> Seems to be the disk type.
> 
> I have six Western Digital WD2500JD-00GBB0.  Tried two both direct and
> PMP, no success.
> 
> Went and bought a new Segate ST3500630AS 500GB and it hotplugged both
> direct and PMP without problems.
> 
> So I guess the old WD2500JD-00GBB0 aren't compatible?

Hi Brad,

I came across a WD2500KS-00MJB0, and recalling this thread I gave it a
try on my system.  It worked fine connected through the PMP on my
kernel (2.6.17.4 + libata-tj-2.6.17.4-20060710).  This disk is a newer
revision, so perhaps bugs were fixed, but it's also possible that you
just got unlucky with bad disks.  At the very least the entire WD2500
line isn't necessarily bad.

-jim