From: Brian Candler <B.Candler@pobox.com>
To: NeilBrown <neilb@suse.de>
Cc: Sebastian Riemer <sebastian.riemer@profitbricks.com>,
linux-raid@vger.kernel.org
Subject: Re: Assembly failure
Date: Wed, 11 Jul 2012 08:58:18 +0100 [thread overview]
Message-ID: <20120711075818.GA30527@nsrc.org> (raw)
In-Reply-To: <20120711124316.206ab3d9@notabene.brown>
On Wed, Jul 11, 2012 at 12:43:16PM +1000, NeilBrown wrote:
> As others have suggested, there is probably some hardware problem somewhere.
> It looks like sdr failed first, around "Jul 3 04:21:50 2012".
> The array continued working until about 06:36 when sdu then sds failed.
> Since then it doesn't look like much if anything has been written to the
> array - but I cannot be completely certain.
Good spotting, how did you work that out from `mdadm --examine` output? I
see 8 drives in state "clean" and four in state "active". Three have update
times on Jul 3, two on Jul 7, the rest on Jul 10. I couldn't see anything
which obviously jumps out as "FAULTY".
You're right that the system has been not doing any writes recently.
> Do you have kernel logs from the morning of 3rd July?
Logs at end of mail. It looks like sde failed, then a few seconds later
reattached itself as sdn - and a couple of hours later more things started
to fail (looks like sdh failed and reattached as sdo, and a minute later sdf
failed and reattached as sdp). Very odd that these devices should fail so
close together, maybe a power glitch? After that even more drives
apparently started to fail.
SMART shows 7 drives have reported at least one uncorrectable error:
root@dev-storage1:~# for i in /dev/sd?; do smartctl -A $i | grep -i correct; done
198 Offline_Uncorrectable 0x0030 200 200 000 Old_age Offline - 0
187 Reported_Uncorrect 0x0032 100 100 000 Old_age Always - 0
198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0
187 Reported_Uncorrect 0x0032 092 092 000 Old_age Always - 8
198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0
187 Reported_Uncorrect 0x0032 098 098 000 Old_age Always - 2
198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0
187 Reported_Uncorrect 0x0032 099 099 000 Old_age Always - 1
198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0
187 Reported_Uncorrect 0x0032 100 100 000 Old_age Always - 0
198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0
187 Reported_Uncorrect 0x0032 100 100 000 Old_age Always - 0
198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0
187 Reported_Uncorrect 0x0032 100 100 000 Old_age Always - 0
198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0
187 Reported_Uncorrect 0x0032 100 100 000 Old_age Always - 0
198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0
187 Reported_Uncorrect 0x0032 095 095 000 Old_age Always - 5
198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0
187 Reported_Uncorrect 0x0032 092 092 000 Old_age Always - 8
198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0
187 Reported_Uncorrect 0x0032 098 098 000 Old_age Always - 2
198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0
187 Reported_Uncorrect 0x0032 093 093 000 Old_age Always - 7
198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0
And three have very high seek error rates:
root@dev-storage1:~# for i in /dev/sd?; do smartctl -A $i | grep -i seek_error; done
7 Seek_Error_Rate 0x002e 200 200 000 Old_age Always - 0
7 Seek_Error_Rate 0x000f 063 060 030 Pre-fail Always - 2233869
7 Seek_Error_Rate 0x000f 063 060 030 Pre-fail Always - 2231308
7 Seek_Error_Rate 0x000f 063 060 030 Pre-fail Always - 2199098
7 Seek_Error_Rate 0x000f 063 060 030 Pre-fail Always - 2250443
7 Seek_Error_Rate 0x000f 063 060 030 Pre-fail Always - 2220215
7 Seek_Error_Rate 0x000f 060 059 030 Pre-fail Always - 8592064174
7 Seek_Error_Rate 0x000f 063 060 030 Pre-fail Always - 2238212
7 Seek_Error_Rate 0x000f 063 060 030 Pre-fail Always - 4297171738
7 Seek_Error_Rate 0x000f 063 060 030 Pre-fail Always - 2170378
7 Seek_Error_Rate 0x000f 063 060 030 Pre-fail Always - 2253934
7 Seek_Error_Rate 0x000f 063 060 030 Pre-fail Always - 2192100
7 Seek_Error_Rate 0x000f 063 060 030 Pre-fail Always - 4297224551
BTW these are all Seagate ST3000DM001. Yes, I know :-(
So this doesn't look good. Having a go at reassembly anyway:
root@dev-storage1:~# mdadm -S /dev/md127
mdadm: stopped /dev/md127
root@dev-storage1:~# cat /proc/mdstat
Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5] [raid4] [raid10]
unused devices: <none>
root@dev-storage1:~# ls /dev/sd*
/dev/sda /dev/sda5 /dev/sde /dev/sdj /dev/sdn /dev/sdq
/dev/sda1 /dev/sdb /dev/sdf /dev/sdk /dev/sdo
/dev/sda2 /dev/sdc /dev/sdi /dev/sdl /dev/sdp
root@dev-storage1:~# mdadm --assemble --force /dev/md/storage1 /dev/sd{b,c,e,f,i,j,k,l,n,o,p,q}
mdadm: forcing event count in /dev/sdc(2) from 29355 upto 29374
mdadm: forcing event count in /dev/sdn(3) from 29352 upto 29374
mdadm: forcing event count in /dev/sdq(5) from 29312 upto 29374
mdadm: forcing event count in /dev/sdo(4) from 29272 upto 29374
mdadm: forcing event count in /dev/sdp(1) from 20228 upto 29374
mdadm: clearing FAULTY flag for device 10 in /dev/md/storage1 for /dev/sdp
mdadm: clearing FAULTY flag for device 8 in /dev/md/storage1 for /dev/sdn
mdadm: clearing FAULTY flag for device 9 in /dev/md/storage1 for /dev/sdo
mdadm: Marking array /dev/md/storage1 as 'clean'
mdadm: /dev/md/storage1 assembled from 12 drives - not enough to start the array.
root@dev-storage1:~# cat /proc/mdstat
Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5] [raid4] [raid10]
md127 : inactive sdb[0](S) sdl[11](S) sdk[10](S) sdj[9](S) sdi[8](S) sde[7](S) sdf[6](S) sdq[5](S) sdo[4](S) sdn[3](S) sdc[2](S) sdp[1](S)
35163186720 blocks super 1.2
unused devices: <none>
> Don't try to --create --assume-clean, it isn't needed.
...
> When you re-assemble it won't include all the devices in the array - just
> enough to make the array functional. You would then need to add the others
> back in if you trust them.
I am guessing that it's not starting the array because devices 8 and 9 were
both marked as failed, which are two halves of the same pair.
This is a test system but I will exchange at least the three drives with the
high seek error rates.
One final point. I would like to be able to monitor for suspect or failed
drives. Is my best bet to look at /proc/mdstat output and identify drives
which have been kicked out of the array? Or to monitor SMART variables (in
that case though I need to decide which ones are the most important to
monitor, and what thresholds to set)?
It would be really useful if the kernel itself kept some per-drive counters
for I/O failures, but if it does, I can't find them.
http://www.kernel.org/doc/Documentation/block/stat.txt
Regards,
Brian.
Jul 3 04:22:33 dev-storage1 kernel: [50147.362942] sd 4:0:3:0: [sde] Synchronizing SCSI cache
Jul 3 04:22:33 dev-storage1 kernel: [50147.364646] end_request: I/O error, dev sde, sector 8
Jul 3 04:22:33 dev-storage1 kernel: [50147.364656] md: super_written gets error=-5, uptodate=0
Jul 3 04:22:33 dev-storage1 kernel: [50147.364663] md/raid10:md127: Disk failure on sde, disabling device.
Jul 3 04:22:33 dev-storage1 kernel: [50147.364665] md/raid10:md127: Operation continuing on 11 devices.
Jul 3 04:22:33 dev-storage1 kernel: [50147.364710] sd 4:0:3:0: [sde] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
Jul 3 04:22:33 dev-storage1 kernel: [50147.364881] mpt2sas0: removing handle(0x000c), sas_addr(0x4433221100000000)
Jul 3 04:22:34 dev-storage1 kernel: [50147.437339] RAID10 conf printout:
Jul 3 04:22:34 dev-storage1 kernel: [50147.437344] --- wd:11 rd:12
Jul 3 04:22:34 dev-storage1 kernel: [50147.437347] disk 0, wo:0, o:1, dev:sdb
Jul 3 04:22:34 dev-storage1 kernel: [50147.437350] disk 1, wo:1, o:0, dev:sde
Jul 3 04:22:34 dev-storage1 kernel: [50147.437352] disk 2, wo:0, o:1, dev:sdc
Jul 3 04:22:34 dev-storage1 kernel: [50147.437354] disk 3, wo:0, o:1, dev:sdd
Jul 3 04:22:34 dev-storage1 kernel: [50147.437357] disk 4, wo:0, o:1, dev:sdh
Jul 3 04:22:34 dev-storage1 kernel: [50147.437359] disk 5, wo:0, o:1, dev:sdf
Jul 3 04:22:34 dev-storage1 kernel: [50147.437361] disk 6, wo:0, o:1, dev:sdi
Jul 3 04:22:34 dev-storage1 kernel: [50147.437363] disk 7, wo:0, o:1, dev:sdg
Jul 3 04:22:34 dev-storage1 kernel: [50147.437366] disk 8, wo:0, o:1, dev:sdj
Jul 3 04:22:34 dev-storage1 kernel: [50147.437368] disk 9, wo:0, o:1, dev:sdk
Jul 3 04:22:34 dev-storage1 kernel: [50147.437370] disk 10, wo:0, o:1, dev:sdl
Jul 3 04:22:34 dev-storage1 kernel: [50147.437372] disk 11, wo:0, o:1, dev:sdm
Jul 3 04:22:34 dev-storage1 kernel: [50147.437429] RAID10 conf printout:
Jul 3 04:22:34 dev-storage1 kernel: [50147.437434] --- wd:11 rd:12
Jul 3 04:22:34 dev-storage1 kernel: [50147.437437] disk 0, wo:0, o:1, dev:sdb
Jul 3 04:22:34 dev-storage1 kernel: [50147.437439] disk 2, wo:0, o:1, dev:sdc
Jul 3 04:22:34 dev-storage1 kernel: [50147.437441] disk 3, wo:0, o:1, dev:sdd
Jul 3 04:22:34 dev-storage1 kernel: [50147.437444] disk 4, wo:0, o:1, dev:sdh
Jul 3 04:22:34 dev-storage1 kernel: [50147.437446] disk 5, wo:0, o:1, dev:sdf
Jul 3 04:22:34 dev-storage1 kernel: [50147.437448] disk 6, wo:0, o:1, dev:sdi
Jul 3 04:22:34 dev-storage1 kernel: [50147.437450] disk 7, wo:0, o:1, dev:sdg
Jul 3 04:22:34 dev-storage1 kernel: [50147.437452] disk 8, wo:0, o:1, dev:sdj
Jul 3 04:22:34 dev-storage1 kernel: [50147.437454] disk 9, wo:0, o:1, dev:sdk
Jul 3 04:22:34 dev-storage1 kernel: [50147.437457] disk 10, wo:0, o:1, dev:sdl
Jul 3 04:22:34 dev-storage1 kernel: [50147.437459] disk 11, wo:0, o:1, dev:sdm
Jul 3 04:22:47 dev-storage1 kernel: [50161.168292] scsi 4:0:8:0: Direct-Access ATA ST3000DM001-9YN1 CC4C PQ: 0 ANSI: 6
Jul 3 04:22:47 dev-storage1 kernel: [50161.168302] scsi 4:0:8:0: SATA: handle(0x000c), sas_addr(0x4433221100000000), phy(0), device_name(0x5000c5004a37a3ae)
Jul 3 04:22:47 dev-storage1 kernel: [50161.168307] scsi 4:0:8:0: SATA: enclosure_logical_id(0x500605b00448c4f0), slot(3)
Jul 3 04:22:47 dev-storage1 kernel: [50161.168457] scsi 4:0:8:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
Jul 3 04:22:47 dev-storage1 kernel: [50161.168465] scsi 4:0:8:0: qdepth(32), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
Jul 3 04:22:47 dev-storage1 kernel: [50161.168686] sd 4:0:8:0: Attached scsi generic sg4 type 0
Jul 3 04:22:47 dev-storage1 kernel: [50161.170776] sd 4:0:8:0: [sdn] physical block alignment offset: 4096
Jul 3 04:22:47 dev-storage1 kernel: [50161.170783] sd 4:0:8:0: [sdn] 5860533168 512-byte logical blocks: (3.00 TB/2.72 TiB)
Jul 3 04:22:47 dev-storage1 kernel: [50161.170786] sd 4:0:8:0: [sdn] 4096-byte physical blocks
Jul 3 04:22:47 dev-storage1 kernel: [50161.233278] sd 4:0:8:0: [sdn] Write Protect is off
Jul 3 04:22:47 dev-storage1 kernel: [50161.233283] sd 4:0:8:0: [sdn] Mode Sense: 7f 00 00 08
Jul 3 04:22:47 dev-storage1 kernel: [50161.233981] sd 4:0:8:0: [sdn] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
Jul 3 04:22:47 dev-storage1 kernel: [50161.325272] sdn: unknown partition table
Jul 3 04:22:47 dev-storage1 kernel: [50161.392086] sd 4:0:8:0: [sdn] Attached SCSI disk
Jul 3 06:37:00 dev-storage1 kernel: [58191.291518] sd 4:0:6:0: [sdh] Synchronizing SCSI cache
Jul 3 06:37:00 dev-storage1 kernel: [58191.291586] sd 4:0:6:0: [sdh] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
Jul 3 06:37:00 dev-storage1 kernel: [58191.291975] md: super_written gets error=-19, uptodate=0
Jul 3 06:37:00 dev-storage1 kernel: [58191.291982] md/raid10:md127: Disk failure on sdh, disabling device.
Jul 3 06:37:00 dev-storage1 kernel: [58191.291985] md/raid10:md127: Operation continuing on 10 devices.
Jul 3 06:37:00 dev-storage1 kernel: [58191.292675] mpt2sas0: removing handle(0x000f), sas_addr(0x4433221105000000)
Jul 3 06:37:00 dev-storage1 kernel: [58191.363950] RAID10 conf printout:
Jul 3 06:37:00 dev-storage1 kernel: [58191.363955] --- wd:10 rd:12
Jul 3 06:37:00 dev-storage1 kernel: [58191.363958] disk 0, wo:0, o:1, dev:sdb
Jul 3 06:37:00 dev-storage1 kernel: [58191.363961] disk 2, wo:0, o:1, dev:sdc
Jul 3 06:37:00 dev-storage1 kernel: [58191.363963] disk 3, wo:0, o:1, dev:sdd
Jul 3 06:37:00 dev-storage1 kernel: [58191.363965] disk 4, wo:1, o:0, dev:sdh
Jul 3 06:37:00 dev-storage1 kernel: [58191.363967] disk 5, wo:0, o:1, dev:sdf
Jul 3 06:37:00 dev-storage1 kernel: [58191.363970] disk 6, wo:0, o:1, dev:sdi
Jul 3 06:37:00 dev-storage1 kernel: [58191.363972] disk 7, wo:0, o:1, dev:sdg
Jul 3 06:37:00 dev-storage1 kernel: [58191.363974] disk 8, wo:0, o:1, dev:sdj
Jul 3 06:37:00 dev-storage1 kernel: [58191.363976] disk 9, wo:0, o:1, dev:sdk
Jul 3 06:37:00 dev-storage1 kernel: [58191.363979] disk 10, wo:0, o:1, dev:sdl
Jul 3 06:37:00 dev-storage1 kernel: [58191.363981] disk 11, wo:0, o:1, dev:sdm
Jul 3 06:37:00 dev-storage1 kernel: [58191.364014] RAID10 conf printout:
Jul 3 06:37:00 dev-storage1 kernel: [58191.364018] --- wd:10 rd:12
Jul 3 06:37:00 dev-storage1 kernel: [58191.364021] disk 0, wo:0, o:1, dev:sdb
Jul 3 06:37:00 dev-storage1 kernel: [58191.364024] disk 2, wo:0, o:1, dev:sdc
Jul 3 06:37:00 dev-storage1 kernel: [58191.364026] disk 3, wo:0, o:1, dev:sdd
Jul 3 06:37:00 dev-storage1 kernel: [58191.364028] disk 5, wo:0, o:1, dev:sdf
Jul 3 06:37:00 dev-storage1 kernel: [58191.364030] disk 6, wo:0, o:1, dev:sdi
Jul 3 06:37:00 dev-storage1 kernel: [58191.364033] disk 7, wo:0, o:1, dev:sdg
Jul 3 06:37:00 dev-storage1 kernel: [58191.364035] disk 8, wo:0, o:1, dev:sdj
Jul 3 06:37:00 dev-storage1 kernel: [58191.364037] disk 9, wo:0, o:1, dev:sdk
Jul 3 06:37:00 dev-storage1 kernel: [58191.364039] disk 10, wo:0, o:1, dev:sdl
Jul 3 06:37:00 dev-storage1 kernel: [58191.364041] disk 11, wo:0, o:1, dev:sdm
Jul 3 06:37:14 dev-storage1 kernel: [58204.853102] scsi 4:0:9:0: Direct-Access ATA ST3000DM001-9YN1 CC4C PQ: 0 ANSI: 6
Jul 3 06:37:14 dev-storage1 kernel: [58204.853112] scsi 4:0:9:0: SATA: handle(0x000f), sas_addr(0x4433221105000000), phy(5), device_name(0x5000c5004a44edbe)
Jul 3 06:37:14 dev-storage1 kernel: [58204.853116] scsi 4:0:9:0: SATA: enclosure_logical_id(0x500605b00448c4f0), slot(6)
Jul 3 06:37:14 dev-storage1 kernel: [58204.853292] scsi 4:0:9:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
Jul 3 06:37:14 dev-storage1 kernel: [58204.853299] scsi 4:0:9:0: qdepth(32), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
Jul 3 06:37:14 dev-storage1 kernel: [58204.853491] sd 4:0:9:0: Attached scsi generic sg7 type 0
Jul 3 06:37:14 dev-storage1 kernel: [58204.853882] sd 4:0:9:0: [sdo] physical block alignment offset: 4096
Jul 3 06:37:14 dev-storage1 kernel: [58204.853892] sd 4:0:9:0: [sdo] 5860533168 512-byte logical blocks: (3.00 TB/2.72 TiB)
Jul 3 06:37:14 dev-storage1 kernel: [58204.853897] sd 4:0:9:0: [sdo] 4096-byte physical blocks
Jul 3 06:37:14 dev-storage1 kernel: [58204.920533] sd 4:0:9:0: [sdo] Write Protect is off
Jul 3 06:37:14 dev-storage1 kernel: [58204.920539] sd 4:0:9:0: [sdo] Mode Sense: 7f 00 00 08
Jul 3 06:37:14 dev-storage1 kernel: [58204.949593] sd 4:0:9:0: [sdo] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
Jul 3 06:37:14 dev-storage1 kernel: [58205.077376] sdo: unknown partition table
Jul 3 06:37:14 dev-storage1 kernel: [58205.145744] sd 4:0:9:0: [sdo] Attached SCSI disk
Jul 3 06:38:15 dev-storage1 kernel: [58266.076919] sd 4:0:4:0: [sdf] Synchronizing SCSI cache
Jul 3 06:38:15 dev-storage1 kernel: [58266.077767] sd 4:0:4:0: [sdf] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
Jul 3 06:38:15 dev-storage1 kernel: [58266.078218] mpt2sas0: removing handle(0x000d), sas_addr(0x4433221104000000)
Jul 3 06:38:15 dev-storage1 kernel: [58266.078681] md: super_written gets error=-19, uptodate=0
Jul 3 06:38:16 dev-storage1 kernel: [58266.356847] md: super_written gets error=-19, uptodate=0
Jul 3 06:38:16 dev-storage1 kernel: [58266.381809] md: super_written gets error=-19, uptodate=0
Jul 3 06:38:18 dev-storage1 kernel: [58268.351226] md: super_written gets error=-19, uptodate=0
Jul 3 06:38:18 dev-storage1 kernel: [58268.381174] md: super_written gets error=-19, uptodate=0
Jul 3 06:38:18 dev-storage1 kernel: [58268.606432] md: super_written gets error=-19, uptodate=0
Jul 3 06:38:18 dev-storage1 kernel: [58268.643731] md: super_written gets error=-19, uptodate=0
Jul 3 06:38:20 dev-storage1 kernel: [58270.676566] md: super_written gets error=-19, uptodate=0
Jul 3 06:38:20 dev-storage1 kernel: [58270.727079] md: super_written gets error=-19, uptodate=0
Jul 3 06:38:20 dev-storage1 kernel: [58270.951730] md: super_written gets error=-19, uptodate=0
Jul 3 06:38:20 dev-storage1 kernel: [58270.986091] md: super_written gets error=-19, uptodate=0
Jul 3 06:38:22 dev-storage1 kernel: [58273.021826] md: super_written gets error=-19, uptodate=0
Jul 3 06:38:22 dev-storage1 kernel: [58273.100664] md: super_written gets error=-19, uptodate=0
Jul 3 06:38:22 dev-storage1 kernel: [58273.122092] md: super_written gets error=-19, uptodate=0
Jul 3 06:38:23 dev-storage1 kernel: [58273.324949] md: super_written gets error=-19, uptodate=0
Jul 3 06:38:23 dev-storage1 kernel: [58273.351418] md: super_written gets error=-19, uptodate=0
Jul 3 06:38:24 dev-storage1 kernel: [58274.318169] md: super_written gets error=-19, uptodate=0
Jul 3 06:38:24 dev-storage1 kernel: [58274.351982] md: super_written gets error=-19, uptodate=0
Jul 3 06:38:24 dev-storage1 kernel: [58274.609269] md: super_written gets error=-19, uptodate=0
Jul 3 06:38:24 dev-storage1 kernel: [58274.636725] md: super_written gets error=-19, uptodate=0
Jul 3 06:38:29 dev-storage1 kernel: [58279.573103] scsi 4:0:10:0: Direct-Access ATA ST3000DM001-9YN1 CC4C PQ: 0 ANSI: 6
Jul 3 06:38:29 dev-storage1 kernel: [58279.573113] scsi 4:0:10:0: SATA: handle(0x000d), sas_addr(0x4433221104000000), phy(4), device_name(0x5000c5004a123b93)
Jul 3 06:38:29 dev-storage1 kernel: [58279.573117] scsi 4:0:10:0: SATA: enclosure_logical_id(0x500605b00448c4f0), slot(7)
Jul 3 06:38:29 dev-storage1 kernel: [58279.573252] scsi 4:0:10:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
Jul 3 06:38:29 dev-storage1 kernel: [58279.573257] scsi 4:0:10:0: qdepth(32), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
Jul 3 06:38:29 dev-storage1 kernel: [58279.573450] sd 4:0:10:0: Attached scsi generic sg5 type 0
Jul 3 06:38:29 dev-storage1 kernel: [58279.573754] sd 4:0:10:0: [sdp] physical block alignment offset: 4096
Jul 3 06:38:29 dev-storage1 kernel: [58279.573764] sd 4:0:10:0: [sdp] 5860533168 512-byte logical blocks: (3.00 TB/2.72 TiB)
Jul 3 06:38:29 dev-storage1 kernel: [58279.573768] sd 4:0:10:0: [sdp] 4096-byte physical blocks
Jul 3 06:38:29 dev-storage1 kernel: [58279.626371] sd 4:0:10:0: [sdp] Write Protect is off
Jul 3 06:38:29 dev-storage1 kernel: [58279.626376] sd 4:0:10:0: [sdp] Mode Sense: 7f 00 00 08
Jul 3 06:38:29 dev-storage1 kernel: [58279.627052] sd 4:0:10:0: [sdp] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
Jul 3 06:38:29 dev-storage1 kernel: [58279.722780] sdp: unknown partition table
Jul 3 06:38:29 dev-storage1 kernel: [58279.785171] sd 4:0:10:0: [sdp] Attached SCSI disk
Jul 3 06:38:45 dev-storage1 kernel: [58296.071974] md: super_written gets error=-19, uptodate=0
Jul 3 06:38:45 dev-storage1 kernel: [58296.104706] md: super_written gets error=-19, uptodate=0
Jul 3 06:38:45 dev-storage1 kernel: [58296.125410] md: super_written gets error=-19, uptodate=0
Jul 3 06:38:46 dev-storage1 kernel: [58296.347134] md: super_written gets error=-19, uptodate=0
Jul 3 06:38:46 dev-storage1 kernel: [58296.373160] md: super_written gets error=-19, uptodate=0
Jul 3 14:00:27 dev-storage1 kernel: [84721.683301] md: super_written gets error=-19, uptodate=0
Jul 3 14:00:27 dev-storage1 kernel: [84721.717956] md: super_written gets error=-19, uptodate=0
Jul 3 14:00:27 dev-storage1 kernel: [84721.974395] md: super_written gets error=-19, uptodate=0
Jul 3 14:00:27 dev-storage1 kernel: [84721.997145] md: super_written gets error=-19, uptodate=0
Jul 3 14:01:01 dev-storage1 kernel: [84755.610249] md: super_written gets error=-19, uptodate=0
Jul 3 14:01:01 dev-storage1 kernel: [84755.652918] md: super_written gets error=-19, uptodate=0
Jul 3 14:01:01 dev-storage1 kernel: [84755.673944] md: super_written gets error=-19, uptodate=0
Jul 3 14:01:01 dev-storage1 kernel: [84755.694312] quiet_error: 24 callbacks suppressed
Jul 3 14:01:01 dev-storage1 kernel: [84755.694318] Buffer I/O error on device md127, logical block 2067791905
Jul 3 14:01:01 dev-storage1 kernel: [84755.694326] lost page write due to I/O error on md127
Jul 3 14:01:01 dev-storage1 kernel: [84755.897413] md: super_written gets error=-19, uptodate=0
Jul 3 14:01:01 dev-storage1 kernel: [84755.918495] md: super_written gets error=-19, uptodate=0
Jul 4 14:00:34 dev-storage1 kernel: [170882.380831] md: super_written gets error=-19, uptodate=0
Jul 4 14:00:34 dev-storage1 kernel: [170882.415605] md: super_written gets error=-19, uptodate=0
Jul 4 14:00:34 dev-storage1 kernel: [170882.671923] md: super_written gets error=-19, uptodate=0
Jul 4 14:00:34 dev-storage1 kernel: [170882.694429] md: super_written gets error=-19, uptodate=0
Jul 4 14:01:08 dev-storage1 kernel: [170916.387597] md: super_written gets error=-19, uptodate=0
Jul 4 14:01:08 dev-storage1 kernel: [170916.423033] md: super_written gets error=-19, uptodate=0
Jul 4 14:01:08 dev-storage1 kernel: [170916.444517] Buffer I/O error on device md127, logical block 2067791905
Jul 4 14:01:08 dev-storage1 kernel: [170916.444524] lost page write due to I/O error on md127
Jul 4 14:01:08 dev-storage1 kernel: [170916.646795] md: super_written gets error=-19, uptodate=0
Jul 4 14:01:08 dev-storage1 kernel: [170916.667910] md: super_written gets error=-19, uptodate=0
Jul 5 06:25:07 dev-storage1 kernel: [229786.969375] md: super_written gets error=-19, uptodate=0
Jul 5 06:25:07 dev-storage1 kernel: [229787.001133] md: super_written gets error=-19, uptodate=0
Jul 5 06:25:07 dev-storage1 kernel: [229787.264457] md: super_written gets error=-19, uptodate=0
Jul 5 06:25:07 dev-storage1 kernel: [229787.284359] md: super_written gets error=-19, uptodate=0
Jul 5 06:25:41 dev-storage1 kernel: [229821.534543] md: super_written gets error=-19, uptodate=0
Jul 5 06:25:41 dev-storage1 kernel: [229821.568091] md: super_written gets error=-19, uptodate=0
Jul 5 06:25:42 dev-storage1 kernel: [229821.793719] md: super_written gets error=-19, uptodate=0
Jul 5 06:25:42 dev-storage1 kernel: [229821.821779] md: super_written gets error=-19, uptodate=0
Jul 5 14:00:41 dev-storage1 kernel: [257043.062362] md: super_written gets error=-19, uptodate=0
Jul 5 14:00:41 dev-storage1 kernel: [257043.096332] md: super_written gets error=-19, uptodate=0
Jul 5 14:00:41 dev-storage1 kernel: [257043.353502] md: super_written gets error=-19, uptodate=0
Jul 5 14:00:41 dev-storage1 kernel: [257043.372982] md: super_written gets error=-19, uptodate=0
Jul 5 14:01:15 dev-storage1 kernel: [257077.148922] md: super_written gets error=-19, uptodate=0
Jul 5 14:01:15 dev-storage1 kernel: [257077.183874] md: super_written gets error=-19, uptodate=0
Jul 5 14:01:15 dev-storage1 kernel: [257077.205482] Buffer I/O error on device md127, logical block 2067791905
Jul 5 14:01:15 dev-storage1 kernel: [257077.205491] lost page write due to I/O error on md127
Jul 5 14:01:15 dev-storage1 kernel: [257077.408139] md: super_written gets error=-19, uptodate=0
Jul 5 14:01:15 dev-storage1 kernel: [257077.430487] md: super_written gets error=-19, uptodate=0
Jul 6 06:25:08 dev-storage1 kernel: [315941.667994] md: super_written gets error=-19, uptodate=0
Jul 6 06:25:08 dev-storage1 kernel: [315941.701458] md: super_written gets error=-19, uptodate=0
Jul 6 06:25:08 dev-storage1 kernel: [315941.959147] md: super_written gets error=-19, uptodate=0
Jul 6 06:25:08 dev-storage1 kernel: [315941.980677] md: super_written gets error=-19, uptodate=0
Jul 6 06:25:42 dev-storage1 kernel: [315975.882227] md: super_written gets error=-19, uptodate=0
Jul 6 06:25:42 dev-storage1 kernel: [315975.911833] md: super_written gets error=-19, uptodate=0
Jul 6 06:25:42 dev-storage1 kernel: [315976.141403] md: super_written gets error=-19, uptodate=0
Jul 6 06:25:42 dev-storage1 kernel: [315976.169041] md: super_written gets error=-19, uptodate=0
Jul 6 14:00:48 dev-storage1 kernel: [343203.728029] md: super_written gets error=-19, uptodate=0
Jul 6 14:00:48 dev-storage1 kernel: [343203.761823] md: super_written gets error=-19, uptodate=0
Jul 6 14:00:48 dev-storage1 kernel: [343204.019107] md: super_written gets error=-19, uptodate=0
Jul 6 14:00:48 dev-storage1 kernel: [343204.041347] md: super_written gets error=-19, uptodate=0
Jul 6 14:01:22 dev-storage1 kernel: [343238.117700] md: super_written gets error=-19, uptodate=0
Jul 6 14:01:22 dev-storage1 kernel: [343238.153053] md: super_written gets error=-19, uptodate=0
Jul 6 14:01:22 dev-storage1 kernel: [343238.173113] Buffer I/O error on device md127, logical block 2067791905
Jul 6 14:01:22 dev-storage1 kernel: [343238.173123] lost page write due to I/O error on md127
Jul 6 14:01:22 dev-storage1 kernel: [343238.372889] md: super_written gets error=-19, uptodate=0
Jul 6 14:01:22 dev-storage1 kernel: [343238.393954] md: super_written gets error=-19, uptodate=0
Jul 7 06:25:07 dev-storage1 kernel: [402094.372432] md: super_written gets error=-19, uptodate=0
Jul 7 06:25:07 dev-storage1 kernel: [402094.405765] md: super_written gets error=-19, uptodate=0
Jul 7 06:25:07 dev-storage1 kernel: [402094.655548] md: super_written gets error=-19, uptodate=0
Jul 7 06:25:07 dev-storage1 kernel: [402094.676942] md: super_written gets error=-19, uptodate=0
Jul 7 06:25:42 dev-storage1 kernel: [402129.208784] md: super_written gets error=-19, uptodate=0
Jul 7 06:25:42 dev-storage1 kernel: [402129.244327] md: super_written gets error=-19, uptodate=0
Jul 7 06:25:42 dev-storage1 kernel: [402129.467991] md: super_written gets error=-19, uptodate=0
Jul 7 06:25:42 dev-storage1 kernel: [402129.491687] md: super_written gets error=-19, uptodate=0
Jul 7 14:00:55 dev-storage1 kernel: [429364.393602] md: super_written gets error=-19, uptodate=0
Jul 7 14:00:55 dev-storage1 kernel: [429364.443065] md: super_written gets error=-19, uptodate=0
Jul 7 14:01:37 dev-storage1 kernel: [429406.619062] sd 4:0:2:0: [sdd] Synchronizing SCSI cache
Jul 7 14:01:37 dev-storage1 kernel: [429406.619127] sd 4:0:2:0: [sdd] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
Jul 7 14:01:37 dev-storage1 kernel: [429406.619415] mpt2sas0: removing handle(0x000a), sas_addr(0x4433221102000000)
Jul 7 14:01:37 dev-storage1 kernel: [429406.860149] md: super_written gets error=-19, uptodate=0
Jul 7 14:01:37 dev-storage1 kernel: [429406.860155] md/raid10:md127: Disk failure on sdd, disabling device.
Jul 7 14:01:37 dev-storage1 kernel: [429406.860157] md/raid10:md127: Operation continuing on 9 devices.
Jul 7 14:01:37 dev-storage1 kernel: [429406.860177] md: super_written gets error=-19, uptodate=0
Jul 7 14:01:37 dev-storage1 kernel: [429406.888238] md: super_written gets error=-19, uptodate=0
Jul 7 14:01:37 dev-storage1 kernel: [429406.909143] md: super_written gets error=-19, uptodate=0
Jul 7 14:01:37 dev-storage1 kernel: [429406.930558] md: super_written gets error=-19, uptodate=0
Jul 7 14:01:37 dev-storage1 kernel: [429406.951439] RAID10 conf printout:
Jul 7 14:01:37 dev-storage1 kernel: [429406.951443] --- wd:9 rd:12
Jul 7 14:01:37 dev-storage1 kernel: [429406.951446] disk 0, wo:0, o:1, dev:sdb
Jul 7 14:01:37 dev-storage1 kernel: [429406.951449] disk 2, wo:0, o:1, dev:sdc
Jul 7 14:01:37 dev-storage1 kernel: [429406.951451] disk 3, wo:1, o:0, dev:sdd
Jul 7 14:01:37 dev-storage1 kernel: [429406.951453] disk 5, wo:0, o:1, dev:sdf
Jul 7 14:01:37 dev-storage1 kernel: [429406.951456] disk 6, wo:0, o:1, dev:sdi
Jul 7 14:01:37 dev-storage1 kernel: [429406.951458] disk 7, wo:0, o:1, dev:sdg
Jul 7 14:01:37 dev-storage1 kernel: [429406.951460] disk 8, wo:0, o:1, dev:sdj
Jul 7 14:01:37 dev-storage1 kernel: [429406.951462] disk 9, wo:0, o:1, dev:sdk
Jul 7 14:01:37 dev-storage1 kernel: [429406.951465] disk 10, wo:0, o:1, dev:sdl
Jul 7 14:01:37 dev-storage1 kernel: [429406.951467] disk 11, wo:0, o:1, dev:sdm
Jul 7 14:01:37 dev-storage1 kernel: [429406.951527] RAID10 conf printout:
Jul 7 14:01:37 dev-storage1 kernel: [429406.951532] --- wd:9 rd:12
Jul 7 14:01:37 dev-storage1 kernel: [429406.951535] disk 0, wo:0, o:1, dev:sdb
Jul 7 14:01:37 dev-storage1 kernel: [429406.951537] disk 2, wo:0, o:1, dev:sdc
Jul 7 14:01:37 dev-storage1 kernel: [429406.951540] disk 5, wo:0, o:1, dev:sdf
Jul 7 14:01:37 dev-storage1 kernel: [429406.951542] disk 6, wo:0, o:1, dev:sdi
Jul 7 14:01:37 dev-storage1 kernel: [429406.951544] disk 7, wo:0, o:1, dev:sdg
Jul 7 14:01:37 dev-storage1 kernel: [429406.951546] disk 8, wo:0, o:1, dev:sdj
Jul 7 14:01:37 dev-storage1 kernel: [429406.951549] disk 9, wo:0, o:1, dev:sdk
Jul 7 14:01:37 dev-storage1 kernel: [429406.951551] disk 10, wo:0, o:1, dev:sdl
Jul 7 14:01:37 dev-storage1 kernel: [429406.951553] disk 11, wo:0, o:1, dev:sdm
Jul 7 14:01:51 dev-storage1 kernel: [429420.898133] scsi 4:0:11:0: Direct-Access ATA ST3000DM001-9YN1 CC4C PQ: 0 ANSI: 6
Jul 7 14:01:51 dev-storage1 kernel: [429420.898143] scsi 4:0:11:0: SATA: handle(0x000a), sas_addr(0x4433221102000000), phy(2), device_name(0x5000c5004a44f42a)
Jul 7 14:01:51 dev-storage1 kernel: [429420.898147] scsi 4:0:11:0: SATA: enclosure_logical_id(0x500605b00448c4f0), slot(1)
Jul 7 14:01:51 dev-storage1 kernel: [429420.898290] scsi 4:0:11:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
Jul 7 14:01:51 dev-storage1 kernel: [429420.898297] scsi 4:0:11:0: qdepth(32), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
Jul 7 14:01:51 dev-storage1 kernel: [429420.898514] sd 4:0:11:0: Attached scsi generic sg3 type 0
Jul 7 14:01:51 dev-storage1 kernel: [429420.898858] sd 4:0:11:0: [sdq] physical block alignment offset: 4096
Jul 7 14:01:51 dev-storage1 kernel: [429420.898867] sd 4:0:11:0: [sdq] 5860533168 512-byte logical blocks: (3.00 TB/2.72 TiB)
Jul 7 14:01:51 dev-storage1 kernel: [429420.898872] sd 4:0:11:0: [sdq] 4096-byte physical blocks
Jul 7 14:01:51 dev-storage1 kernel: [429420.957177] sd 4:0:11:0: [sdq] Write Protect is off
Jul 7 14:01:51 dev-storage1 kernel: [429420.957183] sd 4:0:11:0: [sdq] Mode Sense: 7f 00 00 08
Jul 7 14:01:51 dev-storage1 kernel: [429420.957882] sd 4:0:11:0: [sdq] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
Jul 7 14:01:51 dev-storage1 kernel: [429421.030777] sdq: unknown partition table
Jul 7 14:01:51 dev-storage1 kernel: [429421.099310] sd 4:0:11:0: [sdq] Attached SCSI disk
Jul 7 14:02:07 dev-storage1 kernel: [429436.579265] md: super_written gets error=-19, uptodate=0
Jul 7 14:02:07 dev-storage1 kernel: [429436.612518] md: super_written gets error=-19, uptodate=0
Jul 7 14:02:50 dev-storage1 kernel: [429479.409214] sd 4:0:1:0: [sdc] Synchronizing SCSI cache
Jul 7 14:02:50 dev-storage1 kernel: [429479.409290] sd 4:0:1:0: [sdc] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
Jul 7 14:02:50 dev-storage1 kernel: [429479.409297] Buffer I/O error on device md127, logical block 2067791905
Jul 7 14:02:50 dev-storage1 kernel: [429479.409300] lost page write due to I/O error on md127
Jul 7 14:02:50 dev-storage1 kernel: [429479.409502] mpt2sas0: removing handle(0x0009), sas_addr(0x4433221101000000)
Jul 7 14:02:50 dev-storage1 kernel: [429479.612173] md: super_written gets error=-19, uptodate=0
Jul 7 14:02:50 dev-storage1 kernel: [429479.612192] md: super_written gets error=-19, uptodate=0
Jul 7 14:02:50 dev-storage1 kernel: [429479.639212] md: super_written gets error=-19, uptodate=0
Jul 7 14:02:50 dev-storage1 kernel: [429479.639222] md: super_written gets error=-19, uptodate=0
Jul 7 14:03:04 dev-storage1 kernel: [429493.162396] scsi 4:0:12:0: Direct-Access ATA ST3000DM001-9YN1 CC4C PQ: 0 ANSI: 6
Jul 7 14:03:04 dev-storage1 kernel: [429493.162407] scsi 4:0:12:0: SATA: handle(0x0009), sas_addr(0x4433221101000000), phy(1), device_name(0x5000c5004a46ceca)
Jul 7 14:03:04 dev-storage1 kernel: [429493.162411] scsi 4:0:12:0: SATA: enclosure_logical_id(0x500605b00448c4f0), slot(2)
Jul 7 14:03:04 dev-storage1 kernel: [429493.162518] scsi 4:0:12:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
Jul 7 14:03:04 dev-storage1 kernel: [429493.162526] scsi 4:0:12:0: qdepth(32), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
Jul 7 14:03:04 dev-storage1 kernel: [429493.162782] sd 4:0:12:0: Attached scsi generic sg2 type 0
Jul 7 14:03:04 dev-storage1 kernel: [429493.163136] sd 4:0:12:0: [sdr] physical block alignment offset: 4096
Jul 7 14:03:04 dev-storage1 kernel: [429493.163143] sd 4:0:12:0: [sdr] 5860533168 512-byte logical blocks: (3.00 TB/2.72 TiB)
Jul 7 14:03:04 dev-storage1 kernel: [429493.163146] sd 4:0:12:0: [sdr] 4096-byte physical blocks
Jul 7 14:03:04 dev-storage1 kernel: [429493.217763] sd 4:0:12:0: [sdr] Write Protect is off
Jul 7 14:03:04 dev-storage1 kernel: [429493.217768] sd 4:0:12:0: [sdr] Mode Sense: 7f 00 00 08
Jul 7 14:03:04 dev-storage1 kernel: [429493.218501] sd 4:0:12:0: [sdr] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
Jul 7 14:03:04 dev-storage1 kernel: [429493.289491] sdr: unknown partition table
Jul 7 14:03:04 dev-storage1 kernel: [429493.351632] sd 4:0:12:0: [sdr] Attached SCSI disk
Jul 7 15:38:20 dev-storage1 kernel: [435193.023742] sd 4:0:10:0: [sdp] Synchronizing SCSI cache
Jul 7 15:38:20 dev-storage1 kernel: [435193.023794] sd 4:0:10:0: [sdp] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
Jul 7 15:38:20 dev-storage1 kernel: [435193.024209] mpt2sas0: removing handle(0x000d), sas_addr(0x4433221104000000)
Jul 7 15:38:29 dev-storage1 kernel: [435202.541557] scsi 4:0:13:0: Direct-Access ATA ST3000DM001-9YN1 CC4C PQ: 0 ANSI: 6
Jul 7 15:38:29 dev-storage1 kernel: [435202.541567] scsi 4:0:13:0: SATA: handle(0x000d), sas_addr(0x4433221104000000), phy(4), device_name(0x5000c5004a123b93)
Jul 7 15:38:29 dev-storage1 kernel: [435202.541571] scsi 4:0:13:0: SATA: enclosure_logical_id(0x500605b00448c4f0), slot(7)
Jul 7 15:38:29 dev-storage1 kernel: [435202.541693] scsi 4:0:13:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
Jul 7 15:38:29 dev-storage1 kernel: [435202.541699] scsi 4:0:13:0: qdepth(32), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
Jul 7 15:38:29 dev-storage1 kernel: [435202.541978] sd 4:0:13:0: Attached scsi generic sg5 type 0
Jul 7 15:38:29 dev-storage1 kernel: [435202.542230] sd 4:0:13:0: [sdp] physical block alignment offset: 4096
Jul 7 15:38:29 dev-storage1 kernel: [435202.542240] sd 4:0:13:0: [sdp] 5860533168 512-byte logical blocks: (3.00 TB/2.72 TiB)
Jul 7 15:38:29 dev-storage1 kernel: [435202.542245] sd 4:0:13:0: [sdp] 4096-byte physical blocks
Jul 7 15:38:30 dev-storage1 kernel: [435202.594827] sd 4:0:13:0: [sdp] Write Protect is off
Jul 7 15:38:30 dev-storage1 kernel: [435202.594832] sd 4:0:13:0: [sdp] Mode Sense: 7f 00 00 08
Jul 7 15:38:30 dev-storage1 kernel: [435202.595551] sd 4:0:13:0: [sdp] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
Jul 7 15:38:30 dev-storage1 kernel: [435202.666733] sdp: unknown partition table
Jul 7 15:38:30 dev-storage1 kernel: [435202.728676] sd 4:0:13:0: [sdp] Attached SCSI disk
Jul 7 15:48:21 dev-storage1 kernel: [435792.305634] sd 4:0:13:0: [sdp] Synchronizing SCSI cache
Jul 7 15:48:21 dev-storage1 kernel: [435792.305685] sd 4:0:13:0: [sdp] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
Jul 7 15:48:21 dev-storage1 kernel: [435792.305961] mpt2sas0: removing handle(0x000d), sas_addr(0x4433221104000000)
Jul 7 15:48:21 dev-storage1 kernel: [435792.307158] sd 4:0:9:0: [sdo] Synchronizing SCSI cache
Jul 7 15:48:21 dev-storage1 kernel: [435792.307201] sd 4:0:9:0: [sdo] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
Jul 7 15:48:21 dev-storage1 kernel: [435792.307477] mpt2sas0: removing handle(0x000f), sas_addr(0x4433221105000000)
Jul 7 15:48:30 dev-storage1 kernel: [435801.077761] scsi 4:0:14:0: Direct-Access ATA ST3000DM001-9YN1 CC4C PQ: 0 ANSI: 6
Jul 7 15:48:30 dev-storage1 kernel: [435801.077773] scsi 4:0:14:0: SATA: handle(0x000f), sas_addr(0x4433221105000000), phy(5), device_name(0x5000c5004a44edbe)
Jul 7 15:48:30 dev-storage1 kernel: [435801.077780] scsi 4:0:14:0: SATA: enclosure_logical_id(0x500605b00448c4f0), slot(6)
Jul 7 15:48:30 dev-storage1 kernel: [435801.077876] scsi 4:0:14:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
Jul 7 15:48:30 dev-storage1 kernel: [435801.077884] scsi 4:0:14:0: qdepth(32), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
Jul 7 15:48:30 dev-storage1 kernel: [435801.078164] sd 4:0:14:0: Attached scsi generic sg5 type 0
Jul 7 15:48:30 dev-storage1 kernel: [435801.078467] sd 4:0:14:0: [sdo] physical block alignment offset: 4096
Jul 7 15:48:30 dev-storage1 kernel: [435801.078476] sd 4:0:14:0: [sdo] 5860533168 512-byte logical blocks: (3.00 TB/2.72 TiB)
Jul 7 15:48:30 dev-storage1 kernel: [435801.078481] sd 4:0:14:0: [sdo] 4096-byte physical blocks
Jul 7 15:48:30 dev-storage1 kernel: [435801.134074] sd 4:0:14:0: [sdo] Write Protect is off
Jul 7 15:48:30 dev-storage1 kernel: [435801.134079] sd 4:0:14:0: [sdo] Mode Sense: 7f 00 00 08
Jul 7 15:48:30 dev-storage1 kernel: [435801.134786] sd 4:0:14:0: [sdo] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
Jul 7 15:48:30 dev-storage1 kernel: [435801.208179] sdo: unknown partition table
Jul 7 15:48:30 dev-storage1 kernel: [435801.276258] sd 4:0:14:0: [sdo] Attached SCSI disk
Jul 7 15:48:30 dev-storage1 kernel: [435801.822171] scsi 4:0:15:0: Direct-Access ATA ST3000DM001-9YN1 CC4C PQ: 0 ANSI: 6
Jul 7 15:48:30 dev-storage1 kernel: [435801.822180] scsi 4:0:15:0: SATA: handle(0x000d), sas_addr(0x4433221104000000), phy(4), device_name(0x5000c5004a123b93)
Jul 7 15:48:30 dev-storage1 kernel: [435801.822185] scsi 4:0:15:0: SATA: enclosure_logical_id(0x500605b00448c4f0), slot(7)
Jul 7 15:48:30 dev-storage1 kernel: [435801.822272] scsi 4:0:15:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
Jul 7 15:48:30 dev-storage1 kernel: [435801.822279] scsi 4:0:15:0: qdepth(32), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1)
Jul 7 15:48:30 dev-storage1 kernel: [435801.822589] sd 4:0:15:0: Attached scsi generic sg7 type 0
Jul 7 15:48:30 dev-storage1 kernel: [435801.822886] sd 4:0:15:0: [sdp] physical block alignment offset: 4096
Jul 7 15:48:30 dev-storage1 kernel: [435801.822896] sd 4:0:15:0: [sdp] 5860533168 512-byte logical blocks: (3.00 TB/2.72 TiB)
Jul 7 15:48:30 dev-storage1 kernel: [435801.822900] sd 4:0:15:0: [sdp] 4096-byte physical blocks
Jul 7 15:48:30 dev-storage1 kernel: [435801.875888] sd 4:0:15:0: [sdp] Write Protect is off
Jul 7 15:48:30 dev-storage1 kernel: [435801.875893] sd 4:0:15:0: [sdp] Mode Sense: 7f 00 00 08
Jul 7 15:48:30 dev-storage1 kernel: [435801.876484] sd 4:0:15:0: [sdp] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
Jul 7 15:48:31 dev-storage1 kernel: [435801.947660] sdp: unknown partition table
Jul 7 15:48:31 dev-storage1 kernel: [435802.009745] sd 4:0:15:0: [sdp] Attached SCSI disk
Jul 7 15:49:14 dev-storage1 kernel: [435845.153305] sd 4:0:14:0: [sdo] Synchronizing SCSI cache
Jul 7 15:49:14 dev-storage1 kernel: [435845.153356] sd 4:0:14:0: [sdo] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
... snip rest ...
next prev parent reply other threads:[~2012-07-11 7:58 UTC|newest]
Thread overview: 16+ messages / expand[flat|nested] mbox.gz Atom feed top
2012-07-10 16:33 Assembly failure Brian Candler
2012-07-10 16:48 ` Sebastian Riemer
2012-07-10 17:06 ` Brian Candler
2012-07-10 17:38 ` Sebastian Riemer
2012-07-10 18:59 ` Brian Candler
2012-07-11 2:43 ` NeilBrown
2012-07-11 7:58 ` Brian Candler [this message]
2012-07-11 8:27 ` Christian Balzer
2012-07-11 9:09 ` Brian Candler
2012-07-11 10:32 ` Mikael Abrahamsson
2012-07-11 10:47 ` Brian Candler
2012-07-11 10:44 ` Roman Mamedov
2012-07-11 17:21 ` Christian Balzer
2012-07-13 18:52 ` Brian Candler
2012-07-10 17:05 ` pants
-- strict thread matches above, loose matches on Subject: below --
2012-07-13 20:34 Richard Scobie
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20120711075818.GA30527@nsrc.org \
--to=b.candler@pobox.com \
--cc=linux-raid@vger.kernel.org \
--cc=neilb@suse.de \
--cc=sebastian.riemer@profitbricks.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.