From mboxrd@z Thu Jan 1 00:00:00 1970 From: Stephan Stachurski Subject: Failed --grow. Recovery possible? Date: Thu, 18 Mar 2010 21:52:54 -0400 Message-ID: <959332b61003181852s538d9c74sa7dad6d3150c9e71@mail.gmail.com> References: <959332b61003181836jea0d170jf6163e4ab81376f8@mail.gmail.com> Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: QUOTED-PRINTABLE Return-path: In-Reply-To: <959332b61003181836jea0d170jf6163e4ab81376f8@mail.gmail.com> Sender: linux-raid-owner@vger.kernel.org To: linux-raid@vger.kernel.org List-Id: linux-raid.ids I have had a RAID5 up for quite a while with 6 disks. I recently added 4 and attempted to grow the array to span all 10 devices. =46or an hour after starting the grow command, the speed of the operation was 0K/s the entire time. I thought something must be wrong, and the best course of action would be to reboot and start over from a clean boot. I'm not a linux expert so I thought that if I rebooted everything would try to exit gracefully. After one hour, the system still had not finished shutting down. I then did alt-sysreq RSEISUB waiting over one minute between each command. I've included the syslog of what happened up until the next start up, but put it last because it's by far the longest. When I rebooted, the array seemed to be up, but mounting it resulted in a bad FS type error, even when I tried to specify it (ext4). After stopping the inactive array, and trying to reassemble it, mdadm crashed to segmentation fault. Is it possible to recover the data? We have backups, but they're spread out over 1500 DVDs. When I examine the drives, the output looks pretty much like this for each drive (6 drives say active and 4 say clean, corresponding to the 6 original and 4 added drives): $ mdadm --examine /dev/sda /dev/sda: =A0=A0 =A0 =A0 =A0 =A0Magic : a92b4efc =A0=A0 =A0 =A0 =A0Version : 00.91.00 =A0=A0 =A0 =A0 =A0 =A0 UUID : 56c16545:07db76d6:e368bf24:bd0fce41 =A0=A0Creation Time : Tue Feb =A02 09:58:58 2010 =A0=A0 =A0 Raid Level : raid5 =A0=A0Used Dev Size : 976762368 (931.51 GiB 1000.20 GB) =A0=A0 =A0 Array Size : 8790861312 (8383.62 GiB 9001.84 GB) =A0=A0 Raid Devices : 10 =A0=A0Total Devices : 10 Preferred Minor : 0 =A0=A0Reshape pos'n : 0 =A0=A0Delta Devices : 4 (6->10) =A0=A0 =A0Update Time : Thu Mar 18 23:33:40 2010 =A0=A0 =A0 =A0 =A0 =A0State : active =A0Active Devices : 10 Working Devices : 10 =A0Failed Devices : 0 =A0=A0Spare Devices : 0 =A0=A0 =A0 =A0 Checksum : 79904299 - correct =A0=A0 =A0 =A0 =A0 Events : 270611 =A0=A0 =A0 =A0 =A0 Layout : left-symmetric =A0=A0 =A0 Chunk Size : 256K =A0=A0 =A0 =A0Number =A0 Major =A0 Minor =A0 RaidDevice State this =A0 =A0 4 =A0 =A0 =A0 8 =A0 =A0 =A0 =A00 =A0 =A0 =A0 =A04 =A0 =A0 = =A0active sync =A0 /dev/sda =A0=A0 0 =A0 =A0 0 =A0 =A0 =A0 8 =A0 =A0 =A0 16 =A0 =A0 =A0 =A00 =A0 =A0= =A0active sync =A0 /dev/sdb =A0=A0 1 =A0 =A0 1 =A0 =A0 =A0 8 =A0 =A0 =A0 96 =A0 =A0 =A0 =A01 =A0 =A0= =A0active sync =A0 /dev/sdg =A0=A0 2 =A0 =A0 2 =A0 =A0 =A0 8 =A0 =A0 =A0112 =A0 =A0 =A0 =A02 =A0 =A0= =A0active sync =A0 /dev/sdh =A0=A0 3 =A0 =A0 3 =A0 =A0 =A0 8 =A0 =A0 =A0 48 =A0 =A0 =A0 =A03 =A0 =A0= =A0active sync =A0 /dev/sdd =A0=A0 4 =A0 =A0 4 =A0 =A0 =A0 8 =A0 =A0 =A0 =A00 =A0 =A0 =A0 =A04 =A0 = =A0 =A0active sync =A0 /dev/sda =A0=A0 5 =A0 =A0 5 =A0 =A0 =A0 8 =A0 =A0 =A0 32 =A0 =A0 =A0 =A05 =A0 =A0= =A0active sync =A0 /dev/sdc =A0=A0 6 =A0 =A0 6 =A0 =A0 =A0 8 =A0 =A0 =A0160 =A0 =A0 =A0 =A06 =A0 =A0= =A0active sync =A0 /dev/sdk =A0=A0 7 =A0 =A0 7 =A0 =A0 =A0 8 =A0 =A0 =A0144 =A0 =A0 =A0 =A07 =A0 =A0= =A0active sync =A0 /dev/sdj =A0=A0 8 =A0 =A0 8 =A0 =A0 =A0 8 =A0 =A0 =A0128 =A0 =A0 =A0 =A08 =A0 =A0= =A0active sync =A0 /dev/sdi =A0=A0 9 =A0 =A0 9 =A0 =A0 =A0 8 =A0 =A0 =A0 80 =A0 =A0 =A0 =A09 =A0 =A0= =A0active sync =A0 /dev/sdf #syslog showing how mdadm detects the bad 10-drive array on boot Mar 18 23:47:35 raidserver kernel: [ =A0 =A02.178393] md: bind Mar 18 23:47:35 raidserver kernel: [ =A0 =A02.193132] md: bind Mar 18 23:47:35 raidserver kernel: [ =A0 =A02.211906] md: bind Mar 18 23:47:35 raidserver kernel: [ =A0 =A02.220062] md: bind Mar 18 23:47:35 raidserver kernel: [ =A0 =A02.230062] ohci1394: fw-host= 0: OHCI-1394 1.1 (PCI): IRQ=3D[22] =A0MMIO=3D[fd6ff000-fd6ff7ff] =A0Max Packet=3D[2048] =A0IR/IT contexts=3D[4/8] Mar 18 23:47:35 raidserver kernel: [ =A0 =A03.551483] ieee1394: Host added: ID:BUS[0-00:1023] =A0GUID[003635c7006cf049] Mar 18 23:47:35 raidserver kernel: [ =A0 =A06.579349] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1214:port 0 attach dev info is 0 Mar 18 23:47:35 raidserver kernel: [ =A0 =A06.579353] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1216:port 0 attach sas addr is 0 Mar 18 23:47:35 raidserver kernel: [ =A0 =A06.780038] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1214:port 1 attach dev info is 0 Mar 18 23:47:35 raidserver kernel: [ =A0 =A06.780041] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1216:port 1 attach sas addr is 1 Mar 18 23:47:35 raidserver kernel: [ =A0 =A06.990054] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1214:port 2 attach dev info is 0 Mar 18 23:47:35 raidserver kernel: [ =A0 =A06.990057] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1216:port 2 attach sas addr is 2 Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.200052] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1214:port 3 attach dev info is 0 Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.200055] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1216:port 3 attach sas addr is 3 Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.310035] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1214:port 4 attach dev info is 0 Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.310038] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1216:port 4 attach sas addr is 0 Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.420035] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1214:port 5 attach dev info is 0 Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.420038] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1216:port 5 attach sas addr is 0 Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.630052] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1214:port 6 attach dev info is 2000000 Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.630055] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1216:port 6 attach sas addr is 6 Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.840053] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1214:port 7 attach dev info is 0 Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.840056] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1216:port 7 attach sas addr is 7 Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.840062] scsi8 : mvsas Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.840605] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 380:phy 0 byte dmaded. Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.840610] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 380:phy 1 byte dmaded. Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.840614] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 380:phy 2 byte dmaded. Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.840617] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 380:phy 3 byte dmaded. Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.840621] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 380:phy 6 byte dmaded. Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.840624] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 380:phy 7 byte dmaded. Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.840871] mvsas 0000:03:00.= 0: mvsas: driver version 0.8.2 Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.840885] mvsas 0000:03:00.= 0: PCI INT A -> GSI 16 (level, low) -> IRQ 16 Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.840891] mvsas 0000:03:00.= 0: setting latency timer to 64 Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.841965] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1365:found dev[0:5] is gone. Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.843312] ata9.00: ATA-8: W= DC WD10EARS-00Y5B1, 80.00A80, max UDMA/133 Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.843316] ata9.00: 19535251= 68 sectors, multi 0: LBA48 NCQ (depth 31/32) Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.843480] mvsas 0000:03:00.= 0: mvsas: PCI-E x4, Bandwidth Usage: 2.5 Gbps Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.845117] ata9.00: configur= ed for UDMA/133 Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.845182] scsi 8:0:0:0: Direct-Access =A0 =A0 ATA =A0 =A0 =A0WDC WD10EARS-00Y 80.0 PQ: 0 ANSI: = 5 Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.845801] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1365:found dev[1:5] is gone. Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.846588] ata10.00: ATA-8: = WDC WD10EADS-00L5B1, 01.01A01, max UDMA/133 Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.846591] ata10.00: 1953525= 168 sectors, multi 0: LBA48 NCQ (depth 31/32) Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.847419] ata10.00: configu= red for UDMA/133 Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.847455] scsi 8:0:1:0: Direct-Access =A0 =A0 ATA =A0 =A0 =A0WDC WD10EADS-00L 01.0 PQ: 0 ANSI: = 5 Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.848069] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1365:found dev[2:5] is gone. Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.848894] ata11.00: ATA-8: = WDC WD10EACS-00D6B1, 01.01A01, max UDMA/133 Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.848897] ata11.00: 1953525= 168 sectors, multi 0: LBA48 NCQ (depth 31/32) Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.849713] ata11.00: configu= red for UDMA/133 Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.849751] scsi 8:0:2:0: Direct-Access =A0 =A0 ATA =A0 =A0 =A0WDC WD10EACS-00D 01.0 PQ: 0 ANSI: = 5 Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.850909] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1365:found dev[3:5] is gone. Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.852188] ata12.00: ATA-8: = WDC WD10EARS-00Y5B1, 80.00A80, max UDMA/133 Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.852192] ata12.00: 1953525= 168 sectors, multi 0: LBA48 NCQ (depth 31/32) Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.853488] ata12.00: configu= red for UDMA/133 Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.853524] scsi 8:0:3:0: Direct-Access =A0 =A0 ATA =A0 =A0 =A0WDC WD10EARS-00Y 80.0 PQ: 0 ANSI: = 5 Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.854665] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1365:found dev[4:5] is gone. Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.855955] ata13.00: ATA-8: = WDC WD10EARS-00Y5B1, 80.00A80, max UDMA/133 Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.855959] ata13.00: 1953525= 168 sectors, multi 0: LBA48 NCQ (depth 31/32) Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.857258] ata13.00: configu= red for UDMA/133 Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.857293] scsi 8:0:4:0: Direct-Access =A0 =A0 ATA =A0 =A0 =A0WDC WD10EARS-00Y 80.0 PQ: 0 ANSI: = 5 Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.858437] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1365:found dev[5:5] is gone. Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.859713] ata14.00: ATA-8: = WDC WD10EARS-00Y5B1, 80.00A80, max UDMA/133 Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.859716] ata14.00: 1953525= 168 sectors, multi 0: LBA48 NCQ (depth 31/32) Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.861014] ata14.00: configu= red for UDMA/133 Mar 18 23:47:35 raidserver kernel: [ =A0 =A07.861051] scsi 8:0:5:0: Direct-Access =A0 =A0 ATA =A0 =A0 =A0WDC WD10EARS-00Y 80.0 PQ: 0 ANSI: = 5 Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.831403] sd 8:0:0:0: Attac= hed scsi generic sg5 type 0 Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.831507] sd 8:0:1:0: Attac= hed scsi generic sg6 type 0 Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.831610] sd 8:0:2:0: Attac= hed scsi generic sg7 type 0 Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.831713] sd 8:0:3:0: Attac= hed scsi generic sg8 type 0 Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.831823] sd 8:0:4:0: Attac= hed scsi generic sg9 type 0 Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.831927] sd 8:0:5:0: Attac= hed scsi generic sg10 type 0 Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.832481] sd 8:0:0:0: [sdf] 1953525168 512-byte logical blocks: (1.00 TB/931 GiB) Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.832485] sd 8:0:1:0: [sdg] 1953525168 512-byte logical blocks: (1.00 TB/931 GiB) Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.832547] sd 8:0:1:0: [sdg] Write Protect is off Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.832551] sd 8:0:0:0: [sdf] Write Protect is off Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.832555] sd 8:0:0:0: [sdf] Mode Sense: 00 3a 00 00 Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.832559] sd 8:0:1:0: [sdg] Mode Sense: 00 3a 00 00 Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.832586] sd 8:0:0:0: [sdf] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.832590] sd 8:0:1:0: [sdg] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.832806] =A0sdg: Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.832853] =A0sdf: Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.832914] sd 8:0:2:0: [sdh] 1953525168 512-byte logical blocks: (1.00 TB/931 GiB) Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.832953] sd 8:0:2:0: [sdh] Write Protect is off Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.832956] sd 8:0:2:0: [sdh] Mode Sense: 00 3a 00 00 Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.832976] sd 8:0:2:0: [sdh] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.833087] =A0sdh: Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.833182] sd 8:0:3:0: [sdi] 1953525168 512-byte logical blocks: (1.00 TB/931 GiB) Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.833197] sd 8:0:4:0: [sdj] 1953525168 512-byte logical blocks: (1.00 TB/931 GiB) Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.833238] sd 8:0:3:0: [sdi] Write Protect is off Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.833241] sd 8:0:3:0: [sdi] Mode Sense: 00 3a 00 00 Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.833250] sd 8:0:4:0: [sdj] Write Protect is off Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.833252] sd 8:0:4:0: [sdj] Mode Sense: 00 3a 00 00 Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.833270] sd 8:0:3:0: [sdi] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.833279] sd 8:0:4:0: [sdj] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.833442] =A0sdi: Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.833467] =A0sdj: Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.833553] sd 8:0:5:0: [sdk] 1953525168 512-byte logical blocks: (1.00 TB/931 GiB) Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.833593] sd 8:0:5:0: [sdk] Write Protect is off Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.833596] sd 8:0:5:0: [sdk] Mode Sense: 00 3a 00 00 Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.833617] sd 8:0:5:0: [sdk] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.833734] =A0sdk: unknown p= artition table Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.846211] sd 8:0:2:0: [sdh] Attached SCSI disk Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.846599] =A0unknown partit= ion table Mar 18 23:47:35 raidserver kernel: [ =A0 =A08.846759] sd 8:0:1:0: [sdg] Attached SCSI disk Mar 18 23:47:35 raidserver kernel: [ =A0 =A09.316040] =A0unknown partit= ion table Mar 18 23:47:35 raidserver kernel: [ =A0 =A09.316243] sd 8:0:3:0: [sdi] Attached SCSI disk Mar 18 23:47:35 raidserver kernel: [ =A0 =A09.316249] =A0unknown partit= ion table Mar 18 23:47:35 raidserver kernel: [ =A0 =A09.316404] sd 8:0:0:0: [sdf] Attached SCSI disk Mar 18 23:47:35 raidserver kernel: [ =A0 =A09.317860] =A0unknown partit= ion table Mar 18 23:47:35 raidserver kernel: [ =A0 =A09.318033] sd 8:0:4:0: [sdj] Attached SCSI disk Mar 18 23:47:35 raidserver kernel: [ =A0 =A09.321964] =A0unknown partit= ion table Mar 18 23:47:35 raidserver kernel: [ =A0 =A09.322127] sd 8:0:5:0: [sdk] Attached SCSI disk Mar 18 23:47:35 raidserver kernel: [ =A0 12.220036] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1214:port 0 attach dev info is 0 Mar 18 23:47:35 raidserver kernel: [ =A0 12.220039] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1216:port 0 attach sas addr is 0 Mar 18 23:47:35 raidserver kernel: [ =A0 12.330034] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1214:port 1 attach dev info is 0 Mar 18 23:47:35 raidserver kernel: [ =A0 12.330037] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1216:port 1 attach sas addr is 0 Mar 18 23:47:35 raidserver kernel: [ =A0 12.440035] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1214:port 2 attach dev info is 0 Mar 18 23:47:35 raidserver kernel: [ =A0 12.440037] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1216:port 2 attach sas addr is 0 Mar 18 23:47:35 raidserver kernel: [ =A0 12.550034] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1214:port 3 attach dev info is 0 Mar 18 23:47:35 raidserver kernel: [ =A0 12.550038] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1216:port 3 attach sas addr is 0 Mar 18 23:47:35 raidserver kernel: [ =A0 12.660035] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1214:port 4 attach dev info is 0 Mar 18 23:47:35 raidserver kernel: [ =A0 12.660038] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1216:port 4 attach sas addr is 0 Mar 18 23:47:35 raidserver kernel: [ =A0 12.770035] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1214:port 5 attach dev info is 0 Mar 18 23:47:35 raidserver kernel: [ =A0 12.770037] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1216:port 5 attach sas addr is 0 Mar 18 23:47:35 raidserver kernel: [ =A0 12.880035] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1214:port 6 attach dev info is 0 Mar 18 23:47:35 raidserver kernel: [ =A0 12.880037] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1216:port 6 attach sas addr is 0 Mar 18 23:47:35 raidserver kernel: [ =A0 12.990034] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1214:port 7 attach dev info is 0 Mar 18 23:47:35 raidserver kernel: [ =A0 12.990037] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1216:port 7 attach sas addr is 0 Mar 18 23:47:35 raidserver kernel: [ =A0 12.990043] scsi9 : mvsas Mar 18 23:47:35 raidserver kernel: [ =A0 13.595116] md: bind Mar 18 23:47:35 raidserver kernel: [ =A0 13.651656] md: bind Mar 18 23:47:35 raidserver kernel: [ =A0 13.653928] md: bind Mar 18 23:47:35 raidserver kernel: [ =A0 13.854601] md: bind Mar 18 23:47:35 raidserver kernel: [ =A0 14.055322] md: bind Mar 18 23:47:35 raidserver kernel: [ =A0 14.255683] md: bind Mar 18 23:47:35 raidserver kernel: [ =A0 14.259239] xor: automatically using best checksumming function: generic_sse Mar 18 23:47:35 raidserver kernel: [ =A0 14.300015] =A0 =A0generic_sse: 6593.600 MB/sec Mar 18 23:47:35 raidserver kernel: [ =A0 14.300018] xor: using function= : generic_sse (6593.600 MB/sec) Mar 18 23:47:35 raidserver kernel: [ =A0 14.300599] async_tx: api initialized (async) Mar 18 23:47:35 raidserver kernel: [ =A0 14.470026] raid6: int64x1 =A0 = 1711 MB/s Mar 18 23:47:35 raidserver kernel: [ =A0 14.640019] raid6: int64x2 =A0 = 2392 MB/s Mar 18 23:47:35 raidserver kernel: [ =A0 14.810046] raid6: int64x4 =A0 = 1567 MB/s Mar 18 23:47:35 raidserver kernel: [ =A0 14.980047] raid6: int64x8 =A0 = 1540 MB/s Mar 18 23:47:35 raidserver kernel: [ =A0 15.150016] raid6: sse2x1 =A0 =A0= 2931 MB/s Mar 18 23:47:35 raidserver kernel: [ =A0 15.320030] raid6: sse2x2 =A0 =A0= 3916 MB/s Mar 18 23:47:35 raidserver kernel: [ =A0 15.490023] raid6: sse2x4 =A0 =A0= 4088 MB/s Mar 18 23:47:35 raidserver kernel: [ =A0 15.490025] raid6: using algorithm sse2x4 (4088 MB/s) Mar 18 23:47:35 raidserver kernel: [ =A0 15.493236] md: raid6 personality registered for level 6 Mar 18 23:47:35 raidserver kernel: [ =A0 15.493240] md: raid5 personality registered for level 5 Mar 18 23:47:35 raidserver kernel: [ =A0 15.493242] md: raid4 personality registered for level 4 Mar 18 23:47:35 raidserver kernel: [ =A0 15.493642] raid5: md0 is not clean -- starting background reconstruction Mar 18 23:47:35 raidserver kernel: [ =A0 15.493645] raid5: reshape_position too early for auto-recovery - aborting. Mar 18 23:47:35 raidserver kernel: [ =A0 15.493647] md: pers->run() fai= led ... Mar 18 23:47:35 raidserver kernel: [ =A0 15.931347] md: linear personality registered for level -1 Mar 18 23:47:35 raidserver kernel: [ =A0 15.934321] md: multipath personality registered for level -4 Mar 18 23:47:35 raidserver kernel: [ =A0 15.936772] md: raid0 personality registered for level 0 Mar 18 23:47:35 raidserver kernel: [ =A0 15.940395] md: raid1 personality registered for level 1 Mar 18 23:47:35 raidserver kernel: [ =A0 15.949846] md: raid10 personality registered for level 10 #syslog of the segfault Mar 18 23:41:47 raidserver kernel: [ =A0155.028406] md: md0 stopped. Mar 18 23:41:47 raidserver kernel: [ =A0155.028443] md: unbind Mar 18 23:41:47 raidserver kernel: [ =A0155.051309] md: export_rdev(sdg= ) Mar 18 23:41:47 raidserver kernel: [ =A0155.051464] md: unbind Mar 18 23:41:47 raidserver kernel: [ =A0155.091288] md: export_rdev(sdk= ) Mar 18 23:41:47 raidserver kernel: [ =A0155.091418] md: unbind Mar 18 23:41:47 raidserver kernel: [ =A0155.131274] md: export_rdev(sdj= ) Mar 18 23:41:47 raidserver kernel: [ =A0155.131407] md: unbind Mar 18 23:41:47 raidserver kernel: [ =A0155.161277] md: export_rdev(sdi= ) Mar 18 23:41:47 raidserver kernel: [ =A0155.161421] md: unbind Mar 18 23:41:47 raidserver kernel: [ =A0155.191275] md: export_rdev(sdl= ) Mar 18 23:41:47 raidserver kernel: [ =A0155.191400] md: unbind Mar 18 23:41:47 raidserver kernel: [ =A0155.221276] md: export_rdev(sdh= ) Mar 18 23:41:47 raidserver kernel: [ =A0155.221403] md: unbind Mar 18 23:41:47 raidserver kernel: [ =A0155.251276] md: export_rdev(sda= ) Mar 18 23:41:47 raidserver kernel: [ =A0155.251385] md: unbind Mar 18 23:41:47 raidserver kernel: [ =A0155.281277] md: export_rdev(sdb= ) Mar 18 23:41:47 raidserver kernel: [ =A0155.281379] md: unbind Mar 18 23:41:47 raidserver kernel: [ =A0155.311276] md: export_rdev(sdc= ) Mar 18 23:41:47 raidserver kernel: [ =A0155.311377] md: unbind Mar 18 23:41:47 raidserver mdadm[1738]: DeviceDisappeared event detected on md device /dev/md0 Mar 18 23:41:47 raidserver kernel: [ =A0155.341274] md: export_rdev(sdd= ) Mar 18 23:43:46 raidserver kernel: [ =A0274.246878] md: md0 stopped. Mar 18 23:45:17 raidserver kernel: [ =A0365.227246] md: md0 stopped. Mar 18 23:45:18 raidserver kernel: [ =A0365.828455] __ratelimit: 30 callbacks suppressed Mar 18 23:45:18 raidserver kernel: [ =A0365.828466] mdadm[2874]: segfault at 38 ip 00000000004184ff sp 00007fffc2aa6bd0 error 4 in mdadm[400000+2a000] #syslog of the grow and subsequent reboot Mar 18 23:27:41 raidserver kernel: [ =A0861.411806] md: bind Mar 18 23:27:42 raidserver ata_id[2638]: HDIO_GET_IDENTITY failed for '= /dev/sdi' Mar 18 23:27:42 raidserver kernel: [ =A0862.024028] md: bind Mar 18 23:27:43 raidserver ata_id[2650]: HDIO_GET_IDENTITY failed for '= /dev/sdj' Mar 18 23:27:43 raidserver kernel: [ =A0863.133531] md: bind Mar 18 23:27:43 raidserver ata_id[2658]: HDIO_GET_IDENTITY failed for '= /dev/sdk' Mar 18 23:27:43 raidserver kernel: [ =A0863.285276] md: bind Mar 18 23:28:35 raidserver kernel: [ =A0914.792375] RAID5 conf printout= : Mar 18 23:28:35 raidserver kernel: [ =A0914.792385] =A0--- rd:10 wd:10 Mar 18 23:28:35 raidserver kernel: [ =A0914.792393] =A0disk 0, o:1, dev= :sdb Mar 18 23:28:35 raidserver kernel: [ =A0914.792398] =A0disk 1, o:1, dev= :sdg Mar 18 23:28:35 raidserver kernel: [ =A0914.792402] =A0disk 2, o:1, dev= :sdh Mar 18 23:28:35 raidserver kernel: [ =A0914.792406] =A0disk 3, o:1, dev= :sdd Mar 18 23:28:35 raidserver kernel: [ =A0914.792410] =A0disk 4, o:1, dev= :sda Mar 18 23:28:35 raidserver kernel: [ =A0914.792415] =A0disk 5, o:1, dev= :sdc Mar 18 23:28:35 raidserver kernel: [ =A0914.792419] =A0disk 6, o:1, dev= :sdk Mar 18 23:28:35 raidserver kernel: [ =A0914.792443] RAID5 conf printout= : Mar 18 23:28:35 raidserver kernel: [ =A0914.792447] =A0--- rd:10 wd:10 Mar 18 23:28:35 raidserver kernel: [ =A0914.792450] =A0disk 0, o:1, dev= :sdb Mar 18 23:28:35 raidserver kernel: [ =A0914.792454] =A0disk 1, o:1, dev= :sdg Mar 18 23:28:35 raidserver kernel: [ =A0914.792457] =A0disk 2, o:1, dev= :sdh Mar 18 23:28:35 raidserver kernel: [ =A0914.792461] =A0disk 3, o:1, dev= :sdd Mar 18 23:28:35 raidserver kernel: [ =A0914.792465] =A0disk 4, o:1, dev= :sda Mar 18 23:28:35 raidserver kernel: [ =A0914.792469] =A0disk 5, o:1, dev= :sdc Mar 18 23:28:35 raidserver kernel: [ =A0914.792472] =A0disk 6, o:1, dev= :sdk Mar 18 23:28:35 raidserver kernel: [ =A0914.792476] =A0disk 7, o:1, dev= :sdj Mar 18 23:28:35 raidserver kernel: [ =A0914.792484] RAID5 conf printout= : Mar 18 23:28:35 raidserver kernel: [ =A0914.792487] =A0--- rd:10 wd:10 Mar 18 23:28:35 raidserver kernel: [ =A0914.792491] =A0disk 0, o:1, dev= :sdb Mar 18 23:28:35 raidserver kernel: [ =A0914.792494] =A0disk 1, o:1, dev= :sdg Mar 18 23:28:35 raidserver kernel: [ =A0914.792498] =A0disk 2, o:1, dev= :sdh Mar 18 23:28:35 raidserver kernel: [ =A0914.792502] =A0disk 3, o:1, dev= :sdd Mar 18 23:28:35 raidserver kernel: [ =A0914.792506] =A0disk 4, o:1, dev= :sda Mar 18 23:28:35 raidserver kernel: [ =A0914.792509] =A0disk 5, o:1, dev= :sdc Mar 18 23:28:35 raidserver kernel: [ =A0914.792513] =A0disk 6, o:1, dev= :sdk Mar 18 23:28:35 raidserver kernel: [ =A0914.792517] =A0disk 7, o:1, dev= :sdj Mar 18 23:28:35 raidserver kernel: [ =A0914.792520] =A0disk 8, o:1, dev= :sdi Mar 18 23:28:35 raidserver kernel: [ =A0914.792528] RAID5 conf printout= : Mar 18 23:28:35 raidserver kernel: [ =A0914.792531] =A0--- rd:10 wd:10 Mar 18 23:28:35 raidserver kernel: [ =A0914.792535] =A0disk 0, o:1, dev= :sdb Mar 18 23:28:35 raidserver kernel: [ =A0914.792538] =A0disk 1, o:1, dev= :sdg Mar 18 23:28:35 raidserver kernel: [ =A0914.792542] =A0disk 2, o:1, dev= :sdh Mar 18 23:28:35 raidserver kernel: [ =A0914.792545] =A0disk 3, o:1, dev= :sdd Mar 18 23:28:35 raidserver kernel: [ =A0914.792549] =A0disk 4, o:1, dev= :sda Mar 18 23:28:35 raidserver kernel: [ =A0914.792552] =A0disk 5, o:1, dev= :sdc Mar 18 23:28:35 raidserver kernel: [ =A0914.792556] =A0disk 6, o:1, dev= :sdk Mar 18 23:28:35 raidserver kernel: [ =A0914.792559] =A0disk 7, o:1, dev= :sdj Mar 18 23:28:35 raidserver kernel: [ =A0914.792563] =A0disk 8, o:1, dev= :sdi Mar 18 23:28:35 raidserver kernel: [ =A0914.792567] =A0disk 9, o:1, dev= :sdf Mar 18 23:28:35 raidserver kernel: [ =A0914.792713] md: reshape of RAID= array md0 Mar 18 23:28:35 raidserver kernel: [ =A0914.792722] md: minimum _guaranteed_ =A0speed: 1000 KB/sec/disk. Mar 18 23:28:35 raidserver kernel: [ =A0914.792728] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for reshape. Mar 18 23:28:35 raidserver kernel: [ =A0914.792746] md: using 128k window, over a total of 976762368 blocks. Mar 18 23:28:35 raidserver mdadm[1627]: RebuildStarted event detected on md device /dev/md0 Mar 18 23:28:35 raidserver mdadm[1627]: SpareActive event detected on md device /dev/md0, component device /dev/sdk Mar 18 23:28:35 raidserver mdadm[1627]: SpareActive event detected on md device /dev/md0, component device /dev/sdj Mar 18 23:28:35 raidserver mdadm[1627]: SpareActive event detected on md device /dev/md0, component device /dev/sdi Mar 18 23:28:35 raidserver mdadm[1627]: SpareActive event detected on md device /dev/md0, component device /dev/sdf Mar 18 23:29:05 raidserver kernel: [ =A0945.010492] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:29:05 raidserver kernel: [ =A0945.010501] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:29:05 raidserver kernel: [ =A0945.010517] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:29:05 raidserver kernel: [ =A0945.010523] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:29:36 raidserver kernel: [ =A0976.010049] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:29:36 raidserver kernel: [ =A0976.010058] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:29:36 raidserver kernel: [ =A0976.010071] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:29:36 raidserver kernel: [ =A0976.010077] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:30:07 raidserver kernel: [ 1007.010495] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:30:07 raidserver kernel: [ 1007.010504] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:30:07 raidserver kernel: [ 1007.010518] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:30:07 raidserver kernel: [ 1007.010525] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:30:38 raidserver kernel: [ 1038.010051] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:30:38 raidserver kernel: [ 1038.010060] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:30:38 raidserver kernel: [ 1038.010075] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:30:38 raidserver kernel: [ 1038.010081] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:31:09 raidserver kernel: [ 1069.010493] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:31:09 raidserver kernel: [ 1069.010503] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:31:09 raidserver kernel: [ 1069.010517] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:31:09 raidserver kernel: [ 1069.010523] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:31:20 raidserver kernel: [ 1080.620078] INFO: task md0_reshape:2679 blocked for more than 120 seconds. Mar 18 23:31:20 raidserver kernel: [ 1080.620086] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Mar 18 23:31:20 raidserver kernel: [ 1080.620092] md0_reshape =A0 D 00000000ffffffff =A0 =A0 0 =A02679 =A0 =A0 =A02 0x00000000 Mar 18 23:31:20 raidserver kernel: [ 1080.620103] =A0ffff8800441e1ad0 0000000000000046 ffff8800441e1a80 0000000000015880 Mar 18 23:31:20 raidserver kernel: [ 1080.620113] =A0ffff880068199a60 0000000000015880 0000000000015880 0000000000015880 Mar 18 23:31:20 raidserver kernel: [ 1080.620122] =A00000000000015880 ffff880068199a60 0000000000015880 0000000000015880 Mar 18 23:31:20 raidserver kernel: [ 1080.620131] Call Trace: Mar 18 23:31:20 raidserver kernel: [ 1080.620169] [] get_active_stripe+0x2a1/0x360 [raid456] Mar 18 23:31:20 raidserver kernel: [ 1080.620185] [] ? default_wake_function+0x0/0x10 Mar 18 23:31:20 raidserver kernel: [ 1080.620197] [] reshape_request+0x4a0/0x980 [raid456] Mar 18 23:31:20 raidserver kernel: [ 1080.620210] [] sync_request+0x31a/0x3a0 [raid456] Mar 18 23:31:20 raidserver kernel: [ 1080.620221] [] ? raid5_unplug_device+0x7e/0x110 [raid456] Mar 18 23:31:20 raidserver kernel: [ 1080.620233] [] md_do_sync+0x5fe/0xba0 Mar 18 23:31:20 raidserver kernel: [ 1080.620242] [] md_thread+0x44/0x120 Mar 18 23:31:20 raidserver kernel: [ 1080.620249] [] ? md_thread+0x0/0x120 Mar 18 23:31:20 raidserver kernel: [ 1080.620257] [] kthread+0xa6/0xb0 Mar 18 23:31:20 raidserver kernel: [ 1080.620266] [] child_rip+0xa/0x20 Mar 18 23:31:20 raidserver kernel: [ 1080.620273] [] ? kthread+0x0/0xb0 Mar 18 23:31:20 raidserver kernel: [ 1080.620279] [] ? child_rip+0x0/0x20 Mar 18 23:31:40 raidserver kernel: [ 1100.010040] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:31:40 raidserver kernel: [ 1100.010049] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:31:40 raidserver kernel: [ 1100.010065] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:31:40 raidserver kernel: [ 1100.010072] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:31:40 raidserver kernel: [ 1100.010127] sd 8:0:1:0: [sdg] Unhandled error code Mar 18 23:31:40 raidserver kernel: [ 1100.010132] sd 8:0:1:0: [sdg] Result: hostbyte=3DDID_OK driverbyte=3DDRIVER_TIMEOUT Mar 18 23:31:40 raidserver kernel: [ 1100.010141] end_request: I/O error, dev sdg, sector 0 Mar 18 23:31:40 raidserver kernel: [ 1100.010310] sd 8:0:2:0: [sdh] Unhandled error code Mar 18 23:31:40 raidserver kernel: [ 1100.010314] sd 8:0:2:0: [sdh] Result: hostbyte=3DDID_OK driverbyte=3DDRIVER_TIMEOUT Mar 18 23:31:40 raidserver kernel: [ 1100.010321] end_request: I/O error, dev sdh, sector 8 Mar 18 23:32:11 raidserver kernel: [ 1131.010514] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:32:11 raidserver kernel: [ 1131.010523] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:32:11 raidserver kernel: [ 1131.010545] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:32:11 raidserver kernel: [ 1131.010551] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:32:11 raidserver kernel: [ 1131.010562] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:32:11 raidserver kernel: [ 1131.010567] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:32:11 raidserver kernel: [ 1131.010580] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:32:11 raidserver kernel: [ 1131.010585] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:32:11 raidserver kernel: [ 1131.010596] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:32:11 raidserver kernel: [ 1131.010601] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:32:11 raidserver kernel: [ 1131.010612] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:32:11 raidserver kernel: [ 1131.010617] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:32:42 raidserver kernel: [ 1162.010054] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:32:42 raidserver kernel: [ 1162.010063] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:32:42 raidserver kernel: [ 1162.010084] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:32:42 raidserver kernel: [ 1162.010090] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:32:42 raidserver kernel: [ 1162.010101] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:32:42 raidserver kernel: [ 1162.010107] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:32:42 raidserver kernel: [ 1162.010119] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:32:42 raidserver kernel: [ 1162.010125] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:32:42 raidserver kernel: [ 1162.010136] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:32:42 raidserver kernel: [ 1162.010142] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:32:42 raidserver kernel: [ 1162.010153] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:32:42 raidserver kernel: [ 1162.010159] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:33:13 raidserver kernel: [ 1193.010053] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:33:13 raidserver kernel: [ 1193.010062] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:33:13 raidserver kernel: [ 1193.010083] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:33:13 raidserver kernel: [ 1193.010089] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:33:13 raidserver kernel: [ 1193.010100] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:33:13 raidserver kernel: [ 1193.010106] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:33:13 raidserver kernel: [ 1193.010118] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:33:13 raidserver kernel: [ 1193.010123] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:33:13 raidserver kernel: [ 1193.010134] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:33:13 raidserver kernel: [ 1193.010139] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:33:13 raidserver kernel: [ 1193.010150] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:33:13 raidserver kernel: [ 1193.010156] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:33:16 raidserver ata_id[2906]: HDIO_GET_IDENTITY failed for '= /dev/sdj' Mar 18 23:33:16 raidserver ata_id[2910]: HDIO_GET_IDENTITY failed for '= /dev/sdk' Mar 18 23:33:16 raidserver ata_id[2911]: HDIO_GET_IDENTITY failed for '= /dev/sdi' Mar 18 23:33:34 raidserver kernel: [ 1213.857434] md: md0 still in use. Mar 18 23:33:40 raidserver kernel: [ 1219.907801] EXT4-fs: mballoc: 0 blocks 0 reqs (0 success) Mar 18 23:33:40 raidserver kernel: [ 1219.907801] EXT4-fs: mballoc: 0 extents scanned, 0 goal hits, 0 2^N hits, 0 breaks, 0 lost Mar 18 23:33:40 raidserver kernel: [ 1219.907801] EXT4-fs: mballoc: 0 generated and it took 0 Mar 18 23:33:40 raidserver kernel: [ 1219.907801] EXT4-fs: mballoc: 0 preallocated, 0 discarded Mar 18 23:34:10 raidserver kernel: [ 1250.010051] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:34:10 raidserver kernel: [ 1250.010061] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:34:10 raidserver kernel: [ 1250.010087] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:34:10 raidserver kernel: [ 1250.010093] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:34:10 raidserver kernel: [ 1250.010109] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:34:10 raidserver kernel: [ 1250.010115] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:34:10 raidserver kernel: [ 1250.010130] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:34:10 raidserver kernel: [ 1250.010135] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:34:10 raidserver kernel: [ 1250.010150] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:34:10 raidserver kernel: [ 1250.010155] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:34:10 raidserver kernel: [ 1250.010166] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:34:10 raidserver kernel: [ 1250.010171] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:34:41 raidserver kernel: [ 1281.010517] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:34:41 raidserver kernel: [ 1281.010528] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:34:41 raidserver kernel: [ 1281.010550] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:34:41 raidserver kernel: [ 1281.010556] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:34:41 raidserver kernel: [ 1281.010572] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:34:41 raidserver kernel: [ 1281.010578] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:34:41 raidserver kernel: [ 1281.010592] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:34:41 raidserver kernel: [ 1281.010597] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:34:41 raidserver kernel: [ 1281.010611] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:34:41 raidserver kernel: [ 1281.010617] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:34:41 raidserver kernel: [ 1281.010627] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc=3D 5 Mar 18 23:34:41 raidserver kernel: [ 1281.010633] /build/buildd/linux-2.6.31/drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc=3D 5 Mar 18 23:35:06 raidserver kernel: Kernel logging (proc) stopped. Mar 18 23:35:06 raidserver rsyslogd: [origin software=3D"rsyslogd" swVersion=3D"4.2.0" x-pid=3D"1027" x-info=3D"http://www.rsyslog.com"] exiting on signal 15. Mar 18 23:39:31 raidserver kernel: imklog 4.2.0, log source =3D /var/run/rsyslog/kmsg started. Mar 18 23:39:31 raidserver rsyslogd: [origin software=3D"rsyslogd" swVersion=3D"4.2.0" x-pid=3D"647" x-info=3D"http://www.rsyslog.com"] (re)start Mar 18 23:39:31 raidserver rsyslogd: rsyslogd's groupid changed to 102 Mar 18 23:39:31 raidserver rsyslogd: rsyslogd's userid changed to 101 -- Stephan E Stachurski 773-315-1684 ses1984@gmail.com -- Stephan E Stachurski 773-315-1684 ses1984@gmail.com -- To unsubscribe from this list: send the line "unsubscribe linux-raid" i= n the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html