Linux RAID subsystem development
 help / color / mirror / Atom feed
From: <dchiu@hkasatkd.org>
To: linux-raid@vger.kernel.org
Subject: freezing RAID 1+0 with single disk failure
Date: 16 Oct 2004 05:46:06 -0000	[thread overview]
Message-ID: <20041016054606.27308.qmail@s1.pbasehk.com> (raw)

Hello,

A few days ago my server experienced a single disk failure in a 8 disks RAID
1+0 configuration. Kernel is 2.6.8.1 w/smp, it's a P4 HT machine with 2GB RAM,
filesystem is ext3. 

When the disk failure happens, my webserver stop serving pages, "top" show that
load average is around 300, iowait is ~100%, I can still telnet into my box but
I can't umount the mounted RAID10 volumn, I can't kill the running apache, I
can't even shutdown the machine successfully. Finally, I have to switch of the
power to shut it off.

I found the following at my /var/log/messages:
===============================================================================
Oct 14 23:20:34 s1 kernel: scsi5: ERROR on channel 0, id 0, lun 0, CDB: 0x28 00
08 87 4b a1 00 00 70 00 
Oct 14 23:20:34 s1 kernel: Current sdf: sense = 70  3
Oct 14 23:20:34 s1 kernel: ASC=11 ASCQ= 4
Oct 14 23:20:34 s1 kernel: Raw sense data:0x70 0x00 0x03 0x00 0x00 0x00 0x00
0x06 0x00 0x00 0x00 0x00 0x11 0x04 
Oct 14 23:20:34 s1 kernel: end_request: I/O error, dev sdf, sector 143084449
Oct 14 23:20:39 s1 kernel: scsi5: ERROR on channel 0, id 0, lun 0, CDB: 0x28 00
08 87 4b a2 00 00 6f 00 
Oct 14 23:20:39 s1 kernel: Current sdf: sense = 70  3
Oct 14 23:20:39 s1 kernel: ASC=11 ASCQ= 4
Oct 14 23:20:39 s1 kernel: Raw sense data:0x70 0x00 0x03 0x00 0x00 0x00 0x00
0x06 0x00 0x00 0x00 0x00 0x11 0x04 
Oct 14 23:20:39 s1 kernel: end_request: I/O error, dev sdf, sector 143084450
Oct 14 23:20:43 s1 kernel: scsi5: ERROR on channel 0, id 0, lun 0, CDB: 0x28 00
08 87 4b a3 00 00 6e 00 
Oct 14 23:20:43 s1 kernel: Current sdf: sense = 70  3
Oct 14 23:20:43 s1 kernel: ASC=11 ASCQ= 4
Oct 14 23:20:43 s1 kernel: Raw sense data:0x70 0x00 0x03 0x00 0x00 0x00 0x00
0x06 0x00 0x00 0x00 0x00 0x11 0x04 

.......

Oct 14 23:23:14 s1 kernel: end_request: I/O error, dev sdf, sector 143084484
Oct 14 23:23:19 s1 kernel: scsi5: ERROR on channel 0, id 0, lun 0, CDB: 0x28 00
08 87 4b c5 00 00 4c 00 
Oct 14 23:23:19 s1 kernel: Current sdf: sense = 70  3
Oct 14 23:23:19 s1 kernel: ASC=11 ASCQ= 4
Oct 14 23:23:19 s1 kernel: Raw sense data:0x70 0x00 0x03 0x00 0x00 0x00 0x00
0x06 0x00 0x00 0x00 0x00 0x11 0x04 
Oct 14 23:23:19 s1 kernel: end_request: I/O error, dev sdf, sector 143084485
Oct 14 23:23:19 s1 kernel: raid1: Disk failure on sdf1, disabling device. 
Oct 14 23:23:19 s1 kernel: ^IOperation continuing on 1 devices
Oct 14 23:23:19 s1 kernel: raid1: sdf1: rescheduling sector 138570184
Oct 14 23:23:19 s1 kernel: raid1: sde1: redirecting sector 138570184 to another
mirror
Oct 14 23:23:19 s1 kernel: ata5(0): WARNING: zero len r/w req
Oct 14 23:23:19 s1 kernel: raid1: sde1: rescheduling sector 138570184
Oct 14 23:23:19 s1 kernel: raid1: sde1: redirecting sector 138570184 to another
mirror
===============================================================================

then I can't do anything on the freezing RAID1+0 volumn. Shouldn't the kernel
kick the bad disk off and keep the RAID running?

My raidtab is as follow:

raiddev             /dev/md1
raid-level                  1
nr-raid-disks               2
chunk-size                  64k
persistent-superblock       1
nr-spare-disks              0
    device          /dev/hda2
    raid-disk     0
    device          /dev/hdc2
    raid-disk     1
raiddev             /dev/md0
raid-level                  1
nr-raid-disks               2
chunk-size                  64k
persistent-superblock       1
nr-spare-disks              0
    device          /dev/hda1
    raid-disk     0
    device          /dev/hdc1
    raid-disk     1

raiddev             /dev/md2
raid-level                  1
nr-raid-disks               2
chunk-size                  64k
persistent-superblock       1
nr-spare-disks              0
    device          /dev/sda1
    raid-disk     0
    device          /dev/sdb1
    raid-disk     1

raiddev             /dev/md3
raid-level                  1
nr-raid-disks               2
chunk-size                  64k
persistent-superblock       1
nr-spare-disks              0
    device          /dev/sdc1
    raid-disk     0
    device          /dev/sdd1
    raid-disk     1

raiddev             /dev/md4
raid-level                  1
nr-raid-disks               2
chunk-size                  64k
persistent-superblock       1
nr-spare-disks              0
    device          /dev/sde1
    raid-disk     0
    device          /dev/sdf1
    raid-disk     1

raiddev             /dev/md5
raid-level                  1
nr-raid-disks               2
chunk-size                  64k
persistent-superblock       1
nr-spare-disks              0
    device          /dev/hda4
    raid-disk     0
    device          /dev/hdc4
    raid-disk     1

raiddev             /dev/md6
raid-level                  0
nr-raid-disks               4
chunk-size                  512k
persistent-superblock       1
nr-spare-disks              0
    device          /dev/md5
    raid-disk     0
    device          /dev/md2
    raid-disk     1
    device          /dev/md3
    raid-disk     2
    device          /dev/md4
    raid-disk     3

more /proc/mdstat (after replaced with the demaged disk and finished resync):

Personalities : [raid0] [raid1]
md6 : active raid0 md4[3] md3[2] md2[1] md5[0]
      967753728 blocks 512k chunks

md1 : active raid1 hdc2[0] hda2[1]
      2048192 blocks [2/2] [UU]

md5 : active raid1 hdc4[1] hda4[0]
      241938816 blocks [2/2] [UU]

md2 : active raid1 sdb1[1] sda1[0]
      241938816 blocks [2/2] [UU]

md3 : active raid1 sdd1[1] sdc1[0]
      241938816 blocks [2/2] [UU]

md4 : active raid1 sdf1[1] sde1[0]
      241938816 blocks [2/2] [UU]

md0 : active raid1 hdc1[0] hda1[1]
      104320 blocks [2/2] [UU]

Thanks for reading.



             reply	other threads:[~2004-10-16  5:46 UTC|newest]

Thread overview: 2+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2004-10-16  5:46 dchiu [this message]
2004-10-16 19:13 ` freezing RAID 1+0 with single disk failure Guy

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20041016054606.27308.qmail@s1.pbasehk.com \
    --to=dchiu@hkasatkd.org \
    --cc=linux-raid@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox