linux-raid.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Kevin Shanahan <kmshanah@disenchant.net>
To: Neil Brown <neilb@suse.de>
Cc: linux-raid@vger.kernel.org
Subject: Re: Help recovering RAID6 failure
Date: Tue, 16 Dec 2008 08:55:22 +1030	[thread overview]
Message-ID: <20081215222522.GF1749@cubit> (raw)
In-Reply-To: <18758.55029.597319.376426@notabene.brown>

On Tue, Dec 16, 2008 at 09:15:17AM +1100, Neil Brown wrote:
> On Tuesday December 16, kmshanah@disenchant.net wrote:
> > hermes:~# mdadm -A /dev/md5 /dev/sd[cefghijk]1
> > mdadm: failed to RUN_ARRAY /dev/md5: Input/output error
> 
> Try adding --force to over-ride apparent errors, and --verbose to help
> you see what is happening.

Hrm, force doesn't seem to help. Here's the verbose output:

hermes:~# mdadm -A --force --verbose /dev/md5 /dev/sd[cefghijk]1
mdadm: looking for devices for /dev/md5
mdadm: /dev/sdc1 is identified as a member of /dev/md5, slot 8.
mdadm: /dev/sde1 is identified as a member of /dev/md5, slot 0.
mdadm: /dev/sdf1 is identified as a member of /dev/md5, slot 1.
mdadm: /dev/sdg1 is identified as a member of /dev/md5, slot 2.
mdadm: /dev/sdh1 is identified as a member of /dev/md5, slot 6.
mdadm: /dev/sdi1 is identified as a member of /dev/md5, slot 5.
mdadm: /dev/sdj1 is identified as a member of /dev/md5, slot 4.
mdadm: /dev/sdk1 is identified as a member of /dev/md5, slot 3.
mdadm: added /dev/sdf1 to /dev/md5 as 1
mdadm: added /dev/sdg1 to /dev/md5 as 2
mdadm: added /dev/sdk1 to /dev/md5 as 3
mdadm: added /dev/sdj1 to /dev/md5 as 4
mdadm: added /dev/sdi1 to /dev/md5 as 5
mdadm: added /dev/sdh1 to /dev/md5 as 6
mdadm: no uptodate device for slot 7 of /dev/md5
mdadm: added /dev/sdc1 to /dev/md5 as 8
mdadm: no uptodate device for slot 9 of /dev/md5
mdadm: added /dev/sde1 to /dev/md5 as 0
mdadm: failed to RUN_ARRAY /dev/md5: Input/output error

I don't know what to make of that. It looks like it's got 8/10
devices, which should be enough to re-assemble in degraded mode.

/proc/mdstat shows:
md5 : inactive sde1[0] sdc1[8] sdh1[6] sdi1[5] sdj1[4] sdk1[3] sdg1[2] sdf1[1]
      7814079488 blocks

Cheers,
Kevin.

> > /dev/sdc1:
> >           Magic : a92b4efc
> >         Version : 00.90.00
> >            UUID : 77fa8675:444efef0:12f8dff0:9f609eb4
> >   Creation Time : Sun Jul 27 15:03:44 2008
> >      Raid Level : raid6
> >   Used Dev Size : 976759936 (931.51 GiB 1000.20 GB)
> >      Array Size : 7814079488 (7452.09 GiB 8001.62 GB)
> >    Raid Devices : 10
> >   Total Devices : 10
> > Preferred Minor : 5
> > 
> >     Update Time : Tue Dec 16 05:35:46 2008
> >           State : clean
> > Internal Bitmap : present
> >  Active Devices : 6
> > Working Devices : 6
> >  Failed Devices : 3
> >   Spare Devices : 0
> >        Checksum : e3df9eea - correct
> >          Events : 176870
> > 
> >      Chunk Size : 64K
> > 
> >       Number   Major   Minor   RaidDevice State
> > this     8       8      129        8      active sync   /dev/sdi1
> > 
> >    0     0       0        0        0      removed
> >    1     1       0        0        1      faulty removed
> >    2     2       8       33        2      active sync   /dev/sdc1
> >    3     3       8       49        3      active sync   /dev/sdd1
> >    4     4       8       65        4      active sync   /dev/sde1
> >    5     5       8       81        5      active sync   /dev/sdf1
> >    6     6       8       97        6      active sync   /dev/sdg1
> >    7     7       0        0        7      faulty removed
> >    8     8       8      129        8      active sync   /dev/sdi1
> >    9     9       0        0        9      faulty removed
> > /dev/sdd1:
> >           Magic : a92b4efc
> >         Version : 00.90.00
> >            UUID : 77fa8675:444efef0:12f8dff0:9f609eb4
> >   Creation Time : Sun Jul 27 15:03:44 2008
> >      Raid Level : raid6
> >   Used Dev Size : 976759936 (931.51 GiB 1000.20 GB)
> >      Array Size : 7814079488 (7452.09 GiB 8001.62 GB)
> >    Raid Devices : 10
> >   Total Devices : 10
> > Preferred Minor : 5
> > 
> >     Update Time : Thu Nov 27 09:20:39 2008
> >           State : clean
> > Internal Bitmap : present
> >  Active Devices : 10
> > Working Devices : 10
> >  Failed Devices : 0
> >   Spare Devices : 0
> >        Checksum : e3c42f8b - correct
> >          Events : 91974
> > 
> >      Chunk Size : 64K
> > 
> >       Number   Major   Minor   RaidDevice State
> > this     9       8      145        9      active sync   /dev/sdj1
> > 
> >    0     0       8        1        0      active sync   /dev/sda1
> >    1     1       8       17        1      active sync   /dev/sdb1
> >    2     2       8       33        2      active sync   /dev/sdc1
> >    3     3       8       49        3      active sync   /dev/sdd1
> >    4     4       8       65        4      active sync   /dev/sde1
> >    5     5       8       81        5      active sync   /dev/sdf1
> >    6     6       8       97        6      active sync   /dev/sdg1
> >    7     7       8      113        7      active sync   /dev/sdh1
> >    8     8       8      129        8      active sync   /dev/sdi1
> >    9     9       8      145        9      active sync   /dev/sdj1
> > /dev/sde1:
> >           Magic : a92b4efc
> >         Version : 00.90.00
> >            UUID : 77fa8675:444efef0:12f8dff0:9f609eb4
> >   Creation Time : Sun Jul 27 15:03:44 2008
> >      Raid Level : raid6
> >   Used Dev Size : 976759936 (931.51 GiB 1000.20 GB)
> >      Array Size : 7814079488 (7452.09 GiB 8001.62 GB)
> >    Raid Devices : 10
> >   Total Devices : 10
> > Preferred Minor : 5
> > 
> >     Update Time : Tue Dec 16 00:28:14 2008
> >           State : active
> > Internal Bitmap : present
> >  Active Devices : 8
> > Working Devices : 8
> >  Failed Devices : 2
> >   Spare Devices : 0
> >        Checksum : e3dca329 - correct
> >          Events : 176870
> > 
> >      Chunk Size : 64K
> > 
> >       Number   Major   Minor   RaidDevice State
> > this     0       8        1        0      active sync   /dev/sda1
> > 
> >    0     0       8        1        0      active sync   /dev/sda1
> >    1     1       8       17        1      active sync   /dev/sdb1
> >    2     2       8       33        2      active sync   /dev/sdc1
> >    3     3       8       49        3      active sync   /dev/sdd1
> >    4     4       8       65        4      active sync   /dev/sde1
> >    5     5       8       81        5      active sync   /dev/sdf1
> >    6     6       8       97        6      active sync   /dev/sdg1
> >    7     7       0        0        7      faulty removed
> >    8     8       8      129        8      active sync   /dev/sdi1
> >    9     9       0        0        9      faulty removed
> > /dev/sdf1:
> >           Magic : a92b4efc
> >         Version : 00.90.00
> >            UUID : 77fa8675:444efef0:12f8dff0:9f609eb4
> >   Creation Time : Sun Jul 27 15:03:44 2008
> >      Raid Level : raid6
> >   Used Dev Size : 976759936 (931.51 GiB 1000.20 GB)
> >      Array Size : 7814079488 (7452.09 GiB 8001.62 GB)
> >    Raid Devices : 10
> >   Total Devices : 10
> > Preferred Minor : 5
> > 
> >     Update Time : Tue Dec 16 00:29:00 2008
> >           State : active
> > Internal Bitmap : present
> >  Active Devices : 7
> > Working Devices : 7
> >  Failed Devices : 2
> >   Spare Devices : 0
> >        Checksum : e3dca382 - correct
> >          Events : 176870
> > 
> >      Chunk Size : 64K
> > 
> >       Number   Major   Minor   RaidDevice State
> > this     1       8       17        1      active sync   /dev/sdb1
> > 
> >    0     0       0        0        0      removed
> >    1     1       8       17        1      active sync   /dev/sdb1
> >    2     2       8       33        2      active sync   /dev/sdc1
> >    3     3       8       49        3      active sync   /dev/sdd1
> >    4     4       8       65        4      active sync   /dev/sde1
> >    5     5       8       81        5      active sync   /dev/sdf1
> >    6     6       8       97        6      active sync   /dev/sdg1
> >    7     7       0        0        7      faulty removed
> >    8     8       8      129        8      active sync   /dev/sdi1
> >    9     9       0        0        9      faulty removed
> > /dev/sdg1:
> >           Magic : a92b4efc
> >         Version : 00.90.00
> >            UUID : 77fa8675:444efef0:12f8dff0:9f609eb4
> >   Creation Time : Sun Jul 27 15:03:44 2008
> >      Raid Level : raid6
> >   Used Dev Size : 976759936 (931.51 GiB 1000.20 GB)
> >      Array Size : 7814079488 (7452.09 GiB 8001.62 GB)
> >    Raid Devices : 10
> >   Total Devices : 10
> > Preferred Minor : 5
> > 
> >     Update Time : Tue Dec 16 05:35:46 2008
> >           State : clean
> > Internal Bitmap : present
> >  Active Devices : 6
> > Working Devices : 6
> >  Failed Devices : 3
> >   Spare Devices : 0
> >        Checksum : e3df9e7e - correct
> >          Events : 176870
> > 
> >      Chunk Size : 64K
> > 
> >       Number   Major   Minor   RaidDevice State
> > this     2       8       33        2      active sync   /dev/sdc1
> > 
> >    0     0       0        0        0      removed
> >    1     1       0        0        1      faulty removed
> >    2     2       8       33        2      active sync   /dev/sdc1
> >    3     3       8       49        3      active sync   /dev/sdd1
> >    4     4       8       65        4      active sync   /dev/sde1
> >    5     5       8       81        5      active sync   /dev/sdf1
> >    6     6       8       97        6      active sync   /dev/sdg1
> >    7     7       0        0        7      faulty removed
> >    8     8       8      129        8      active sync   /dev/sdi1
> >    9     9       0        0        9      faulty removed
> > /dev/sdh1:
> >           Magic : a92b4efc
> >         Version : 00.90.00
> >            UUID : 77fa8675:444efef0:12f8dff0:9f609eb4
> >   Creation Time : Sun Jul 27 15:03:44 2008
> >      Raid Level : raid6
> >   Used Dev Size : 976759936 (931.51 GiB 1000.20 GB)
> >      Array Size : 7814079488 (7452.09 GiB 8001.62 GB)
> >    Raid Devices : 10
> >   Total Devices : 10
> > Preferred Minor : 5
> > 
> >     Update Time : Tue Dec 16 05:35:46 2008
> >           State : clean
> > Internal Bitmap : present
> >  Active Devices : 6
> > Working Devices : 6
> >  Failed Devices : 3
> >   Spare Devices : 0
> >        Checksum : e3df9ec6 - correct
> >          Events : 176870
> > 
> >      Chunk Size : 64K
> > 
> >       Number   Major   Minor   RaidDevice State
> > this     6       8       97        6      active sync   /dev/sdg1
> > 
> >    0     0       0        0        0      removed
> >    1     1       0        0        1      faulty removed
> >    2     2       8       33        2      active sync   /dev/sdc1
> >    3     3       8       49        3      active sync   /dev/sdd1
> >    4     4       8       65        4      active sync   /dev/sde1
> >    5     5       8       81        5      active sync   /dev/sdf1
> >    6     6       8       97        6      active sync   /dev/sdg1
> >    7     7       0        0        7      faulty removed
> >    8     8       8      129        8      active sync   /dev/sdi1
> >    9     9       0        0        9      faulty removed
> > /dev/sdi1:
> >           Magic : a92b4efc
> >         Version : 00.90.00
> >            UUID : 77fa8675:444efef0:12f8dff0:9f609eb4
> >   Creation Time : Sun Jul 27 15:03:44 2008
> >      Raid Level : raid6
> >   Used Dev Size : 976759936 (931.51 GiB 1000.20 GB)
> >      Array Size : 7814079488 (7452.09 GiB 8001.62 GB)
> >    Raid Devices : 10
> >   Total Devices : 10
> > Preferred Minor : 5
> > 
> >     Update Time : Tue Dec 16 05:35:46 2008
> >           State : clean
> > Internal Bitmap : present
> >  Active Devices : 6
> > Working Devices : 6
> >  Failed Devices : 3
> >   Spare Devices : 0
> >        Checksum : e3df9eb4 - correct
> >          Events : 176870
> > 
> >      Chunk Size : 64K
> > 
> >       Number   Major   Minor   RaidDevice State
> > this     5       8       81        5      active sync   /dev/sdf1
> > 
> >    0     0       0        0        0      removed
> >    1     1       0        0        1      faulty removed
> >    2     2       8       33        2      active sync   /dev/sdc1
> >    3     3       8       49        3      active sync   /dev/sdd1
> >    4     4       8       65        4      active sync   /dev/sde1
> >    5     5       8       81        5      active sync   /dev/sdf1
> >    6     6       8       97        6      active sync   /dev/sdg1
> >    7     7       0        0        7      faulty removed
> >    8     8       8      129        8      active sync   /dev/sdi1
> >    9     9       0        0        9      faulty removed
> > /dev/sdj1:
> >           Magic : a92b4efc
> >         Version : 00.90.00
> >            UUID : 77fa8675:444efef0:12f8dff0:9f609eb4
> >   Creation Time : Sun Jul 27 15:03:44 2008
> >      Raid Level : raid6
> >   Used Dev Size : 976759936 (931.51 GiB 1000.20 GB)
> >      Array Size : 7814079488 (7452.09 GiB 8001.62 GB)
> >    Raid Devices : 10
> >   Total Devices : 10
> > Preferred Minor : 5
> > 
> >     Update Time : Tue Dec 16 05:35:46 2008
> >           State : clean
> > Internal Bitmap : present
> >  Active Devices : 6
> > Working Devices : 6
> >  Failed Devices : 3
> >   Spare Devices : 0
> >        Checksum : e3df9ea2 - correct
> >          Events : 176870
> > 
> >      Chunk Size : 64K
> > 
> >       Number   Major   Minor   RaidDevice State
> > this     4       8       65        4      active sync   /dev/sde1
> > 
> >    0     0       0        0        0      removed
> >    1     1       0        0        1      faulty removed
> >    2     2       8       33        2      active sync   /dev/sdc1
> >    3     3       8       49        3      active sync   /dev/sdd1
> >    4     4       8       65        4      active sync   /dev/sde1
> >    5     5       8       81        5      active sync   /dev/sdf1
> >    6     6       8       97        6      active sync   /dev/sdg1
> >    7     7       0        0        7      faulty removed
> >    8     8       8      129        8      active sync   /dev/sdi1
> >    9     9       0        0        9      faulty removed
> > /dev/sdk1:
> >           Magic : a92b4efc
> >         Version : 00.90.00
> >            UUID : 77fa8675:444efef0:12f8dff0:9f609eb4
> >   Creation Time : Sun Jul 27 15:03:44 2008
> >      Raid Level : raid6
> >   Used Dev Size : 976759936 (931.51 GiB 1000.20 GB)
> >      Array Size : 7814079488 (7452.09 GiB 8001.62 GB)
> >    Raid Devices : 10
> >   Total Devices : 10
> > Preferred Minor : 5
> > 
> >     Update Time : Tue Dec 16 05:35:46 2008
> >           State : clean
> > Internal Bitmap : present
> >  Active Devices : 6
> > Working Devices : 6
> >  Failed Devices : 3
> >   Spare Devices : 0
> >        Checksum : e3df9e90 - correct
> >          Events : 176870
> > 
> >      Chunk Size : 64K
> > 
> >       Number   Major   Minor   RaidDevice State
> > this     3       8       49        3      active sync   /dev/sdd1
> > 
> >    0     0       0        0        0      removed
> >    1     1       0        0        1      faulty removed
> >    2     2       8       33        2      active sync   /dev/sdc1
> >    3     3       8       49        3      active sync   /dev/sdd1
> >    4     4       8       65        4      active sync   /dev/sde1
> >    5     5       8       81        5      active sync   /dev/sdf1
> >    6     6       8       97        6      active sync   /dev/sdg1
> >    7     7       0        0        7      faulty removed
> >    8     8       8      129        8      active sync   /dev/sdi1
> >    9     9       0        0        9      faulty removed
> > /dev/sdl1:
> >           Magic : a92b4efc
> >         Version : 00.90.00
> >            UUID : 77fa8675:444efef0:12f8dff0:9f609eb4
> >   Creation Time : Sun Jul 27 15:03:44 2008
> >      Raid Level : raid6
> >   Used Dev Size : 976759936 (931.51 GiB 1000.20 GB)
> >      Array Size : 7814079488 (7452.09 GiB 8001.62 GB)
> >    Raid Devices : 10
> >   Total Devices : 10
> > Preferred Minor : 5
> > 
> >     Update Time : Mon Dec 15 22:36:32 2008
> >           State : active
> > Internal Bitmap : present
> >  Active Devices : 9
> > Working Devices : 9
> >  Failed Devices : 1
> >   Spare Devices : 0
> >        Checksum : e3dc8525 - correct
> >          Events : 175787
> > 
> >      Chunk Size : 64K
> > 
> >       Number   Major   Minor   RaidDevice State
> > this     7       8      113        7      active sync   /dev/sdh1
> > 
> >    0     0       8        1        0      active sync   /dev/sda1
> >    1     1       8       17        1      active sync   /dev/sdb1
> >    2     2       8       33        2      active sync   /dev/sdc1
> >    3     3       8       49        3      active sync   /dev/sdd1
> >    4     4       8       65        4      active sync   /dev/sde1
> >    5     5       8       81        5      active sync   /dev/sdf1
> >    6     6       8       97        6      active sync   /dev/sdg1
> >    7     7       8      113        7      active sync   /dev/sdh1
> >    8     8       8      129        8      active sync   /dev/sdi1
> >    9     9       0        0        9      faulty removed
> > --
> > To unsubscribe from this list: send the line "unsubscribe linux-raid" in
> > the body of a message to majordomo@vger.kernel.org
> > More majordomo info at  http://vger.kernel.org/majordomo-info.html
> --
> To unsubscribe from this list: send the line "unsubscribe linux-raid" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html

  reply	other threads:[~2008-12-15 22:25 UTC|newest]

Thread overview: 7+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2008-12-15 22:03 Help recovering RAID6 failure Kevin Shanahan
2008-12-15 22:15 ` Neil Brown
2008-12-15 22:25   ` Kevin Shanahan [this message]
2008-12-15 22:37     ` Kevin Shanahan
2008-12-15 22:39       ` Kevin Shanahan
2008-12-15 23:05       ` Neil Brown
2008-12-15 23:18         ` Kevin Shanahan

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20081215222522.GF1749@cubit \
    --to=kmshanah@disenchant.net \
    --cc=linux-raid@vger.kernel.org \
    --cc=neilb@suse.de \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).