From: Semyon Enskiy <semyon.enskiy@yandex.ru>
To: Phil Turmel <philip@turmel.org>,
"linux-raid@vger.kernel.org" <linux-raid@vger.kernel.org>
Subject: Re: Recovering RAID5 with 2, actually 1, faulty disks.
Date: Wed, 25 Nov 2015 20:32:10 +0300 [thread overview]
Message-ID: <398591448472730@web17m.yandex.ru> (raw)
In-Reply-To: <5655E8D1.2050906@turmel.org>
> Hmmm. That's interesting. That means mdadm wrote the revert-reshape
> before it finished assembly. Try this:
>
> mdadm --stop /dev/md3
>
> mdadm --assemble --update=revert-reshape /dev/md3 /dev/sdj3
>
> That should fail w/ not enough to start, but apply the revert to that
> one drive. Then --stop again, and try with [a-j].
Phil, thanks for your sustaining.
Does you think, that problem is that "Raid Devices : 10", but
"Array State : AAAAAAAA.A.", where the extra, 11th, device is sdj3, which
was rejected from system in past, but record about it leave in superblock?
# mdadm --stop /dev/md3
mdadm: error opening /dev/md3: No such file or directory
# mdadm --assemble --update=revert-reshape /dev/md3 /dev/sdj3
mdadm: /dev/md3 assembled from 1 drive - not enough to start the array.
# mdadm --stop /dev/md3
mdadm: error opening /dev/md3: No such file or directory
# mdadm -v --assemble --update=revert-reshape /dev/md3 /dev/sd[a-j]3
mdadm: looking for devices for /dev/md3
mdadm: /dev/sda3 is identified as a member of /dev/md3, slot -1.
mdadm: /dev/sdb3 is identified as a member of /dev/md3, slot 6.
mdadm: /dev/sdc3 is identified as a member of /dev/md3, slot 7.
mdadm: /dev/sdd3 is identified as a member of /dev/md3, slot 4.
mdadm: /dev/sde3 is identified as a member of /dev/md3, slot 5.
mdadm: /dev/sdf3 is identified as a member of /dev/md3, slot 0.
mdadm: /dev/sdg3 is identified as a member of /dev/md3, slot 3.
mdadm: /dev/sdh3 is identified as a member of /dev/md3, slot 2.
mdadm: /dev/sdi3 is identified as a member of /dev/md3, slot 1.
mdadm: /dev/sdj3 is identified as a member of /dev/md3, slot 9.
mdadm: added /dev/sdi3 to /dev/md3 as 1
mdadm: added /dev/sdh3 to /dev/md3 as 2
mdadm: added /dev/sdg3 to /dev/md3 as 3
mdadm: added /dev/sdd3 to /dev/md3 as 4
mdadm: added /dev/sde3 to /dev/md3 as 5
mdadm: added /dev/sdb3 to /dev/md3 as 6
mdadm: added /dev/sdc3 to /dev/md3 as 7
mdadm: no uptodate device for slot 16 of /dev/md3
mdadm: added /dev/sdj3 to /dev/md3 as 9
mdadm: no uptodate device for slot 20 of /dev/md3
mdadm: added /dev/sda3 to /dev/md3 as -1
mdadm: added /dev/sdf3 to /dev/md3 as 0
mdadm: /dev/md3 assembled from 9 drives and 1 spare - not enough to start the array.
# mdadm -v --assemble --update=revert-reshape --force /dev/md3 /dev/sd[a-j]3
mdadm: looking for devices for /dev/md3
mdadm: /dev/sda3 is identified as a member of /dev/md3, slot -1.
mdadm: /dev/sdb3 is identified as a member of /dev/md3, slot 6.
mdadm: /dev/sdc3 is identified as a member of /dev/md3, slot 7.
mdadm: /dev/sdd3 is identified as a member of /dev/md3, slot 4.
mdadm: /dev/sde3 is identified as a member of /dev/md3, slot 5.
mdadm: /dev/sdf3 is identified as a member of /dev/md3, slot 0.
mdadm: /dev/sdg3 is identified as a member of /dev/md3, slot 3.
mdadm: /dev/sdh3 is identified as a member of /dev/md3, slot 2.
mdadm: /dev/sdi3 is identified as a member of /dev/md3, slot 1.
mdadm: /dev/sdj3 is identified as a member of /dev/md3, slot 9.
mdadm: added /dev/sdi3 to /dev/md3 as 1
mdadm: added /dev/sdh3 to /dev/md3 as 2
mdadm: added /dev/sdg3 to /dev/md3 as 3
mdadm: added /dev/sdd3 to /dev/md3 as 4
mdadm: added /dev/sde3 to /dev/md3 as 5
mdadm: added /dev/sdb3 to /dev/md3 as 6
mdadm: added /dev/sdc3 to /dev/md3 as 7
mdadm: no uptodate device for slot 16 of /dev/md3
mdadm: added /dev/sdj3 to /dev/md3 as 9
mdadm: no uptodate device for slot 20 of /dev/md3
mdadm: added /dev/sda3 to /dev/md3 as -1
mdadm: added /dev/sdf3 to /dev/md3 as 0
mdadm: /dev/md3 assembled from 9 drives and 1 spare - not enough to start the array.
# mdadm --examine /dev/sd?3
/dev/sda3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x45
Array UUID : 9bdc0939:483889af:b67c199b:2aaecb4e
Name : ubuntu:3
Creation Time : Thu Jul 24 16:06:32 2014
Raid Level : raid5
Raid Devices : 10
Avail Dev Size : 7799105167 (3718.90 GiB 3993.14 GB)
Array Size : 35095924224 (33470.08 GiB 35938.23 GB)
Used Dev Size : 7799094272 (3718.90 GiB 3993.14 GB)
Data Offset : 251904 sectors
New Offset : 262144 sectors
Super Offset : 8 sectors
State : clean
Device UUID : c0155214:a9c8e378:d368b6f6:735048a8
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : -1 (11->10)
Update Time : Fri Nov 6 16:53:06 2015
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : 952aa5ef - correct
Events : 21586
Layout : left-symmetric
Chunk Size : 512K
Device Role : spare
Array State : AAAAAAAA.A. ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdb3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x45
Array UUID : 9bdc0939:483889af:b67c199b:2aaecb4e
Name : ubuntu:3
Creation Time : Thu Jul 24 16:06:32 2014
Raid Level : raid5
Raid Devices : 10
Avail Dev Size : 7799105167 (3718.90 GiB 3993.14 GB)
Array Size : 35095924224 (33470.08 GiB 35938.23 GB)
Used Dev Size : 7799094272 (3718.90 GiB 3993.14 GB)
Data Offset : 251904 sectors
New Offset : 262144 sectors
Super Offset : 8 sectors
State : clean
Device UUID : 375d85e2:9077dd68:bc1327af:8fee4112
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : -1 (11->10)
Update Time : Fri Nov 6 16:53:06 2015
Checksum : 75b9e502 - correct
Events : 21586
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 6
Array State : AAAAAAAA.A. ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdc3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x45
Array UUID : 9bdc0939:483889af:b67c199b:2aaecb4e
Name : ubuntu:3
Creation Time : Thu Jul 24 16:06:32 2014
Raid Level : raid5
Raid Devices : 10
Avail Dev Size : 7799105167 (3718.90 GiB 3993.14 GB)
Array Size : 35095924224 (33470.08 GiB 35938.23 GB)
Used Dev Size : 7799094272 (3718.90 GiB 3993.14 GB)
Data Offset : 251904 sectors
New Offset : 262144 sectors
Super Offset : 8 sectors
State : clean
Device UUID : 67cd2bfa:affa578c:e0c1286a:bd4d2627
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : -1 (11->10)
Update Time : Fri Nov 6 16:53:06 2015
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : 80c8e5f0 - correct
Events : 21586
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 7
Array State : AAAAAAAA.A. ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdd3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x45
Array UUID : 9bdc0939:483889af:b67c199b:2aaecb4e
Name : ubuntu:3
Creation Time : Thu Jul 24 16:06:32 2014
Raid Level : raid5
Raid Devices : 10
Avail Dev Size : 7799105167 (3718.90 GiB 3993.14 GB)
Array Size : 35095924224 (33470.08 GiB 35938.23 GB)
Used Dev Size : 7799094272 (3718.90 GiB 3993.14 GB)
Data Offset : 251904 sectors
New Offset : 262144 sectors
Super Offset : 8 sectors
State : clean
Device UUID : 4490843e:d2c5c2e7:d222fa0a:f98b277c
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : -1 (11->10)
Update Time : Fri Nov 6 16:53:06 2015
Checksum : 165712cf - correct
Events : 21586
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 4
Array State : AAAAAAAA.A. ('A' == active, '.' == missing, 'R' == replacing)
/dev/sde3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x45
Array UUID : 9bdc0939:483889af:b67c199b:2aaecb4e
Name : ubuntu:3
Creation Time : Thu Jul 24 16:06:32 2014
Raid Level : raid5
Raid Devices : 10
Avail Dev Size : 7799105167 (3718.90 GiB 3993.14 GB)
Array Size : 35095924224 (33470.08 GiB 35938.23 GB)
Used Dev Size : 7799094272 (3718.90 GiB 3993.14 GB)
Data Offset : 251904 sectors
New Offset : 262144 sectors
Super Offset : 8 sectors
State : clean
Device UUID : 1d41056f:88149b1a:48e939e5:8c775e23
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : -1 (11->10)
Update Time : Fri Nov 6 16:53:06 2015
Checksum : fb26c467 - correct
Events : 21586
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 5
Array State : AAAAAAAA.A. ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdf3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x45
Array UUID : 9bdc0939:483889af:b67c199b:2aaecb4e
Name : ubuntu:3
Creation Time : Thu Jul 24 16:06:32 2014
Raid Level : raid5
Raid Devices : 10
Avail Dev Size : 7799105167 (3718.90 GiB 3993.14 GB)
Array Size : 35095924224 (33470.08 GiB 35938.23 GB)
Used Dev Size : 7799094272 (3718.90 GiB 3993.14 GB)
Data Offset : 251904 sectors
New Offset : 262144 sectors
Super Offset : 8 sectors
State : clean
Device UUID : fa7c541d:a25babd8:14ffe1c0:c6c1578c
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : -1 (11->10)
Update Time : Fri Nov 6 16:53:06 2015
Checksum : ac27a760 - correct
Events : 21586
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 0
Array State : AAAAAAAA.A. ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdg3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x45
Array UUID : 9bdc0939:483889af:b67c199b:2aaecb4e
Name : ubuntu:3
Creation Time : Thu Jul 24 16:06:32 2014
Raid Level : raid5
Raid Devices : 10
Avail Dev Size : 7799105167 (3718.90 GiB 3993.14 GB)
Array Size : 35095924224 (33470.08 GiB 35938.23 GB)
Used Dev Size : 7799094272 (3718.90 GiB 3993.14 GB)
Data Offset : 251904 sectors
New Offset : 262144 sectors
Super Offset : 8 sectors
State : clean
Device UUID : a4b8b425:b0307fe5:9eb8e3ac:ae985311
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : -1 (11->10)
Update Time : Fri Nov 6 16:53:06 2015
Checksum : 3259488d - correct
Events : 21586
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 3
Array State : AAAAAAAA.A. ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdh3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x45
Array UUID : 9bdc0939:483889af:b67c199b:2aaecb4e
Name : ubuntu:3
Creation Time : Thu Jul 24 16:06:32 2014
Raid Level : raid5
Raid Devices : 10
Avail Dev Size : 7799105167 (3718.90 GiB 3993.14 GB)
Array Size : 35095924224 (33470.08 GiB 35938.23 GB)
Used Dev Size : 7799094272 (3718.90 GiB 3993.14 GB)
Data Offset : 251904 sectors
New Offset : 262144 sectors
Super Offset : 8 sectors
State : clean
Device UUID : 345b0212:6c3a0ae8:d8ed9273:ecc53573
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : -1 (11->10)
Update Time : Fri Nov 6 16:53:06 2015
Checksum : 49c35750 - correct
Events : 21586
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 2
Array State : AAAAAAAA.A. ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdi3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x45
Array UUID : 9bdc0939:483889af:b67c199b:2aaecb4e
Name : ubuntu:3
Creation Time : Thu Jul 24 16:06:32 2014
Raid Level : raid5
Raid Devices : 10
Avail Dev Size : 7799105167 (3718.90 GiB 3993.14 GB)
Array Size : 35095924224 (33470.08 GiB 35938.23 GB)
Used Dev Size : 7799094272 (3718.90 GiB 3993.14 GB)
Data Offset : 251904 sectors
New Offset : 262144 sectors
Super Offset : 8 sectors
State : clean
Device UUID : 70afdaad:b0979fb1:1b99ef18:dd58cc3a
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : -1 (11->10)
Update Time : Fri Nov 6 16:53:06 2015
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : 1c2c4756 - correct
Events : 21586
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 1
Array State : AAAAAAAA.A. ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdj3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x45
Array UUID : 9bdc0939:483889af:b67c199b:2aaecb4e
Name : ubuntu:3
Creation Time : Thu Jul 24 16:06:32 2014
Raid Level : raid5
Raid Devices : 10
Avail Dev Size : 7799105167 (3718.90 GiB 3993.14 GB)
Array Size : 35095924224 (33470.08 GiB 35938.23 GB)
Used Dev Size : 7799094272 (3718.90 GiB 3993.14 GB)
Data Offset : 251904 sectors
New Offset : 262144 sectors
Super Offset : 8 sectors
State : clean
Device UUID : a5f2cea8:a89c88a0:0dd3900c:624f0491
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : -1 (11->10)
Update Time : Fri Nov 6 16:53:06 2015
Checksum : 4fdabfb0 - correct
Events : 21586
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 9
Array State : AAAAAAAA.A. ('A' == active, '.' == missing, 'R' == replacing)
END OF MESSAGE
next prev parent reply other threads:[~2015-11-25 17:32 UTC|newest]
Thread overview: 17+ messages / expand[flat|nested] mbox.gz Atom feed top
2015-11-23 15:28 Recovering RAID5 with 2, actually 1, faulty disks Semyon Enskiy
2015-11-23 15:35 ` Semyon Enskiy
2015-11-23 15:47 ` Wols Lists
2015-11-23 15:57 ` Semyon Enskiy
2015-11-23 16:08 ` Wols Lists
2015-11-23 18:24 ` Phil Turmel
2015-11-25 12:12 ` Semyon Enskiy
2015-11-25 13:22 ` Phil Turmel
2015-11-25 14:48 ` Semyon Enskiy
2015-11-25 14:55 ` Semyon Enskiy
2015-11-25 15:44 ` Phil Turmel
2015-11-25 16:29 ` Semyon Enskiy
2015-11-25 16:58 ` Phil Turmel
2015-11-25 17:32 ` Semyon Enskiy [this message]
2015-11-25 17:49 ` Phil Turmel
2015-11-26 13:21 ` Semyon Enskiy
-- strict thread matches above, loose matches on Subject: below --
2015-12-02 13:35 Semyon Enskiy
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=398591448472730@web17m.yandex.ru \
--to=semyon.enskiy@yandex.ru \
--cc=linux-raid@vger.kernel.org \
--cc=philip@turmel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.