From: Semyon Enskiy <semyon.enskiy@yandex.ru>
To: Phil Turmel <philip@turmel.org>,
"linux-raid@vger.kernel.org" <linux-raid@vger.kernel.org>
Subject: Re: Recovering RAID5 with 2, actually 1, faulty disks.
Date: Wed, 25 Nov 2015 20:32:10 +0300 [thread overview]
Message-ID: <398591448472730@web17m.yandex.ru> (raw)
In-Reply-To: <5655E8D1.2050906@turmel.org>
> Hmmm. That's interesting. That means mdadm wrote the revert-reshape
> before it finished assembly. Try this:
>
> mdadm --stop /dev/md3
>
> mdadm --assemble --update=revert-reshape /dev/md3 /dev/sdj3
>
> That should fail w/ not enough to start, but apply the revert to that
> one drive. Then --stop again, and try with [a-j].
Phil, thanks for your sustaining.
Does you think, that problem is that "Raid Devices : 10", but
"Array State : AAAAAAAA.A.", where the extra, 11th, device is sdj3, which
was rejected from system in past, but record about it leave in superblock?
# mdadm --stop /dev/md3
mdadm: error opening /dev/md3: No such file or directory
# mdadm --assemble --update=revert-reshape /dev/md3 /dev/sdj3
mdadm: /dev/md3 assembled from 1 drive - not enough to start the array.
# mdadm --stop /dev/md3
mdadm: error opening /dev/md3: No such file or directory
# mdadm -v --assemble --update=revert-reshape /dev/md3 /dev/sd[a-j]3
mdadm: looking for devices for /dev/md3
mdadm: /dev/sda3 is identified as a member of /dev/md3, slot -1.
mdadm: /dev/sdb3 is identified as a member of /dev/md3, slot 6.
mdadm: /dev/sdc3 is identified as a member of /dev/md3, slot 7.
mdadm: /dev/sdd3 is identified as a member of /dev/md3, slot 4.
mdadm: /dev/sde3 is identified as a member of /dev/md3, slot 5.
mdadm: /dev/sdf3 is identified as a member of /dev/md3, slot 0.
mdadm: /dev/sdg3 is identified as a member of /dev/md3, slot 3.
mdadm: /dev/sdh3 is identified as a member of /dev/md3, slot 2.
mdadm: /dev/sdi3 is identified as a member of /dev/md3, slot 1.
mdadm: /dev/sdj3 is identified as a member of /dev/md3, slot 9.
mdadm: added /dev/sdi3 to /dev/md3 as 1
mdadm: added /dev/sdh3 to /dev/md3 as 2
mdadm: added /dev/sdg3 to /dev/md3 as 3
mdadm: added /dev/sdd3 to /dev/md3 as 4
mdadm: added /dev/sde3 to /dev/md3 as 5
mdadm: added /dev/sdb3 to /dev/md3 as 6
mdadm: added /dev/sdc3 to /dev/md3 as 7
mdadm: no uptodate device for slot 16 of /dev/md3
mdadm: added /dev/sdj3 to /dev/md3 as 9
mdadm: no uptodate device for slot 20 of /dev/md3
mdadm: added /dev/sda3 to /dev/md3 as -1
mdadm: added /dev/sdf3 to /dev/md3 as 0
mdadm: /dev/md3 assembled from 9 drives and 1 spare - not enough to start the array.
# mdadm -v --assemble --update=revert-reshape --force /dev/md3 /dev/sd[a-j]3
mdadm: looking for devices for /dev/md3
mdadm: /dev/sda3 is identified as a member of /dev/md3, slot -1.
mdadm: /dev/sdb3 is identified as a member of /dev/md3, slot 6.
mdadm: /dev/sdc3 is identified as a member of /dev/md3, slot 7.
mdadm: /dev/sdd3 is identified as a member of /dev/md3, slot 4.
mdadm: /dev/sde3 is identified as a member of /dev/md3, slot 5.
mdadm: /dev/sdf3 is identified as a member of /dev/md3, slot 0.
mdadm: /dev/sdg3 is identified as a member of /dev/md3, slot 3.
mdadm: /dev/sdh3 is identified as a member of /dev/md3, slot 2.
mdadm: /dev/sdi3 is identified as a member of /dev/md3, slot 1.
mdadm: /dev/sdj3 is identified as a member of /dev/md3, slot 9.
mdadm: added /dev/sdi3 to /dev/md3 as 1
mdadm: added /dev/sdh3 to /dev/md3 as 2
mdadm: added /dev/sdg3 to /dev/md3 as 3
mdadm: added /dev/sdd3 to /dev/md3 as 4
mdadm: added /dev/sde3 to /dev/md3 as 5
mdadm: added /dev/sdb3 to /dev/md3 as 6
mdadm: added /dev/sdc3 to /dev/md3 as 7
mdadm: no uptodate device for slot 16 of /dev/md3
mdadm: added /dev/sdj3 to /dev/md3 as 9
mdadm: no uptodate device for slot 20 of /dev/md3
mdadm: added /dev/sda3 to /dev/md3 as -1
mdadm: added /dev/sdf3 to /dev/md3 as 0
mdadm: /dev/md3 assembled from 9 drives and 1 spare - not enough to start the array.
# mdadm --examine /dev/sd?3
/dev/sda3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x45
Array UUID : 9bdc0939:483889af:b67c199b:2aaecb4e
Name : ubuntu:3
Creation Time : Thu Jul 24 16:06:32 2014
Raid Level : raid5
Raid Devices : 10
Avail Dev Size : 7799105167 (3718.90 GiB 3993.14 GB)
Array Size : 35095924224 (33470.08 GiB 35938.23 GB)
Used Dev Size : 7799094272 (3718.90 GiB 3993.14 GB)
Data Offset : 251904 sectors
New Offset : 262144 sectors
Super Offset : 8 sectors
State : clean
Device UUID : c0155214:a9c8e378:d368b6f6:735048a8
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : -1 (11->10)
Update Time : Fri Nov 6 16:53:06 2015
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : 952aa5ef - correct
Events : 21586
Layout : left-symmetric
Chunk Size : 512K
Device Role : spare
Array State : AAAAAAAA.A. ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdb3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x45
Array UUID : 9bdc0939:483889af:b67c199b:2aaecb4e
Name : ubuntu:3
Creation Time : Thu Jul 24 16:06:32 2014
Raid Level : raid5
Raid Devices : 10
Avail Dev Size : 7799105167 (3718.90 GiB 3993.14 GB)
Array Size : 35095924224 (33470.08 GiB 35938.23 GB)
Used Dev Size : 7799094272 (3718.90 GiB 3993.14 GB)
Data Offset : 251904 sectors
New Offset : 262144 sectors
Super Offset : 8 sectors
State : clean
Device UUID : 375d85e2:9077dd68:bc1327af:8fee4112
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : -1 (11->10)
Update Time : Fri Nov 6 16:53:06 2015
Checksum : 75b9e502 - correct
Events : 21586
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 6
Array State : AAAAAAAA.A. ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdc3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x45
Array UUID : 9bdc0939:483889af:b67c199b:2aaecb4e
Name : ubuntu:3
Creation Time : Thu Jul 24 16:06:32 2014
Raid Level : raid5
Raid Devices : 10
Avail Dev Size : 7799105167 (3718.90 GiB 3993.14 GB)
Array Size : 35095924224 (33470.08 GiB 35938.23 GB)
Used Dev Size : 7799094272 (3718.90 GiB 3993.14 GB)
Data Offset : 251904 sectors
New Offset : 262144 sectors
Super Offset : 8 sectors
State : clean
Device UUID : 67cd2bfa:affa578c:e0c1286a:bd4d2627
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : -1 (11->10)
Update Time : Fri Nov 6 16:53:06 2015
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : 80c8e5f0 - correct
Events : 21586
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 7
Array State : AAAAAAAA.A. ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdd3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x45
Array UUID : 9bdc0939:483889af:b67c199b:2aaecb4e
Name : ubuntu:3
Creation Time : Thu Jul 24 16:06:32 2014
Raid Level : raid5
Raid Devices : 10
Avail Dev Size : 7799105167 (3718.90 GiB 3993.14 GB)
Array Size : 35095924224 (33470.08 GiB 35938.23 GB)
Used Dev Size : 7799094272 (3718.90 GiB 3993.14 GB)
Data Offset : 251904 sectors
New Offset : 262144 sectors
Super Offset : 8 sectors
State : clean
Device UUID : 4490843e:d2c5c2e7:d222fa0a:f98b277c
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : -1 (11->10)
Update Time : Fri Nov 6 16:53:06 2015
Checksum : 165712cf - correct
Events : 21586
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 4
Array State : AAAAAAAA.A. ('A' == active, '.' == missing, 'R' == replacing)
/dev/sde3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x45
Array UUID : 9bdc0939:483889af:b67c199b:2aaecb4e
Name : ubuntu:3
Creation Time : Thu Jul 24 16:06:32 2014
Raid Level : raid5
Raid Devices : 10
Avail Dev Size : 7799105167 (3718.90 GiB 3993.14 GB)
Array Size : 35095924224 (33470.08 GiB 35938.23 GB)
Used Dev Size : 7799094272 (3718.90 GiB 3993.14 GB)
Data Offset : 251904 sectors
New Offset : 262144 sectors
Super Offset : 8 sectors
State : clean
Device UUID : 1d41056f:88149b1a:48e939e5:8c775e23
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : -1 (11->10)
Update Time : Fri Nov 6 16:53:06 2015
Checksum : fb26c467 - correct
Events : 21586
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 5
Array State : AAAAAAAA.A. ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdf3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x45
Array UUID : 9bdc0939:483889af:b67c199b:2aaecb4e
Name : ubuntu:3
Creation Time : Thu Jul 24 16:06:32 2014
Raid Level : raid5
Raid Devices : 10
Avail Dev Size : 7799105167 (3718.90 GiB 3993.14 GB)
Array Size : 35095924224 (33470.08 GiB 35938.23 GB)
Used Dev Size : 7799094272 (3718.90 GiB 3993.14 GB)
Data Offset : 251904 sectors
New Offset : 262144 sectors
Super Offset : 8 sectors
State : clean
Device UUID : fa7c541d:a25babd8:14ffe1c0:c6c1578c
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : -1 (11->10)
Update Time : Fri Nov 6 16:53:06 2015
Checksum : ac27a760 - correct
Events : 21586
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 0
Array State : AAAAAAAA.A. ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdg3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x45
Array UUID : 9bdc0939:483889af:b67c199b:2aaecb4e
Name : ubuntu:3
Creation Time : Thu Jul 24 16:06:32 2014
Raid Level : raid5
Raid Devices : 10
Avail Dev Size : 7799105167 (3718.90 GiB 3993.14 GB)
Array Size : 35095924224 (33470.08 GiB 35938.23 GB)
Used Dev Size : 7799094272 (3718.90 GiB 3993.14 GB)
Data Offset : 251904 sectors
New Offset : 262144 sectors
Super Offset : 8 sectors
State : clean
Device UUID : a4b8b425:b0307fe5:9eb8e3ac:ae985311
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : -1 (11->10)
Update Time : Fri Nov 6 16:53:06 2015
Checksum : 3259488d - correct
Events : 21586
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 3
Array State : AAAAAAAA.A. ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdh3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x45
Array UUID : 9bdc0939:483889af:b67c199b:2aaecb4e
Name : ubuntu:3
Creation Time : Thu Jul 24 16:06:32 2014
Raid Level : raid5
Raid Devices : 10
Avail Dev Size : 7799105167 (3718.90 GiB 3993.14 GB)
Array Size : 35095924224 (33470.08 GiB 35938.23 GB)
Used Dev Size : 7799094272 (3718.90 GiB 3993.14 GB)
Data Offset : 251904 sectors
New Offset : 262144 sectors
Super Offset : 8 sectors
State : clean
Device UUID : 345b0212:6c3a0ae8:d8ed9273:ecc53573
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : -1 (11->10)
Update Time : Fri Nov 6 16:53:06 2015
Checksum : 49c35750 - correct
Events : 21586
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 2
Array State : AAAAAAAA.A. ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdi3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x45
Array UUID : 9bdc0939:483889af:b67c199b:2aaecb4e
Name : ubuntu:3
Creation Time : Thu Jul 24 16:06:32 2014
Raid Level : raid5
Raid Devices : 10
Avail Dev Size : 7799105167 (3718.90 GiB 3993.14 GB)
Array Size : 35095924224 (33470.08 GiB 35938.23 GB)
Used Dev Size : 7799094272 (3718.90 GiB 3993.14 GB)
Data Offset : 251904 sectors
New Offset : 262144 sectors
Super Offset : 8 sectors
State : clean
Device UUID : 70afdaad:b0979fb1:1b99ef18:dd58cc3a
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : -1 (11->10)
Update Time : Fri Nov 6 16:53:06 2015
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : 1c2c4756 - correct
Events : 21586
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 1
Array State : AAAAAAAA.A. ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdj3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x45
Array UUID : 9bdc0939:483889af:b67c199b:2aaecb4e
Name : ubuntu:3
Creation Time : Thu Jul 24 16:06:32 2014
Raid Level : raid5
Raid Devices : 10
Avail Dev Size : 7799105167 (3718.90 GiB 3993.14 GB)
Array Size : 35095924224 (33470.08 GiB 35938.23 GB)
Used Dev Size : 7799094272 (3718.90 GiB 3993.14 GB)
Data Offset : 251904 sectors
New Offset : 262144 sectors
Super Offset : 8 sectors
State : clean
Device UUID : a5f2cea8:a89c88a0:0dd3900c:624f0491
Internal Bitmap : 8 sectors from superblock
Reshape pos'n : 0
Delta Devices : -1 (11->10)
Update Time : Fri Nov 6 16:53:06 2015
Checksum : 4fdabfb0 - correct
Events : 21586
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 9
Array State : AAAAAAAA.A. ('A' == active, '.' == missing, 'R' == replacing)
END OF MESSAGE
next prev parent reply other threads:[~2015-11-25 17:32 UTC|newest]
Thread overview: 17+ messages / expand[flat|nested] mbox.gz Atom feed top
2015-11-23 15:28 Recovering RAID5 with 2, actually 1, faulty disks Semyon Enskiy
2015-11-23 15:35 ` Semyon Enskiy
2015-11-23 15:47 ` Wols Lists
2015-11-23 15:57 ` Semyon Enskiy
2015-11-23 16:08 ` Wols Lists
2015-11-23 18:24 ` Phil Turmel
2015-11-25 12:12 ` Semyon Enskiy
2015-11-25 13:22 ` Phil Turmel
2015-11-25 14:48 ` Semyon Enskiy
2015-11-25 14:55 ` Semyon Enskiy
2015-11-25 15:44 ` Phil Turmel
2015-11-25 16:29 ` Semyon Enskiy
2015-11-25 16:58 ` Phil Turmel
2015-11-25 17:32 ` Semyon Enskiy [this message]
2015-11-25 17:49 ` Phil Turmel
2015-11-26 13:21 ` Semyon Enskiy
-- strict thread matches above, loose matches on Subject: below --
2015-12-02 13:35 Semyon Enskiy
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=398591448472730@web17m.yandex.ru \
--to=semyon.enskiy@yandex.ru \
--cc=linux-raid@vger.kernel.org \
--cc=philip@turmel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox