From: Semyon Enskiy <semyon.enskiy@yandex.ru>
To: philip@turmel.org,
"linux-raid@vger.kernel.org" <linux-raid@vger.kernel.org>
Subject: Re: Recovering RAID5 with 2, actually 1, faulty disks.
Date: Wed, 2 Dec 2015 16:35:55 +0300 [thread overview]
Message-ID: <565EF3BB.3000306@yandex.ru> (raw)
Hello, Phil, thank you for help.
Writing to report, that array and LVM/ext4 on it successfully restored.
# Before rebooting and committing changes, dump of first 10 MB was done,
now restore headers.
# for i in f i h g d e b c a j; do dd if=devsd"$i"3-head-bigger.raw
of=/dev/sd"$i"3; done
# Without revert-reshape assembling.
# mdadm --create --assume-clean --level=5 --raid-devices=10
--metadata=1.2 /dev/md3 /dev/sd{f,i,h,g,d,e,b,c,a,j}3
# cat /proc/mdstat
Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5]
[raid4] [raid10]
md3 : active raid5 sdj3[9] sda3[8] sdc3[7] sdb3[6] sde3[5] sdd3[4]
sdg3[3] sdh3[2] sdi3[1] sdf3[0]
35095924224 blocks super 1.2 level 5, 512k chunk, algorithm 2
[10/10] [UUUUUUUUUU]
bitmap: 1/30 pages [4KB], 65536KB chunk
# blkid /dev/md3
/dev/md3: UUID="4bz7kl-2QWk-4YZX-IDmH-IFXL-eM3l-F2dB2n" TYPE="LVM2_member"
# vgchange -aay
# blkid /dev/vg/data
/dev/vg/data: UUID="60e11554-074d-4156-a4d3-ed43318f5446" TYPE="ext4"
# fsck.ext4 /dev/vg/data
e2fsck 1.42.9 (4-Feb-2014)
/dev/vg/data: clean, 464/548112384 files, 4798924497/8769786880 blocks
# mount /dev/vg/data
# echo check > /sys/block/md3/md/sync_action
# mdadm --detail /dev/md3
/dev/md3:
Version : 1.2
Creation Time : Wed Dec 2 13:09:01 2015
Raid Level : raid5
Array Size : 35095924224 (33470.08 GiB 35938.23 GB)
Used Dev Size : 3899547136 (3718.90 GiB 3993.14 GB)
Raid Devices : 10
Total Devices : 10
Persistence : Superblock is persistent
Intent Bitmap : Internal
Update Time : Wed Dec 2 13:40:04 2015
State : active
Active Devices : 10
Working Devices : 10
Failed Devices : 0
Spare Devices : 0
Layout : left-symmetric
Chunk Size : 512K
Name : ubuntu:3 (local to host ubuntu)
UUID : 39b91f6d:7fd12764:825bb342:dd4d14fd
Events : 2
Number Major Minor RaidDevice State
0 8 83 0 active sync /dev/sdf3
1 8 131 1 active sync /dev/sdi3
2 8 115 2 active sync /dev/sdh3
3 8 99 3 active sync /dev/sdg3
4 8 51 4 active sync /dev/sdd3
5 8 67 5 active sync /dev/sde3
6 8 19 6 active sync /dev/sdb3
7 8 35 7 active sync /dev/sdc3
8 8 3 8 active sync /dev/sda3
9 8 147 9 active sync /dev/sdj3
# mdadm --examine /dev/sd?3
/dev/sda3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : 39b91f6d:7fd12764:825bb342:dd4d14fd
Name : ubuntu:3 (local to host ubuntu)
Creation Time : Wed Dec 2 13:09:01 2015
Raid Level : raid5
Raid Devices : 10
Avail Dev Size : 7799094927 (3718.90 GiB 3993.14 GB)
Array Size : 35095924224 (33470.08 GiB 35938.23 GB)
Used Dev Size : 7799094272 (3718.90 GiB 3993.14 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262056 sectors, after=655 sectors
State : clean
Device UUID : 074ebbe7:81662e37:cc777096:3d50d481
Internal Bitmap : 8 sectors from superblock
Update Time : Wed Dec 2 15:19:29 2015
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : d47becef - correct
Events : 2
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 8
Array State : AAAAAAAAAA ('A' == active, '.' == missing, 'R' ==
replacing)
/dev/sdb3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : 39b91f6d:7fd12764:825bb342:dd4d14fd
Name : ubuntu:3 (local to host ubuntu)
Creation Time : Wed Dec 2 13:09:01 2015
Raid Level : raid5
Raid Devices : 10
Avail Dev Size : 7799094927 (3718.90 GiB 3993.14 GB)
Array Size : 35095924224 (33470.08 GiB 35938.23 GB)
Used Dev Size : 7799094272 (3718.90 GiB 3993.14 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262056 sectors, after=655 sectors
State : clean
Device UUID : 4adc3cf2:9d813d1e:ab8044ab:0cc5afe8
Internal Bitmap : 8 sectors from superblock
Update Time : Wed Dec 2 15:19:29 2015
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : 41bc13fb - correct
Events : 2
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 6
Array State : AAAAAAAAAA ('A' == active, '.' == missing, 'R' ==
replacing)
/dev/sdc3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : 39b91f6d:7fd12764:825bb342:dd4d14fd
Name : ubuntu:3 (local to host ubuntu)
Creation Time : Wed Dec 2 13:09:01 2015
Raid Level : raid5
Raid Devices : 10
Avail Dev Size : 7799094927 (3718.90 GiB 3993.14 GB)
Array Size : 35095924224 (33470.08 GiB 35938.23 GB)
Used Dev Size : 7799094272 (3718.90 GiB 3993.14 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262056 sectors, after=655 sectors
State : clean
Device UUID : ddc9c73b:007f6c0f:35a03e5c:e5fc8157
Internal Bitmap : 8 sectors from superblock
Update Time : Wed Dec 2 15:19:29 2015
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : 9c425653 - correct
Events : 2
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 7
Array State : AAAAAAAAAA ('A' == active, '.' == missing, 'R' ==
replacing)
/dev/sdd3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : 39b91f6d:7fd12764:825bb342:dd4d14fd
Name : ubuntu:3 (local to host ubuntu)
Creation Time : Wed Dec 2 13:09:01 2015
Raid Level : raid5
Raid Devices : 10
Avail Dev Size : 7799094927 (3718.90 GiB 3993.14 GB)
Array Size : 35095924224 (33470.08 GiB 35938.23 GB)
Used Dev Size : 7799094272 (3718.90 GiB 3993.14 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262056 sectors, after=655 sectors
State : clean
Device UUID : 73077551:029e51dc:6d036bf4:b81195a4
Internal Bitmap : 8 sectors from superblock
Update Time : Wed Dec 2 15:19:29 2015
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : 64142af5 - correct
Events : 2
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 4
Array State : AAAAAAAAAA ('A' == active, '.' == missing, 'R' ==
replacing)
/dev/sde3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : 39b91f6d:7fd12764:825bb342:dd4d14fd
Name : ubuntu:3 (local to host ubuntu)
Creation Time : Wed Dec 2 13:09:01 2015
Raid Level : raid5
Raid Devices : 10
Avail Dev Size : 7799094927 (3718.90 GiB 3993.14 GB)
Array Size : 35095924224 (33470.08 GiB 35938.23 GB)
Used Dev Size : 7799094272 (3718.90 GiB 3993.14 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262056 sectors, after=655 sectors
State : clean
Device UUID : 1edcf3a7:9decc271:262271a6:54cff640
Internal Bitmap : 8 sectors from superblock
Update Time : Wed Dec 2 15:19:29 2015
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : 9e6c2a90 - correct
Events : 2
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 5
Array State : AAAAAAAAAA ('A' == active, '.' == missing, 'R' ==
replacing)
/dev/sdf3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : 39b91f6d:7fd12764:825bb342:dd4d14fd
Name : ubuntu:3 (local to host ubuntu)
Creation Time : Wed Dec 2 13:09:01 2015
Raid Level : raid5
Raid Devices : 10
Avail Dev Size : 7799094927 (3718.90 GiB 3993.14 GB)
Array Size : 35095924224 (33470.08 GiB 35938.23 GB)
Used Dev Size : 7799094272 (3718.90 GiB 3993.14 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262056 sectors, after=655 sectors
State : clean
Device UUID : 0438b536:b5943d93:70280dd9:70952d14
Internal Bitmap : 8 sectors from superblock
Update Time : Wed Dec 2 15:19:29 2015
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : 547afaef - correct
Events : 2
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 0
Array State : AAAAAAAAAA ('A' == active, '.' == missing, 'R' ==
replacing)
/dev/sdg3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : 39b91f6d:7fd12764:825bb342:dd4d14fd
Name : ubuntu:3 (local to host ubuntu)
Creation Time : Wed Dec 2 13:09:01 2015
Raid Level : raid5
Raid Devices : 10
Avail Dev Size : 7799094927 (3718.90 GiB 3993.14 GB)
Array Size : 35095924224 (33470.08 GiB 35938.23 GB)
Used Dev Size : 7799094272 (3718.90 GiB 3993.14 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262056 sectors, after=655 sectors
State : clean
Device UUID : e16e0db6:5d8e9016:84d2034b:7519f24d
Internal Bitmap : 8 sectors from superblock
Update Time : Wed Dec 2 15:19:29 2015
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : 2e15990 - correct
Events : 2
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 3
Array State : AAAAAAAAAA ('A' == active, '.' == missing, 'R' ==
replacing)
/dev/sdh3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : 39b91f6d:7fd12764:825bb342:dd4d14fd
Name : ubuntu:3 (local to host ubuntu)
Creation Time : Wed Dec 2 13:09:01 2015
Raid Level : raid5
Raid Devices : 10
Avail Dev Size : 7799094927 (3718.90 GiB 3993.14 GB)
Array Size : 35095924224 (33470.08 GiB 35938.23 GB)
Used Dev Size : 7799094272 (3718.90 GiB 3993.14 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262056 sectors, after=655 sectors
State : clean
Device UUID : 32bdd4dd:934c3ba5:adc8bfc2:0f1f323e
Internal Bitmap : 8 sectors from superblock
Update Time : Wed Dec 2 15:19:29 2015
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : 214f61da - correct
Events : 2
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 2
Array State : AAAAAAAAAA ('A' == active, '.' == missing, 'R' ==
replacing)
/dev/sdi3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : 39b91f6d:7fd12764:825bb342:dd4d14fd
Name : ubuntu:3 (local to host ubuntu)
Creation Time : Wed Dec 2 13:09:01 2015
Raid Level : raid5
Raid Devices : 10
Avail Dev Size : 7799094927 (3718.90 GiB 3993.14 GB)
Array Size : 35095924224 (33470.08 GiB 35938.23 GB)
Used Dev Size : 7799094272 (3718.90 GiB 3993.14 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262056 sectors, after=655 sectors
State : clean
Device UUID : bd0d56ba:78e5ee76:d600d587:ab65cbc9
Internal Bitmap : 8 sectors from superblock
Update Time : Wed Dec 2 15:19:29 2015
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : 2032ca0e - correct
Events : 2
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 1
Array State : AAAAAAAAAA ('A' == active, '.' == missing, 'R' ==
replacing)
/dev/sdj3:
Magic : a92b4efc
Version : 1.2
Feature Map : 0x1
Array UUID : 39b91f6d:7fd12764:825bb342:dd4d14fd
Name : ubuntu:3 (local to host ubuntu)
Creation Time : Wed Dec 2 13:09:01 2015
Raid Level : raid5
Raid Devices : 10
Avail Dev Size : 7799094927 (3718.90 GiB 3993.14 GB)
Array Size : 35095924224 (33470.08 GiB 35938.23 GB)
Used Dev Size : 7799094272 (3718.90 GiB 3993.14 GB)
Data Offset : 262144 sectors
Super Offset : 8 sectors
Unused Space : before=262056 sectors, after=655 sectors
State : clean
Device UUID : 35d4e323:8e2485cb:2c6492a1:e9f8e215
Internal Bitmap : 8 sectors from superblock
Update Time : Wed Dec 2 15:19:29 2015
Bad Block Log : 512 entries available at offset 72 sectors
Checksum : 442bc637 - correct
Events : 2
Layout : left-symmetric
Chunk Size : 512K
Device Role : Active device 9
Array State : AAAAAAAAAA ('A' == active, '.' == missing, 'R' ==
replacing)
next reply other threads:[~2015-12-02 13:35 UTC|newest]
Thread overview: 17+ messages / expand[flat|nested] mbox.gz Atom feed top
2015-12-02 13:35 Semyon Enskiy [this message]
-- strict thread matches above, loose matches on Subject: below --
2015-11-23 15:28 Recovering RAID5 with 2, actually 1, faulty disks Semyon Enskiy
2015-11-23 15:35 ` Semyon Enskiy
2015-11-23 15:47 ` Wols Lists
2015-11-23 15:57 ` Semyon Enskiy
2015-11-23 16:08 ` Wols Lists
2015-11-23 18:24 ` Phil Turmel
2015-11-25 12:12 ` Semyon Enskiy
2015-11-25 13:22 ` Phil Turmel
2015-11-25 14:48 ` Semyon Enskiy
2015-11-25 14:55 ` Semyon Enskiy
2015-11-25 15:44 ` Phil Turmel
2015-11-25 16:29 ` Semyon Enskiy
2015-11-25 16:58 ` Phil Turmel
2015-11-25 17:32 ` Semyon Enskiy
2015-11-25 17:49 ` Phil Turmel
2015-11-26 13:21 ` Semyon Enskiy
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=565EF3BB.3000306@yandex.ru \
--to=semyon.enskiy@yandex.ru \
--cc=linux-raid@vger.kernel.org \
--cc=philip@turmel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox