From mboxrd@z Thu Jan 1 00:00:00 1970 From: Semyon Enskiy Subject: Re: Recovering RAID5 with 2, actually 1, faulty disks. Date: Wed, 25 Nov 2015 19:29:04 +0300 Message-ID: <166511448468944@web24o.yandex.ru> References: <189791448292518@web28m.yandex.ru> <565359F6.3020201@turmel.org> <3822301448453563@web17m.yandex.ru> <5655B62F.2070806@turmel.org> <240681448462882@web25o.yandex.ru> <939171448463324@web17m.yandex.ru> <5655D75B.9020901@turmel.org> Mime-Version: 1.0 Content-Type: text/plain; charset=koi8-r Content-Transfer-Encoding: QUOTED-PRINTABLE Return-path: In-Reply-To: <5655D75B.9020901@turmel.org> Sender: linux-raid-owner@vger.kernel.org To: Phil Turmel , "linux-raid@vger.kernel.org" List-Id: linux-raid.ids >> =9AMaybe assemble command should include sdj3 device too? >> =9ALike >> =9A# mdadm -v --assemble --update=3Drevert-reshape /dev/md3 /dev/sd[= a-j]3 >> =9Anot >> =9A# mdadm -v --assemble --update=3Drevert-reshape /dev/md3 /dev/sd[= a-i]3 > > Yes, my mistake. :-( Try again, including 'sdj3'. > > Phil # mdadm -v --assemble --update=3Drevert-reshape /dev/md3 /dev/sd[a-j]3 mdadm: looking for devices for /dev/md3 mdadm: superblock on /dev/sdj3 doesn't match others - assembly aborted # mdadm -v --assemble --update=3Drevert-reshape --force /dev/md3 /dev/s= d[a-j]3 mdadm: looking for devices for /dev/md3 mdadm: superblock on /dev/sdj3 doesn't match others - assembly aborted Note, that --examine in previous message shows delta devices value "-1"= for all members of array, excepting sdj3, which has value "1", without minu= s symbol. According to mdadm wiki 1.2v superblock placed on device after first 4K= and has size 256 Bytes, plus 2 Bytes per device in the array, in current ca= se this is 276 Bytes. Dumping superblock: # for i in /dev/sd?3; do dd ibs=3D1c skip=3D4000 count=3D276 if=3D$i of= =3D`echo $i | tr -d /`-superblock.raw; done # for i in devsd*.raw; do echo -e "\n$i" && hd -v $i; done > superblock= -dump-000.txt devsda3-superblock.raw 00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000010 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000020 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000040 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000060 fc 4e 2b a9 01 00 00 00 45 00 00 00 00 00 00 00 |.N+.....E.= =2E.....| 00000070 9b dc 09 39 48 38 89 af b6 7c 19 9b 2a ae cb 4e |...9H8...|= =2E.*..N| 00000080 75 62 75 6e 74 75 3a 33 00 00 00 00 00 00 00 00 |ubuntu:3..= =2E.....| 00000090 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 000000a0 c8 f6 d0 53 00 00 00 00 05 00 00 00 02 00 00 00 |...S......= =2E.....| 000000b0 00 bc dc d0 01 00 00 00 00 04 00 00 0a 00 00 00 |..........= =2E.....| 000000c0 08 00 00 00 05 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 000000d0 ff ff ff ff 02 00 00 00 00 04 00 00 00 28 00 00 |..........= =2E..(..| 000000e0 00 d8 03 00 00 00 00 00 8f e6 dc d0 01 00 00 00 |..........= =2E.....| 000000f0 08 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000100 0e 00 00 00 00 00 00 00 c0 15 52 14 a9 c8 e3 78 |..........= R....x| 00000110 d3 68 b6 f6 |.h..| 00000114 devsdb3-superblock.raw 00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000010 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000020 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000040 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000060 fc 4e 2b a9 01 00 00 00 45 00 00 00 00 00 00 00 |.N+.....E.= =2E.....| 00000070 9b dc 09 39 48 38 89 af b6 7c 19 9b 2a ae cb 4e |...9H8...|= =2E.*..N| 00000080 75 62 75 6e 74 75 3a 33 00 00 00 00 00 00 00 00 |ubuntu:3..= =2E.....| 00000090 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 000000a0 c8 f6 d0 53 00 00 00 00 05 00 00 00 02 00 00 00 |...S......= =2E.....| 000000b0 00 bc dc d0 01 00 00 00 00 04 00 00 0a 00 00 00 |..........= =2E.....| 000000c0 08 00 00 00 05 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 000000d0 ff ff ff ff 02 00 00 00 00 04 00 00 00 28 00 00 |..........= =2E..(..| 000000e0 00 d8 03 00 00 00 00 00 8f e6 dc d0 01 00 00 00 |..........= =2E.....| 000000f0 08 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000100 06 00 00 00 00 00 00 00 37 5d 85 e2 90 77 dd 68 |........7]= =2E..w.h| 00000110 bc 13 27 af |..'.| 00000114 devsdc3-superblock.raw 00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000010 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000020 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000040 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000060 fc 4e 2b a9 01 00 00 00 45 00 00 00 00 00 00 00 |.N+.....E.= =2E.....| 00000070 9b dc 09 39 48 38 89 af b6 7c 19 9b 2a ae cb 4e |...9H8...|= =2E.*..N| 00000080 75 62 75 6e 74 75 3a 33 00 00 00 00 00 00 00 00 |ubuntu:3..= =2E.....| 00000090 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 000000a0 c8 f6 d0 53 00 00 00 00 05 00 00 00 02 00 00 00 |...S......= =2E.....| 000000b0 00 bc dc d0 01 00 00 00 00 04 00 00 0a 00 00 00 |..........= =2E.....| 000000c0 08 00 00 00 05 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 000000d0 ff ff ff ff 02 00 00 00 00 04 00 00 00 28 00 00 |..........= =2E..(..| 000000e0 00 d8 03 00 00 00 00 00 8f e6 dc d0 01 00 00 00 |..........= =2E.....| 000000f0 08 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000100 0b 00 00 00 00 00 00 00 67 cd 2b fa af fa 57 8c |........g.= +...W.| 00000110 e0 c1 28 6a |..(j| 00000114 devsdd3-superblock.raw 00000000 4e fc 4f 03 50 51 50 4e fe 4f 02 50 4e 4e fe 4f |N.O.PQPN.O= =2EPNN.O| 00000010 ff 4b ff 49 1b 4a 4e 4d 4a 4d 4b 4c 49 4a 46 47 |.K.I.JNMJM= KLIJFG| 00000020 47 49 48 49 48 47 46 45 45 46 46 45 47 48 46 48 |GIHIHGFEEF= =46EGHFH| 00000030 46 fe 45 fe 46 00 42 fe 46 08 44 45 44 47 46 46 |F.E.F.B.F.= DEDGFF| 00000040 45 45 46 fd 45 05 46 45 46 46 45 45 fc 46 03 45 |EEF.E.FEFF= EE.F.E| 00000050 46 46 45 fc 46 13 45 44 46 45 44 46 45 45 46 45 |FFE.F.EDFE= DFEEFE| 00000060 fc 4e 2b a9 01 00 00 00 45 00 00 00 00 00 00 00 |.N+.....E.= =2E.....| 00000070 9b dc 09 39 48 38 89 af b6 7c 19 9b 2a ae cb 4e |...9H8...|= =2E.*..N| 00000080 75 62 75 6e 74 75 3a 33 00 00 00 00 00 00 00 00 |ubuntu:3..= =2E.....| 00000090 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 000000a0 c8 f6 d0 53 00 00 00 00 05 00 00 00 02 00 00 00 |...S......= =2E.....| 000000b0 00 bc dc d0 01 00 00 00 00 04 00 00 0a 00 00 00 |..........= =2E.....| 000000c0 08 00 00 00 05 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 000000d0 ff ff ff ff 02 00 00 00 00 04 00 00 00 28 00 00 |..........= =2E..(..| 000000e0 00 d8 03 00 00 00 00 00 8f e6 dc d0 01 00 00 00 |..........= =2E.....| 000000f0 08 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000100 04 00 00 00 00 00 00 00 44 90 84 3e d2 c5 c2 e7 |........D.= =2E>....| 00000110 d2 22 fa 0a |."..| 00000114 devsde3-superblock.raw 00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000010 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000020 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000040 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000060 fc 4e 2b a9 01 00 00 00 45 00 00 00 00 00 00 00 |.N+.....E.= =2E.....| 00000070 9b dc 09 39 48 38 89 af b6 7c 19 9b 2a ae cb 4e |...9H8...|= =2E.*..N| 00000080 75 62 75 6e 74 75 3a 33 00 00 00 00 00 00 00 00 |ubuntu:3..= =2E.....| 00000090 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 000000a0 c8 f6 d0 53 00 00 00 00 05 00 00 00 02 00 00 00 |...S......= =2E.....| 000000b0 00 bc dc d0 01 00 00 00 00 04 00 00 0a 00 00 00 |..........= =2E.....| 000000c0 08 00 00 00 05 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 000000d0 ff ff ff ff 02 00 00 00 00 04 00 00 00 28 00 00 |..........= =2E..(..| 000000e0 00 d8 03 00 00 00 00 00 8f e6 dc d0 01 00 00 00 |..........= =2E.....| 000000f0 08 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000100 05 00 00 00 00 00 00 00 1d 41 05 6f 88 14 9b 1a |.........A= =2Eo....| 00000110 48 e9 39 e5 |H.9.| 00000114 devsdf3-superblock.raw 00000000 3c 39 37 39 3a 3a 39 38 36 39 38 37 34 35 35 36 |<979::9869= 874556| 00000010 36 31 37 35 35 31 31 35 36 31 34 35 37 35 35 37 |6175511561= 457557| 00000020 37 35 31 36 36 35 37 38 36 35 34 38 37 37 35 39 |7516657865= 487759| 00000030 3a 37 3a 3b ff 38 09 3b 3a 3a 3b 3a 3d 3b 3c 3c |:7:;.8.;::= ;:=3D;<<| 00000040 40 fe 3d fc 41 03 45 43 43 41 fe 43 ff 46 02 45 |@.=3D.A.EC= CA.C.F.E| 00000050 48 48 fa 4a 14 4b 4a 4e 4a 4d 4d 4f 4f 4e 4e 51 |HH.J.KJNJM= MOONNQ| 00000060 fc 4e 2b a9 01 00 00 00 45 00 00 00 00 00 00 00 |.N+.....E.= =2E.....| 00000070 9b dc 09 39 48 38 89 af b6 7c 19 9b 2a ae cb 4e |...9H8...|= =2E.*..N| 00000080 75 62 75 6e 74 75 3a 33 00 00 00 00 00 00 00 00 |ubuntu:3..= =2E.....| 00000090 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 000000a0 c8 f6 d0 53 00 00 00 00 05 00 00 00 02 00 00 00 |...S......= =2E.....| 000000b0 00 bc dc d0 01 00 00 00 00 04 00 00 0a 00 00 00 |..........= =2E.....| 000000c0 08 00 00 00 05 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 000000d0 ff ff ff ff 02 00 00 00 00 04 00 00 00 28 00 00 |..........= =2E..(..| 000000e0 00 d8 03 00 00 00 00 00 8f e6 dc d0 01 00 00 00 |..........= =2E.....| 000000f0 08 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000100 00 00 00 00 00 00 00 00 fa 7c 54 1d a2 5b ab d8 |.........|= T..[..| 00000110 14 ff e1 c0 |....| 00000114 devsdg3-superblock.raw 00000000 5e 75 7c 7f 74 7b 81 8a 97 a0 a8 af b0 be c6 da |^u|.t{....= =2E.....| 00000010 e5 e9 f2 f3 f6 f7 f2 ef ee ed e9 e7 e8 e8 e3 de |..........= =2E.....| 00000020 df e1 df e0 da de e2 e0 df d9 dc d5 d3 ce d3 d3 |..........= =2E.....| 00000030 d1 ce cb 07 d2 d5 d7 d7 da d7 d7 db fe da 4a d9 |..........= =2E...J.| 00000040 d6 d6 d5 d5 d6 d2 ce cc d2 d1 cf d0 d2 d4 d9 db |..........= =2E.....| 00000050 db dc da db da da d8 da da d7 cf d3 cf ce ce d2 |..........= =2E.....| 00000060 fc 4e 2b a9 01 00 00 00 45 00 00 00 00 00 00 00 |.N+.....E.= =2E.....| 00000070 9b dc 09 39 48 38 89 af b6 7c 19 9b 2a ae cb 4e |...9H8...|= =2E.*..N| 00000080 75 62 75 6e 74 75 3a 33 00 00 00 00 00 00 00 00 |ubuntu:3..= =2E.....| 00000090 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 000000a0 c8 f6 d0 53 00 00 00 00 05 00 00 00 02 00 00 00 |...S......= =2E.....| 000000b0 00 bc dc d0 01 00 00 00 00 04 00 00 0a 00 00 00 |..........= =2E.....| 000000c0 08 00 00 00 05 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 000000d0 ff ff ff ff 02 00 00 00 00 04 00 00 00 28 00 00 |..........= =2E..(..| 000000e0 00 d8 03 00 00 00 00 00 8f e6 dc d0 01 00 00 00 |..........= =2E.....| 000000f0 08 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000100 03 00 00 00 00 00 00 00 a4 b8 b4 25 b0 30 7f e5 |..........= =2E%.0..| 00000110 9e b8 e3 ac |....| 00000114 devsdh3-superblock.raw 00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000010 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000020 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000040 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000060 fc 4e 2b a9 01 00 00 00 45 00 00 00 00 00 00 00 |.N+.....E.= =2E.....| 00000070 9b dc 09 39 48 38 89 af b6 7c 19 9b 2a ae cb 4e |...9H8...|= =2E.*..N| 00000080 75 62 75 6e 74 75 3a 33 00 00 00 00 00 00 00 00 |ubuntu:3..= =2E.....| 00000090 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 000000a0 c8 f6 d0 53 00 00 00 00 05 00 00 00 02 00 00 00 |...S......= =2E.....| 000000b0 00 bc dc d0 01 00 00 00 00 04 00 00 0a 00 00 00 |..........= =2E.....| 000000c0 08 00 00 00 05 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 000000d0 ff ff ff ff 02 00 00 00 00 04 00 00 00 28 00 00 |..........= =2E..(..| 000000e0 00 d8 03 00 00 00 00 00 8f e6 dc d0 01 00 00 00 |..........= =2E.....| 000000f0 08 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000100 02 00 00 00 00 00 00 00 34 5b 02 12 6c 3a 0a e8 |........4[= =2E.l:..| 00000110 d8 ed 92 73 |...s| 00000114 devsdi3-superblock.raw 00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000010 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000020 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000040 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000060 fc 4e 2b a9 01 00 00 00 45 00 00 00 00 00 00 00 |.N+.....E.= =2E.....| 00000070 9b dc 09 39 48 38 89 af b6 7c 19 9b 2a ae cb 4e |...9H8...|= =2E.*..N| 00000080 75 62 75 6e 74 75 3a 33 00 00 00 00 00 00 00 00 |ubuntu:3..= =2E.....| 00000090 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 000000a0 c8 f6 d0 53 00 00 00 00 05 00 00 00 02 00 00 00 |...S......= =2E.....| 000000b0 00 bc dc d0 01 00 00 00 00 04 00 00 0a 00 00 00 |..........= =2E.....| 000000c0 08 00 00 00 05 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 000000d0 ff ff ff ff 02 00 00 00 00 04 00 00 00 28 00 00 |..........= =2E..(..| 000000e0 00 d8 03 00 00 00 00 00 8f e6 dc d0 01 00 00 00 |..........= =2E.....| 000000f0 08 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |..........= =2E.....| 00000100 0c 00 00 00 00 00 00 00 70 af da ad b0 97 9f b1 |........p.= =2E.....| 00000110 1b 99 ef 18 |....| 00000114 devsdj3-superblock.raw 00000000 8b f5 bf f2 9f 03 b5 cb fd 29 28 17 15 d9 c5 6a |.........)= (....j| 00000010 37 52 cb f3 72 47 43 45 3c 44 23 33 2e d2 de fa |7R..rGCE