* Recreating RAID-5 after SATA controller failure and botched auto-assemble
@ 2015-12-23 9:58 Wolfgang Draxinger
2015-12-27 23:11 ` Phil Turmel
0 siblings, 1 reply; 2+ messages in thread
From: Wolfgang Draxinger @ 2015-12-23 9:58 UTC (permalink / raw)
To: linux-raid
Hi,
Just before anyone tells me off: I've got a Backup of my
important data; however there was a bunch of stuff on the RAID that I
didn't backup because it was not irreplaceable (mostly music, movies I
converted from DVDs, conference recordings, stuff like that), and I'd
like to save the hassle of procuring all that stuff again.
A little bit of backstory: Temperatures this summer were brutal. So
brutal that the controller hardware in my NAS experienced severe
failure (the HDDs of the RAID are apparently fine, at least there have
been no issues copying them onto a scratch disk, SMART doesn't show up
either). The main symptom is, that after connecting a disk it takes
only a couple of minutes before the SATA link will drop and the disk
get kicked from the set of block devices. Since there's a hotspare
the RAID would autorebuild on that, but the formerly dropped disk
would reappear. Then the spare might drop during autorebuild. And so
on. When I finally realized what was going on I pulled the plug hard,
but the damage was done.
That was 6 months ago. With the holidays being here I thought, I'd
finally have a look at the whole mess. First thing was to copy the
contents of 4 of the 5 drives to a single drive that could hold them
(it was short of 60MB to hold the last disk); but then I figured, that
for getting the whole thing into a read-only state that should suffice.
Here's the examine results for the superblocks (/dev/sdb is the large
disk to which I copied the original RAID disks, /dev/sdd is the one
original disk that didn't fit). Now the strange thing is, that these
are superblocks of two different arrays. I dimly remember, that back in
2008 I first created a test array to check the hardware before tearing
it down and creating the proper array. I've been using that 4 + 1 hot
spare configuration ever since, so the superblock UUID 42e59462... is
the one I'm probably after. However *all* of the disks participated in
that array, yet that other UUID superblock shows up.
Now I'd be only half surprised if the Creation or Update Time of the
UUID=13667845... superblock would say 2015, because then I'd blame the
botched attempts on rebuilding in that failure loop on it (you can see
that in the Update Time of the 42e59462) BTW.
What's going on there?
/dev/sdb1:
Magic : a92b4efc
Version : 0.90.00
UUID : 13667845:511c4be5:16e52af0:0ac6a895
Creation Time : Sat Oct 25 08:34:03 2008
Raid Level : raid5
Used Dev Size : 976762496 (931.51 GiB 1000.20 GB)
Array Size : 1953524992 (1863.03 GiB 2000.41 GB)
Raid Devices : 3
Total Devices : 3
Preferred Minor : 0
Update Time : Sat Oct 25 08:34:17 2008
State : active
Active Devices : 3
Working Devices : 3
Failed Devices : 0
Spare Devices : 0
Checksum : fbc116d1 - correct
Events : 3
Layout : left-symmetric
Chunk Size : 64K
Number Major Minor RaidDevice State
this 0 8 0 0 active sync /dev/sda
0 0 8 0 0 active sync /dev/sda
1 1 8 32 1 active sync /dev/sdc
2 2 8 16 2 active sync /dev/sdb
/dev/sdb2:
Magic : a92b4efc
Version : 0.90.00
UUID : 42e59462:04b3a9b6:b1e97ac7:394f85ec
Creation Time : Sat Oct 25 08:52:56 2008
Raid Level : raid5
Used Dev Size : 976759936 (931.51 GiB 1000.20 GB)
Array Size : 2930279808 (2794.53 GiB 3000.61 GB)
Raid Devices : 4
Total Devices : 4
Preferred Minor : 0
Update Time : Sat Jul 11 19:27:56 2015
State : active
Active Devices : 2
Working Devices : 2
Failed Devices : 1
Spare Devices : 0
Checksum : b4e50c1d - correct
Events : 670769
Layout : left-symmetric
Chunk Size : 64K
Number Major Minor RaidDevice State
this 2 8 0 2 active sync /dev/sda
0 0 0 0 0 removed
1 1 8 17 1 active sync /dev/sdb1
2 2 8 0 2 active sync /dev/sda
3 3 0 0 3 faulty removed
/dev/sdb3:
Magic : a92b4efc
Version : 0.90.00
UUID : 42e59462:04b3a9b6:b1e97ac7:394f85ec
Creation Time : Sat Oct 25 08:52:56 2008
Raid Level : raid5
Used Dev Size : 976759936 (931.51 GiB 1000.20 GB)
Array Size : 2930279808 (2794.53 GiB 3000.61 GB)
Raid Devices : 4
Total Devices : 4
Preferred Minor : 0
Update Time : Sat Jul 11 18:29:02 2015
State : clean
Active Devices : 3
Working Devices : 4
Failed Devices : 0
Spare Devices : 1
Checksum : b4ef3a8f - correct
Events : 670757
Layout : left-symmetric
Chunk Size : 64K
Number Major Minor RaidDevice State
this 3 8 48 3 active sync /dev/sdd
0 0 0 0 0 removed
1 1 8 17 1 active sync /dev/sdb1
2 2 8 0 2 active sync /dev/sda
3 3 8 48 3 active sync /dev/sdd
4 4 8 33 4 spare
/dev/sdb4:
Magic : a92b4efc
Version : 0.90.00
UUID : 13667845:511c4be5:16e52af0:0ac6a895
Creation Time : Sat Oct 25 08:34:03 2008
Raid Level : raid5
Used Dev Size : 976762496 (931.51 GiB 1000.20 GB)
Array Size : 1953524992 (1863.03 GiB 2000.41 GB)
Raid Devices : 3
Total Devices : 3
Preferred Minor : 0
Update Time : Sat Oct 25 08:34:17 2008
State : active
Active Devices : 3
Working Devices : 3
Failed Devices : 0
Spare Devices : 0
Checksum : fbc116e5 - correct
Events : 3
Layout : left-symmetric
Chunk Size : 64K
Number Major Minor RaidDevice State
this 2 8 16 2 active sync /dev/sdb
0 0 8 0 0 active sync /dev/sda
1 1 8 32 1 active sync /dev/sdc
2 2 8 16 2 active sync /dev/sdb
/dev/sdd:
Magic : a92b4efc
Version : 0.90.00
UUID : 13667845:511c4be5:16e52af0:0ac6a895
Creation Time : Sat Oct 25 08:34:03 2008
Raid Level : raid5
Used Dev Size : 976762496 (931.51 GiB 1000.20 GB)
Array Size : 1953524992 (1863.03 GiB 2000.41 GB)
Raid Devices : 3
Total Devices : 3
Preferred Minor : 0
Update Time : Sat Oct 25 08:34:17 2008
State : active
Active Devices : 3
Working Devices : 3
Failed Devices : 0
Spare Devices : 0
Checksum : fbc116f3 - correct
Events : 3
Layout : left-symmetric
Chunk Size : 64K
Number Major Minor RaidDevice State
this 1 8 32 1 active sync /dev/sdc
0 0 8 0 0 active sync /dev/sda
1 1 8 32 1 active sync /dev/sdc
2 2 8 16 2 active sync /dev/sdb
Anyway, I'd appreciate if anyone knew how I could read-only assemble
the disks into an array that resembles the 42e59462... configuration to
see if I can pull anything useful from it. There are a few things on
it (hopefully left) that I'd like to extract, if possible.
Cheers,
Wolfgang
^ permalink raw reply [flat|nested] 2+ messages in thread* Re: Recreating RAID-5 after SATA controller failure and botched auto-assemble
2015-12-23 9:58 Recreating RAID-5 after SATA controller failure and botched auto-assemble Wolfgang Draxinger
@ 2015-12-27 23:11 ` Phil Turmel
0 siblings, 0 replies; 2+ messages in thread
From: Phil Turmel @ 2015-12-27 23:11 UTC (permalink / raw)
To: Wolfgang Draxinger, linux-raid
On 12/23/2015 04:58 AM, Wolfgang Draxinger wrote:
> Anyway, I'd appreciate if anyone knew how I could read-only assemble
> the disks into an array that resembles the 42e59462... configuration to
> see if I can pull anything useful from it. There are a few things on
> it (hopefully left) that I'd like to extract, if possible.
I think it's gone. You only have two members of the 42e59462 uuid
array, and you need at least three. The others all have 2008 timestamps
so could not have been part of the desired array at any recent date.
Sorry.
You *could* assemble the other array, though, to see what's there:
mdadm -Afv /dev/mdX /dev/sdb1 /dev/sdb4 /dev/sdd
With the failure mode you described, I doubt the series of rebuilds
would have destroyed much.
Phil
^ permalink raw reply [flat|nested] 2+ messages in thread
end of thread, other threads:[~2015-12-27 23:11 UTC | newest]
Thread overview: 2+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2015-12-23 9:58 Recreating RAID-5 after SATA controller failure and botched auto-assemble Wolfgang Draxinger
2015-12-27 23:11 ` Phil Turmel
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.