Re: raid5 with 2 disks not working correctly. Need help!

["Roy Lim" <cableroy@gmail.com>]

Call me coward but...
ares:~#  mdadm -C /dev/md0 -l5 -n5 /dev/hde1 /dev/hdg1 /dev/hdi1
missing /dev/sda1
mdadm: /dev/hde1 appears to contain an ext2fs file system
    size=1953535744K  mtime=Mon Feb  4 20:57:17 2008
mdadm: /dev/hde1 appears to be part of a raid array:
    level=raid5 devices=5 ctime=Mon Feb  4 18:25:28 2008
mdadm: /dev/hdg1 appears to be part of a raid array:
    level=raid5 devices=5 ctime=Mon Feb  4 18:25:28 2008
Continue creating array?


hde1 appears to contain an ext2fs file system?? No i don't think so..

But experts... can't i create with assume-clean without hdk1 then? I
ask cause there is 1.5TB data there and i'm not any expert on raid :)


Roy

On Tue, Dec 16, 2008 at 2:36 PM, Roy Lim <cableroy@gmail.com> wrote:
> Hi
> I have ran into a serious problem with my raid5 array and need expert
> help on this one.
>
> My array is with 5x500GB disks none spare, I've accidentally did a
> unclean shutdown of the server. When it came up it gave me this error:
>
> Dec 15 09:07:11 ares kernel: md: kicking non-fresh hdk1 from array!
> Dec 15 09:07:11 ares kernel: md: unbind<hdk1>
> Dec 15 09:07:11 ares kernel: md: export_rdev(hdk1)
> Dec 15 09:07:11 ares kernel: md: md0: raid array is not clean --
> starting background reconstruction
> Dec 15 09:07:11 ares kernel: raid5: device hde1 operational as raid disk 0
> Dec 15 09:07:11 ares kernel: raid5: device sda1 operational as raid disk 4
> Dec 15 09:07:11 ares kernel: raid5: device hdi1 operational as raid disk 2
> Dec 15 09:07:11 ares kernel: raid5: device hdg1 operational as raid disk 1
> Dec 15 09:07:11 ares kernel: raid5: cannot start dirty degraded array for md0
>
> However i managed to get this back up with remove and add, the system
> was rebuilding the array. around 70-80% in the process i was going to
> prepare to decrypt it (luks crypted) so I'm going to mount the usb
> stick witch has the encryption key however when i was going to mount
> it i tried to mount wrong device, resulting trying to mount a device
> in the array (sda1) i hit repeatedly crtl+c, now taking a look at the
> details on the array it looks like this:
>
> /dev/md0:
>        Version : 00.90.03
>  Creation Time : Mon Feb  4 18:25:28 2008
>     Raid Level : raid5
>     Array Size : 1953535744 (1863.04 GiB 2000.42 GB)
>    Device Size : 488383936 (465.76 GiB 500.11 GB)
>   Raid Devices : 5
>  Total Devices : 5
> Preferred Minor : 0
>    Persistence : Superblock is persistent
>
>    Update Time : Mon Dec 15 16:02:54 2008
>          State : clean, degraded
>  Active Devices : 3
> Working Devices : 4
>  Failed Devices : 1
>  Spare Devices : 1
>
>         Layout : left-symmetric
>     Chunk Size : 64K
>
>           UUID : 856a6e4e:a1663e98:9efbd2b1:7507133b
>         Events : 0.74
>
>    Number   Major   Minor   RaidDevice State
>       0      33        1        0      active sync   /dev/hde1
>       1      34        1        1      active sync   /dev/hdg1
>       2      56        1        2      active sync   /dev/hdi1
>       3       0        0        3      removed
>       4       0        0        4      removed
>
>       5      57        1        -      spare   /dev/hdk1
>       6       8        1        -      faulty spare   /dev/sda1
>
> a quick summary: hdk1 was the one failing in the first place, witch
> was about to get rebuild, sda1 was the device i tried to mount while
> reconstruction the data. As you can see, hdk1 is now marked as spare
> and sda1 a faulty spare.  I have not touch the array after this. Can
> anyone help me out? How can i force mdadm to set the sda1 to active
> sync so i can mount the array and start a backup? Can i use dd_rescue
> to file of all of the disks and play with it?
>
> All help is appreciated!
>
> /Roy
>