* No md superblock immediately after creating RAID 5 /dev/md0
@ 2008-08-28 8:32 thomas62186218
2008-08-28 9:17 ` Andrew Farley
` (3 more replies)
0 siblings, 4 replies; 8+ messages in thread
From: thomas62186218 @ 2008-08-28 8:32 UTC (permalink / raw)
To: linux-raid, thomas62186218
Hi all,
I am struggling with an issue on an Ubuntu 8.0.4 64-bit system. The
system has 12 SATA drives. I create a RAID 5 array using mdadm as
follows:
mdadm -Cv /dev/md0 -n12 -l5 -c128 /dev/sd[b-m] -R -f
The device creates successfully and starts and is visible as syncing in
cat /proc/mdstat. But, according to mdadm -X /dev/md0, there is no md
superblock on the device. Doing the same mdadm -X command for all
components /dev/sdb through /dev/sdm shows superblocks. If I reboot the
system, /dev/md0 is completely gone, and a mdadm --assemble --scan
produces no results. I've also tried creating the md with Version 1 and
1.2 superblocks, but the same problem occurs. Below is complete output.
Thank you for your assistance on this strange issue!
Best,
Thomas
root@localhost:~# cat /proc/mdstat
Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5]
[raid4] [ra id10]
md0 : active raid5 sdm1[11](S) sdl1[10] sdk1[9] sdj1[8] sdi1[7] sdh1[6]
sdg1[5] sdf1[4] sde1[3] sdd1[2] sdc1[1] sdb1[0]
4883839360 blocks level 5, 16k chunk, algorithm 2 [11/11]
[UUUUUUUUUUU]
[>....................] resync = 0.6% (3207984/488383936)
finish=158.8mi n speed=50916K/sec
unused devices: <none>
root@localhost:~# pvs
PV VG Fmt Attr PSize PFree
/dev/md0 raid5test lvm2 a- 4.55T 4.55T
root@localhost:~# cat /etc/mdadm.conf
DEVICE /dev/sd*
ARRAY /dev/md0 level=raid5 num-devices=12
UUID=9f962f09:2d47f553:417df021:0032bb 18
root@localhost:~# reboot
Broadcast message from root@localhost
(/dev/pts/0) at 9:35 ...
The system is going down for reboot NOW!
root@localhost:~#
login as: root
root@192.168.0.70's password:
Last login: Thu Aug 28 09:28:34 2008 from 192.168.0.114
root@localhost:~# cat /proc/mdstat
Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5]
[raid4] [ra id10]
unused devices: <none>
root@localhost:~# mdadm --assemble --scan
mdadm: no devices found for /dev/md0
root@localhost:~# mdadm --query /dev/md0
/dev/md0: is an md device which is not active
root@localhost:/var/log# mdadm --examine /dev/sdb1
/dev/sdb1:
Magic : a92b4efc
Version : 00.90.00
UUID : 9f962f09:2d47f553:417df021:0032bb18
Creation Time : Thu Aug 28 09:33:49 2008
Raid Level : raid5
Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
Raid Devices : 11
Total Devices : 12
Preferred Minor : 0
Update Time : Thu Aug 28 09:36:07 2008
State : active
Active Devices : 11
Working Devices : 12
Failed Devices : 0
Spare Devices : 1
Checksum : 670c7e62 - correct
Events : 5
Layout : left-symmetric
Chunk Size : 16K
Number Major Minor RaidDevice State
this 0 8 17 0 active sync /dev/sdb1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 active sync /dev/sdi1
8 8 8 145 8 active sync /dev/sdj1
9 9 8 161 9 active sync /dev/sdk1
10 10 8 177 10 active sync /dev/sdl1
11 11 8 193 11 spare /dev/sdm1
root@localhost:/var/log# mdadm --examine /dev/sdc1
/dev/sdc1:
Magic : a92b4efc
Version : 00.90.00
UUID : 9f962f09:2d47f553:417df021:0032bb18
Creation Time : Thu Aug 28 09:33:49 2008
Raid Level : raid5
Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
Raid Devices : 11
Total Devices : 12
Preferred Minor : 0
Update Time : Thu Aug 28 09:36:07 2008
State : active
Active Devices : 11
Working Devices : 12
Failed Devices : 0
Spare Devices : 1
Checksum : 670c7e74 - correct
Events : 5
Layout : left-symmetric
Chunk Size : 16K
Number Major Minor RaidDevice State
this 1 8 33 1 active sync /dev/sdc1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 active sync /dev/sdi1
8 8 8 145 8 active sync /dev/sdj1
9 9 8 161 9 active sync /dev/sdk1
10 10 8 177 10 active sync /dev/sdl1
11 11 8 193 11 spare /dev/sdm1
root@localhost:/var/log# mdadm --examine /dev/sdd1
/dev/sdd1:
Magic : a92b4efc
Version : 00.90.00
UUID : 9f962f09:2d47f553:417df021:0032bb18
Creation Time : Thu Aug 28 09:33:49 2008
Raid Level : raid5
Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
Raid Devices : 11
Total Devices : 12
Preferred Minor : 0
Update Time : Thu Aug 28 09:36:07 2008
State : active
Active Devices : 11
Working Devices : 12
Failed Devices : 0
Spare Devices : 1
Checksum : 670c7e86 - correct
Events : 5
Layout : left-symmetric
Chunk Size : 16K
Number Major Minor RaidDevice State
this 2 8 49 2 active sync /dev/sdd1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 active sync /dev/sdi1
8 8 8 145 8 active sync /dev/sdj1
9 9 8 161 9 active sync /dev/sdk1
10 10 8 177 10 active sync /dev/sdl1
11 11 8 193 11 spare /dev/sdm1
root@localhost:/var/log# mdadm --examine /dev/sde1
/dev/sde1:
Magic : a92b4efc
Version : 00.90.00
UUID : 9f962f09:2d47f553:417df021:0032bb18
Creation Time : Thu Aug 28 09:33:49 2008
Raid Level : raid5
Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
Raid Devices : 11
Total Devices : 12
Preferred Minor : 0
Update Time : Thu Aug 28 09:36:07 2008
State : active
Active Devices : 11
Working Devices : 12
Failed Devices : 0
Spare Devices : 1
Checksum : 670c7e98 - correct
Events : 5
Layout : left-symmetric
Chunk Size : 16K
Number Major Minor RaidDevice State
this 3 8 65 3 active sync /dev/sde1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 active sync /dev/sdi1
8 8 8 145 8 active sync /dev/sdj1
9 9 8 161 9 active sync /dev/sdk1
10 10 8 177 10 active sync /dev/sdl1
11 11 8 193 11 spare /dev/sdm1
root@localhost:/var/log# mdadm --examine /dev/sdf1
/dev/sdf1:
Magic : a92b4efc
Version : 00.90.00
UUID : 9f962f09:2d47f553:417df021:0032bb18
Creation Time : Thu Aug 28 09:33:49 2008
Raid Level : raid5
Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
Raid Devices : 11
Total Devices : 12
Preferred Minor : 0
Update Time : Thu Aug 28 09:36:07 2008
State : active
Active Devices : 11
Working Devices : 12
Failed Devices : 0
Spare Devices : 1
Checksum : 670c7eaa - correct
Events : 5
Layout : left-symmetric
Chunk Size : 16K
Number Major Minor RaidDevice State
this 4 8 81 4 active sync /dev/sdf1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 active sync /dev/sdi1
8 8 8 145 8 active sync /dev/sdj1
9 9 8 161 9 active sync /dev/sdk1
10 10 8 177 10 active sync /dev/sdl1
11 11 8 193 11 spare /dev/sdm1
root@localhost:/var/log# mdadm --examine /dev/sdg1
/dev/sdg1:
Magic : a92b4efc
Version : 00.90.00
UUID : 9f962f09:2d47f553:417df021:0032bb18
Creation Time : Thu Aug 28 09:33:49 2008
Raid Level : raid5
Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
Raid Devices : 11
Total Devices : 12
Preferred Minor : 0
Update Time : Thu Aug 28 09:36:07 2008
State : active
Active Devices : 11
Working Devices : 12
Failed Devices : 0
Spare Devices : 1
Checksum : 670c7ebc - correct
Events : 5
Layout : left-symmetric
Chunk Size : 16K
Number Major Minor RaidDevice State
this 5 8 97 5 active sync /dev/sdg1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 active sync /dev/sdi1
8 8 8 145 8 active sync /dev/sdj1
9 9 8 161 9 active sync /dev/sdk1
10 10 8 177 10 active sync /dev/sdl1
11 11 8 193 11 spare /dev/sdm1
root@localhost:/var/log# mdadm --examine /dev/sdh1
/dev/sdh1:
Magic : a92b4efc
Version : 00.90.00
UUID : 9f962f09:2d47f553:417df021:0032bb18
Creation Time : Thu Aug 28 09:33:49 2008
Raid Level : raid5
Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
Raid Devices : 11
Total Devices : 12
Preferred Minor : 0
Update Time : Thu Aug 28 09:36:07 2008
State : active
Active Devices : 11
Working Devices : 12
Failed Devices : 0
Spare Devices : 1
Checksum : 670c7ece - correct
Events : 5
Layout : left-symmetric
Chunk Size : 16K
Number Major Minor RaidDevice State
this 6 8 113 6 active sync /dev/sdh1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 active sync /dev/sdi1
8 8 8 145 8 active sync /dev/sdj1
9 9 8 161 9 active sync /dev/sdk1
10 10 8 177 10 active sync /dev/sdl1
11 11 8 193 11 spare /dev/sdm1
root@localhost:/var/log# mdadm --examine /dev/sdi1
/dev/sdi1:
Magic : a92b4efc
Version : 00.90.00
UUID : 9f962f09:2d47f553:417df021:0032bb18
Creation Time : Thu Aug 28 09:33:49 2008
Raid Level : raid5
Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
Raid Devices : 11
Total Devices : 12
Preferred Minor : 0
Update Time : Thu Aug 28 09:36:07 2008
State : active
Active Devices : 11
Working Devices : 12
Failed Devices : 0
Spare Devices : 1
Checksum : 670c7ee0 - correct
Events : 5
Layout : left-symmetric
Chunk Size : 16K
Number Major Minor RaidDevice State
this 7 8 129 7 active sync /dev/sdi1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 active sync /dev/sdi1
8 8 8 145 8 active sync /dev/sdj1
9 9 8 161 9 active sync /dev/sdk1
10 10 8 177 10 active sync /dev/sdl1
11 11 8 193 11 spare /dev/sdm1
root@localhost:/var/log# mdadm --examine /dev/sdj1
/dev/sdj1:
Magic : a92b4efc
Version : 00.90.00
UUID : 9f962f09:2d47f553:417df021:0032bb18
Creation Time : Thu Aug 28 09:33:49 2008
Raid Level : raid5
Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
Raid Devices : 11
Total Devices : 12
Preferred Minor : 0
Update Time : Thu Aug 28 09:36:07 2008
State : active
Active Devices : 11
Working Devices : 12
Failed Devices : 0
Spare Devices : 1
Checksum : 670c7ef2 - correct
Events : 5
Layout : left-symmetric
Chunk Size : 16K
Number Major Minor RaidDevice State
this 8 8 145 8 active sync /dev/sdj1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 active sync /dev/sdi1
8 8 8 145 8 active sync /dev/sdj1
9 9 8 161 9 active sync /dev/sdk1
10 10 8 177 10 active sync /dev/sdl1
11 11 8 193 11 spare /dev/sdm1
root@localhost:/var/log# mdadm --examine /dev/sdk1
/dev/sdk1:
Magic : a92b4efc
Version : 00.90.00
UUID : 9f962f09:2d47f553:417df021:0032bb18
Creation Time : Thu Aug 28 09:33:49 2008
Raid Level : raid5
Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
Raid Devices : 11
Total Devices : 12
Preferred Minor : 0
Update Time : Thu Aug 28 09:36:07 2008
State : active
Active Devices : 11
Working Devices : 12
Failed Devices : 0
Spare Devices : 1
Checksum : 670c7f04 - correct
Events : 5
Layout : left-symmetric
Chunk Size : 16K
Number Major Minor RaidDevice State
this 9 8 161 9 active sync /dev/sdk1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 active sync /dev/sdi1
8 8 8 145 8 active sync /dev/sdj1
9 9 8 161 9 active sync /dev/sdk1
10 10 8 177 10 active sync /dev/sdl1
11 11 8 193 11 spare /dev/sdm1
root@localhost:/var/log# mdadm --examine /dev/sdl1
/dev/sdl1:
Magic : a92b4efc
Version : 00.90.00
UUID : 9f962f09:2d47f553:417df021:0032bb18
Creation Time : Thu Aug 28 09:33:49 2008
Raid Level : raid5
Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
Raid Devices : 11
Total Devices : 12
Preferred Minor : 0
Update Time : Thu Aug 28 09:36:07 2008
State : active
Active Devices : 11
Working Devices : 12
Failed Devices : 0
Spare Devices : 1
Checksum : 670c7f16 - correct
Events : 5
Layout : left-symmetric
Chunk Size : 16K
Number Major Minor RaidDevice State
this 10 8 177 10 active sync /dev/sdl1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 active sync /dev/sdi1
8 8 8 145 8 active sync /dev/sdj1
9 9 8 161 9 active sync /dev/sdk1
10 10 8 177 10 active sync /dev/sdl1
11 11 8 193 11 spare /dev/sdm1
root@localhost:/var/log# mdadm --examine /dev/sdm1
/dev/sdm1:
Magic : a92b4efc
Version : 00.90.00
UUID : 9f962f09:2d47f553:417df021:0032bb18
Creation Time : Thu Aug 28 09:33:49 2008
Raid Level : raid5
Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
Raid Devices : 11
Total Devices : 12
Preferred Minor : 0
Update Time : Thu Aug 28 09:36:07 2008
State : active
Active Devices : 11
Working Devices : 12
Failed Devices : 0
Spare Devices : 1
Checksum : 670c7f22 - correct
Events : 5
Layout : left-symmetric
Chunk Size : 16K
Number Major Minor RaidDevice State
this 11 8 193 11 spare /dev/sdm1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 active sync /dev/sdi1
8 8 8 145 8 active sync /dev/sdj1
9 9 8 161 9 active sync /dev/sdk1
10 10 8 177 10 active sync /dev/sdl1
11 11 8 193 11 spare /dev/sdm1
root@localhost:/var/log# mdadm --examine /dev/md0
mdadm: No md superblock detected on /dev/md0.
root@localhost:/var/log# mdadm --detail /dev/md0
mdadm: md device /dev/md0 does not appear to be active.
root@localhost:/var/log# cat /etc/mdadm.conf
DEVICE /dev/sd*
ARRAY /dev/md0 level=raid5 num-devices=12
UUID=9f962f09:2d47f553:417df021:0032bb18
root@localhost:/var/log# mdadm --query /dev/md0
/dev/md0: is an md device which is not active
root@localhost:/var/log# mdadm --assemble --scan
mdadm: no devices found for /dev/md0
root@localhost:/var/log# mdadm -X /dev/md0
mdadm: failed to read superblock of bitmap file: No such device
root@localhost:/var/log# mdadm -E /dev/md0
mdadm: No md superblock detected on /dev/md0.
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: No md superblock immediately after creating RAID 5 /dev/md0
2008-08-28 8:32 No md superblock immediately after creating RAID 5 /dev/md0 thomas62186218
@ 2008-08-28 9:17 ` Andrew Farley
2008-08-29 5:31 ` thomas62186218
2008-08-28 9:49 ` Bernd Schubert
` (2 subsequent siblings)
3 siblings, 1 reply; 8+ messages in thread
From: Andrew Farley @ 2008-08-28 9:17 UTC (permalink / raw)
To: thomas62186218; +Cc: linux-raid
Thomas,
I have seen this happen to me before when your kernel doesn't have
large block device support (CONFIG_LBD). I still forget it sometimes
in between making large file servers and seem to waste time every time
figuring it out.
See here: http://www.suse.de/~aj/linux_lfs.html
Check if it's compiled into your kernel if you compiled it yourself by
looking for CONFIG_LBD=y in /usr/src/linux/.config or if it's
supported in your kernel extract from and search in /proc/config.gz.
If it's not in there go recompile your kernel to support LBD.
Cheers,
Farley
On Aug 28, 2008, at 1:32 AM, thomas62186218@aol.com wrote:
> Hi all,
>
> I am struggling with an issue on an Ubuntu 8.0.4 64-bit system. The
> system has 12 SATA drives. I create a RAID 5 array using mdadm as
> follows:
>
> mdadm -Cv /dev/md0 -n12 -l5 -c128 /dev/sd[b-m] -R -f
>
> The device creates successfully and starts and is visible as syncing
> in cat /proc/mdstat. But, according to mdadm -X /dev/md0, there is
> no md superblock on the device. Doing the same mdadm -X command for
> all components /dev/sdb through /dev/sdm shows superblocks. If I
> reboot the system, /dev/md0 is completely gone, and a mdadm --
> assemble --scan produces no results. I've also tried creating the md
> with Version 1 and 1.2 superblocks, but the same problem occurs.
> Below is complete output.
>
> Thank you for your assistance on this strange issue!
>
> Best,
> Thomas
>
>
> root@localhost:~# cat /proc/mdstat
> Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5]
> [raid4] [ra id10]
> md0 : active raid5 sdm1[11](S) sdl1[10] sdk1[9] sdj1[8] sdi1[7]
> sdh1[6] sdg1[5] sdf1[4] sde1[3] sdd1[2] sdc1[1] sdb1[0]
> 4883839360 blocks level 5, 16k chunk, algorithm 2 [11/11]
> [UUUUUUUUUUU]
> [>....................] resync = 0.6% (3207984/488383936)
> finish=158.8mi n speed=50916K/sec
>
> unused devices: <none>
>
> root@localhost:~# pvs
> PV VG Fmt Attr PSize PFree
> /dev/md0 raid5test lvm2 a- 4.55T 4.55T
>
> root@localhost:~# cat /etc/mdadm.conf
> DEVICE /dev/sd*
> ARRAY /dev/md0 level=raid5 num-devices=12
> UUID=9f962f09:2d47f553:417df021:0032bb 18
>
> root@localhost:~# reboot
>
> Broadcast message from root@localhost
> (/dev/pts/0) at 9:35 ...
>
> The system is going down for reboot NOW!
>
> root@localhost:~#
> login as: root
> root@192.168.0.70's password:
> Last login: Thu Aug 28 09:28:34 2008 from 192.168.0.114
>
>
> root@localhost:~# cat /proc/mdstat
> Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5]
> [raid4] [ra id10]
> unused devices: <none>
>
>
> root@localhost:~# mdadm --assemble --scan
> mdadm: no devices found for /dev/md0
>
> root@localhost:~# mdadm --query /dev/md0
> /dev/md0: is an md device which is not active
>
> root@localhost:/var/log# mdadm --examine /dev/sdb1
> /dev/sdb1:
> Magic : a92b4efc
> Version : 00.90.00
> UUID : 9f962f09:2d47f553:417df021:0032bb18
> Creation Time : Thu Aug 28 09:33:49 2008
> Raid Level : raid5
> Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
> Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
> Raid Devices : 11
> Total Devices : 12
> Preferred Minor : 0
>
> Update Time : Thu Aug 28 09:36:07 2008
> State : active
> Active Devices : 11
> Working Devices : 12
> Failed Devices : 0
> Spare Devices : 1
> Checksum : 670c7e62 - correct
> Events : 5
>
> Layout : left-symmetric
> Chunk Size : 16K
>
> Number Major Minor RaidDevice State
> this 0 8 17 0 active sync /dev/sdb1
>
> 0 0 8 17 0 active sync /dev/sdb1
> 1 1 8 33 1 active sync /dev/sdc1
> 2 2 8 49 2 active sync /dev/sdd1
> 3 3 8 65 3 active sync /dev/sde1
> 4 4 8 81 4 active sync /dev/sdf1
> 5 5 8 97 5 active sync /dev/sdg1
> 6 6 8 113 6 active sync /dev/sdh1
> 7 7 8 129 7 active sync /dev/sdi1
> 8 8 8 145 8 active sync /dev/sdj1
> 9 9 8 161 9 active sync /dev/sdk1
> 10 10 8 177 10 active sync /dev/sdl1
> 11 11 8 193 11 spare /dev/sdm1
>
> root@localhost:/var/log# mdadm --examine /dev/sdc1
> /dev/sdc1:
> Magic : a92b4efc
> Version : 00.90.00
> UUID : 9f962f09:2d47f553:417df021:0032bb18
> Creation Time : Thu Aug 28 09:33:49 2008
> Raid Level : raid5
> Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
> Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
> Raid Devices : 11
> Total Devices : 12
> Preferred Minor : 0
>
> Update Time : Thu Aug 28 09:36:07 2008
> State : active
> Active Devices : 11
> Working Devices : 12
> Failed Devices : 0
> Spare Devices : 1
> Checksum : 670c7e74 - correct
> Events : 5
>
> Layout : left-symmetric
> Chunk Size : 16K
>
> Number Major Minor RaidDevice State
> this 1 8 33 1 active sync /dev/sdc1
>
> 0 0 8 17 0 active sync /dev/sdb1
> 1 1 8 33 1 active sync /dev/sdc1
> 2 2 8 49 2 active sync /dev/sdd1
> 3 3 8 65 3 active sync /dev/sde1
> 4 4 8 81 4 active sync /dev/sdf1
> 5 5 8 97 5 active sync /dev/sdg1
> 6 6 8 113 6 active sync /dev/sdh1
> 7 7 8 129 7 active sync /dev/sdi1
> 8 8 8 145 8 active sync /dev/sdj1
> 9 9 8 161 9 active sync /dev/sdk1
> 10 10 8 177 10 active sync /dev/sdl1
> 11 11 8 193 11 spare /dev/sdm1
>
> root@localhost:/var/log# mdadm --examine /dev/sdd1
> /dev/sdd1:
> Magic : a92b4efc
> Version : 00.90.00
> UUID : 9f962f09:2d47f553:417df021:0032bb18
> Creation Time : Thu Aug 28 09:33:49 2008
> Raid Level : raid5
> Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
> Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
> Raid Devices : 11
> Total Devices : 12
> Preferred Minor : 0
>
> Update Time : Thu Aug 28 09:36:07 2008
> State : active
> Active Devices : 11
> Working Devices : 12
> Failed Devices : 0
> Spare Devices : 1
> Checksum : 670c7e86 - correct
> Events : 5
>
> Layout : left-symmetric
> Chunk Size : 16K
>
> Number Major Minor RaidDevice State
> this 2 8 49 2 active sync /dev/sdd1
>
> 0 0 8 17 0 active sync /dev/sdb1
> 1 1 8 33 1 active sync /dev/sdc1
> 2 2 8 49 2 active sync /dev/sdd1
> 3 3 8 65 3 active sync /dev/sde1
> 4 4 8 81 4 active sync /dev/sdf1
> 5 5 8 97 5 active sync /dev/sdg1
> 6 6 8 113 6 active sync /dev/sdh1
> 7 7 8 129 7 active sync /dev/sdi1
> 8 8 8 145 8 active sync /dev/sdj1
> 9 9 8 161 9 active sync /dev/sdk1
> 10 10 8 177 10 active sync /dev/sdl1
> 11 11 8 193 11 spare /dev/sdm1
>
> root@localhost:/var/log# mdadm --examine /dev/sde1
> /dev/sde1:
> Magic : a92b4efc
> Version : 00.90.00
> UUID : 9f962f09:2d47f553:417df021:0032bb18
> Creation Time : Thu Aug 28 09:33:49 2008
> Raid Level : raid5
> Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
> Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
> Raid Devices : 11
> Total Devices : 12
> Preferred Minor : 0
>
> Update Time : Thu Aug 28 09:36:07 2008
> State : active
> Active Devices : 11
> Working Devices : 12
> Failed Devices : 0
> Spare Devices : 1
> Checksum : 670c7e98 - correct
> Events : 5
>
> Layout : left-symmetric
> Chunk Size : 16K
>
> Number Major Minor RaidDevice State
> this 3 8 65 3 active sync /dev/sde1
>
> 0 0 8 17 0 active sync /dev/sdb1
> 1 1 8 33 1 active sync /dev/sdc1
> 2 2 8 49 2 active sync /dev/sdd1
> 3 3 8 65 3 active sync /dev/sde1
> 4 4 8 81 4 active sync /dev/sdf1
> 5 5 8 97 5 active sync /dev/sdg1
> 6 6 8 113 6 active sync /dev/sdh1
> 7 7 8 129 7 active sync /dev/sdi1
> 8 8 8 145 8 active sync /dev/sdj1
> 9 9 8 161 9 active sync /dev/sdk1
> 10 10 8 177 10 active sync /dev/sdl1
> 11 11 8 193 11 spare /dev/sdm1
>
> root@localhost:/var/log# mdadm --examine /dev/sdf1
> /dev/sdf1:
> Magic : a92b4efc
> Version : 00.90.00
> UUID : 9f962f09:2d47f553:417df021:0032bb18
> Creation Time : Thu Aug 28 09:33:49 2008
> Raid Level : raid5
> Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
> Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
> Raid Devices : 11
> Total Devices : 12
> Preferred Minor : 0
>
> Update Time : Thu Aug 28 09:36:07 2008
> State : active
> Active Devices : 11
> Working Devices : 12
> Failed Devices : 0
> Spare Devices : 1
> Checksum : 670c7eaa - correct
> Events : 5
>
> Layout : left-symmetric
> Chunk Size : 16K
>
> Number Major Minor RaidDevice State
> this 4 8 81 4 active sync /dev/sdf1
>
> 0 0 8 17 0 active sync /dev/sdb1
> 1 1 8 33 1 active sync /dev/sdc1
> 2 2 8 49 2 active sync /dev/sdd1
> 3 3 8 65 3 active sync /dev/sde1
> 4 4 8 81 4 active sync /dev/sdf1
> 5 5 8 97 5 active sync /dev/sdg1
> 6 6 8 113 6 active sync /dev/sdh1
> 7 7 8 129 7 active sync /dev/sdi1
> 8 8 8 145 8 active sync /dev/sdj1
> 9 9 8 161 9 active sync /dev/sdk1
> 10 10 8 177 10 active sync /dev/sdl1
> 11 11 8 193 11 spare /dev/sdm1
>
> root@localhost:/var/log# mdadm --examine /dev/sdg1
> /dev/sdg1:
> Magic : a92b4efc
> Version : 00.90.00
> UUID : 9f962f09:2d47f553:417df021:0032bb18
> Creation Time : Thu Aug 28 09:33:49 2008
> Raid Level : raid5
> Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
> Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
> Raid Devices : 11
> Total Devices : 12
> Preferred Minor : 0
>
> Update Time : Thu Aug 28 09:36:07 2008
> State : active
> Active Devices : 11
> Working Devices : 12
> Failed Devices : 0
> Spare Devices : 1
> Checksum : 670c7ebc - correct
> Events : 5
>
> Layout : left-symmetric
> Chunk Size : 16K
>
> Number Major Minor RaidDevice State
> this 5 8 97 5 active sync /dev/sdg1
>
> 0 0 8 17 0 active sync /dev/sdb1
> 1 1 8 33 1 active sync /dev/sdc1
> 2 2 8 49 2 active sync /dev/sdd1
> 3 3 8 65 3 active sync /dev/sde1
> 4 4 8 81 4 active sync /dev/sdf1
> 5 5 8 97 5 active sync /dev/sdg1
> 6 6 8 113 6 active sync /dev/sdh1
> 7 7 8 129 7 active sync /dev/sdi1
> 8 8 8 145 8 active sync /dev/sdj1
> 9 9 8 161 9 active sync /dev/sdk1
> 10 10 8 177 10 active sync /dev/sdl1
> 11 11 8 193 11 spare /dev/sdm1
>
> root@localhost:/var/log# mdadm --examine /dev/sdh1
> /dev/sdh1:
> Magic : a92b4efc
> Version : 00.90.00
> UUID : 9f962f09:2d47f553:417df021:0032bb18
> Creation Time : Thu Aug 28 09:33:49 2008
> Raid Level : raid5
> Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
> Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
> Raid Devices : 11
> Total Devices : 12
> Preferred Minor : 0
>
> Update Time : Thu Aug 28 09:36:07 2008
> State : active
> Active Devices : 11
> Working Devices : 12
> Failed Devices : 0
> Spare Devices : 1
> Checksum : 670c7ece - correct
> Events : 5
>
> Layout : left-symmetric
> Chunk Size : 16K
>
> Number Major Minor RaidDevice State
> this 6 8 113 6 active sync /dev/sdh1
>
> 0 0 8 17 0 active sync /dev/sdb1
> 1 1 8 33 1 active sync /dev/sdc1
> 2 2 8 49 2 active sync /dev/sdd1
> 3 3 8 65 3 active sync /dev/sde1
> 4 4 8 81 4 active sync /dev/sdf1
> 5 5 8 97 5 active sync /dev/sdg1
> 6 6 8 113 6 active sync /dev/sdh1
> 7 7 8 129 7 active sync /dev/sdi1
> 8 8 8 145 8 active sync /dev/sdj1
> 9 9 8 161 9 active sync /dev/sdk1
> 10 10 8 177 10 active sync /dev/sdl1
> 11 11 8 193 11 spare /dev/sdm1
>
> root@localhost:/var/log# mdadm --examine /dev/sdi1
> /dev/sdi1:
> Magic : a92b4efc
> Version : 00.90.00
> UUID : 9f962f09:2d47f553:417df021:0032bb18
> Creation Time : Thu Aug 28 09:33:49 2008
> Raid Level : raid5
> Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
> Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
> Raid Devices : 11
> Total Devices : 12
> Preferred Minor : 0
>
> Update Time : Thu Aug 28 09:36:07 2008
> State : active
> Active Devices : 11
> Working Devices : 12
> Failed Devices : 0
> Spare Devices : 1
> Checksum : 670c7ee0 - correct
> Events : 5
>
> Layout : left-symmetric
> Chunk Size : 16K
>
> Number Major Minor RaidDevice State
> this 7 8 129 7 active sync /dev/sdi1
>
> 0 0 8 17 0 active sync /dev/sdb1
> 1 1 8 33 1 active sync /dev/sdc1
> 2 2 8 49 2 active sync /dev/sdd1
> 3 3 8 65 3 active sync /dev/sde1
> 4 4 8 81 4 active sync /dev/sdf1
> 5 5 8 97 5 active sync /dev/sdg1
> 6 6 8 113 6 active sync /dev/sdh1
> 7 7 8 129 7 active sync /dev/sdi1
> 8 8 8 145 8 active sync /dev/sdj1
> 9 9 8 161 9 active sync /dev/sdk1
> 10 10 8 177 10 active sync /dev/sdl1
> 11 11 8 193 11 spare /dev/sdm1
>
> root@localhost:/var/log# mdadm --examine /dev/sdj1
> /dev/sdj1:
> Magic : a92b4efc
> Version : 00.90.00
> UUID : 9f962f09:2d47f553:417df021:0032bb18
> Creation Time : Thu Aug 28 09:33:49 2008
> Raid Level : raid5
> Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
> Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
> Raid Devices : 11
> Total Devices : 12
> Preferred Minor : 0
>
> Update Time : Thu Aug 28 09:36:07 2008
> State : active
> Active Devices : 11
> Working Devices : 12
> Failed Devices : 0
> Spare Devices : 1
> Checksum : 670c7ef2 - correct
> Events : 5
>
> Layout : left-symmetric
> Chunk Size : 16K
>
> Number Major Minor RaidDevice State
> this 8 8 145 8 active sync /dev/sdj1
>
> 0 0 8 17 0 active sync /dev/sdb1
> 1 1 8 33 1 active sync /dev/sdc1
> 2 2 8 49 2 active sync /dev/sdd1
> 3 3 8 65 3 active sync /dev/sde1
> 4 4 8 81 4 active sync /dev/sdf1
> 5 5 8 97 5 active sync /dev/sdg1
> 6 6 8 113 6 active sync /dev/sdh1
> 7 7 8 129 7 active sync /dev/sdi1
> 8 8 8 145 8 active sync /dev/sdj1
> 9 9 8 161 9 active sync /dev/sdk1
> 10 10 8 177 10 active sync /dev/sdl1
> 11 11 8 193 11 spare /dev/sdm1
>
> root@localhost:/var/log# mdadm --examine /dev/sdk1
> /dev/sdk1:
> Magic : a92b4efc
> Version : 00.90.00
> UUID : 9f962f09:2d47f553:417df021:0032bb18
> Creation Time : Thu Aug 28 09:33:49 2008
> Raid Level : raid5
> Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
> Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
> Raid Devices : 11
> Total Devices : 12
> Preferred Minor : 0
>
> Update Time : Thu Aug 28 09:36:07 2008
> State : active
> Active Devices : 11
> Working Devices : 12
> Failed Devices : 0
> Spare Devices : 1
> Checksum : 670c7f04 - correct
> Events : 5
>
> Layout : left-symmetric
> Chunk Size : 16K
>
> Number Major Minor RaidDevice State
> this 9 8 161 9 active sync /dev/sdk1
>
> 0 0 8 17 0 active sync /dev/sdb1
> 1 1 8 33 1 active sync /dev/sdc1
> 2 2 8 49 2 active sync /dev/sdd1
> 3 3 8 65 3 active sync /dev/sde1
> 4 4 8 81 4 active sync /dev/sdf1
> 5 5 8 97 5 active sync /dev/sdg1
> 6 6 8 113 6 active sync /dev/sdh1
> 7 7 8 129 7 active sync /dev/sdi1
> 8 8 8 145 8 active sync /dev/sdj1
> 9 9 8 161 9 active sync /dev/sdk1
> 10 10 8 177 10 active sync /dev/sdl1
> 11 11 8 193 11 spare /dev/sdm1
>
> root@localhost:/var/log# mdadm --examine /dev/sdl1
> /dev/sdl1:
> Magic : a92b4efc
> Version : 00.90.00
> UUID : 9f962f09:2d47f553:417df021:0032bb18
> Creation Time : Thu Aug 28 09:33:49 2008
> Raid Level : raid5
> Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
> Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
> Raid Devices : 11
> Total Devices : 12
> Preferred Minor : 0
>
> Update Time : Thu Aug 28 09:36:07 2008
> State : active
> Active Devices : 11
> Working Devices : 12
> Failed Devices : 0
> Spare Devices : 1
> Checksum : 670c7f16 - correct
> Events : 5
>
> Layout : left-symmetric
> Chunk Size : 16K
>
> Number Major Minor RaidDevice State
> this 10 8 177 10 active sync /dev/sdl1
>
> 0 0 8 17 0 active sync /dev/sdb1
> 1 1 8 33 1 active sync /dev/sdc1
> 2 2 8 49 2 active sync /dev/sdd1
> 3 3 8 65 3 active sync /dev/sde1
> 4 4 8 81 4 active sync /dev/sdf1
> 5 5 8 97 5 active sync /dev/sdg1
> 6 6 8 113 6 active sync /dev/sdh1
> 7 7 8 129 7 active sync /dev/sdi1
> 8 8 8 145 8 active sync /dev/sdj1
> 9 9 8 161 9 active sync /dev/sdk1
> 10 10 8 177 10 active sync /dev/sdl1
> 11 11 8 193 11 spare /dev/sdm1
>
> root@localhost:/var/log# mdadm --examine /dev/sdm1
> /dev/sdm1:
> Magic : a92b4efc
> Version : 00.90.00
> UUID : 9f962f09:2d47f553:417df021:0032bb18
> Creation Time : Thu Aug 28 09:33:49 2008
> Raid Level : raid5
> Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
> Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
> Raid Devices : 11
> Total Devices : 12
> Preferred Minor : 0
>
> Update Time : Thu Aug 28 09:36:07 2008
> State : active
> Active Devices : 11
> Working Devices : 12
> Failed Devices : 0
> Spare Devices : 1
> Checksum : 670c7f22 - correct
> Events : 5
>
> Layout : left-symmetric
> Chunk Size : 16K
>
> Number Major Minor RaidDevice State
> this 11 8 193 11 spare /dev/sdm1
>
> 0 0 8 17 0 active sync /dev/sdb1
> 1 1 8 33 1 active sync /dev/sdc1
> 2 2 8 49 2 active sync /dev/sdd1
> 3 3 8 65 3 active sync /dev/sde1
> 4 4 8 81 4 active sync /dev/sdf1
> 5 5 8 97 5 active sync /dev/sdg1
> 6 6 8 113 6 active sync /dev/sdh1
> 7 7 8 129 7 active sync /dev/sdi1
> 8 8 8 145 8 active sync /dev/sdj1
> 9 9 8 161 9 active sync /dev/sdk1
> 10 10 8 177 10 active sync /dev/sdl1
> 11 11 8 193 11 spare /dev/sdm1
>
> root@localhost:/var/log# mdadm --examine /dev/md0
> mdadm: No md superblock detected on /dev/md0.
>
> root@localhost:/var/log# mdadm --detail /dev/md0
> mdadm: md device /dev/md0 does not appear to be active.
>
> root@localhost:/var/log# cat /etc/mdadm.conf
> DEVICE /dev/sd*
> ARRAY /dev/md0 level=raid5 num-devices=12
> UUID=9f962f09:2d47f553:417df021:0032bb18
>
> root@localhost:/var/log# mdadm --query /dev/md0
> /dev/md0: is an md device which is not active
>
> root@localhost:/var/log# mdadm --assemble --scan
> mdadm: no devices found for /dev/md0
>
> root@localhost:/var/log# mdadm -X /dev/md0
> mdadm: failed to read superblock of bitmap file: No such device
>
> root@localhost:/var/log# mdadm -E /dev/md0
> mdadm: No md superblock detected on /dev/md0.
>
>
> --
> To unsubscribe from this list: send the line "unsubscribe linux-
> raid" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: No md superblock immediately after creating RAID 5 /dev/md0
2008-08-28 8:32 No md superblock immediately after creating RAID 5 /dev/md0 thomas62186218
2008-08-28 9:17 ` Andrew Farley
@ 2008-08-28 9:49 ` Bernd Schubert
2008-08-28 10:07 ` Peter Rabbitson
[not found] ` <9b4ac8ccbe69d232ff2d77fd4e3590c2.squirrel@neil.brown.name>
3 siblings, 0 replies; 8+ messages in thread
From: Bernd Schubert @ 2008-08-28 9:49 UTC (permalink / raw)
To: thomas62186218; +Cc: linux-raid
On Thursday 28 August 2008 10:32:32 thomas62186218@aol.com wrote:
> Hi all,
>
> I am struggling with an issue on an Ubuntu 8.0.4 64-bit system. The
> system has 12 SATA drives. I create a RAID 5 array using mdadm as
> follows:
>
> mdadm -Cv /dev/md0 -n12 -l5 -c128 /dev/sd[b-m] -R -f
>
> The device creates successfully and starts and is visible as syncing in
> cat /proc/mdstat. But, according to mdadm -X /dev/md0, there is no md
> superblock on the device. Doing the same mdadm -X command for all
You need to run --detail for md devices
> components /dev/sdb through /dev/sdm shows superblocks. If I reboot the
--examine only works for the components
> system, /dev/md0 is completely gone, and a mdadm --assemble --scan
Did you add the corresponding entries to your mdadm.conf?
See this chapter in "man 8 mdadm"
<quote>
echo ’DEVICE /dev/hd[a-z] /dev/sd*[a-z]’ > mdadm.conf
mdadm --examine --scan --config=mdadm.conf >> mdadm.conf
This will find arrays which could be assembled from existing IDE and
SCSI whole drives (not partitions),
and store the information in the format of a config file. This file is
very likely to contain unwanted
detail, particularly the devices= entries. It should be reviewed and
edited before being used as an actual
config file.
</quote>
Cheers,
Bernd
--
Bernd Schubert
Q-Leap Networks GmbH
--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: No md superblock immediately after creating RAID 5 /dev/md0
2008-08-28 8:32 No md superblock immediately after creating RAID 5 /dev/md0 thomas62186218
2008-08-28 9:17 ` Andrew Farley
2008-08-28 9:49 ` Bernd Schubert
@ 2008-08-28 10:07 ` Peter Rabbitson
[not found] ` <9b4ac8ccbe69d232ff2d77fd4e3590c2.squirrel@neil.brown.name>
3 siblings, 0 replies; 8+ messages in thread
From: Peter Rabbitson @ 2008-08-28 10:07 UTC (permalink / raw)
To: thomas62186218; +Cc: linux-raid
thomas62186218@aol.com wrote:
> Hi all,
>
> I am struggling with an issue on an Ubuntu 8.0.4 64-bit system. The
> system has 12 SATA drives. I create a RAID 5 array using mdadm as follows:
>
> mdadm -Cv /dev/md0 -n12 -l5 -c128 /dev/sd[b-m] -R -f
>
As a side note, what you are about to do is sheer madness. At least use
RAID6. Search for raid5 in the list archives for a number of discussions
why using RAID5 with a large number of disks is rather shortsighted.
HTH
Peter
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: No md superblock immediately after creating RAID 5 /dev/md0
2008-08-28 9:17 ` Andrew Farley
@ 2008-08-29 5:31 ` thomas62186218
0 siblings, 0 replies; 8+ messages in thread
From: thomas62186218 @ 2008-08-29 5:31 UTC (permalink / raw)
To: andrew; +Cc: linux-raid
Hi Andrew,
Thanks for the feedback but I am running Ubuntu 64-bit, and with 64-bit
OSes, CONFIG_LBD is not a configurable option (it is always enabled).
-Thomas
-----Original Message-----
From: Andrew Farley <andrew@neonsurge.com>
To: thomas62186218@aol.com
Cc: linux-raid@vger.kernel.org
Sent: Thu, 28 Aug 2008 2:17 am
Subject: Re: No md superblock immediately after creating RAID 5 /dev/md0
Thomas,
I have seen this happen to me before when your kernel doesn't have
large block device support (CONFIG_LBD). I still forget it sometimes
in between making large file servers and seem to waste time every time
figuring it out.
See here: http://www.suse.de/~aj/linux_lfs.html
Check if it's compiled into your kernel if you compiled it yourself by
looking for CONFIG_LBD=y in /usr/src/linux/.config or if it's supported
in your kernel extract from and search in /proc/config.gz. If it's not
in there go recompile your kernel to support LBD.
Cheers,
Farley
On Aug 28, 2008, at 1:32 AM, thomas62186218@aol.com wrote:
> Hi all,
>
> I am struggling with an issue on an Ubuntu 8.0.4 64-bit system. The >
system has 12 SATA drives. I create a RAID 5 array using mdadm as >
follows:
>
> mdadm -Cv /dev/md0 -n12 -l5 -c128 /dev/sd[b-m] -R -f
>
> The device creates successfully and starts and is visible as syncing
> in cat /proc/mdstat. But, according to mdadm -X /dev/md0, there is >
no md superblock on the device. Doing the same mdadm -X command for >
all components /dev/sdb through /dev/sdm shows superblocks. If I >
reboot the system, /dev/md0 is completely gone, and a mdadm -->
assemble --scan produces no results. I've also tried creating the md >
with Version 1 and 1.2 superblocks, but the same problem occurs. >
Below is complete output.
>
> Thank you for your assistance on this strange issue!
>
> Best,
> Thomas
>
>
> root@localhost:~# cat /proc/mdstat
> Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5]
> [raid4] [ra id10]
> md0 : active raid5 sdm1[11](S) sdl1[10] sdk1[9] sdj1[8] sdi1[7] >
sdh1[6] sdg1[5] sdf1[4] sde1[3] sdd1[2] sdc1[1] sdb1[0]
> 4883839360 blocks level 5, 16k chunk, algorithm 2 [11/11] >
[UUUUUUUUUUU]
> [>....................] resync = 0.6% (3207984/488383936) >
finish=158.8mi n speed=50916K/sec
>
> unused devices: <none>
>
> root@localhost:~# pvs
> PV VG Fmt Attr PSize PFree
> /dev/md0 raid5test lvm2 a-20 4.55T 4.55T
>
> root@localhost:~# cat /etc/mdadm.conf
> DEVICE /dev/sd*
> ARRAY /dev/md0 level=raid5 num-devices=12 >
UUID=9f962f09:2d47f553:417df021:0032bb 18
>
> root@localhost:~# reboot
>
> Broadcast message from root@localhost
> (/dev/pts/0) at 9:35 ...
>
> The system is going down for reboot NOW!
>
> root@localhost:~#
> login as: root
> root@192.168.0.70's password:
> Last login: Thu Aug 28 09:28:34 2008 from 192.168.0.114
>
>
> root@localhost:~# cat /proc/mdstat
> Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5]
> [raid4] [ra id10]
> unused devices: <none>
>
>
> root@localhost:~# mdadm --assemble --scan
> mdadm: no devices found for /dev/md0
>
> root@localhost:~# mdadm --query /dev/md0
> /dev/md0: is an md device which is not active
>
> root@localhost:/var/log# mdadm --examine /dev/sdb1
> /dev/sdb1:
> Magic : a92b4efc
> Version : 00.90.00
> UUID : 9f962f09:2d47f553:417df021:0032bb18
> Creation Time : Thu Aug 28 09:33:49 2008
> Raid Level : raid5
> Used Dev Size
: 488383936 (465.76 GiB 500.11 GB)
> Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
> Raid Devices : 11
> Total Devices : 12
> Preferred Minor : 0
>
> Update Time : Thu Aug 28 09:36:07 2008
> State : active
> Active Devices : 11
> Working Devices : 12
> Failed Devices : 0
> Spare Devices : 1
> Checksum : 670c7e62 - correct
> Events : 5
>
> Layout : left-symmetric
> Chunk Size : 16K
>
> Number Major Minor RaidDevice State
> this 0 8 17 0 active sync /dev/sdb1
>
> 0 0 8 17 0 active sync /dev/sdb1
> 1 1 8 33 1 active sync /dev/sdc1
> 2 2 8 49 2 active sync /dev/sdd1
> 3 3 8 65 3 active sync /dev/sde1
> 4 4 8 81 4 active sync /dev/sdf1
> 5 5
8 97 5 active sync /dev/sdg1
> 6 6 8 113 6 active sync /dev/sdh1
> 7 7 8 129 7 active sync /dev/sdi1
> 8 8 8 145 8 active sync /dev/sdj1
> 9 9 8 161 9 active sync /dev/sdk1
> 10 10 8 177 10 active sync /dev/sdl1
> 11 11 8 193 11 spare /dev/sdm1
>
> root@localhost:/var/log# mdadm --examine /dev/sdc1
> /dev/sdc1:
> Magic : a92b4efc
> Version : 00.90.00
> UUID : 9f962f09:2d47f553:417df021:0032bb18
> Creation Time : Thu Aug 28 09:33:49 2008
> Raid Level : raid5
> Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
> Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
> Raid Devices : 11
> Total Devices : 12
> Preferred Minor : 0
>
> Update Time : Thu Aug 28 09:36:07 2008
> State : active
> Active
Devices : 11
> Working Devices : 12
> Failed Devices : 0
> Spare Devices : 1
> Checksum : 670c7e74 - correct
> Events : 5
>
> Layout : left-symmetric
> Chunk Size : 16K
>
> Number Major Minor RaidDevice State
> this 1 8 33 1 active sync /dev/sdc1
>
> 0 0 8 17 0 active sync /dev/sdb1
> 1 1 8 33 1 active sync /dev/sdc1
> 2 2 8 49 2 active sync /dev/sdd1
> 3 3 8 65 3 active sync /dev/sde1
> 4 4 8 81 4 active sync /dev/sdf1
> 5 5 8 97 5 active sync /dev/sdg1
> 6 6 8 113 6 active sync /dev/sdh1
> 7 7 8 129 7 active sync /dev/sdi1
> 8
8 8 145 8 active sync /dev/sdj1
> 9 9 8 161 9 active sync /dev/sdk1
> 10 10 8 177 10 active sync /dev/sdl1
> 11 11 8 193 11 spare /dev/sdm1
>
> root@localhost:/var/log# mdadm --examine /dev/sdd1
> /dev/sdd1:
> Magic : a92b4efc
> Version : 00.90.00
> UUID : 9f962f09:2d47f553:417df021:0032bb18
> Creation Time : Thu Aug 28 09:33:49 2008
> Raid Level : raid5
> Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
> Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
> Raid Devices : 11
> Total Devices : 12
> Preferred Minor : 0
>
> Update Time : Thu Aug 28 09:36:07 2008
> State : active
> Active Devices : 11
> Working Devices : 12
> Failed Devices : 0
> Spare Devices : 1
> Checksum : 670c7e86 - correct
> Events : 5
>
> Layout : left-symmetric
> Chunk Size : 16K
>
>
Number Major Minor RaidDevice State
> this 2 8 49 2 active sync /dev/sdd1
>
> 0 0 8 17 0 active sync /dev/sdb1
> 1 1 8 33 1 active sync /dev/sdc1
> 2 2 8 49 2 active sync /dev/sdd1
> 3 3 8 65 3 active sync /dev/sde1
> 4 4 8 81 4 active sync /dev/sdf1
> 5 5 8 97 5 active sync /dev/sdg1
> 6 6 8 113 6 active sync /dev/sdh1
> 7 7 8 129 7 active sync /dev/sdi1
> 8 8 8 145 8 active sync /dev/sdj1
> 9 9 8 161 9 active sync /dev/sdk1
> 10 10 8 177 10 active sync /dev/sdl1
> 11 11 20 8 193 11 spare /dev/sdm1
>
> root@localhost:/var/log# mdadm --examine /dev/sde1
> /dev/sde1:
> Magic : a92b4efc
> Version : 00.90.00
> UUID : 9f962f09:2d47f553:417df021:0032bb18
> Creation Time : Thu Aug 28 09:33:49 2008
> Raid Level : raid5
> Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
> Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
> Raid Devices : 11
> Total Devices : 12
> Preferred Minor : 0
>
> Update Time : Thu Aug 28 09:36:07 2008
> State : active
> Active Devices : 11
> Working Devices : 12
> Failed Devices : 0
> Spare Devices : 1
> Checksum : 670c7e98 - correct
> Events : 5
>
> Layout : left-symmetric
> Chunk Size : 16K
>
> Number Major Minor RaidDevice State
> this 3 8 65 3 active sync /dev/sde1
>
> 0 0 8 17 0 active sync /dev/sdb1
> 1 1 8
33 1 active sync /dev/sdc1
> 2 2 8 49 2 active sync /dev/sdd1
> 3 3 8 65 3 active sync /dev/sde1
> 4 4 8 81 4 active sync /dev/sdf1
> 5 5 8 97 5 active sync /dev/sdg1
> 6 6 8 113 6 active sync /dev/sdh1
> 7 7 8 129 7 active sync /dev/sdi1
> 8 8 8 145 8 active sync /dev/sdj1
> 9 9 8 161 9 active sync /dev/sdk1
> 10 10 8 177 10 active sync /dev/sdl1
> 11 11 8 193 11 spare /dev/sdm1
>
> root@localhost:/var/log# mdadm --examine /dev/sdf1
> /dev/sdf1:
> Magic : a92b4efc
> Version : 00.90.00
> UUID : 9f962f09:2d47f553:417df021:0032bb18
> C
reation Time : Thu Aug 28 09:33:49 2008
> Raid Level : raid5
> Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
> Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
> Raid Devices : 11
> Total Devices : 12
> Preferred Minor : 0
>
> Update Time : Thu Aug 28 09:36:07 2008
> State : active
> Active Devices : 11
> Working Devices : 12
> Failed Devices : 0
> Spare Devices : 1
> Checksum : 670c7eaa - correct
> Events : 5
>
> Layout : left-symmetric
> Chunk Size : 16K
>
> Number Major Minor RaidDevice State
> this 4 8 81 4 active sync /dev/sdf1
>
> 0 0 8 17 0 active sync /dev/sdb1
> 1 1 8 33 1 active sync /dev/sdc1
> 2 2 8 49 2 active sync /dev/sdd1
> 3 3 8 65 3 active sync /dev/sde1
> 4 4 =2
0 8 81 4 active sync /dev/sdf1
> 5 5 8 97 5 active sync /dev/sdg1
> 6 6 8 113 6 active sync /dev/sdh1
> 7 7 8 129 7 active sync /dev/sdi1
> 8 8 8 145 8 active sync /dev/sdj1
> 9 9 8 161 9 active sync /dev/sdk1
> 10 10 8 177 10 active sync /dev/sdl1
> 11 11 8 193 11 spare /dev/sdm1
>
> root@localhost:/var/log# mdadm --examine /dev/sdg1
> /dev/sdg1:
> Magic : a92b4efc
> Version : 00.90.00
> UUID : 9f962f09:2d47f553:417df021:0032bb18
> Creation Time : Thu Aug 28 09:33:49 2008
> Raid Level : raid5
> Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
> Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
> Raid Devices : 11
> Total Devices : 12
> Preferred Minor : 0
>
>
Update Time : Thu Aug 28 09:36:07 2008
> State : active
> Active Devices : 11
> Working Devices : 12
> Failed Devices : 0
> Spare Devices : 1
> Checksum : 670c7ebc - correct
> Events : 5
>
> Layout : left-symmetric
> Chunk Size : 16K
>
> Number Major Minor RaidDevice State
> this 5 8 97 5 active sync /dev/sdg1
>
> 0 0 8 17 0 active sync /dev/sdb1
> 1 1 8 33 1 active sync /dev/sdc1
> 2 2 8 49 2 active sync /dev/sdd1
> 3 3 8 65 3 active sync /dev/sde1
> 4 4 8 81 4 active sync /dev/sdf1
> 5 5 8 97 5 active sync /dev/sdg1
> 6 6 8 113 6 active sync /dev/sdh1
> 7 7 =2
0 8 129 7 active sync /dev/sdi1
> 8 8 8 145 8 active sync /dev/sdj1
> 9 9 8 161 9 active sync /dev/sdk1
> 10 10 8 177 10 active sync /dev/sdl1
> 11 11 8 193 11 spare /dev/sdm1
>
> root@localhost:/var/log# mdadm --examine /dev/sdh1
> /dev/sdh1:
> Magic : a92b4efc
> Version : 00.90.00
> UUID : 9f962f09:2d47f553:417df021:0032bb18
> Creation Time : Thu Aug 28 09:33:49 2008
> Raid Level : raid5
> Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
> Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
> Raid Devices : 11
> Total Devices : 12
> Preferred Minor : 0
>
> Update Time : Thu Aug 28 09:36:07 2008
> State : active
> Active Devices : 11
> Working Devices : 12
> Failed Devices : 0
> Spare Devices : 1
> Checksum : 670c7ece - correct
> Events : 5
>
> 20 Layout : left-symmetric
> Chunk Size : 16K
>
> Number Major Minor RaidDevice State
> this 6 8 113 6 active sync /dev/sdh1
>
> 0 0 8 17 0 active sync /dev/sdb1
> 1 1 8 33 1 active sync /dev/sdc1
> 2 2 8 49 2 active sync /dev/sdd1
> 3 3 8 65 3 active sync /dev/sde1
> 4 4 8 81 4 active sync /dev/sdf1
> 5 5 8 97 5 active sync /dev/sdg1
> 6 6 8 113 6 active sync /dev/sdh1
> 7 7 8 129 7 active sync /dev/sdi1
> 8 8 8 145 8 active sync /dev/sdj1
> 9 9 8 161 9 active sync /dev/sdk1
> 10 10
8 177 10 active sync /dev/sdl1
> 11 11 8 193 11 spare /dev/sdm1
>
> root@localhost:/var/log# mdadm --examine /dev/sdi1
> /dev/sdi1:
> Magic : a92b4efc
> Version : 00.90.00
> UUID : 9f962f09:2d47f553:417df021:0032bb18
> Creation Time : Thu Aug 28 09:33:49 2008
> Raid Level : raid5
> Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
> Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
> Raid Devices : 11
> Total Devices : 12
> Preferred Minor : 0
>
> Update Time : Thu Aug 28 09:36:07 2008
> State : active
> Active Devices : 11
> Working Devices : 12
> Failed Devices : 0
> Spare Devices : 1
> Checksum : 670c7ee0 - correct
> Events : 5
>
> Layout : left-symmetric
> Chunk Size : 16K
>
> Number Major Minor RaidDevice State
> this 7 8 129 7 active sync /dev/sdi1
>
> 0 0 8
17 0 active sync /dev/sdb1
> 1 1 8 33 1 active sync /dev/sdc1
> 2 2 8 49 2 active sync /dev/sdd1
> 3 3 8 65 3 active sync /dev/sde1
> 4 4 8 81 4 active sync /dev/sdf1
> 5 5 8 97 5 active sync /dev/sdg1
> 6 6 8 113 6 active sync /dev/sdh1
> 7 7 8 129 7 active sync /dev/sdi1
> 8 8 8 145 8 active sync /dev/sdj1
> 9 9 8 161 9 active sync /dev/sdk1
> 10 10 8 177 10 active sync /dev/sdl1
> 11 11 8 193 11 spare /dev/sdm1
>
> root@localhost:/var/log# mdadm --examine /dev/sdj1
> /dev/sdj1:
> Magic : a92b4efc
>
Version : 00.90.00
> UUID : 9f962f09:2d47f553:417df021:0032bb18
> Creation Time : Thu Aug 28 09:33:49 2008
> Raid Level : raid5
> Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
> Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
> Raid Devices : 11
> Total Devices : 12
> Preferred Minor : 0
>
> Update Time : Thu Aug 28 09:36:07 2008
> State : active
> Active Devices : 11
> Working Devices : 12
> Failed Devices : 0
> Spare Devices : 1
> Checksum : 670c7ef2 - correct
> Events : 5
>
> Layout : left-symmetric
> Chunk Size : 16K
>
> Number Major Minor RaidDevice State
> this 8 8 145 8 active sync /dev/sdj1
>
> 0 0 8 17 0 active sync /dev/sdb1
> 1 1 8 33 1 active sync /dev/sdc1
> 2 2 8 49 2 active sync /dev/sdd1
> 3 3 8
65 3 active sync /dev/sde1
> 4 4 8 81 4 active sync /dev/sdf1
> 5 5 8 97 5 active sync /dev/sdg1
> 6 6 8 113 6 active sync /dev/sdh1
> 7 7 8 129 7 active sync /dev/sdi1
> 8 8 8 145 8 active sync /dev/sdj1
> 9 9 8 161 9 active sync /dev/sdk1
> 10 10 8 177 10 active sync /dev/sdl1
> 11 11 8 193 11 spare /dev/sdm1
>
> root@localhost:/var/log# mdadm --examine /dev/sdk1
> /dev/sdk1:
> Magic : a92b4efc
> Version : 00.90.00
> UUID : 9f962f09:2d47f553:417df021:0032bb18
> Creation Time : Thu Aug 28 09:33:49 2008
> Raid Level : raid5
> Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
> Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
> Raid Devices : 1
1
> Total Devices : 12
> Preferred Minor : 0
>
> Update Time : Thu Aug 28 09:36:07 2008
> State : active
> Active Devices : 11
> Working Devices : 12
> Failed Devices : 0
> Spare Devices : 1
> Checksum : 670c7f04 - correct
> Events : 5
>
> Layout : left-symmetric
> Chunk Size : 16K
>
> Number Major Minor RaidDevice State
> this 9 8 161 9 active sync /dev/sdk1
>
> 0 0 8 17 0 active sync /dev/sdb1
> 1 1 8 33 1 active sync /dev/sdc1
> 2 2 8 49 2 active sync /dev/sdd1
> 3 3 8 65 3 active sync /dev/sde1
> 4 4 8 81 4 active sync /dev/sdf1
> 5 5 8 97 5 active sync /dev/sdg1
> 6 6 8
113 6 active sync /dev/sdh1
> 7 7 8 129 7 active sync /dev/sdi1
> 8 8 8 145 8 active sync /dev/sdj1
> 9 9 8 161 9 active sync /dev/sdk1
> 10 10 8 177 10 active sync /dev/sdl1
> 11 11 8 193 11 spare /dev/sdm1
>
> root@localhost:/var/log# mdadm --examine /dev/sdl1
> /dev/sdl1:
> Magic : a92b4efc
> Version : 00.90.00
> UUID : 9f962f09:2d47f553:417df021:0032bb18
> Creation Time : Thu Aug 28 09:33:49 2008
> Raid Level : raid5
> Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
> Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
> Raid Devices : 11
> Total Devices : 12
> Preferred Minor : 0
>
> Update Time : Thu Aug 28 09:36:07 2008
> State : active
> Active Devices : 11
> Working Devices : 12
> Failed Devices : 0
> Spare Devices : 1
>
Checksum : 670c7f16 - correct
> Events : 5
>
> Layout : left-symmetric
> Chunk Size : 16K
>
> Number Major Minor RaidDevice State
> this 10 8 177 10 active sync /dev/sdl1
>
> 0 0 8 17 0 active sync /dev/sdb1
> 1 1 8 33 1 active sync /dev/sdc1
> 2 2 8 49 2 active sync /dev/sdd1
> 3 3 8 65 3 active sync /dev/sde1
> 4 4 8 81 4 active sync /dev/sdf1
> 5 5 8 97 5 active sync /dev/sdg1
> 6 6 8 113 6 active sync /dev/sdh1
> 7 7 8 129 7 active sync /dev/sdi1
> 8 8 8 145 8 active sync /dev/sdj1
> 9 9 8 20 161 9 active sync /dev/sdk1
> 10 10 8 177 10 active sync /dev/sdl1
> 11 11 8 193 11 spare /dev/sdm1
>
> root@localhost:/var/log# mdadm --examine /dev/sdm1
> /dev/sdm1:
> Magic : a92b4efc
> Version : 00.90.00
> UUID : 9f962f09:2d47f553:417df021:0032bb18
> Creation Time : Thu Aug 28 09:33:49 2008
> Raid Level : raid5
> Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
> Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
> Raid Devices : 11
> Total Devices : 12
> Preferred Minor : 0
>
> Update Time : Thu Aug 28 09:36:07 2008
> State : active
> Active Devices : 11
> Working Devices : 12
> Failed Devices : 0
> Spare Devices : 1
> Checksum : 670c7f22 - correct
> Events : 5
>
> Layout : left-symmetric
> Chunk Size : 16K
>
> Number Major Minor RaidDevice State
> this 11 8 193 11 spar
e /dev/sdm1
>
> 0 0 8 17 0 active sync /dev/sdb1
> 1 1 8 33 1 active sync /dev/sdc1
> 2 2 8 49 2 active sync /dev/sdd1
> 3 3 8 65 3 active sync /dev/sde1
> 4 4 8 81 4 active sync /dev/sdf1
> 5 5 8 97 5 active sync /dev/sdg1
> 6 6 8 113 6 active sync /dev/sdh1
> 7 7 8 129 7 active sync /dev/sdi1
> 8 8 8 145 8 active sync /dev/sdj1
> 9 9 8 161 9 active sync /dev/sdk1
> 10 10 8 177 10 active sync /dev/sdl1
> 11 11 8 193 11 spare /dev/sdm1
>
> root@localhost:/var/log# mdadm --examine /dev/md0
0D
> mdadm: No md superblock detected on /dev/md0.
>
> root@localhost:/var/log# mdadm --detail /dev/md0
> mdadm: md device /dev/md0 does not appear to be active.
>
> root@localhost:/var/log# cat /etc/mdadm.conf
> DEVICE /dev/sd*
> ARRAY /dev/md0 level=raid5 num-devices=12 >
UUID=9f962f09:2d47f553:417df021:0032bb18
>
> root@localhost:/var/log# mdadm --query /dev/md0
> /dev/md0: is an md device which is not active
>
> root@localhost:/var/log# mdadm --assemble --scan
> mdadm: no devices found for /dev/md0
>
> root@localhost:/var/log# mdadm -X /dev/md0
> mdadm: failed to read superblock of bitmap file: No such device
>
> root@localhost:/var/log# mdadm -E /dev/md0
> mdadm: No md superblock detected on /dev/md0.
>
>
> --
> To unsubscribe from this list: send the line "unsubscribe linux->
raid" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at http://vger.kernel.org/majordomo-info.html
--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: No md superblock immediately after creating RAID 5 /dev/md0
[not found] ` <9b4ac8ccbe69d232ff2d77fd4e3590c2.squirrel@neil.brown.name>
@ 2008-08-29 5:47 ` thomas62186218
2008-08-29 6:01 ` NeilBrown
0 siblings, 1 reply; 8+ messages in thread
From: thomas62186218 @ 2008-08-29 5:47 UTC (permalink / raw)
To: neilb, linux-raid
Hi Neil,
Sorry for the confusion. I mistyped the -C command in my initial email
(forgot the hot-spare) and thus the confusion.
Here is the full output from the top using copy/paste. Thank you in
advance for your help!!
root@localhost:~# fdisk -l
Disk /dev/sda: 2095 MB, 2095865856 bytes
65 heads, 62 sectors/track, 1015 cylinders
Units = cylinders of 4030 * 512 = 2063360 bytes
Disk identifier: 0x00000000
Device Boot Start End Blocks Id System
/dev/sda1 * 1 500 1007469 83 Linux
/dev/sda2 * 501 1015 1037725 83 Linux
Disk /dev/sdb: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x0b65bb81
Device Boot Start End Blocks Id System
Disk /dev/sdc: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x273d0b7e
Device Boot Start End Blocks Id System
Disk /dev/sdd: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x03cf614e
Device Boot Start End Blocks Id System
Disk /dev/sde: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0xa6b886bb
Device Boot Start End Blocks Id System
Disk /dev/sdf: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x65752a1a
Device Boot Start End Blocks Id System
Disk /dev/sdg: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x9f188135
Device Boot Start End Blocks Id System
Disk /dev/sdh: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0xc19605d4
Device Boot Start End Blocks Id System
Disk /dev/sdi: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x1e6c4f8e
Device Boot Start End Blocks Id System
Disk /dev/sdj: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0xd13edb81
Device Boot Start End Blocks Id System
Disk /dev/sdk: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x5bbd83b9
Disk /dev/sdk doesn't contain a valid partition table
Disk /dev/sdl: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0xebcdc998
Device Boot Start End Blocks Id System
Disk /dev/sdm: 1000.2 GB, 1000204886016 bytes
255 heads, 63 sectors/track, 121601 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0xd90b43ff
Device Boot Start End Blocks Id System
root@localhost:~#
root@localhost:~# cat /etc/mdadm.conf
root@localhost:~#
root@localhost:~# mdadm --examine --scan --verbose
root@localhost:~#
root@localhost:~# mdadm -Cv /dev/md0 -n11 -l5 -c128 /dev/sd[b-l] -x1
/dev/sdm -R -f --verbose
mdadm: layout defaults to left-symmetric
mdadm: size set to 976762496K
mdadm: array /dev/md0 started.
root@localhost:~#
root@localhost:~# cat /proc/mdstat
Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5]
[raid4] [raid10]
md0 : active raid5 sdm[11](S) sdl[10] sdk[9] sdj[8] sdi[7] sdh[6]
sdg[5] sdf[4] sde[3] sdd[2] sdc[1] sdb[0]
9767624960 blocks level 5, 128k chunk, algorithm 2 [11/11]
[UUUUUUUUUUU]
[>....................] resync = 0.0% (265128/976762496)
finish=306.8min speed=53025K/sec
unused devices: <none>
root@localhost:~#
root@localhost:~# cat /etc/mdadm.conf
root@localhost:~#
root@localhost:~# mdadm --examine --scan --verbose
ARRAY /dev/md0 level=raid5 num-devices=11
UUID=09db8873:25545721:e5d66b81:63573add
spares=1
devices=/dev/sdm,/dev/sdl,/dev/sdk,/dev/sdj,/dev/sdi,/dev/sdh,/dev/sdg,/d
ev/sdf,/dev/sde,/dev/sdd,/dev/sdc,/dev/sdb
root@localhost:~#
root@localhost:~# mdadm -D /dev/md0
/dev/md0:
Version : 00.90
Creation Time : Fri Aug 29 05:34:40 2008
Raid Level : raid5
Array Size : 9767624960 (9315.13 GiB 10002.05 GB)
Used Dev Size : 976762496 (931.51 GiB 1000.20 GB)
Raid Devices : 11
Total Devices : 12
Preferred Minor : 0
Persistence : Superblock is persistent
Update Time : Fri Aug 29 05:34:41 2008
State : active, resyncing
Active Devices : 11
Working Devices : 12
Failed Devices : 0
Spare Devices : 1
Layout : left-symmetric
Chunk Size : 128K
Rebuild Status : 0% complete
UUID : 09db8873:25545721:e5d66b81:63573add
Events : 0.3
Number Major Minor RaidDevice State
0 8 16 0 active sync /dev/sdb
1 8 32 1 active sync /dev/sdc
2 8 48 2 active sync /dev/sdd
3 8 64 3 active sync /dev/sde
4 8 80 4 active sync /dev/sdf
5 8 96 5 active sync /dev/sdg
6 8 112 6 active sync /dev/sdh
7 8 128 7 active sync /dev/sdi
8 8 144 8 active sync /dev/sdj
9 8 160 9 active sync /dev/sdk
10 8 176 10 active sync /dev/sdl
11 8 192 - spare /dev/sdm
root@localhost:~#
root@localhost:~# shutdown -r now
Broadcast message from root@localhost
(/dev/pts/0) at 5:35 ...
The system is going down for reboot NOW!
root@localhost:~# login as: root
root@192.168.1.15's password:
root@localhost:~#
root@localhost:~#
root@localhost:~# cat /proc/mdstat
Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5]
[raid4] [raid10]
unused devices: <none>
root@localhost:~#
root@localhost:~# mdadm --examine --scan --verbose
ARRAY /dev/md0 level=raid5 num-devices=11
UUID=09db8873:25545721:e5d66b81:63573add
spares=1
devices=/dev/sdm,/dev/sdl,/dev/sdk,/dev/sdj,/dev/sdi,/dev/sdh,/dev/sdg,/d
ev/sdf,/dev/sde,/dev/sdd,/dev/sdc,/dev/sdb
root@localhost:~#
root@localhost:~# cat /etc/mdadm.conf
root@localhost:~#
root@localhost:~# mdadm --assemble --scan --verbose
mdadm: No arrays found in config file
root@localhost:~#
root@localhost:~# mdadm --scan
mdadm: --scan does not set the mode, and so cannot be the first option.
root@localhost:~# mdadm -E /dev/md0
mdadm: cannot open /dev/md0: No such file or directory
root@localhost:~#
root@localhost:~# mdadm -X /dev/md0
mdadm: failed to find file /dev/md0: No such file or directory
root@localhost:~# mdadm --assemble --scan --verbose /dev/md0
mdadm: /dev/md0 not identified in config file.
root@localhost:~# mdadm --query /dev/md0
mdadm: cannot open /dev/md0: No such file or directory
root@localhost:~#
-----Original Message-----
From: NeilBrown <neilb@suse.de>
To: thomas62186218@aol.com
Sent: Thu, 28 Aug 2008 5:04 am
Subject: Re: No md superblock immediately after creating RAID 5 /dev/md0
On Thu, August 28, 2008 6:32 pm, thomas62186218@aol.com wrote:
>
> mdadm -Cv /dev/md0 -n12 -l5 -c128 /dev/sd[b-m] -R -f
^^
12.
>
> root@localhost:~# cat /proc/mdstat
> Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5]
> [raid4] [ra id10]
> md0 : active raid5 sdm1[11](S) sdl1[10] sdk1[9] sdj1[8] sdi1[7]
sdh1[6]
> sdg1[5] sdf1[4] sde1[3] sdd1[2] sdc1[1] sdb1[0]
> 4883839360 blocks level 5, 16k chunk, algorithm 2 [11/11]
^^
11!
> root@localhost:~# cat /etc/mdadm.conf
> DEVICE /dev/sd*
> ARRAY /dev/md0 level=raid5 num-devices=12
^^
12 ??
> Raid Devices : 11
^^
Something odd here.
> root@localhost:/var/log# mdadm --assemble --scan
> mdadm: no devices found for /dev/md0
Could you add --verbose to that line and try again?
NeilBrown
P.S. Thanks for including lots of details!
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: No md superblock immediately after creating RAID 5 /dev/md0
2008-08-29 5:47 ` thomas62186218
@ 2008-08-29 6:01 ` NeilBrown
2008-09-16 9:37 ` thomas62186218
0 siblings, 1 reply; 8+ messages in thread
From: NeilBrown @ 2008-08-29 6:01 UTC (permalink / raw)
To: thomas62186218; +Cc: linux-raid
On Fri, August 29, 2008 3:47 pm, thomas62186218@aol.com wrote:
>
> Hi Neil,
>
> Sorry for the confusion. I mistyped the -C command in my initial email
> (forgot the hot-spare) and thus the confusion.
>
> Here is the full output from the top using copy/paste. Thank you in
> advance for your help!!
In the first mail you sent, there was an mdadm.conf.
But now:
> root@localhost:~# cat /etc/mdadm.conf
> root@localhost:~#
there isn't.
Why is that?
If you want mdadm to assemble an array you need to tell it where to find
the devices and how to recognise them. The mdadm.conf you had before
was exactly the right sort of thing to have.
Without it you need to be more explicit
mdadm -A /dev/md0 /dev/sd[b-m]
maybe.
Or after creating the array
mdadm -D > /etc/mdadm.conf
NeilBrown
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: No md superblock immediately after creating RAID 5 /dev/md0
2008-08-29 6:01 ` NeilBrown
@ 2008-09-16 9:37 ` thomas62186218
0 siblings, 0 replies; 8+ messages in thread
From: thomas62186218 @ 2008-09-16 9:37 UTC (permalink / raw)
To: neilb; +Cc: linux-raid, thomas62186218
Hi Neil,
Thank you for your help on this. It seems like running mdadm -D >
/etc/mdadm.conf is the way to go.
But, this raises another question. In EVMS, you do not need to ever
tell it how to assemble an array. In fact, we could have a EVMS RAID of
3 drives, pull the 3 drives out, and put them into a brand new system
with no configuration files, etc. and EVMS would instantly recognize
the RAID device, and even all volumes on it.
With mdadm, though, it seems like without /etc/mdadm.conf (or manually
telling mdadm what to assemble), mdadm cannot really tell on its own
what to do. This puts greater importance of course on /etc/mdadm.conf.
Is there any way around this? In other words, is there a way to
auto-assemble arrays without using mdadm -A or without having
/etc/mdadm.conf?
Finally, if /etc/mdadm.conf is the solution, can you advise what should
happen when an md device is deleted? Should the "legacy" entries be
left in /etc/mdadm.conf? Or should these be cleaned out? Any easy way
to do this?
Thank you in advance for your help!
With Regards,
-Thomas
-----Original Message-----
From: NeilBrown <neilb@suse.de>
To: thomas62186218@aol.com
Cc: linux-raid@vger.kernel.org
Sent: Thu, 28 Aug 2008 11:01 pm
Subject: Re: No md superblock immediately after creating RAID 5 /dev/md0
On Fri, August 29, 2008 3:47 pm, thomas62186218@aol.com wrote:
>
> Hi Neil,
>
> Sorry for the confusion. I mistyped the -C command in my initial email
> (forgot the hot-spare) and thus the confusion.
>
> Here is the full output from the top using copy/paste. Thank you in
> advance for your help!!
In the first mail you sent, there was an mdadm.conf.
But now:
> root@localhost:~# cat /etc/mdadm.conf
> root@localhost:~#
there isn't.
Why is that?
If you want mdadm to assemble an array you need to tell it where to find
the devices and how to recognise them. The mdadm.conf you had before
was exactly the right sort of thing to have.
Without it you need to be more explicit
mdadm -A /dev/md0 /dev/sd[b-m]
maybe.
Or after creating the array
mdadm -D > /etc/mdadm.conf
NeilBrown
^ permalink raw reply [flat|nested] 8+ messages in thread
end of thread, other threads:[~2008-09-16 9:37 UTC | newest]
Thread overview: 8+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2008-08-28 8:32 No md superblock immediately after creating RAID 5 /dev/md0 thomas62186218
2008-08-28 9:17 ` Andrew Farley
2008-08-29 5:31 ` thomas62186218
2008-08-28 9:49 ` Bernd Schubert
2008-08-28 10:07 ` Peter Rabbitson
[not found] ` <9b4ac8ccbe69d232ff2d77fd4e3590c2.squirrel@neil.brown.name>
2008-08-29 5:47 ` thomas62186218
2008-08-29 6:01 ` NeilBrown
2008-09-16 9:37 ` thomas62186218
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).