* No md superblock immediately after creating RAID 5 /dev/md0
@ 2008-08-28 8:32 thomas62186218
2008-08-28 9:17 ` Andrew Farley
` (3 more replies)
0 siblings, 4 replies; 8+ messages in thread
From: thomas62186218 @ 2008-08-28 8:32 UTC (permalink / raw)
To: linux-raid, thomas62186218
Hi all,
I am struggling with an issue on an Ubuntu 8.0.4 64-bit system. The
system has 12 SATA drives. I create a RAID 5 array using mdadm as
follows:
mdadm -Cv /dev/md0 -n12 -l5 -c128 /dev/sd[b-m] -R -f
The device creates successfully and starts and is visible as syncing in
cat /proc/mdstat. But, according to mdadm -X /dev/md0, there is no md
superblock on the device. Doing the same mdadm -X command for all
components /dev/sdb through /dev/sdm shows superblocks. If I reboot the
system, /dev/md0 is completely gone, and a mdadm --assemble --scan
produces no results. I've also tried creating the md with Version 1 and
1.2 superblocks, but the same problem occurs. Below is complete output.
Thank you for your assistance on this strange issue!
Best,
Thomas
root@localhost:~# cat /proc/mdstat
Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5]
[raid4] [ra id10]
md0 : active raid5 sdm1[11](S) sdl1[10] sdk1[9] sdj1[8] sdi1[7] sdh1[6]
sdg1[5] sdf1[4] sde1[3] sdd1[2] sdc1[1] sdb1[0]
4883839360 blocks level 5, 16k chunk, algorithm 2 [11/11]
[UUUUUUUUUUU]
[>....................] resync = 0.6% (3207984/488383936)
finish=158.8mi n speed=50916K/sec
unused devices: <none>
root@localhost:~# pvs
PV VG Fmt Attr PSize PFree
/dev/md0 raid5test lvm2 a- 4.55T 4.55T
root@localhost:~# cat /etc/mdadm.conf
DEVICE /dev/sd*
ARRAY /dev/md0 level=raid5 num-devices=12
UUID=9f962f09:2d47f553:417df021:0032bb 18
root@localhost:~# reboot
Broadcast message from root@localhost
(/dev/pts/0) at 9:35 ...
The system is going down for reboot NOW!
root@localhost:~#
login as: root
root@192.168.0.70's password:
Last login: Thu Aug 28 09:28:34 2008 from 192.168.0.114
root@localhost:~# cat /proc/mdstat
Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5]
[raid4] [ra id10]
unused devices: <none>
root@localhost:~# mdadm --assemble --scan
mdadm: no devices found for /dev/md0
root@localhost:~# mdadm --query /dev/md0
/dev/md0: is an md device which is not active
root@localhost:/var/log# mdadm --examine /dev/sdb1
/dev/sdb1:
Magic : a92b4efc
Version : 00.90.00
UUID : 9f962f09:2d47f553:417df021:0032bb18
Creation Time : Thu Aug 28 09:33:49 2008
Raid Level : raid5
Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
Raid Devices : 11
Total Devices : 12
Preferred Minor : 0
Update Time : Thu Aug 28 09:36:07 2008
State : active
Active Devices : 11
Working Devices : 12
Failed Devices : 0
Spare Devices : 1
Checksum : 670c7e62 - correct
Events : 5
Layout : left-symmetric
Chunk Size : 16K
Number Major Minor RaidDevice State
this 0 8 17 0 active sync /dev/sdb1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 active sync /dev/sdi1
8 8 8 145 8 active sync /dev/sdj1
9 9 8 161 9 active sync /dev/sdk1
10 10 8 177 10 active sync /dev/sdl1
11 11 8 193 11 spare /dev/sdm1
root@localhost:/var/log# mdadm --examine /dev/sdc1
/dev/sdc1:
Magic : a92b4efc
Version : 00.90.00
UUID : 9f962f09:2d47f553:417df021:0032bb18
Creation Time : Thu Aug 28 09:33:49 2008
Raid Level : raid5
Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
Raid Devices : 11
Total Devices : 12
Preferred Minor : 0
Update Time : Thu Aug 28 09:36:07 2008
State : active
Active Devices : 11
Working Devices : 12
Failed Devices : 0
Spare Devices : 1
Checksum : 670c7e74 - correct
Events : 5
Layout : left-symmetric
Chunk Size : 16K
Number Major Minor RaidDevice State
this 1 8 33 1 active sync /dev/sdc1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 active sync /dev/sdi1
8 8 8 145 8 active sync /dev/sdj1
9 9 8 161 9 active sync /dev/sdk1
10 10 8 177 10 active sync /dev/sdl1
11 11 8 193 11 spare /dev/sdm1
root@localhost:/var/log# mdadm --examine /dev/sdd1
/dev/sdd1:
Magic : a92b4efc
Version : 00.90.00
UUID : 9f962f09:2d47f553:417df021:0032bb18
Creation Time : Thu Aug 28 09:33:49 2008
Raid Level : raid5
Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
Raid Devices : 11
Total Devices : 12
Preferred Minor : 0
Update Time : Thu Aug 28 09:36:07 2008
State : active
Active Devices : 11
Working Devices : 12
Failed Devices : 0
Spare Devices : 1
Checksum : 670c7e86 - correct
Events : 5
Layout : left-symmetric
Chunk Size : 16K
Number Major Minor RaidDevice State
this 2 8 49 2 active sync /dev/sdd1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 active sync /dev/sdi1
8 8 8 145 8 active sync /dev/sdj1
9 9 8 161 9 active sync /dev/sdk1
10 10 8 177 10 active sync /dev/sdl1
11 11 8 193 11 spare /dev/sdm1
root@localhost:/var/log# mdadm --examine /dev/sde1
/dev/sde1:
Magic : a92b4efc
Version : 00.90.00
UUID : 9f962f09:2d47f553:417df021:0032bb18
Creation Time : Thu Aug 28 09:33:49 2008
Raid Level : raid5
Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
Raid Devices : 11
Total Devices : 12
Preferred Minor : 0
Update Time : Thu Aug 28 09:36:07 2008
State : active
Active Devices : 11
Working Devices : 12
Failed Devices : 0
Spare Devices : 1
Checksum : 670c7e98 - correct
Events : 5
Layout : left-symmetric
Chunk Size : 16K
Number Major Minor RaidDevice State
this 3 8 65 3 active sync /dev/sde1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 active sync /dev/sdi1
8 8 8 145 8 active sync /dev/sdj1
9 9 8 161 9 active sync /dev/sdk1
10 10 8 177 10 active sync /dev/sdl1
11 11 8 193 11 spare /dev/sdm1
root@localhost:/var/log# mdadm --examine /dev/sdf1
/dev/sdf1:
Magic : a92b4efc
Version : 00.90.00
UUID : 9f962f09:2d47f553:417df021:0032bb18
Creation Time : Thu Aug 28 09:33:49 2008
Raid Level : raid5
Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
Raid Devices : 11
Total Devices : 12
Preferred Minor : 0
Update Time : Thu Aug 28 09:36:07 2008
State : active
Active Devices : 11
Working Devices : 12
Failed Devices : 0
Spare Devices : 1
Checksum : 670c7eaa - correct
Events : 5
Layout : left-symmetric
Chunk Size : 16K
Number Major Minor RaidDevice State
this 4 8 81 4 active sync /dev/sdf1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 active sync /dev/sdi1
8 8 8 145 8 active sync /dev/sdj1
9 9 8 161 9 active sync /dev/sdk1
10 10 8 177 10 active sync /dev/sdl1
11 11 8 193 11 spare /dev/sdm1
root@localhost:/var/log# mdadm --examine /dev/sdg1
/dev/sdg1:
Magic : a92b4efc
Version : 00.90.00
UUID : 9f962f09:2d47f553:417df021:0032bb18
Creation Time : Thu Aug 28 09:33:49 2008
Raid Level : raid5
Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
Raid Devices : 11
Total Devices : 12
Preferred Minor : 0
Update Time : Thu Aug 28 09:36:07 2008
State : active
Active Devices : 11
Working Devices : 12
Failed Devices : 0
Spare Devices : 1
Checksum : 670c7ebc - correct
Events : 5
Layout : left-symmetric
Chunk Size : 16K
Number Major Minor RaidDevice State
this 5 8 97 5 active sync /dev/sdg1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 active sync /dev/sdi1
8 8 8 145 8 active sync /dev/sdj1
9 9 8 161 9 active sync /dev/sdk1
10 10 8 177 10 active sync /dev/sdl1
11 11 8 193 11 spare /dev/sdm1
root@localhost:/var/log# mdadm --examine /dev/sdh1
/dev/sdh1:
Magic : a92b4efc
Version : 00.90.00
UUID : 9f962f09:2d47f553:417df021:0032bb18
Creation Time : Thu Aug 28 09:33:49 2008
Raid Level : raid5
Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
Raid Devices : 11
Total Devices : 12
Preferred Minor : 0
Update Time : Thu Aug 28 09:36:07 2008
State : active
Active Devices : 11
Working Devices : 12
Failed Devices : 0
Spare Devices : 1
Checksum : 670c7ece - correct
Events : 5
Layout : left-symmetric
Chunk Size : 16K
Number Major Minor RaidDevice State
this 6 8 113 6 active sync /dev/sdh1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 active sync /dev/sdi1
8 8 8 145 8 active sync /dev/sdj1
9 9 8 161 9 active sync /dev/sdk1
10 10 8 177 10 active sync /dev/sdl1
11 11 8 193 11 spare /dev/sdm1
root@localhost:/var/log# mdadm --examine /dev/sdi1
/dev/sdi1:
Magic : a92b4efc
Version : 00.90.00
UUID : 9f962f09:2d47f553:417df021:0032bb18
Creation Time : Thu Aug 28 09:33:49 2008
Raid Level : raid5
Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
Raid Devices : 11
Total Devices : 12
Preferred Minor : 0
Update Time : Thu Aug 28 09:36:07 2008
State : active
Active Devices : 11
Working Devices : 12
Failed Devices : 0
Spare Devices : 1
Checksum : 670c7ee0 - correct
Events : 5
Layout : left-symmetric
Chunk Size : 16K
Number Major Minor RaidDevice State
this 7 8 129 7 active sync /dev/sdi1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 active sync /dev/sdi1
8 8 8 145 8 active sync /dev/sdj1
9 9 8 161 9 active sync /dev/sdk1
10 10 8 177 10 active sync /dev/sdl1
11 11 8 193 11 spare /dev/sdm1
root@localhost:/var/log# mdadm --examine /dev/sdj1
/dev/sdj1:
Magic : a92b4efc
Version : 00.90.00
UUID : 9f962f09:2d47f553:417df021:0032bb18
Creation Time : Thu Aug 28 09:33:49 2008
Raid Level : raid5
Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
Raid Devices : 11
Total Devices : 12
Preferred Minor : 0
Update Time : Thu Aug 28 09:36:07 2008
State : active
Active Devices : 11
Working Devices : 12
Failed Devices : 0
Spare Devices : 1
Checksum : 670c7ef2 - correct
Events : 5
Layout : left-symmetric
Chunk Size : 16K
Number Major Minor RaidDevice State
this 8 8 145 8 active sync /dev/sdj1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 active sync /dev/sdi1
8 8 8 145 8 active sync /dev/sdj1
9 9 8 161 9 active sync /dev/sdk1
10 10 8 177 10 active sync /dev/sdl1
11 11 8 193 11 spare /dev/sdm1
root@localhost:/var/log# mdadm --examine /dev/sdk1
/dev/sdk1:
Magic : a92b4efc
Version : 00.90.00
UUID : 9f962f09:2d47f553:417df021:0032bb18
Creation Time : Thu Aug 28 09:33:49 2008
Raid Level : raid5
Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
Raid Devices : 11
Total Devices : 12
Preferred Minor : 0
Update Time : Thu Aug 28 09:36:07 2008
State : active
Active Devices : 11
Working Devices : 12
Failed Devices : 0
Spare Devices : 1
Checksum : 670c7f04 - correct
Events : 5
Layout : left-symmetric
Chunk Size : 16K
Number Major Minor RaidDevice State
this 9 8 161 9 active sync /dev/sdk1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 active sync /dev/sdi1
8 8 8 145 8 active sync /dev/sdj1
9 9 8 161 9 active sync /dev/sdk1
10 10 8 177 10 active sync /dev/sdl1
11 11 8 193 11 spare /dev/sdm1
root@localhost:/var/log# mdadm --examine /dev/sdl1
/dev/sdl1:
Magic : a92b4efc
Version : 00.90.00
UUID : 9f962f09:2d47f553:417df021:0032bb18
Creation Time : Thu Aug 28 09:33:49 2008
Raid Level : raid5
Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
Raid Devices : 11
Total Devices : 12
Preferred Minor : 0
Update Time : Thu Aug 28 09:36:07 2008
State : active
Active Devices : 11
Working Devices : 12
Failed Devices : 0
Spare Devices : 1
Checksum : 670c7f16 - correct
Events : 5
Layout : left-symmetric
Chunk Size : 16K
Number Major Minor RaidDevice State
this 10 8 177 10 active sync /dev/sdl1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 active sync /dev/sdi1
8 8 8 145 8 active sync /dev/sdj1
9 9 8 161 9 active sync /dev/sdk1
10 10 8 177 10 active sync /dev/sdl1
11 11 8 193 11 spare /dev/sdm1
root@localhost:/var/log# mdadm --examine /dev/sdm1
/dev/sdm1:
Magic : a92b4efc
Version : 00.90.00
UUID : 9f962f09:2d47f553:417df021:0032bb18
Creation Time : Thu Aug 28 09:33:49 2008
Raid Level : raid5
Used Dev Size : 488383936 (465.76 GiB 500.11 GB)
Array Size : 4883839360 (4657.59 GiB 5001.05 GB)
Raid Devices : 11
Total Devices : 12
Preferred Minor : 0
Update Time : Thu Aug 28 09:36:07 2008
State : active
Active Devices : 11
Working Devices : 12
Failed Devices : 0
Spare Devices : 1
Checksum : 670c7f22 - correct
Events : 5
Layout : left-symmetric
Chunk Size : 16K
Number Major Minor RaidDevice State
this 11 8 193 11 spare /dev/sdm1
0 0 8 17 0 active sync /dev/sdb1
1 1 8 33 1 active sync /dev/sdc1
2 2 8 49 2 active sync /dev/sdd1
3 3 8 65 3 active sync /dev/sde1
4 4 8 81 4 active sync /dev/sdf1
5 5 8 97 5 active sync /dev/sdg1
6 6 8 113 6 active sync /dev/sdh1
7 7 8 129 7 active sync /dev/sdi1
8 8 8 145 8 active sync /dev/sdj1
9 9 8 161 9 active sync /dev/sdk1
10 10 8 177 10 active sync /dev/sdl1
11 11 8 193 11 spare /dev/sdm1
root@localhost:/var/log# mdadm --examine /dev/md0
mdadm: No md superblock detected on /dev/md0.
root@localhost:/var/log# mdadm --detail /dev/md0
mdadm: md device /dev/md0 does not appear to be active.
root@localhost:/var/log# cat /etc/mdadm.conf
DEVICE /dev/sd*
ARRAY /dev/md0 level=raid5 num-devices=12
UUID=9f962f09:2d47f553:417df021:0032bb18
root@localhost:/var/log# mdadm --query /dev/md0
/dev/md0: is an md device which is not active
root@localhost:/var/log# mdadm --assemble --scan
mdadm: no devices found for /dev/md0
root@localhost:/var/log# mdadm -X /dev/md0
mdadm: failed to read superblock of bitmap file: No such device
root@localhost:/var/log# mdadm -E /dev/md0
mdadm: No md superblock detected on /dev/md0.
^ permalink raw reply [flat|nested] 8+ messages in thread* Re: No md superblock immediately after creating RAID 5 /dev/md0 2008-08-28 8:32 No md superblock immediately after creating RAID 5 /dev/md0 thomas62186218 @ 2008-08-28 9:17 ` Andrew Farley 2008-08-29 5:31 ` thomas62186218 2008-08-28 9:49 ` Bernd Schubert ` (2 subsequent siblings) 3 siblings, 1 reply; 8+ messages in thread From: Andrew Farley @ 2008-08-28 9:17 UTC (permalink / raw) To: thomas62186218; +Cc: linux-raid Thomas, I have seen this happen to me before when your kernel doesn't have large block device support (CONFIG_LBD). I still forget it sometimes in between making large file servers and seem to waste time every time figuring it out. See here: http://www.suse.de/~aj/linux_lfs.html Check if it's compiled into your kernel if you compiled it yourself by looking for CONFIG_LBD=y in /usr/src/linux/.config or if it's supported in your kernel extract from and search in /proc/config.gz. If it's not in there go recompile your kernel to support LBD. Cheers, Farley On Aug 28, 2008, at 1:32 AM, thomas62186218@aol.com wrote: > Hi all, > > I am struggling with an issue on an Ubuntu 8.0.4 64-bit system. The > system has 12 SATA drives. I create a RAID 5 array using mdadm as > follows: > > mdadm -Cv /dev/md0 -n12 -l5 -c128 /dev/sd[b-m] -R -f > > The device creates successfully and starts and is visible as syncing > in cat /proc/mdstat. But, according to mdadm -X /dev/md0, there is > no md superblock on the device. Doing the same mdadm -X command for > all components /dev/sdb through /dev/sdm shows superblocks. If I > reboot the system, /dev/md0 is completely gone, and a mdadm -- > assemble --scan produces no results. I've also tried creating the md > with Version 1 and 1.2 superblocks, but the same problem occurs. > Below is complete output. > > Thank you for your assistance on this strange issue! > > Best, > Thomas > > > root@localhost:~# cat /proc/mdstat > Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5] > [raid4] [ra id10] > md0 : active raid5 sdm1[11](S) sdl1[10] sdk1[9] sdj1[8] sdi1[7] > sdh1[6] sdg1[5] sdf1[4] sde1[3] sdd1[2] sdc1[1] sdb1[0] > 4883839360 blocks level 5, 16k chunk, algorithm 2 [11/11] > [UUUUUUUUUUU] > [>....................] resync = 0.6% (3207984/488383936) > finish=158.8mi n speed=50916K/sec > > unused devices: <none> > > root@localhost:~# pvs > PV VG Fmt Attr PSize PFree > /dev/md0 raid5test lvm2 a- 4.55T 4.55T > > root@localhost:~# cat /etc/mdadm.conf > DEVICE /dev/sd* > ARRAY /dev/md0 level=raid5 num-devices=12 > UUID=9f962f09:2d47f553:417df021:0032bb 18 > > root@localhost:~# reboot > > Broadcast message from root@localhost > (/dev/pts/0) at 9:35 ... > > The system is going down for reboot NOW! > > root@localhost:~# > login as: root > root@192.168.0.70's password: > Last login: Thu Aug 28 09:28:34 2008 from 192.168.0.114 > > > root@localhost:~# cat /proc/mdstat > Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5] > [raid4] [ra id10] > unused devices: <none> > > > root@localhost:~# mdadm --assemble --scan > mdadm: no devices found for /dev/md0 > > root@localhost:~# mdadm --query /dev/md0 > /dev/md0: is an md device which is not active > > root@localhost:/var/log# mdadm --examine /dev/sdb1 > /dev/sdb1: > Magic : a92b4efc > Version : 00.90.00 > UUID : 9f962f09:2d47f553:417df021:0032bb18 > Creation Time : Thu Aug 28 09:33:49 2008 > Raid Level : raid5 > Used Dev Size : 488383936 (465.76 GiB 500.11 GB) > Array Size : 4883839360 (4657.59 GiB 5001.05 GB) > Raid Devices : 11 > Total Devices : 12 > Preferred Minor : 0 > > Update Time : Thu Aug 28 09:36:07 2008 > State : active > Active Devices : 11 > Working Devices : 12 > Failed Devices : 0 > Spare Devices : 1 > Checksum : 670c7e62 - correct > Events : 5 > > Layout : left-symmetric > Chunk Size : 16K > > Number Major Minor RaidDevice State > this 0 8 17 0 active sync /dev/sdb1 > > 0 0 8 17 0 active sync /dev/sdb1 > 1 1 8 33 1 active sync /dev/sdc1 > 2 2 8 49 2 active sync /dev/sdd1 > 3 3 8 65 3 active sync /dev/sde1 > 4 4 8 81 4 active sync /dev/sdf1 > 5 5 8 97 5 active sync /dev/sdg1 > 6 6 8 113 6 active sync /dev/sdh1 > 7 7 8 129 7 active sync /dev/sdi1 > 8 8 8 145 8 active sync /dev/sdj1 > 9 9 8 161 9 active sync /dev/sdk1 > 10 10 8 177 10 active sync /dev/sdl1 > 11 11 8 193 11 spare /dev/sdm1 > > root@localhost:/var/log# mdadm --examine /dev/sdc1 > /dev/sdc1: > Magic : a92b4efc > Version : 00.90.00 > UUID : 9f962f09:2d47f553:417df021:0032bb18 > Creation Time : Thu Aug 28 09:33:49 2008 > Raid Level : raid5 > Used Dev Size : 488383936 (465.76 GiB 500.11 GB) > Array Size : 4883839360 (4657.59 GiB 5001.05 GB) > Raid Devices : 11 > Total Devices : 12 > Preferred Minor : 0 > > Update Time : Thu Aug 28 09:36:07 2008 > State : active > Active Devices : 11 > Working Devices : 12 > Failed Devices : 0 > Spare Devices : 1 > Checksum : 670c7e74 - correct > Events : 5 > > Layout : left-symmetric > Chunk Size : 16K > > Number Major Minor RaidDevice State > this 1 8 33 1 active sync /dev/sdc1 > > 0 0 8 17 0 active sync /dev/sdb1 > 1 1 8 33 1 active sync /dev/sdc1 > 2 2 8 49 2 active sync /dev/sdd1 > 3 3 8 65 3 active sync /dev/sde1 > 4 4 8 81 4 active sync /dev/sdf1 > 5 5 8 97 5 active sync /dev/sdg1 > 6 6 8 113 6 active sync /dev/sdh1 > 7 7 8 129 7 active sync /dev/sdi1 > 8 8 8 145 8 active sync /dev/sdj1 > 9 9 8 161 9 active sync /dev/sdk1 > 10 10 8 177 10 active sync /dev/sdl1 > 11 11 8 193 11 spare /dev/sdm1 > > root@localhost:/var/log# mdadm --examine /dev/sdd1 > /dev/sdd1: > Magic : a92b4efc > Version : 00.90.00 > UUID : 9f962f09:2d47f553:417df021:0032bb18 > Creation Time : Thu Aug 28 09:33:49 2008 > Raid Level : raid5 > Used Dev Size : 488383936 (465.76 GiB 500.11 GB) > Array Size : 4883839360 (4657.59 GiB 5001.05 GB) > Raid Devices : 11 > Total Devices : 12 > Preferred Minor : 0 > > Update Time : Thu Aug 28 09:36:07 2008 > State : active > Active Devices : 11 > Working Devices : 12 > Failed Devices : 0 > Spare Devices : 1 > Checksum : 670c7e86 - correct > Events : 5 > > Layout : left-symmetric > Chunk Size : 16K > > Number Major Minor RaidDevice State > this 2 8 49 2 active sync /dev/sdd1 > > 0 0 8 17 0 active sync /dev/sdb1 > 1 1 8 33 1 active sync /dev/sdc1 > 2 2 8 49 2 active sync /dev/sdd1 > 3 3 8 65 3 active sync /dev/sde1 > 4 4 8 81 4 active sync /dev/sdf1 > 5 5 8 97 5 active sync /dev/sdg1 > 6 6 8 113 6 active sync /dev/sdh1 > 7 7 8 129 7 active sync /dev/sdi1 > 8 8 8 145 8 active sync /dev/sdj1 > 9 9 8 161 9 active sync /dev/sdk1 > 10 10 8 177 10 active sync /dev/sdl1 > 11 11 8 193 11 spare /dev/sdm1 > > root@localhost:/var/log# mdadm --examine /dev/sde1 > /dev/sde1: > Magic : a92b4efc > Version : 00.90.00 > UUID : 9f962f09:2d47f553:417df021:0032bb18 > Creation Time : Thu Aug 28 09:33:49 2008 > Raid Level : raid5 > Used Dev Size : 488383936 (465.76 GiB 500.11 GB) > Array Size : 4883839360 (4657.59 GiB 5001.05 GB) > Raid Devices : 11 > Total Devices : 12 > Preferred Minor : 0 > > Update Time : Thu Aug 28 09:36:07 2008 > State : active > Active Devices : 11 > Working Devices : 12 > Failed Devices : 0 > Spare Devices : 1 > Checksum : 670c7e98 - correct > Events : 5 > > Layout : left-symmetric > Chunk Size : 16K > > Number Major Minor RaidDevice State > this 3 8 65 3 active sync /dev/sde1 > > 0 0 8 17 0 active sync /dev/sdb1 > 1 1 8 33 1 active sync /dev/sdc1 > 2 2 8 49 2 active sync /dev/sdd1 > 3 3 8 65 3 active sync /dev/sde1 > 4 4 8 81 4 active sync /dev/sdf1 > 5 5 8 97 5 active sync /dev/sdg1 > 6 6 8 113 6 active sync /dev/sdh1 > 7 7 8 129 7 active sync /dev/sdi1 > 8 8 8 145 8 active sync /dev/sdj1 > 9 9 8 161 9 active sync /dev/sdk1 > 10 10 8 177 10 active sync /dev/sdl1 > 11 11 8 193 11 spare /dev/sdm1 > > root@localhost:/var/log# mdadm --examine /dev/sdf1 > /dev/sdf1: > Magic : a92b4efc > Version : 00.90.00 > UUID : 9f962f09:2d47f553:417df021:0032bb18 > Creation Time : Thu Aug 28 09:33:49 2008 > Raid Level : raid5 > Used Dev Size : 488383936 (465.76 GiB 500.11 GB) > Array Size : 4883839360 (4657.59 GiB 5001.05 GB) > Raid Devices : 11 > Total Devices : 12 > Preferred Minor : 0 > > Update Time : Thu Aug 28 09:36:07 2008 > State : active > Active Devices : 11 > Working Devices : 12 > Failed Devices : 0 > Spare Devices : 1 > Checksum : 670c7eaa - correct > Events : 5 > > Layout : left-symmetric > Chunk Size : 16K > > Number Major Minor RaidDevice State > this 4 8 81 4 active sync /dev/sdf1 > > 0 0 8 17 0 active sync /dev/sdb1 > 1 1 8 33 1 active sync /dev/sdc1 > 2 2 8 49 2 active sync /dev/sdd1 > 3 3 8 65 3 active sync /dev/sde1 > 4 4 8 81 4 active sync /dev/sdf1 > 5 5 8 97 5 active sync /dev/sdg1 > 6 6 8 113 6 active sync /dev/sdh1 > 7 7 8 129 7 active sync /dev/sdi1 > 8 8 8 145 8 active sync /dev/sdj1 > 9 9 8 161 9 active sync /dev/sdk1 > 10 10 8 177 10 active sync /dev/sdl1 > 11 11 8 193 11 spare /dev/sdm1 > > root@localhost:/var/log# mdadm --examine /dev/sdg1 > /dev/sdg1: > Magic : a92b4efc > Version : 00.90.00 > UUID : 9f962f09:2d47f553:417df021:0032bb18 > Creation Time : Thu Aug 28 09:33:49 2008 > Raid Level : raid5 > Used Dev Size : 488383936 (465.76 GiB 500.11 GB) > Array Size : 4883839360 (4657.59 GiB 5001.05 GB) > Raid Devices : 11 > Total Devices : 12 > Preferred Minor : 0 > > Update Time : Thu Aug 28 09:36:07 2008 > State : active > Active Devices : 11 > Working Devices : 12 > Failed Devices : 0 > Spare Devices : 1 > Checksum : 670c7ebc - correct > Events : 5 > > Layout : left-symmetric > Chunk Size : 16K > > Number Major Minor RaidDevice State > this 5 8 97 5 active sync /dev/sdg1 > > 0 0 8 17 0 active sync /dev/sdb1 > 1 1 8 33 1 active sync /dev/sdc1 > 2 2 8 49 2 active sync /dev/sdd1 > 3 3 8 65 3 active sync /dev/sde1 > 4 4 8 81 4 active sync /dev/sdf1 > 5 5 8 97 5 active sync /dev/sdg1 > 6 6 8 113 6 active sync /dev/sdh1 > 7 7 8 129 7 active sync /dev/sdi1 > 8 8 8 145 8 active sync /dev/sdj1 > 9 9 8 161 9 active sync /dev/sdk1 > 10 10 8 177 10 active sync /dev/sdl1 > 11 11 8 193 11 spare /dev/sdm1 > > root@localhost:/var/log# mdadm --examine /dev/sdh1 > /dev/sdh1: > Magic : a92b4efc > Version : 00.90.00 > UUID : 9f962f09:2d47f553:417df021:0032bb18 > Creation Time : Thu Aug 28 09:33:49 2008 > Raid Level : raid5 > Used Dev Size : 488383936 (465.76 GiB 500.11 GB) > Array Size : 4883839360 (4657.59 GiB 5001.05 GB) > Raid Devices : 11 > Total Devices : 12 > Preferred Minor : 0 > > Update Time : Thu Aug 28 09:36:07 2008 > State : active > Active Devices : 11 > Working Devices : 12 > Failed Devices : 0 > Spare Devices : 1 > Checksum : 670c7ece - correct > Events : 5 > > Layout : left-symmetric > Chunk Size : 16K > > Number Major Minor RaidDevice State > this 6 8 113 6 active sync /dev/sdh1 > > 0 0 8 17 0 active sync /dev/sdb1 > 1 1 8 33 1 active sync /dev/sdc1 > 2 2 8 49 2 active sync /dev/sdd1 > 3 3 8 65 3 active sync /dev/sde1 > 4 4 8 81 4 active sync /dev/sdf1 > 5 5 8 97 5 active sync /dev/sdg1 > 6 6 8 113 6 active sync /dev/sdh1 > 7 7 8 129 7 active sync /dev/sdi1 > 8 8 8 145 8 active sync /dev/sdj1 > 9 9 8 161 9 active sync /dev/sdk1 > 10 10 8 177 10 active sync /dev/sdl1 > 11 11 8 193 11 spare /dev/sdm1 > > root@localhost:/var/log# mdadm --examine /dev/sdi1 > /dev/sdi1: > Magic : a92b4efc > Version : 00.90.00 > UUID : 9f962f09:2d47f553:417df021:0032bb18 > Creation Time : Thu Aug 28 09:33:49 2008 > Raid Level : raid5 > Used Dev Size : 488383936 (465.76 GiB 500.11 GB) > Array Size : 4883839360 (4657.59 GiB 5001.05 GB) > Raid Devices : 11 > Total Devices : 12 > Preferred Minor : 0 > > Update Time : Thu Aug 28 09:36:07 2008 > State : active > Active Devices : 11 > Working Devices : 12 > Failed Devices : 0 > Spare Devices : 1 > Checksum : 670c7ee0 - correct > Events : 5 > > Layout : left-symmetric > Chunk Size : 16K > > Number Major Minor RaidDevice State > this 7 8 129 7 active sync /dev/sdi1 > > 0 0 8 17 0 active sync /dev/sdb1 > 1 1 8 33 1 active sync /dev/sdc1 > 2 2 8 49 2 active sync /dev/sdd1 > 3 3 8 65 3 active sync /dev/sde1 > 4 4 8 81 4 active sync /dev/sdf1 > 5 5 8 97 5 active sync /dev/sdg1 > 6 6 8 113 6 active sync /dev/sdh1 > 7 7 8 129 7 active sync /dev/sdi1 > 8 8 8 145 8 active sync /dev/sdj1 > 9 9 8 161 9 active sync /dev/sdk1 > 10 10 8 177 10 active sync /dev/sdl1 > 11 11 8 193 11 spare /dev/sdm1 > > root@localhost:/var/log# mdadm --examine /dev/sdj1 > /dev/sdj1: > Magic : a92b4efc > Version : 00.90.00 > UUID : 9f962f09:2d47f553:417df021:0032bb18 > Creation Time : Thu Aug 28 09:33:49 2008 > Raid Level : raid5 > Used Dev Size : 488383936 (465.76 GiB 500.11 GB) > Array Size : 4883839360 (4657.59 GiB 5001.05 GB) > Raid Devices : 11 > Total Devices : 12 > Preferred Minor : 0 > > Update Time : Thu Aug 28 09:36:07 2008 > State : active > Active Devices : 11 > Working Devices : 12 > Failed Devices : 0 > Spare Devices : 1 > Checksum : 670c7ef2 - correct > Events : 5 > > Layout : left-symmetric > Chunk Size : 16K > > Number Major Minor RaidDevice State > this 8 8 145 8 active sync /dev/sdj1 > > 0 0 8 17 0 active sync /dev/sdb1 > 1 1 8 33 1 active sync /dev/sdc1 > 2 2 8 49 2 active sync /dev/sdd1 > 3 3 8 65 3 active sync /dev/sde1 > 4 4 8 81 4 active sync /dev/sdf1 > 5 5 8 97 5 active sync /dev/sdg1 > 6 6 8 113 6 active sync /dev/sdh1 > 7 7 8 129 7 active sync /dev/sdi1 > 8 8 8 145 8 active sync /dev/sdj1 > 9 9 8 161 9 active sync /dev/sdk1 > 10 10 8 177 10 active sync /dev/sdl1 > 11 11 8 193 11 spare /dev/sdm1 > > root@localhost:/var/log# mdadm --examine /dev/sdk1 > /dev/sdk1: > Magic : a92b4efc > Version : 00.90.00 > UUID : 9f962f09:2d47f553:417df021:0032bb18 > Creation Time : Thu Aug 28 09:33:49 2008 > Raid Level : raid5 > Used Dev Size : 488383936 (465.76 GiB 500.11 GB) > Array Size : 4883839360 (4657.59 GiB 5001.05 GB) > Raid Devices : 11 > Total Devices : 12 > Preferred Minor : 0 > > Update Time : Thu Aug 28 09:36:07 2008 > State : active > Active Devices : 11 > Working Devices : 12 > Failed Devices : 0 > Spare Devices : 1 > Checksum : 670c7f04 - correct > Events : 5 > > Layout : left-symmetric > Chunk Size : 16K > > Number Major Minor RaidDevice State > this 9 8 161 9 active sync /dev/sdk1 > > 0 0 8 17 0 active sync /dev/sdb1 > 1 1 8 33 1 active sync /dev/sdc1 > 2 2 8 49 2 active sync /dev/sdd1 > 3 3 8 65 3 active sync /dev/sde1 > 4 4 8 81 4 active sync /dev/sdf1 > 5 5 8 97 5 active sync /dev/sdg1 > 6 6 8 113 6 active sync /dev/sdh1 > 7 7 8 129 7 active sync /dev/sdi1 > 8 8 8 145 8 active sync /dev/sdj1 > 9 9 8 161 9 active sync /dev/sdk1 > 10 10 8 177 10 active sync /dev/sdl1 > 11 11 8 193 11 spare /dev/sdm1 > > root@localhost:/var/log# mdadm --examine /dev/sdl1 > /dev/sdl1: > Magic : a92b4efc > Version : 00.90.00 > UUID : 9f962f09:2d47f553:417df021:0032bb18 > Creation Time : Thu Aug 28 09:33:49 2008 > Raid Level : raid5 > Used Dev Size : 488383936 (465.76 GiB 500.11 GB) > Array Size : 4883839360 (4657.59 GiB 5001.05 GB) > Raid Devices : 11 > Total Devices : 12 > Preferred Minor : 0 > > Update Time : Thu Aug 28 09:36:07 2008 > State : active > Active Devices : 11 > Working Devices : 12 > Failed Devices : 0 > Spare Devices : 1 > Checksum : 670c7f16 - correct > Events : 5 > > Layout : left-symmetric > Chunk Size : 16K > > Number Major Minor RaidDevice State > this 10 8 177 10 active sync /dev/sdl1 > > 0 0 8 17 0 active sync /dev/sdb1 > 1 1 8 33 1 active sync /dev/sdc1 > 2 2 8 49 2 active sync /dev/sdd1 > 3 3 8 65 3 active sync /dev/sde1 > 4 4 8 81 4 active sync /dev/sdf1 > 5 5 8 97 5 active sync /dev/sdg1 > 6 6 8 113 6 active sync /dev/sdh1 > 7 7 8 129 7 active sync /dev/sdi1 > 8 8 8 145 8 active sync /dev/sdj1 > 9 9 8 161 9 active sync /dev/sdk1 > 10 10 8 177 10 active sync /dev/sdl1 > 11 11 8 193 11 spare /dev/sdm1 > > root@localhost:/var/log# mdadm --examine /dev/sdm1 > /dev/sdm1: > Magic : a92b4efc > Version : 00.90.00 > UUID : 9f962f09:2d47f553:417df021:0032bb18 > Creation Time : Thu Aug 28 09:33:49 2008 > Raid Level : raid5 > Used Dev Size : 488383936 (465.76 GiB 500.11 GB) > Array Size : 4883839360 (4657.59 GiB 5001.05 GB) > Raid Devices : 11 > Total Devices : 12 > Preferred Minor : 0 > > Update Time : Thu Aug 28 09:36:07 2008 > State : active > Active Devices : 11 > Working Devices : 12 > Failed Devices : 0 > Spare Devices : 1 > Checksum : 670c7f22 - correct > Events : 5 > > Layout : left-symmetric > Chunk Size : 16K > > Number Major Minor RaidDevice State > this 11 8 193 11 spare /dev/sdm1 > > 0 0 8 17 0 active sync /dev/sdb1 > 1 1 8 33 1 active sync /dev/sdc1 > 2 2 8 49 2 active sync /dev/sdd1 > 3 3 8 65 3 active sync /dev/sde1 > 4 4 8 81 4 active sync /dev/sdf1 > 5 5 8 97 5 active sync /dev/sdg1 > 6 6 8 113 6 active sync /dev/sdh1 > 7 7 8 129 7 active sync /dev/sdi1 > 8 8 8 145 8 active sync /dev/sdj1 > 9 9 8 161 9 active sync /dev/sdk1 > 10 10 8 177 10 active sync /dev/sdl1 > 11 11 8 193 11 spare /dev/sdm1 > > root@localhost:/var/log# mdadm --examine /dev/md0 > mdadm: No md superblock detected on /dev/md0. > > root@localhost:/var/log# mdadm --detail /dev/md0 > mdadm: md device /dev/md0 does not appear to be active. > > root@localhost:/var/log# cat /etc/mdadm.conf > DEVICE /dev/sd* > ARRAY /dev/md0 level=raid5 num-devices=12 > UUID=9f962f09:2d47f553:417df021:0032bb18 > > root@localhost:/var/log# mdadm --query /dev/md0 > /dev/md0: is an md device which is not active > > root@localhost:/var/log# mdadm --assemble --scan > mdadm: no devices found for /dev/md0 > > root@localhost:/var/log# mdadm -X /dev/md0 > mdadm: failed to read superblock of bitmap file: No such device > > root@localhost:/var/log# mdadm -E /dev/md0 > mdadm: No md superblock detected on /dev/md0. > > > -- > To unsubscribe from this list: send the line "unsubscribe linux- > raid" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: No md superblock immediately after creating RAID 5 /dev/md0 2008-08-28 9:17 ` Andrew Farley @ 2008-08-29 5:31 ` thomas62186218 0 siblings, 0 replies; 8+ messages in thread From: thomas62186218 @ 2008-08-29 5:31 UTC (permalink / raw) To: andrew; +Cc: linux-raid Hi Andrew, Thanks for the feedback but I am running Ubuntu 64-bit, and with 64-bit OSes, CONFIG_LBD is not a configurable option (it is always enabled). -Thomas -----Original Message----- From: Andrew Farley <andrew@neonsurge.com> To: thomas62186218@aol.com Cc: linux-raid@vger.kernel.org Sent: Thu, 28 Aug 2008 2:17 am Subject: Re: No md superblock immediately after creating RAID 5 /dev/md0 Thomas, I have seen this happen to me before when your kernel doesn't have large block device support (CONFIG_LBD). I still forget it sometimes in between making large file servers and seem to waste time every time figuring it out. See here: http://www.suse.de/~aj/linux_lfs.html Check if it's compiled into your kernel if you compiled it yourself by looking for CONFIG_LBD=y in /usr/src/linux/.config or if it's supported in your kernel extract from and search in /proc/config.gz. If it's not in there go recompile your kernel to support LBD. Cheers, Farley On Aug 28, 2008, at 1:32 AM, thomas62186218@aol.com wrote: > Hi all, > > I am struggling with an issue on an Ubuntu 8.0.4 64-bit system. The > system has 12 SATA drives. I create a RAID 5 array using mdadm as > follows: > > mdadm -Cv /dev/md0 -n12 -l5 -c128 /dev/sd[b-m] -R -f > > The device creates successfully and starts and is visible as syncing > in cat /proc/mdstat. But, according to mdadm -X /dev/md0, there is > no md superblock on the device. Doing the same mdadm -X command for > all components /dev/sdb through /dev/sdm shows superblocks. If I > reboot the system, /dev/md0 is completely gone, and a mdadm --> assemble --scan produces no results. I've also tried creating the md > with Version 1 and 1.2 superblocks, but the same problem occurs. > Below is complete output. > > Thank you for your assistance on this strange issue! > > Best, > Thomas > > > root@localhost:~# cat /proc/mdstat > Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5] > [raid4] [ra id10] > md0 : active raid5 sdm1[11](S) sdl1[10] sdk1[9] sdj1[8] sdi1[7] > sdh1[6] sdg1[5] sdf1[4] sde1[3] sdd1[2] sdc1[1] sdb1[0] > 4883839360 blocks level 5, 16k chunk, algorithm 2 [11/11] > [UUUUUUUUUUU] > [>....................] resync = 0.6% (3207984/488383936) > finish=158.8mi n speed=50916K/sec > > unused devices: <none> > > root@localhost:~# pvs > PV VG Fmt Attr PSize PFree > /dev/md0 raid5test lvm2 a-20 4.55T 4.55T > > root@localhost:~# cat /etc/mdadm.conf > DEVICE /dev/sd* > ARRAY /dev/md0 level=raid5 num-devices=12 > UUID=9f962f09:2d47f553:417df021:0032bb 18 > > root@localhost:~# reboot > > Broadcast message from root@localhost > (/dev/pts/0) at 9:35 ... > > The system is going down for reboot NOW! > > root@localhost:~# > login as: root > root@192.168.0.70's password: > Last login: Thu Aug 28 09:28:34 2008 from 192.168.0.114 > > > root@localhost:~# cat /proc/mdstat > Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5] > [raid4] [ra id10] > unused devices: <none> > > > root@localhost:~# mdadm --assemble --scan > mdadm: no devices found for /dev/md0 > > root@localhost:~# mdadm --query /dev/md0 > /dev/md0: is an md device which is not active > > root@localhost:/var/log# mdadm --examine /dev/sdb1 > /dev/sdb1: > Magic : a92b4efc > Version : 00.90.00 > UUID : 9f962f09:2d47f553:417df021:0032bb18 > Creation Time : Thu Aug 28 09:33:49 2008 > Raid Level : raid5 > Used Dev Size : 488383936 (465.76 GiB 500.11 GB) > Array Size : 4883839360 (4657.59 GiB 5001.05 GB) > Raid Devices : 11 > Total Devices : 12 > Preferred Minor : 0 > > Update Time : Thu Aug 28 09:36:07 2008 > State : active > Active Devices : 11 > Working Devices : 12 > Failed Devices : 0 > Spare Devices : 1 > Checksum : 670c7e62 - correct > Events : 5 > > Layout : left-symmetric > Chunk Size : 16K > > Number Major Minor RaidDevice State > this 0 8 17 0 active sync /dev/sdb1 > > 0 0 8 17 0 active sync /dev/sdb1 > 1 1 8 33 1 active sync /dev/sdc1 > 2 2 8 49 2 active sync /dev/sdd1 > 3 3 8 65 3 active sync /dev/sde1 > 4 4 8 81 4 active sync /dev/sdf1 > 5 5 8 97 5 active sync /dev/sdg1 > 6 6 8 113 6 active sync /dev/sdh1 > 7 7 8 129 7 active sync /dev/sdi1 > 8 8 8 145 8 active sync /dev/sdj1 > 9 9 8 161 9 active sync /dev/sdk1 > 10 10 8 177 10 active sync /dev/sdl1 > 11 11 8 193 11 spare /dev/sdm1 > > root@localhost:/var/log# mdadm --examine /dev/sdc1 > /dev/sdc1: > Magic : a92b4efc > Version : 00.90.00 > UUID : 9f962f09:2d47f553:417df021:0032bb18 > Creation Time : Thu Aug 28 09:33:49 2008 > Raid Level : raid5 > Used Dev Size : 488383936 (465.76 GiB 500.11 GB) > Array Size : 4883839360 (4657.59 GiB 5001.05 GB) > Raid Devices : 11 > Total Devices : 12 > Preferred Minor : 0 > > Update Time : Thu Aug 28 09:36:07 2008 > State : active > Active Devices : 11 > Working Devices : 12 > Failed Devices : 0 > Spare Devices : 1 > Checksum : 670c7e74 - correct > Events : 5 > > Layout : left-symmetric > Chunk Size : 16K > > Number Major Minor RaidDevice State > this 1 8 33 1 active sync /dev/sdc1 > > 0 0 8 17 0 active sync /dev/sdb1 > 1 1 8 33 1 active sync /dev/sdc1 > 2 2 8 49 2 active sync /dev/sdd1 > 3 3 8 65 3 active sync /dev/sde1 > 4 4 8 81 4 active sync /dev/sdf1 > 5 5 8 97 5 active sync /dev/sdg1 > 6 6 8 113 6 active sync /dev/sdh1 > 7 7 8 129 7 active sync /dev/sdi1 > 8 8 8 145 8 active sync /dev/sdj1 > 9 9 8 161 9 active sync /dev/sdk1 > 10 10 8 177 10 active sync /dev/sdl1 > 11 11 8 193 11 spare /dev/sdm1 > > root@localhost:/var/log# mdadm --examine /dev/sdd1 > /dev/sdd1: > Magic : a92b4efc > Version : 00.90.00 > UUID : 9f962f09:2d47f553:417df021:0032bb18 > Creation Time : Thu Aug 28 09:33:49 2008 > Raid Level : raid5 > Used Dev Size : 488383936 (465.76 GiB 500.11 GB) > Array Size : 4883839360 (4657.59 GiB 5001.05 GB) > Raid Devices : 11 > Total Devices : 12 > Preferred Minor : 0 > > Update Time : Thu Aug 28 09:36:07 2008 > State : active > Active Devices : 11 > Working Devices : 12 > Failed Devices : 0 > Spare Devices : 1 > Checksum : 670c7e86 - correct > Events : 5 > > Layout : left-symmetric > Chunk Size : 16K > > Number Major Minor RaidDevice State > this 2 8 49 2 active sync /dev/sdd1 > > 0 0 8 17 0 active sync /dev/sdb1 > 1 1 8 33 1 active sync /dev/sdc1 > 2 2 8 49 2 active sync /dev/sdd1 > 3 3 8 65 3 active sync /dev/sde1 > 4 4 8 81 4 active sync /dev/sdf1 > 5 5 8 97 5 active sync /dev/sdg1 > 6 6 8 113 6 active sync /dev/sdh1 > 7 7 8 129 7 active sync /dev/sdi1 > 8 8 8 145 8 active sync /dev/sdj1 > 9 9 8 161 9 active sync /dev/sdk1 > 10 10 8 177 10 active sync /dev/sdl1 > 11 11 20 8 193 11 spare /dev/sdm1 > > root@localhost:/var/log# mdadm --examine /dev/sde1 > /dev/sde1: > Magic : a92b4efc > Version : 00.90.00 > UUID : 9f962f09:2d47f553:417df021:0032bb18 > Creation Time : Thu Aug 28 09:33:49 2008 > Raid Level : raid5 > Used Dev Size : 488383936 (465.76 GiB 500.11 GB) > Array Size : 4883839360 (4657.59 GiB 5001.05 GB) > Raid Devices : 11 > Total Devices : 12 > Preferred Minor : 0 > > Update Time : Thu Aug 28 09:36:07 2008 > State : active > Active Devices : 11 > Working Devices : 12 > Failed Devices : 0 > Spare Devices : 1 > Checksum : 670c7e98 - correct > Events : 5 > > Layout : left-symmetric > Chunk Size : 16K > > Number Major Minor RaidDevice State > this 3 8 65 3 active sync /dev/sde1 > > 0 0 8 17 0 active sync /dev/sdb1 > 1 1 8 33 1 active sync /dev/sdc1 > 2 2 8 49 2 active sync /dev/sdd1 > 3 3 8 65 3 active sync /dev/sde1 > 4 4 8 81 4 active sync /dev/sdf1 > 5 5 8 97 5 active sync /dev/sdg1 > 6 6 8 113 6 active sync /dev/sdh1 > 7 7 8 129 7 active sync /dev/sdi1 > 8 8 8 145 8 active sync /dev/sdj1 > 9 9 8 161 9 active sync /dev/sdk1 > 10 10 8 177 10 active sync /dev/sdl1 > 11 11 8 193 11 spare /dev/sdm1 > > root@localhost:/var/log# mdadm --examine /dev/sdf1 > /dev/sdf1: > Magic : a92b4efc > Version : 00.90.00 > UUID : 9f962f09:2d47f553:417df021:0032bb18 > C reation Time : Thu Aug 28 09:33:49 2008 > Raid Level : raid5 > Used Dev Size : 488383936 (465.76 GiB 500.11 GB) > Array Size : 4883839360 (4657.59 GiB 5001.05 GB) > Raid Devices : 11 > Total Devices : 12 > Preferred Minor : 0 > > Update Time : Thu Aug 28 09:36:07 2008 > State : active > Active Devices : 11 > Working Devices : 12 > Failed Devices : 0 > Spare Devices : 1 > Checksum : 670c7eaa - correct > Events : 5 > > Layout : left-symmetric > Chunk Size : 16K > > Number Major Minor RaidDevice State > this 4 8 81 4 active sync /dev/sdf1 > > 0 0 8 17 0 active sync /dev/sdb1 > 1 1 8 33 1 active sync /dev/sdc1 > 2 2 8 49 2 active sync /dev/sdd1 > 3 3 8 65 3 active sync /dev/sde1 > 4 4 =2 0 8 81 4 active sync /dev/sdf1 > 5 5 8 97 5 active sync /dev/sdg1 > 6 6 8 113 6 active sync /dev/sdh1 > 7 7 8 129 7 active sync /dev/sdi1 > 8 8 8 145 8 active sync /dev/sdj1 > 9 9 8 161 9 active sync /dev/sdk1 > 10 10 8 177 10 active sync /dev/sdl1 > 11 11 8 193 11 spare /dev/sdm1 > > root@localhost:/var/log# mdadm --examine /dev/sdg1 > /dev/sdg1: > Magic : a92b4efc > Version : 00.90.00 > UUID : 9f962f09:2d47f553:417df021:0032bb18 > Creation Time : Thu Aug 28 09:33:49 2008 > Raid Level : raid5 > Used Dev Size : 488383936 (465.76 GiB 500.11 GB) > Array Size : 4883839360 (4657.59 GiB 5001.05 GB) > Raid Devices : 11 > Total Devices : 12 > Preferred Minor : 0 > > Update Time : Thu Aug 28 09:36:07 2008 > State : active > Active Devices : 11 > Working Devices : 12 > Failed Devices : 0 > Spare Devices : 1 > Checksum : 670c7ebc - correct > Events : 5 > > Layout : left-symmetric > Chunk Size : 16K > > Number Major Minor RaidDevice State > this 5 8 97 5 active sync /dev/sdg1 > > 0 0 8 17 0 active sync /dev/sdb1 > 1 1 8 33 1 active sync /dev/sdc1 > 2 2 8 49 2 active sync /dev/sdd1 > 3 3 8 65 3 active sync /dev/sde1 > 4 4 8 81 4 active sync /dev/sdf1 > 5 5 8 97 5 active sync /dev/sdg1 > 6 6 8 113 6 active sync /dev/sdh1 > 7 7 =2 0 8 129 7 active sync /dev/sdi1 > 8 8 8 145 8 active sync /dev/sdj1 > 9 9 8 161 9 active sync /dev/sdk1 > 10 10 8 177 10 active sync /dev/sdl1 > 11 11 8 193 11 spare /dev/sdm1 > > root@localhost:/var/log# mdadm --examine /dev/sdh1 > /dev/sdh1: > Magic : a92b4efc > Version : 00.90.00 > UUID : 9f962f09:2d47f553:417df021:0032bb18 > Creation Time : Thu Aug 28 09:33:49 2008 > Raid Level : raid5 > Used Dev Size : 488383936 (465.76 GiB 500.11 GB) > Array Size : 4883839360 (4657.59 GiB 5001.05 GB) > Raid Devices : 11 > Total Devices : 12 > Preferred Minor : 0 > > Update Time : Thu Aug 28 09:36:07 2008 > State : active > Active Devices : 11 > Working Devices : 12 > Failed Devices : 0 > Spare Devices : 1 > Checksum : 670c7ece - correct > Events : 5 > > 20 Layout : left-symmetric > Chunk Size : 16K > > Number Major Minor RaidDevice State > this 6 8 113 6 active sync /dev/sdh1 > > 0 0 8 17 0 active sync /dev/sdb1 > 1 1 8 33 1 active sync /dev/sdc1 > 2 2 8 49 2 active sync /dev/sdd1 > 3 3 8 65 3 active sync /dev/sde1 > 4 4 8 81 4 active sync /dev/sdf1 > 5 5 8 97 5 active sync /dev/sdg1 > 6 6 8 113 6 active sync /dev/sdh1 > 7 7 8 129 7 active sync /dev/sdi1 > 8 8 8 145 8 active sync /dev/sdj1 > 9 9 8 161 9 active sync /dev/sdk1 > 10 10 8 177 10 active sync /dev/sdl1 > 11 11 8 193 11 spare /dev/sdm1 > > root@localhost:/var/log# mdadm --examine /dev/sdi1 > /dev/sdi1: > Magic : a92b4efc > Version : 00.90.00 > UUID : 9f962f09:2d47f553:417df021:0032bb18 > Creation Time : Thu Aug 28 09:33:49 2008 > Raid Level : raid5 > Used Dev Size : 488383936 (465.76 GiB 500.11 GB) > Array Size : 4883839360 (4657.59 GiB 5001.05 GB) > Raid Devices : 11 > Total Devices : 12 > Preferred Minor : 0 > > Update Time : Thu Aug 28 09:36:07 2008 > State : active > Active Devices : 11 > Working Devices : 12 > Failed Devices : 0 > Spare Devices : 1 > Checksum : 670c7ee0 - correct > Events : 5 > > Layout : left-symmetric > Chunk Size : 16K > > Number Major Minor RaidDevice State > this 7 8 129 7 active sync /dev/sdi1 > > 0 0 8 17 0 active sync /dev/sdb1 > 1 1 8 33 1 active sync /dev/sdc1 > 2 2 8 49 2 active sync /dev/sdd1 > 3 3 8 65 3 active sync /dev/sde1 > 4 4 8 81 4 active sync /dev/sdf1 > 5 5 8 97 5 active sync /dev/sdg1 > 6 6 8 113 6 active sync /dev/sdh1 > 7 7 8 129 7 active sync /dev/sdi1 > 8 8 8 145 8 active sync /dev/sdj1 > 9 9 8 161 9 active sync /dev/sdk1 > 10 10 8 177 10 active sync /dev/sdl1 > 11 11 8 193 11 spare /dev/sdm1 > > root@localhost:/var/log# mdadm --examine /dev/sdj1 > /dev/sdj1: > Magic : a92b4efc > Version : 00.90.00 > UUID : 9f962f09:2d47f553:417df021:0032bb18 > Creation Time : Thu Aug 28 09:33:49 2008 > Raid Level : raid5 > Used Dev Size : 488383936 (465.76 GiB 500.11 GB) > Array Size : 4883839360 (4657.59 GiB 5001.05 GB) > Raid Devices : 11 > Total Devices : 12 > Preferred Minor : 0 > > Update Time : Thu Aug 28 09:36:07 2008 > State : active > Active Devices : 11 > Working Devices : 12 > Failed Devices : 0 > Spare Devices : 1 > Checksum : 670c7ef2 - correct > Events : 5 > > Layout : left-symmetric > Chunk Size : 16K > > Number Major Minor RaidDevice State > this 8 8 145 8 active sync /dev/sdj1 > > 0 0 8 17 0 active sync /dev/sdb1 > 1 1 8 33 1 active sync /dev/sdc1 > 2 2 8 49 2 active sync /dev/sdd1 > 3 3 8 65 3 active sync /dev/sde1 > 4 4 8 81 4 active sync /dev/sdf1 > 5 5 8 97 5 active sync /dev/sdg1 > 6 6 8 113 6 active sync /dev/sdh1 > 7 7 8 129 7 active sync /dev/sdi1 > 8 8 8 145 8 active sync /dev/sdj1 > 9 9 8 161 9 active sync /dev/sdk1 > 10 10 8 177 10 active sync /dev/sdl1 > 11 11 8 193 11 spare /dev/sdm1 > > root@localhost:/var/log# mdadm --examine /dev/sdk1 > /dev/sdk1: > Magic : a92b4efc > Version : 00.90.00 > UUID : 9f962f09:2d47f553:417df021:0032bb18 > Creation Time : Thu Aug 28 09:33:49 2008 > Raid Level : raid5 > Used Dev Size : 488383936 (465.76 GiB 500.11 GB) > Array Size : 4883839360 (4657.59 GiB 5001.05 GB) > Raid Devices : 1 1 > Total Devices : 12 > Preferred Minor : 0 > > Update Time : Thu Aug 28 09:36:07 2008 > State : active > Active Devices : 11 > Working Devices : 12 > Failed Devices : 0 > Spare Devices : 1 > Checksum : 670c7f04 - correct > Events : 5 > > Layout : left-symmetric > Chunk Size : 16K > > Number Major Minor RaidDevice State > this 9 8 161 9 active sync /dev/sdk1 > > 0 0 8 17 0 active sync /dev/sdb1 > 1 1 8 33 1 active sync /dev/sdc1 > 2 2 8 49 2 active sync /dev/sdd1 > 3 3 8 65 3 active sync /dev/sde1 > 4 4 8 81 4 active sync /dev/sdf1 > 5 5 8 97 5 active sync /dev/sdg1 > 6 6 8 113 6 active sync /dev/sdh1 > 7 7 8 129 7 active sync /dev/sdi1 > 8 8 8 145 8 active sync /dev/sdj1 > 9 9 8 161 9 active sync /dev/sdk1 > 10 10 8 177 10 active sync /dev/sdl1 > 11 11 8 193 11 spare /dev/sdm1 > > root@localhost:/var/log# mdadm --examine /dev/sdl1 > /dev/sdl1: > Magic : a92b4efc > Version : 00.90.00 > UUID : 9f962f09:2d47f553:417df021:0032bb18 > Creation Time : Thu Aug 28 09:33:49 2008 > Raid Level : raid5 > Used Dev Size : 488383936 (465.76 GiB 500.11 GB) > Array Size : 4883839360 (4657.59 GiB 5001.05 GB) > Raid Devices : 11 > Total Devices : 12 > Preferred Minor : 0 > > Update Time : Thu Aug 28 09:36:07 2008 > State : active > Active Devices : 11 > Working Devices : 12 > Failed Devices : 0 > Spare Devices : 1 > Checksum : 670c7f16 - correct > Events : 5 > > Layout : left-symmetric > Chunk Size : 16K > > Number Major Minor RaidDevice State > this 10 8 177 10 active sync /dev/sdl1 > > 0 0 8 17 0 active sync /dev/sdb1 > 1 1 8 33 1 active sync /dev/sdc1 > 2 2 8 49 2 active sync /dev/sdd1 > 3 3 8 65 3 active sync /dev/sde1 > 4 4 8 81 4 active sync /dev/sdf1 > 5 5 8 97 5 active sync /dev/sdg1 > 6 6 8 113 6 active sync /dev/sdh1 > 7 7 8 129 7 active sync /dev/sdi1 > 8 8 8 145 8 active sync /dev/sdj1 > 9 9 8 20 161 9 active sync /dev/sdk1 > 10 10 8 177 10 active sync /dev/sdl1 > 11 11 8 193 11 spare /dev/sdm1 > > root@localhost:/var/log# mdadm --examine /dev/sdm1 > /dev/sdm1: > Magic : a92b4efc > Version : 00.90.00 > UUID : 9f962f09:2d47f553:417df021:0032bb18 > Creation Time : Thu Aug 28 09:33:49 2008 > Raid Level : raid5 > Used Dev Size : 488383936 (465.76 GiB 500.11 GB) > Array Size : 4883839360 (4657.59 GiB 5001.05 GB) > Raid Devices : 11 > Total Devices : 12 > Preferred Minor : 0 > > Update Time : Thu Aug 28 09:36:07 2008 > State : active > Active Devices : 11 > Working Devices : 12 > Failed Devices : 0 > Spare Devices : 1 > Checksum : 670c7f22 - correct > Events : 5 > > Layout : left-symmetric > Chunk Size : 16K > > Number Major Minor RaidDevice State > this 11 8 193 11 spar e /dev/sdm1 > > 0 0 8 17 0 active sync /dev/sdb1 > 1 1 8 33 1 active sync /dev/sdc1 > 2 2 8 49 2 active sync /dev/sdd1 > 3 3 8 65 3 active sync /dev/sde1 > 4 4 8 81 4 active sync /dev/sdf1 > 5 5 8 97 5 active sync /dev/sdg1 > 6 6 8 113 6 active sync /dev/sdh1 > 7 7 8 129 7 active sync /dev/sdi1 > 8 8 8 145 8 active sync /dev/sdj1 > 9 9 8 161 9 active sync /dev/sdk1 > 10 10 8 177 10 active sync /dev/sdl1 > 11 11 8 193 11 spare /dev/sdm1 > > root@localhost:/var/log# mdadm --examine /dev/md0 0D > mdadm: No md superblock detected on /dev/md0. > > root@localhost:/var/log# mdadm --detail /dev/md0 > mdadm: md device /dev/md0 does not appear to be active. > > root@localhost:/var/log# cat /etc/mdadm.conf > DEVICE /dev/sd* > ARRAY /dev/md0 level=raid5 num-devices=12 > UUID=9f962f09:2d47f553:417df021:0032bb18 > > root@localhost:/var/log# mdadm --query /dev/md0 > /dev/md0: is an md device which is not active > > root@localhost:/var/log# mdadm --assemble --scan > mdadm: no devices found for /dev/md0 > > root@localhost:/var/log# mdadm -X /dev/md0 > mdadm: failed to read superblock of bitmap file: No such device > > root@localhost:/var/log# mdadm -E /dev/md0 > mdadm: No md superblock detected on /dev/md0. > > > -- > To unsubscribe from this list: send the line "unsubscribe linux-> raid" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html -- To unsubscribe from this list: send the line "unsubscribe linux-raid" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: No md superblock immediately after creating RAID 5 /dev/md0 2008-08-28 8:32 No md superblock immediately after creating RAID 5 /dev/md0 thomas62186218 2008-08-28 9:17 ` Andrew Farley @ 2008-08-28 9:49 ` Bernd Schubert 2008-08-28 10:07 ` Peter Rabbitson [not found] ` <9b4ac8ccbe69d232ff2d77fd4e3590c2.squirrel@neil.brown.name> 3 siblings, 0 replies; 8+ messages in thread From: Bernd Schubert @ 2008-08-28 9:49 UTC (permalink / raw) To: thomas62186218; +Cc: linux-raid On Thursday 28 August 2008 10:32:32 thomas62186218@aol.com wrote: > Hi all, > > I am struggling with an issue on an Ubuntu 8.0.4 64-bit system. The > system has 12 SATA drives. I create a RAID 5 array using mdadm as > follows: > > mdadm -Cv /dev/md0 -n12 -l5 -c128 /dev/sd[b-m] -R -f > > The device creates successfully and starts and is visible as syncing in > cat /proc/mdstat. But, according to mdadm -X /dev/md0, there is no md > superblock on the device. Doing the same mdadm -X command for all You need to run --detail for md devices > components /dev/sdb through /dev/sdm shows superblocks. If I reboot the --examine only works for the components > system, /dev/md0 is completely gone, and a mdadm --assemble --scan Did you add the corresponding entries to your mdadm.conf? See this chapter in "man 8 mdadm" <quote> echo ’DEVICE /dev/hd[a-z] /dev/sd*[a-z]’ > mdadm.conf mdadm --examine --scan --config=mdadm.conf >> mdadm.conf This will find arrays which could be assembled from existing IDE and SCSI whole drives (not partitions), and store the information in the format of a config file. This file is very likely to contain unwanted detail, particularly the devices= entries. It should be reviewed and edited before being used as an actual config file. </quote> Cheers, Bernd -- Bernd Schubert Q-Leap Networks GmbH -- To unsubscribe from this list: send the line "unsubscribe linux-raid" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: No md superblock immediately after creating RAID 5 /dev/md0 2008-08-28 8:32 No md superblock immediately after creating RAID 5 /dev/md0 thomas62186218 2008-08-28 9:17 ` Andrew Farley 2008-08-28 9:49 ` Bernd Schubert @ 2008-08-28 10:07 ` Peter Rabbitson [not found] ` <9b4ac8ccbe69d232ff2d77fd4e3590c2.squirrel@neil.brown.name> 3 siblings, 0 replies; 8+ messages in thread From: Peter Rabbitson @ 2008-08-28 10:07 UTC (permalink / raw) To: thomas62186218; +Cc: linux-raid thomas62186218@aol.com wrote: > Hi all, > > I am struggling with an issue on an Ubuntu 8.0.4 64-bit system. The > system has 12 SATA drives. I create a RAID 5 array using mdadm as follows: > > mdadm -Cv /dev/md0 -n12 -l5 -c128 /dev/sd[b-m] -R -f > As a side note, what you are about to do is sheer madness. At least use RAID6. Search for raid5 in the list archives for a number of discussions why using RAID5 with a large number of disks is rather shortsighted. HTH Peter ^ permalink raw reply [flat|nested] 8+ messages in thread
[parent not found: <9b4ac8ccbe69d232ff2d77fd4e3590c2.squirrel@neil.brown.name>]
* Re: No md superblock immediately after creating RAID 5 /dev/md0 [not found] ` <9b4ac8ccbe69d232ff2d77fd4e3590c2.squirrel@neil.brown.name> @ 2008-08-29 5:47 ` thomas62186218 2008-08-29 6:01 ` NeilBrown 0 siblings, 1 reply; 8+ messages in thread From: thomas62186218 @ 2008-08-29 5:47 UTC (permalink / raw) To: neilb, linux-raid Hi Neil, Sorry for the confusion. I mistyped the -C command in my initial email (forgot the hot-spare) and thus the confusion. Here is the full output from the top using copy/paste. Thank you in advance for your help!! root@localhost:~# fdisk -l Disk /dev/sda: 2095 MB, 2095865856 bytes 65 heads, 62 sectors/track, 1015 cylinders Units = cylinders of 4030 * 512 = 2063360 bytes Disk identifier: 0x00000000 Device Boot Start End Blocks Id System /dev/sda1 * 1 500 1007469 83 Linux /dev/sda2 * 501 1015 1037725 83 Linux Disk /dev/sdb: 1000.2 GB, 1000204886016 bytes 255 heads, 63 sectors/track, 121601 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x0b65bb81 Device Boot Start End Blocks Id System Disk /dev/sdc: 1000.2 GB, 1000204886016 bytes 255 heads, 63 sectors/track, 121601 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x273d0b7e Device Boot Start End Blocks Id System Disk /dev/sdd: 1000.2 GB, 1000204886016 bytes 255 heads, 63 sectors/track, 121601 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x03cf614e Device Boot Start End Blocks Id System Disk /dev/sde: 1000.2 GB, 1000204886016 bytes 255 heads, 63 sectors/track, 121601 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0xa6b886bb Device Boot Start End Blocks Id System Disk /dev/sdf: 1000.2 GB, 1000204886016 bytes 255 heads, 63 sectors/track, 121601 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x65752a1a Device Boot Start End Blocks Id System Disk /dev/sdg: 1000.2 GB, 1000204886016 bytes 255 heads, 63 sectors/track, 121601 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x9f188135 Device Boot Start End Blocks Id System Disk /dev/sdh: 1000.2 GB, 1000204886016 bytes 255 heads, 63 sectors/track, 121601 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0xc19605d4 Device Boot Start End Blocks Id System Disk /dev/sdi: 1000.2 GB, 1000204886016 bytes 255 heads, 63 sectors/track, 121601 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x1e6c4f8e Device Boot Start End Blocks Id System Disk /dev/sdj: 1000.2 GB, 1000204886016 bytes 255 heads, 63 sectors/track, 121601 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0xd13edb81 Device Boot Start End Blocks Id System Disk /dev/sdk: 1000.2 GB, 1000204886016 bytes 255 heads, 63 sectors/track, 121601 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0x5bbd83b9 Disk /dev/sdk doesn't contain a valid partition table Disk /dev/sdl: 1000.2 GB, 1000204886016 bytes 255 heads, 63 sectors/track, 121601 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0xebcdc998 Device Boot Start End Blocks Id System Disk /dev/sdm: 1000.2 GB, 1000204886016 bytes 255 heads, 63 sectors/track, 121601 cylinders Units = cylinders of 16065 * 512 = 8225280 bytes Disk identifier: 0xd90b43ff Device Boot Start End Blocks Id System root@localhost:~# root@localhost:~# cat /etc/mdadm.conf root@localhost:~# root@localhost:~# mdadm --examine --scan --verbose root@localhost:~# root@localhost:~# mdadm -Cv /dev/md0 -n11 -l5 -c128 /dev/sd[b-l] -x1 /dev/sdm -R -f --verbose mdadm: layout defaults to left-symmetric mdadm: size set to 976762496K mdadm: array /dev/md0 started. root@localhost:~# root@localhost:~# cat /proc/mdstat Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5] [raid4] [raid10] md0 : active raid5 sdm[11](S) sdl[10] sdk[9] sdj[8] sdi[7] sdh[6] sdg[5] sdf[4] sde[3] sdd[2] sdc[1] sdb[0] 9767624960 blocks level 5, 128k chunk, algorithm 2 [11/11] [UUUUUUUUUUU] [>....................] resync = 0.0% (265128/976762496) finish=306.8min speed=53025K/sec unused devices: <none> root@localhost:~# root@localhost:~# cat /etc/mdadm.conf root@localhost:~# root@localhost:~# mdadm --examine --scan --verbose ARRAY /dev/md0 level=raid5 num-devices=11 UUID=09db8873:25545721:e5d66b81:63573add spares=1 devices=/dev/sdm,/dev/sdl,/dev/sdk,/dev/sdj,/dev/sdi,/dev/sdh,/dev/sdg,/d ev/sdf,/dev/sde,/dev/sdd,/dev/sdc,/dev/sdb root@localhost:~# root@localhost:~# mdadm -D /dev/md0 /dev/md0: Version : 00.90 Creation Time : Fri Aug 29 05:34:40 2008 Raid Level : raid5 Array Size : 9767624960 (9315.13 GiB 10002.05 GB) Used Dev Size : 976762496 (931.51 GiB 1000.20 GB) Raid Devices : 11 Total Devices : 12 Preferred Minor : 0 Persistence : Superblock is persistent Update Time : Fri Aug 29 05:34:41 2008 State : active, resyncing Active Devices : 11 Working Devices : 12 Failed Devices : 0 Spare Devices : 1 Layout : left-symmetric Chunk Size : 128K Rebuild Status : 0% complete UUID : 09db8873:25545721:e5d66b81:63573add Events : 0.3 Number Major Minor RaidDevice State 0 8 16 0 active sync /dev/sdb 1 8 32 1 active sync /dev/sdc 2 8 48 2 active sync /dev/sdd 3 8 64 3 active sync /dev/sde 4 8 80 4 active sync /dev/sdf 5 8 96 5 active sync /dev/sdg 6 8 112 6 active sync /dev/sdh 7 8 128 7 active sync /dev/sdi 8 8 144 8 active sync /dev/sdj 9 8 160 9 active sync /dev/sdk 10 8 176 10 active sync /dev/sdl 11 8 192 - spare /dev/sdm root@localhost:~# root@localhost:~# shutdown -r now Broadcast message from root@localhost (/dev/pts/0) at 5:35 ... The system is going down for reboot NOW! root@localhost:~# login as: root root@192.168.1.15's password: root@localhost:~# root@localhost:~# root@localhost:~# cat /proc/mdstat Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5] [raid4] [raid10] unused devices: <none> root@localhost:~# root@localhost:~# mdadm --examine --scan --verbose ARRAY /dev/md0 level=raid5 num-devices=11 UUID=09db8873:25545721:e5d66b81:63573add spares=1 devices=/dev/sdm,/dev/sdl,/dev/sdk,/dev/sdj,/dev/sdi,/dev/sdh,/dev/sdg,/d ev/sdf,/dev/sde,/dev/sdd,/dev/sdc,/dev/sdb root@localhost:~# root@localhost:~# cat /etc/mdadm.conf root@localhost:~# root@localhost:~# mdadm --assemble --scan --verbose mdadm: No arrays found in config file root@localhost:~# root@localhost:~# mdadm --scan mdadm: --scan does not set the mode, and so cannot be the first option. root@localhost:~# mdadm -E /dev/md0 mdadm: cannot open /dev/md0: No such file or directory root@localhost:~# root@localhost:~# mdadm -X /dev/md0 mdadm: failed to find file /dev/md0: No such file or directory root@localhost:~# mdadm --assemble --scan --verbose /dev/md0 mdadm: /dev/md0 not identified in config file. root@localhost:~# mdadm --query /dev/md0 mdadm: cannot open /dev/md0: No such file or directory root@localhost:~# -----Original Message----- From: NeilBrown <neilb@suse.de> To: thomas62186218@aol.com Sent: Thu, 28 Aug 2008 5:04 am Subject: Re: No md superblock immediately after creating RAID 5 /dev/md0 On Thu, August 28, 2008 6:32 pm, thomas62186218@aol.com wrote: > > mdadm -Cv /dev/md0 -n12 -l5 -c128 /dev/sd[b-m] -R -f ^^ 12. > > root@localhost:~# cat /proc/mdstat > Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5] > [raid4] [ra id10] > md0 : active raid5 sdm1[11](S) sdl1[10] sdk1[9] sdj1[8] sdi1[7] sdh1[6] > sdg1[5] sdf1[4] sde1[3] sdd1[2] sdc1[1] sdb1[0] > 4883839360 blocks level 5, 16k chunk, algorithm 2 [11/11] ^^ 11! > root@localhost:~# cat /etc/mdadm.conf > DEVICE /dev/sd* > ARRAY /dev/md0 level=raid5 num-devices=12 ^^ 12 ?? > Raid Devices : 11 ^^ Something odd here. > root@localhost:/var/log# mdadm --assemble --scan > mdadm: no devices found for /dev/md0 Could you add --verbose to that line and try again? NeilBrown P.S. Thanks for including lots of details! ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: No md superblock immediately after creating RAID 5 /dev/md0 2008-08-29 5:47 ` thomas62186218 @ 2008-08-29 6:01 ` NeilBrown 2008-09-16 9:37 ` thomas62186218 0 siblings, 1 reply; 8+ messages in thread From: NeilBrown @ 2008-08-29 6:01 UTC (permalink / raw) To: thomas62186218; +Cc: linux-raid On Fri, August 29, 2008 3:47 pm, thomas62186218@aol.com wrote: > > Hi Neil, > > Sorry for the confusion. I mistyped the -C command in my initial email > (forgot the hot-spare) and thus the confusion. > > Here is the full output from the top using copy/paste. Thank you in > advance for your help!! In the first mail you sent, there was an mdadm.conf. But now: > root@localhost:~# cat /etc/mdadm.conf > root@localhost:~# there isn't. Why is that? If you want mdadm to assemble an array you need to tell it where to find the devices and how to recognise them. The mdadm.conf you had before was exactly the right sort of thing to have. Without it you need to be more explicit mdadm -A /dev/md0 /dev/sd[b-m] maybe. Or after creating the array mdadm -D > /etc/mdadm.conf NeilBrown ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: No md superblock immediately after creating RAID 5 /dev/md0 2008-08-29 6:01 ` NeilBrown @ 2008-09-16 9:37 ` thomas62186218 0 siblings, 0 replies; 8+ messages in thread From: thomas62186218 @ 2008-09-16 9:37 UTC (permalink / raw) To: neilb; +Cc: linux-raid, thomas62186218 Hi Neil, Thank you for your help on this. It seems like running mdadm -D > /etc/mdadm.conf is the way to go. But, this raises another question. In EVMS, you do not need to ever tell it how to assemble an array. In fact, we could have a EVMS RAID of 3 drives, pull the 3 drives out, and put them into a brand new system with no configuration files, etc. and EVMS would instantly recognize the RAID device, and even all volumes on it. With mdadm, though, it seems like without /etc/mdadm.conf (or manually telling mdadm what to assemble), mdadm cannot really tell on its own what to do. This puts greater importance of course on /etc/mdadm.conf. Is there any way around this? In other words, is there a way to auto-assemble arrays without using mdadm -A or without having /etc/mdadm.conf? Finally, if /etc/mdadm.conf is the solution, can you advise what should happen when an md device is deleted? Should the "legacy" entries be left in /etc/mdadm.conf? Or should these be cleaned out? Any easy way to do this? Thank you in advance for your help! With Regards, -Thomas -----Original Message----- From: NeilBrown <neilb@suse.de> To: thomas62186218@aol.com Cc: linux-raid@vger.kernel.org Sent: Thu, 28 Aug 2008 11:01 pm Subject: Re: No md superblock immediately after creating RAID 5 /dev/md0 On Fri, August 29, 2008 3:47 pm, thomas62186218@aol.com wrote: > > Hi Neil, > > Sorry for the confusion. I mistyped the -C command in my initial email > (forgot the hot-spare) and thus the confusion. > > Here is the full output from the top using copy/paste. Thank you in > advance for your help!! In the first mail you sent, there was an mdadm.conf. But now: > root@localhost:~# cat /etc/mdadm.conf > root@localhost:~# there isn't. Why is that? If you want mdadm to assemble an array you need to tell it where to find the devices and how to recognise them. The mdadm.conf you had before was exactly the right sort of thing to have. Without it you need to be more explicit mdadm -A /dev/md0 /dev/sd[b-m] maybe. Or after creating the array mdadm -D > /etc/mdadm.conf NeilBrown ^ permalink raw reply [flat|nested] 8+ messages in thread
end of thread, other threads:[~2008-09-16 9:37 UTC | newest]
Thread overview: 8+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2008-08-28 8:32 No md superblock immediately after creating RAID 5 /dev/md0 thomas62186218
2008-08-28 9:17 ` Andrew Farley
2008-08-29 5:31 ` thomas62186218
2008-08-28 9:49 ` Bernd Schubert
2008-08-28 10:07 ` Peter Rabbitson
[not found] ` <9b4ac8ccbe69d232ff2d77fd4e3590c2.squirrel@neil.brown.name>
2008-08-29 5:47 ` thomas62186218
2008-08-29 6:01 ` NeilBrown
2008-09-16 9:37 ` thomas62186218
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).