* trouble adding spare
@ 2009-01-14 9:43 Max Waterman
2009-01-14 11:56 ` Justin Piszcz
0 siblings, 1 reply; 13+ messages in thread
From: Max Waterman @ 2009-01-14 9:43 UTC (permalink / raw)
To: linux-raid
Hi,
I have a RAID5 array using 6 disks and 2 spares. I took one spare away
for a few months for another purpose (OS X) and am having trouble adding
it back in as a spare.
I can add it manually :
sudo /sbin/mdadm /dev/md2 -a /dev/sdi
but it doesn't want to add itself in after rebooting (the other spare is
added ok).
I'm sure this is simple for someone...
Max.
/dev/md2:
Version : 00.90
Creation Time : Sat Aug 6 05:18:41 2005
Raid Level : raid5
Array Size : 976804480 (931.55 GiB 1000.25 GB)
Used Dev Size : 195360896 (186.31 GiB 200.05 GB)
Raid Devices : 6
Total Devices : 8
Preferred Minor : 2
Persistence : Superblock is persistent
Update Time : Wed Jan 14 11:27:11 2009
State : clean
Active Devices : 6
Working Devices : 8
Failed Devices : 0
Spare Devices : 2
Layout : left-symmetric
Chunk Size : 64K
UUID : 15bfec75:595ac793:0914f8ee:862effd8
Events : 0.9341278
Number Major Minor RaidDevice State
0 8 80 0 active sync /dev/sdf
1 8 96 1 active sync /dev/sdg
2 8 16 2 active sync /dev/sdb
3 8 48 3 active sync /dev/sdd
4 8 32 4 active sync /dev/sdc
5 8 64 5 active sync /dev/sde
6 8 128 - spare /dev/sdi
7 8 112 - spare /dev/sdh
..../etc/mdadm/mdadm.conf
DEVICE /dev/sd[bcdefghi]
# auto-create devices with Debian standard permissions
CREATE owner=root group=disk mode=0660 auto=yes
# automatically tag new arrays as belonging to the local system
HOMEHOST <system>
# instruct the monitoring daemon where to send mail alerts
MAILADDR davidmaxwaterman@fastmail.co.uk
# definitions of existing MD arrays
ARRAY /dev/md2 level=raid5 num-devices=6
UUID=15bfec75:595ac793:0914f8ee:862effd8 spares=2
^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: trouble adding spare
2009-01-14 9:43 trouble adding spare Max Waterman
@ 2009-01-14 11:56 ` Justin Piszcz
2009-01-14 13:03 ` Max Waterman
0 siblings, 1 reply; 13+ messages in thread
From: Justin Piszcz @ 2009-01-14 11:56 UTC (permalink / raw)
To: Max Waterman; +Cc: linux-raid
On Wed, 14 Jan 2009, Max Waterman wrote:
> Hi,
>
> I have a RAID5 array using 6 disks and 2 spares. I took one spare away for a
> few months for another purpose (OS X) and am having trouble adding it back in
> as a spare.
>
> I can add it manually :
>
> sudo /sbin/mdadm /dev/md2 -a /dev/sdi
>
> but it doesn't want to add itself in after rebooting (the other spare is
> added ok).
After reboot, show dmesg/logs, what is the error? I would try:
1. mdadm --examine --scan
2. Put that info into mdadm.conf.
3. Reboot, see if its good.
4. Otherwise, remove the spare from the array, zero the mdadm superblock.
5. Re-add it to the array.
6. Worst case, zero out the drive and then re-add it and re-run step 1 and
add the new information to mdadm.conf.
>
> I'm sure this is simple for someone...
>
> Max.
>
> /dev/md2:
> Version : 00.90
> Creation Time : Sat Aug 6 05:18:41 2005
> Raid Level : raid5
> Array Size : 976804480 (931.55 GiB 1000.25 GB)
> Used Dev Size : 195360896 (186.31 GiB 200.05 GB)
> Raid Devices : 6
> Total Devices : 8
> Preferred Minor : 2
> Persistence : Superblock is persistent
>
> Update Time : Wed Jan 14 11:27:11 2009
> State : clean
> Active Devices : 6
> Working Devices : 8
> Failed Devices : 0
> Spare Devices : 2
>
> Layout : left-symmetric
> Chunk Size : 64K
>
> UUID : 15bfec75:595ac793:0914f8ee:862effd8
> Events : 0.9341278
>
> Number Major Minor RaidDevice State
> 0 8 80 0 active sync /dev/sdf
> 1 8 96 1 active sync /dev/sdg
> 2 8 16 2 active sync /dev/sdb
> 3 8 48 3 active sync /dev/sdd
> 4 8 32 4 active sync /dev/sdc
> 5 8 64 5 active sync /dev/sde
>
> 6 8 128 - spare /dev/sdi
> 7 8 112 - spare /dev/sdh
>
> ..../etc/mdadm/mdadm.conf
> DEVICE /dev/sd[bcdefghi]
>
> # auto-create devices with Debian standard permissions
> CREATE owner=root group=disk mode=0660 auto=yes
>
> # automatically tag new arrays as belonging to the local system
> HOMEHOST <system>
>
> # instruct the monitoring daemon where to send mail alerts
> MAILADDR davidmaxwaterman@fastmail.co.uk
>
> # definitions of existing MD arrays
> ARRAY /dev/md2 level=raid5 num-devices=6
> UUID=15bfec75:595ac793:0914f8ee:862effd8 spares=2
^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: trouble adding spare
2009-01-14 11:56 ` Justin Piszcz
@ 2009-01-14 13:03 ` Max Waterman
2009-01-14 13:23 ` Max Waterman
0 siblings, 1 reply; 13+ messages in thread
From: Max Waterman @ 2009-01-14 13:03 UTC (permalink / raw)
To: Justin Piszcz; +Cc: linux-raid
Justin Piszcz wrote:
> After reboot, show dmesg/logs, what is the error?
There's no error specific to md - it seems to just ignore sdi. There are
errors from 'sd' saying sdi has an unknown partition table - but I don't
care about partition tables since I'm using the whole devices (ie
/dev/sdi not /dev/sdi1 or whatever). /dev/sdh is the other spare.
Here's some bits from dmesg :
[ 9.720380] sd 11:0:0:0: [sdi] 390721968 512-byte hardware sectors
(200050 MB
)
[ 9.720392] sd 11:0:0:0: [sdi] Write Protect is off
[ 9.720395] sd 11:0:0:0: [sdi] Mode Sense: 00 3a 00 00
[ 9.720413] sd 11:0:0:0: [sdi] Write cache: enabled, read cache:
enabled, doe
sn't support DPO or FUA
[ 9.720460] sd 11:0:0:0: [sdi] 390721968 512-byte hardware sectors
(200050 MB
)
[ 9.720471] sd 11:0:0:0: [sdi] Write Protect is off
[ 9.720473] sd 11:0:0:0: [sdi] Mode Sense: 00 3a 00 00
[ 9.720490] sd 11:0:0:0: [sdi] Write cache: enabled, read cache:
enabled, doe
sn't support DPO or FUA
[ 9.720493] sdi: unknown partition table
[ 9.725328] sd 11:0:0:0: [sdi] Attached SCSI disk
...
[ 13.735948] md: md2 stopped.
[ 13.755547] md: md2 stopped.
[ 13.757496] md: bind<sdh>
[ 13.757657] md: bind<sdg>
[ 13.763358] Driver 'sr' needs updating - please use bus_type methods
[ 13.767589] sr0: scsi3-mmc drive: 40x/40x cd/rw xa/form2 cdda tray
[ 13.767594] Uniform CD-ROM driver Revision: 3.20
[ 13.767692] sr 8:0:1:0: Attached scsi CD-ROM sr0
[ 13.770178] md: md2 stopped.
[ 13.770201] md: unbind<sdg>
[ 13.803686] md: export_rdev(sdg)
[ 13.803704] md: unbind<sdh>
[ 13.806345] md: export_rdev(sdh)
[ 13.809153] md: bind<sdg>
[ 13.809290] md: bind<sdd>
[ 13.809430] md: bind<sdh>
[ 13.809577] md: bind<sdf>
[ 13.812235] md: md2 stopped.
[ 13.812250] md: unbind<sdf>
[ 13.818201] md: export_rdev(sdf)
[ 13.818217] md: unbind<sdh>
[ 13.830018] md: export_rdev(sdh)
[ 13.830024] md: unbind<sdd>
[ 13.834004] md: export_rdev(sdd)
[ 13.834011] md: unbind<sdg>
[ 13.834262] md: export_rdev(sdg)
[ 13.837616] md: bind<sdg>
[ 13.837748] md: bind<sdb>
[ 13.837870] md: bind<sdd>
[ 13.837992] md: bind<sde>
[ 13.838133] md: bind<sdh>
[ 13.838280] md: bind<sdf>
[ 13.847605] md: md2 stopped.
[ 13.847620] md: unbind<sdf>
[ 13.860054] md: export_rdev(sdf)
[ 13.860063] md: unbind<sdh>
[ 13.860091] md: export_rdev(sdh)
[ 13.860096] md: unbind<sde>
[ 13.860120] md: export_rdev(sde)
[ 13.860126] md: unbind<sdd>
[ 13.860149] md: export_rdev(sdd)
[ 13.860154] md: unbind<sdb>
[ 13.860176] md: export_rdev(sdb)
[ 13.860182] md: unbind<sdg>
[ 13.860204] md: export_rdev(sdg)
[ 13.863504] md: bind<sdg>
[ 13.863636] md: bind<sdb>
[ 13.863759] md: bind<sdd>
[ 13.863877] md: bind<sdc>
[ 13.863999] md: bind<sde>
[ 13.864139] md: bind<sdh>
[ 13.864285] md: bind<sdf>
[ 13.873381] raid5: device sdf operational as raid disk 0
[ 13.873383] raid5: device sde operational as raid disk 5
[ 13.873385] raid5: device sdc operational as raid disk 4
[ 13.873387] raid5: device sdd operational as raid disk 3
[ 13.873389] raid5: device sdb operational as raid disk 2
[ 13.873391] raid5: device sdg operational as raid disk 1
[ 13.873941] raid5: allocated 6312kB for md2
[ 13.873944] raid5: raid level 5 set md2 active with 6 out of 6
devices, algorithm 2
[ 13.873947] RAID5 conf printout:
[ 13.873948] --- rd:6 wd:6
[ 13.873950] disk 0, o:1, dev:sdf
[ 13.873952] disk 1, o:1, dev:sdg
[ 13.873953] disk 2, o:1, dev:sdb
[ 13.873955] disk 3, o:1, dev:sdd
[ 13.873957] disk 4, o:1, dev:sdc
[ 13.873958] disk 5, o:1, dev:sde
I'll give the below a try...
Thanks,
Max.
> I would try:
>
> 1. mdadm --examine --scan
> 2. Put that info into mdadm.conf.
> 3. Reboot, see if its good.
> 4. Otherwise, remove the spare from the array, zero the mdadm superblock.
> 5. Re-add it to the array.
> 6. Worst case, zero out the drive and then re-add it and re-run step 1
> and
> add the new information to mdadm.conf.
>
^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: trouble adding spare
2009-01-14 13:03 ` Max Waterman
@ 2009-01-14 13:23 ` Max Waterman
2009-01-14 13:39 ` Justin Piszcz
0 siblings, 1 reply; 13+ messages in thread
From: Max Waterman @ 2009-01-14 13:23 UTC (permalink / raw)
To: Justin Piszcz; +Cc: linux-raid
Max Waterman wrote:
>> I would try:
>>
>> 1. mdadm --examine --scan
>> 2. Put that info into mdadm.conf.
It's already there - I think that's how I got the line in the first place.
>> 4. Otherwise, remove the spare from the array, zero the mdadm
>> superblock.
How would I do this? I tried :
$ sudo /sbin/mdadm /dev/sdi --zero-superblock --force
mdadm: /dev/sdi does not appear to be an md device
Max.
^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: trouble adding spare
2009-01-14 13:23 ` Max Waterman
@ 2009-01-14 13:39 ` Justin Piszcz
2009-01-14 14:32 ` Max Waterman
0 siblings, 1 reply; 13+ messages in thread
From: Justin Piszcz @ 2009-01-14 13:39 UTC (permalink / raw)
To: Max Waterman; +Cc: linux-raid
On Wed, 14 Jan 2009, Max Waterman wrote:
> Max Waterman wrote:
>>> I would try:
>>>
>>> 1. mdadm --examine --scan
>>> 2. Put that info into mdadm.conf.
> It's already there - I think that's how I got the line in the first place.
>>> 4. Otherwise, remove the spare from the array, zero the mdadm superblock.
> How would I do this? I tried :
>
> $ sudo /sbin/mdadm /dev/sdi --zero-superblock --force
> mdadm: /dev/sdi does not appear to be an md device
>
> Max.
> --
> To unsubscribe from this list: send the line "unsubscribe linux-raid" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at http://vger.kernel.org/majordomo-info.html
>
Output from when I have run this in the past:
p34:~# mdadm --zero-superblock /dev/hde1
p34:~#
If that does not work, clean the drive out manually after removing it as
a spare from the array:
dd if=/dev/zero of=/dev/sdi bs=1M
Then try to re-add it.
If that still does not work you may need to modify some additional bits
possibly with/in regards to the spare itself, I only have one spare in my
array and I use a partition with type (fd) for the spare.
The only other thing I can think of is the events for that spare were
0.123 (example) and then after you installed OSX onto the drive, it could
have deleted the superblock for mdadm from when it was created as a spare.
I have not fixed this problem in any of my use-cases, but it may(?) be
necessary to re-write that superblock onto the spare so it is identified
as such, however, how to do this, is a good question, it would probably be
assembly or if that does not work you would need to create the array,
assume clean (as you originally created it before) so the superblock is
written to the spare. This all seems too complicated though, there should
(and probably) is a simpler way.
Justin.
^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: trouble adding spare
2009-01-14 13:39 ` Justin Piszcz
@ 2009-01-14 14:32 ` Max Waterman
2009-01-14 15:08 ` Max Waterman
0 siblings, 1 reply; 13+ messages in thread
From: Max Waterman @ 2009-01-14 14:32 UTC (permalink / raw)
To: Justin Piszcz; +Cc: linux-raid
Justin Piszcz wrote:
> Output from when I have run this in the past:
> p34:~# mdadm --zero-superblock /dev/hde1
> p34:~#
Ok, shuffling the args (why is it that the args are sometimes one way,
and sometimes another?) made it at least run, but it made no difference
to the device being added at boot-time.
>
> If that does not work, clean the drive out manually after removing it
> as a spare from the array:
> dd if=/dev/zero of=/dev/sdi bs=1M
This is taking forever. Isn't there a way to force mdadm to ignore the
contents and just add it? How about a specific 'dd' that targets
whatever is on the disk that is causing the problem (partition table?)?
> Then try to re-add it.
>
> If that still does not work you may need to modify some additional
> bits possibly with/in regards to the spare itself, I only have one
> spare in my array and I use a partition with type (fd) for the spare.
>
> The only other thing I can think of is the events for that spare were
> 0.123 (example) and then after you installed OSX onto the drive,
Well, I didn't install OSX on it...just formatted it on OSX - what's
that? HFS+ or something? Anyway, it makes several different partitions
for some reason. Do you think that's causing the problem?
> it could have deleted the superblock for mdadm from when it was
> created as a spare.
I would expect it to have deleted everything on the drive.
>
> I have not fixed this problem in any of my use-cases, but it may(?) be
> necessary to re-write that superblock onto the spare so it is
> identified as such, however, how to do this, is a good question, it
> would probably be assembly or if that does not work you would need to
> create the array, assume clean (as you originally created it before)
> so the superblock is written to the spare. This all seems too
> complicated though, there should (and probably) is a simpler way.
That's kind of that I was thinking...
Thanks for your continued help though :)
Max.
^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: trouble adding spare
2009-01-14 14:32 ` Max Waterman
@ 2009-01-14 15:08 ` Max Waterman
2009-01-14 15:14 ` Justin Piszcz
0 siblings, 1 reply; 13+ messages in thread
From: Max Waterman @ 2009-01-14 15:08 UTC (permalink / raw)
To: Justin Piszcz; +Cc: linux-raid
Max Waterman wrote:
>>
>> If that does not work, clean the drive out manually after removing it
>> as a spare from the array:
>> dd if=/dev/zero of=/dev/sdi bs=1M
> This is taking forever
I stopped it after about half an hour, hoping that it had made garbage
of whatever was the problem.
I then added it into the array and it worked as before.
However, it still wasn't added when I rebooted.
...but, there is something different. Now, when I --examine /dev/sdi, it
gives output for the whole array including 2 spares, which is the end
result I expect :
Active Devices : 6
Working Devices : 8
Failed Devices : 0
Spare Devices : 2
However, --detail /dev/md2 still denies /dev/sdi exists :
Active Devices : 6
Working Devices : 7
Failed Devices : 0
Spare Devices : 1
What's up?
Max.
^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: trouble adding spare
2009-01-14 15:08 ` Max Waterman
@ 2009-01-14 15:14 ` Justin Piszcz
2009-01-14 17:54 ` Max Waterman
0 siblings, 1 reply; 13+ messages in thread
From: Justin Piszcz @ 2009-01-14 15:14 UTC (permalink / raw)
To: Max Waterman; +Cc: linux-raid
On Wed, 14 Jan 2009, Max Waterman wrote:
> Max Waterman wrote:
>>>
>>> If that does not work, clean the drive out manually after removing it as a
>>> spare from the array:
>>> dd if=/dev/zero of=/dev/sdi bs=1M
>> This is taking forever
> I stopped it after about half an hour, hoping that it had made garbage of
> whatever was the problem.
>
> I then added it into the array and it worked as before.
>
> However, it still wasn't added when I rebooted.
>
> ...but, there is something different. Now, when I --examine /dev/sdi, it
> gives output for the whole array including 2 spares, which is the end result
> I expect :
>
> Active Devices : 6
> Working Devices : 8
> Failed Devices : 0
> Spare Devices : 2
>
> However, --detail /dev/md2 still denies /dev/sdi exists :
>
> Active Devices : 6
> Working Devices : 7
> Failed Devices : 0
> Spare Devices : 1
>
> What's up?
>
> Max.
>
> --
> To unsubscribe from this list: send the line "unsubscribe linux-raid" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at http://vger.kernel.org/majordomo-info.html
>
The superblock is at the end of the disk for 0.90.00 superblocks, so you
would need to write to end of the disk or just let dd clear out the entire
disk. Honestly though that may not fix the root cause of the problem, we
may need to wait for others on the list and/or Neil to check this one out.
It seems very strange, can you post the regular output that people ask
for so once they see your mail, they will have (hopefully) most of what
they need to diagnose the problem.
1. mdadm -D /dev/mdX
2. cat /proc/mdstat
3. mdadm -Esvvv
4. uname -a
Justin.
^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: trouble adding spare
2009-01-14 15:14 ` Justin Piszcz
@ 2009-01-14 17:54 ` Max Waterman
2009-01-16 17:57 ` Max Waterman
0 siblings, 1 reply; 13+ messages in thread
From: Max Waterman @ 2009-01-14 17:54 UTC (permalink / raw)
To: linux-raid
Justin Piszcz wrote:
>
>
> On Wed, 14 Jan 2009, Max Waterman wrote:
>
>> Max Waterman wrote:
>>>>
>>>> If that does not work, clean the drive out manually after removing
>>>> it as a spare from the array:
>>>> dd if=/dev/zero of=/dev/sdi bs=1M
>>> This is taking forever
>> I stopped it after about half an hour, hoping that it had made
>> garbage of whatever was the problem.
>>
>> I then added it into the array and it worked as before.
>>
>> However, it still wasn't added when I rebooted.
>>
>> ...but, there is something different. Now, when I --examine /dev/sdi,
>> it gives output for the whole array including 2 spares, which is the
>> end result I expect :
>>
>> Active Devices : 6
>> Working Devices : 8
>> Failed Devices : 0
>> Spare Devices : 2
>>
>> However, --detail /dev/md2 still denies /dev/sdi exists :
>>
>> Active Devices : 6
>> Working Devices : 7
>> Failed Devices : 0
>> Spare Devices : 1
>>
>> What's up?
>>
>> Max.
>>
>> --
>> To unsubscribe from this list: send the line "unsubscribe linux-raid" in
>> the body of a message to majordomo@vger.kernel.org
>> More majordomo info at http://vger.kernel.org/majordomo-info.html
>>
>
> The superblock is at the end of the disk for 0.90.00 superblocks, so
> you would need to write to end of the disk or just let dd clear out
> the entire disk. Honestly though that may not fix the root cause of
> the problem, we may need to wait for others on the list and/or Neil to
> check this one out. It seems very strange, can you post the regular
> output that people ask for so once they see your mail, they will have
> (hopefully) most of what they need to diagnose the problem.
>
> 1. mdadm -D /dev/mdX
> 2. cat /proc/mdstat
> 3. mdadm -Esvvv
> 4. uname -a
5. mdadm -E /dev/sdi
OK, I uploaded the output of the above commands to here :
<http://reality.sgiweb.org/maxw/tmp/md2Details/>
I hope someone can shed some light on this.
Thanks,
Max.
^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: trouble adding spare
2009-01-14 17:54 ` Max Waterman
@ 2009-01-16 17:57 ` Max Waterman
2009-01-21 17:21 ` Max Waterman
0 siblings, 1 reply; 13+ messages in thread
From: Max Waterman @ 2009-01-16 17:57 UTC (permalink / raw)
To: linux-raid
Can no one provide any enlightenment on this issue?
Max.
Max Waterman wrote:
> Justin Piszcz wrote:
>>
>>
>> On Wed, 14 Jan 2009, Max Waterman wrote:
>>
>>> Max Waterman wrote:
>>>>>
>>>>> If that does not work, clean the drive out manually after removing
>>>>> it as a spare from the array:
>>>>> dd if=/dev/zero of=/dev/sdi bs=1M
>>>> This is taking forever
>>> I stopped it after about half an hour, hoping that it had made
>>> garbage of whatever was the problem.
>>>
>>> I then added it into the array and it worked as before.
>>>
>>> However, it still wasn't added when I rebooted.
>>>
>>> ...but, there is something different. Now, when I --examine
>>> /dev/sdi, it gives output for the whole array including 2 spares,
>>> which is the end result I expect :
>>>
>>> Active Devices : 6
>>> Working Devices : 8
>>> Failed Devices : 0
>>> Spare Devices : 2
>>>
>>> However, --detail /dev/md2 still denies /dev/sdi exists :
>>>
>>> Active Devices : 6
>>> Working Devices : 7
>>> Failed Devices : 0
>>> Spare Devices : 1
>>>
>>> What's up?
>>>
>>> Max.
>>>
>>> --
>>> To unsubscribe from this list: send the line "unsubscribe
>>> linux-raid" in
>>> the body of a message to majordomo@vger.kernel.org
>>> More majordomo info at http://vger.kernel.org/majordomo-info.html
>>>
>>
>> The superblock is at the end of the disk for 0.90.00 superblocks, so
>> you would need to write to end of the disk or just let dd clear out
>> the entire disk. Honestly though that may not fix the root cause of
>> the problem, we may need to wait for others on the list and/or Neil
>> to check this one out. It seems very strange, can you post the
>> regular output that people ask for so once they see your mail, they
>> will have (hopefully) most of what they need to diagnose the problem.
>>
>> 1. mdadm -D /dev/mdX
>> 2. cat /proc/mdstat
>> 3. mdadm -Esvvv
>> 4. uname -a
> 5. mdadm -E /dev/sdi
>
> OK, I uploaded the output of the above commands to here :
>
> <http://reality.sgiweb.org/maxw/tmp/md2Details/>
>
> I hope someone can shed some light on this.
>
> Thanks,
>
> Max.
> --
> To unsubscribe from this list: send the line "unsubscribe linux-raid" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: trouble adding spare
2009-01-16 17:57 ` Max Waterman
@ 2009-01-21 17:21 ` Max Waterman
2009-01-22 3:50 ` Beolach
0 siblings, 1 reply; 13+ messages in thread
From: Max Waterman @ 2009-01-21 17:21 UTC (permalink / raw)
To: linux-raid
Someone else's post prompted me to try :
$ sudo /sbin/mdadm --detail --scan
ARRAY /dev/md2 level=raid5 num-devices=6 metadata=00.90 spares=2
UUID=15bfec75:595ac793:0914f8ee:862effd8
and use that in mdadm.conf instead of the output of :
~$ sudo /sbin/mdadm --examine --scan
ARRAY /dev/md2 level=raid5 num-devices=6
UUID=15bfec75:595ac793:0914f8ee:862effd8
spares=2
This fixes my problem of the second spare drive not being added. I'm not
sure why.
However, mdadm now gives me a 'message' :
mdadm: metadata format 00.90 unknown, ignored.
What's this about? Anything to worry about?
Max.
Max Waterman wrote:
> Can no one provide any enlightenment on this issue?
>
> Max.
>
> Max Waterman wrote:
>> Justin Piszcz wrote:
>>>
>>>
>>> On Wed, 14 Jan 2009, Max Waterman wrote:
>>>
>>>> Max Waterman wrote:
>>>>>>
>>>>>> If that does not work, clean the drive out manually after
>>>>>> removing it as a spare from the array:
>>>>>> dd if=/dev/zero of=/dev/sdi bs=1M
>>>>> This is taking forever
>>>> I stopped it after about half an hour, hoping that it had made
>>>> garbage of whatever was the problem.
>>>>
>>>> I then added it into the array and it worked as before.
>>>>
>>>> However, it still wasn't added when I rebooted.
>>>>
>>>> ...but, there is something different. Now, when I --examine
>>>> /dev/sdi, it gives output for the whole array including 2 spares,
>>>> which is the end result I expect :
>>>>
>>>> Active Devices : 6
>>>> Working Devices : 8
>>>> Failed Devices : 0
>>>> Spare Devices : 2
>>>>
>>>> However, --detail /dev/md2 still denies /dev/sdi exists :
>>>>
>>>> Active Devices : 6
>>>> Working Devices : 7
>>>> Failed Devices : 0
>>>> Spare Devices : 1
>>>>
>>>> What's up?
>>>>
>>>> Max.
>>>>
>>>> --
>>>> To unsubscribe from this list: send the line "unsubscribe
>>>> linux-raid" in
>>>> the body of a message to majordomo@vger.kernel.org
>>>> More majordomo info at http://vger.kernel.org/majordomo-info.html
>>>>
>>>
>>> The superblock is at the end of the disk for 0.90.00 superblocks, so
>>> you would need to write to end of the disk or just let dd clear out
>>> the entire disk. Honestly though that may not fix the root cause of
>>> the problem, we may need to wait for others on the list and/or Neil
>>> to check this one out. It seems very strange, can you post the
>>> regular output that people ask for so once they see your mail, they
>>> will have (hopefully) most of what they need to diagnose the problem.
>>>
>>> 1. mdadm -D /dev/mdX
>>> 2. cat /proc/mdstat
>>> 3. mdadm -Esvvv
>>> 4. uname -a
>> 5. mdadm -E /dev/sdi
>>
>> OK, I uploaded the output of the above commands to here :
>>
>> <http://reality.sgiweb.org/maxw/tmp/md2Details/>
>>
>> I hope someone can shed some light on this.
>>
>> Thanks,
>>
>> Max.
>> --
>> To unsubscribe from this list: send the line "unsubscribe linux-raid" in
>> the body of a message to majordomo@vger.kernel.org
>> More majordomo info at http://vger.kernel.org/majordomo-info.html
>
> --
> To unsubscribe from this list: send the line "unsubscribe linux-raid" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: trouble adding spare
2009-01-21 17:21 ` Max Waterman
@ 2009-01-22 3:50 ` Beolach
2009-01-22 16:43 ` Max Waterman
0 siblings, 1 reply; 13+ messages in thread
From: Beolach @ 2009-01-22 3:50 UTC (permalink / raw)
To: linux-raid
On Wed, Jan 21, 2009 at 10:21 AM, Max Waterman
<davidmaxwaterman@fastmail.co.uk> wrote:
> Someone else's post prompted me to try :
>
> $ sudo /sbin/mdadm --detail --scan
> ARRAY /dev/md2 level=raid5 num-devices=6 metadata=00.90 spares=2
> UUID=15bfec75:595ac793:0914f8ee:862effd8
>
> and use that in mdadm.conf instead of the output of :
>
> ~$ sudo /sbin/mdadm --examine --scan
> ARRAY /dev/md2 level=raid5 num-devices=6
> UUID=15bfec75:595ac793:0914f8ee:862effd8
> spares=2
>
> This fixes my problem of the second spare drive not being added. I'm not
> sure why.
>
> However, mdadm now gives me a 'message' :
>
> mdadm: metadata format 00.90 unknown, ignored.
>
> What's this about? Anything to worry about?
>
Change it to metadata=0.90 instead of metadata=00.90 & it should work
w/out the error message. It would probably be good if mdadm.conf
and/or mdadm --detail --scan dropped leading zeros.
Conway S. Smith
^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: trouble adding spare
2009-01-22 3:50 ` Beolach
@ 2009-01-22 16:43 ` Max Waterman
0 siblings, 0 replies; 13+ messages in thread
From: Max Waterman @ 2009-01-22 16:43 UTC (permalink / raw)
To: linux-raid
Beolach wrote:
> On Wed, Jan 21, 2009 at 10:21 AM, Max Waterman
> <davidmaxwaterman@fastmail.co.uk> wrote:
>
>> Someone else's post prompted me to try :
>>
>> $ sudo /sbin/mdadm --detail --scan
>> ARRAY /dev/md2 level=raid5 num-devices=6 metadata=00.90 spares=2
>> UUID=15bfec75:595ac793:0914f8ee:862effd8
>>
>> and use that in mdadm.conf instead of the output of :
>>
>> ~$ sudo /sbin/mdadm --examine --scan
>> ARRAY /dev/md2 level=raid5 num-devices=6
>> UUID=15bfec75:595ac793:0914f8ee:862effd8
>> spares=2
>>
>> This fixes my problem of the second spare drive not being added. I'm not
>> sure why.
>>
>> However, mdadm now gives me a 'message' :
>>
>> mdadm: metadata format 00.90 unknown, ignored.
>>
>> What's this about? Anything to worry about?
>>
>>
>
> Change it to metadata=0.90 instead of metadata=00.90 & it should work
> w/out the error message. It would probably be good if mdadm.conf
> and/or mdadm --detail --scan dropped leading zeros.
>
Yup, that fixed the error.
Any ideas why it didn't work with the output of --examine?
Max.
^ permalink raw reply [flat|nested] 13+ messages in thread
end of thread, other threads:[~2009-01-22 16:43 UTC | newest]
Thread overview: 13+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2009-01-14 9:43 trouble adding spare Max Waterman
2009-01-14 11:56 ` Justin Piszcz
2009-01-14 13:03 ` Max Waterman
2009-01-14 13:23 ` Max Waterman
2009-01-14 13:39 ` Justin Piszcz
2009-01-14 14:32 ` Max Waterman
2009-01-14 15:08 ` Max Waterman
2009-01-14 15:14 ` Justin Piszcz
2009-01-14 17:54 ` Max Waterman
2009-01-16 17:57 ` Max Waterman
2009-01-21 17:21 ` Max Waterman
2009-01-22 3:50 ` Beolach
2009-01-22 16:43 ` Max Waterman
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).