3ware and dmraid - duplicate serial numbers (!)

3ware and dmraid - duplicate serial numbers (!)

[Ask Bjørn Hansen]

Hi everyone,

One of my boxes crashed (with a hardware error, I think - CPU and  
motherboard replacements are on their way).  I booted it up on a  
rescue disk (Fedora 8) to let the software raid sync up.

When it was running I noticed that one of the disks were listed as  
"dm-5" and ... uh-oh ... there was a disk missing.   I figured out  
that the multipath stuff for some reason had setup two of the disks  
as /dev/mapper/mpath0 and now md was syncing to this device.

Much later I figured out that "dmraid -b" reported two of the disks as  
being the same:

/dev/sda:    976541696 total, "W553841781E0A2001842"
/dev/sdb:    976773168 total, "V600VXZG000000000000"
/dev/sdc:    586114704 total, "U1757241000000000000"
/dev/sdd:    976773168 total, "U1907712000000000000"
/dev/sde:    976773168 total, "U2133609000000000000"
/dev/sdf:    976773168 total, "D2994402000000000000"
/dev/sdg:    625140335 total, "U2130349000000000000"
/dev/sdh:    976773168 total, "U1541228000000000000"
/dev/sdi:    976771055 total, "W5267124000000000000"
/dev/sdj:    976773168 total, "U1409513000000000000"
/dev/sdk:    976773168 total, "U1409513000000000000"

Any idea how this could happen?   All 11 disks are on a 3ware 9650  
controller (the first one is a "single" 3ware device, the rest are  
JBOD).  I tried rebooting and booting on a Fedora 7 DVD with the same  
result.

[ all this of course seems to have messed up my raid10 badly -- more  
on that tomorrow ]


  - ask

-- 
http://develooper.com/ - http://askask.com/

Re: 3ware and erroneous multipathing - duplicate serial numbers (was: 3ware and dmraid)

[Ask Bjørn Hansen]

On Jan 18, 2008, at 3:17 AM, Ask Bjørn Hansen wrote:

[ Uh, I just realized that I forgot to update the subject line as I  
figured out what was going on; it's obviously not a software raid  
problem but a multipath problem ]

One of my boxes crashed (with a hardware error, I think - CPU and  
motherboard replacements are on their way).  I booted it up on a  
rescue disk (Fedora 8) to let the software raid sync up.

When it was running I noticed that one of the disks were listed as  
"dm-5" and ... uh-oh ... there was a disk missing.   I figured out  
that the multipath stuff for some reason had setup two of the disks  
as /dev/mapper/mpath0 and now md was syncing to this device.

Much later I figured out that "dmraid -b" reported two of the disks as  
being the same:

/dev/sda:    976541696 total, "W553841781E0A2001842"
/dev/sdb:    976773168 total, "V600VXZG000000000000"
/dev/sdc:    586114704 total, "U1757241000000000000"
/dev/sdd:    976773168 total, "U1907712000000000000"
/dev/sde:    976773168 total, "U2133609000000000000"
/dev/sdf:    976773168 total, "D2994402000000000000"
/dev/sdg:    625140335 total, "U2130349000000000000"
/dev/sdh:    976773168 total, "U1541228000000000000"
/dev/sdi:    976771055 total, "W5267124000000000000"
/dev/sdj:    976773168 total, "U1409513000000000000"
/dev/sdk:    976773168 total, "U1409513000000000000"

Any idea how this could happen?   All 11 disks are on a 3ware 9650  
controller (the first one is a "single" 3ware device, the rest are  
JBOD).  I tried rebooting and booting on a Fedora 7 DVD with the same  
result.

[ all this of course seems to have messed up my raid10 badly -- more  
on that tomorrow ]


- ask

-- 
http://develooper.com/ - http://askask.com/

-
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: 3ware and erroneous multipathing - duplicate serial numbers (was: 3ware and dmraid)

[Heinz Mauelshagen]

On Fri, Jan 18, 2008 at 03:23:24AM -0800, Ask Bjørn Hansen wrote:
>
> On Jan 18, 2008, at 3:17 AM, Ask Bjørn Hansen wrote:
>
> [ Uh, I just realized that I forgot to update the subject line as I figured 
> out what was going on; it's obviously not a software raid problem but a 
> multipath problem ]
>
> One of my boxes crashed (with a hardware error, I think - CPU and 
> motherboard replacements are on their way).  I booted it up on a rescue 
> disk (Fedora 8) to let the software raid sync up.
>
> When it was running I noticed that one of the disks were listed as "dm-5" 
> and ... uh-oh ... there was a disk missing.   I figured out that the 
> multipath stuff for some reason had setup two of the disks as 
> /dev/mapper/mpath0 and now md was syncing to this device.
>
> Much later I figured out that "dmraid -b" reported two of the disks as 
> being the same:

Looks like the md sync duplicated the metadata and dmraid just spots
that duplication. You gotta remove one of the duplicates to clean this up
but check first which to pick in case the sync was partial only.

Regards,
Heinz    -- The LVM Guy --


>
> /dev/sda:    976541696 total, "W553841781E0A2001842"
> /dev/sdb:    976773168 total, "V600VXZG000000000000"
> /dev/sdc:    586114704 total, "U1757241000000000000"
> /dev/sdd:    976773168 total, "U1907712000000000000"
> /dev/sde:    976773168 total, "U2133609000000000000"
> /dev/sdf:    976773168 total, "D2994402000000000000"
> /dev/sdg:    625140335 total, "U2130349000000000000"
> /dev/sdh:    976773168 total, "U1541228000000000000"
> /dev/sdi:    976771055 total, "W5267124000000000000"
> /dev/sdj:    976773168 total, "U1409513000000000000"
> /dev/sdk:    976773168 total, "U1409513000000000000"
>
> Any idea how this could happen?   All 11 disks are on a 3ware 9650 
> controller (the first one is a "single" 3ware device, the rest are JBOD).  
> I tried rebooting and booting on a Fedora 7 DVD with the same result.
>
> [ all this of course seems to have messed up my raid10 badly -- more on 
> that tomorrow ]
>
>
> - ask
>
> -- 
> http://develooper.com/ - http://askask.com/
>
> -
> To unsubscribe from this list: send the line "unsubscribe linux-raid" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html

=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-

Heinz Mauelshagen                                 Red Hat GmbH
Consulting Development Engineer                   Am Sonnenhang 11
Storage Development                               56242 Marienrachdorf
                                                  Germany
Mauelshagen@RedHat.com                            PHONE +49  171 7803392
                                                  FAX   +49 2626 924446
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
-
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: 3ware and erroneous multipathing - duplicate serial numbers (was: 3ware and dmraid)

[Ask Bjørn Hansen]

On Jan 18, 2008, at 4:33 AM, Heinz Mauelshagen wrote:

>> Much later I figured out that "dmraid -b" reported two of the disks  
>> as
>> being the same:
>
> Looks like the md sync duplicated the metadata and dmraid just spots
> that duplication. You gotta remove one of the duplicates to clean  
> this up
> but check first which to pick in case the sync was partial only.


The "event" counter is the same on both; is that what I should look for?

Is there a way to reset the dmraid metadata?   I'm not actually using  
dmraid, I use "regular software raid" so I think I just need to reset  
the dmraid data...


  - ask

-- 
http://develooper.com/ - http://askask.com/

Re: 3ware and erroneous multipathing - duplicate serial numbers (was: 3ware and dmraid)

[Heinz Mauelshagen]

On Fri, Jan 18, 2008 at 11:54:29AM -0800, Ask Bjørn Hansen wrote:
>
> On Jan 18, 2008, at 4:33 AM, Heinz Mauelshagen wrote:
>
>>> Much later I figured out that "dmraid -b" reported two of the disks as
>>> being the same:
>>
>> Looks like the md sync duplicated the metadata and dmraid just spots
>> that duplication. You gotta remove one of the duplicates to clean this up
>> but check first which to pick in case the sync was partial only.
>
>
> The "event" counter is the same on both; is that what I should look for?
>
> Is there a way to reset the dmraid metadata?   I'm not actually using 
> dmraid, I use "regular software raid" so I think I just need to reset the 
> dmraid data...

dmraid -rD ...

Heinz

>
>
>  - ask
>
> -- 
> http://develooper.com/ - http://askask.com/
>
>
> -
> To unsubscribe from this list: send the line "unsubscribe linux-raid" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html

=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-

Heinz Mauelshagen                                 Red Hat GmbH
Consulting Development Engineer                   Am Sonnenhang 11
Storage Development                               56242 Marienrachdorf
                                                  Germany
Mauelshagen@RedHat.com                            PHONE +49  171 7803392
                                                  FAX   +49 2626 924446
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
-
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html