Removing a failed device from LVM2/DM

Removing a failed device from LVM2/DM

[Alan D. Brunelle]

I constructed a 1-copy mirror with the following commands:

# pvcreate --metadatasize 192k /dev/sdcn /dev/sdfj /dev/sdfa
  Physical volume "/dev/sdcn" successfully created
  Physical volume "/dev/sdfj" successfully created
  Physical volume "/dev/sdfa" successfully created
# vgcreate vg /dev/sdcn /dev/sdfj /dev/sdfa
  Volume group "vg" successfully created
# lvcreate -L 32g -m 1 -n lv vg
  Logical volume "lv" created

The status showed:

# lvs -a -o +devices
  LV            VG   Attr   LSize  Origin Snap%  Move Log     Copy%
Convert Devices                      
  lv            vg   mwi-a- 32.00G                    lv_mlog  29.72
lv_mimage_0(0),lv_mimage_1(0)
  [lv_mimage_0] vg   Iwi-ao
32.00G                                           /dev/sdcn(0)                 
  [lv_mimage_1] vg   Iwi-ao
32.00G                                           /dev/sdfj(0)                 
  [lv_mlog]     vg   lwi-ao
4.00M                                           /dev/sdfa(0)                 

Then I forced /dev/sdfj to fail (removing the unit from the FC SAN), and
the state of the mirror went to:

# lvs
  /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
  LV   VG   Attr   LSize  Origin Snap%  Move Log Copy%  Convert
  lv   vg   -wi-a- 32.00G           

At this point I know I can do:

# vgreduce -a vg
  /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
  Physical volume "/dev/sdcn" still in use
  Removed "/dev/sdfa" from volume group "vg"

But I run into two problems:

(1) I'd like to be able to live without the constant errors
about /dev/sdfj, and tried:

# pvremove -f /dev/sdfj
  /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
  No physical volume label read from /dev/sdfj
  /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
  Labels on physical volume "/dev/sdfj" successfully wiped

but that didn't stop it. 

and:

(2) I'd like to be able to recreate the 1-copy mirror from the currently
linear volume, but can't (easily):

# pvcreate --metadatasize 192k /dev/sdp
  Physical volume "/dev/sdp" successfully created
# vgextend vg /dev/sdp
  ... errors from sdfj omitted...
  Volume group "vg" successfully extended
# vgs
  /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
  VG   #PV #LV #SN Attr   VSize   VFree  
  vg     2   1   0 wz--n- 542.67G 510.67G
# lvconvert -m 1 /dev/vg/lv
  /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
  Insufficient suitable allocatable extents for logical volume : 8192
more required
  Unable to allocate extents for mirror(s).

I can use the alloc anywhere options, but I'm at a loss as to why that's
needed:

# lvconvert -m1 --alloc anywhere /dev/vg/lv
  /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
  /dev/vg/lv: Converted: 1.3%
  /dev/vg/lv: Converted: 2.6%
  /dev/vg/lv: Converted: 3.8%
...


Any pointers on how to remove /dev/sdfj from the scan (other than, I
guess, updated /etc/lvm.conf to filter it out) or an explanation as to
why the 'alloc anywhere' is needed for the lvconvert would be muchly
appreciated.

Alan D. Brunelle
Hewlett-Packard 

Re: Removing a failed device from LVM2/DM

[Takahiro Yasui]

On 08/31/09 11:16, Alan D. Brunelle wrote:
> I constructed a 1-copy mirror with the following commands:
> 
> # pvcreate --metadatasize 192k /dev/sdcn /dev/sdfj /dev/sdfa
>   Physical volume "/dev/sdcn" successfully created
>   Physical volume "/dev/sdfj" successfully created
>   Physical volume "/dev/sdfa" successfully created
> # vgcreate vg /dev/sdcn /dev/sdfj /dev/sdfa
>   Volume group "vg" successfully created
> # lvcreate -L 32g -m 1 -n lv vg
>   Logical volume "lv" created
> 
> The status showed:
> 
> # lvs -a -o +devices
>   LV            VG   Attr   LSize  Origin Snap%  Move Log     Copy%
> Convert Devices                      
>   lv            vg   mwi-a- 32.00G                    lv_mlog  29.72
> lv_mimage_0(0),lv_mimage_1(0)
>   [lv_mimage_0] vg   Iwi-ao
> 32.00G                                           /dev/sdcn(0)                 
>   [lv_mimage_1] vg   Iwi-ao
> 32.00G                                           /dev/sdfj(0)                 
>   [lv_mlog]     vg   lwi-ao
> 4.00M                                           /dev/sdfa(0)                 
> 
> Then I forced /dev/sdfj to fail (removing the unit from the FC SAN), and
> the state of the mirror went to:
> 
> # lvs
>   /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
>   LV   VG   Attr   LSize  Origin Snap%  Move Log Copy%  Convert
>   lv   vg   -wi-a- 32.00G           
> 
> At this point I know I can do:
> 
> # vgreduce -a vg
>   /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
>   Physical volume "/dev/sdcn" still in use
>   Removed "/dev/sdfa" from volume group "vg"
> 
> But I run into two problems:
> 
> (1) I'd like to be able to live without the constant errors
> about /dev/sdfj, and tried:
> 
> # pvremove -f /dev/sdfj
>   /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
>   No physical volume label read from /dev/sdfj
>   /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
>   Labels on physical volume "/dev/sdfj" successfully wiped
> 
> but that didn't stop it. 
> 
> and:
> 
> (2) I'd like to be able to recreate the 1-copy mirror from the currently
> linear volume, but can't (easily):
> 
> # pvcreate --metadatasize 192k /dev/sdp
>   Physical volume "/dev/sdp" successfully created
> # vgextend vg /dev/sdp
>   ... errors from sdfj omitted...
>   Volume group "vg" successfully extended
> # vgs
>   /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
>   VG   #PV #LV #SN Attr   VSize   VFree  
>   vg     2   1   0 wz--n- 542.67G 510.67G
> # lvconvert -m 1 /dev/vg/lv
>   /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
>   Insufficient suitable allocatable extents for logical volume : 8192
> more required
>   Unable to allocate extents for mirror(s).
> 
> I can use the alloc anywhere options, but I'm at a loss as to why that's
> needed:
> 
> # lvconvert -m1 --alloc anywhere /dev/vg/lv
>   /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
>   /dev/vg/lv: Converted: 1.3%
>   /dev/vg/lv: Converted: 2.6%
>   /dev/vg/lv: Converted: 3.8%
> ...
> 
> 
> Any pointers on how to remove /dev/sdfj from the scan (other than, I
> guess, updated /etc/lvm.conf to filter it out)

The following URL explains how to remove lost PVs from VG.

6.6. Removing Lost Physical Volumes from a Volume Group
http://www.redhat.com/docs/manuals/enterprise/RHEL-5-manual/Cluster_Logical_Volume_Manager/lost_PV_remove_from_VG.html

I think "vgreduce --removemissing vg" will remove "/dev/sdfj."

> or an explanation as to
> why the 'alloc anywhere' is needed for the lvconvert would be muchly
> appreciated.

To create a mirror volume with disk log, three PVs are required in the VG
to allocate two mirror legs and one mirror log. But in this case, the "vg"
contains only two valid PVs (/dev/sdcn and /dev/sdp), and '--alloc anywhere'
options is necessary to allocate a mirror log on the same disk as mirror legs.

I hope this would be help.

Thanks,
Taka

Re: Removing a failed device from LVM2/DM

[malahal]

Takahiro Yasui [tyasui@redhat.com] wrote:
> On 08/31/09 11:16, Alan D. Brunelle wrote:
> > I constructed a 1-copy mirror with the following commands:
> > 
> > # pvcreate --metadatasize 192k /dev/sdcn /dev/sdfj /dev/sdfa
> >   Physical volume "/dev/sdcn" successfully created
> >   Physical volume "/dev/sdfj" successfully created
> >   Physical volume "/dev/sdfa" successfully created
> > # vgcreate vg /dev/sdcn /dev/sdfj /dev/sdfa
> >   Volume group "vg" successfully created
> > # lvcreate -L 32g -m 1 -n lv vg
> >   Logical volume "lv" created
> > 
> > The status showed:
> > 
> > # lvs -a -o +devices
> >   LV            VG   Attr   LSize  Origin Snap%  Move Log     Copy%
> > Convert Devices                      
> >   lv            vg   mwi-a- 32.00G                    lv_mlog  29.72
> > lv_mimage_0(0),lv_mimage_1(0)
> >   [lv_mimage_0] vg   Iwi-ao
> > 32.00G                                           /dev/sdcn(0)                 
> >   [lv_mimage_1] vg   Iwi-ao
> > 32.00G                                           /dev/sdfj(0)                 
> >   [lv_mlog]     vg   lwi-ao
> > 4.00M                                           /dev/sdfa(0)                 
> > 
> > Then I forced /dev/sdfj to fail (removing the unit from the FC SAN), and
> > the state of the mirror went to:
> > 
> > # lvs
> >   /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
> >   LV   VG   Attr   LSize  Origin Snap%  Move Log Copy%  Convert
> >   lv   vg   -wi-a- 32.00G           
> > 
> > At this point I know I can do:
> > 
> > # vgreduce -a vg
> >   /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
> >   Physical volume "/dev/sdcn" still in use
> >   Removed "/dev/sdfa" from volume group "vg"
> > 
> > But I run into two problems:
> > 
> > (1) I'd like to be able to live without the constant errors
> > about /dev/sdfj, and tried:
> > 
> > # pvremove -f /dev/sdfj
> >   /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
> >   No physical volume label read from /dev/sdfj
> >   /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
> >   Labels on physical volume "/dev/sdfj" successfully wiped
> > 
> > but that didn't stop it. 
> > 
> > and:
> > 
> > (2) I'd like to be able to recreate the 1-copy mirror from the currently
> > linear volume, but can't (easily):
> > 
> > # pvcreate --metadatasize 192k /dev/sdp
> >   Physical volume "/dev/sdp" successfully created
> > # vgextend vg /dev/sdp
> >   ... errors from sdfj omitted...
> >   Volume group "vg" successfully extended
> > # vgs
> >   /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
> >   VG   #PV #LV #SN Attr   VSize   VFree  
> >   vg     2   1   0 wz--n- 542.67G 510.67G
> > # lvconvert -m 1 /dev/vg/lv
> >   /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
> >   Insufficient suitable allocatable extents for logical volume : 8192
> > more required
> >   Unable to allocate extents for mirror(s).
> > 
> > I can use the alloc anywhere options, but I'm at a loss as to why that's
> > needed:
> > 
> > # lvconvert -m1 --alloc anywhere /dev/vg/lv
> >   /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
> >   /dev/vg/lv: Converted: 1.3%
> >   /dev/vg/lv: Converted: 2.6%
> >   /dev/vg/lv: Converted: 3.8%
> > ...
> > 
> > 
> > Any pointers on how to remove /dev/sdfj from the scan (other than, I
> > guess, updated /etc/lvm.conf to filter it out)
> 
> The following URL explains how to remove lost PVs from VG.
> 
> 6.6. Removing Lost Physical Volumes from a Volume Group
> http://www.redhat.com/docs/manuals/enterprise/RHEL-5-manual/Cluster_Logical_Volume_Manager/lost_PV_remove_from_VG.html
> 
> I think "vgreduce --removemissing vg" will remove "/dev/sdfj."
> 
> > or an explanation as to
> > why the 'alloc anywhere' is needed for the lvconvert would be muchly
> > appreciated.
> 
> To create a mirror volume with disk log, three PVs are required in the VG
> to allocate two mirror legs and one mirror log. But in this case, the "vg"
> contains only two valid PVs (/dev/sdcn and /dev/sdp), and '--alloc anywhere'
> options is necessary to allocate a mirror log on the same disk as mirror legs.

Or add /dev/sdfa back to your vg (you removed it, right?)

Re: Removing a failed device from LVM2/DM

[Alan D. Brunelle]

On Mon, 2009-08-31 at 12:02 -0400, Takahiro Yasui wrote:
> On 08/31/09 11:16, Alan D. Brunelle wrote:
> > I constructed a 1-copy mirror with the following commands:
> > 
> > # pvcreate --metadatasize 192k /dev/sdcn /dev/sdfj /dev/sdfa
> >   Physical volume "/dev/sdcn" successfully created
> >   Physical volume "/dev/sdfj" successfully created
> >   Physical volume "/dev/sdfa" successfully created
> > # vgcreate vg /dev/sdcn /dev/sdfj /dev/sdfa
> >   Volume group "vg" successfully created
> > # lvcreate -L 32g -m 1 -n lv vg
> >   Logical volume "lv" created
> > 
> > The status showed:
> > 
> > # lvs -a -o +devices
> >   LV            VG   Attr   LSize  Origin Snap%  Move Log     Copy%
> > Convert Devices                      
> >   lv            vg   mwi-a- 32.00G                    lv_mlog  29.72
> > lv_mimage_0(0),lv_mimage_1(0)
> >   [lv_mimage_0] vg   Iwi-ao
> > 32.00G                                           /dev/sdcn(0)                 
> >   [lv_mimage_1] vg   Iwi-ao
> > 32.00G                                           /dev/sdfj(0)                 
> >   [lv_mlog]     vg   lwi-ao
> > 4.00M                                           /dev/sdfa(0)                 
> > 
> > Then I forced /dev/sdfj to fail (removing the unit from the FC SAN), and
> > the state of the mirror went to:
> > 
> > # lvs
> >   /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
> >   LV   VG   Attr   LSize  Origin Snap%  Move Log Copy%  Convert
> >   lv   vg   -wi-a- 32.00G           
> > 
> > At this point I know I can do:
> > 
> > # vgreduce -a vg
> >   /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
> >   Physical volume "/dev/sdcn" still in use
> >   Removed "/dev/sdfa" from volume group "vg"
> > 
> > But I run into two problems:
> > 
> > (1) I'd like to be able to live without the constant errors
> > about /dev/sdfj, and tried:
> > 
> > # pvremove -f /dev/sdfj
> >   /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
> >   No physical volume label read from /dev/sdfj
> >   /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
> >   Labels on physical volume "/dev/sdfj" successfully wiped
> > 
> > but that didn't stop it. 
> > 
> > and:
> > 
> > (2) I'd like to be able to recreate the 1-copy mirror from the currently
> > linear volume, but can't (easily):
> > 
> > # pvcreate --metadatasize 192k /dev/sdp
> >   Physical volume "/dev/sdp" successfully created
> > # vgextend vg /dev/sdp
> >   ... errors from sdfj omitted...
> >   Volume group "vg" successfully extended
> > # vgs
> >   /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
> >   VG   #PV #LV #SN Attr   VSize   VFree  
> >   vg     2   1   0 wz--n- 542.67G 510.67G
> > # lvconvert -m 1 /dev/vg/lv
> >   /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
> >   Insufficient suitable allocatable extents for logical volume : 8192
> > more required
> >   Unable to allocate extents for mirror(s).
> > 
> > I can use the alloc anywhere options, but I'm at a loss as to why that's
> > needed:
> > 
> > # lvconvert -m1 --alloc anywhere /dev/vg/lv
> >   /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
> >   /dev/vg/lv: Converted: 1.3%
> >   /dev/vg/lv: Converted: 2.6%
> >   /dev/vg/lv: Converted: 3.8%
> > ...
> > 
> > 
> > Any pointers on how to remove /dev/sdfj from the scan (other than, I
> > guess, updated /etc/lvm.conf to filter it out)
> 
> The following URL explains how to remove lost PVs from VG.
> 
> 6.6. Removing Lost Physical Volumes from a Volume Group
> http://www.redhat.com/docs/manuals/enterprise/RHEL-5-manual/Cluster_Logical_Volume_Manager/lost_PV_remove_from_VG.html
> 
> I think "vgreduce --removemissing vg" will remove "/dev/sdfj."


I guess this is an interesting problem:


> > > # vgreduce -a vg
> > >   /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
> > >   Physical volume "/dev/sdcn" still in use
> > >   Removed "/dev/sdfa" from volume group "vg"
> > 

So, /dev/sdfa was removed from the volume group instead of /dev/sdfj (Why? /dev/sdfa was being used for the mirror log - but since the volume group was downgraded to a linear array, it was no longer needed? Doesn't sound like the right thing to do - hence I should have used the --test and worked it out from that). I'll go retry the experiment and do the "removemissing" command.

And since /dev/sdfa was removed & /dev/sdfj was failed that left only a single physical disk in the VG, then when I added in /dev/sdp it only brought the volume group to two devices. <sigh>

> 
> > or an explanation as to
> > why the 'alloc anywhere' is needed for the lvconvert would be muchly
> > appreciated.
> 
> To create a mirror volume with disk log, three PVs are required in the VG
> to allocate two mirror legs and one mirror log. But in this case, the "vg"
> contains only two valid PVs (/dev/sdcn and /dev/sdp), and '--alloc anywhere'
> options is necessary to allocate a mirror log on the same disk as mirror legs.
> 
> I hope this would be help.
> 
> Thanks,
> Taka
> 
> --
> dm-devel mailing list
> dm-devel@redhat.com
> https://www.redhat.com/mailman/listinfo/dm-devel

Re: Removing a failed device from LVM2/DM

[Takahiro Yasui]

On 08/31/09 12:55, Alan D. Brunelle wrote:
> On Mon, 2009-08-31 at 12:02 -0400, Takahiro Yasui wrote:
>> On 08/31/09 11:16, Alan D. Brunelle wrote:
>>> I constructed a 1-copy mirror with the following commands:
>>>
>>> # pvcreate --metadatasize 192k /dev/sdcn /dev/sdfj /dev/sdfa
>>>   Physical volume "/dev/sdcn" successfully created
>>>   Physical volume "/dev/sdfj" successfully created
>>>   Physical volume "/dev/sdfa" successfully created
>>> # vgcreate vg /dev/sdcn /dev/sdfj /dev/sdfa
>>>   Volume group "vg" successfully created
>>> # lvcreate -L 32g -m 1 -n lv vg
>>>   Logical volume "lv" created
>>>
>>> The status showed:
>>>
>>> # lvs -a -o +devices
>>>   LV            VG   Attr   LSize  Origin Snap%  Move Log     Copy%
>>> Convert Devices                      
>>>   lv            vg   mwi-a- 32.00G                    lv_mlog  29.72
>>> lv_mimage_0(0),lv_mimage_1(0)
>>>   [lv_mimage_0] vg   Iwi-ao
>>> 32.00G                                           /dev/sdcn(0)                 
>>>   [lv_mimage_1] vg   Iwi-ao
>>> 32.00G                                           /dev/sdfj(0)                 
>>>   [lv_mlog]     vg   lwi-ao
>>> 4.00M                                           /dev/sdfa(0)                 
>>>
>>> Then I forced /dev/sdfj to fail (removing the unit from the FC SAN), and
>>> the state of the mirror went to:
>>>
>>> # lvs
>>>   /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
>>>   LV   VG   Attr   LSize  Origin Snap%  Move Log Copy%  Convert
>>>   lv   vg   -wi-a- 32.00G           
>>>
>>> At this point I know I can do:
>>>
>>> # vgreduce -a vg
>>>   /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
>>>   Physical volume "/dev/sdcn" still in use
>>>   Removed "/dev/sdfa" from volume group "vg"
>>>
>>> But I run into two problems:
>>>
>>> (1) I'd like to be able to live without the constant errors
>>> about /dev/sdfj, and tried:
>>>
>>> # pvremove -f /dev/sdfj
>>>   /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
>>>   No physical volume label read from /dev/sdfj
>>>   /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
>>>   Labels on physical volume "/dev/sdfj" successfully wiped
>>>
>>> but that didn't stop it. 
>>>
>>> and:
>>>
>>> (2) I'd like to be able to recreate the 1-copy mirror from the currently
>>> linear volume, but can't (easily):
>>>
>>> # pvcreate --metadatasize 192k /dev/sdp
>>>   Physical volume "/dev/sdp" successfully created
>>> # vgextend vg /dev/sdp
>>>   ... errors from sdfj omitted...
>>>   Volume group "vg" successfully extended
>>> # vgs
>>>   /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
>>>   VG   #PV #LV #SN Attr   VSize   VFree  
>>>   vg     2   1   0 wz--n- 542.67G 510.67G
>>> # lvconvert -m 1 /dev/vg/lv
>>>   /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
>>>   Insufficient suitable allocatable extents for logical volume : 8192
>>> more required
>>>   Unable to allocate extents for mirror(s).
>>>
>>> I can use the alloc anywhere options, but I'm at a loss as to why that's
>>> needed:
>>>
>>> # lvconvert -m1 --alloc anywhere /dev/vg/lv
>>>   /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
>>>   /dev/vg/lv: Converted: 1.3%
>>>   /dev/vg/lv: Converted: 2.6%
>>>   /dev/vg/lv: Converted: 3.8%
>>> ...
>>>
>>>
>>> Any pointers on how to remove /dev/sdfj from the scan (other than, I
>>> guess, updated /etc/lvm.conf to filter it out)
>> The following URL explains how to remove lost PVs from VG.
>>
>> 6.6. Removing Lost Physical Volumes from a Volume Group
>> http://www.redhat.com/docs/manuals/enterprise/RHEL-5-manual/Cluster_Logical_Volume_Manager/lost_PV_remove_from_VG.html
>>
>> I think "vgreduce --removemissing vg" will remove "/dev/sdfj."
> 
> 
> I guess this is an interesting problem:
> 
> 
>>>> # vgreduce -a vg
>>>>   /dev/sdfj: read failed after 0 of 2048 at 0: Input/output error
>>>>   Physical volume "/dev/sdcn" still in use
>>>>   Removed "/dev/sdfa" from volume group "vg"
> 
> So, /dev/sdfa was removed from the volume group instead of /dev/sdfj (Why? /dev/sdfa was being used for the mirror log - but since the volume group was downgraded to a linear array, it was no longer needed? Doesn't sound like the right thing to do - hence I should have used the --test and worked it out from that). I'll go retry the experiment and do the "removemissing" command.
> And since /dev/sdfa was removed & /dev/sdfj was failed that left only a single physical disk in the VG, then when I added in /dev/sdp it only brought the volume group to two devices. <sigh>

When you executed "vgreduce -a vg," the mirror volume, "lv", had already been converted
to non-mirror (linear) volume. The linear device is not a mirror device any more, and
a log disk is not used. So /dev/sdfa was removed since it was not used. I'm not sure why
a missing device is not removed by "vgreduce -a vg," but vgreduce provides an option to
remove a missing device and we can use it instead of executing "vgreduce -a."

Thanks,
Taka

Re: Removing a failed device from LVM2/DM

[Alan D. Brunelle]

[-- Attachment #1: Type: text/plain, Size: 1932 bytes --]

The vgreduce --removemissing helped a lot, thanks! But I still remain
with all these error messages about the removed device. I tried
everything again - using devices sda, sdab & sdad (failing sdab), and
now every time I issue an LVM2/DM command I get all sorts of error
messages about /dev/sdab failures. The 'pvs -a -o +devices' command not
only puts out a ton - but also has a messed up display about the devices
left working:

# pvs -a -o +devices
  /dev/sdab: read failed after 0 of 2048 at 0: Input/output error
  Volume group name (null) has invalid characters
  Skipping volume group (null)
...
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  PV         VG   Fmt  Attr PSize   PFree   Devices    
  /dev/sda   vg   lvm2 a-   271.34G 239.34G /dev/sda(0)
  /dev/sda   vg   lvm2 a-   271.34G 239.34G            
  /dev/sda   vg   lvm2 a-   271.34G 239.34G            
  /dev/sdad  vg   lvm2 a-   271.34G 271.34G            
  /dev/sdad  vg   lvm2 a-   271.34G 271.34G

Why the 5 lines for 2 devices?

I've attached a log of commands & results.

I have tried adding in "/dev/sdab" as being filtered out
in /etc/lvm/lvm.conf but that doesn't change things. Here is first part
of the output from lvm dumpconfig:

# lvm dumpconfig
  devices {
  	dir="/dev"
  	scan="/dev"
  	preferred_names=[]
  	filter=["r|sdab|", "a/.*/"]
  	cache_dir="/etc/lvm/cache"
  	cache_file_prefix=""
  	write_cache_state=1
  	sysfs_scan=1
  	md_component_detection=1
  	md_chunk_alignment=1
  	ignore_suspended_devices=0
  }

but commands still error on /dev/sdab:

# lvs
  /dev/sdab: read failed after 0 of 2048 at 0: Input/output error
  LV   VG   Attr   LSize  Origin Snap%  Move Log     Copy%  Convert
  lv   vg   mwi-a- 32.00G                    lv_mlog 100.00

So, how do I stop LVM2/DM from "looking at" /dev/sdab?

Thanks,
Alan

[-- Attachment #2: lvm_log.txt --]
[-- Type: text/plain, Size: 41659 bytes --]


# pvcreate --metadatasize 192k /dev/sda /dev/sdab /dev/sdad
  Physical volume "/dev/sda" successfully created
  Physical volume "/dev/sdab" successfully created
  Physical volume "/dev/sdad" successfully created

# vgcreate vg /dev/sda /dev/sdab /dev/sdad
  Volume group "vg" successfully created

# lvcreate -L 32g -m 1 -n lv vg
  Logical volume "lv" created

# watch -n 5 lvs
Every 5.0s: lvs                                         Tue Sep  1 09:32:03 2009

  LV   VG   Attr   LSize  Origin Snap%  Move Log     Copy%  Convert
  lv   vg   mwi-a- 32.00G                    lv_mlog   6.08

...

  LV   VG   Attr   LSize  Origin Snap%  Move Log     Copy%  Convert
  lv   vg   mwi-a- 32.00G                    lv_mlog 100.00

# lvs -a -o +devices
  LV            VG   Attr   LSize  Origin Snap%  Move Log     Copy%  Convert Devices                      
  lv            vg   mwi-a- 32.00G                    lv_mlog 100.00         lv_mimage_0(0),lv_mimage_1(0)
  [lv_mimage_0] vg   iwi-ao 32.00G                                           /dev/sda(0)                  
  [lv_mimage_1] vg   iwi-ao 32.00G                                           /dev/sdab(0)                 
  [lv_mlog]     vg   lwi-ao  4.00M                                           /dev/sdad(0)

*** FAILED /dev/sdab ***

# lvs
  /dev/sdab: read failed after 0 of 2048 at 0: Input/output error
  LV   VG   Attr   LSize  Origin Snap%  Move Log Copy%  Convert
  lv   vg   -wi-a- 32.00G

# vgreduce --removemissing --test /dev/vg
  Test mode: Metadata will NOT be updated.
  /dev/sdab: read failed after 0 of 2048 at 0: Input/output error
  Volume group "vg" is already consistent

# vgreduce --removemissing /dev/vg
  /dev/sdab: read failed after 0 of 2048 at 0: Input/output error
  Volume group "vg" is already consistent

# pvs
  /dev/sdab: read failed after 0 of 2048 at 0: Input/output error
  PV         VG   Fmt  Attr PSize   PFree  
  /dev/sda   vg   lvm2 a-   271.34G 239.34G
  /dev/sdad  vg   lvm2 a-   271.34G 271.34G

# pvs -a -o +devices
  /dev/sdab: read failed after 0 of 2048 at 0: Input/output error
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  /dev/sdab: read failed after 0 of 512 at 0: Input/output error
  /dev/sdab: read failed after 0 of 512 at 291347562496: Input/output error
  /dev/sdab: read failed after 0 of 512 at 291347632128: Input/output error
  /dev/sdab: read failed after 0 of 512 at 0: Input/output error
  /dev/sdab: read failed after 0 of 512 at 4096: Input/output error
  /dev/sdab: read failed after 0 of 2048 at 0: Input/output error
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  PV         VG   Fmt  Attr PSize   PFree   Devices    
  /dev/sda   vg   lvm2 a-   271.34G 239.34G /dev/sda(0)
  /dev/sda   vg   lvm2 a-   271.34G 239.34G            
  /dev/sda   vg   lvm2 a-   271.34G 239.34G            
  /dev/sdad  vg   lvm2 a-   271.34G 271.34G            
  /dev/sdad  vg   lvm2 a-   271.34G 271.34G

# root@dl785b(root):pvcreate /dev/sdfi
  Physical volume "/dev/sdfi" successfully created

# vgextend vg /dev/sdfi
  /dev/sdab: read failed after 0 of 2048 at 0: Input/output error
  /dev/sdab: read failed after 0 of 512 at 0: Input/output error
  /dev/sdab: read failed after 0 of 512 at 291347562496: Input/output error
  /dev/sdab: read failed after 0 of 512 at 291347632128: Input/output error
  /dev/sdab: read failed after 0 of 512 at 0: Input/output error
  /dev/sdab: read failed after 0 of 512 at 4096: Input/output error
  /dev/sdab: read failed after 0 of 2048 at 0: Input/output error
  Volume group "vg" successfully extended

# pvs
  /dev/sdab: read failed after 0 of 2048 at 0: Input/output error
  PV         VG   Fmt  Attr PSize   PFree  
  /dev/sda   vg   lvm2 a-   271.34G 239.34G
  /dev/sdad  vg   lvm2 a-   271.34G 271.34G
  /dev/sdfi  vg   lvm2 a-   271.34G 271.34G

# lvdisplay -m
  /dev/sdab: read failed after 0 of 2048 at 0: Input/output error
  --- Logical volume ---
  LV Name                /dev/vg/lv
  VG Name                vg
  LV UUID                L0n377-sqiL-282A-wVjZ-ipB4-N21I-wMwa7U
  LV Write Access        read/write
  LV Status              available
  # open                 0
  LV Size                32.00 GB
  Current LE             8192
  Segments               1
  Allocation             inherit
  Read ahead sectors     auto
  - currently set to     256
  Block device           253:3
   
  --- Segments ---
  Logical extent 0 to 8191:
    Type		linear
    Physical volume	/dev/sda
    Physical extents	0 to 8191

# lvconvert -m 1 /dev/vg/lv
  /dev/sdab: read failed after 0 of 2048 at 0: Input/output error
  /dev/vg/lv: Converted: 2.2%
  /dev/vg/lv: Converted: 4.4%
  /dev/vg/lv: Converted: 6.7%
...
  /dev/vg/lv: Converted: 95.8%
  /dev/vg/lv: Converted: 98.0%
  /dev/vg/lv: Converted: 100.0%
  Logical volume lv converted.

# lvdisplay -m
  /dev/sdab: read failed after 0 of 2048 at 0: Input/output error
  --- Logical volume ---
  LV Name                /dev/vg/lv
  VG Name                vg
  LV UUID                L0n377-sqiL-282A-wVjZ-ipB4-N21I-wMwa7U
  LV Write Access        read/write
  LV Status              available
  # open                 0
  LV Size                32.00 GB
  Current LE             8192
  Segments               1
  Allocation             inherit
  Read ahead sectors     auto
  - currently set to     256
  Block device           253:3
   
  --- Segments ---
  Logical extent 0 to 8191:
    Type		mirror
    Mirrors		2
    Mirror size		8192
    Mirror log volume	lv_mlog
    Mirror region size	512.00 KB
    Mirror original:
      Logical volume	lv_mimage_0
      Logical extents	0 to 8191
    Mirror destinations:
      Logical volume	lv_mimage_1
      Logical extents	0 to 8191
   

# pvs -a -o +devices
  /dev/sdab: read failed after 0 of 2048 at 0: Input/output error
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  /dev/sdab: read failed after 0 of 512 at 0: Input/output error
  /dev/sdab: read failed after 0 of 512 at 291347562496: Input/output error
  /dev/sdab: read failed after 0 of 512 at 291347632128: Input/output error
  /dev/sdab: read failed after 0 of 512 at 0: Input/output error
  /dev/sdab: read failed after 0 of 512 at 4096: Input/output error
  /dev/sdab: read failed after 0 of 2048 at 0: Input/output error
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  Volume group name (null) has invalid characters
  Skipping volume group (null)
  PV         VG   Fmt  Attr PSize   PFree   Devices     
  /dev/sda   vg   lvm2 a-   271.34G 239.34G /dev/sda(0) 
  /dev/sda   vg   lvm2 a-   271.34G 239.34G             
  /dev/sda   vg   lvm2 a-   271.34G 239.34G             
  /dev/sdad  vg   lvm2 a-   271.34G 239.34G /dev/sdad(0)
  /dev/sdad  vg   lvm2 a-   271.34G 239.34G             
  /dev/sdad  vg   lvm2 a-   271.34G 239.34G             
  /dev/sdfi  vg   lvm2 a-   271.34G 271.33G /dev/sdfi(0)
  /dev/sdfi  vg   lvm2 a-   271.34G 271.33G             
  /dev/sdfi  vg   lvm2 a-   271.34G 271.33G

# lvm dumpconfig
  devices {
  	dir="/dev"
  	scan="/dev"
  	preferred_names=[]
  	filter=["r|sdab|", "a/.*/"]
  	cache_dir="/etc/lvm/cache"
  	cache_file_prefix=""
  	write_cache_state=1
  	sysfs_scan=1
  	md_component_detection=1
  	md_chunk_alignment=1
  	ignore_suspended_devices=0
  }
  dmeventd {
  	mirror_library="libdevmapper-event-lvm2mirror.so"
  	snapshot_library="libdevmapper-event-lvm2snapshot.so"
  }
  activation {
  	missing_stripe_filler="error"
  	reserved_stack=256
  	reserved_memory=8192
  	process_priority=-18
  	mirror_region_size=512
  	readahead="auto"
  	mirror_log_fault_policy="allocate"
  	mirror_device_fault_policy="remove"
  }
  global {
  	umask=63
  	test=0
  	units="h"
  	activation=1
  	proc="/proc"
  	locking_type=1
  	fallback_to_clustered_locking=1
  	fallback_to_local_locking=1
  	locking_dir="/var/lock/lvm"
  }
  shell {
  	history_size=100
  }
  backup {
  	backup=1
  	backup_dir="/etc/lvm/backup"
  	archive=1
  	archive_dir="/etc/lvm/archive"
  	retain_min=10
  	retain_days=30
  }
  log {
  	verbose=0
  	syslog=1
  	overwrite=0
  	level=0
  	indent=1
  	command_names=0
  	prefix="  "
  }

[-- Attachment #3: Type: text/plain, Size: 0 bytes --]

Re: Removing a failed device from LVM2/DM

[malahal]

Alan D. Brunelle [Alan.Brunelle@hp.com] wrote:
> The vgreduce --removemissing helped a lot, thanks! But I still remain
> with all these error messages about the removed device. I tried
> everything again - using devices sda, sdab & sdad (failing sdab), and
> now every time I issue an LVM2/DM command I get all sorts of error
> messages about /dev/sdab failures. The 'pvs -a -o +devices' command not
> only puts out a ton - but also has a messed up display about the devices
> left working:
> 
> # pvs -a -o +devices
>   /dev/sdab: read failed after 0 of 2048 at 0: Input/output error
>   Volume group name (null) has invalid characters
>   Skipping volume group (null)
> ...
>   Volume group name (null) has invalid characters
>   Skipping volume group (null)
>   Volume group name (null) has invalid characters
>   Skipping volume group (null)
>   PV         VG   Fmt  Attr PSize   PFree   Devices    
>   /dev/sda   vg   lvm2 a-   271.34G 239.34G /dev/sda(0)
>   /dev/sda   vg   lvm2 a-   271.34G 239.34G            
>   /dev/sda   vg   lvm2 a-   271.34G 239.34G            
>   /dev/sdad  vg   lvm2 a-   271.34G 271.34G            
>   /dev/sdad  vg   lvm2 a-   271.34G 271.34G
> 
> Why the 5 lines for 2 devices?
> 
> I've attached a log of commands & results.
> 
> I have tried adding in "/dev/sdab" as being filtered out
> in /etc/lvm/lvm.conf but that doesn't change things. Here is first part
> of the output from lvm dumpconfig:
> 
> # lvm dumpconfig
>   devices {
>   	dir="/dev"
>   	scan="/dev"
>   	preferred_names=[]
>   	filter=["r|sdab|", "a/.*/"]
>   	cache_dir="/etc/lvm/cache"
>   	cache_file_prefix=""
>   	write_cache_state=1
>   	sysfs_scan=1
>   	md_component_detection=1
>   	md_chunk_alignment=1
>   	ignore_suspended_devices=0
>   }
> 
> but commands still error on /dev/sdab:

Did you remove the cache or ran vgscan?
/etc/lvm/lvm.conf recommends running 'vgscan -vvvv' to see what is going
on with filters.

Re: Removing a failed device from LVM2/DM

[Alan D. Brunelle]

On Tue, 2009-09-01 at 09:25 -0700, malahal@us.ibm.com wrote:
> Alan D. Brunelle [Alan.Brunelle@hp.com] wrote:
> > The vgreduce --removemissing helped a lot, thanks! But I still remain
> > with all these error messages about the removed device. I tried
> > everything again - using devices sda, sdab & sdad (failing sdab), and
> > now every time I issue an LVM2/DM command I get all sorts of error
> > messages about /dev/sdab failures. The 'pvs -a -o +devices' command not
> > only puts out a ton - but also has a messed up display about the devices
> > left working:
> > 
> > # pvs -a -o +devices
> >   /dev/sdab: read failed after 0 of 2048 at 0: Input/output error
> >   Volume group name (null) has invalid characters
> >   Skipping volume group (null)
> > ...
> >   Volume group name (null) has invalid characters
> >   Skipping volume group (null)
> >   Volume group name (null) has invalid characters
> >   Skipping volume group (null)
> >   PV         VG   Fmt  Attr PSize   PFree   Devices    
> >   /dev/sda   vg   lvm2 a-   271.34G 239.34G /dev/sda(0)
> >   /dev/sda   vg   lvm2 a-   271.34G 239.34G            
> >   /dev/sda   vg   lvm2 a-   271.34G 239.34G            
> >   /dev/sdad  vg   lvm2 a-   271.34G 271.34G            
> >   /dev/sdad  vg   lvm2 a-   271.34G 271.34G
> > 
> > Why the 5 lines for 2 devices?
> > 
> > I've attached a log of commands & results.
> > 
> > I have tried adding in "/dev/sdab" as being filtered out
> > in /etc/lvm/lvm.conf but that doesn't change things. Here is first part
> > of the output from lvm dumpconfig:
> > 
> > # lvm dumpconfig
> >   devices {
> >   	dir="/dev"
> >   	scan="/dev"
> >   	preferred_names=[]
> >   	filter=["r|sdab|", "a/.*/"]
> >   	cache_dir="/etc/lvm/cache"
> >   	cache_file_prefix=""
> >   	write_cache_state=1
> >   	sysfs_scan=1
> >   	md_component_detection=1
> >   	md_chunk_alignment=1
> >   	ignore_suspended_devices=0
> >   }
> > 
> > but commands still error on /dev/sdab:
> 
> Did you remove the cache or ran vgscan?
> /etc/lvm/lvm.conf recommends running 'vgscan -vvvv' to see what is going
> on with filters.
> 
> --
> dm-devel mailing list
> dm-devel@redhat.com
> https://www.redhat.com/mailman/listinfo/dm-devel

#device/dev-cache.c:245         /dev/sdab: Already in device cache

How does one remove the cache? I tried remove /etc/lvm/cache/.cache &
running vgscan, but no difference.

Alan

Re: Removing a failed device from LVM2/DM

[malahal]

Alan D. Brunelle [Alan.Brunelle@hp.com] wrote:
> #device/dev-cache.c:245         /dev/sdab: Already in device cache
> 
> How does one remove the cache? I tried remove /etc/lvm/cache/.cache &
> running vgscan, but no difference.
> 
> Alan

I think removing that file should help. What is your cache_dir setting
in /etc/lvm.conf file? You can completely remove that dir. On my
machine, cache_dir is set to /etc/lvm/cache and doing "rm -rf
/etc/lvm/cache" or "rm -f /etc/lvm/cache/.cache" should help.

BTW, the .cache file is just a text file, see what is there.

Thanks, Malahal.

Re: Removing a failed device from LVM2/DM

[Alan D. Brunelle]

[-- Attachment #1: Type: text/plain, Size: 1908 bytes --]

On Tue, 2009-09-01 at 12:08 -0700, malahal@us.ibm.com wrote:
> Alan D. Brunelle [Alan.Brunelle@hp.com] wrote:
> > #device/dev-cache.c:245         /dev/sdab: Already in device cache
> > 
> > How does one remove the cache? I tried remove /etc/lvm/cache/.cache &
> > running vgscan, but no difference.
> > 
> > Alan
> 
> I think removing that file should help. What is your cache_dir setting
> in /etc/lvm.conf file? You can completely remove that dir. On my
> machine, cache_dir is set to /etc/lvm/cache and doing "rm -rf
> /etc/lvm/cache" or "rm -f /etc/lvm/cache/.cache" should help.
> 
> BTW, the .cache file is just a text file, see what is there.
> 
> Thanks, Malahal.
> 
> --
> dm-devel mailing list
> dm-devel@redhat.com
> https://www.redhat.com/mailman/listinfo/dm-devel

Unfortunately:

# rm -rf /etc/lvm/cache

# vgscan
  Reading all physical volumes.  This may take a while...
  /dev/disk/by-id/scsi-360060b0000837a508c01035ef0d00033: read failed
after 0 of 512 at 0: Input/output error
  /dev/disk/by-id/scsi-360060b0000837a508c01035ef0d00033: read failed
after 0 of 512 at 291347562496: Input/output error
  /dev/disk/by-id/scsi-360060b0000837a508c01035ef0d00033: read failed
after 0 of 512 at 291347632128: Input/output error
  /dev/disk/by-id/scsi-360060b0000837a508c01035ef0d00033: read failed
after 0 of 512 at 0: Input/output error
  /dev/disk/by-id/scsi-360060b0000837a508c01035ef0d00033: read failed
after 0 of 512 at 4096: Input/output error
  /dev/disk/by-id/scsi-360060b0000837a508c01035ef0d00033: read failed
after 0 of 2048 at 0: Input/output error
  Found volume group "vg" using metadata type lvm2

# pvs
  /dev/sdab: read failed after 0 of 2048 at 0: Input/output error
  PV         VG   Fmt  Attr PSize   PFree  
  /dev/sda   vg   lvm2 a-   271.34G 239.34G
  /dev/sdad  vg   lvm2 a-   271.34G 239.34G
  /dev/sdfi  vg   lvm2 a-   271.34G 271.33G

The .cache file is attached

Alan


[-- Attachment #2: cache.txt --]
[-- Type: text/plain, Size: 29944 bytes --]

# This file is automatically maintained by lvm.

persistent_filter_cache {
	valid_devices=[
		"/dev/disk/by-label/boot1",
		"/dev/disk/by-id/scsi-360014380000846009225d792139b0033",
		"/dev/disk/by-id/scsi-360060b00008483c0148c0725bc790044",
		"/dev/disk/by-path/pci-0000:0a:00.1-fc-0x50060b000083eed1:0x0002000000000000",
		"/dev/disk/by-path/pci-0000:47:00.1-fc-0x50060b000084a961:0x0002000000000000",
		"/dev/disk/by-path/pci-0000:44:00.0-fc-0x50060b00008381d1:0x0002000000000000",
		"/dev/disk/by-id/scsi-360060b00008441c0bc6dea826cd50036",
		"/dev/disk/by-id/scsi-360060b0000840620428d9d82bd230033",
		"/dev/disk/by-id/scsi-36001438000084600b59c9d833ec60030",
		"/dev/disk/by-id/scsi-360060b0000848200b6ace0fe959d0044",
		"/dev/disk/by-id/scsi-360014380000844309c5edddb1578002a",
		"/dev/disk/by-path/pci-0000:c1:00.1-fc-0x50060b0000848141:0x0002000000000000",
		"/dev/disk/by-path/pci-0000:81:00.1-fc-0x50060b00008480f1:0x0003000000000000",
		"/dev/disk/by-id/scsi-36001438000080040cf34fee3f72b001f",
		"/dev/disk/by-id/scsi-360060b00008482808214a37b95c7003b",
		"/dev/mapper/vg-lv",
		"/dev/disk/by-id/scsi-360014380000803608413229db5ab0026",
		"/dev/disk/by-path/pci-0000:0a:00.0-fc-0x50060b00008381e1:0x0004000000000000",
		"/dev/disk/by-id/scsi-360014380000847304539bf3b177d001d",
		"/dev/ram11",
		"/dev/disk/by-id/scsi-360060b00008441c0a86b0e8df5180038",
		"/dev/disk/by-id/scsi-360060b00008474d0eb296301f5300036",
		"/dev/disk/by-path/pci-0000:84:00.1-fc-0x50060b0000848261:0x0002000000000000",
		"/dev/disk/by-id/scsi-360060b00008381f0dd81a844bbd70044",
		"/dev/disk/by-path/pci-0000:c4:00.0-fc-0x50060b0000847511:0x0005000000000000",
		"/dev/sdh",
		"/dev/disk/by-id/scsi-360060b0000840e10fd2f3f55d3f20033",
		"/dev/disk/by-id/scsi-360060b0000840620d5a38b7d79010032",
		"/dev/disk/by-id/scsi-360014380000845908b88df3cfa110014",
		"/dev/sdo",
		"/dev/disk/by-path/pci-0000:04:00.1-fc-0x50060b00008441c1:0x0004000000000000",
		"/dev/disk/by-id/scsi-360060b00008410a05abba43deea3003e",
		"/dev/disk/by-id/scsi-360060b00008441207d37344b0e4b004d-part3",
		"/dev/disk/by-id/scsi-360060b00008441207d37344b0e4b004d-part4",
		"/dev/disk/by-path/pci-0000:07:00.0-fc-0x50060b00008410a1:0x0004000000000000",
		"/dev/disk/by-id/scsi-360060b0000848530c508ecfac76c004e",
		"/dev/disk/by-id/scsi-360060b00008379e0633268092c640037",
		"/dev/disk/by-id/scsi-360060b00008482807273ca85ff73003d",
		"/dev/disk/by-id/scsi-360014380000803608fd9fd922d650024",
		"/dev/disk/by-path/pci-0000:44:00.1-fc-0x50060b00008381f1:0x0004000000000000",
		"/dev/disk/by-id/scsi-360060b0000840f7020e8880a398b0035",
		"/dev/disk/by-id/scsi-360060b000084853015a0d9f57ae1004d",
		"/dev/disk/by-id/scsi-360060b00008325a00086dc1003c40050",
		"/dev/disk/by-path/pci-0000:04:00.0-fc-0x50060b00008325a1:0x0003000000000000",
		"/dev/disk/by-id/scsi-360060b0000837a50574b18633d5a0034",
		"/dev/disk/by-id/scsi-360060b00008482803ef4218b91b8003e",
		"/dev/disk/by-id/scsi-360060b0000840f706f0fad149b150037",
		"/dev/disk/by-path/pci-0000:81:00.0-fc-0x50060b0000837f31:0x0005000000000000",
		"/dev/disk/by-path/pci-0000:04:00.1-fc-0x50060b0000844221:0x0004000000000000",
		"/dev/disk/by-id/scsi-360060b00008482802728b580bb32003c",
		"/dev/sdag",
		"/dev/disk/by-path/pci-0000:81:00.1-fc-0x50060b00008483d1:0x0005000000000000",
		"/dev/sdai1",
		"/dev/sdaj",
		"/dev/sdak",
		"/dev/sdcg",
		"/dev/disk/by-id/scsi-360060b00008441c0470dd57d217b0035",
		"/dev/sdcj",
		"/dev/disk/by-id/scsi-360060b00008381e01f9c73e7f745003b",
		"/dev/sdck",
		"/dev/sdbg",
		"/dev/sdbj",
		"/dev/sdbk",
		"/dev/sddj",
		"/dev/sddk",
		"/dev/sdfg",
		"/dev/sdfj",
		"/dev/sdfk",
		"/dev/sdeg",
		"/dev/disk/by-path/pci-0000:44:00.1-fc-0x50060b00008379e1:0x0004000000000000",
		"/dev/sdej",
		"/dev/disk/by-path/pci-0000:c1:00.1-fc-0x50060b0000848141:0x0004000000000000",
		"/dev/sdek",
		"/dev/sddg",
		"/dev/disk/by-id/scsi-360060b00008441207d37344b0e4b004d",
		"/dev/disk/by-id/scsi-360060b000081ecb0c5dca8676e390038",
		"/dev/disk/by-path/pci-0000:47:00.1-fc-0x50060b000084a961:0x0004000000000000",
		"/dev/disk/by-path/pci-0000:c1:00.0-fc-0x50060b0000848531:0x0003000000000000",
		"/dev/disk/by-id/scsi-360060b0000840fb0583a95e7beae0033",
		"/dev/disk/by-path/pci-0000:81:00.1-fc-0x50060b00008483d1:0x0004000000000000",
		"/dev/disk/by-path/pci-0000:47:00.0-fc-0x50060b000084ac21:0x0003000000000000",
		"/dev/disk/by-path/pci-0000:47:00.1-fc-0x50060b0000840f71:0x0003000000000000",
		"/dev/disk/by-id/scsi-360060b00008474d008be51fcb10c0035",
		"/dev/disk/by-id/scsi-360014380000843505b31dc6950e5001f",
		"/dev/disk/by-id/scsi-360060b00008410a0fce0c84776e90040",
		"/dev/disk/by-id/scsi-360014380000803609291e88de0dc0023",
		"/dev/disk/by-path/pci-0000:47:00.0-fc-0x50060b000083f091:0x0002000000000000",
		"/dev/disk/by-id/scsi-360060b0000837e70c090424f5d1b0036",
		"/dev/disk/by-uuid/3366c250-26a5-4282-bf74-1360b76742bf",
		"/dev/disk/by-path/pci-0000:0d:00.0-fc-0x5001438000080361:0x0005000000000000",
		"/dev/disk/by-path/pci-0000:41:00.1-fc-0x5001438000084431:0x0005000000000000",
		"/dev/disk/by-path/pci-0000:07:00.1-fc-0x50060b0000840e11:0x0002000000000000",
		"/dev/disk/by-path/pci-0000:0d:00.1-fc-0x5001438000080041:0x0004000000000000",
		"/dev/disk/by-path/pci-0000:c4:00.1-fc-0x50060b000081ecb1:0x0004000000000000",
		"/dev/disk/by-path/pci-0000:c1:00.1-fc-0x50060b00008483c1:0x0002000000000000",
		"/dev/disk/by-path/pci-0000:c1:00.0-fc-0x50060b00008481f1:0x0005000000000000",
		"/dev/ram10",
		"/dev/disk/by-id/scsi-360060b00008381d058b922720d61002e",
		"/dev/disk/by-id/scsi-360060b00008380b09431e4dbbe92003a",
		"/dev/disk/by-path/pci-0000:0d:00.1-fc-0x5001438000084111:0x0004000000000000",
		"/dev/disk/by-path/pci-0000:81:00.1-fc-0x50060b00008480f1:0x0004000000000000",
		"/dev/ram",
		"/dev/disk/by-path/pci-0000:44:00.0-fc-0x50060b00008382d1:0x0002000000000000",
		"/dev/sdv",
		"/dev/disk/by-id/scsi-360060b00008441207d37344b0e4b004d-part2",
		"/dev/disk/by-path/pci-0000:c1:00.0-fc-0x50060b00008481f1:0x0004000000000000",
		"/dev/disk/by-path/pci-0000:07:00.0-fc-0x50060b0000840fb1:0x0003000000000000",
		"/dev/disk/by-id/scsi-360060b00008325a08c89ca0bb86d004f",
		"/dev/disk/by-id/scsi-360060b0000848200c445e903b29f0045",
		"/dev/disk/by-path/pci-0000:c1:00.1-fc-0x50060b00008483c1:0x0004000000000000",
		"/dev/disk/by-path/pci-0000:c1:00.0-fc-0x50060b0000848531:0x0004000000000000",
		"/dev/disk/by-path/pci-0000:81:00.1-fc-0x50060b00008480f1:0x0005000000000000",
		"/dev/disk/by-id/scsi-360060b00008443a02778e6474d70002e",
		"/dev/disk/by-id/scsi-360060b00008380b003c74ccdd4820037",
		"/dev/disk/by-path/pci-0000:84:00.1-fc-0x50060b0000848151:0x0004000000000000",
		"/dev/sdcc",
		"/dev/disk/by-path/pci-0000:04:00.0-fc-0x50060b0000844121:0x0005000000000000",
		"/dev/sdaz",
		"/dev/disk/by-id/scsi-360060b00008442203224b0750fa20031",
		"/dev/sdbq",
		"/dev/sdbc",
		"/dev/sdcz",
		"/dev/sdaq",
		"/dev/disk/by-id/scsi-360060b00008480f0328e443581de0045",
		"/dev/sdac",
		"/dev/sdbz",
		"/dev/sdcq",
		"/dev/sdfc",
		"/dev/disk/by-id/scsi-360060b0000840e106858635f35180035",
		"/dev/sddz",
		"/dev/disk/by-path/pci-0000:07:00.0-fc-0x50060b0000840fb1:0x0005000000000000",
		"/dev/sdeq",
		"/dev/sdec",
		"/dev/disk/by-path/pci-0000:c4:00.0-fc-0x50060b00008474d1:0x0003000000000000",
		"/dev/sddq",
		"/dev/sddc",
		"/dev/sdez",
		"/dev/sdfq",
		"/dev/mapper/vg-lv_mlog",
		"/dev/disk/by-path/pci-0000:84:00.0-fc-0x50060b0000848201:0x0005000000000000",
		"/dev/disk/by-path/pci-0000:04:00.1-fc-0x50060b0000844221:0x0003000000000000",
		"/dev/disk/by-id/scsi-360014380000841100b54a04d9906001c",
		"/dev/disk/by-path/pci-0000:44:00.1-fc-0x50060b00008381f1:0x0003000000000000",
		"/dev/disk/by-label/boot2",
		"/dev/disk/by-path/pci-0000:47:00.1-fc-0x50060b000084a961:0x0003000000000000",
		"/dev/disk/by-id/scsi-3600143800008473067db9731adef001b",
		"/dev/disk/by-id/scsi-360060b00008443a07189f84c99fb002f",
		"/dev/disk/by-id/scsi-360060b00008443a0f30c205722420031",
		"/dev/disk/by-path/pci-0000:0a:00.1-fc-0x50060b000083eed1:0x0003000000000000",
		"/dev/disk/by-id/scsi-360014380000841108e1f8b484c7f001b",
		"/dev/disk/by-id/scsi-360060b000084a9602699ad38ebe60035",
		"/dev/disk/by-id/scsi-360060b00008481f098864c1200a70024",
		"/dev/disk/by-id/scsi-360060b00008480f05f8e32303dba0044",
		"/dev/disk/by-path/pci-0000:c1:00.1-fc-0x50060b0000848141:0x0003000000000000",
		"/dev/disk/by-id/scsi-360060b00008410a009728f387b16003d",
		"/dev/disk/by-id/scsi-360060b00008381e0fd35adf6cc17003e",
		"/dev/disk/by-id/scsi-360060b00008381d0708a986d5d57002d",
		"/dev/disk/by-path/pci-0000:81:00.0-fc-0x50060b0000837a51:0x0003000000000000",
		"/dev/disk/by-id/scsi-360060b00008441c04cacfc87b0f50037",
		"/dev/disk/by-id/scsi-360060b00008474d036a129f2205f0033",
		"/dev/disk/by-id/scsi-360060b000081ecb0ab78815ddd8c0036",
		"/dev/disk/by-label/1",
		"/dev/disk/by-path/pci-0000:0a:00.0-fc-0x50060b00008381e1:0x0005000000000000",
		"/dev/ram12",
		"/dev/disk/by-id/scsi-360060b00008474d082d63ef76ce90034",
		"/dev/disk/by-path/pci-0000:81:00.0-fc-0x50060b0000837a51:0x0004000000000000",
		"/dev/disk/by-id/scsi-360060b000083eed0b3afe1899a990030",
		"/dev/disk/by-id/scsi-360060b0000840f70bd259b0f7dcc0036",
		"/dev/disk/by-path/pci-0000:84:00.1-fc-0x50060b0000848261:0x0003000000000000",
		"/dev/disk/by-path/pci-0000:c4:00.0-fc-0x50060b0000847511:0x0004000000000000",
		"/dev/disk/by-id/scsi-360060b00008441209d25836f1ccb0051",
		"/dev/sdb",
		"/dev/disk/by-path/pci-0000:04:00.1-fc-0x50060b00008441c1:0x0005000000000000",
		"/dev/sdt",
		"/dev/sdn",
		"/dev/disk/by-id/scsi-360060b0000837a509d882a68817d0035",
		"/dev/disk/by-id/scsi-360060b0000840fb029eedcf6937f0036",
		"/dev/disk/by-path/pci-0000:44:00.1-fc-0x50060b00008381f1:0x0005000000000000",
		"/dev/disk/by-path/pci-0000:84:00.0-fc-0x50060b0000848281:0x0005000000000000",
		"/dev/disk/by-id/scsi-360060b0000837f302d6456b166530036",
		"/dev/disk/by-id/scsi-360060b000083f0907733a3cfc1ac0034",
		"/dev/disk/by-id/scsi-360060b0000837f3067c37dbbf7700038",
		"/dev/disk/by-path/pci-0000:81:00.0-fc-0x50060b0000837f31:0x0004000000000000",
		"/dev/disk/by-path/pci-0000:04:00.1-fc-0x50060b0000844221:0x0005000000000000",
		"/dev/sdaw",
		"/dev/sdbm",
		"/dev/ram6",
		"/dev/sdai",
		"/dev/sdcu",
		"/dev/sdai2",
		"/dev/sdcw",
		"/dev/sdam",
		"/dev/sdci",
		"/dev/sdbu",
		"/dev/disk/by-id/scsi-360060b0000837f302b7768b6b34d0037",
		"/dev/sdbw",
		"/dev/sdcm",
		"/dev/sdbi",
		"/dev/sdau",
		"/dev/sddi",
		"/dev/sddm",
		"/dev/sdfi",
		"/dev/disk/by-path/pci-0000:44:00.1-fc-0x50060b00008379e1:0x0005000000000000",
		"/dev/sdeu",
		"/dev/sdew",
		"/dev/sdfm",
		"/dev/sdei",
		"/dev/sddu",
		"/dev/sddw",
		"/dev/sdem",
		"/dev/disk/by-path/pci-0000:c1:00.0-fc-0x50060b0000848531:0x0002000000000000",
		"/dev/disk/by-label/usex-tmp",
		"/dev/disk/by-id/scsi-36001438000084590b5b1f1413e350015",
		"/dev/disk/by-path/pci-0000:07:00.1-fc-0x50060b0000837e71:0x0003000000000000",
		"/dev/disk/by-uuid/56e8aa12-6ba8-4205-a908-c37f4d4a649a",
		"/dev/disk/by-id/scsi-360014380000841106278c457fa2c001e",
		"/dev/disk/by-id/scsi-360060b00008443a0bed10d52de3d0030",
		"/dev/disk/by-path/pci-0000:c4:00.1-fc-0x50060b00008443a1:0x0002000000000000",
		"/dev/disk/by-path/pci-0000:47:00.1-fc-0x50060b0000840f71:0x0002000000000000",
		"/dev/disk/by-path/pci-0000:84:00.0-fc-0x50060b0000848201:0x0002000000000000",
		"/dev/disk/by-id/scsi-360060b000083eed09683f38edebc0031",
		"/dev/disk/by-path/pci-0000:0a:00.1-fc-0x50060b0000840621:0x0002000000000000",
		"/dev/disk/by-id/scsi-36001438000084600aed2c48dcf740032",
		"/dev/disk/by-path/pci-0000:47:00.0-fc-0x50060b000084ac21:0x0002000000000000",
		"/dev/disk/by-id/scsi-360060b00008483c06e41f21f6fef0043",
		"/dev/disk/by-path/pci-0000:41:00.1-fc-0x5001438000084431:0x0004000000000000",
		"/dev/disk/by-path/pci-0000:c4:00.0-fc-0x50060b00008474d1:0x0004000000000000",
		"/dev/disk/by-id/scsi-36001438000084730ce02aa36d35a001c",
		"/dev/disk/by-path/pci-0000:0d:00.1-fc-0x5001438000080041:0x0005000000000000",
		"/dev/disk/by-path/pci-0000:07:00.1-fc-0x50060b0000840e11:0x0003000000000000",
		"/dev/disk/by-id/scsi-360060b00008475108f6faf754ae4002f",
		"/dev/disk/by-path/pci-0000:47:00.0-fc-0x50060b000083f091:0x0003000000000000",
		"/dev/disk/by-id/scsi-360060b00008379e002e75204e8410036",
		"/dev/disk/by-path/pci-0000:84:00.0-fc-0x50060b0000848281:0x0003000000000000",
		"/dev/disk/by-id/scsi-360060b0000848140a004c8c2bbaa0027",
		"/dev/disk/by-id/scsi-360060b0000848260b671bf1bef870042",
		"/dev/disk/by-id/scsi-360060b0000848140a738ddc708340028",
		"/dev/disk/by-path/pci-0000:c1:00.1-fc-0x50060b00008483c1:0x0003000000000000",
		"/dev/ram13",
		"/dev/ram14",
		"/dev/disk/by-id/scsi-360060b0000847510bbe1d67fd32a0031",
		"/dev/disk/by-path/pci-0000:0d:00.1-fc-0x5001438000084111:0x0005000000000000",
		"/dev/disk/by-path/pci-0000:84:00.0-fc-0x50060b0000848281:0x0004000000000000",
		"/dev/disk/by-id/scsi-360060b00008382d0464d3d3bf8cd0030",
		"/dev/sdf",
		"/dev/sdy",
		"/dev/disk/by-path/pci-0000:07:00.0-fc-0x50060b0000840fb1:0x0002000000000000",
		"/dev/sdp",
		"/dev/disk/by-path/pci-0000:44:00.0-fc-0x50060b00008382d1:0x0003000000000000",
		"/dev/disk/by-id/scsi-360060b00008441207d37344b0e4b004d-part1",
		"/dev/disk/by-id/scsi-360060b000083eed08627ba7f09eb002e",
		"/dev/disk/by-path/pci-0000:81:00.0-fc-0x50060b0000837a51:0x0005000000000000",
		"/dev/disk/by-id/scsi-360060b0000848140764eefcc4c570029",
		"/dev/disk/by-path/pci-0000:c1:00.0-fc-0x50060b0000848531:0x0005000000000000",
		"/dev/disk/by-id/scsi-360060b000084a96002d7bf3d30090036",
		"/dev/disk/by-path/pci-0000:41:00.0-fc-0x5001438000084601:0x0005000000000000",
		"/dev/sdcs",
		"/dev/ram5",
		"/dev/sdax",
		"/dev/sdcd",
		"/dev/sdce",
		"/dev/disk/by-id/scsi-360060b000084815034ba092250a0003d",
		"/dev/disk/by-path/pci-0000:84:00.1-fc-0x50060b0000848151:0x0005000000000000",
		"/dev/sdai3",
		"/dev/sdai4",
		"/dev/disk/by-path/pci-0000:41:00.1-fc-0x5001438000084431:0x0002000000000000",
		"/dev/disk/by-label/RHEL53LTS",
		"/dev/sdba",
		"/dev/sdal",
		"/dev/sdbr",
		"/dev/sdcx",
		"/dev/disk/by-path/pci-0000:c4:00.0-fc-0x50060b00008474d1:0x0002000000000000",
		"/dev/disk/by-path/pci-0000:0a:00.1-fc-0x50060b0000840621:0x0003000000000000",
		"/dev/sdbs",
		"/dev/sdbd",
		"/dev/disk/by-label/kbuild-test",
		"/dev/sdbe",
		"/dev/sdcl",
		"/dev/sdaa",
		"/dev/sdar",
		"/dev/sdbx",
		"/dev/sdas",
		"/dev/sdfa",
		"/dev/sdad",
		"/dev/sdae",
		"/dev/sdca",
		"/dev/sdbl",
		"/dev/sdcr",
		"/dev/sdfe",
		"/dev/sdea",
		"/dev/sddl",
		"/dev/sder",
		"/dev/sdes",
		"/dev/sded",
		"/dev/sdee",
		"/dev/sdfl",
		"/dev/disk/by-id/scsi-360060b00008382d09bdb9045a8330032",
		"/dev/sdda",
		"/dev/sddr",
		"/dev/sdex",
		"/dev/sdds",
		"/dev/sddd",
		"/dev/sdde",
		"/dev/sdel",
		"/dev/sdfr",
		"/dev/disk/by-path/pci-0000:07:00.0-fc-0x50060b0000840fb1:0x0004000000000000",
		"/dev/sdfs",
		"/dev/sddx",
		"/dev/sdfd",
		"/dev/disk/by-path/pci-0000:47:00.1-fc-0x50060b0000840f71:0x0004000000000000",
		"/dev/disk/by-path/pci-0000:44:00.0-fc-0x50060b00008381d1:0x0003000000000000",
		"/dev/disk/by-path/pci-0000:44:00.1-fc-0x50060b00008381f1:0x0002000000000000",
		"/dev/disk/by-id/scsi-360060b0000848530173f01000b8f004f",
		"/dev/disk/by-id/scsi-360060b0000837e70376c1e45fc120034",
		"/dev/disk/by-path/pci-0000:84:00.0-fc-0x50060b0000848201:0x0004000000000000",
		"/dev/disk/by-path/pci-0000:04:00.1-fc-0x50060b0000844221:0x0002000000000000",
		"/dev/disk/by-id/scsi-360060b00008481f0ed703a0dbc840023",
		"/dev/disk/by-path/pci-0000:84:00.1-fc-0x50060b0000848151:0x0003000000000000",
		"/dev/cciss/c0d0p1",
		"/dev/disk/by-id/scsi-360060b0000840f7096b17305ed000034",
		"/dev/disk/by-path/pci-0000:04:00.0-fc-0x50060b00008325a1:0x0004000000000000",
		"/dev/disk/by-id/scsi-360060b0000837f30300190c03b930039",
		"/dev/cciss/c0d4p1",
		"/dev/disk/by-uuid/af65d1dc-7f5f-45cd-a0ed-f415c0eb74b0",
		"/dev/disk/by-path/pci-0000:0a:00.0-fc-0x50060b00008381e1:0x0002000000000000",
		"/dev/disk/by-path/pci-0000:04:00.1-fc-0x50060b00008441c1:0x0003000000000000",
		"/dev/disk/by-id/scsi-360060b000084ac205afd411829960036",
		"/dev/disk/by-id/scsi-360060b00008475102cacc17a8f070030",
		"/dev/disk/by-id/scsi-360060b00008381e0184d9bf18811003d",
		"/dev/cciss/c0d3p1",
		"/dev/disk/by-id/scsi-360060b00008325a05ed9ee1547e70051",
		"/dev/disk/by-path/pci-0000:07:00.1-fc-0x50060b0000837e71:0x0005000000000000",
		"/dev/disk/by-id/scsi-3600143800008435033bfa25a7c14001c",
		"/dev/disk/by-path/pci-0000:0d:00.0-fc-0x5001438000084351:0x0004000000000000",
		"/dev/cciss/c0d6p1",
		"/dev/cciss/c0d7p1",
		"/dev/disk/by-path/pci-0000:81:00.1-fc-0x50060b00008480f1:0x0002000000000000",
		"/dev/cciss/c0d2p1",
		"/dev/disk/by-id/scsi-360060b0000848260d0f91995e05e003f",
		"/dev/disk/by-path/pci-0000:81:00.1-fc-0x50060b00008483d1:0x0002000000000000",
		"/dev/disk/by-uuid/ad3c6f6e-12db-4239-a958-46172d981987",
		"/dev/disk/by-uuid/4e8f0ab1-7380-493c-b77c-4f5dba7c1465",
		"/dev/sdg",
		"/dev/sdj",
		"/dev/sdk",
		"/dev/disk/by-uuid/56792aed-d7fa-469f-bd25-4c749bf9a4e5",
		"/dev/disk/by-id/scsi-360060b00008480f0f6411d2bf9970043",
		"/dev/disk/by-path/pci-0000:c1:00.1-fc-0x50060b0000848141:0x0005000000000000",
		"/dev/disk/by-path/pci-0000:41:00.1-fc-0x5001438000084591:0x0003000000000000",
		"/dev/disk/by-path/pci-0000:41:00.0-fc-0x5001438000084731:0x0005000000000000",
		"/dev/disk/by-path/pci-0000:07:00.0-fc-0x50060b00008410a1:0x0002000000000000",
		"/dev/vg/lv",
		"/dev/disk/by-path/pci-0000:04:00.0-fc-0x50060b0000844121:0x0002000000000000-part3",
		"/dev/disk/by-path/pci-0000:04:00.0-fc-0x50060b0000844121:0x0002000000000000-part4",
		"/dev/disk/by-id/scsi-360014380000841102890b252b609001d",
		"/dev/disk/by-path/pci-0000:47:00.1-fc-0x50060b000084a961:0x0005000000000000",
		"/dev/disk/by-path/pci-0000:0a:00.0-fc-0x50060b00008380b1:0x0004000000000000",
		"/dev/disk/by-id/scsi-360060b0000847510be5b9d70fe5a002e",
		"/dev/disk/by-path/pci-0000:0d:00.1-fc-0x5001438000084111:0x0003000000000000",
		"/dev/disk/by-id/scsi-360060b0000848140246201d2907a002a",
		"/dev/ram1",
		"/dev/sdah",
		"/dev/sdbo",
		"/dev/sdch",
		"/dev/disk/by-id/scsi-360060b00008381f088f8803a2b2d0042",
		"/dev/sdao",
		"/dev/disk/by-id/scsi-360060b0000848260141c2f9a24810040",
		"/dev/sdbh",
		"/dev/disk/by-path/pci-0000:41:00.1-fc-0x5001438000084591:0x0004000000000000",
		"/dev/sdco",
		"/dev/sdeo",
		"/dev/cciss/c0d1p1",
		"/dev/sdfh",
		"/dev/disk/by-uuid/37510659-d23a-4ab1-985b-7cc10cff1422",
		"/dev/disk/by-id/scsi-360060b000084a9603d3b862e82590033",
		"/dev/sddo",
		"/dev/disk/by-id/scsi-360060b000084422063612e82867b0032",
		"/dev/disk/by-path/pci-0000:07:00.0-fc-0x50060b00008410a1:0x0005000000000000",
		"/dev/sdeh",
		"/dev/sdfo",
		"/dev/disk/by-path/pci-0000:47:00.0-fc-0x50060b000084ac21:0x0004000000000000",
		"/dev/sddh",
		"/dev/disk/by-path/pci-0000:41:00.0-fc-0x5001438000084601:0x0004000000000000",
		"/dev/disk/by-path/pci-0000:0a:00.0-fc-0x50060b00008380b1:0x0003000000000000",
		"/dev/disk/by-path/pci-0000:44:00.0-fc-0x50060b00008382d1:0x0004000000000000",
		"/dev/disk/by-path/pci-0000:04:00.1-fc-0x50060b00008441c1:0x0002000000000000",
		"/dev/disk/by-path/pci-0000:c4:00.1-fc-0x50060b000081ecb1:0x0003000000000000",
		"/dev/disk/by-path/pci-0000:07:00.1-fc-0x50060b0000840e11:0x0005000000000000",
		"/dev/ramdisk",
		"/dev/disk/by-path/pci-0000:04:00.0-fc-0x50060b00008325a1:0x0002000000000000",
		"/dev/disk/by-id/scsi-360060b000084ac2073c6080954c90033",
		"/dev/disk/by-path/pci-0000:0d:00.1-fc-0x5001438000080041:0x0003000000000000",
		"/dev/disk/by-path/pci-0000:0d:00.0-fc-0x5001438000084351:0x0003000000000000",
		"/dev/disk/by-id/scsi-360060b00008442204bc3ae8ecf000033",
		"/dev/disk/by-path/pci-0000:44:00.1-fc-0x50060b00008379e1:0x0003000000000000",
		"/dev/disk/by-path/pci-0000:41:00.0-fc-0x5001438000084601:0x0003000000000000",
		"/dev/disk/by-path/pci-0000:44:00.0-fc-0x50060b00008382d1:0x0005000000000000",
		"/dev/disk/by-id/scsi-360060b00008483c09ab42b2f44c00046",
		"/dev/disk/by-id/scsi-360014380000847303a77d1405ba0001e",
		"/dev/disk/by-id/scsi-360060b000083f09097d17bc5304b0032",
		"/dev/disk/by-id/scsi-360060b00008481503c91f71c0c7c003c",
		"/dev/disk/by-path/pci-0000:07:00.0-fc-0x50060b00008410a1:0x0003000000000000",
		"/dev/disk/by-path/pci-0000:47:00.0-fc-0x50060b000083f091:0x0004000000000000",
		"/dev/disk/by-path/pci-0000:c4:00.0-fc-0x50060b0000847511:0x0002000000000000",
		"/dev/disk/by-id/scsi-360060b000081ecb0fa9fba6cb25c0039",
		"/dev/disk/by-path/pci-0000:44:00.0-fc-0x50060b00008381d1:0x0005000000000000",
		"/dev/disk/by-path/pci-0000:0d:00.0-fc-0x5001438000080361:0x0004000000000000",
		"/dev/disk/by-path/pci-0000:04:00.0-fc-0x50060b0000844121:0x0002000000000000",
		"/dev/disk/by-id/scsi-360060b00008410a097f8b64232c5003f",
		"/dev/disk/by-id/scsi-360060b000084a96075639833cee30034",
		"/dev/disk/by-id/scsi-360060b00008483c05adc1a2a009c0045",
		"/dev/disk/by-id/scsi-360060b00008382d0fc894f403cf00031",
		"/dev/disk/by-path/pci-0000:81:00.0-fc-0x50060b0000837f31:0x0002000000000000",
		"/dev/cciss/c0d5",
		"/dev/disk/by-path/pci-0000:0a:00.1-fc-0x50060b0000840621:0x0005000000000000",
		"/dev/disk/by-path/pci-0000:c4:00.1-fc-0x50060b000081ecb1:0x0005000000000000",
		"/dev/disk/by-path/pci-0000:0d:00.0-fc-0x5001438000080361:0x0002000000000000",
		"/dev/sdq",
		"/dev/sdc",
		"/dev/disk/by-path/pci-0000:47:00.0-fc-0x50060b000083f091:0x0005000000000000",
		"/dev/disk/by-id/scsi-360060b00008381d0788adf76dc2b002f",
		"/dev/sdz",
		"/dev/disk/by-id/scsi-36001438000080040498e26ee88730021",
		"/dev/disk/by-path/pci-0000:04:00.0-fc-0x50060b0000844121:0x0004000000000000",
		"/dev/disk/by-uuid/7705c653-1b71-4537-8752-544345a24635",
		"/dev/disk/by-id/scsi-360060b0000837a50194e7350394c0037",
		"/dev/disk/by-path/pci-0000:04:00.0-fc-0x50060b0000844121:0x0002000000000000-part2",
		"/dev/disk/by-path/pci-0000:84:00.1-fc-0x50060b0000848261:0x0005000000000000",
		"/dev/disk/by-id/scsi-360060b000083f090a0fb8dca7d8a0033",
		"/dev/disk/by-uuid/8a45e97b-ec46-4aa8-b070-a63eb599048e",
		"/dev/ram0",
		"/dev/disk/by-id/scsi-360060b00008381f0d14ccd49fffa0045",
		"/dev/sdcv",
		"/dev/sdbv",
		"/dev/sdav",
		"/dev/disk/by-path/pci-0000:0a:00.1-fc-0x50060b000083eed1:0x0005000000000000",
		"/dev/disk/by-id/scsi-360060b0000840620131d6473e8520030",
		"/dev/disk/by-path/pci-0000:41:00.0-fc-0x5001438000084731:0x0002000000000000",
		"/dev/sdev",
		"/dev/disk/by-id/scsi-360060b0000840e10bcf92950876b0032",
		"/dev/sddv",
		"/dev/disk/by-path/pci-0000:c1:00.1-fc-0x50060b00008483c1:0x0005000000000000",
		"/dev/disk/by-path/pci-0000:c1:00.0-fc-0x50060b00008481f1:0x0002000000000000",
		"/dev/disk/by-path/pci-0000:84:00.1-fc-0x50060b0000848151:0x0002000000000000",
		"/dev/disk/by-id/scsi-360060b00008379e0020140ff9bb70035",
		"/dev/disk/by-id/scsi-360060b0000840fb074d0a5ec0b390034",
		"/dev/disk/by-id/scsi-360060b000084ac206da92f13e5740035",
		"/dev/cciss/c0d0p2",
		"/dev/disk/by-id/scsi-360060b0000848200399499f516d00042",
		"/dev/disk/by-id/scsi-360060b000081ecb0bf7993622a160037",
		"/dev/disk/by-id/scsi-360060b00008381f08d2e963f77b40043",
		"/dev/disk/by-path/pci-0000:04:00.0-fc-0x50060b00008325a1:0x0005000000000000",
		"/dev/disk/by-id/scsi-360060b00008483d0922eb856da93003e",
		"/dev/disk/by-id/scsi-3600143800008459082bd164782760016",
		"/dev/disk/by-path/pci-0000:0a:00.0-fc-0x50060b00008381e1:0x0003000000000000",
		"/dev/disk/by-id/scsi-360060b00008441205c6d495059a2004e",
		"/dev/cciss/c0d4p2",
		"/dev/disk/by-id/scsi-360060b0000844120317e5c559dc5004f",
		"/dev/cciss/c0d3p2",
		"/dev/disk/by-id/scsi-360060b00008380b0ecd4f4d6c8af0039",
		"/dev/disk/by-path/pci-0000:07:00.1-fc-0x50060b0000837e71:0x0004000000000000",
		"/dev/disk/by-uuid/9547de54-c0f7-4b9f-9740-bd2dc40672a8",
		"/dev/root",
		"/dev/disk/by-uuid/73172a46-6f90-4526-896f-36b19c841ad2",
		"/dev/disk/by-path/pci-0000:0d:00.0-fc-0x5001438000084351:0x0005000000000000",
		"/dev/disk/by-path/pci-0000:81:00.0-fc-0x50060b0000837a51:0x0002000000000000",
		"/dev/disk/by-path/pci-0000:81:00.1-fc-0x50060b00008483d1:0x0003000000000000",
		"/dev/mapper/vg-lv_mimage_0",
		"/dev/sdu",
		"/dev/disk/by-path/pci-0000:41:00.1-fc-0x5001438000084591:0x0002000000000000",
		"/dev/sdw",
		"/dev/sdi",
		"/dev/sdm",
		"/dev/disk/by-path/pci-0000:41:00.0-fc-0x5001438000084731:0x0004000000000000",
		"/dev/disk/by-id/scsi-360060b00008406205865797834dd0031",
		"/dev/disk/by-path/pci-0000:0d:00.1-fc-0x5001438000084111:0x0002000000000000",
		"/dev/disk/by-path/pci-0000:c4:00.1-fc-0x50060b00008443a1:0x0003000000000000",
		"/dev/disk/by-id/scsi-36001438000080040b38e37f3cc960022",
		"/dev/disk/by-path/pci-0000:0a:00.0-fc-0x50060b00008380b1:0x0005000000000000",
		"/dev/disk/by-id/scsi-360060b000084826094d1079093d4003e",
		"/dev/disk/by-path/pci-0000:07:00.1-fc-0x50060b0000837e71:0x0002000000000000",
		"/dev/disk/by-label/boot",
		"/dev/ram2",
		"/dev/ram8",
		"/dev/ram9",
		"/dev/sdbn",
		"/dev/sdct",
		"/dev/disk/by-path/pci-0000:41:00.1-fc-0x5001438000084591:0x0005000000000000",
		"/dev/disk/by-id/scsi-360060b00008380b09a1838d2d2cd0038",
		"/dev/sdbb",
		"/dev/sdan",
		"/dev/sdbt",
		"/dev/disk/by-id/scsi-360060b00008381e0efed85ec43cf003c",
		"/dev/sdab",
		"/dev/sdcn",
		"/dev/sdat",
		"/dev/sdfb",
		"/dev/disk/by-id/scsi-360060b00008483d03b3a00d81ca7003b",
		"/dev/sdcb",
		"/dev/cciss/c0d1p2",
		"/dev/sdeb",
		"/dev/sddn",
		"/dev/sdet",
		"/dev/sddb",
		"/dev/sdfn",
		"/dev/sddt",
		"/dev/disk/by-path/pci-0000:47:00.0-fc-0x50060b000084ac21:0x0005000000000000",
		"/dev/sden",
		"/dev/sdft",
		"/dev/disk/by-path/pci-0000:0d:00.1-fc-0x5001438000080041:0x0002000000000000",
		"/dev/disk/by-id/scsi-360060b00008442209cd62c9b3ea50034",
		"/dev/disk/by-path/pci-0000:07:00.1-fc-0x50060b0000840e11:0x0004000000000000",
		"/dev/disk/by-id/scsi-360060b00008480f041ed0a26ad0c0042",
		"/dev/disk/by-id/scsi-360060b000083f0902b72b5d405cf0035",
		"/dev/disk/by-path/pci-0000:0a:00.0-fc-0x50060b00008380b1:0x0002000000000000",
		"/dev/disk/by-id/scsi-360060b0000837a508c01035ef0d00033",
		"/dev/disk/by-id/scsi-360060b00008381d0e968c67bd2080030",
		"/dev/disk/by-id/scsi-360060b00008325a024534c3c3c110054",
		"/dev/disk/by-id/scsi-360014380000843503448ca640cdf001e",
		"/dev/cciss/c0d0p3",
		"/dev/disk/by-uuid/97e8cbbb-1093-40d3-bfb8-039de966e4cd",
		"/dev/disk/by-path/pci-0000:0d:00.0-fc-0x5001438000084351:0x0002000000000000",
		"/dev/disk/by-path/pci-0000:44:00.1-fc-0x50060b00008379e1:0x0002000000000000",
		"/dev/disk/by-path/pci-0000:41:00.0-fc-0x5001438000084601:0x0002000000000000",
		"/dev/disk/by-id/scsi-360060b0000848150c77ce517c85c003b",
		"/dev/disk/by-id/scsi-360060b00008382d0bf3b2b36ac43002f",
		"/dev/disk/by-id/scsi-360060b00008379e065f2980e97a80038",
		"/dev/disk/by-path/pci-0000:c4:00.1-fc-0x50060b000081ecb1:0x0002000000000000",
		"/dev/cciss/c0d4p3",
		"/dev/disk/by-uuid/f7f1a198-010e-4bb4-802c-5127d2555f50",
		"/dev/disk/by-path/pci-0000:c4:00.1-fc-0x50060b00008443a1:0x0005000000000000",
		"/dev/disk/by-id/scsi-3600143800008443060deeee059b9002b",
		"/dev/disk/by-id/scsi-360060b00008481f0f9c55e1744ca0025",
		"/dev/disk/by-id/scsi-360060b000084ac20da711a0ea1500034",
		"/dev/disk/by-path/pci-0000:44:00.0-fc-0x50060b00008381d1:0x0004000000000000",
		"/dev/disk/by-path/pci-0000:c4:00.0-fc-0x50060b0000847511:0x0003000000000000",
		"/dev/disk/by-path/pci-0000:84:00.0-fc-0x50060b0000848201:0x0003000000000000",
		"/dev/ram15",
		"/dev/disk/by-path/pci-0000:c4:00.0-fc-0x50060b00008474d1:0x0005000000000000",
		"/dev/disk/by-path/pci-0000:81:00.0-fc-0x50060b0000837f31:0x0003000000000000",
		"/dev/disk/by-id/scsi-360060b00008483d00b29eed2d01c003a",
		"/dev/disk/by-id/scsi-360060b0000837e70ee240940af690033",
		"/dev/disk/by-path/pci-0000:84:00.0-fc-0x50060b0000848281:0x0002000000000000",
		"/dev/disk/by-id/scsi-360060b0000840fb0b7b8c7f14f5c0035",
		"/dev/disk/by-id/scsi-360060b0000837e7093a8304a19150035",
		"/dev/disk/by-id/scsi-36001438000084590dc51ca37ad870013",
		"/dev/disk/by-path/pci-0000:0a:00.1-fc-0x50060b0000840621:0x0004000000000000",
		"/dev/disk/by-path/pci-0000:04:00.0-fc-0x50060b0000844121:0x0003000000000000",
		"/dev/sda",
		"/dev/mapper/vg-lv_mimage_1",
		"/dev/sdr",
		"/dev/sds",
		"/dev/sdd",
		"/dev/disk/by-id/scsi-360014380000844302982b5d184cb0028",
		"/dev/sde",
		"/dev/sdx",
		"/dev/sdl",
		"/dev/disk/by-id/scsi-360014380000846009a86af888b510031",
		"/dev/disk/by-path/pci-0000:0d:00.0-fc-0x5001438000080361:0x0003000000000000",
		"/dev/disk/by-id/scsi-360014380000803606dfe109871880025",
		"/dev/disk/by-path/pci-0000:41:00.1-fc-0x5001438000084431:0x0003000000000000",
		"/dev/disk/by-id/scsi-360060b00008481f02a2425086ffa0022",
		"/dev/disk/by-id/scsi-360060b00008481505931d0127bce003a",
		"/dev/disk/by-path/pci-0000:04:00.0-fc-0x50060b0000844121:0x0002000000000000-part1",
		"/dev/disk/by-path/pci-0000:47:00.1-fc-0x50060b0000840f71:0x0005000000000000",
		"/dev/disk/by-id/scsi-36001438000084350d2fcb45fc89e001d",
		"/dev/disk/by-path/pci-0000:84:00.1-fc-0x50060b0000848261:0x0004000000000000",
		"/dev/disk/by-id/scsi-36001438000084430b429c8d6d1550029",
		"/dev/ram3",
		"/dev/ram4",
		"/dev/ram7",
		"/dev/sday",
		"/dev/sdbp",
		"/dev/sdcf",
		"/dev/sdcy",
		"/dev/sdap",
		"/dev/sdbf",
		"/dev/disk/by-path/pci-0000:41:00.0-fc-0x5001438000084731:0x0003000000000000",
		"/dev/sdby",
		"/dev/sdcp",
		"/dev/sdaf",
		"/dev/disk/by-path/pci-0000:0a:00.1-fc-0x50060b000083eed1:0x0004000000000000",
		"/dev/sddy",
		"/dev/disk/by-id/scsi-360060b00008483d0d96f15dd60ca003c",
		"/dev/disk/by-id/scsi-360060b000083eed0797acc845676002f",
		"/dev/sdep",
		"/dev/sdff",
		"/dev/sddp",
		"/dev/sdef",
		"/dev/sdey",
		"/dev/sdfp",
		"/dev/disk/by-id/scsi-36001438000080040e56813e944500020",
		"/dev/disk/by-id/scsi-360060b0000840e108356525af0f50034",
		"/dev/sddf",
		"/dev/disk/by-id/scsi-360060b000084820017da23fac6da0043",
		"/dev/disk/by-path/pci-0000:c1:00.0-fc-0x50060b00008481f1:0x0003000000000000",
		"/dev/disk/by-path/pci-0000:c4:00.1-fc-0x50060b00008443a1:0x0004000000000000",
		"/dev/disk/by-id/scsi-360060b0000848530cc3d13054fb20050"
	]
}

[-- Attachment #3: Type: text/plain, Size: 0 bytes --]

Re: Removing a failed device from LVM2/DM

[malahal]

Alan D. Brunelle [Alan.Brunelle@hp.com] wrote:
> Unfortunately:
> 
> # rm -rf /etc/lvm/cache
> 
> # vgscan
>   Reading all physical volumes.  This may take a while...
>   /dev/disk/by-id/scsi-360060b0000837a508c01035ef0d00033: read failed
> after 0 of 512 at 0: Input/output error
>   /dev/disk/by-id/scsi-360060b0000837a508c01035ef0d00033: read failed
> after 0 of 512 at 291347562496: Input/output error
>   /dev/disk/by-id/scsi-360060b0000837a508c01035ef0d00033: read failed
> after 0 of 512 at 291347632128: Input/output error
>   /dev/disk/by-id/scsi-360060b0000837a508c01035ef0d00033: read failed
> after 0 of 512 at 0: Input/output error
>   /dev/disk/by-id/scsi-360060b0000837a508c01035ef0d00033: read failed
> after 0 of 512 at 4096: Input/output error
>   /dev/disk/by-id/scsi-360060b0000837a508c01035ef0d00033: read failed
> after 0 of 2048 at 0: Input/output error
>   Found volume group "vg" using metadata type lvm2

Looks like you have some symbolic links that point to a dead device.
Change your filter to accept devices appropriately, maybe like below
(untested!).

filter = [ "r|sdab|", a|/dev/sd|", "r|.*|" ]

The above filter would avoid looking at /dev/disk/by-id and other
unneeded directories.

Thanks, Malahal.

Re: Removing a failed device from LVM2/DM

[Alan D. Brunelle]

On Tue, 2009-09-01 at 15:47 -0700, malahal@us.ibm.com wrote:
> filter = [ "r|sdab|", a|/dev/sd|", "r|.*|" ]

Other than adding in the missing " ("a|/dev/sd|") this seems to have
fixed the problem. Thanks!

Alan

Re: Removing a failed device from LVM2/DM

[malahal]

Alan D. Brunelle [Alan.Brunelle@hp.com] wrote:
> On Tue, 2009-09-01 at 15:47 -0700, malahal@us.ibm.com wrote:
> > filter = [ "r|sdab|", a|/dev/sd|", "r|.*|" ]
> 
> Other than adding in the missing " ("a|/dev/sd|") this seems to have
> fixed the problem. Thanks!

You are welcome!

Thanks, Malahal.

Re: Removing a failed device from LVM2/DM

[Javier Barroso]

On Thu, Sep 3, 2009 at 5:15 PM,  <malahal@us.ibm.com> wrote:
> Alan D. Brunelle [Alan.Brunelle@hp.com] wrote:
>> On Tue, 2009-09-01 at 15:47 -0700, malahal@us.ibm.com wrote:
>> > filter = [ "r|sdab|", a|/dev/sd|", "r|.*|" ]
>>
>> Other than adding in the missing " ("a|/dev/sd|") this seems to have
>> fixed the problem. Thanks!

But in the future, is it not possible host will reutilize "/dev/sdab"
to another device?

Is this change sure in nexts boots ?

Thank you