[linux-lvm] pvcreate issues

[linux-lvm] pvcreate issues

[Arshavir Grigorian]

Hi,

We have a SAN that exports 4 LUNs. These appear as SCSI devices on the 
server (/dev/sd[c-f]). When I try to create physical volumes on these 
devices, I get the following error:

#>pvcreate /dev/sdc
   Physical volume "/dev/sdc" successfully created

#>pvcreate /dev/sdd
   Found duplicate PV ZlhU50ejJ1VkoULTcU5ODsl2BP26IjQW: using /dev/sdc 
not /dev/sdd
   Found duplicate PV ZlhU50ejJ1VkoULTcU5ODsl2BP26IjQW: using /dev/sde 
not /dev/sdd
   Found duplicate PV ZlhU50ejJ1VkoULTcU5ODsl2BP26IjQW: using /dev/sdf 
not /dev/sdd
   Physical volume "/dev/sdd" successfully created

This happens after pvcreate is run the second time, does not matter in 
which order. It looks like when pvcreate sets the device id, it somehow 
sets it for all the devices.

Debian/Sarge

pvcreate --version
   LVM version:     2.01.04 (2005-02-09)
   Library version: 1.01.00-ioctl (2005-01-17)
   Driver version:  4.4.0


Thanks for any ideas.


-- 
Arshavir Grigorian
Systems Administrator/Engineer

Re: [linux-lvm] pvcreate issues

[AJ Lewis]

[-- Attachment #1: Type: text/plain, Size: 1338 bytes --]

On Mon, May 23, 2005 at 02:48:11PM -0400, Arshavir Grigorian wrote:
> Hi,
> 
> We have a SAN that exports 4 LUNs. These appear as SCSI devices on the 
> server (/dev/sd[c-f]). When I try to create physical volumes on these 
> devices, I get the following error:
> 
> #>pvcreate /dev/sdc
>   Physical volume "/dev/sdc" successfully created
> 
> #>pvcreate /dev/sdd
>   Found duplicate PV ZlhU50ejJ1VkoULTcU5ODsl2BP26IjQW: using /dev/sdc 
> not /dev/sdd
>   Found duplicate PV ZlhU50ejJ1VkoULTcU5ODsl2BP26IjQW: using /dev/sde 
> not /dev/sdd
>   Found duplicate PV ZlhU50ejJ1VkoULTcU5ODsl2BP26IjQW: using /dev/sdf 
> not /dev/sdd
>   Physical volume "/dev/sdd" successfully created
> 
> This happens after pvcreate is run the second time, does not matter in 
> which order. It looks like when pvcreate sets the device id, it somehow 
> sets it for all the devices.

You're sure sd[c-f] is not the same device on multiple paths?

-- 
AJ Lewis                                   Voice:  612-638-0500
Red Hat Inc.                               E-Mail: alewis@redhat.com
720 Washington Ave. SE, Suite 200
Minneapolis, MN 55414
   
Current GPG fingerprint = D9F8 EDCE 4242 855F A03D  9B63 F50C 54A8 578C 8715
Grab the key at: http://people.redhat.com/alewis/gpg.html or one of the
many keyservers out there...


[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]

Re: [linux-lvm] pvcreate issues

[Arshavir Grigorian]

AJ Lewis wrote:
> On Mon, May 23, 2005 at 02:48:11PM -0400, Arshavir Grigorian wrote:
> 
>>Hi,
>>
>>We have a SAN that exports 4 LUNs. These appear as SCSI devices on the 
>>server (/dev/sd[c-f]). When I try to create physical volumes on these 
>>devices, I get the following error:
>>
>>#>pvcreate /dev/sdc
>>  Physical volume "/dev/sdc" successfully created
>>
>>#>pvcreate /dev/sdd
>>  Found duplicate PV ZlhU50ejJ1VkoULTcU5ODsl2BP26IjQW: using /dev/sdc 
>>not /dev/sdd
>>  Found duplicate PV ZlhU50ejJ1VkoULTcU5ODsl2BP26IjQW: using /dev/sde 
>>not /dev/sdd
>>  Found duplicate PV ZlhU50ejJ1VkoULTcU5ODsl2BP26IjQW: using /dev/sdf 
>>not /dev/sdd
>>  Physical volume "/dev/sdd" successfully created
>>
>>This happens after pvcreate is run the second time, does not matter in 
>>which order. It looks like when pvcreate sets the device id, it somehow 
>>sets it for all the devices.
> 
> 
> You're sure sd[c-f] is not the same device on multiple paths?
> 

How can I be sure? How do I check?

This SAN exports another set of 4 LUNs to a different server and they 
work just fine.

pvcreate --version
   LVM version:     2.00.33 (2005-01-07)
   Library version: 1.00.19-ioctl (2004-07-03)
   Driver version:  4.4.0

pvcreate on the server that does not work is a little newer, so I wonder 
if there was any new code/bug fix(es) since this version that caused a 
regression.

-- 
Arshavir Grigorian
Systems Administrator/Engineer

Re: [linux-lvm] pvcreate issues

[Henrik Morsing]

> AJ Lewis wrote:
>> On Mon, May 23, 2005 at 02:48:11PM -0400, Arshavir Grigorian wrote:
>>
>>
>> You're sure sd[c-f] is not the same device on multiple paths?
>>
>
> How can I be sure? How do I check?
>
> This SAN exports another set of 4 LUNs to a different server and they
> work just fine.

It does look like you're seing the same disk through four different paths.
What OS is the other server running? The people that setup the SAN should
know if it is multi pathed or not.

-- 
---
Henrik Morsing
henrik@morsing.cc
www.morsing.cc
---

Re: [linux-lvm] pvcreate issues

[Arshavir Grigorian]

Henrik Morsing wrote:
>>AJ Lewis wrote:
>>
>>>On Mon, May 23, 2005 at 02:48:11PM -0400, Arshavir Grigorian wrote:
>>>
>>>
>>>You're sure sd[c-f] is not the same device on multiple paths?
>>>
>>
>>How can I be sure? How do I check?
>>
>>This SAN exports another set of 4 LUNs to a different server and they
>>work just fine.
> 
> 
> It does look like you're seing the same disk through four different paths.
> What OS is the other server running? The people that setup the SAN should
> know if it is multi pathed or not.
> 

Thanks.

Looks like it might be a problem with the type of firmware we have on 
the SAN which only allows for one active fiber channel controller at a 
time. The second controller should be used only when the first one 
fails. What we were doing was to export the first set of 4 volumes 
through one controller and another set of 4 on the other controller, 
hence the problem. We will either have to change the firmware to allow 
for 2 active controllers (no failover spare) or buy a switch to make all 
the volumes accessible to more than one server through the first fc 
controller.

-- 
Arshavir Grigorian
Systems Administrator/Engineer