* EMC CX LUN problem
@ 2006-01-24 21:31 Nicola Murino
2006-01-24 22:28 ` Brian Wong
0 siblings, 1 reply; 8+ messages in thread
From: Nicola Murino @ 2006-01-24 21:31 UTC (permalink / raw)
To: device-mapper development
Hi,
I'm trying to configure a new emc cx storage, I have the following:
2 server, each server has a qla2462 dual port hba
each qla2462 is connected to a switch (only one switch)
1 emc cx storage with 4 path connected to the switch
I defined two lun on the storage however I'm able to see only one LUN
multipath -l show the following:
multipath -l
mail (36006016086f01600e46f567adb8cda11)
[size=150 GB][features="1 queue_if_no_path"][hwhandler="1 emc"]
\_ round-robin 0 [active]
\_ 1:0:1:0 sdd 8:48 [active][ready]
\_ 1:0:1:1 sde 8:64 [active][ready]
\_ 2:0:1:0 sdh 8:112 [active][ready]
\_ 2:0:1:1 sdi 8:128 [active][ready]
\_ round-robin 0 [enabled]
\_ 2:0:0:0 sdf 8:80 [active][ready]
\_ 1:0:0:0 sdb 8:16 [active][ready]
\_ 1:0:0:1 sdc 8:32 [active][ready]
\_ 2:0:0:1 sdg 8:96 [active][ready]
this seems correct for my configuration however I'm not able to see the
other LUN, tommorrow I'll try to connect the 2 server directly to the
storage, some other hint?
from dmesg:
QLogic Fibre Channel HBA Driver
ACPI: PCI Interrupt 0000:08:00.0[A] -> GSI 16 (level, low) -> IRQ 16
qla2400 0000:08:00.0: Found an ISP2432, irq 16, iobase 0xf881a000
qla2400 0000:08:00.0: Configuring PCI space...
PCI: Setting latency timer of device 0000:08:00.0 to 64
qla2400 0000:08:00.0: Configure NVRAM parameters...
qla2400 0000:08:00.0: Verifying loaded RISC code...
qla2400 0000:08:00.0: Allocated (1061 KB) for firmware dump...
qla2400 0000:08:00.0: Waiting for LIP to complete...
qla2400 0000:08:00.0: LIP reset occured (f8f7).
qla2400 0000:08:00.0: LIP occured (f8f7).
qla2400 0000:08:00.0: LOOP UP detected (2 Gbps).
qla2400 0000:08:00.0: Topology - (F_Port), Host Loop address 0x0
scsi1 : qla2xxx
qla2400 0000:08:00.0:
QLogic Fibre Channel HBA Driver: 8.01.04-k-fw
QLogic QLE2462 - PCI-Express to 4Gb FC, Dual Channel
ISP2432: PCIe (2.5Gb/s x4) @ 0000:08:00.0 hdma-, host#=1, fw=4.00.16 [IP]
ACPI: PCI Interrupt 0000:08:00.1[B] -> GSI 17 (level, low) -> IRQ 20
Vendor: DGC Model: RAID 5 Rev: 0219
Type: Direct-Access ANSI SCSI revision: 04
SCSI device sdb: 314572800 512-byte hdwr sectors (161061 MB)
sdb: test WP failed, assume Write Enabled
sdb: asking for cache data failed
sdb: assuming drive cache: write through
qla2400 0000:08:00.1: Found an ISP2432, irq 20, iobase 0xf881c000
SCSI device sdb: 314572800 512-byte hdwr sectors (161061 MB)
qla2400 0000:08:00.1: Configuring PCI space...
PCI: Setting latency timer of device 0000:08:00.1 to 64
sdb: test WP failed, assume Write Enabled
qla2400 0000:08:00.1: Configure NVRAM parameters...
sdb: asking for cache data failed
sdb: assuming drive cache: write through
sdb:<6>sd 1:0:0:0: Device not ready.
end_request: I/O error, dev sdb, sector 0
Buffer I/O error on device sdb, logical block 0
sd 1:0:0:0: Device not ready.
end_request: I/O error, dev sdb, sector 0
Buffer I/O error on device sdb, logical block 0
unable to read partition table
sd 1:0:0:0: Attached scsi disk sdb
Vendor: DGC Model: RAID 5 Rev: 0219
Type: Direct-Access ANSI SCSI revision: 04
qla2400 0000:08:00.1: Verifying loaded RISC code...
SCSI device sdc: 314572800 512-byte hdwr sectors (161061 MB)
sdc: test WP failed, assume Write Enabled
sdc: asking for cache data failed
sdc: assuming drive cache: write through
SCSI device sdc: 314572800 512-byte hdwr sectors (161061 MB)
sdc: test WP failed, assume Write Enabled
sdc: asking for cache data failed
sdc: assuming drive cache: write through
sdc:<6>sd 1:0:0:1: Device not ready.
end_request: I/O error, dev sdc, sector 0
Buffer I/O error on device sdc, logical block 0
sd 1:0:0:1: Device not ready.
end_request: I/O error, dev sdc, sector 0
Buffer I/O error on device sdc, logical block 0
unable to read partition table
sd 1:0:0:1: Attached scsi disk sdc
Vendor: DGC Model: RAID 5 Rev: 0219
Type: Direct-Access ANSI SCSI revision: 04
SCSI device sdd: 314572800 512-byte hdwr sectors (161061 MB)
sdd: Write Protect is off
sdd: Mode Sense: 87 00 00 08
SCSI device sdd: drive cache: write through
SCSI device sdd: 314572800 512-byte hdwr sectors (161061 MB)
sdd: Write Protect is off
sdd: Mode Sense: 87 00 00 08
SCSI device sdd: drive cache: write through
sdd: unknown partition table
sd 1:0:1:0: Attached scsi disk sdd
Vendor: DGC Model: RAID 5 Rev: 0219
Type: Direct-Access ANSI SCSI revision: 04
SCSI device sde: 314572800 512-byte hdwr sectors (161061 MB)
sde: Write Protect is off
sde: Mode Sense: 87 00 00 08
SCSI device sde: drive cache: write through
SCSI device sde: 314572800 512-byte hdwr sectors (161061 MB)
sde: Write Protect is off
sde: Mode Sense: 87 00 00 08
SCSI device sde: drive cache: write through
sde: unknown partition table
sd 1:0:1:1: Attached scsi disk sde
qla2400 0000:08:00.1: Allocated (1061 KB) for firmware dump...
qla2400 0000:08:00.1: Waiting for LIP to complete...
qla2400 0000:08:00.1: LIP reset occured (f8f7).
qla2400 0000:08:00.1: LIP occured (f8f7).
qla2400 0000:08:00.1: LOOP UP detected (2 Gbps).
qla2400 0000:08:00.1: Topology - (F_Port), Host Loop address 0x0
scsi2 : qla2xxx
qla2400 0000:08:00.1:
QLogic Fibre Channel HBA Driver: 8.01.04-k-fw
QLogic QLE2462 - PCI-Express to 4Gb FC, Dual Channel
ISP2432: PCIe (2.5Gb/s x4) @ 0000:08:00.1 hdma-, host#=2, fw=4.00.16 [IP]
Vendor: DGC Model: RAID 5 Rev: 0219
Type: Direct-Access ANSI SCSI revision: 04
SCSI device sdf: 314572800 512-byte hdwr sectors (161061 MB)
sdf: test WP failed, assume Write Enabled
sdf: asking for cache data failed
sdf: assuming drive cache: write through
SCSI device sdf: 314572800 512-byte hdwr sectors (161061 MB)
sdf: test WP failed, assume Write Enabled
sdf: asking for cache data failed
sdf: assuming drive cache: write through
sdf:<6>sd 2:0:0:0: Device not ready.
end_request: I/O error, dev sdf, sector 0
Buffer I/O error on device sdf, logical block 0
sd 2:0:0:0: Device not ready.
end_request: I/O error, dev sdf, sector 0
Buffer I/O error on device sdf, logical block 0
unable to read partition table
sd 2:0:0:0: Attached scsi disk sdf
Vendor: DGC Model: RAID 5 Rev: 0219
Type: Direct-Access ANSI SCSI revision: 04
SCSI device sdg: 314572800 512-byte hdwr sectors (161061 MB)
sdg: test WP failed, assume Write Enabled
sdg: asking for cache data failed
sdg: assuming drive cache: write through
SCSI device sdg: 314572800 512-byte hdwr sectors (161061 MB)
sdg: test WP failed, assume Write Enabled
sdg: asking for cache data failed
sdg: assuming drive cache: write through
sdg:<6>sd 2:0:0:1: Device not ready.
end_request: I/O error, dev sdg, sector 0
Buffer I/O error on device sdg, logical block 0
sd 2:0:0:1: Device not ready.
end_request: I/O error, dev sdg, sector 0
Buffer I/O error on device sdg, logical block 0
unable to read partition table
sd 2:0:0:1: Attached scsi disk sdg
Vendor: DGC Model: RAID 5 Rev: 0219
Type: Direct-Access ANSI SCSI revision: 04
SCSI device sdh: 314572800 512-byte hdwr sectors (161061 MB)
sdh: Write Protect is off
sdh: Mode Sense: 87 00 00 08
SCSI device sdh: drive cache: write through
SCSI device sdh: 314572800 512-byte hdwr sectors (161061 MB)
sdh: Write Protect is off
sdh: Mode Sense: 87 00 00 08
SCSI device sdh: drive cache: write through
sdh: unknown partition table
sd 2:0:1:0: Attached scsi disk sdh
Vendor: DGC Model: RAID 5 Rev: 0219
Type: Direct-Access ANSI SCSI revision: 04
SCSI device sdi: 314572800 512-byte hdwr sectors (161061 MB)
sdi: Write Protect is off
sdi: Mode Sense: 87 00 00 08
SCSI device sdi: drive cache: write through
SCSI device sdi: 314572800 512-byte hdwr sectors (161061 MB)
sdi: Write Protect is off
sdi: Mode Sense: 87 00 00 08
SCSI device sdi: drive cache: write through
sdi: unknown partition table
sd 2:0:1:1: Attached scsi disk sdi
it seems as if only one LUN was defined but the management software
confirm that two LUN was created,
any help would be appreciated,
thanks
Nicola
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: EMC CX LUN problem
2006-01-24 21:31 EMC CX LUN problem Nicola Murino
@ 2006-01-24 22:28 ` Brian Wong
2006-01-25 1:16 ` Bernd Zeimetz
2006-01-25 9:05 ` Nicola Murino
0 siblings, 2 replies; 8+ messages in thread
From: Brian Wong @ 2006-01-24 22:28 UTC (permalink / raw)
To: device-mapper development
On Tue, 2006-01-24 at 22:31 +0100, Nicola Murino wrote:
> Hi,
>
> I'm trying to configure a new emc cx storage, I have the following:
>
> 2 server, each server has a qla2462 dual port hba
> each qla2462 is connected to a switch (only one switch)
> 1 emc cx storage with 4 path connected to the switch
>
> I defined two lun on the storage however I'm able to see only one LUN
>
> multipath -l show the following:
>
> multipath -l
> mail (36006016086f01600e46f567adb8cda11)
> [size=150 GB][features="1 queue_if_no_path"][hwhandler="1 emc"]
> \_ round-robin 0 [active]
> \_ 1:0:1:0 sdd 8:48 [active][ready]
> \_ 1:0:1:1 sde 8:64 [active][ready]
> \_ 2:0:1:0 sdh 8:112 [active][ready]
> \_ 2:0:1:1 sdi 8:128 [active][ready]
> \_ round-robin 0 [enabled]
> \_ 2:0:0:0 sdf 8:80 [active][ready]
> \_ 1:0:0:0 sdb 8:16 [active][ready]
> \_ 1:0:0:1 sdc 8:32 [active][ready]
> \_ 2:0:0:1 sdg 8:96 [active][ready]
>
i could be off in the weeds here, but this output looks wrong. the
host:channel:target:lun numbers listed there suggest your cx is indeed
surfacing luns 0 and 1, but multipath is grouping them under a single
target ID.
i think emc engineers monitor this list; perhaps they can help.
also, look at this if you havent already (there's a section on clariion
cx's), and feel free to add your findings.
http://christophe.varoqui.free.fr/wiki/wakka.php?wiki=TestedEnvironments
hope that helps,
brian
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: EMC CX LUN problem
2006-01-24 22:28 ` Brian Wong
@ 2006-01-25 1:16 ` Bernd Zeimetz
2006-01-25 8:09 ` Nicola Murino
2006-01-25 9:05 ` Nicola Murino
1 sibling, 1 reply; 8+ messages in thread
From: Bernd Zeimetz @ 2006-01-25 1:16 UTC (permalink / raw)
To: bwong, device-mapper development
Hi,
>>I'm trying to configure a new emc cx storage, I have the following:
>>
>>
>>I defined two lun on the storage however I'm able to see only one LUN
>>
>>multipath -l show the following:
>>
>>multipath -l
>>mail (36006016086f01600e46f567adb8cda11)
>>[size=150 GB][features="1 queue_if_no_path"][hwhandler="1 emc"]
>>\_ round-robin 0 [active]
>> \_ 1:0:1:0 sdd 8:48 [active][ready]
>> \_ 1:0:1:1 sde 8:64 [active][ready]
>> \_ 2:0:1:0 sdh 8:112 [active][ready]
>> \_ 2:0:1:1 sdi 8:128 [active][ready]
>>\_ round-robin 0 [enabled]
>> \_ 2:0:0:0 sdf 8:80 [active][ready]
>> \_ 1:0:0:0 sdb 8:16 [active][ready]
>> \_ 1:0:0:1 sdc 8:32 [active][ready]
>> \_ 2:0:0:1 sdg 8:96 [active][ready]
>>
>>
>>
did you probably just share one raid group via 2 LUNs? Then the output
of multipath is imho indeed right. For me it shows the setup you've
described - one raidgroup, shared via 2 LUNs (usually one per default on
SP A, one on SP B, attached via 2 paths per SP to a switch, accessed
from your server via 2 HBAs.
If you have access to the Navisphere cli tool - please post the output of
./navicli -h IP_OF_ONE_OF_YOUR_SPs getlun
I think this will show that my hint is right.
Imho you want to create a second raid group and share it via 2 LUNs, too.
>http://christophe.varoqui.free.fr/wiki/wakka.php?wiki=TestedEnvironments
>
>
I hope there's nothing wring with the stuff I've written about the
EMC/CX in there, if you find anything please let me know - I don't look
in there often.
Hope that helps,
best regards
Bernd
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: EMC CX LUN problem
2006-01-25 1:16 ` Bernd Zeimetz
@ 2006-01-25 8:09 ` Nicola Murino
0 siblings, 0 replies; 8+ messages in thread
From: Nicola Murino @ 2006-01-25 8:09 UTC (permalink / raw)
To: device-mapper development, bernd
[-- Attachment #1.1: Type: text/plain, Size: 8906 bytes --]
Hi thanks all for your help,
I have two raid group, each raid group has two lun, the lun of the first
raid group are for a linux cluster, the lun of the second raid group are
for a windows cluster,
I installed navicli, this is the output you requested:
./navicli -h 192.168.2.11 getlun
Statistics logging is disabled.
Certain fields are not printed if statistics
logging is not enabled.
LOGICAL UNIT NUMBER 0
Prefetch size (blocks) = 0
Prefetch multiplier = 4
Segment size (blocks) = 0
Segment multiplier = 4
Maximum prefetch (blocks) = 4096
Prefetch Disable Size (blocks) = 4097
Prefetch idle count = 40
Variable length prefetching YES
Prefetched data retained YES
Read cache configured according to
specified parameters.
Total Hard Errors: 0
Total Soft Errors: 0
Total Queue Length: 0
Name ql
Minimum latency reads N/A
RAID Type: RAID5
RAIDGroup ID: 0
State: Bound
Stripe Crossing: 0
Element Size: 128
Current owner: SP B
Offset: 0
Auto-trespass: DISABLED
Auto-assign: DISABLED
Write cache: ENABLED
Read cache: ENABLED
Idle Threshold: 0
Idle Delay Time: 20
Write Aside Size: 2048
Default Owner: SP B
Rebuild Priority: ASAP
Verify Priority: ASAP
Prct Reads Forced Flushed: 0
Prct Writes Forced Flushed: 0
Prct Rebuilt: 100
Prct Bound: 100
LUN Capacity(Megabytes): 512000
LUN Capacity(Blocks): 1048576000
UID: 60:06:01:60:86:F0:16:00:BE:5A:CA:73:DB:8C:DA:11
Is Private: NO
Snapshots List: None
MirrorView Name if any: Not Mirrored
LOGICAL UNIT NUMBER 2
Prefetch size (blocks) = 0
Prefetch multiplier = 4
Segment size (blocks) = 0
Segment multiplier = 4
Maximum prefetch (blocks) = 4096
Prefetch Disable Size (blocks) = 4097
Prefetch idle count = 40
Variable length prefetching YES
Prefetched data retained YES
Read cache configured according to
specified parameters.
Total Hard Errors: 0
Total Soft Errors: 0
Total Queue Length: 0
Name win
Minimum latency reads N/A
RAID Type: RAID5
RAIDGroup ID: 1
State: Bound
Stripe Crossing: 0
Element Size: 128
Current owner: SP A
Offset: 0
Auto-trespass: DISABLED
Auto-assign: DISABLED
Write cache: ENABLED
Read cache: ENABLED
Idle Threshold: 0
Idle Delay Time: 20
Write Aside Size: 2048
Default Owner: SP A
Rebuild Priority: ASAP
Verify Priority: ASAP
Prct Reads Forced Flushed: 0
Prct Writes Forced Flushed: 0
Prct Rebuilt: 100
Prct Bound: 100
LUN Capacity(Megabytes): 819200
LUN Capacity(Blocks): 1677721600
UID: 60:06:01:60:86:F0:16:00:B6:2F:72:8B:DB:8C:DA:11
Is Private: NO
Snapshots List: None
MirrorView Name if any: Not Mirrored
LOGICAL UNIT NUMBER 3
Prefetch size (blocks) = 0
Prefetch multiplier = 4
Segment size (blocks) = 0
Segment multiplier = 4
Maximum prefetch (blocks) = 4096
Prefetch Disable Size (blocks) = 4097
Prefetch idle count = 40
Variable length prefetching YES
Prefetched data retained YES
Read cache configured according to
specified parameters.
Total Hard Errors: 0
Total Soft Errors: 0
Total Queue Length: 0
Name quorum
Minimum latency reads N/A
RAID Type: RAID5
RAIDGroup ID: 1
State: Bound
Stripe Crossing: 0
Element Size: 128
Current owner: SP A
Offset: 0
Auto-trespass: DISABLED
Auto-assign: DISABLED
Write cache: ENABLED
Read cache: ENABLED
Idle Threshold: 0
Idle Delay Time: 20
Write Aside Size: 2048
Default Owner: SP A
Rebuild Priority: ASAP
Verify Priority: ASAP
Prct Reads Forced Flushed: 0
Prct Writes Forced Flushed: 0
Prct Rebuilt: 100
Prct Bound: 100
LUN Capacity(Megabytes): 5120
LUN Capacity(Blocks): 10485760
UID: 60:06:01:60:86:F0:16:00:FC:D3:8B:91:DB:8C:DA:11
Is Private: NO
Snapshots List: None
MirrorView Name if any: Not Mirrored
LOGICAL UNIT NUMBER 1
Prefetch size (blocks) = 0
Prefetch multiplier = 4
Segment size (blocks) = 0
Segment multiplier = 4
Maximum prefetch (blocks) = 4096
Prefetch Disable Size (blocks) = 4097
Prefetch idle count = 40
Variable length prefetching YES
Prefetched data retained YES
Read cache configured according to
specified parameters.
Total Hard Errors: 0
Total Soft Errors: 0
Total Queue Length: 0
Name mail
Minimum latency reads N/A
RAID Type: RAID5
RAIDGroup ID: 0
State: Bound
Stripe Crossing: 0
Element Size: 128
Current owner: SP B
Offset: 0
Auto-trespass: DISABLED
Auto-assign: DISABLED
Write cache: ENABLED
Read cache: ENABLED
Idle Threshold: 0
Idle Delay Time: 20
Write Aside Size: 2048
Default Owner: SP B
Rebuild Priority: ASAP
Verify Priority: ASAP
Prct Reads Forced Flushed: 0
Prct Writes Forced Flushed: 0
Prct Rebuilt: 100
Prct Bound: 100
LUN Capacity(Megabytes): 153600
LUN Capacity(Blocks): 314572800
UID: 60:06:01:60:86:F0:16:00:E4:6F:56:7A:DB:8C:DA:11
Is Private: NO
Snapshots List: None
MirrorView Name if any: Not Mirrored
the output of scsi_id is the same:
server2 block # scsi_id -g -u -s /block/sdb
36006016086f01600e46f567adb8cda11
server2 block # scsi_id -g -u -s /block/sdc
36006016086f01600e46f567adb8cda11
server2 block # scsi_id -g -u -s /block/sdd
36006016086f01600e46f567adb8cda11
server2 block # scsi_id -g -u -s /block/sde
36006016086f01600e46f567adb8cda11
server2 block # scsi_id -g -u -s /block/sdf
36006016086f01600e46f567adb8cda11
server2 block # scsi_id -g -u -s /block/sdg
36006016086f01600e46f567adb8cda11
server2 block # scsi_id -g -u -s /block/sdh
36006016086f01600e46f567adb8cda11
server2 block # scsi_id -g -u -s /block/sdi
36006016086f01600e46f567adb8cda11
I can see and write only on the LUN called mail, I'm not able to see ql
thanks for your help,
regards
Nicola
Bernd Zeimetz ha scritto:
> Hi,
>
>
>>> I'm trying to configure a new emc cx storage, I have the following:
>>>
>>>
>>> I defined two lun on the storage however I'm able to see only one LUN
>>>
>>> multipath -l show the following:
>>>
>>> multipath -l
>>> mail (36006016086f01600e46f567adb8cda11)
>>> [size=150 GB][features="1 queue_if_no_path"][hwhandler="1 emc"]
>>> \_ round-robin 0 [active]
>>> \_ 1:0:1:0 sdd 8:48 [active][ready]
>>> \_ 1:0:1:1 sde 8:64 [active][ready]
>>> \_ 2:0:1:0 sdh 8:112 [active][ready]
>>> \_ 2:0:1:1 sdi 8:128 [active][ready]
>>> \_ round-robin 0 [enabled]
>>> \_ 2:0:0:0 sdf 8:80 [active][ready]
>>> \_ 1:0:0:0 sdb 8:16 [active][ready]
>>> \_ 1:0:0:1 sdc 8:32 [active][ready]
>>> \_ 2:0:0:1 sdg 8:96 [active][ready]
>>>
>>>
>>>
>>>
> did you probably just share one raid group via 2 LUNs? Then the output
> of multipath is imho indeed right. For me it shows the setup you've
> described - one raidgroup, shared via 2 LUNs (usually one per default on
> SP A, one on SP B, attached via 2 paths per SP to a switch, accessed
> from your server via 2 HBAs.
> If you have access to the Navisphere cli tool - please post the output of
>
> ./navicli -h IP_OF_ONE_OF_YOUR_SPs getlun
>
> I think this will show that my hint is right.
> Imho you want to create a second raid group and share it via 2 LUNs, too.
>
>
>> http://christophe.varoqui.free.fr/wiki/wakka.php?wiki=TestedEnvironments
>>
>>
>>
> I hope there's nothing wring with the stuff I've written about the
> EMC/CX in there, if you find anything please let me know - I don't look
> in there often.
>
>
> Hope that helps,
>
> best regards
>
>
> Bernd
>
> --
> dm-devel mailing list
> dm-devel@redhat.com
> https://www.redhat.com/mailman/listinfo/dm-devel
>
>
[-- Attachment #1.2: Type: text/html, Size: 19341 bytes --]
[-- Attachment #2: Type: text/plain, Size: 0 bytes --]
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: EMC CX LUN problem
2006-01-24 22:28 ` Brian Wong
2006-01-25 1:16 ` Bernd Zeimetz
@ 2006-01-25 9:05 ` Nicola Murino
2006-01-25 9:21 ` Nicola Murino
` (2 more replies)
1 sibling, 3 replies; 8+ messages in thread
From: Nicola Murino @ 2006-01-25 9:05 UTC (permalink / raw)
To: bwong, device-mapper development, bernd
Brian Wong ha scritto:
> On Tue, 2006-01-24 at 22:31 +0100, Nicola Murino wrote:
>
>> Hi,
>>
>> I'm trying to configure a new emc cx storage, I have the following:
>>
>> 2 server, each server has a qla2462 dual port hba
>> each qla2462 is connected to a switch (only one switch)
>> 1 emc cx storage with 4 path connected to the switch
>>
>> I defined two lun on the storage however I'm able to see only one LUN
>>
>> multipath -l show the following:
>>
>> multipath -l
>> mail (36006016086f01600e46f567adb8cda11)
>> [size=150 GB][features="1 queue_if_no_path"][hwhandler="1 emc"]
>> \_ round-robin 0 [active]
>> \_ 1:0:1:0 sdd 8:48 [active][ready]
>> \_ 1:0:1:1 sde 8:64 [active][ready]
>> \_ 2:0:1:0 sdh 8:112 [active][ready]
>> \_ 2:0:1:1 sdi 8:128 [active][ready]
>> \_ round-robin 0 [enabled]
>> \_ 2:0:0:0 sdf 8:80 [active][ready]
>> \_ 1:0:0:0 sdb 8:16 [active][ready]
>> \_ 1:0:0:1 sdc 8:32 [active][ready]
>> \_ 2:0:0:1 sdg 8:96 [active][ready]
>>
>>
>
> i could be off in the weeds here, but this output looks wrong. the
> host:channel:target:lun numbers listed there suggest your cx is indeed
> surfacing luns 0 and 1, but multipath is grouping them under a single
> target ID.
>
>
Maybe you are right! I added another LUN and this is multipath output
multipath -l
mail (36006016086f01600e46f567adb8cda11)
[size=150 GB][features="1 queue_if_no_path"][hwhandler="1 emc"]
\_ round-robin 0 [active]
\_ 2:0:0:0 sdh 8:112 [active][ready]
\_ 1:0:0:0 sdb 8:16 [active][ready]
\_ 1:0:0:1 sdc 8:32 [active][ready]
\_ 1:0:0:2 sdd 8:48 [active][ready]
\_ 2:0:0:1 sdi 8:128 [active][ready]
\_ 2:0:0:2 sdj 8:144 [active][ready]
\_ round-robin 0 [enabled]
\_ 1:0:1:0 sde 8:64 [active][ready]
\_ 1:0:1:1 sdf 8:80 [active][ready]
\_ 1:0:1:2 sdg 8:96 [active][ready]
\_ 2:0:1:0 sdk 8:160 [active][ready]
\_ 2:0:1:1 sdl 8:176 [active][ready]
\_ 2:0:1:2 sdm 8:192 [active][ready]
> i think emc engineers monitor this list; perhaps they can help.
>
maybe the problem is scsi_id that report the same output for all block
device,
I have kernel 2.6.16-rc1 on a server and 2.6.13.5 on the other one,
with 2.6.16-rc1
lsmod
Module Size Used by
dm_round_robin 3840 1
dm_emc 5760 1
dm_multipath 18696 3 dm_round_robin,dm_emc
qla2400 200448 0
qla2xxx 116964 25 qla2400
with 2.6.13.5
root@server1:/home/admin# lsmod
Module Size Used by
ehci_hcd 29576 0
uhci_hcd 30864 0
usbcore 104828 3 ehci_hcd,uhci_hcd
dm_round_robin 3712 1
dm_emc 5632 1
dm_multipath 18312 3 dm_round_robin,dm_emc
qla2xxx 110044 12
firmware_class 8448 1 qla2xxx
hba controller are qlogic2462
thanks
Nicola
> also, look at this if you havent already (there's a section on clariion
> cx's), and feel free to add your findings.
>
> http://christophe.varoqui.free.fr/wiki/wakka.php?wiki=TestedEnvironments
>
> hope that helps,
>
> brian
>
>
> --
> dm-devel mailing list
> dm-devel@redhat.com
> https://www.redhat.com/mailman/listinfo/dm-devel
>
>
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: EMC CX LUN problem
2006-01-25 9:05 ` Nicola Murino
@ 2006-01-25 9:21 ` Nicola Murino
2006-01-25 9:35 ` Hannes Reinecke
2006-01-25 19:42 ` EMC CX LUN problem [SOLVED] Nicola Murino
2 siblings, 0 replies; 8+ messages in thread
From: Nicola Murino @ 2006-01-25 9:21 UTC (permalink / raw)
To: device-mapper development
If I attach the a server directly to the storage I have this:
multipath -l
mail (36006016086f01600e46f567adb8cda11)
[size=150 GB][features="1 queue_if_no_path"][hwhandler="1 emc"]
\_ round-robin 0 [active]
\_ 2:0:0:2 sdg 8:96 [active][ready]
\_ 2:0:0:0 sde 8:64 [active][ready]
\_ 2:0:0:1 sdf 8:80 [active][ready]
\_ round-robin 0 [enabled]
\_ 1:0:0:0 sdb 8:16 [active][ready]
\_ 1:0:0:1 sdc 8:32 [active][ready]
\_ 1:0:0:2 sdd 8:48 [active][ready]
all the tree defined LUN are grouped in the same path :-(,
maybe is a bug in qlogic driver (linux see an isp 2432 but it is a 2462)
or in scsi_id what do you think about?
Nicola Murino ha scritto:
> Brian Wong ha scritto:
>> On Tue, 2006-01-24 at 22:31 +0100, Nicola Murino wrote:
>>
>>> Hi,
>>>
>>> I'm trying to configure a new emc cx storage, I have the following:
>>>
>>> 2 server, each server has a qla2462 dual port hba
>>> each qla2462 is connected to a switch (only one switch)
>>> 1 emc cx storage with 4 path connected to the switch
>>>
>>> I defined two lun on the storage however I'm able to see only one LUN
>>>
>>> multipath -l show the following:
>>>
>>> multipath -l
>>> mail (36006016086f01600e46f567adb8cda11)
>>> [size=150 GB][features="1 queue_if_no_path"][hwhandler="1 emc"]
>>> \_ round-robin 0 [active]
>>> \_ 1:0:1:0 sdd 8:48 [active][ready]
>>> \_ 1:0:1:1 sde 8:64 [active][ready]
>>> \_ 2:0:1:0 sdh 8:112 [active][ready]
>>> \_ 2:0:1:1 sdi 8:128 [active][ready]
>>> \_ round-robin 0 [enabled]
>>> \_ 2:0:0:0 sdf 8:80 [active][ready]
>>> \_ 1:0:0:0 sdb 8:16 [active][ready]
>>> \_ 1:0:0:1 sdc 8:32 [active][ready]
>>> \_ 2:0:0:1 sdg 8:96 [active][ready]
>>>
>>>
>>
>> i could be off in the weeds here, but this output looks wrong. the
>> host:channel:target:lun numbers listed there suggest your cx is indeed
>> surfacing luns 0 and 1, but multipath is grouping them under a single
>> target ID.
>>
>>
> Maybe you are right! I added another LUN and this is multipath output
>
> multipath -l
> mail (36006016086f01600e46f567adb8cda11)
> [size=150 GB][features="1 queue_if_no_path"][hwhandler="1 emc"]
> \_ round-robin 0 [active]
> \_ 2:0:0:0 sdh 8:112 [active][ready]
> \_ 1:0:0:0 sdb 8:16 [active][ready]
> \_ 1:0:0:1 sdc 8:32 [active][ready]
> \_ 1:0:0:2 sdd 8:48 [active][ready]
> \_ 2:0:0:1 sdi 8:128 [active][ready]
> \_ 2:0:0:2 sdj 8:144 [active][ready]
> \_ round-robin 0 [enabled]
> \_ 1:0:1:0 sde 8:64 [active][ready]
> \_ 1:0:1:1 sdf 8:80 [active][ready]
> \_ 1:0:1:2 sdg 8:96 [active][ready]
> \_ 2:0:1:0 sdk 8:160 [active][ready]
> \_ 2:0:1:1 sdl 8:176 [active][ready]
> \_ 2:0:1:2 sdm 8:192 [active][ready]
>
>
>> i think emc engineers monitor this list; perhaps they can help.
>>
> maybe the problem is scsi_id that report the same output for all block
> device,
>
> I have kernel 2.6.16-rc1 on a server and 2.6.13.5 on the other one,
>
> with 2.6.16-rc1
>
> lsmod
> Module Size Used by
> dm_round_robin 3840 1
> dm_emc 5760 1
> dm_multipath 18696 3 dm_round_robin,dm_emc
> qla2400 200448 0
> qla2xxx 116964 25 qla2400
>
> with 2.6.13.5
>
>
> root@server1:/home/admin# lsmod
> Module Size Used by
> ehci_hcd 29576 0
> uhci_hcd 30864 0
> usbcore 104828 3 ehci_hcd,uhci_hcd
> dm_round_robin 3712 1
> dm_emc 5632 1
> dm_multipath 18312 3 dm_round_robin,dm_emc
> qla2xxx 110044 12
> firmware_class 8448 1 qla2xxx
>
>
> hba controller are qlogic2462
>
> thanks
> Nicola
>
>
>
>> also, look at this if you havent already (there's a section on clariion
>> cx's), and feel free to add your findings.
>>
>> http://christophe.varoqui.free.fr/wiki/wakka.php?wiki=TestedEnvironments
>>
>> hope that helps,
>>
>> brian
>>
>>
>> --
>> dm-devel mailing list
>> dm-devel@redhat.com
>> https://www.redhat.com/mailman/listinfo/dm-devel
>>
>>
>
> --
> dm-devel mailing list
> dm-devel@redhat.com
> https://www.redhat.com/mailman/listinfo/dm-devel
>
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: EMC CX LUN problem
2006-01-25 9:05 ` Nicola Murino
2006-01-25 9:21 ` Nicola Murino
@ 2006-01-25 9:35 ` Hannes Reinecke
2006-01-25 19:42 ` EMC CX LUN problem [SOLVED] Nicola Murino
2 siblings, 0 replies; 8+ messages in thread
From: Hannes Reinecke @ 2006-01-25 9:35 UTC (permalink / raw)
To: device-mapper development
Nicola Murino wrote:
> Brian Wong ha scritto:
>>
>> i could be off in the weeds here, but this output looks wrong. the
>> host:channel:target:lun numbers listed there suggest your cx is indeed
>> surfacing luns 0 and 1, but multipath is grouping them under a single
>> target ID.
>>
>>
> Maybe you are right! I added another LUN and this is multipath output
>
> multipath -l
> mail (36006016086f01600e46f567adb8cda11)
> [size=150 GB][features="1 queue_if_no_path"][hwhandler="1 emc"]
> \_ round-robin 0 [active]
> \_ 2:0:0:0 sdh 8:112 [active][ready]
> \_ 1:0:0:0 sdb 8:16 [active][ready]
> \_ 1:0:0:1 sdc 8:32 [active][ready]
> \_ 1:0:0:2 sdd 8:48 [active][ready]
> \_ 2:0:0:1 sdi 8:128 [active][ready]
> \_ 2:0:0:2 sdj 8:144 [active][ready]
> \_ round-robin 0 [enabled]
> \_ 1:0:1:0 sde 8:64 [active][ready]
> \_ 1:0:1:1 sdf 8:80 [active][ready]
> \_ 1:0:1:2 sdg 8:96 [active][ready]
> \_ 2:0:1:0 sdk 8:160 [active][ready]
> \_ 2:0:1:1 sdl 8:176 [active][ready]
> \_ 2:0:1:2 sdm 8:192 [active][ready]
>
>
>> i think emc engineers monitor this list; perhaps they can help.
>>
> maybe the problem is scsi_id that report the same output for all block
> device,
>
Ah, the infamous EMC CX. There was some bug in the EMC firmware that
returned a non-standard VPD page 0x83 (pre-spc3 format).
You'll have to check scsi_id, it should have some fixes for it.
Be sure to have the most recent version of scsi_id (resp udev)
installed. It should be called with the option '-p pre-spc3-83'.
Alternatively there is always the possibility of a misconfiguration;
AFAIK EMC has a setting to always return the same information for each
drive; of course this should be switched off ...
Cheers,
Hannes
--
Dr. Hannes Reinecke hare@suse.de
SuSE Linux Products GmbH S390 & zSeries
Maxfeldstraße 5 +49 911 74053 688
90409 Nürnberg http://www.suse.de
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: EMC CX LUN problem [SOLVED]
2006-01-25 9:05 ` Nicola Murino
2006-01-25 9:21 ` Nicola Murino
2006-01-25 9:35 ` Hannes Reinecke
@ 2006-01-25 19:42 ` Nicola Murino
2 siblings, 0 replies; 8+ messages in thread
From: Nicola Murino @ 2006-01-25 19:42 UTC (permalink / raw)
To: device-mapper development
Finally I solved my problem, the gulty was scsi_id, I install CentOS and
scsi_id works as expected reporting different uuid for each lun
this is my final situation:
[root@server1 block]# scsi_id -g -u -s /block/sdb
36006016086f01600bc80c9afbc8dda11
[root@server1 block]# scsi_id -g -u -s /block/sdc
36006016086f01600463513d9978dda11
[root@server1 block]# scsi_id -g -u -s /block/sdd
36006016086f01600bc80c9afbc8dda11
[root@server1 block]# scsi_id -g -u -s /block/sde
36006016086f01600463513d9978dda11
[root@server1 block]# scsi_id -g -u -s /block/sdf
36006016086f01600bc80c9afbc8dda11
[root@server1 block]# scsi_id -g -u -s /block/sdg
36006016086f01600463513d9978dda11
[root@server1 block]# scsi_id -g -u -s /block/sdh
36006016086f01600bc80c9afbc8dda11
[root@server1 block]# scsi_id -g -u -s /block/sdi
36006016086f01600463513d9978dda11
multipath -l
mail (36006016086f01600bc80c9afbc8dda11)
[size=150 GB][features="1 queue_if_no_path"][hwhandler="1 emc"]
\_ round-robin 0 [active]
\_ 1:0:1:0 sdd 8:48 [active]
\_ 2:0:1:0 sdh 8:112 [active]
\_ round-robin 0 [enabled]
\_ 1:0:0:0 sdb 8:16 [active]
\_ 2:0:0:0 sdf 8:80 [active]
ql (36006016086f01600463513d9978dda11)
[size=500 GB][features="1 queue_if_no_path"][hwhandler="1 emc"]
\_ round-robin 0 [active]
\_ 1:0:1:1 sde 8:64 [active]
\_ 2:0:1:1 sdi 8:128 [active]
\_ round-robin 0 [enabled]
\_ 1:0:0:1 sdc 8:32 [active]
\_ 2:0:0:1 sdg 8:96 [active]
scsi_id is broken in gentoo and ubuntu, at least for this setup infact I
have a working multipath setup using gentoo with some minor difference
in hardware equipment,
thanks to all,
regards
Nicola
Nicola Murino ha scritto:
> Brian Wong ha scritto:
>> On Tue, 2006-01-24 at 22:31 +0100, Nicola Murino wrote:
>>
>>> Hi,
>>>
>>> I'm trying to configure a new emc cx storage, I have the following:
>>>
>>> 2 server, each server has a qla2462 dual port hba
>>> each qla2462 is connected to a switch (only one switch)
>>> 1 emc cx storage with 4 path connected to the switch
>>>
>>> I defined two lun on the storage however I'm able to see only one LUN
>>>
>>> multipath -l show the following:
>>>
>>> multipath -l
>>> mail (36006016086f01600e46f567adb8cda11)
>>> [size=150 GB][features="1 queue_if_no_path"][hwhandler="1 emc"]
>>> \_ round-robin 0 [active]
>>> \_ 1:0:1:0 sdd 8:48 [active][ready]
>>> \_ 1:0:1:1 sde 8:64 [active][ready]
>>> \_ 2:0:1:0 sdh 8:112 [active][ready]
>>> \_ 2:0:1:1 sdi 8:128 [active][ready]
>>> \_ round-robin 0 [enabled]
>>> \_ 2:0:0:0 sdf 8:80 [active][ready]
>>> \_ 1:0:0:0 sdb 8:16 [active][ready]
>>> \_ 1:0:0:1 sdc 8:32 [active][ready]
>>> \_ 2:0:0:1 sdg 8:96 [active][ready]
>>>
>>>
>>
>> i could be off in the weeds here, but this output looks wrong. the
>> host:channel:target:lun numbers listed there suggest your cx is indeed
>> surfacing luns 0 and 1, but multipath is grouping them under a single
>> target ID.
>>
>>
> Maybe you are right! I added another LUN and this is multipath output
>
> multipath -l
> mail (36006016086f01600e46f567adb8cda11)
> [size=150 GB][features="1 queue_if_no_path"][hwhandler="1 emc"]
> \_ round-robin 0 [active]
> \_ 2:0:0:0 sdh 8:112 [active][ready]
> \_ 1:0:0:0 sdb 8:16 [active][ready]
> \_ 1:0:0:1 sdc 8:32 [active][ready]
> \_ 1:0:0:2 sdd 8:48 [active][ready]
> \_ 2:0:0:1 sdi 8:128 [active][ready]
> \_ 2:0:0:2 sdj 8:144 [active][ready]
> \_ round-robin 0 [enabled]
> \_ 1:0:1:0 sde 8:64 [active][ready]
> \_ 1:0:1:1 sdf 8:80 [active][ready]
> \_ 1:0:1:2 sdg 8:96 [active][ready]
> \_ 2:0:1:0 sdk 8:160 [active][ready]
> \_ 2:0:1:1 sdl 8:176 [active][ready]
> \_ 2:0:1:2 sdm 8:192 [active][ready]
>
>
>> i think emc engineers monitor this list; perhaps they can help.
>>
> maybe the problem is scsi_id that report the same output for all block
> device,
>
> I have kernel 2.6.16-rc1 on a server and 2.6.13.5 on the other one,
>
> with 2.6.16-rc1
>
> lsmod
> Module Size Used by
> dm_round_robin 3840 1
> dm_emc 5760 1
> dm_multipath 18696 3 dm_round_robin,dm_emc
> qla2400 200448 0
> qla2xxx 116964 25 qla2400
>
> with 2.6.13.5
>
>
> root@server1:/home/admin# lsmod
> Module Size Used by
> ehci_hcd 29576 0
> uhci_hcd 30864 0
> usbcore 104828 3 ehci_hcd,uhci_hcd
> dm_round_robin 3712 1
> dm_emc 5632 1
> dm_multipath 18312 3 dm_round_robin,dm_emc
> qla2xxx 110044 12
> firmware_class 8448 1 qla2xxx
>
>
> hba controller are qlogic2462
>
> thanks
> Nicola
>
>
>
>> also, look at this if you havent already (there's a section on clariion
>> cx's), and feel free to add your findings.
>>
>> http://christophe.varoqui.free.fr/wiki/wakka.php?wiki=TestedEnvironments
>>
>> hope that helps,
>>
>> brian
>>
>>
>> --
>> dm-devel mailing list
>> dm-devel@redhat.com
>> https://www.redhat.com/mailman/listinfo/dm-devel
>>
>>
>
> --
> dm-devel mailing list
> dm-devel@redhat.com
> https://www.redhat.com/mailman/listinfo/dm-devel
>
^ permalink raw reply [flat|nested] 8+ messages in thread
end of thread, other threads:[~2006-01-25 19:42 UTC | newest]
Thread overview: 8+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2006-01-24 21:31 EMC CX LUN problem Nicola Murino
2006-01-24 22:28 ` Brian Wong
2006-01-25 1:16 ` Bernd Zeimetz
2006-01-25 8:09 ` Nicola Murino
2006-01-25 9:05 ` Nicola Murino
2006-01-25 9:21 ` Nicola Murino
2006-01-25 9:35 ` Hannes Reinecke
2006-01-25 19:42 ` EMC CX LUN problem [SOLVED] Nicola Murino
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.