* Running open-iscsi with device mapper hangs
@ 2006-05-09 14:00 Erez Zilber
2006-05-09 14:14 ` Erez Zilber
2006-05-09 16:55 ` Mike Christie
0 siblings, 2 replies; 6+ messages in thread
From: Erez Zilber @ 2006-05-09 14:00 UTC (permalink / raw)
To: open-iscsi, device-mapper development
Hi,
I'm trying to run open-iscsi with the multipath tool. I was able to
create a scenario in which the initiator machine hangs:
My initiator runs on a SLES 10 beta 8 machine. The db contains 2 targets:
iscsiadm -m node
[83347a] 192.168.10.106:3260,1 iqn.2005-12.com.voltaire.206000C0FF07C1D1
[030479] 192.168.10.105:3260,1 iqn.2005-12.com.voltaire.206000C0FF07C1D1
Loading the dm modules:
salt:~ # modprobe dm-mod; modprobe dm-multipath
I start the initiator:
salt:~ # /etc/init.d/open-iscsi start
Starting iSCSI initiator service: done
Logging into iqn.2005-12.com.voltaire.206000C0FF07C1D1: done
Logging into iqn.2005-12.com.voltaire.206000C0FF07C1D1: done
salt:~ # sg_map -i -x
/dev/sg0 0 0 0 0 0 /dev/sda DotHill SANnet II FC 411I
/dev/sg1 1 0 0 0 0 /dev/sdb DotHill SANnet II FC 411I
Now, I start the multipath daemon:
salt:~ # ls /dev/mapper/
control
salt:~ # multipathd
salt:~ # ls /dev/mapper/
control mpath0
salt:~ # multipath -l
mpath0 (3600c0ff00000000007c1d121c397f503)
[size=10 GB][features=0][hwhandler=0]
\_ round-robin 0 [prio=0][active]
\_ 0:0:0:0 sda 8:0 [active][undef]
\_ round-robin 0 [prio=0][enabled]
\_ 1:0:0:0 sdb 8:16 [active][undef]
Running some traffic:
salt:~ # dd if=/dev/mapper/mpath0 of=/dev/null count=500000
500000+0 records in
500000+0 records out
256000000 bytes (256 MB) copied, 9.54608 seconds, 26.8 MB/s
Now, I disconnect (unplug the cable) the target which is represented by
/dev/sda and run another dd command:
salt:~ # dd if=/dev/mapper/mpath0 of=/dev/null count=500000
500000+0 records in
500000+0 records out
256000000 bytes (256 MB) copied, 199.601 seconds, 1.3 MB/s
Now, the 1st priority group has failed:
salt:~ # multipath -l
mpath0 (3600c0ff00000000007c1d121c397f503)
[size=10 GB][features=0][hwhandler=0]
\_ round-robin 0 [prio=0][enabled]
\_ 0:0:0:0 sda 8:0 [failed][faulty]
\_ round-robin 0 [prio=0][active]
\_ 1:0:0:0 sdb 8:16 [active][undef]
I reconnect the target and it's back to life:
salt:~ # multipath -l
mpath0 (3600c0ff00000000007c1d121c397f503)
[size=10 GB][features=0][hwhandler=0]
\_ round-robin 0 [prio=0][enabled]
\_ 0:0:0:0 sda 8:0 [active][undef]
\_ round-robin 0 [prio=0][active]
\_ 1:0:0:0 sdb 8:16 [active][undef]
I stop the initiator and the machine hangs:
salt:~ # /etc/init.d/open-iscsi stop
Logging out from iqn.2005-12.com.voltaire.206000C0FF07C1D1: done
Logging out from iqn.2005-12.com.voltaire.206000C0FF07C1D1: (now the
machine is dead)
I know that the device mapper was tested in the past. Was this scenario
tested? Is anyone able to reproduce this behavior? I was able to
reproduce it 5 times in a row.
Thanks
--
____________________________________________________________
Erez Zilber | 972-9-971-7689
Software Engineer, Storage Team
Voltaire – _The Grid Backbone_
__
www.voltaire.com <http://www.voltaire.com/>
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Running open-iscsi with device mapper hangs
2006-05-09 14:00 Running open-iscsi with device mapper hangs Erez Zilber
@ 2006-05-09 14:14 ` Erez Zilber
2006-05-09 16:55 ` Mike Christie
1 sibling, 0 replies; 6+ messages in thread
From: Erez Zilber @ 2006-05-09 14:14 UTC (permalink / raw)
To: open-iscsi; +Cc: device-mapper development
Erez Zilber wrote:
>Hi,
>
>I'm trying to run open-iscsi with the multipath tool. I was able to
>create a scenario in which the initiator machine hangs:
>
>My initiator runs on a SLES 10 beta 8 machine. The db contains 2 targets:
>iscsiadm -m node
>[83347a] 192.168.10.106:3260,1 iqn.2005-12.com.voltaire.206000C0FF07C1D1
>[030479] 192.168.10.105:3260,1 iqn.2005-12.com.voltaire.206000C0FF07C1D1
>
>Loading the dm modules:
>
>salt:~ # modprobe dm-mod; modprobe dm-multipath
>
>I start the initiator:
>
>salt:~ # /etc/init.d/open-iscsi start
>Starting iSCSI initiator service: done
>Logging into iqn.2005-12.com.voltaire.206000C0FF07C1D1: done
>Logging into iqn.2005-12.com.voltaire.206000C0FF07C1D1: done
>
>salt:~ # sg_map -i -x
>/dev/sg0 0 0 0 0 0 /dev/sda DotHill SANnet II FC 411I
>/dev/sg1 1 0 0 0 0 /dev/sdb DotHill SANnet II FC 411I
>
>Now, I start the multipath daemon:
>
>salt:~ # ls /dev/mapper/
>control
>salt:~ # multipathd
>salt:~ # ls /dev/mapper/
>control mpath0
>salt:~ # multipath -l
>mpath0 (3600c0ff00000000007c1d121c397f503)
>[size=10 GB][features=0][hwhandler=0]
>\_ round-robin 0 [prio=0][active]
>\_ 0:0:0:0 sda 8:0 [active][undef]
>\_ round-robin 0 [prio=0][enabled]
>\_ 1:0:0:0 sdb 8:16 [active][undef]
>
>Running some traffic:
>
>salt:~ # dd if=/dev/mapper/mpath0 of=/dev/null count=500000
>500000+0 records in
>500000+0 records out
>256000000 bytes (256 MB) copied, 9.54608 seconds, 26.8 MB/s
>
>Now, I disconnect (unplug the cable) the target which is represented by
>/dev/sda and run another dd command:
>
>salt:~ # dd if=/dev/mapper/mpath0 of=/dev/null count=500000
>500000+0 records in
>500000+0 records out
>256000000 bytes (256 MB) copied, 199.601 seconds, 1.3 MB/s
>
>Now, the 1st priority group has failed:
>
>salt:~ # multipath -l
>mpath0 (3600c0ff00000000007c1d121c397f503)
>[size=10 GB][features=0][hwhandler=0]
>\_ round-robin 0 [prio=0][enabled]
>\_ 0:0:0:0 sda 8:0 [failed][faulty]
>\_ round-robin 0 [prio=0][active]
>\_ 1:0:0:0 sdb 8:16 [active][undef]
>
>I reconnect the target and it's back to life:
>
>salt:~ # multipath -l
>mpath0 (3600c0ff00000000007c1d121c397f503)
>[size=10 GB][features=0][hwhandler=0]
>\_ round-robin 0 [prio=0][enabled]
>\_ 0:0:0:0 sda 8:0 [active][undef]
>\_ round-robin 0 [prio=0][active]
>\_ 1:0:0:0 sdb 8:16 [active][undef]
>
>I stop the initiator and the machine hangs:
>
>salt:~ # /etc/init.d/open-iscsi stop
>Logging out from iqn.2005-12.com.voltaire.206000C0FF07C1D1: done
>Logging out from iqn.2005-12.com.voltaire.206000C0FF07C1D1: (now the
>machine is dead)
>
>I know that the device mapper was tested in the past. Was this scenario
>tested? Is anyone able to reproduce this behavior? I was able to
>reproduce it 5 times in a row.
>
>Thanks
>
>
BTW - a very similar test without the device mapper works ok. I've
disconnected /dev/sda, tried running a dd command using /dev/sda, then I
reconnected /dev/sda and the command completed. When I stopped the
initiator, the machine didn't hang.
Erez
--
____________________________________________________________
Erez Zilber | 972-9-971-7689
Software Engineer, Storage Team
Voltaire – _The Grid Backbone_
__
www.voltaire.com <http://www.voltaire.com/>
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Running open-iscsi with device mapper hangs
2006-05-09 14:00 Running open-iscsi with device mapper hangs Erez Zilber
2006-05-09 14:14 ` Erez Zilber
@ 2006-05-09 16:55 ` Mike Christie
2006-05-10 7:20 ` Erez Zilber
1 sibling, 1 reply; 6+ messages in thread
From: Mike Christie @ 2006-05-09 16:55 UTC (permalink / raw)
To: open-iscsi; +Cc: device-mapper development
Erez Zilber wrote:
> Hi,
>
> I'm trying to run open-iscsi with the multipath tool. I was able to
> create a scenario in which the initiator machine hangs:
>
> My initiator runs on a SLES 10 beta 8 machine. The db contains 2 targets:
> iscsiadm -m node
> [83347a] 192.168.10.106:3260,1 iqn.2005-12.com.voltaire.206000C0FF07C1D1
> [030479] 192.168.10.105:3260,1 iqn.2005-12.com.voltaire.206000C0FF07C1D1
>
are you using the iscsi initiator in a SLES kernel, a mainline kernel or
svn or a open-iscsi.org tarball?
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Re: Running open-iscsi with device mapper hangs
2006-05-09 16:55 ` Mike Christie
@ 2006-05-10 7:20 ` Erez Zilber
2006-05-10 17:22 ` Mike Christie
0 siblings, 1 reply; 6+ messages in thread
From: Erez Zilber @ 2006-05-10 7:20 UTC (permalink / raw)
To: open-iscsi; +Cc: device-mapper development
Mike Christie wrote:
>Erez Zilber wrote:
>
>
>>Hi,
>>
>>I'm trying to run open-iscsi with the multipath tool. I was able to
>>create a scenario in which the initiator machine hangs:
>>
>>My initiator runs on a SLES 10 beta 8 machine. The db contains 2 targets:
>>iscsiadm -m node
>>[83347a] 192.168.10.106:3260,1 iqn.2005-12.com.voltaire.206000C0FF07C1D1
>>[030479] 192.168.10.105:3260,1 iqn.2005-12.com.voltaire.206000C0FF07C1D1
>>
>>
>>
>
>are you using the iscsi initiator in a SLES kernel, a mainline kernel or
>svn or a open-iscsi.org tarball?
>
>--
>dm-devel mailing list
>dm-devel@redhat.com
>https://www.redhat.com/mailman/listinfo/dm-devel
>
>
I'm using the initiator that comes with the SLES kernel
(2.6.16-rc6-git1-4-smp). We applied 3 patches that are located in
https://openib.org/svn/gen2/branches/backport/sles10/:
iscsi-04-libiscsi.patch
iscsi-05-convert-tcp.patch
iscsi-06-transport-ep-cb.patch
The userspace part is r560.
Do you prefer that I try to run it with a different open-iscsi version?
--
____________________________________________________________
Erez Zilber | 972-9-971-7689
Software Engineer, Storage Team
Voltaire – _The Grid Backbone_
__
www.voltaire.com <http://www.voltaire.com/>
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Re: Running open-iscsi with device mapper hangs
2006-05-10 7:20 ` Erez Zilber
@ 2006-05-10 17:22 ` Mike Christie
2006-05-11 14:55 ` Erez Zilber
0 siblings, 1 reply; 6+ messages in thread
From: Mike Christie @ 2006-05-10 17:22 UTC (permalink / raw)
To: open-iscsi; +Cc: device-mapper development
Erez Zilber wrote:
> Mike Christie wrote:
>
>> Erez Zilber wrote:
>>
>>
>>> Hi,
>>>
>>> I'm trying to run open-iscsi with the multipath tool. I was able to
>>> create a scenario in which the initiator machine hangs:
>>>
>>> My initiator runs on a SLES 10 beta 8 machine. The db contains 2 targets:
>>> iscsiadm -m node
>>> [83347a] 192.168.10.106:3260,1 iqn.2005-12.com.voltaire.206000C0FF07C1D1
>>> [030479] 192.168.10.105:3260,1 iqn.2005-12.com.voltaire.206000C0FF07C1D1
>>>
>>>
>>>
>> are you using the iscsi initiator in a SLES kernel, a mainline kernel or
>> svn or a open-iscsi.org tarball?
>>
>> --
>> dm-devel mailing list
>> dm-devel@redhat.com
>> https://www.redhat.com/mailman/listinfo/dm-devel
>>
>>
> I'm using the initiator that comes with the SLES kernel
> (2.6.16-rc6-git1-4-smp). We applied 3 patches that are located in
> https://openib.org/svn/gen2/branches/backport/sles10/:
> iscsi-04-libiscsi.patch
> iscsi-05-convert-tcp.patch
> iscsi-06-transport-ep-cb.patch
>
> The userspace part is r560.
>
> Do you prefer that I try to run it with a different open-iscsi version?
>
Maybe. Do those patches have any of the later fixes PatM found? Look at
r543, 544, 545. Without them you can hit some lockups or oops.
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Re: Running open-iscsi with device mapper hangs
2006-05-10 17:22 ` Mike Christie
@ 2006-05-11 14:55 ` Erez Zilber
0 siblings, 0 replies; 6+ messages in thread
From: Erez Zilber @ 2006-05-11 14:55 UTC (permalink / raw)
To: open-iscsi, Hannes Reinecke; +Cc: device-mapper development
Mike Christie wrote:
>Erez Zilber wrote:
>
>
>>Mike Christie wrote:
>>
>>
>>
>>>Erez Zilber wrote:
>>>
>>>
>>>
>>>
>>>>Hi,
>>>>
>>>>I'm trying to run open-iscsi with the multipath tool. I was able to
>>>>create a scenario in which the initiator machine hangs:
>>>>
>>>>My initiator runs on a SLES 10 beta 8 machine. The db contains 2 targets:
>>>>iscsiadm -m node
>>>>[83347a] 192.168.10.106:3260,1 iqn.2005-12.com.voltaire.206000C0FF07C1D1
>>>>[030479] 192.168.10.105:3260,1 iqn.2005-12.com.voltaire.206000C0FF07C1D1
>>>>
>>>>
>>>>
>>>>
>>>>
>>>are you using the iscsi initiator in a SLES kernel, a mainline kernel or
>>>svn or a open-iscsi.org tarball?
>>>
>>>--
>>>dm-devel mailing list
>>>dm-devel@redhat.com
>>>https://www.redhat.com/mailman/listinfo/dm-devel
>>>
>>>
>>>
>>>
>>I'm using the initiator that comes with the SLES kernel
>>(2.6.16-rc6-git1-4-smp). We applied 3 patches that are located in
>>https://openib.org/svn/gen2/branches/backport/sles10/:
>>iscsi-04-libiscsi.patch
>>iscsi-05-convert-tcp.patch
>>iscsi-06-transport-ep-cb.patch
>>
>>The userspace part is r560.
>>
>>Do you prefer that I try to run it with a different open-iscsi version?
>>
>>
>>
>
>Maybe. Do those patches have any of the later fixes PatM found? Look at
>r543, 544, 545. Without them you can hit some lockups or oops.
>
>--
>dm-devel mailing list
>dm-devel@redhat.com
>https://www.redhat.com/mailman/listinfo/dm-devel
>
>
I'm now running with r545 and I don't see this behavior anymore.
Hannes - do you know when will there be an update for SLES 10 with those
fixes ?
--
____________________________________________________________
Erez Zilber | 972-9-971-7689
Software Engineer, Storage Team
Voltaire – _The Grid Backbone_
__
www.voltaire.com <http://www.voltaire.com/>
^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2006-05-11 14:55 UTC | newest]
Thread overview: 6+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2006-05-09 14:00 Running open-iscsi with device mapper hangs Erez Zilber
2006-05-09 14:14 ` Erez Zilber
2006-05-09 16:55 ` Mike Christie
2006-05-10 7:20 ` Erez Zilber
2006-05-10 17:22 ` Mike Christie
2006-05-11 14:55 ` Erez Zilber
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.