iser problems

iser problems

[Popovics László]

Dear stgt list,

I would like to ask, that, is there any information about that, tgtd can run in multiple instances ?
When we tried to run a second instance, it give an error message because rdma listening port is occupied.

We would like to test multiple tgt instance because we have a feeling about that, rdma connecion number is limited for one instance, and we reached this limit.

We configured multiple storage machines with each of 312 disk which has 624 connection because of the multipath access.

When we put load to the system get the following messages:

Nov 4 14:08:10 taistoreb04 tgtd: iser_task_alloc_rdma_bufs(715) conn:0x2d31920 task:0x2bcb9180 tag:0x0028, free list empty

On the initiator side we see devices disconnected.

Is there any idea how to solve this problem ?

Best regards,

       Laszlo Popovics

Re: iser problems

[Eric Millbrandt]

[-- Attachment #1: Type: text/plain, Size: 717 bytes --]

On 11/25/2013 05:35 AM, Popovics László wrote:
> Dear stgt list,
>
> I would like to ask, that, is there any information about that, tgtd can run in multiple instances ?
> When we tried to run a second instance, it give an error message because rdma listening port is occupied.
>
> We would like to test multiple tgt instance because we have a feeling about that, rdma connecion number is limited for one instance, and we reached this limit.
Pass these command-line arguments to tgtd when launching multiple
instances (replace XXX with an open port number).

tgtd --control-port XXX --iscsi portal=0.0.0.0:XXX --iser port=XXX

Make sure you specify a unique port number for each tgtd instance.

Eric


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 901 bytes --]

Re: iser problems

[Popovics László]

Thanks for the answer. Now it is working.
I had two important information which useful for every one who facing this problem.

iser port and portal port (XXX) must be same.
selinux can produce problems when port is not 3260.

Best regards,

	Laszlo

2013.11.25. dátummal, 19:18 időpontban Eric Millbrandt <eric.millbrandt@cacheio.com> írta:

> On 11/25/2013 05:35 AM, Popovics László wrote:
>> Dear stgt list,
>> 
>> I would like to ask, that, is there any information about that, tgtd can run in multiple instances ?
>> When we tried to run a second instance, it give an error message because rdma listening port is occupied.
>> 
>> We would like to test multiple tgt instance because we have a feeling about that, rdma connecion number is limited for one instance, and we reached this limit.
> Pass these command-line arguments to tgtd when launching multiple
> instances (replace XXX with an open port number).
> 
> tgtd --control-port XXX --iscsi portal=0.0.0.0:XXX --iser port=XXX
> 
> Make sure you specify a unique port number for each tgtd instance.
> 
> Eric
> 

RE: iser problems

[Roi Dayan]

Hi,

I want to add that the control-port doesn't have to match the iscsi portal and iser port.
Though it is convenient.
It has to match against tgtdadm commands to specify which tgtd process to control.
Can be any number.

Thanks,
Roi

-----Original Message-----
From: stgt-owner@vger.kernel.org [mailto:stgt-owner@vger.kernel.org] On Behalf Of Eric Millbrandt
Sent: Monday, November 25, 2013 8:21 PM
To: Popovics László; stgt@vger.kernel.org
Subject: Re: iser problems

On 11/25/2013 05:35 AM, Popovics László wrote:
> Dear stgt list,
>
> I would like to ask, that, is there any information about that, tgtd can run in multiple instances ?
> When we tried to run a second instance, it give an error message because rdma listening port is occupied.
>
> We would like to test multiple tgt instance because we have a feeling about that, rdma connecion number is limited for one instance, and we reached this limit.
Pass these command-line arguments to tgtd when launching multiple instances (replace XXX with an open port number).

tgtd --control-port XXX --iscsi portal=0.0.0.0:XXX --iser port=XXX

Make sure you specify a unique port number for each tgtd instance.

Eric