linux-rdma.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Bart Van Assche <bvanassche-HInyCGIudOg@public.gmane.org>
To: Sagi Grimberg <sagig-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>
Cc: Roland Dreier <roland-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org>,
	David Dillow <dave-i1Mk8JYDVaaSihdK6806/g@public.gmane.org>,
	Vu Pham <vuhuong-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>,
	Sebastian Riemer
	<sebastian.riemer-EIkl63zCoXaH+58JC4qpiA@public.gmane.org>,
	linux-rdma <linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org>,
	Konrad Grzybowski <konradg-XLFqaoR9dsI@public.gmane.org>
Subject: Re: [PATCH 8/8] IB/srp: Make queue size configurable
Date: Tue, 20 Aug 2013 17:55:39 +0200	[thread overview]
Message-ID: <5213917B.3020403@acm.org> (raw)
In-Reply-To: <52138C6E.6080201-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>

On 08/20/13 17:34, Sagi Grimberg wrote:
> On 8/20/2013 3:50 PM, Bart Van Assche wrote:
>> Certain storage configurations, e.g. a sufficiently large array of
>> hard disks in a RAID configuration, need a queue depth above 64 to
>> achieve optimal performance. Hence make the queue depth configurable.
>> [ ... ]
>
> I noticed this patch in your github and played with it, I agree that
> this patch is needed for a long time...
>
> Question,
> If srp now will allow larger queues while using a single global FMR pool
> of size 1024, isn't it more likely now that in stress environment srp
> will run out of FMRs to handle IO commands?
> I mean that let's say that you have x scsi hosts with can_queue size of
> 512 (+-) and all of them are running IO stress, is it possible that all
> FMRs will be inuse and no FMR is available to register the next IO SG-list?
> Did you try out such a scenario?
>
> I guess that in such a case IB core will return EAGAIN and SRP will
> return SCSI_MLQUEUE_HOST_BUSY.
> I think it is a good Idea to move FMR pools to be per connection rather
> than a global pool, what do you think?

That makes sense to me. And as long as the above has not yet been 
implemented I'm fine with dropping patch 8/8 from this patch set.

Bart.
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

  parent reply	other threads:[~2013-08-20 15:55 UTC|newest]

Thread overview: 31+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2013-08-20 12:41 [PATCH 0/8] IB SRP initiator patches for kernel 3.12 Bart Van Assche
     [not found] ` <521363EA.8080906-HInyCGIudOg@public.gmane.org>
2013-08-20 12:43   ` [PATCH 1/8] IB/srp: Keep rport as long as the IB transport layer Bart Van Assche
2013-08-20 12:44   ` [PATCH 2/8] scsi_transport_srp: Add transport layer error handling Bart Van Assche
2013-08-20 12:45   ` [PATCH 3/8] IB/srp: Add srp_terminate_io() Bart Van Assche
2013-08-20 12:46   ` [PATCH 4/8] IB/srp: Use SRP transport layer error recovery Bart Van Assche
2013-08-20 12:46   ` [PATCH 5/8] IB/srp: Start timers if a transport layer error occurs Bart Van Assche
2013-08-20 12:47   ` [PATCH 6/8] IB/srp: Make transport layer retry count configurable Bart Van Assche
2013-08-20 12:48   ` [PATCH 7/8] IB/srp: Introduce srp_alloc_req_data() Bart Van Assche
2013-08-20 12:50   ` [PATCH 8/8] IB/srp: Make queue size configurable Bart Van Assche
     [not found]     ` <52136609.3090406-HInyCGIudOg@public.gmane.org>
2013-08-20 15:34       ` Sagi Grimberg
     [not found]         ` <52138C6E.6080201-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>
2013-08-20 15:55           ` Bart Van Assche [this message]
     [not found]             ` <5213917B.3020403-HInyCGIudOg@public.gmane.org>
2013-08-20 17:43               ` David Dillow
     [not found]                 ` <1377020595.22321.6.camel-zHLflQxYYDO4Hhoo1DtQwJ9G+ZOsUmrO@public.gmane.org>
2013-08-21  7:19                   ` Sagi Grimberg
2013-09-10  3:01       ` David Dillow
     [not found]         ` <1378782080.3794.6.camel-VK19RVc5TWXUd6DVheFtbw@public.gmane.org>
2013-09-10 17:44           ` Bart Van Assche
     [not found]             ` <522F5A81.8040101-HInyCGIudOg@public.gmane.org>
2013-09-11 22:16               ` David Dillow
     [not found]                 ` <1378937796.6649.5.camel-a7a0dvSY7KqLUyTwlgNVppKKF0rrzTr+@public.gmane.org>
2013-09-12 16:16                   ` Jack Wang
     [not found]                     ` <5231E8CE.5060105-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
2013-09-12 16:30                       ` Bart Van Assche
     [not found]                         ` <5231EC1A.7030902-HInyCGIudOg@public.gmane.org>
2013-09-13  8:06                           ` Jack Wang
     [not found]                             ` <5232C76B.4010704-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
2013-09-13  8:40                               ` Bart Van Assche
     [not found]                                 ` <5232CF86.20507-HInyCGIudOg@public.gmane.org>
2013-09-13  9:24                                   ` Bart Van Assche
     [not found]                                     ` <5232D9BC.7090808-HInyCGIudOg@public.gmane.org>
2013-09-13 12:25                                       ` Jack Wang
     [not found]                                         ` <5233043F.5020804-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
2013-09-13 13:33                                           ` Bart Van Assche
     [not found]                                             ` <52331444.8070007-HInyCGIudOg@public.gmane.org>
2013-09-13 13:51                                               ` Jack Wang
     [not found]                                                 ` <52331854.9010607-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
2013-09-13 14:03                                                   ` Bart Van Assche
     [not found]                                                     ` <52331B47.9070202-HInyCGIudOg@public.gmane.org>
2013-09-13 14:15                                                       ` Jack Wang
     [not found]                                                         ` <52331E01.3060005-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
2013-09-13 14:31                                                           ` Jack Wang
2013-09-13 14:31                                                           ` Bart Van Assche
2013-09-16 14:25                   ` Bart Van Assche
     [not found]                     ` <523714D8.3020104-HInyCGIudOg@public.gmane.org>
2013-09-16 14:28                       ` David Dillow
2013-09-10  2:53   ` [PATCH 0/8] IB SRP initiator patches for kernel 3.12 David Dillow

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=5213917B.3020403@acm.org \
    --to=bvanassche-hinycgiudog@public.gmane.org \
    --cc=dave-i1Mk8JYDVaaSihdK6806/g@public.gmane.org \
    --cc=konradg-XLFqaoR9dsI@public.gmane.org \
    --cc=linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
    --cc=roland-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org \
    --cc=sagig-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org \
    --cc=sebastian.riemer-EIkl63zCoXaH+58JC4qpiA@public.gmane.org \
    --cc=vuhuong-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).