linux-rdma.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Bart Van Assche <bvanassche-HInyCGIudOg@public.gmane.org>
To: Sagi Grimberg
	<sagig-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>,
	Roland Dreier <roland-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org>
Cc: Sagi Grimberg <sagig-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>,
	Vu Pham <vuhuong-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>,
	David Dillow <dave-i1Mk8JYDVaaSihdK6806/g@public.gmane.org>,
	Sebastian Parschauer
	<sebastian.riemer-EIkl63zCoXaH+58JC4qpiA@public.gmane.org>,
	linux-rdma <linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org>
Subject: Re: [PATCH 9/9] IB/srp: Add fast registration support
Date: Thu, 08 May 2014 14:38:22 +0200	[thread overview]
Message-ID: <536B7ABE.8080502@acm.org> (raw)
In-Reply-To: <536A6B2F.70807-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>

On 05/07/14 19:19, Sagi Grimberg wrote:
> On 5/7/2014 5:59 PM, Bart Van Assche wrote:
>> On 05/07/14 13:34, Sagi Grimberg wrote:
>>>> +        pool = srp_create_fr_pool(dev->dev, dev->pd,
>>>> +                      SRP_MDESC_PER_POOL, max_pages_per_mr);
>>> 1024 FRMRs per connection?! we use 1024 FMRs for all connections
>>> (per-device). I'd say that's a major over-allocation.
>> It depends on how many discontiguous I/O requests are submitted
>> concurrently. Anyway, how about limiting the number of memory regions to
>> the queue size ?
> 
> Perhaps, but we will need to reserve some more for discontinuous IOs.
> It is heuristic, for FS in most cases IO will align nicely, for some
> crazy DB applications - I'm not sure.

If srp_map_sg() runs out of memory descriptors it adds the remaining sg
entries to the SRP indirect descriptor without using memory
registration. In other words, I think a queue full of discontiguous I/O
requests should be handled properly by srp_map_sg().

Bart.
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

  parent reply	other threads:[~2014-05-08 12:38 UTC|newest]

Thread overview: 32+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2014-05-06 12:49 [PATCH 0/9] SRP initiator patches for kernel 3.16 Bart Van Assche
     [not found] ` <5368DA5B.80609-HInyCGIudOg@public.gmane.org>
2014-05-06 12:50   ` [PATCH 1/9] IB/srp: Fix kernel-doc warnings Bart Van Assche
     [not found]     ` <5368DAB2.2070006-HInyCGIudOg@public.gmane.org>
2014-05-07 10:35       ` Sagi Grimberg
2014-05-06 12:51   ` [PATCH 2/9] IB/srp: Introduce an additional local variable Bart Van Assche
     [not found]     ` <5368DADF.2070105-HInyCGIudOg@public.gmane.org>
2014-05-07 10:37       ` Sagi Grimberg
     [not found]         ` <536A0CF7.7080307-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
2014-05-07 13:52           ` Bart Van Assche
     [not found]             ` <536A3AA4.5010100-HInyCGIudOg@public.gmane.org>
2014-05-07 16:58               ` Sagi Grimberg
2014-05-06 12:52   ` [PATCH 3/9] IB/srp: Introduce srp_alloc_fmr_pool() Bart Van Assche
     [not found]     ` <5368DB05.4070600-HInyCGIudOg@public.gmane.org>
2014-05-07 10:38       ` Sagi Grimberg
2014-05-06 12:53   ` [PATCH 4/9] IB/srp: Introduce srp_map_fmr() Bart Van Assche
     [not found]     ` <5368DB2F.8020506-HInyCGIudOg@public.gmane.org>
2014-05-07 10:39       ` Sagi Grimberg
2014-05-06 12:53   ` [PATCH 5/9] IB/srp: Introduce srp_finish_mapping() Bart Van Assche
     [not found]     ` <5368DB58.6070502-HInyCGIudOg@public.gmane.org>
2014-05-07 10:41       ` Sagi Grimberg
2014-05-06 12:54   ` [PATCH 6/9] IB/srp: Make srp_alloc_req_data() reallocate request data Bart Van Assche
     [not found]     ` <5368DB90.9050209-HInyCGIudOg@public.gmane.org>
2014-05-07 10:50       ` Sagi Grimberg
     [not found]         ` <536A0FF7.7050608-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
2014-05-07 14:11           ` Bart Van Assche
     [not found]             ` <536A3F08.7030108-HInyCGIudOg@public.gmane.org>
2014-05-07 16:58               ` Sagi Grimberg
2014-05-06 12:55   ` [PATCH 7/9] IB/srp: Avoid triggering an infinite loop if memory mapping fails Bart Van Assche
     [not found]     ` <5368DBC5.6070609-HInyCGIudOg@public.gmane.org>
2014-05-07 10:50       ` Sagi Grimberg
2014-05-06 12:56   ` [PATCH 8/9] IB/srp: Rename FMR-related variables Bart Van Assche
2014-05-06 12:56   ` [PATCH 9/9] IB/srp: Add fast registration support Bart Van Assche
     [not found]     ` <5368DC09.70608-HInyCGIudOg@public.gmane.org>
2014-05-07 11:34       ` Sagi Grimberg
     [not found]         ` <536A1A3A.9090208-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
2014-05-07 14:59           ` Bart Van Assche
     [not found]             ` <536A4A68.4080605-HInyCGIudOg@public.gmane.org>
2014-05-07 17:19               ` Sagi Grimberg
     [not found]                 ` <536A6B2F.70807-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
2014-05-08 12:38                   ` Bart Van Assche [this message]
     [not found]                     ` <536B7ABE.8080502-HInyCGIudOg@public.gmane.org>
2014-05-08 15:16                       ` Sagi Grimberg
     [not found]                         ` <536B9FB4.5040009-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
2014-05-08 16:00                           ` Bart Van Assche
     [not found]                             ` <536BAA13.3050905-HInyCGIudOg@public.gmane.org>
2014-05-08 16:18                               ` Sagi Grimberg
2014-05-12 13:21                   ` Bart Van Assche
2014-05-06 14:06   ` [PATCH 0/9] SRP initiator patches for kernel 3.16 Jack Wang
     [not found]     ` <5368EC54.8020802-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
2014-05-06 14:26       ` Bart Van Assche
2014-05-06 14:21   ` [PATCH 3/9] IB/srp: Introduce srp_alloc_fmr_pool() Bart Van Assche

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=536B7ABE.8080502@acm.org \
    --to=bvanassche-hinycgiudog@public.gmane.org \
    --cc=dave-i1Mk8JYDVaaSihdK6806/g@public.gmane.org \
    --cc=linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
    --cc=roland-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org \
    --cc=sagig-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org \
    --cc=sagig-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org \
    --cc=sebastian.riemer-EIkl63zCoXaH+58JC4qpiA@public.gmane.org \
    --cc=vuhuong-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).