From: Bart Van Assche <bvanassche-HInyCGIudOg@public.gmane.org>
To: Sagi Grimberg
<sagig-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>,
Roland Dreier <roland-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org>
Cc: Sagi Grimberg <sagig-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>,
Vu Pham <vuhuong-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>,
David Dillow <dave-i1Mk8JYDVaaSihdK6806/g@public.gmane.org>,
Sebastian Parschauer
<sebastian.riemer-EIkl63zCoXaH+58JC4qpiA@public.gmane.org>,
linux-rdma <linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org>
Subject: Re: [PATCH 9/9] IB/srp: Add fast registration support
Date: Thu, 08 May 2014 14:38:22 +0200 [thread overview]
Message-ID: <536B7ABE.8080502@acm.org> (raw)
In-Reply-To: <536A6B2F.70807-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
On 05/07/14 19:19, Sagi Grimberg wrote:
> On 5/7/2014 5:59 PM, Bart Van Assche wrote:
>> On 05/07/14 13:34, Sagi Grimberg wrote:
>>>> + pool = srp_create_fr_pool(dev->dev, dev->pd,
>>>> + SRP_MDESC_PER_POOL, max_pages_per_mr);
>>> 1024 FRMRs per connection?! we use 1024 FMRs for all connections
>>> (per-device). I'd say that's a major over-allocation.
>> It depends on how many discontiguous I/O requests are submitted
>> concurrently. Anyway, how about limiting the number of memory regions to
>> the queue size ?
>
> Perhaps, but we will need to reserve some more for discontinuous IOs.
> It is heuristic, for FS in most cases IO will align nicely, for some
> crazy DB applications - I'm not sure.
If srp_map_sg() runs out of memory descriptors it adds the remaining sg
entries to the SRP indirect descriptor without using memory
registration. In other words, I think a queue full of discontiguous I/O
requests should be handled properly by srp_map_sg().
Bart.
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
next prev parent reply other threads:[~2014-05-08 12:38 UTC|newest]
Thread overview: 32+ messages / expand[flat|nested] mbox.gz Atom feed top
2014-05-06 12:49 [PATCH 0/9] SRP initiator patches for kernel 3.16 Bart Van Assche
[not found] ` <5368DA5B.80609-HInyCGIudOg@public.gmane.org>
2014-05-06 12:50 ` [PATCH 1/9] IB/srp: Fix kernel-doc warnings Bart Van Assche
[not found] ` <5368DAB2.2070006-HInyCGIudOg@public.gmane.org>
2014-05-07 10:35 ` Sagi Grimberg
2014-05-06 12:51 ` [PATCH 2/9] IB/srp: Introduce an additional local variable Bart Van Assche
[not found] ` <5368DADF.2070105-HInyCGIudOg@public.gmane.org>
2014-05-07 10:37 ` Sagi Grimberg
[not found] ` <536A0CF7.7080307-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
2014-05-07 13:52 ` Bart Van Assche
[not found] ` <536A3AA4.5010100-HInyCGIudOg@public.gmane.org>
2014-05-07 16:58 ` Sagi Grimberg
2014-05-06 12:52 ` [PATCH 3/9] IB/srp: Introduce srp_alloc_fmr_pool() Bart Van Assche
[not found] ` <5368DB05.4070600-HInyCGIudOg@public.gmane.org>
2014-05-07 10:38 ` Sagi Grimberg
2014-05-06 12:53 ` [PATCH 4/9] IB/srp: Introduce srp_map_fmr() Bart Van Assche
[not found] ` <5368DB2F.8020506-HInyCGIudOg@public.gmane.org>
2014-05-07 10:39 ` Sagi Grimberg
2014-05-06 12:53 ` [PATCH 5/9] IB/srp: Introduce srp_finish_mapping() Bart Van Assche
[not found] ` <5368DB58.6070502-HInyCGIudOg@public.gmane.org>
2014-05-07 10:41 ` Sagi Grimberg
2014-05-06 12:54 ` [PATCH 6/9] IB/srp: Make srp_alloc_req_data() reallocate request data Bart Van Assche
[not found] ` <5368DB90.9050209-HInyCGIudOg@public.gmane.org>
2014-05-07 10:50 ` Sagi Grimberg
[not found] ` <536A0FF7.7050608-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
2014-05-07 14:11 ` Bart Van Assche
[not found] ` <536A3F08.7030108-HInyCGIudOg@public.gmane.org>
2014-05-07 16:58 ` Sagi Grimberg
2014-05-06 12:55 ` [PATCH 7/9] IB/srp: Avoid triggering an infinite loop if memory mapping fails Bart Van Assche
[not found] ` <5368DBC5.6070609-HInyCGIudOg@public.gmane.org>
2014-05-07 10:50 ` Sagi Grimberg
2014-05-06 12:56 ` [PATCH 8/9] IB/srp: Rename FMR-related variables Bart Van Assche
2014-05-06 12:56 ` [PATCH 9/9] IB/srp: Add fast registration support Bart Van Assche
[not found] ` <5368DC09.70608-HInyCGIudOg@public.gmane.org>
2014-05-07 11:34 ` Sagi Grimberg
[not found] ` <536A1A3A.9090208-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
2014-05-07 14:59 ` Bart Van Assche
[not found] ` <536A4A68.4080605-HInyCGIudOg@public.gmane.org>
2014-05-07 17:19 ` Sagi Grimberg
[not found] ` <536A6B2F.70807-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
2014-05-08 12:38 ` Bart Van Assche [this message]
[not found] ` <536B7ABE.8080502-HInyCGIudOg@public.gmane.org>
2014-05-08 15:16 ` Sagi Grimberg
[not found] ` <536B9FB4.5040009-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
2014-05-08 16:00 ` Bart Van Assche
[not found] ` <536BAA13.3050905-HInyCGIudOg@public.gmane.org>
2014-05-08 16:18 ` Sagi Grimberg
2014-05-12 13:21 ` Bart Van Assche
2014-05-06 14:06 ` [PATCH 0/9] SRP initiator patches for kernel 3.16 Jack Wang
[not found] ` <5368EC54.8020802-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
2014-05-06 14:26 ` Bart Van Assche
2014-05-06 14:21 ` [PATCH 3/9] IB/srp: Introduce srp_alloc_fmr_pool() Bart Van Assche
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=536B7ABE.8080502@acm.org \
--to=bvanassche-hinycgiudog@public.gmane.org \
--cc=dave-i1Mk8JYDVaaSihdK6806/g@public.gmane.org \
--cc=linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
--cc=roland-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org \
--cc=sagig-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org \
--cc=sagig-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org \
--cc=sebastian.riemer-EIkl63zCoXaH+58JC4qpiA@public.gmane.org \
--cc=vuhuong-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).