public inbox for linux-rdma@vger.kernel.org
 help / color / mirror / Atom feed
From: Ursula Braun <ubraun-23VcF4HTsmIX0ybBhKVfKdBPR1lH4CV8@public.gmane.org>
To: Sagi Grimberg <sagi-NQWnxTmZq1alnMjI0IkVqw@public.gmane.org>,
	linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
Cc: hwippel-23VcF4HTsmIX0ybBhKVfKdBPR1lH4CV8@public.gmane.org,
	raspl-23VcF4HTsmIX0ybBhKVfKdBPR1lH4CV8@public.gmane.org
Subject: Re: [RFC net-next 05/10] net/smc: register RMB-related memory region
Date: Fri, 21 Jul 2017 09:47:36 +0200	[thread overview]
Message-ID: <287e9962-0a05-df51-40ec-e4f46fc2cade@linux.vnet.ibm.com> (raw)
In-Reply-To: <8df0459f-b2be-53f1-a7c3-388ca22a128c-NQWnxTmZq1alnMjI0IkVqw@public.gmane.org>



On 07/20/2017 05:17 PM, Sagi Grimberg wrote:
>> A memory region created for a new RMB must be registered explicitly,
>> before the peer can make use of it for remote DMA transfer.
> 
> OK, Now I understand the sgl construction in the previous patch.
> 
> We got rid of the synchronous memory registration API in the kernel
> in the absence of users, but now with smc we might want to restore
> it because looking at the patchset, the fast memory registration
> scheme is obviously not a good fit.
> 
> For the simple smc use case the API should be as simple as:
> 
> ib_reg_contig_mr(struct ib_pd *pd, void *addr, size_t length);
> 
> Do you have a use-case for scattered buffers memory registration?
> 

>From my smc perspective I would like to finally allocate the RMB memory as 
scattered pages mapped to contiguous DMA-memory. When creating a new connection
the smc protocol exchanges some information, among them the dma-address to
enable the peer for RDMA WRITEs. According to the smc protocol just one dma-address
can be exchanged; thus contiguous DMA-memory describable by one address only is
required here.
I have prepared already such an smc patch, and it worked for s390, but on my
x-system the scattered pages mapped to scattered DMA-memory after calling
ib_dma_map_sg() and ib_map_mr_sg(). Have I missed something? Is there a way
to explicitly ask for mapping to contiguous memory? 

--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

  parent reply	other threads:[~2017-07-21  7:47 UTC|newest]

Thread overview: 16+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2017-07-20 12:09 [RFC net-next 00/10] net/smc: get rid of unsafe_global_rkey Ursula Braun
     [not found] ` <20170720120946.67234-1-ubraun-23VcF4HTsmIX0ybBhKVfKdBPR1lH4CV8@public.gmane.org>
2017-07-20 12:09   ` [RFC net-next 01/10] net/smc: serialize connection creation in all cases Ursula Braun
2017-07-20 12:09   ` [RFC net-next 02/10] net/smc: shorten local bufsize variables Ursula Braun
2017-07-20 12:09   ` [RFC net-next 03/10] net/smc: introduce sg-logic for RMBs Ursula Braun
     [not found]     ` <20170720120946.67234-4-ubraun-23VcF4HTsmIX0ybBhKVfKdBPR1lH4CV8@public.gmane.org>
2017-07-20 15:13       ` Sagi Grimberg
2017-07-20 12:09   ` [RFC net-next 04/10] net/smc: use separate memory regions " Ursula Braun
2017-07-20 12:09   ` [RFC net-next 05/10] net/smc: register RMB-related memory region Ursula Braun
     [not found]     ` <20170720120946.67234-6-ubraun-23VcF4HTsmIX0ybBhKVfKdBPR1lH4CV8@public.gmane.org>
2017-07-20 15:17       ` Sagi Grimberg
     [not found]         ` <8df0459f-b2be-53f1-a7c3-388ca22a128c-NQWnxTmZq1alnMjI0IkVqw@public.gmane.org>
2017-07-20 15:47           ` Parav Pandit
2017-07-21  7:47           ` Ursula Braun [this message]
2017-07-20 12:09   ` [RFC net-next 06/10] net/smc: remove Kconfig warning Ursula Braun
2017-07-20 12:09   ` [RFC net-next 07/10] net/smc: introduce sg-logic for send buffers Ursula Braun
2017-07-20 12:09   ` [RFC net-next 08/10] net/smc: common functions for RMBs and " Ursula Braun
2017-07-20 12:09   ` [RFC net-next 09/10] net/smc: cleanup function __smc_buf_create() Ursula Braun
2017-07-20 12:09   ` [RFC net-next 10/10] net/smc: synchronize buffer usage with device Ursula Braun
2017-07-20 15:06   ` [RFC net-next 00/10] net/smc: get rid of unsafe_global_rkey Sagi Grimberg

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=287e9962-0a05-df51-40ec-e4f46fc2cade@linux.vnet.ibm.com \
    --to=ubraun-23vcf4htsmix0ybbhkvfkdbpr1lh4cv8@public.gmane.org \
    --cc=hwippel-23VcF4HTsmIX0ybBhKVfKdBPR1lH4CV8@public.gmane.org \
    --cc=linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
    --cc=raspl-23VcF4HTsmIX0ybBhKVfKdBPR1lH4CV8@public.gmane.org \
    --cc=sagi-NQWnxTmZq1alnMjI0IkVqw@public.gmane.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox