From: "Steve Wise" <swise-7bPotxP6k4+P2YhJcF5u+vpXobYPEAuW@public.gmane.org>
To: 'Jason Gunthorpe'
<jgunthorpe-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org>,
'Chuck Lever'
<chuck.lever-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
Cc: "'Amrani,
Ram'" <Ram.Amrani-YGCgFSpz5w/QT0dZR+AlfA@public.gmane.org>,
"'Elior,
Ariel'" <Ariel.Elior-YGCgFSpz5w/QT0dZR+AlfA@public.gmane.org>,
"'Kalderon,
Michal'"
<Michal.Kalderon-YGCgFSpz5w/QT0dZR+AlfA@public.gmane.org>,
linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org,
'Hariprasad S'
<hariprasad-ut6Up61K2wZBDgjK7y7TUQ@public.gmane.org>,
'Faisal Latif'
<faisal.latif-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org>,
'Doug Ledford' <dledford-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>
Subject: RE: NFSoRDMA Fails for max_sge Less Than 18
Date: Wed, 11 Jan 2017 15:15:04 -0600 [thread overview]
Message-ID: <042601d26c4f$c7190e90$554b2bb0$@opengridcomputing.com> (raw)
In-Reply-To: <20170111211123.GD28917-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org>
>
> On Wed, Jan 11, 2017 at 02:40:37PM -0500, Chuck Lever wrote:
>
> > It might be cool to have an API similar to rdma_rw that allows ULPs
> > to use a scatterlist for Send and Receive operations. It could hide
> > the driver and device maximum SGE values.
>
> That would be good, it could bounce buffer, build temporary MRs,
> or repeat RDMA WRITE/READ as appropriate..
>
We're talking SEND opcodes where the ULP transfers data in the SEND that
includes the command request or reply instead of having the target/server side
issue RDMA opcodes.
> The ULP really is not the right place to put this trade off logic
> since it will be very device specific..
>
A temporary REG_MR would do the trick...assuming it can contain the SGE depth as
well. But issuing multiple SEND operations involves ULP protocol headers so
that couldn't be done by a core service...
Steve.
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
next prev parent reply other threads:[~2017-01-11 21:15 UTC|newest]
Thread overview: 16+ messages / expand[flat|nested] mbox.gz Atom feed top
2017-01-11 7:41 NFSoRDMA Fails for max_sge Less Than 18 Amrani, Ram
[not found] ` <SN1PR07MB2207F28F05DC6E22B03CC516F8660-mikhvbZlbf8TSoR2DauN2+FPX92sqiQdvxpqHgZTriW3zl9H0oFU5g@public.gmane.org>
2017-01-11 16:38 ` Chuck Lever
[not found] ` <FE817A76-28A7-4AEC-AF1E-01DE15790E43-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
2017-01-11 17:04 ` Steve Wise
2017-01-11 19:40 ` Chuck Lever
[not found] ` <28B0D906-7BDB-4B87-94E9-6BE263BFBFF7-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
2017-01-11 19:53 ` Steve Wise
2017-01-11 20:09 ` Chuck Lever
[not found] ` <383D1FFB-346B-40E9-A174-606F13AFF849-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
2017-01-11 20:18 ` Steve Wise
2017-01-11 20:35 ` Chuck Lever
[not found] ` <A7A39994-66C6-4467-837B-288348C0CC53-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
2017-01-13 22:42 ` Steve Wise
2017-01-13 22:43 ` Chuck Lever
[not found] ` <906A1B75-67E9-4D10-AD87-18F694F54818-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
2017-01-13 22:45 ` Steve Wise
2017-01-19 17:19 ` Amrani, Ram
2017-01-11 21:11 ` Jason Gunthorpe
[not found] ` <20170111211123.GD28917-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org>
2017-01-11 21:15 ` Steve Wise [this message]
2017-01-11 21:34 ` Jason Gunthorpe
[not found] ` <20170111213416.GA30681-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org>
2017-01-11 21:48 ` Steve Wise
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to='042601d26c4f$c7190e90$554b2bb0$@opengridcomputing.com' \
--to=swise-7bpotxp6k4+p2yhjcf5u+vpxobypeauw@public.gmane.org \
--cc=Ariel.Elior-YGCgFSpz5w/QT0dZR+AlfA@public.gmane.org \
--cc=Michal.Kalderon-YGCgFSpz5w/QT0dZR+AlfA@public.gmane.org \
--cc=Ram.Amrani-YGCgFSpz5w/QT0dZR+AlfA@public.gmane.org \
--cc=chuck.lever-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org \
--cc=dledford-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org \
--cc=faisal.latif-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org \
--cc=hariprasad-ut6Up61K2wZBDgjK7y7TUQ@public.gmane.org \
--cc=jgunthorpe-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org \
--cc=linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).