linux-rdma.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Steve Wise <swise-7bPotxP6k4+P2YhJcF5u+vpXobYPEAuW@public.gmane.org>
To: Jason Gunthorpe
	<jgunthorpe-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org>
Cc: 'Tom Talpey' <tom-CLs1Zie5N5HQT0dZR+AlfA@public.gmane.org>,
	'Chuck Lever'
	<chuck.lever-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>,
	linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org,
	linux-nfs-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
Subject: Re: [PATCH v3 05/15] xprtrdma: Remove last ib_reg_phys_mr() call site
Date: Tue, 21 Jul 2015 17:41:22 -0500	[thread overview]
Message-ID: <55AECA92.3040105@opengridcomputing.com> (raw)
In-Reply-To: <20150720224244.GB12278-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org>

On 7/20/2015 5:42 PM, Jason Gunthorpe wrote:
> On Mon, Jul 20, 2015 at 05:41:27PM -0500, Steve Wise wrote:
>>> B) why bother to check? Are machines with <4GB interesting, and worth
>>> supporting a special optimization?
>> No, but cxgb3 is still interesting to user applications, and perhaps NFSRDMA using FRMRs.
> Doesn't look like the NFS client will work. It requires an all
> physical memory lkey for SEND and RECV buffers..
>
> Jason
> --
> To unsubscribe from this list: send the line "unsubscribe linux-nfs" in
> the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html

Looks like cxgb3 supports LOCAL_DMA_LKEY and MEM_MGT_EXTENSIONS so dma 
mrs aren't required for NFSRDMA:

t4:~/linux-2.6/drivers/infiniband/hw/cxgb3 # grep IB_DEVICE_ iwch_provider.c
         strlcpy(dev->ibdev.name, "cxgb3_%d", IB_DEVICE_NAME_MAX);
         dev->device_cap_flags = IB_DEVICE_LOCAL_DMA_LKEY |
                                 IB_DEVICE_MEM_WINDOW |
                                 IB_DEVICE_MEM_MGT_EXTENSIONS;

So cxgb3 can still support NFSRDMA and user verbs w/o get_dma_mr(). I'll 
submit a patch soon to only support get_dma_mr() if unsigned long is 4 
bytes...

Steve.

--
To unsubscribe from this list: send the line "unsubscribe linux-nfs" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

  parent reply	other threads:[~2015-07-21 22:41 UTC|newest]

Thread overview: 57+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2015-07-20 19:02 [PATCH v3 00/15] NFS/RDMA client side for Linux 4.3 Chuck Lever
     [not found] ` <20150720185624.10997.51574.stgit-FYjufvaPoItvLzlybtyyYzGyq/o6K9yX@public.gmane.org>
2015-07-20 19:02   ` [PATCH v3 01/15] xprtrdma: Make xprt_setup_rdma() agnostic to family of server address Chuck Lever
     [not found]     ` <20150720190233.10997.29445.stgit-FYjufvaPoItvLzlybtyyYzGyq/o6K9yX@public.gmane.org>
2015-07-26 16:49       ` Christoph Hellwig
2015-07-20 19:02   ` [PATCH v3 02/15] xprtrdma: Raise maximum payload size to one megabyte Chuck Lever
2015-07-20 19:02   ` [PATCH v3 03/15] xprtrdma: Increase default credit limit Chuck Lever
2015-07-20 19:03   ` [PATCH v3 04/15] xprtrdma: Don't fall back to PHYSICAL memory registration Chuck Lever
     [not found]     ` <20150720190302.10997.86410.stgit-FYjufvaPoItvLzlybtyyYzGyq/o6K9yX@public.gmane.org>
2015-07-26 16:50       ` Christoph Hellwig
2015-07-20 19:03   ` [PATCH v3 05/15] xprtrdma: Remove last ib_reg_phys_mr() call site Chuck Lever
     [not found]     ` <20150720190311.10997.12636.stgit-FYjufvaPoItvLzlybtyyYzGyq/o6K9yX@public.gmane.org>
2015-07-20 20:34       ` Tom Talpey
     [not found]         ` <55AD5B48.3010906-CLs1Zie5N5HQT0dZR+AlfA@public.gmane.org>
2015-07-20 20:55           ` Chuck Lever
     [not found]             ` <06BCEDB0-1589-454B-BDD1-9937290AAD29-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
2015-07-20 21:55               ` Tom Talpey
     [not found]                 ` <55AD6E43.60205-CLs1Zie5N5HQT0dZR+AlfA@public.gmane.org>
2015-07-20 22:21                   ` Chuck Lever
     [not found]                     ` <6AEC449B-7E77-4DD1-BE6F-A68F6D8D022D-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
2015-07-20 22:30                       ` Tom Talpey
2015-07-20 21:05           ` Jason Gunthorpe
     [not found]             ` <20150720210544.GA9655-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org>
2015-07-20 21:16               ` Steve Wise
2015-07-20 22:04                 ` Tom Talpey
     [not found]                   ` <55AD7065.8040809-CLs1Zie5N5HQT0dZR+AlfA@public.gmane.org>
2015-07-20 22:17                     ` Jason Gunthorpe
     [not found]                       ` <20150720221703.GB11356-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org>
2015-07-20 22:26                         ` Tom Talpey
2015-07-20 22:41                     ` Steve Wise
2015-07-20 22:42                       ` Jason Gunthorpe
     [not found]                         ` <20150720224244.GB12278-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org>
2015-07-21 22:41                           ` Steve Wise [this message]
     [not found]                             ` <55AECA92.3040105-7bPotxP6k4+P2YhJcF5u+vpXobYPEAuW@public.gmane.org>
2015-07-21 22:54                               ` Jason Gunthorpe
     [not found]                                 ` <20150721225433.GA25724-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org>
2015-07-22 13:58                                   ` Steve Wise
2015-07-21  0:15                       ` Tom Talpey
     [not found]                         ` <55AD8F05.6070409-CLs1Zie5N5HQT0dZR+AlfA@public.gmane.org>
2015-07-21 14:33                           ` Steve Wise
2015-07-21 20:47                             ` Tom Talpey
     [not found]                               ` <55AEAFCE.60207-CLs1Zie5N5HQT0dZR+AlfA@public.gmane.org>
2015-07-21 20:55                                 ` Steve Wise
2015-07-21 21:22                               ` Steve Wise
2015-07-20 21:34             ` Steve Wise
2015-07-20 21:37             ` Steve Wise
2015-07-20 22:13               ` Jason Gunthorpe
     [not found]                 ` <20150720221333.GA11356-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org>
2015-07-20 22:43                   ` Steve Wise
2015-07-20 22:54                     ` Jason Gunthorpe
     [not found]                       ` <20150720225414.GA12442-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org>
2015-07-20 22:54                         ` Steve Wise
2015-07-20 22:26       ` Jason Gunthorpe
     [not found]         ` <20150720222608.GA12005-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org>
2015-07-20 22:31           ` Chuck Lever
     [not found]             ` <73A27338-7EFC-4F54-A15E-09B9D5145242-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
2015-07-20 22:41               ` Jason Gunthorpe
     [not found]                 ` <20150720224134.GA12278-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org>
2015-07-20 23:36                   ` Chuck Lever
     [not found]                     ` <D54C793F-7420-4FC8-9BCA-32C19EC492AA-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
2015-07-21  0:11                       ` Tom Talpey
     [not found]                         ` <55AD8E1D.2010803-CLs1Zie5N5HQT0dZR+AlfA@public.gmane.org>
2015-07-21  0:34                           ` Chuck Lever
     [not found]                             ` <1419E153-14FF-4182-9768-FC40AE92B84A-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
2015-07-21  1:03                               ` Tom Talpey
2015-07-20 19:03   ` [PATCH v3 06/15] xprtrdma: Clean up rpcrdma_ia_open() Chuck Lever
     [not found]     ` <20150720190320.10997.40165.stgit-FYjufvaPoItvLzlybtyyYzGyq/o6K9yX@public.gmane.org>
2015-07-26 16:53       ` Christoph Hellwig
     [not found]         ` <20150726165337.GC9273-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
2015-07-26 18:21           ` Chuck Lever
     [not found]             ` <B8761105-FE4E-4DD4-8E3D-77F30B170ADD-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
2015-07-26 18:51               ` Christoph Hellwig
2015-07-20 19:03   ` [PATCH v3 07/15] xprtrdma: Remove logic that constructs RDMA_MSGP type calls Chuck Lever
2015-07-20 19:03   ` [PATCH v3 08/15] xprtrdma: Account for RPC/RDMA header size when deciding to inline Chuck Lever
2015-07-20 19:03   ` [PATCH v3 09/15] xprtrdma: Always provide a write list when sending NFS READ Chuck Lever
2015-07-20 19:03   ` [PATCH v3 10/15] xprtrdma: Don't provide a reply chunk when expecting a short reply Chuck Lever
2015-07-20 19:04   ` [PATCH v3 11/15] xprtrdma: Fix XDR tail buffer marshalling Chuck Lever
2015-07-20 19:04   ` [PATCH v3 12/15] xprtrdma: Fix large NFS SYMLINK calls Chuck Lever
2015-07-20 19:04   ` [PATCH v3 13/15] xprtrdma: Clean up xprt_rdma_print_stats() Chuck Lever
2015-07-20 19:04   ` [PATCH v3 14/15] xprtrdma: Count RDMA_NOMSG type calls Chuck Lever
2015-07-20 19:04   ` [PATCH v3 15/15] core: Remove the ib_reg_phys_mr() and ib_rereg_phys_mr() verbs Chuck Lever
     [not found]     ` <20150720190446.10997.83633.stgit-FYjufvaPoItvLzlybtyyYzGyq/o6K9yX@public.gmane.org>
2015-07-21 20:08       ` Anna Schumaker
     [not found]         ` <55AEA6A4.8020204-ZwjVKphTwtPQT0dZR+AlfA@public.gmane.org>
2015-07-21 20:16           ` Chuck Lever
     [not found]             ` <D4DD6D9E-1660-4424-9A2A-54AE85368A7A-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
2015-07-21 20:18               ` Anna Schumaker

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=55AECA92.3040105@opengridcomputing.com \
    --to=swise-7bpotxp6k4+p2yhjcf5u+vpxobypeauw@public.gmane.org \
    --cc=chuck.lever-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org \
    --cc=jgunthorpe-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org \
    --cc=linux-nfs-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
    --cc=linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
    --cc=tom-CLs1Zie5N5HQT0dZR+AlfA@public.gmane.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).