public inbox for linux-rdma@vger.kernel.org
 help / color / mirror / Atom feed
From: Roland Dreier <rdreier-FYB4Gu1CFyUAvxtiuMwx3w@public.gmane.org>
To: Mike Heinz <michael.heinz-h88ZbnxC6KDQT0dZR+AlfA@public.gmane.org>
Cc: "linux-rdma@vger.kernel.org"
	<linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org>,
	Hal Rosenstock
	<hal.rosenstock-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>,
	"Hefty,
	Sean" <sean.hefty-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org>
Subject: Re: [PATCH v2] allow passthrough of rmpp packets to user mad clients
Date: Wed, 23 Jun 2010 10:26:37 -0700	[thread overview]
Message-ID: <adad3vhvewi.fsf@roland-alpha.cisco.com> (raw)
In-Reply-To: <4C2744E8AD2982428C5BFE523DF8CDCB49D09E7C2F-amwN6d8PyQWXx9kJd3VG2h2eb7JE58TQ@public.gmane.org> (Mike Heinz's message of "Fri, 18 Jun 2010 08:42:38 -0500")

 > Unfortunately for IB the size of an RMPP response and buffer cannot
 > be controlled by the kernel.  So if an application has a large
 > response to send, the entire buffer must be copied into the kernel
 > and the kernel cannot decide on its own segmentation boundaries.
 > Hence the ability for selected management applications to control and
 > limit the amount of kernel memory space is desirable.  These issues
 > become serious at scale when larger RMPP responses are needed and
 > more clients may also be issuing requests.  The two can combine and
 > result in N^2 types behavior for kernel memory footprint relative to
 > N=cluster node count or potentially N=cluster CPU core count.

So this is an interesting point.  However I don't think we really want
to solve this by adding some magic value of the version field that
changes the umad interface into a completely different mode and then
have every app implement its own copy of the RMPP protocol in userspace.
It would seem a lot cleaner to me to just fix up the kernel RMPP
implementation to avoid the huge double buffering; is that not possible?

The other argument (proprietary legacy apps) doesn't really carry any
weight with me.  We're not going to introduce duplicate APIs just so
someone doesn't have to port old code.

 - R.
-- 
Roland Dreier <rolandd-FYB4Gu1CFyUAvxtiuMwx3w@public.gmane.org> || For corporate legal information go to:
http://www.cisco.com/web/about/doing_business/legal/cri/index.html
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

  parent reply	other threads:[~2010-06-23 17:26 UTC|newest]

Thread overview: 12+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2010-06-04 17:14 [PATCH v2] allow passthrough of rmpp packets to user mad clients Mike Heinz
     [not found] ` <4C2744E8AD2982428C5BFE523DF8CDCB49A488DAD8-amwN6d8PyQWXx9kJd3VG2h2eb7JE58TQ@public.gmane.org>
2010-06-04 19:54   ` Roland Dreier
     [not found]     ` <adask52o9p6.fsf-BjVyx320WGW9gfZ95n9DRSW4+XlvGpQz@public.gmane.org>
2010-06-07 17:55       ` Mike Heinz
2010-06-18 13:42       ` Mike Heinz
     [not found]         ` <4C2744E8AD2982428C5BFE523DF8CDCB49D09E7C2F-amwN6d8PyQWXx9kJd3VG2h2eb7JE58TQ@public.gmane.org>
2010-06-18 15:41           ` Jason Gunthorpe
     [not found]             ` <20100618154134.GA12884-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org>
2010-06-18 16:33               ` Hefty, Sean
     [not found]                 ` <CF9C39F99A89134C9CF9C4CCB68B8DDF259E5A7B73-osO9UTpF0USkrb+BlOpmy7fspsVTdybXVpNB7YpNyf8@public.gmane.org>
2010-06-18 16:38                   ` Jason Gunthorpe
     [not found]                     ` <20100618163842.GJ4630-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org>
2010-06-18 16:42                       ` Hefty, Sean
2010-06-18 17:23           ` Hefty, Sean
2010-06-23 17:26           ` Roland Dreier [this message]
2010-06-08 16:59   ` [PATCH v2] allow passthrough of rmpp protocol " Mike Heinz
     [not found]     ` <4C2744E8AD2982428C5BFE523DF8CDCB49A488DCEE-amwN6d8PyQWXx9kJd3VG2h2eb7JE58TQ@public.gmane.org>
2010-06-09 16:03       ` Hefty, Sean

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=adad3vhvewi.fsf@roland-alpha.cisco.com \
    --to=rdreier-fyb4gu1cfyuavxtiumwx3w@public.gmane.org \
    --cc=hal.rosenstock-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org \
    --cc=linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
    --cc=michael.heinz-h88ZbnxC6KDQT0dZR+AlfA@public.gmane.org \
    --cc=sean.hefty-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox