netdev.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: John Ousterhout <ouster@cs.stanford.edu>
To: Paolo Abeni <pabeni@redhat.com>
Cc: Netdev <netdev@vger.kernel.org>,
	Eric Dumazet <edumazet@google.com>,
	 Simon Horman <horms@kernel.org>,
	Jakub Kicinski <kuba@kernel.org>
Subject: Re: [PATCH net-next v6 08/12] net: homa: create homa_incoming.c
Date: Tue, 4 Feb 2025 08:30:32 -0800	[thread overview]
Message-ID: <CAGXJAmzL39XZ-tcDRrLs-hiAXi3W79cAoVe18hHkD7iGDKe7yQ@mail.gmail.com> (raw)
In-Reply-To: <52365045-c771-412a-9232-70e80e26c34f@redhat.com>

On Tue, Feb 4, 2025 at 12:50 AM Paolo Abeni <pabeni@redhat.com> wrote:
>
> On 2/4/25 12:33 AM, John Ousterhout wrote:
> > On Mon, Feb 3, 2025 at 1:12 AM Paolo Abeni <pabeni@redhat.com> wrote:
> >> I don't see where/how the SO_HOMA_RCVBUF max value is somehow bounded?!?
> >> It looks like the user-space could pick an arbitrary large value for it.
> >
> > That's right; is there anything to be gained by limiting it? This is
> > simply mmapped memory in the user address space. Aren't applications
> > allowed to allocate as much memory as they like? If so, why shouldn't
> > they be able to use that memory for incoming buffers if they choose?
>
> If unprivileged applications could use unlimited amount of kernel
> memory, they could hurt the whole system stability, possibly causing
> functional issue of core kernel due to ENOMEM.
>
> The we always try to bound/put limits on amount of kernel memory
> user-space application can use.

Homa's receive buffer space is *not kernel memory*; it's just a large
mmapped region created by the application., no different from an
application allocating a large region of memory for its internal
computation.

> >> Fine tuning controls and sysctls could land later, but the basic
> >> constraints should IMHO be there from the beginning.
> >
> > OK. I think that SO_HOMA_RCVBUF takes care of RX buffer space.
>
> We need some way to allow the admin to bound the SO_HOMA_RCVBUF max value.

Even if this memory is entirely user memory (we seem to be
miscommunicating over this)?

> > For TX, what's the simplest scheme that you would be comfortable with? For
> > example, if I cap the number of outstanding RPCs per socket, will that
> > be enough for now?
>
> Usually the bounds are expressed in bytes. How complex would be adding
> wmem accounting?

I'll see what I can do.

-John-

  reply	other threads:[~2025-02-04 16:31 UTC|newest]

Thread overview: 68+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2025-01-15 18:59 [PATCH net-next v6 00/12] Begin upstreaming Homa transport protocol John Ousterhout
2025-01-15 18:59 ` [PATCH net-next v6 01/12] net: homa: define user-visible API for Homa John Ousterhout
2025-01-15 18:59 ` [PATCH net-next v6 02/12] net: homa: create homa_wire.h John Ousterhout
2025-01-15 18:59 ` [PATCH net-next v6 03/12] net: homa: create shared Homa header files John Ousterhout
2025-01-23 11:01   ` Paolo Abeni
2025-01-24 21:21     ` John Ousterhout
2025-01-27  9:05       ` Paolo Abeni
2025-01-27 17:04         ` John Ousterhout
2025-01-15 18:59 ` [PATCH net-next v6 04/12] net: homa: create homa_pool.h and homa_pool.c John Ousterhout
2025-01-23 12:06   ` Paolo Abeni
2025-01-24 23:53     ` John Ousterhout
2025-01-25  0:46       ` Andrew Lunn
2025-01-26  5:33         ` John Ousterhout
2025-01-27  9:41       ` Paolo Abeni
2025-01-27 17:34         ` John Ousterhout
2025-01-27 18:28           ` Paolo Abeni
2025-01-27 19:12             ` John Ousterhout
2025-01-28  8:27               ` Paolo Abeni
2025-01-15 18:59 ` [PATCH net-next v6 05/12] net: homa: create homa_rpc.h and homa_rpc.c John Ousterhout
2025-01-23 14:29   ` Paolo Abeni
2025-01-27  5:22     ` John Ousterhout
2025-01-27 10:01       ` Paolo Abeni
2025-01-27 18:03         ` John Ousterhout
2025-01-28  8:19           ` Paolo Abeni
2025-01-29  1:23             ` John Ousterhout
     [not found]               ` <13345e2a-849d-4bd8-a95e-9cd7f287c7df@redhat.com>
2025-01-29 16:43                 ` John Ousterhout
2025-01-29 16:49                   ` Eric Dumazet
2025-01-29 16:54                     ` John Ousterhout
2025-01-29 17:04                       ` Eric Dumazet
2025-01-29 20:27                         ` John Ousterhout
2025-01-29 20:40                           ` Eric Dumazet
2025-01-29 21:08                             ` John Ousterhout
2025-01-15 18:59 ` [PATCH net-next v6 06/12] net: homa: create homa_peer.h and homa_peer.c John Ousterhout
2025-01-23 17:45   ` Paolo Abeni
2025-01-28  0:06     ` John Ousterhout
2025-01-28  0:32       ` Jason Xing
2025-01-15 18:59 ` [PATCH net-next v6 07/12] net: homa: create homa_sock.h and homa_sock.c John Ousterhout
2025-01-23 19:01   ` Paolo Abeni
2025-01-28  0:40     ` John Ousterhout
2025-01-28  4:26       ` John Ousterhout
2025-01-28 15:10       ` Eric Dumazet
2025-01-28 17:04         ` John Ousterhout
2025-01-24  7:33   ` Paolo Abeni
2025-01-15 18:59 ` [PATCH net-next v6 08/12] net: homa: create homa_incoming.c John Ousterhout
2025-01-24  8:31   ` Paolo Abeni
2025-01-30  0:41     ` John Ousterhout
     [not found]       ` <991b5ad9-57cf-4e1d-8e01-9d0639fa4e49@redhat.com>
2025-01-31 22:48         ` John Ousterhout
2025-02-03  9:12           ` Paolo Abeni
2025-02-03 23:33             ` John Ousterhout
2025-02-04  8:50               ` Paolo Abeni
2025-02-04 16:30                 ` John Ousterhout [this message]
2025-02-04 19:41                   ` Andrew Lunn
2025-02-04 21:20                     ` John Ousterhout
2025-01-27 10:19   ` Paolo Abeni
2025-01-30  0:48     ` John Ousterhout
2025-01-30  9:57       ` Paolo Abeni
2025-01-31 22:51         ` John Ousterhout
     [not found]         ` <CAGXJAmxLqnjnWr8sjooJRRyQ2-5BqPCQL8gnn0gzYoZ0MMoBSw@mail.gmail.com>
2025-02-03  9:17           ` Paolo Abeni
2025-02-03 17:33             ` John Ousterhout
2025-02-03 17:58               ` Andrew Lunn
2025-02-05 23:56                 ` John Ousterhout
2025-02-06  1:49                   ` Andrew Lunn
2025-01-15 18:59 ` [PATCH net-next v6 09/12] net: homa: create homa_outgoing.c John Ousterhout
2025-01-15 18:59 ` [PATCH net-next v6 10/12] net: homa: create homa_timer.c John Ousterhout
2025-01-15 18:59 ` [PATCH net-next v6 11/12] net: homa: create homa_plumbing.c and homa_utils.c John Ousterhout
2025-01-15 18:59 ` [PATCH net-next v6 12/12] net: homa: create Makefile and Kconfig John Ousterhout
2025-01-24  8:55 ` [PATCH net-next v6 00/12] Begin upstreaming Homa transport protocol Paolo Abeni
2025-02-10 19:19   ` John Ousterhout

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=CAGXJAmzL39XZ-tcDRrLs-hiAXi3W79cAoVe18hHkD7iGDKe7yQ@mail.gmail.com \
    --to=ouster@cs.stanford.edu \
    --cc=edumazet@google.com \
    --cc=horms@kernel.org \
    --cc=kuba@kernel.org \
    --cc=netdev@vger.kernel.org \
    --cc=pabeni@redhat.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).