netdev.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Eric Dumazet <eric.dumazet@gmail.com>
To: Jakub Kicinski <kuba@kernel.org>, Eric Dumazet <eric.dumazet@gmail.com>
Cc: davem@davemloft.net, netdev@vger.kernel.org, willemb@google.com,
	dsahern@gmail.com, yoshfuji@linux-ipv6.org,
	Dave Jones <dsj@fb.com>
Subject: Re: [PATCH net-next] ip: avoid OOM kills with large UDP sends over loopback
Date: Tue, 22 Jun 2021 20:47:57 +0200	[thread overview]
Message-ID: <d4e2cf28-89f9-7c1f-91de-759de2c47fae@gmail.com> (raw)
In-Reply-To: <20210622110935.35318a30@kicinski-fedora-PC1C0HJN.hsd1.ca.comcast.net>



On 6/22/21 8:09 PM, Jakub Kicinski wrote:
> On Tue, 22 Jun 2021 19:48:43 +0200 Eric Dumazet wrote:
>>>> What about using 	sock_alloc_send_pskb(... PAGE_ALLOC_COSTLY_ORDER)
>>>> (as we did in unix_dgram_sendmsg() for large packets), for SG enabled interfaces ?  
>>>
>>> PAGE_ALLOC_COSTLY_ORDER in itself is more of a problem than a solution.
>>> AFAIU the app sends messages primarily above the ~60kB mark, which is
>>> above COSTLY, and those do not trigger OOM kills. All OOM kills we see
>>> have order=3. Checking with Rik and Johannes W that's expected, OOM
>>> killer is only invoked for allocations <= COSTLY, larger ones will just
>>> return NULL and let us deal with it (e.g. by falling back).  
>>
>> I  really thought alloc_skb_with_frags() was already handling low-memory-conditions.
>>
>> (alloc_skb_with_frags() is called from sock_alloc_send_pskb())
>>
>> If it is not, lets fix it, because af_unix sockets will have the same issue ?
> 
> af_unix seems to cap at SKB_MAX_ALLOC which is order 2, AFAICT.

It does not cap to SKB_MAX_ALLOC.

It definitely attempt big allocations if you send 64KB datagrams.

Please look at commit d14b56f508ad70eca3e659545aab3c45200f258c
    net: cleanup gfp mask in alloc_skb_with_frags

This explains why we do not have __GFP_NORETRY there.

> 
> Perhaps that's a good enough fix in practice given we see OOMs with
> order=3 only?
> 
> I'll review callers of alloc_skb_with_frags() and see if they depend 
> on the explicit geometry of the skb or we can safely fallback to pages.
> 

  reply	other threads:[~2021-06-22 18:48 UTC|newest]

Thread overview: 12+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2021-06-21 23:13 [PATCH net-next] ip: avoid OOM kills with large UDP sends over loopback Jakub Kicinski
2021-06-22 10:07 ` Paolo Abeni
2021-06-22 16:57   ` Jakub Kicinski
2021-06-22 14:12 ` Eric Dumazet
2021-06-22 16:54   ` Jakub Kicinski
2021-06-22 17:19     ` Jakub Kicinski
2021-06-22 17:49       ` Eric Dumazet
2021-06-22 17:48     ` Eric Dumazet
2021-06-22 18:09       ` Jakub Kicinski
2021-06-22 18:47         ` Eric Dumazet [this message]
2021-06-22 19:04           ` Jakub Kicinski
2021-06-22 19:51             ` Jakub Kicinski

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=d4e2cf28-89f9-7c1f-91de-759de2c47fae@gmail.com \
    --to=eric.dumazet@gmail.com \
    --cc=davem@davemloft.net \
    --cc=dsahern@gmail.com \
    --cc=dsj@fb.com \
    --cc=kuba@kernel.org \
    --cc=netdev@vger.kernel.org \
    --cc=willemb@google.com \
    --cc=yoshfuji@linux-ipv6.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).