From: Yosry Ahmed <yosry@kernel.org>
To: Brendan Jackman <brendan.jackman@linux.dev>
Cc: "Vlastimil Babka (SUSE)" <vbabka@kernel.org>,
Borislav Petkov <bp@alien8.de>,
Dave Hansen <dave.hansen@linux.intel.com>,
Peter Zijlstra <peterz@infradead.org>,
Andrew Morton <akpm@linux-foundation.org>,
David Hildenbrand <david@kernel.org>,
Mike Rapoport <rppt@kernel.org>, Wei Xu <weixugc@google.com>,
Johannes Weiner <hannes@cmpxchg.org>, Zi Yan <ziy@nvidia.com>,
Lorenzo Stoakes <ljs@kernel.org>,
linux-mm@kvack.org, linux-kernel@vger.kernel.org,
x86@kernel.org, Sumit Garg <sumit.garg@oss.qualcomm.com>,
Will Deacon <will@kernel.org>,
rientjes@google.com, patrick.roy@linux.dev, "Itazuri,
Takahiro" <itazur@amazon.co.uk>,
Andy Lutomirski <luto@kernel.org>,
David Kaplan <david.kaplan@amd.com>,
Thomas Gleixner <tglx@kernel.org>,
Patrick Bellasi <derkling@google.com>,
Reiji Watanabe <reijiw@google.com>,
Sean Christopherson <seanjc@google.com>
Subject: Re: [PATCH v3 19/26] mm/page_alloc: rename ALLOC_NON_BLOCK back to _HARDER
Date: Tue, 18 Aug 2026 00:45:11 +0000 [thread overview]
Message-ID: <aoOqd8Th9dhx2bjT@google.com> (raw)
In-Reply-To: <DKONM2LHEP8I.1PW06S1B3CDC7@linux.dev>
On Fri, Aug 14, 2026 at 01:09:32PM +0100, Brendan Jackman wrote:
> On Tue Aug 4, 2026 at 10:50 PM BST, Yosry Ahmed wrote:
> > On Fri, Jul 31, 2026 at 04:52:59PM +0200, Vlastimil Babka (SUSE) wrote:
> >> On 7/27/26 00:22, Brendan Jackman wrote:
> >> > Commit 1ebbb21811b7 ("mm/page_alloc: explicitly define how __GFP_HIGH
> >> > non-blocking allocations accesses reserves") renamed ALLOC_HARDER to
> >> > ALLOC_NON_BLOCK because the former is "a vague description".
> >> >
> >> > However, vagueness is accurate here, this is a vague flag. It is not set
> >> > for __GFP_NOMEMALLOC. It doesn't really mean "allocate without blocking"
> >> > but rather "allow dipping into atomic reserves, _because_ of the need
> >> > not to block".
> >> >
> >> > A later commit will need an alloc flag that really means "don't block
> >> > here", so go back to the flag's old name and update the commentary
> >> > to try and give it a slightly clearer meaning.
> >> >
> >> > Signed-off-by: Brendan Jackman <jackmanb@google.com>
>
> Writing this to get it clear in my head, so I'll also dump it in the
> mail in case it helps get us on the same page...
>
> What we actually want here is a flag that tells us when we can do a TLB
> shootdown. That means (on x86) that IRQs must be on and we mustn't be
> holding some random spinlock (most spinlocks would actually be fine but
> I think it's simpler to assume we can't hold any).
>
> It must never be over-permissive i.e. tell us we can do a TLB flush
> when we can't. It's fine to _sometimes_ be over-restrictive i.e. tell us
> we can't do a TLB flush when we can, but if it always forbids flushing
> while GFP_BOOT_MASK is in effect then we'll fail critical allocations
> and crash.
Why is it a problem if it forbids flushing while GFP_BOOT_MASK is in
effect? We should change gfp_allowed_mask before any unmapped
allocations are possible, right?
>
> >> I wonder if we need to do this, and instead we could repurpose
> >> ALLOC_NON_BLOCK directly. AFAIU it's about removing the side-effect of
> >> gfp_allowed_mask in the next patch. But what would happen if we did that
> >> using the existing ALLOC_NON_BLOCK (or maybe just renamed to ALLOC_NOBLOCK?).
> >>
> >> - in __zone_watermark_ok(), ALLOC_NON_BLOCK could now be *not* set in
> >> situations where previously it was set due to gfp_allowed_mask masking out
> >> __GFP_DIRECT_RECLAIM.
>
> Hm, I can't follow this. The first paragraph sounds like you're
> proposing that we set ALLOC_NON_BLOCk regardless of gfp_allowed_mask. I
> think that would be fine. But then the second paragraph is saying
> ALLOC_NON_BLOCK would now be unset in places where it's formerly set,
> whereas I think the proposal means it gets set in places it was formerly
> unset.
>
> >> But it only has an effect on top of __GFP_HIGH (thus
> >> ALLOC_MIN_RESERVE... which seems contradicting the ALLOC_NON_BLOCK
> >> description comment btw). Also __GFP_DIRECT_RECLAIM is only masked out by
> >> GFP_BOOT_MASK when all memory is free, so it's kinda moot?
>
> ... but yes, I do think making the existing ALLOC_NON_BLOCK ignore
> gfp_allowed_mask would probably work.
>
> Aside from gfp_allowed_mask the other thing about ALLOC_NON_BLOCK is
> that it gets disabled if __GFP_NOMEMALLOC is set. That is fine for the
> current usecase, but it's pretty confusing...
>
> >> - in rmqueue_buddy() we allow access to highatomic reserves since
> >> 281dd25c1a018. That commit describes GFP_ATOMIC so we could have been
> >> checking ALLOC_MIN_RESERVE. But we can also leave this alone because it
> >> doesn't actually matter when GFP_BOOT_MASK is set, as above.
> >
> > IIUC we are trying to find out if the callers either has interrupts
> > disabled or is holding a lock, and using __GFP_DIRECT_RECLAIM as an
> > indicator. As you mention, it seems like __GFP_DIRECT_RECLAIM is only
> > masked during boot, presumably before we can allocate any unmapped
> > memory (should always be user memory?).
>
> Exactly.
>
> > So maybe we should just use gfpflags_allow_blocking()?
>
> Oh yeah, it definitely should. This doesn't change any of the plumbing
> challenges though since we've lost the GFP flags by the time we get to
> __rmqueue_direct_map().
Yeah I think I prefer just using gfpflags_allow_blocking() if we cannot
use preemtible().
>
> > I also wonder if restricing to callers __GFP_DIRECT_RECLAIM is too
> > restrictive,
>
> It is overly restrictive, but I dont' know of anything better, and if it
> existed I think it would be in gfpflags_allow_blocking().
>
> > we can probably key off __GFP_ATOMIC as I assume any
> > callers with IRQs disabled or wiht a lock have to set it.
>
> There's no such thing as __GFP_ATOMIC. (I think there used to be?)
Duh.
>
> > Maybe we can also use preemptible(), but that creates a dependency on
> > CONFIG_PREEMPT_COUNT as far as I can tell.
>
> Yeah. Which... maybe is fine nowadays? Since commit 7dadeaa6e851
> ("sched: Further restrict the preemption modes") you can only set
> PREEMPT_NONE on alpha/hexagon/m68k. And this restriction only actually
> matters on x86 anyway...
Yeah I will look into that. I like preemptible() because it encodes
exactly what we actually need.
next prev parent reply other threads:[~2026-08-18 0:45 UTC|newest]
Thread overview: 108+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-07-26 22:22 [PATCH v3 00/26] mm: Add ALLOC_UNMAPPED and AS_NO_DIRECT_MAP Brendan Jackman
2026-07-26 22:22 ` [PATCH v3 01/26] set_memory: add folio_{zap,restore}_direct_map helpers Brendan Jackman
2026-07-27 10:33 ` Mike Rapoport
2026-07-29 11:42 ` Brendan Jackman
2026-07-30 20:34 ` Yosry Ahmed
2026-07-31 5:21 ` Mike Rapoport
2026-07-31 11:57 ` Brendan Jackman
2026-07-26 22:22 ` [PATCH v3 02/26] mm/secretmem: make use of folio_{zap,restore}_direct_map Brendan Jackman
2026-07-27 10:40 ` Mike Rapoport
2026-07-26 22:22 ` [PATCH v3 03/26] mm: introduce AS_NO_DIRECT_MAP Brendan Jackman
2026-07-30 21:06 ` Yosry Ahmed
2026-07-31 12:15 ` Brendan Jackman
2026-07-31 19:28 ` Yosry Ahmed
2026-08-07 0:02 ` Sean Christopherson
2026-08-07 0:13 ` Yosry Ahmed
2026-08-07 0:19 ` Sean Christopherson
2026-08-07 0:29 ` Yosry Ahmed
2026-08-07 14:26 ` Sean Christopherson
2026-08-07 18:12 ` Yosry Ahmed
2026-08-07 18:49 ` Sean Christopherson
2026-08-07 19:39 ` Yosry Ahmed
2026-08-07 22:44 ` Sean Christopherson
2026-08-07 22:48 ` Yosry Ahmed
2026-08-08 13:56 ` Brendan Jackman
2026-08-10 21:39 ` Yosry Ahmed
2026-08-10 21:46 ` Sean Christopherson
2026-08-13 15:32 ` Brendan Jackman
2026-08-13 17:25 ` Ackerley Tng
2026-08-18 0:32 ` Yosry Ahmed
2026-08-02 16:10 ` Mike Rapoport
2026-08-08 0:19 ` Yosry Ahmed
2026-07-26 22:22 ` [PATCH v3 04/26] x86/mm: split out preallocate_sub_pgd() Brendan Jackman
2026-07-31 22:10 ` Yosry Ahmed
2026-08-13 15:42 ` Brendan Jackman
2026-08-18 0:30 ` Yosry Ahmed
2026-08-02 16:13 ` Mike Rapoport
2026-08-13 15:46 ` Brendan Jackman
2026-07-26 22:22 ` [PATCH v3 05/26] x86: move PAE PMD preallocation defines to header Brendan Jackman
2026-07-31 23:59 ` Yosry Ahmed
2026-08-13 15:49 ` Brendan Jackman
2026-07-26 22:22 ` [PATCH v3 06/26] x86/tlb: Expose some flush function declarations to modules Brendan Jackman
2026-07-26 22:22 ` [PATCH v3 07/26] x86/mm: introduce mm-local region Brendan Jackman
2026-08-02 16:27 ` Mike Rapoport
2026-08-13 16:10 ` Brendan Jackman
2026-08-03 22:29 ` Yosry Ahmed
2026-08-13 16:23 ` Brendan Jackman
2026-07-26 22:22 ` [PATCH v3 08/26] x86/mm: move LDT remap into " Brendan Jackman
2026-08-03 22:33 ` Yosry Ahmed
2026-07-26 22:22 ` [PATCH v3 09/26] mm: Create flags arg for __apply_to_page_range() Brendan Jackman
2026-07-26 22:22 ` [PATCH v3 10/26] mm: Add more flags " Brendan Jackman
2026-08-04 0:08 ` Yosry Ahmed
2026-08-13 16:40 ` Brendan Jackman
2026-07-26 22:22 ` [PATCH v3 11/26] x86/mm: introduce the mermap Brendan Jackman
2026-08-02 16:40 ` Mike Rapoport
2026-08-13 16:44 ` Brendan Jackman
2026-08-04 18:38 ` Yosry Ahmed
2026-07-26 22:22 ` [PATCH v3 12/26] mm: KUnit tests for " Brendan Jackman
2026-07-26 22:22 ` [PATCH v3 13/26] mm: introduce freetype_t Brendan Jackman
2026-08-04 22:23 ` Yosry Ahmed
2026-08-14 10:37 ` Brendan Jackman
2026-08-18 0:35 ` Yosry Ahmed
2026-08-04 23:02 ` Yosry Ahmed
2026-08-14 10:48 ` Brendan Jackman
2026-07-26 22:22 ` [PATCH v3 14/26] mm: move migratetype definitions to freetype.h Brendan Jackman
2026-07-26 22:22 ` [PATCH v3 15/26] mm/page_alloc: add support for freetypes with no freelist Brendan Jackman
2026-07-31 14:13 ` Vlastimil Babka (SUSE)
2026-07-26 22:22 ` [PATCH v3 16/26] mm: add definitions for allocating unmapped pages Brendan Jackman
2026-08-04 19:53 ` Yosry Ahmed
2026-08-14 11:22 ` Brendan Jackman
2026-07-26 22:22 ` [PATCH v3 17/26] mm: encode freetype flags in pageblock flags Brendan Jackman
2026-07-26 22:22 ` [PATCH v3 18/26] mm/page_alloc: separate pcplists by freetype flags Brendan Jackman
2026-07-26 22:22 ` [PATCH v3 19/26] mm/page_alloc: rename ALLOC_NON_BLOCK back to _HARDER Brendan Jackman
2026-07-31 14:52 ` Vlastimil Babka (SUSE)
2026-08-03 9:20 ` Vlastimil Babka (SUSE)
2026-08-04 21:50 ` Yosry Ahmed
2026-08-14 12:09 ` Brendan Jackman
2026-08-18 0:45 ` Yosry Ahmed [this message]
2026-07-26 22:22 ` [PATCH v3 20/26] mm/page_alloc: introduce ALLOC_NOBLOCK Brendan Jackman
2026-07-26 22:22 ` [PATCH v3 21/26] mm/page_alloc: implement FREETYPE_UNMAPPED allocations Brendan Jackman
2026-08-03 9:18 ` Vlastimil Babka (SUSE)
2026-08-15 14:12 ` Brendan Jackman
2026-08-04 23:41 ` Yosry Ahmed
2026-08-07 0:05 ` Yosry Ahmed
2026-08-14 12:31 ` Brendan Jackman
2026-08-04 23:53 ` Yosry Ahmed
2026-08-05 16:13 ` Yosry Ahmed
2026-08-15 14:28 ` Brendan Jackman
2026-08-18 0:55 ` Yosry Ahmed
2026-08-07 0:16 ` Yosry Ahmed
2026-08-15 14:30 ` Brendan Jackman
2026-08-18 0:50 ` Yosry Ahmed
2026-08-12 21:26 ` Yosry Ahmed
2026-08-15 14:43 ` Brendan Jackman
2026-08-18 0:49 ` Yosry Ahmed
2026-08-18 1:01 ` Yosry Ahmed
2026-07-26 22:22 ` [PATCH v3 22/26] mm: Minimal KUnit tests for some new page_alloc logic Brendan Jackman
2026-08-03 9:30 ` Vlastimil Babka (SUSE)
2026-07-26 22:22 ` [PATCH v3 23/26] mm: Split out NR_FREE_PAGES_BLOCKS_[UN]MAPPED Brendan Jackman
2026-08-03 9:32 ` Vlastimil Babka (SUSE)
2026-07-26 22:22 ` [PATCH v3 24/26] mm/page_alloc: always direct compact for unmapped allocs Brendan Jackman
2026-08-03 9:44 ` Vlastimil Babka (SUSE)
2026-08-15 14:44 ` Brendan Jackman
2026-08-06 23:29 ` Yosry Ahmed
2026-07-26 22:22 ` [PATCH v3 25/26] mm: plumb alloc flags into some alloc funcs Brendan Jackman
2026-08-03 9:52 ` Vlastimil Babka (SUSE)
2026-07-26 22:22 ` [PATCH v3 26/26] mm: add fast path for AS_NO_DIRECT_MAP Brendan Jackman
2026-08-08 0:06 ` Yosry Ahmed
2026-07-29 11:52 ` [PATCH v3 00/26] mm: Add ALLOC_UNMAPPED and AS_NO_DIRECT_MAP Brendan Jackman
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=aoOqd8Th9dhx2bjT@google.com \
--to=yosry@kernel.org \
--cc=akpm@linux-foundation.org \
--cc=bp@alien8.de \
--cc=brendan.jackman@linux.dev \
--cc=dave.hansen@linux.intel.com \
--cc=david.kaplan@amd.com \
--cc=david@kernel.org \
--cc=derkling@google.com \
--cc=hannes@cmpxchg.org \
--cc=itazur@amazon.co.uk \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=ljs@kernel.org \
--cc=luto@kernel.org \
--cc=patrick.roy@linux.dev \
--cc=peterz@infradead.org \
--cc=reijiw@google.com \
--cc=rientjes@google.com \
--cc=rppt@kernel.org \
--cc=seanjc@google.com \
--cc=sumit.garg@oss.qualcomm.com \
--cc=tglx@kernel.org \
--cc=vbabka@kernel.org \
--cc=weixugc@google.com \
--cc=will@kernel.org \
--cc=x86@kernel.org \
--cc=ziy@nvidia.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox