All of lore.kernel.org
 help / color / mirror / Atom feed
From: "Lorenzo Stoakes (ARM)" <ljs@kernel.org>
To: "David Hildenbrand (Arm)" <david@kernel.org>
Cc: Andrew Morton <akpm@linux-foundation.org>,
	Zi Yan <ziy@nvidia.com>,
	 Baolin Wang <baolin.wang@linux.alibaba.com>,
	"Liam R. Howlett" <liam@infradead.org>,
	 Nico Pache <nico.pache@linux.dev>,
	Ryan Roberts <ryan.roberts@arm.com>, Dev Jain <dev.jain@arm.com>,
	 Barry Song <baohua@kernel.org>,
	Lance Yang <lance.yang@linux.dev>,
	 Usama Arif <usama.arif@linux.dev>,
	Kiryl Shutsemau <kas@kernel.org>, Guo Ren <guoren@kernel.org>,
	 Brian Cain <bcain@kernel.org>,
	Geert Uytterhoeven <geert@linux-m68k.org>,
	 Dinh Nguyen <dinguyen@kernel.org>,
	Simon Schuster <schuster.simon@siemens-energy.com>,
	 Jonas Bonn <jonas@southpole.se>,
	Stefan Kristiansson <stefan.kristiansson@saunalahti.fi>,
	 Stafford Horne <shorne@gmail.com>,
	Yoshinori Sato <ysato@users.sourceforge.jp>,
	 Rich Felker <dalias@libc.org>,
	John Paul Adrian Glaubitz <glaubitz@physik.fu-berlin.de>,
	 Paul Walmsley <pjw@kernel.org>,
	Palmer Dabbelt <palmer@dabbelt.com>,
	 Albert Ou <aou@eecs.berkeley.edu>,
	Alexandre Ghiti <alex@ghiti.fr>,
	 Russell King <linux@armlinux.org.uk>,
	Vineet Gupta <vgupta@kernel.org>,
	 Michal Simek <monstr@monstr.eu>, Chris Zankel <chris@zankel.net>,
	 Max Filippov <jcmvbkbc@gmail.com>, Will Deacon <will@kernel.org>,
	 "Aneesh Kumar K.V" <aneesh.kumar@kernel.org>,
	Nick Piggin <npiggin@gmail.com>,
	 Peter Zijlstra <peterz@infradead.org>,
	"David S. Miller" <davem@davemloft.net>,
	 Andreas Larsson <andreas@gaisler.com>,
	Richard Henderson <richard.henderson@linaro.org>,
	 Matt Turner <mattst88@gmail.com>,
	Magnus Lindholm <linmag7@gmail.com>,
	 Catalin Marinas <catalin.marinas@arm.com>,
	Mark Rutland <mark.rutland@arm.com>,
	 Huacai Chen <chenhuacai@kernel.org>,
	WANG Xuerui <kernel@xen0n.name>,
	 Thomas Bogendoerfer <tsbogend@alpha.franken.de>,
	"James E.J. Bottomley" <James.Bottomley@hansenpartnership.com>,
	 Helge Deller <deller@gmx.de>,
	Madhavan Srinivasan <maddy@linux.ibm.com>,
	 Michael Ellerman <mpe@ellerman.id.au>,
	"Christophe Leroy (CS GROUP)" <chleroy@kernel.org>,
	 Heiko Carstens <hca@linux.ibm.com>,
	Vasily Gorbik <gor@linux.ibm.com>,
	 Alexander Gordeev <agordeev@linux.ibm.com>,
	Christian Borntraeger <borntraeger@linux.ibm.com>,
	 Sven Schnelle <svens@linux.ibm.com>,
	Richard Weinberger <richard@nod.at>,
	 Anton Ivanov <anton.ivanov@cambridgegreys.com>,
	Johannes Berg <johannes@sipsolutions.net>,
	 Thomas Gleixner <tglx@kernel.org>,
	Ingo Molnar <mingo@redhat.com>, Borislav Petkov <bp@alien8.de>,
	 Dave Hansen <dave.hansen@linux.intel.com>,
	x86@kernel.org, "H. Peter Anvin" <hpa@zytor.com>,
	 Arnd Bergmann <arnd@arndb.de>,
	Vlastimil Babka <vbabka@kernel.org>,
	 Mike Rapoport <rppt@kernel.org>,
	Suren Baghdasaryan <surenb@google.com>,
	 Michal Hocko <mhocko@suse.com>, Jason Gunthorpe <jgg@ziepe.ca>,
	 John Hubbard <jhubbard@nvidia.com>, Peter Xu <peterx@redhat.com>,
	linux-mm@kvack.org,  linux-kernel@vger.kernel.org,
	linux-csky@vger.kernel.org, linux-hexagon@vger.kernel.org,
	 linux-m68k@lists.linux-m68k.org, linux-openrisc@vger.kernel.org,
	linux-sh@vger.kernel.org,  linux-riscv@lists.infradead.org,
	linux-arm-kernel@lists.infradead.org,
	 linux-snps-arc@lists.infradead.org, linux-arch@vger.kernel.org,
	sparclinux@vger.kernel.org,  linux-alpha@vger.kernel.org,
	loongarch@lists.linux.dev, linux-mips@vger.kernel.org,
	 linux-parisc@vger.kernel.org, linuxppc-dev@lists.ozlabs.org,
	linux-s390@vger.kernel.org,  linux-um@lists.infradead.org,
	Hugh Dickins <hughd@google.com>, Qi Zheng <qi.zheng@linux.dev>
Subject: Re: [PATCH v3 01/12] mm/huge_memory: zap deposited page tables after an RCU grace period
Date: Tue, 22 Sep 2026 13:14:52 +0100	[thread overview]
Message-ID: <arJrv6FdUUgAbVp1@gremlin> (raw)
In-Reply-To: <bc2805a7-361e-4082-bf71-efc125b93c84@kernel.org>

On Mon, Sep 21, 2026 at 07:13:16PM +0200, David Hildenbrand (Arm) wrote:
> On 9/16/26 18:59, Lorenzo Stoakes (ARM) wrote:
> > On Wed, Sep 16, 2026 at 04:42:04PM +0200, David Hildenbrand (Arm) wrote:
> >> On 9/11/26 21:36, Lorenzo Stoakes (ARM) wrote:
> >>> When an anonymous mapping is collapsed for THP, a PTE page table is
> >>> 'deposited' with the installed PMD entry.
> >>
> >> Right. Or when we allocate an anon THP.
> >
> > That case doesn't interact with page walking though, as they're
> > just-allocated right?
>
> I was surprised to read that page tables deposited during collapse should behave
> differently than page tables deposited during allocation :)

You'll be super surprised by how VMAs behave when detached vs. attached then ;)

>
> That's the semantic change you are adding (and that I didn't quite understand
> from reading your description): a deposited page table could now get reused and
> modified for another page table due to a PMD split, while there might still be
> an RCU page table walker walking it. And PMD comparisons (+ proper memory
> ordering) have to make sure that we didn't just walk  something that doesn't
> belong to us.
>
> [...]
>
> >>
> >> Wait, but wouldn't it be really problematic to punch a page table that is still
> >
> > Punch? You mean deposit?
>
> Yes!

Ack.

>
> >
> >> being walked into the deposited list where it can just be allocated from another
> >> PMD->PTE split?
> >
> > In general, RCU-only page table walkers are _only_ guaranteed that the page
> > tables are not freed from underneath them, as per the cover letter:
> >
> > 	"As a result, page table walks can now be performed safely under RCU without
> > 	 any risk of page tables being freed underneath a walker.
> >
> > 	However, this is the only guarantee that this work provides - page table
> > 	walkers must still ensure that page table entries are as expected
> > 	throughout."
>
> So far page table walkers never walk deposited page tables. Just like they never
> walk freed page tables.
>
> For *current* lockless page table walkers (IRQs disabled),
> tlb_remove_table_sync_one() takes care of that. So there is no such thing as
> "walking a page table that was reused in different context (as a page table) in
> the meantime".

Yup I know. That describes what happens for RCU page table walkers _after_ the
changes of course.

>
> >
> > So this series doesn't actually have to answer that :)
> >
> > But a PTE PTL -> pmd_same() check will flag anything like that,
> > a.k.a. pte_offset_map_lock().
> >
> > The RCU lock replaces stablisation on stuff other than VMA/mmap or rmap
> > lock.
> >
> > If the walker needs to be sure the PTE is actually valid and belongs to the
> > expected walk then further is required.
> >
> > Alternatively (like GUP-fast) if you wanted to avoid locking at all, IRQs
> > off would be required paired with the tlb_remove_table_sync_one() in
> > collapse_huge_page().
>
> Doing an RCU sync in tlb_remove_table_sync_one() would be the big hammer (I
> thought that was discussed with Lance recently). There is also this option: just
> allocate a new page table and deposit it, and free the existing page table
> through RCU.

Hmm yeah big old lump hammer :) I mean I don't see how that could really
possibly fly as an option, we have tlb_remove_table_sync_rcu() for
!CONFIG_PT_RECLAIM arches (i.e. err... the more 'specialist' ones :) but for
those in actual use that sounds a wee bit nuclear.

>
> Long story short: allowing empty page tables to be freed by RCU is simple.
> Allowing empty page tables to be reused while they are still getting walked is
> obviously more complicated conceptually. Likely it can be made working, but I'd
> hope that we can keep it simpler.

I'm not sure it can really safely be guaranteed or it'd involve more lock
dependencies or something horrible anyway.

But... we don't need to care about any of that....

>
> >
> > Another strategy could be used I guess with looped checks but it gets a bit
> > sketchy with timing etc.
> >
> > But actually maybe we can avoid all that...
> >
> >>
> >> Note that pgtable_trans_huge_withdraw() just dequeues *some* PTE page table in
> >> the list attached to the PMD table.
> >>
> >> Something is odd here.
> >
> > ...Since this code path already allocates (the huge folio), so allocation
> > here isn't an issue (as long as done outside of lcosk), why not have it
> > also allocate a new PTE to deposit and RCU-free the existing PTE instead?
> >
> > That eliminates the one place in the kernel (afaik) where a
> > page-table-walker-visible table can just get yoinked over somewhere else.
> >
> > Then a lockless PMD check works.
> >
> > E.g. something like the below?
>
> Hah! Great minds think alike.

...Because great minds indeed <3

Will respin with that then, thanks! :)

>
> --
> Cheers,
>
> David

--
Cheers, Lorenzo

WARNING: multiple messages have this Message-ID (diff)
From: "Lorenzo Stoakes (ARM)" <ljs@kernel.org>
To: "David Hildenbrand (Arm)" <david@kernel.org>
Cc: Andrew Morton <akpm@linux-foundation.org>,
	Zi Yan <ziy@nvidia.com>,
	 Baolin Wang <baolin.wang@linux.alibaba.com>,
	"Liam R. Howlett" <liam@infradead.org>,
	 Nico Pache <nico.pache@linux.dev>,
	Ryan Roberts <ryan.roberts@arm.com>, Dev Jain <dev.jain@arm.com>,
	 Barry Song <baohua@kernel.org>,
	Lance Yang <lance.yang@linux.dev>,
	 Usama Arif <usama.arif@linux.dev>,
	Kiryl Shutsemau <kas@kernel.org>, Guo Ren <guoren@kernel.org>,
	 Brian Cain <bcain@kernel.org>,
	Geert Uytterhoeven <geert@linux-m68k.org>,
	 Dinh Nguyen <dinguyen@kernel.org>,
	Simon Schuster <schuster.simon@siemens-energy.com>,
	 Jonas Bonn <jonas@southpole.se>,
	Stefan Kristiansson <stefan.kristiansson@saunalahti.fi>,
	 Stafford Horne <shorne@gmail.com>,
	Yoshinori Sato <ysato@users.sourceforge.jp>,
	 Rich Felker <dalias@libc.org>,
	John Paul Adrian Glaubitz <glaubitz@physik.fu-berlin.de>,
	 Paul Walmsley <pjw@kernel.org>,
	Palmer Dabbelt <palmer@dabbelt.com>,
	 Albert Ou <aou@eecs.berkeley.edu>,
	Alexandre Ghiti <alex@ghiti.fr>,
	 Russell King <linux@armlinux.org.uk>,
	Vineet Gupta <vgupta@kernel.org>,
	 Michal Simek <monstr@monstr.eu>, Chris Zankel <chris@zankel.net>,
	 Max Filippov <jcmvbkbc@gmail.com>, Will Deacon <will@kernel.org>,
	 "Aneesh Kumar K.V" <aneesh.kumar@kernel.org>,
	Nick Piggin <npiggin@gmail.com>,
	 Peter Zijlstra <peterz@infradead.org>,
	"David S. Miller" <davem@davemloft.net>,
	 Andreas Larsson <andreas@gaisler.com>,
	Richard Henderson <richard.henderson@linaro.org>,
	 Matt Turner <mattst88@gmail.com>,
	Magnus Lindholm <linmag7@gmail.com>,
	 Catalin Marinas <catalin.marinas@arm.com>,
	Mark Rutland <mark.rutland@arm.com>,
	 Huacai Chen <chenhuacai@kernel.org>,
	WANG Xuerui <kernel@xen0n.name>,
	 Thomas Bogendoerfer <tsbogend@alpha.franken.de>,
	"James E.J. Bottomley" <James.Bottomley@hansenpartnership.com>,
	 Helge Deller <deller@gmx.de>,
	Madhavan Srinivasan <maddy@linux.ibm.com>,
	 Michael Ellerman <mpe@ellerman.id.au>,
	"Christophe Leroy (CS GROUP)" <chleroy@kernel.org>,
	 Heiko Carstens <hca@linux.ibm.com>,
	Vasily Gorbik <gor@linux.ibm.com>,
	 Alexander Gordeev <agordeev@linux.ibm.com>,
	Christian Borntraeger <borntraeger@linux.ibm.com>,
	 Sven Schnelle <svens@linux.ibm.com>,
	Richard Weinberger <richard@nod.at>,
	 Anton Ivanov <anton.ivanov@cambridgegreys.com>,
	Johannes Berg <johannes@sipsolutions.net>,
	 Thomas Gleixner <tglx@kernel.org>,
	Ingo Molnar <mingo@redhat.com>, Borislav Petkov <bp@alien8.de>,
	 Dave Hansen <dave.hansen@linux.intel.com>,
	x86@kernel.org, "H. Peter Anvin" <hpa@zytor.com>,
	 Arnd Bergmann <arnd@arndb.de>,
	Vlastimil Babka <vbabka@kernel.org>,
	 Mike Rapoport <rppt@kernel.org>,
	Suren Baghdasaryan <surenb@google.com>,
	 Michal Hocko <mhocko@suse.com>, Jason Gunthorpe <jgg@ziepe.ca>,
	 John Hubbard <jhubbard@nvidia.com>, Peter Xu <peterx@redhat.com>,
	linux-mm@kvack.org,  linux-kernel@vger.kernel.org,
	linux-csky@vger.kernel.org, linux-hexagon@vger.kernel.org,
	 linux-m68k@lists.linux-m68k.org, linux-openrisc@vger.kernel.org,
	linux-sh@vger.kernel.org,  linux-riscv@lists.infradead.org,
	linux-arm-kernel@lists.infradead.org,
	 linux-snps-arc@lists.infradead.org, linux-arch@vger.kernel.org,
	sparclinux@vger.kernel.org,  linux-alpha@vger.kernel.org,
	loongarch@lists.linux.dev, linux-mips@vger.kernel.org,
	 linux-parisc@vger.kernel.org, linuxppc-dev@lists.ozlabs.org,
	linux-s390@vger.kernel.org,  linux-um@lists.infradead.org,
	Hugh Dickins <hughd@google.com>, Qi Zheng <qi.zheng@linux.dev>
Subject: Re: [PATCH v3 01/12] mm/huge_memory: zap deposited page tables after an RCU grace period
Date: Tue, 22 Sep 2026 13:14:52 +0100	[thread overview]
Message-ID: <arJrv6FdUUgAbVp1@gremlin> (raw)
In-Reply-To: <bc2805a7-361e-4082-bf71-efc125b93c84@kernel.org>

On Mon, Sep 21, 2026 at 07:13:16PM +0200, David Hildenbrand (Arm) wrote:
> On 9/16/26 18:59, Lorenzo Stoakes (ARM) wrote:
> > On Wed, Sep 16, 2026 at 04:42:04PM +0200, David Hildenbrand (Arm) wrote:
> >> On 9/11/26 21:36, Lorenzo Stoakes (ARM) wrote:
> >>> When an anonymous mapping is collapsed for THP, a PTE page table is
> >>> 'deposited' with the installed PMD entry.
> >>
> >> Right. Or when we allocate an anon THP.
> >
> > That case doesn't interact with page walking though, as they're
> > just-allocated right?
>
> I was surprised to read that page tables deposited during collapse should behave
> differently than page tables deposited during allocation :)

You'll be super surprised by how VMAs behave when detached vs. attached then ;)

>
> That's the semantic change you are adding (and that I didn't quite understand
> from reading your description): a deposited page table could now get reused and
> modified for another page table due to a PMD split, while there might still be
> an RCU page table walker walking it. And PMD comparisons (+ proper memory
> ordering) have to make sure that we didn't just walk  something that doesn't
> belong to us.
>
> [...]
>
> >>
> >> Wait, but wouldn't it be really problematic to punch a page table that is still
> >
> > Punch? You mean deposit?
>
> Yes!

Ack.

>
> >
> >> being walked into the deposited list where it can just be allocated from another
> >> PMD->PTE split?
> >
> > In general, RCU-only page table walkers are _only_ guaranteed that the page
> > tables are not freed from underneath them, as per the cover letter:
> >
> > 	"As a result, page table walks can now be performed safely under RCU without
> > 	 any risk of page tables being freed underneath a walker.
> >
> > 	However, this is the only guarantee that this work provides - page table
> > 	walkers must still ensure that page table entries are as expected
> > 	throughout."
>
> So far page table walkers never walk deposited page tables. Just like they never
> walk freed page tables.
>
> For *current* lockless page table walkers (IRQs disabled),
> tlb_remove_table_sync_one() takes care of that. So there is no such thing as
> "walking a page table that was reused in different context (as a page table) in
> the meantime".

Yup I know. That describes what happens for RCU page table walkers _after_ the
changes of course.

>
> >
> > So this series doesn't actually have to answer that :)
> >
> > But a PTE PTL -> pmd_same() check will flag anything like that,
> > a.k.a. pte_offset_map_lock().
> >
> > The RCU lock replaces stablisation on stuff other than VMA/mmap or rmap
> > lock.
> >
> > If the walker needs to be sure the PTE is actually valid and belongs to the
> > expected walk then further is required.
> >
> > Alternatively (like GUP-fast) if you wanted to avoid locking at all, IRQs
> > off would be required paired with the tlb_remove_table_sync_one() in
> > collapse_huge_page().
>
> Doing an RCU sync in tlb_remove_table_sync_one() would be the big hammer (I
> thought that was discussed with Lance recently). There is also this option: just
> allocate a new page table and deposit it, and free the existing page table
> through RCU.

Hmm yeah big old lump hammer :) I mean I don't see how that could really
possibly fly as an option, we have tlb_remove_table_sync_rcu() for
!CONFIG_PT_RECLAIM arches (i.e. err... the more 'specialist' ones :) but for
those in actual use that sounds a wee bit nuclear.

>
> Long story short: allowing empty page tables to be freed by RCU is simple.
> Allowing empty page tables to be reused while they are still getting walked is
> obviously more complicated conceptually. Likely it can be made working, but I'd
> hope that we can keep it simpler.

I'm not sure it can really safely be guaranteed or it'd involve more lock
dependencies or something horrible anyway.

But... we don't need to care about any of that....

>
> >
> > Another strategy could be used I guess with looped checks but it gets a bit
> > sketchy with timing etc.
> >
> > But actually maybe we can avoid all that...
> >
> >>
> >> Note that pgtable_trans_huge_withdraw() just dequeues *some* PTE page table in
> >> the list attached to the PMD table.
> >>
> >> Something is odd here.
> >
> > ...Since this code path already allocates (the huge folio), so allocation
> > here isn't an issue (as long as done outside of lcosk), why not have it
> > also allocate a new PTE to deposit and RCU-free the existing PTE instead?
> >
> > That eliminates the one place in the kernel (afaik) where a
> > page-table-walker-visible table can just get yoinked over somewhere else.
> >
> > Then a lockless PMD check works.
> >
> > E.g. something like the below?
>
> Hah! Great minds think alike.

...Because great minds indeed <3

Will respin with that then, thanks! :)

>
> --
> Cheers,
>
> David

--
Cheers, Lorenzo

_______________________________________________
linux-riscv mailing list
linux-riscv@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/linux-riscv

WARNING: multiple messages have this Message-ID (diff)
From: "Lorenzo Stoakes (ARM)" <ljs@kernel.org>
To: "David Hildenbrand (Arm)" <david@kernel.org>
Cc: Andrew Morton <akpm@linux-foundation.org>,
	Zi Yan <ziy@nvidia.com>,
	 Baolin Wang <baolin.wang@linux.alibaba.com>,
	"Liam R. Howlett" <liam@infradead.org>,
	 Nico Pache <nico.pache@linux.dev>,
	Ryan Roberts <ryan.roberts@arm.com>, Dev Jain <dev.jain@arm.com>,
	 Barry Song <baohua@kernel.org>,
	Lance Yang <lance.yang@linux.dev>,
	 Usama Arif <usama.arif@linux.dev>,
	Kiryl Shutsemau <kas@kernel.org>, Guo Ren <guoren@kernel.org>,
	 Brian Cain <bcain@kernel.org>,
	Geert Uytterhoeven <geert@linux-m68k.org>,
	 Dinh Nguyen <dinguyen@kernel.org>,
	Simon Schuster <schuster.simon@siemens-energy.com>,
	 Jonas Bonn <jonas@southpole.se>,
	Stefan Kristiansson <stefan.kristiansson@saunalahti.fi>,
	 Stafford Horne <shorne@gmail.com>,
	Yoshinori Sato <ysato@users.sourceforge.jp>,
	 Rich Felker <dalias@libc.org>,
	John Paul Adrian Glaubitz <glaubitz@physik.fu-berlin.de>,
	 Paul Walmsley <pjw@kernel.org>,
	Palmer Dabbelt <palmer@dabbelt.com>,
	 Albert Ou <aou@eecs.berkeley.edu>,
	Alexandre Ghiti <alex@ghiti.fr>,
	 Russell King <linux@armlinux.org.uk>,
	Vineet Gupta <vgupta@kernel.org>,
	 Michal Simek <monstr@monstr.eu>, Chris Zankel <chris@zankel.net>,
	 Max Filippov <jcmvbkbc@gmail.com>, Will Deacon <will@kernel.org>,
	 "Aneesh Kumar K.V" <aneesh.kumar@kernel.org>,
	Nick Piggin <npiggin@gmail.com>,
	 Peter Zijlstra <peterz@infradead.org>,
	"David S. Miller" <davem@davemloft.net>,
	 Andreas Larsson <andreas@gaisler.com>,
	Richard Henderson <richard.henderson@linaro.org>,
	 Matt Turner <mattst88@gmail.com>,
	Magnus Lindholm <linmag7@gmail.com>,
	 Catalin Marinas <catalin.marinas@arm.com>,
	Mark Rutland <mark.rutland@arm.com>,
	 Huacai Chen <chenhuacai@kernel.org>,
	WANG Xuerui <kernel@xen0n.name>,
	 Thomas Bogendoerfer <tsbogend@alpha.franken.de>,
	"James E.J. Bottomley" <James.Bottomley@hansenpartnership.com>,
	 Helge Deller <deller@gmx.de>,
	Madhavan Srinivasan <maddy@linux.ibm.com>,
	 Michael Ellerman <mpe@ellerman.id.au>,
	"Christophe Leroy (CS GROUP)" <chleroy@kernel.org>,
	 Heiko Carstens <hca@linux.ibm.com>,
	Vasily Gorbik <gor@linux.ibm.com>,
	 Alexander Gordeev <agordeev@linux.ibm.com>,
	Christian Borntraeger <borntraeger@linux.ibm.com>,
	 Sven Schnelle <svens@linux.ibm.com>,
	Richard Weinberger <richard@nod.at>,
	 Anton Ivanov <anton.ivanov@cambridgegreys.com>,
	Johannes Berg <johannes@sipsolutions.net>,
	 Thomas Gleixner <tglx@kernel.org>,
	Ingo Molnar <mingo@redhat.com>, Borislav Petkov <bp@alien8.de>,
	 Dave Hansen <dave.hansen@linux.intel.com>,
	x86@kernel.org, "H. Peter Anvin" <hpa@zytor.com>,
	 Arnd Bergmann <arnd@arndb.de>,
	Vlastimil Babka <vbabka@kernel.org>,
	 Mike Rapoport <rppt@kernel.org>,
	Suren Baghdasaryan <surenb@google.com>,
	 Michal Hocko <mhocko@suse.com>, Jason Gunthorpe <jgg@ziepe.ca>,
	 John Hubbard <jhubbard@nvidia.com>, Peter Xu <peterx@redhat.com>,
	linux-mm@kvack.org,  linux-kernel@vger.kernel.org,
	linux-csky@vger.kernel.org, linux-hexagon@vger.kernel.org,
	 linux-m68k@lists.linux-m68k.org, linux-openrisc@vger.kernel.org,
	linux-sh@vger.kernel.org,  linux-riscv@lists.infradead.org,
	linux-arm-kernel@lists.infradead.org,
	 linux-snps-arc@lists.infradead.org, linux-arch@vger.kernel.org,
	sparclinux@vger.kernel.org,  linux-alpha@vger.kernel.org,
	loongarch@lists.linux.dev, linux-mips@vger.kernel.org,
	 linux-parisc@vger.kernel.org, linuxppc-dev@lists.ozlabs.org,
	linux-s390@vger.kernel.org,  linux-um@lists.infradead.org,
	Hugh Dickins <hughd@google.com>, Qi Zheng <qi.zheng@linux.dev>
Subject: Re: [PATCH v3 01/12] mm/huge_memory: zap deposited page tables after an RCU grace period
Date: Tue, 22 Sep 2026 13:14:52 +0100	[thread overview]
Message-ID: <arJrv6FdUUgAbVp1@gremlin> (raw)
In-Reply-To: <bc2805a7-361e-4082-bf71-efc125b93c84@kernel.org>

On Mon, Sep 21, 2026 at 07:13:16PM +0200, David Hildenbrand (Arm) wrote:
> On 9/16/26 18:59, Lorenzo Stoakes (ARM) wrote:
> > On Wed, Sep 16, 2026 at 04:42:04PM +0200, David Hildenbrand (Arm) wrote:
> >> On 9/11/26 21:36, Lorenzo Stoakes (ARM) wrote:
> >>> When an anonymous mapping is collapsed for THP, a PTE page table is
> >>> 'deposited' with the installed PMD entry.
> >>
> >> Right. Or when we allocate an anon THP.
> >
> > That case doesn't interact with page walking though, as they're
> > just-allocated right?
>
> I was surprised to read that page tables deposited during collapse should behave
> differently than page tables deposited during allocation :)

You'll be super surprised by how VMAs behave when detached vs. attached then ;)

>
> That's the semantic change you are adding (and that I didn't quite understand
> from reading your description): a deposited page table could now get reused and
> modified for another page table due to a PMD split, while there might still be
> an RCU page table walker walking it. And PMD comparisons (+ proper memory
> ordering) have to make sure that we didn't just walk  something that doesn't
> belong to us.
>
> [...]
>
> >>
> >> Wait, but wouldn't it be really problematic to punch a page table that is still
> >
> > Punch? You mean deposit?
>
> Yes!

Ack.

>
> >
> >> being walked into the deposited list where it can just be allocated from another
> >> PMD->PTE split?
> >
> > In general, RCU-only page table walkers are _only_ guaranteed that the page
> > tables are not freed from underneath them, as per the cover letter:
> >
> > 	"As a result, page table walks can now be performed safely under RCU without
> > 	 any risk of page tables being freed underneath a walker.
> >
> > 	However, this is the only guarantee that this work provides - page table
> > 	walkers must still ensure that page table entries are as expected
> > 	throughout."
>
> So far page table walkers never walk deposited page tables. Just like they never
> walk freed page tables.
>
> For *current* lockless page table walkers (IRQs disabled),
> tlb_remove_table_sync_one() takes care of that. So there is no such thing as
> "walking a page table that was reused in different context (as a page table) in
> the meantime".

Yup I know. That describes what happens for RCU page table walkers _after_ the
changes of course.

>
> >
> > So this series doesn't actually have to answer that :)
> >
> > But a PTE PTL -> pmd_same() check will flag anything like that,
> > a.k.a. pte_offset_map_lock().
> >
> > The RCU lock replaces stablisation on stuff other than VMA/mmap or rmap
> > lock.
> >
> > If the walker needs to be sure the PTE is actually valid and belongs to the
> > expected walk then further is required.
> >
> > Alternatively (like GUP-fast) if you wanted to avoid locking at all, IRQs
> > off would be required paired with the tlb_remove_table_sync_one() in
> > collapse_huge_page().
>
> Doing an RCU sync in tlb_remove_table_sync_one() would be the big hammer (I
> thought that was discussed with Lance recently). There is also this option: just
> allocate a new page table and deposit it, and free the existing page table
> through RCU.

Hmm yeah big old lump hammer :) I mean I don't see how that could really
possibly fly as an option, we have tlb_remove_table_sync_rcu() for
!CONFIG_PT_RECLAIM arches (i.e. err... the more 'specialist' ones :) but for
those in actual use that sounds a wee bit nuclear.

>
> Long story short: allowing empty page tables to be freed by RCU is simple.
> Allowing empty page tables to be reused while they are still getting walked is
> obviously more complicated conceptually. Likely it can be made working, but I'd
> hope that we can keep it simpler.

I'm not sure it can really safely be guaranteed or it'd involve more lock
dependencies or something horrible anyway.

But... we don't need to care about any of that....

>
> >
> > Another strategy could be used I guess with looped checks but it gets a bit
> > sketchy with timing etc.
> >
> > But actually maybe we can avoid all that...
> >
> >>
> >> Note that pgtable_trans_huge_withdraw() just dequeues *some* PTE page table in
> >> the list attached to the PMD table.
> >>
> >> Something is odd here.
> >
> > ...Since this code path already allocates (the huge folio), so allocation
> > here isn't an issue (as long as done outside of lcosk), why not have it
> > also allocate a new PTE to deposit and RCU-free the existing PTE instead?
> >
> > That eliminates the one place in the kernel (afaik) where a
> > page-table-walker-visible table can just get yoinked over somewhere else.
> >
> > Then a lockless PMD check works.
> >
> > E.g. something like the below?
>
> Hah! Great minds think alike.

...Because great minds indeed <3

Will respin with that then, thanks! :)

>
> --
> Cheers,
>
> David

--
Cheers, Lorenzo

_______________________________________________
linux-snps-arc mailing list
linux-snps-arc@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/linux-snps-arc

  reply	other threads:[~2026-09-22 12:15 UTC|newest]

Thread overview: 66+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-09-11 19:36 [PATCH v3 00/12] mm: make userland page table freeing RCU-safe Lorenzo Stoakes (ARM)
2026-09-11 19:36 ` Lorenzo Stoakes (ARM)
2026-09-11 19:36 ` Lorenzo Stoakes (ARM)
2026-09-11 19:36 ` [PATCH v3 01/12] mm/huge_memory: zap deposited page tables after an RCU grace period Lorenzo Stoakes (ARM)
2026-09-11 19:36   ` Lorenzo Stoakes (ARM)
2026-09-11 19:36   ` Lorenzo Stoakes (ARM)
2026-09-11 19:50   ` sashiko-bot
2026-09-16 14:42   ` David Hildenbrand (Arm)
2026-09-16 14:42     ` David Hildenbrand (Arm)
2026-09-16 14:42     ` David Hildenbrand (Arm)
2026-09-16 16:59     ` Lorenzo Stoakes (ARM)
2026-09-16 16:59       ` Lorenzo Stoakes (ARM)
2026-09-16 16:59       ` Lorenzo Stoakes (ARM)
2026-09-21 17:13       ` David Hildenbrand (Arm)
2026-09-21 17:13         ` David Hildenbrand (Arm)
2026-09-21 17:13         ` David Hildenbrand (Arm)
2026-09-22 12:14         ` Lorenzo Stoakes (ARM) [this message]
2026-09-22 12:14           ` Lorenzo Stoakes (ARM)
2026-09-22 12:14           ` Lorenzo Stoakes (ARM)
2026-09-11 19:36 ` [PATCH v3 02/12] mm: enable MMU_GATHER_RCU_TABLE_FREE for most 2-level architectures Lorenzo Stoakes (ARM)
2026-09-11 19:36   ` Lorenzo Stoakes (ARM)
2026-09-11 19:36   ` Lorenzo Stoakes (ARM)
2026-09-11 19:53   ` sashiko-bot
2026-09-11 19:36 ` [PATCH v3 03/12] mm: enable MMU_GATHER_RCU_TABLE_FREE for MMU riscv Lorenzo Stoakes (ARM)
2026-09-11 19:36   ` Lorenzo Stoakes (ARM)
2026-09-11 19:36   ` Lorenzo Stoakes (ARM)
2026-09-11 19:49   ` sashiko-bot
2026-09-11 19:36 ` [PATCH v3 04/12] mm: enable MMU_GATHER_RCU_TABLE_FREE for MMU arm Lorenzo Stoakes (ARM)
2026-09-11 19:36   ` Lorenzo Stoakes (ARM)
2026-09-11 19:36   ` Lorenzo Stoakes (ARM)
2026-09-11 19:53   ` sashiko-bot
2026-09-11 19:36 ` [PATCH v3 05/12] mm: enable MMU_GATHER_RCU_TABLE_FREE for arc, microblaze, xtensa Lorenzo Stoakes (ARM)
2026-09-11 19:36   ` Lorenzo Stoakes (ARM)
2026-09-11 19:36   ` Lorenzo Stoakes (ARM)
2026-09-11 19:51   ` sashiko-bot
2026-09-11 19:36 ` [PATCH v3 06/12] mm: enable MMU_GATHER_RCU_TABLE_FREE for sparc64 Lorenzo Stoakes (ARM)
2026-09-11 19:36   ` Lorenzo Stoakes (ARM)
2026-09-11 19:36   ` Lorenzo Stoakes (ARM)
2026-09-11 19:51   ` sashiko-bot
2026-09-11 19:36 ` [PATCH v3 07/12] mm: enable MMU_GATHER_RCU_TABLE_FREE for m68k-coldfire Lorenzo Stoakes (ARM)
2026-09-11 19:36   ` Lorenzo Stoakes (ARM)
2026-09-11 19:36   ` Lorenzo Stoakes (ARM)
2026-09-11 19:50   ` sashiko-bot
2026-09-11 19:36 ` [PATCH v3 08/12] mm: enable MMU_GATHER_RCU_TABLE_FREE for sh-X2 Lorenzo Stoakes (ARM)
2026-09-11 19:36   ` Lorenzo Stoakes (ARM)
2026-09-11 19:36   ` Lorenzo Stoakes (ARM)
2026-09-11 19:52   ` sashiko-bot
2026-09-11 19:36 ` [PATCH v3 09/12] mm: enable MMU_GATHER_RCU_TABLE_FREE for m68k-motorola Lorenzo Stoakes (ARM)
2026-09-11 19:36   ` Lorenzo Stoakes (ARM)
2026-09-11 19:36   ` Lorenzo Stoakes (ARM)
2026-09-11 19:56   ` sashiko-bot
2026-09-11 19:36 ` [PATCH v3 10/12] mm: enable MMU_GATHER_RCU_TABLE_FREE for sparc32 Lorenzo Stoakes (ARM)
2026-09-11 19:36   ` Lorenzo Stoakes (ARM)
2026-09-11 19:36   ` Lorenzo Stoakes (ARM)
2026-09-11 19:58   ` sashiko-bot
2026-09-11 19:36 ` [PATCH v3 11/12] mm: make userland page table freeing RCU-safe Lorenzo Stoakes (ARM)
2026-09-11 19:36   ` Lorenzo Stoakes (ARM)
2026-09-11 19:36   ` Lorenzo Stoakes (ARM)
2026-09-11 19:59   ` sashiko-bot
2026-09-11 19:36 ` [PATCH v3 12/12] mm: change the contract for free_pgtables(), update docs Lorenzo Stoakes (ARM)
2026-09-11 19:36   ` Lorenzo Stoakes (ARM)
2026-09-11 19:36   ` Lorenzo Stoakes (ARM)
2026-09-11 19:54   ` sashiko-bot
2026-09-16  2:01 ` [PATCH v3 00/12] mm: make userland page table freeing RCU-safe Andrew Morton
2026-09-16  2:01   ` Andrew Morton
2026-09-16  2:01   ` Andrew Morton

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=arJrv6FdUUgAbVp1@gremlin \
    --to=ljs@kernel.org \
    --cc=James.Bottomley@hansenpartnership.com \
    --cc=agordeev@linux.ibm.com \
    --cc=akpm@linux-foundation.org \
    --cc=alex@ghiti.fr \
    --cc=andreas@gaisler.com \
    --cc=aneesh.kumar@kernel.org \
    --cc=anton.ivanov@cambridgegreys.com \
    --cc=aou@eecs.berkeley.edu \
    --cc=arnd@arndb.de \
    --cc=baohua@kernel.org \
    --cc=baolin.wang@linux.alibaba.com \
    --cc=bcain@kernel.org \
    --cc=borntraeger@linux.ibm.com \
    --cc=bp@alien8.de \
    --cc=catalin.marinas@arm.com \
    --cc=chenhuacai@kernel.org \
    --cc=chleroy@kernel.org \
    --cc=chris@zankel.net \
    --cc=dalias@libc.org \
    --cc=dave.hansen@linux.intel.com \
    --cc=davem@davemloft.net \
    --cc=david@kernel.org \
    --cc=deller@gmx.de \
    --cc=dev.jain@arm.com \
    --cc=dinguyen@kernel.org \
    --cc=geert@linux-m68k.org \
    --cc=glaubitz@physik.fu-berlin.de \
    --cc=gor@linux.ibm.com \
    --cc=guoren@kernel.org \
    --cc=hca@linux.ibm.com \
    --cc=hpa@zytor.com \
    --cc=hughd@google.com \
    --cc=jcmvbkbc@gmail.com \
    --cc=jgg@ziepe.ca \
    --cc=jhubbard@nvidia.com \
    --cc=johannes@sipsolutions.net \
    --cc=jonas@southpole.se \
    --cc=kas@kernel.org \
    --cc=kernel@xen0n.name \
    --cc=lance.yang@linux.dev \
    --cc=liam@infradead.org \
    --cc=linmag7@gmail.com \
    --cc=linux-alpha@vger.kernel.org \
    --cc=linux-arch@vger.kernel.org \
    --cc=linux-arm-kernel@lists.infradead.org \
    --cc=linux-csky@vger.kernel.org \
    --cc=linux-hexagon@vger.kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-m68k@lists.linux-m68k.org \
    --cc=linux-mips@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=linux-openrisc@vger.kernel.org \
    --cc=linux-parisc@vger.kernel.org \
    --cc=linux-riscv@lists.infradead.org \
    --cc=linux-s390@vger.kernel.org \
    --cc=linux-sh@vger.kernel.org \
    --cc=linux-snps-arc@lists.infradead.org \
    --cc=linux-um@lists.infradead.org \
    --cc=linux@armlinux.org.uk \
    --cc=linuxppc-dev@lists.ozlabs.org \
    --cc=loongarch@lists.linux.dev \
    --cc=maddy@linux.ibm.com \
    --cc=mark.rutland@arm.com \
    --cc=mattst88@gmail.com \
    --cc=mhocko@suse.com \
    --cc=mingo@redhat.com \
    --cc=monstr@monstr.eu \
    --cc=mpe@ellerman.id.au \
    --cc=nico.pache@linux.dev \
    --cc=npiggin@gmail.com \
    --cc=palmer@dabbelt.com \
    --cc=peterx@redhat.com \
    --cc=peterz@infradead.org \
    --cc=pjw@kernel.org \
    --cc=qi.zheng@linux.dev \
    --cc=richard.henderson@linaro.org \
    --cc=richard@nod.at \
    --cc=rppt@kernel.org \
    --cc=ryan.roberts@arm.com \
    --cc=schuster.simon@siemens-energy.com \
    --cc=shorne@gmail.com \
    --cc=sparclinux@vger.kernel.org \
    --cc=stefan.kristiansson@saunalahti.fi \
    --cc=surenb@google.com \
    --cc=svens@linux.ibm.com \
    --cc=tglx@kernel.org \
    --cc=tsbogend@alpha.franken.de \
    --cc=usama.arif@linux.dev \
    --cc=vbabka@kernel.org \
    --cc=vgupta@kernel.org \
    --cc=will@kernel.org \
    --cc=x86@kernel.org \
    --cc=ysato@users.sourceforge.jp \
    --cc=ziy@nvidia.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.