* Re: [PATCH 2/2] Revert "arm64: Enable vmalloc-huge with ptdump" @ 2026-07-10 20:58 kernel test robot 0 siblings, 0 replies; 6+ messages in thread From: kernel test robot @ 2026-07-10 20:58 UTC (permalink / raw) To: oe-kbuild; +Cc: lkp, Dan Carpenter BCC: lkp@intel.com CC: oe-kbuild-all@lists.linux.dev In-Reply-To: <20260710-series-vmap-race-fix-v1-2-5b3794c113fe@kernel.org> References: <20260710-series-vmap-race-fix-v1-2-5b3794c113fe@kernel.org> TO: Lorenzo Stoakes <ljs@kernel.org> TO: Andrew Morton <akpm@linux-foundation.org> CC: Linux Memory Management List <linux-mm@kvack.org> TO: Suren Baghdasaryan <surenb@google.com> TO: "Liam R. Howlett" <liam@infradead.org> TO: Vlastimil Babka <vbabka@kernel.org> TO: Shakeel Butt <shakeel.butt@linux.dev> TO: David Hildenbrand <david@kernel.org> TO: Mike Rapoport <rppt@kernel.org> TO: Michal Hocko <mhocko@suse.com> TO: Uladzislau Rezki <urezki@gmail.com> TO: Toshi Kani <toshi.kani@hpe.com> TO: Catalin Marinas <catalin.marinas@arm.com> TO: Will Deacon <will@kernel.org> CC: David Carlier <devnexen@gmail.com> CC: Dev Jain <dev.jain@arm.com> CC: Ryan Roberts <ryan.roberts@arm.com> CC: linux-kernel@vger.kernel.org CC: linux-arm-kernel@lists.infradead.org CC: Lorenzo Stoakes <ljs@kernel.org> Hi Lorenzo, kernel test robot noticed the following build warnings: [auto build test WARNING on a635d6748234582ea287c5ffeae28b9b23f91c7e] url: https://github.com/intel-lab-lkp/linux/commits/Lorenzo-Stoakes/mm-vmalloc-acquire-init_mm-read-lock-on-huge-vmap-promotion/20260710-185124 base: a635d6748234582ea287c5ffeae28b9b23f91c7e patch link: https://lore.kernel.org/r/20260710-series-vmap-race-fix-v1-2-5b3794c113fe%40kernel.org patch subject: [PATCH 2/2] Revert "arm64: Enable vmalloc-huge with ptdump" :::::: branch date: 10 hours ago :::::: commit date: 10 hours ago config: mips-randconfig-r073-20260710 (https://download.01.org/0day-ci/archive/20260711/202607110447.q52CyOJd-lkp@intel.com/config) compiler: mips-linux-gcc (GCC) 12.5.0 smatch: v0.5.0-9185-gbcc58b9c If you fix the issue in a separate patch/commit (i.e. not just a new version of the same patch/commit), kindly add following tags | Reported-by: kernel test robot <lkp@intel.com> | Reported-by: Dan Carpenter <error27@gmail.com> | Closes: https://lore.kernel.org/r/202607110447.q52CyOJd-lkp@intel.com/ smatch warnings: include/linux/mmap_lock.h:624 class_mmap_read_lock_try_constructor() warn: passing zero to 'ERR_PTR' vim +/ERR_PTR +624 include/linux/mmap_lock.h 9740ca4e95b43b Michel Lespinasse 2020-06-08 621 c042c505210dc3 Peter Zijlstra 2025-04-16 622 DEFINE_GUARD(mmap_read_lock, struct mm_struct *, c042c505210dc3 Peter Zijlstra 2025-04-16 623 mmap_read_lock(_T), mmap_read_unlock(_T)) b5a299112e7d1e Lorenzo Stoakes 2026-07-10 @624 DEFINE_GUARD_COND(mmap_read_lock, _try, mmap_read_trylock(_T)) c042c505210dc3 Peter Zijlstra 2025-04-16 625 -- 0-DAY CI Kernel Test Service https://github.com/intel/lkp-tests/wiki ^ permalink raw reply [flat|nested] 6+ messages in thread
* [PATCH 0/2] mm: fix UAF caused by race between ptdump and vmap pgtable freeing
@ 2026-07-10 10:49 Lorenzo Stoakes
2026-07-10 10:49 ` [PATCH 2/2] Revert "arm64: Enable vmalloc-huge with ptdump" Lorenzo Stoakes
0 siblings, 1 reply; 6+ messages in thread
From: Lorenzo Stoakes @ 2026-07-10 10:49 UTC (permalink / raw)
To: Andrew Morton, Suren Baghdasaryan, Liam R. Howlett,
Vlastimil Babka, Shakeel Butt, David Hildenbrand, Mike Rapoport,
Michal Hocko, Uladzislau Rezki, Toshi Kani, Catalin Marinas,
Will Deacon
Cc: David Carlier, Dev Jain, Ryan Roberts, linux-mm, linux-kernel,
linux-arm-kernel, Lorenzo Stoakes, stable,
syzbot+fd95a72470f5a44e464c
Kernel page table walkers fall into two broad categories - those ranges
where no exclusion is required via walk_kernel_page_table_range_lockless()
and those where exclusion is required via walk_kernel_page_table_range()
or walk_page_range_debug().
The former category is used only by arm64 arch code operating on ranges it
both wholly owns and does not concurrently write.
The latter category consists of kernel page table walkers operating on
ranges that are wholly owned (but which need exclusion against concurrent
writers).
The lock used for exclusion is the mmap lock, and for kernel ranges this
the mmap lock on init_mm.
ptdump is a special case being both the only user of
walk_page_range_debug(), and the only case in which it walks ranges it does
not own.
This presents a problem, as page tables may be freed under ptdump. And
indeed there is a use-after-free bug in the kernel as a result, which this
series addresses.
vmap promotes page tables to huge leaf entries where possible, freeing the
lower leaf page table when it does. It does this with no meaningful locks
held against concurrent ptdump walks.
As a result, use-after-free can currently occur. This series addresses the
issue by having the vmap huge promotion logic acquire the mmap read lock
while both setting the huge page table entry and freeing the prior leaf
page table.
The ptdump code already acquires the mmap write lock, so by doing so we
ensure that the ptdump walker only ever observes either the huge page table
entry or the existing page table entry, and nothing is freed underneath it.
A mitigation for this issue was already applied for arm64 in commit
a93b45fd397 ("arm64: Enable vmalloc-huge with ptdump"), which this series
has to deal with carefully.
This mitigation resolves the issue by acquiring the mmap read lock on
init_mm on vmap page table free if a ptdump is in progress.
However the fix in this series would cause a deadlock if we were to simply
apply it for arm64 without also reverting the change.
This is because vmap may acquire the read lock before ptdump attempts to
acquire the write lock, which then gets queued, and rwsem starvation rules
mean that the (unacknowledged) nested mmap read lock in the arm64 code
would also block, meaning the original read lock is never released and thus
deadlock.
This series works around this by #ifndef CONFIG_ARM64'ing the mmap read
lock in vmap logic, then partially reverting commit
a93b45fd397 ("arm64: Enable vmalloc-huge with ptdump"), keeping the
enablement of huge vmap support, and removing the ifdeffery with the
partial revert patch.
Signed-off-by: Lorenzo Stoakes <ljs@kernel.org>
---
Lorenzo Stoakes (2):
mm/vmalloc: acquire init_mm read lock on huge vmap promotion
Revert "arm64: Enable vmalloc-huge with ptdump"
arch/arm64/include/asm/ptdump.h | 2 --
arch/arm64/mm/mmu.c | 43 ++++-------------------------------------
arch/arm64/mm/ptdump.c | 11 ++---------
include/linux/mmap_lock.h | 1 +
mm/pagewalk.c | 22 +++++++++++----------
mm/vmalloc.c | 41 ++++++++++++++++++++++++++++++---------
6 files changed, 51 insertions(+), 69 deletions(-)
---
base-commit: a635d6748234582ea287c5ffeae28b9b23f91c7e
change-id: 20260710-series-vmap-race-fix-2a4cac988938
Cheers,
--
Lorenzo Stoakes <ljs@kernel.org>
^ permalink raw reply [flat|nested] 6+ messages in thread* [PATCH 2/2] Revert "arm64: Enable vmalloc-huge with ptdump" 2026-07-10 10:49 [PATCH 0/2] mm: fix UAF caused by race between ptdump and vmap pgtable freeing Lorenzo Stoakes @ 2026-07-10 10:49 ` Lorenzo Stoakes 2026-07-11 10:15 ` Mike Rapoport 2026-07-12 7:46 ` Dev Jain 0 siblings, 2 replies; 6+ messages in thread From: Lorenzo Stoakes @ 2026-07-10 10:49 UTC (permalink / raw) To: Andrew Morton, Suren Baghdasaryan, Liam R. Howlett, Vlastimil Babka, Shakeel Butt, David Hildenbrand, Mike Rapoport, Michal Hocko, Uladzislau Rezki, Toshi Kani, Catalin Marinas, Will Deacon Cc: David Carlier, Dev Jain, Ryan Roberts, linux-mm, linux-kernel, linux-arm-kernel, Lorenzo Stoakes This partially reverts commit fa93b45fd397 ("arm64: Enable vmalloc-huge with ptdump"), retaining vmalloc-huge support but eliminating the now redundant mitigation against a race between huge vmap page table freeing and ptdump, as this issue has now been fixed at core. We also simultaneously remove the arm64 ifdeffery when acquiring the mmap read lock upon vmap huge page table promotion as it is no longer required. Signed-off-by: Lorenzo Stoakes <ljs@kernel.org> --- arch/arm64/include/asm/ptdump.h | 2 -- arch/arm64/mm/mmu.c | 43 ++++------------------------------------- arch/arm64/mm/ptdump.c | 11 ++--------- mm/vmalloc.c | 15 +++----------- 4 files changed, 9 insertions(+), 62 deletions(-) diff --git a/arch/arm64/include/asm/ptdump.h b/arch/arm64/include/asm/ptdump.h index 5b374a6ab34a..50a195eda8ed 100644 --- a/arch/arm64/include/asm/ptdump.h +++ b/arch/arm64/include/asm/ptdump.h @@ -7,8 +7,6 @@ #include <linux/ptdump.h> -DECLARE_STATIC_KEY_FALSE(arm64_ptdump_lock_key); - #ifdef CONFIG_PTDUMP #include <linux/mm_types.h> diff --git a/arch/arm64/mm/mmu.c b/arch/arm64/mm/mmu.c index f2be501468ce..f723bcf68174 100644 --- a/arch/arm64/mm/mmu.c +++ b/arch/arm64/mm/mmu.c @@ -49,8 +49,6 @@ #define NO_CONT_MAPPINGS BIT(1) #define NO_EXEC_MAPPINGS BIT(2) /* assumes FEAT_HPDS is not used */ -DEFINE_STATIC_KEY_FALSE(arm64_ptdump_lock_key); - u64 kimage_voffset __ro_after_init; EXPORT_SYMBOL(kimage_voffset); @@ -1857,8 +1855,7 @@ int pmd_clear_huge(pmd_t *pmdp) return 1; } -static int __pmd_free_pte_page(pmd_t *pmdp, unsigned long addr, - bool acquire_mmap_lock) +int pmd_free_pte_page(pmd_t *pmdp, unsigned long addr) { pte_t *table; pmd_t pmd; @@ -1870,25 +1867,13 @@ static int __pmd_free_pte_page(pmd_t *pmdp, unsigned long addr, return 1; } - /* See comment in pud_free_pmd_page for static key logic */ table = pte_offset_kernel(pmdp, addr); pmd_clear(pmdp); __flush_tlb_kernel_pgtable(addr); - if (static_branch_unlikely(&arm64_ptdump_lock_key) && acquire_mmap_lock) { - mmap_read_lock(&init_mm); - mmap_read_unlock(&init_mm); - } - pte_free_kernel(NULL, table); return 1; } -int pmd_free_pte_page(pmd_t *pmdp, unsigned long addr) -{ - /* If ptdump is walking the pagetables, acquire init_mm.mmap_lock */ - return __pmd_free_pte_page(pmdp, addr, /* acquire_mmap_lock = */ true); -} - int pud_free_pmd_page(pud_t *pudp, unsigned long addr) { pmd_t *table; @@ -1904,36 +1889,16 @@ int pud_free_pmd_page(pud_t *pudp, unsigned long addr) } table = pmd_offset(pudp, addr); - - /* - * Our objective is to prevent ptdump from reading a PMD table which has - * been freed. In this race, if pud_free_pmd_page observes the key on - * (which got flipped by ptdump) then the mmap lock sequence here will, - * as a result of the mmap write lock/unlock sequence in ptdump, give - * us the correct synchronization. If not, this means that ptdump has - * yet not started walking the pagetables - the sequence of barriers - * issued by __flush_tlb_kernel_pgtable() guarantees that ptdump will - * observe an empty PUD. - */ - pud_clear(pudp); - __flush_tlb_kernel_pgtable(addr); - if (static_branch_unlikely(&arm64_ptdump_lock_key)) { - mmap_read_lock(&init_mm); - mmap_read_unlock(&init_mm); - } - pmdp = table; next = addr; end = addr + PUD_SIZE; do { if (pmd_present(pmdp_get(pmdp))) - /* - * PMD has been isolated, so ptdump won't see it. No - * need to acquire init_mm.mmap_lock. - */ - __pmd_free_pte_page(pmdp, next, /* acquire_mmap_lock = */ false); + pmd_free_pte_page(pmdp, next); } while (pmdp++, next += PMD_SIZE, next != end); + pud_clear(pudp); + __flush_tlb_kernel_pgtable(addr); pmd_free(NULL, table); return 1; } diff --git a/arch/arm64/mm/ptdump.c b/arch/arm64/mm/ptdump.c index 1c20144700d7..5a76c59b5ada 100644 --- a/arch/arm64/mm/ptdump.c +++ b/arch/arm64/mm/ptdump.c @@ -283,13 +283,6 @@ void note_page_flush(struct ptdump_state *pt_st) note_page(pt_st, 0, -1, pte_val(pte_zero)); } -static void arm64_ptdump_walk_pgd(struct ptdump_state *st, struct mm_struct *mm) -{ - static_branch_inc(&arm64_ptdump_lock_key); - ptdump_walk_pgd(st, mm, NULL); - static_branch_dec(&arm64_ptdump_lock_key); -} - void ptdump_walk(struct seq_file *s, struct ptdump_info *info) { unsigned long end = ~0UL; @@ -318,7 +311,7 @@ void ptdump_walk(struct seq_file *s, struct ptdump_info *info) } }; - arm64_ptdump_walk_pgd(&st.ptdump, info->mm); + ptdump_walk_pgd(&st.ptdump, info->mm, NULL); } static void __init ptdump_initialize(void) @@ -360,7 +353,7 @@ bool ptdump_check_wx(void) } }; - arm64_ptdump_walk_pgd(&st.ptdump, &init_mm); + ptdump_walk_pgd(&st.ptdump, &init_mm, NULL); if (st.wx_pages || st.uxn_pages) { pr_warn("Checked W+X mappings: FAILED, %lu W+X pages found, %lu non-UXN pages found\n", diff --git a/mm/vmalloc.c b/mm/vmalloc.c index 9d0f1fdd6af3..537ff7b3c412 100644 --- a/mm/vmalloc.c +++ b/mm/vmalloc.c @@ -170,10 +170,7 @@ static int vmap_try_huge_pmd(pmd_t *pmd, unsigned long addr, unsigned long end, * Therefore, acquire the mmap read lock to prevent use-after-free when * freeing page tables. */ -#ifndef CONFIG_ARM64 - scoped_cond_guard(mmap_read_lock_try, return 0, &init_mm) -#endif - { + scoped_cond_guard(mmap_read_lock_try, return 0, &init_mm) { if (!pmd_free_pte_page(pmd, addr)) return 0; return pmd_set_huge(pmd, phys_addr, prot); @@ -230,10 +227,7 @@ static int vmap_try_huge_pud(pud_t *pud, unsigned long addr, unsigned long end, return pud_set_huge(pud, phys_addr, prot); /* See comment in vmap_try_huge_pmd(). */ -#ifndef CONFIG_ARM64 - scoped_cond_guard(mmap_read_lock_try, return 0, &init_mm) -#endif - { + scoped_cond_guard(mmap_read_lock_try, return 0, &init_mm) { if (!pud_free_pmd_page(pud, addr)) return 0; return pud_set_huge(pud, phys_addr, prot); @@ -290,10 +284,7 @@ static int vmap_try_huge_p4d(p4d_t *p4d, unsigned long addr, unsigned long end, return p4d_set_huge(p4d, phys_addr, prot); /* See comment in vmap_try_huge_pmd(). */ -#ifndef CONFIG_ARM64 - scoped_cond_guard(mmap_read_lock_try, return 0, &init_mm) -#endif - { + scoped_cond_guard(mmap_read_lock_try, return 0, &init_mm) { if (!p4d_free_pud_page(p4d, addr)) return 0; return p4d_set_huge(p4d, phys_addr, prot); -- 2.55.0 ^ permalink raw reply related [flat|nested] 6+ messages in thread
* Re: [PATCH 2/2] Revert "arm64: Enable vmalloc-huge with ptdump" 2026-07-10 10:49 ` [PATCH 2/2] Revert "arm64: Enable vmalloc-huge with ptdump" Lorenzo Stoakes @ 2026-07-11 10:15 ` Mike Rapoport 2026-07-12 8:27 ` Lorenzo Stoakes 2026-07-12 7:46 ` Dev Jain 1 sibling, 1 reply; 6+ messages in thread From: Mike Rapoport @ 2026-07-11 10:15 UTC (permalink / raw) To: Lorenzo Stoakes Cc: Andrew Morton, Suren Baghdasaryan, Liam R. Howlett, Vlastimil Babka, Shakeel Butt, David Hildenbrand, Michal Hocko, Uladzislau Rezki, Toshi Kani, Catalin Marinas, Will Deacon, David Carlier, Dev Jain, Ryan Roberts, linux-mm, linux-kernel, linux-arm-kernel On Fri, Jul 10, 2026 at 11:49:19AM +0100, Lorenzo Stoakes wrote: > Subject: [PATCH 2/2] Revert "arm64: Enable vmalloc-huge with ptdump" Without reading the full changelog this sounds like you are disabling vmalloc-huge with ptdump ;-) How about "remove redundant locking guarding ptdump against vmalloc-huge"? > This partially reverts commit fa93b45fd397 ("arm64: Enable vmalloc-huge > with ptdump"), retaining vmalloc-huge support but eliminating the now > redundant mitigation against a race between huge vmap page table freeing > and ptdump, as this issue has now been fixed at core. > > We also simultaneously remove the arm64 ifdeffery when acquiring the mmap > read lock upon vmap huge page table promotion as it is no longer required. > > Signed-off-by: Lorenzo Stoakes <ljs@kernel.org>B Acked-by: Mike Rapoport (Microsoft) <rppt@kernel.org> > --- > arch/arm64/include/asm/ptdump.h | 2 -- > arch/arm64/mm/mmu.c | 43 ++++------------------------------------- > arch/arm64/mm/ptdump.c | 11 ++--------- > mm/vmalloc.c | 15 +++----------- > 4 files changed, 9 insertions(+), 62 deletions(-) -- Sincerely yours, Mike. ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [PATCH 2/2] Revert "arm64: Enable vmalloc-huge with ptdump" 2026-07-11 10:15 ` Mike Rapoport @ 2026-07-12 8:27 ` Lorenzo Stoakes 0 siblings, 0 replies; 6+ messages in thread From: Lorenzo Stoakes @ 2026-07-12 8:27 UTC (permalink / raw) To: Mike Rapoport Cc: Andrew Morton, Suren Baghdasaryan, Liam R. Howlett, Vlastimil Babka, Shakeel Butt, David Hildenbrand, Michal Hocko, Uladzislau Rezki, Toshi Kani, Catalin Marinas, Will Deacon, David Carlier, Dev Jain, Ryan Roberts, linux-mm, linux-kernel, linux-arm-kernel On Sat, Jul 11, 2026 at 01:15:45PM +0300, Mike Rapoport wrote: > On Fri, Jul 10, 2026 at 11:49:19AM +0100, Lorenzo Stoakes wrote: > > Subject: [PATCH 2/2] Revert "arm64: Enable vmalloc-huge with ptdump" > > Without reading the full changelog this sounds like you are disabling > vmalloc-huge with ptdump ;-) > > How about "remove redundant locking guarding ptdump against vmalloc-huge"? I'm just following the standard convention when it comes to partial reverts, as I revert the majority of the patch and I ran 'git revert' to do it ;) But then again I do remove the arm64 ifdeffery in the same commit and you're right it does suggest I revert more than I do so will fix it up! > > > This partially reverts commit fa93b45fd397 ("arm64: Enable vmalloc-huge > > with ptdump"), retaining vmalloc-huge support but eliminating the now > > redundant mitigation against a race between huge vmap page table freeing > > and ptdump, as this issue has now been fixed at core. > > > > We also simultaneously remove the arm64 ifdeffery when acquiring the mmap > > read lock upon vmap huge page table promotion as it is no longer required. > > > > Signed-off-by: Lorenzo Stoakes <ljs@kernel.org>B > > Acked-by: Mike Rapoport (Microsoft) <rppt@kernel.org> Thanks! > > > --- > > arch/arm64/include/asm/ptdump.h | 2 -- > > arch/arm64/mm/mmu.c | 43 ++++------------------------------------- > > arch/arm64/mm/ptdump.c | 11 ++--------- > > mm/vmalloc.c | 15 +++----------- > > 4 files changed, 9 insertions(+), 62 deletions(-) > > -- > Sincerely yours, > Mike. Thanks, Lorenzo ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [PATCH 2/2] Revert "arm64: Enable vmalloc-huge with ptdump" 2026-07-10 10:49 ` [PATCH 2/2] Revert "arm64: Enable vmalloc-huge with ptdump" Lorenzo Stoakes 2026-07-11 10:15 ` Mike Rapoport @ 2026-07-12 7:46 ` Dev Jain 2026-07-12 8:28 ` Lorenzo Stoakes 1 sibling, 1 reply; 6+ messages in thread From: Dev Jain @ 2026-07-12 7:46 UTC (permalink / raw) To: Lorenzo Stoakes, Andrew Morton, Suren Baghdasaryan, Liam R. Howlett, Vlastimil Babka, Shakeel Butt, David Hildenbrand, Mike Rapoport, Michal Hocko, Uladzislau Rezki, Toshi Kani, Catalin Marinas, Will Deacon Cc: David Carlier, Ryan Roberts, linux-mm, linux-kernel, linux-arm-kernel On 10/07/26 4:19 pm, Lorenzo Stoakes wrote: > This partially reverts commit fa93b45fd397 ("arm64: Enable vmalloc-huge > with ptdump"), retaining vmalloc-huge support but eliminating the now > redundant mitigation against a race between huge vmap page table freeing > and ptdump, as this issue has now been fixed at core. > > We also simultaneously remove the arm64 ifdeffery when acquiring the mmap > read lock upon vmap huge page table promotion as it is no longer required. > > Signed-off-by: Lorenzo Stoakes <ljs@kernel.org> > --- As pointed out by Mike, the subject line doesn't fit. Perhaps just start with "Partially revert ..." Reviewed-by: Dev Jain <dev.jain@arm.com> > arch/arm64/include/asm/ptdump.h | 2 -- > arch/arm64/mm/mmu.c | 43 ++++------------------------------------- > arch/arm64/mm/ptdump.c | 11 ++--------- > mm/vmalloc.c | 15 +++----------- > 4 files changed, 9 insertions(+), 62 deletions(-) > > diff --git a/arch/arm64/include/asm/ptdump.h b/arch/arm64/include/asm/ptdump.h > index 5b374a6ab34a..50a195eda8ed 100644 > --- a/arch/arm64/include/asm/ptdump.h > +++ b/arch/arm64/include/asm/ptdump.h > @@ -7,8 +7,6 @@ > > #include <linux/ptdump.h> > > -DECLARE_STATIC_KEY_FALSE(arm64_ptdump_lock_key); > - > #ifdef CONFIG_PTDUMP > > #include <linux/mm_types.h> > diff --git a/arch/arm64/mm/mmu.c b/arch/arm64/mm/mmu.c > index f2be501468ce..f723bcf68174 100644 > --- a/arch/arm64/mm/mmu.c > +++ b/arch/arm64/mm/mmu.c > @@ -49,8 +49,6 @@ > #define NO_CONT_MAPPINGS BIT(1) > #define NO_EXEC_MAPPINGS BIT(2) /* assumes FEAT_HPDS is not used */ > > -DEFINE_STATIC_KEY_FALSE(arm64_ptdump_lock_key); > - > u64 kimage_voffset __ro_after_init; > EXPORT_SYMBOL(kimage_voffset); > > @@ -1857,8 +1855,7 @@ int pmd_clear_huge(pmd_t *pmdp) > return 1; > } > > -static int __pmd_free_pte_page(pmd_t *pmdp, unsigned long addr, > - bool acquire_mmap_lock) > +int pmd_free_pte_page(pmd_t *pmdp, unsigned long addr) > { > pte_t *table; > pmd_t pmd; > @@ -1870,25 +1867,13 @@ static int __pmd_free_pte_page(pmd_t *pmdp, unsigned long addr, > return 1; > } > > - /* See comment in pud_free_pmd_page for static key logic */ > table = pte_offset_kernel(pmdp, addr); > pmd_clear(pmdp); > __flush_tlb_kernel_pgtable(addr); > - if (static_branch_unlikely(&arm64_ptdump_lock_key) && acquire_mmap_lock) { > - mmap_read_lock(&init_mm); > - mmap_read_unlock(&init_mm); > - } > - > pte_free_kernel(NULL, table); > return 1; > } > > -int pmd_free_pte_page(pmd_t *pmdp, unsigned long addr) > -{ > - /* If ptdump is walking the pagetables, acquire init_mm.mmap_lock */ > - return __pmd_free_pte_page(pmdp, addr, /* acquire_mmap_lock = */ true); > -} > - > int pud_free_pmd_page(pud_t *pudp, unsigned long addr) > { > pmd_t *table; > @@ -1904,36 +1889,16 @@ int pud_free_pmd_page(pud_t *pudp, unsigned long addr) > } > > table = pmd_offset(pudp, addr); > - > - /* > - * Our objective is to prevent ptdump from reading a PMD table which has > - * been freed. In this race, if pud_free_pmd_page observes the key on > - * (which got flipped by ptdump) then the mmap lock sequence here will, > - * as a result of the mmap write lock/unlock sequence in ptdump, give > - * us the correct synchronization. If not, this means that ptdump has > - * yet not started walking the pagetables - the sequence of barriers > - * issued by __flush_tlb_kernel_pgtable() guarantees that ptdump will > - * observe an empty PUD. > - */ > - pud_clear(pudp); > - __flush_tlb_kernel_pgtable(addr); > - if (static_branch_unlikely(&arm64_ptdump_lock_key)) { > - mmap_read_lock(&init_mm); > - mmap_read_unlock(&init_mm); > - } > - > pmdp = table; > next = addr; > end = addr + PUD_SIZE; > do { > if (pmd_present(pmdp_get(pmdp))) > - /* > - * PMD has been isolated, so ptdump won't see it. No > - * need to acquire init_mm.mmap_lock. > - */ > - __pmd_free_pte_page(pmdp, next, /* acquire_mmap_lock = */ false); > + pmd_free_pte_page(pmdp, next); > } while (pmdp++, next += PMD_SIZE, next != end); > > + pud_clear(pudp); > + __flush_tlb_kernel_pgtable(addr); > pmd_free(NULL, table); > return 1; > } > diff --git a/arch/arm64/mm/ptdump.c b/arch/arm64/mm/ptdump.c > index 1c20144700d7..5a76c59b5ada 100644 > --- a/arch/arm64/mm/ptdump.c > +++ b/arch/arm64/mm/ptdump.c > @@ -283,13 +283,6 @@ void note_page_flush(struct ptdump_state *pt_st) > note_page(pt_st, 0, -1, pte_val(pte_zero)); > } > > -static void arm64_ptdump_walk_pgd(struct ptdump_state *st, struct mm_struct *mm) > -{ > - static_branch_inc(&arm64_ptdump_lock_key); > - ptdump_walk_pgd(st, mm, NULL); > - static_branch_dec(&arm64_ptdump_lock_key); > -} > - > void ptdump_walk(struct seq_file *s, struct ptdump_info *info) > { > unsigned long end = ~0UL; > @@ -318,7 +311,7 @@ void ptdump_walk(struct seq_file *s, struct ptdump_info *info) > } > }; > > - arm64_ptdump_walk_pgd(&st.ptdump, info->mm); > + ptdump_walk_pgd(&st.ptdump, info->mm, NULL); > } > > static void __init ptdump_initialize(void) > @@ -360,7 +353,7 @@ bool ptdump_check_wx(void) > } > }; > > - arm64_ptdump_walk_pgd(&st.ptdump, &init_mm); > + ptdump_walk_pgd(&st.ptdump, &init_mm, NULL); > > if (st.wx_pages || st.uxn_pages) { > pr_warn("Checked W+X mappings: FAILED, %lu W+X pages found, %lu non-UXN pages found\n", > diff --git a/mm/vmalloc.c b/mm/vmalloc.c > index 9d0f1fdd6af3..537ff7b3c412 100644 > --- a/mm/vmalloc.c > +++ b/mm/vmalloc.c > @@ -170,10 +170,7 @@ static int vmap_try_huge_pmd(pmd_t *pmd, unsigned long addr, unsigned long end, > * Therefore, acquire the mmap read lock to prevent use-after-free when > * freeing page tables. > */ > -#ifndef CONFIG_ARM64 > - scoped_cond_guard(mmap_read_lock_try, return 0, &init_mm) > -#endif > - { > + scoped_cond_guard(mmap_read_lock_try, return 0, &init_mm) { > if (!pmd_free_pte_page(pmd, addr)) > return 0; > return pmd_set_huge(pmd, phys_addr, prot); > @@ -230,10 +227,7 @@ static int vmap_try_huge_pud(pud_t *pud, unsigned long addr, unsigned long end, > return pud_set_huge(pud, phys_addr, prot); > > /* See comment in vmap_try_huge_pmd(). */ > -#ifndef CONFIG_ARM64 > - scoped_cond_guard(mmap_read_lock_try, return 0, &init_mm) > -#endif > - { > + scoped_cond_guard(mmap_read_lock_try, return 0, &init_mm) { > if (!pud_free_pmd_page(pud, addr)) > return 0; > return pud_set_huge(pud, phys_addr, prot); > @@ -290,10 +284,7 @@ static int vmap_try_huge_p4d(p4d_t *p4d, unsigned long addr, unsigned long end, > return p4d_set_huge(p4d, phys_addr, prot); > > /* See comment in vmap_try_huge_pmd(). */ > -#ifndef CONFIG_ARM64 > - scoped_cond_guard(mmap_read_lock_try, return 0, &init_mm) > -#endif > - { > + scoped_cond_guard(mmap_read_lock_try, return 0, &init_mm) { > if (!p4d_free_pud_page(p4d, addr)) > return 0; > return p4d_set_huge(p4d, phys_addr, prot); > ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [PATCH 2/2] Revert "arm64: Enable vmalloc-huge with ptdump" 2026-07-12 7:46 ` Dev Jain @ 2026-07-12 8:28 ` Lorenzo Stoakes 0 siblings, 0 replies; 6+ messages in thread From: Lorenzo Stoakes @ 2026-07-12 8:28 UTC (permalink / raw) To: Dev Jain Cc: Andrew Morton, Suren Baghdasaryan, Liam R. Howlett, Vlastimil Babka, Shakeel Butt, David Hildenbrand, Mike Rapoport, Michal Hocko, Uladzislau Rezki, Toshi Kani, Catalin Marinas, Will Deacon, David Carlier, Ryan Roberts, linux-mm, linux-kernel, linux-arm-kernel On Sun, Jul 12, 2026 at 01:16:17PM +0530, Dev Jain wrote: > > > On 10/07/26 4:19 pm, Lorenzo Stoakes wrote: > > This partially reverts commit fa93b45fd397 ("arm64: Enable vmalloc-huge > > with ptdump"), retaining vmalloc-huge support but eliminating the now > > redundant mitigation against a race between huge vmap page table freeing > > and ptdump, as this issue has now been fixed at core. > > > > We also simultaneously remove the arm64 ifdeffery when acquiring the mmap > > read lock upon vmap huge page table promotion as it is no longer required. > > > > Signed-off-by: Lorenzo Stoakes <ljs@kernel.org> > > --- > > As pointed out by Mike, the subject line doesn't fit. Perhaps just start with > "Partially revert ..." Ack yeah will fix! > > > Reviewed-by: Dev Jain <dev.jain@arm.com> Thanks! Cheers, Lorenzo > > > arch/arm64/include/asm/ptdump.h | 2 -- > > arch/arm64/mm/mmu.c | 43 ++++------------------------------------- > > arch/arm64/mm/ptdump.c | 11 ++--------- > > mm/vmalloc.c | 15 +++----------- > > 4 files changed, 9 insertions(+), 62 deletions(-) > > > > diff --git a/arch/arm64/include/asm/ptdump.h b/arch/arm64/include/asm/ptdump.h > > index 5b374a6ab34a..50a195eda8ed 100644 > > --- a/arch/arm64/include/asm/ptdump.h > > +++ b/arch/arm64/include/asm/ptdump.h > > @@ -7,8 +7,6 @@ > > > > #include <linux/ptdump.h> > > > > -DECLARE_STATIC_KEY_FALSE(arm64_ptdump_lock_key); > > - > > #ifdef CONFIG_PTDUMP > > > > #include <linux/mm_types.h> > > diff --git a/arch/arm64/mm/mmu.c b/arch/arm64/mm/mmu.c > > index f2be501468ce..f723bcf68174 100644 > > --- a/arch/arm64/mm/mmu.c > > +++ b/arch/arm64/mm/mmu.c > > @@ -49,8 +49,6 @@ > > #define NO_CONT_MAPPINGS BIT(1) > > #define NO_EXEC_MAPPINGS BIT(2) /* assumes FEAT_HPDS is not used */ > > > > -DEFINE_STATIC_KEY_FALSE(arm64_ptdump_lock_key); > > - > > u64 kimage_voffset __ro_after_init; > > EXPORT_SYMBOL(kimage_voffset); > > > > @@ -1857,8 +1855,7 @@ int pmd_clear_huge(pmd_t *pmdp) > > return 1; > > } > > > > -static int __pmd_free_pte_page(pmd_t *pmdp, unsigned long addr, > > - bool acquire_mmap_lock) > > +int pmd_free_pte_page(pmd_t *pmdp, unsigned long addr) > > { > > pte_t *table; > > pmd_t pmd; > > @@ -1870,25 +1867,13 @@ static int __pmd_free_pte_page(pmd_t *pmdp, unsigned long addr, > > return 1; > > } > > > > - /* See comment in pud_free_pmd_page for static key logic */ > > table = pte_offset_kernel(pmdp, addr); > > pmd_clear(pmdp); > > __flush_tlb_kernel_pgtable(addr); > > - if (static_branch_unlikely(&arm64_ptdump_lock_key) && acquire_mmap_lock) { > > - mmap_read_lock(&init_mm); > > - mmap_read_unlock(&init_mm); > > - } > > - > > pte_free_kernel(NULL, table); > > return 1; > > } > > > > -int pmd_free_pte_page(pmd_t *pmdp, unsigned long addr) > > -{ > > - /* If ptdump is walking the pagetables, acquire init_mm.mmap_lock */ > > - return __pmd_free_pte_page(pmdp, addr, /* acquire_mmap_lock = */ true); > > -} > > - > > int pud_free_pmd_page(pud_t *pudp, unsigned long addr) > > { > > pmd_t *table; > > @@ -1904,36 +1889,16 @@ int pud_free_pmd_page(pud_t *pudp, unsigned long addr) > > } > > > > table = pmd_offset(pudp, addr); > > - > > - /* > > - * Our objective is to prevent ptdump from reading a PMD table which has > > - * been freed. In this race, if pud_free_pmd_page observes the key on > > - * (which got flipped by ptdump) then the mmap lock sequence here will, > > - * as a result of the mmap write lock/unlock sequence in ptdump, give > > - * us the correct synchronization. If not, this means that ptdump has > > - * yet not started walking the pagetables - the sequence of barriers > > - * issued by __flush_tlb_kernel_pgtable() guarantees that ptdump will > > - * observe an empty PUD. > > - */ > > - pud_clear(pudp); > > - __flush_tlb_kernel_pgtable(addr); > > - if (static_branch_unlikely(&arm64_ptdump_lock_key)) { > > - mmap_read_lock(&init_mm); > > - mmap_read_unlock(&init_mm); > > - } > > - > > pmdp = table; > > next = addr; > > end = addr + PUD_SIZE; > > do { > > if (pmd_present(pmdp_get(pmdp))) > > - /* > > - * PMD has been isolated, so ptdump won't see it. No > > - * need to acquire init_mm.mmap_lock. > > - */ > > - __pmd_free_pte_page(pmdp, next, /* acquire_mmap_lock = */ false); > > + pmd_free_pte_page(pmdp, next); > > } while (pmdp++, next += PMD_SIZE, next != end); > > > > + pud_clear(pudp); > > + __flush_tlb_kernel_pgtable(addr); > > pmd_free(NULL, table); > > return 1; > > } > > diff --git a/arch/arm64/mm/ptdump.c b/arch/arm64/mm/ptdump.c > > index 1c20144700d7..5a76c59b5ada 100644 > > --- a/arch/arm64/mm/ptdump.c > > +++ b/arch/arm64/mm/ptdump.c > > @@ -283,13 +283,6 @@ void note_page_flush(struct ptdump_state *pt_st) > > note_page(pt_st, 0, -1, pte_val(pte_zero)); > > } > > > > -static void arm64_ptdump_walk_pgd(struct ptdump_state *st, struct mm_struct *mm) > > -{ > > - static_branch_inc(&arm64_ptdump_lock_key); > > - ptdump_walk_pgd(st, mm, NULL); > > - static_branch_dec(&arm64_ptdump_lock_key); > > -} > > - > > void ptdump_walk(struct seq_file *s, struct ptdump_info *info) > > { > > unsigned long end = ~0UL; > > @@ -318,7 +311,7 @@ void ptdump_walk(struct seq_file *s, struct ptdump_info *info) > > } > > }; > > > > - arm64_ptdump_walk_pgd(&st.ptdump, info->mm); > > + ptdump_walk_pgd(&st.ptdump, info->mm, NULL); > > } > > > > static void __init ptdump_initialize(void) > > @@ -360,7 +353,7 @@ bool ptdump_check_wx(void) > > } > > }; > > > > - arm64_ptdump_walk_pgd(&st.ptdump, &init_mm); > > + ptdump_walk_pgd(&st.ptdump, &init_mm, NULL); > > > > if (st.wx_pages || st.uxn_pages) { > > pr_warn("Checked W+X mappings: FAILED, %lu W+X pages found, %lu non-UXN pages found\n", > > diff --git a/mm/vmalloc.c b/mm/vmalloc.c > > index 9d0f1fdd6af3..537ff7b3c412 100644 > > --- a/mm/vmalloc.c > > +++ b/mm/vmalloc.c > > @@ -170,10 +170,7 @@ static int vmap_try_huge_pmd(pmd_t *pmd, unsigned long addr, unsigned long end, > > * Therefore, acquire the mmap read lock to prevent use-after-free when > > * freeing page tables. > > */ > > -#ifndef CONFIG_ARM64 > > - scoped_cond_guard(mmap_read_lock_try, return 0, &init_mm) > > -#endif > > - { > > + scoped_cond_guard(mmap_read_lock_try, return 0, &init_mm) { > > if (!pmd_free_pte_page(pmd, addr)) > > return 0; > > return pmd_set_huge(pmd, phys_addr, prot); > > @@ -230,10 +227,7 @@ static int vmap_try_huge_pud(pud_t *pud, unsigned long addr, unsigned long end, > > return pud_set_huge(pud, phys_addr, prot); > > > > /* See comment in vmap_try_huge_pmd(). */ > > -#ifndef CONFIG_ARM64 > > - scoped_cond_guard(mmap_read_lock_try, return 0, &init_mm) > > -#endif > > - { > > + scoped_cond_guard(mmap_read_lock_try, return 0, &init_mm) { > > if (!pud_free_pmd_page(pud, addr)) > > return 0; > > return pud_set_huge(pud, phys_addr, prot); > > @@ -290,10 +284,7 @@ static int vmap_try_huge_p4d(p4d_t *p4d, unsigned long addr, unsigned long end, > > return p4d_set_huge(p4d, phys_addr, prot); > > > > /* See comment in vmap_try_huge_pmd(). */ > > -#ifndef CONFIG_ARM64 > > - scoped_cond_guard(mmap_read_lock_try, return 0, &init_mm) > > -#endif > > - { > > + scoped_cond_guard(mmap_read_lock_try, return 0, &init_mm) { > > if (!p4d_free_pud_page(p4d, addr)) > > return 0; > > return p4d_set_huge(p4d, phys_addr, prot); > > > ^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2026-07-12 8:28 UTC | newest] Thread overview: 6+ messages (download: mbox.gz follow: Atom feed -- links below jump to the message on this page -- 2026-07-10 20:58 [PATCH 2/2] Revert "arm64: Enable vmalloc-huge with ptdump" kernel test robot -- strict thread matches above, loose matches on Subject: below -- 2026-07-10 10:49 [PATCH 0/2] mm: fix UAF caused by race between ptdump and vmap pgtable freeing Lorenzo Stoakes 2026-07-10 10:49 ` [PATCH 2/2] Revert "arm64: Enable vmalloc-huge with ptdump" Lorenzo Stoakes 2026-07-11 10:15 ` Mike Rapoport 2026-07-12 8:27 ` Lorenzo Stoakes 2026-07-12 7:46 ` Dev Jain 2026-07-12 8:28 ` Lorenzo Stoakes
This is an external index of several public inboxes, see mirroring instructions on how to clone and mirror all data and code used by this external index.