From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from smtp.kernel.org (aws-us-west-2-korg-mail-alma10-1.taild15c8.ts.net [100.103.45.18]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 23CF5471CE0 for ; Thu, 3 Sep 2026 17:34:57 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=100.103.45.18 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1788456899; cv=none; b=DVlL6PCE1i+ChiAZ12NaVBtefWiw1fK8n9RAPwdDc+rzOdzmAXI6CBQHsQh+qkOK0aFi3ykarHHLqNJHSFCK+MgzXqmk8c10qJaqKYBQsAx9yw1aCKv7aq1tUj5IGtRm54WbCD+6GYbxUpfGHhCuAf5xcrMNoYuE6llyxGFCv+o= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1788456899; c=relaxed/simple; bh=pWhIvY6123pgfJmkkNcSD0Nb7u094FQeDlr8yJ9kpTA=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version; b=aU4y6sBJYyfCzay0bGzTtF0u5LkgUGsBws2NRKGSbGJLqAApavm3W0loAqDUs0GXRluG6e2OfIoBzOX5U9wmkUylRuaXQ/Ju4FEAycEOBwPKac+Ee4R89dodW4ANzIjnfNXpXCoyMA9x6XlEscF0Q7H4F3YVXQfESTC2TFn0v/Q= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=LLoGQOT7; arc=none smtp.client-ip=100.103.45.18 Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="LLoGQOT7" Received: by smtp.kernel.org (Postfix) with ESMTPSA id 07F611F000E9; Thu, 3 Sep 2026 17:34:55 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kernel.org; s=k20260515; t=1788456897; bh=06N9IL+LNkTbZbcMaOAu4gpg0ODo+r9i9g4AV1GQDnU=; h=From:To:Cc:Subject:Date:In-Reply-To:References; b=LLoGQOT7ty9xvaMLPNsh15jNQyFlWrREp+v7DqfhIfRIgnP3x6DS1ipRHaFoQ2wrV uCqGbW+PvFwMb3vZluZUdrJvmxvohnIYVSknNKQrl5Hcca2HlGAc3zmL3DRJa4jYO2 MVLXswRpXA4CIb4Ix51ee9YYV7Ro6DX0kYUpKr8EnbX2FdCrGZgwTRgmcHEpO7YrYt X3XkpgriWbRnv+4KmfSEmh6tMp9OksLKi4YKFre5t518t7mH+FiCzWa4aTdoHvHhyd /hf8F079ALi666bRRweruc9WgI06ol3110sERkAEqdqyHm0e0LcJB46Lxf9Ze115OB 2ZyiLCiBfiRQg== From: Sasha Levin To: stable@vger.kernel.org Cc: Muchun Song , "Mike Rapoport (Microsoft)" , Oscar Salvador , "Aneesh Kumar K.V" , David Hildenbrand , Frank van der Linden , "Liam R. Howlett" , Lorenzo Stoakes , Madhavan Srinivasan , Michael Ellerman , Nicholas Piggin , "Oscar Salvador (SUSE)" , "Ritesh Harjani (IBM)" , Usama Arif , Vlastimil Babka , Andrew Morton , Sasha Levin Subject: [PATCH 6.12.y] mm/hugetlb: initialize gigantic bootmem hugepage struct pages earlier Date: Thu, 3 Sep 2026 13:34:54 -0400 Message-ID: <20260903173454.1199815-1-sashal@kernel.org> X-Mailer: git-send-email 2.53.0 In-Reply-To: <2026090313-preschool-santa-9fe8@gregkh> References: <2026090313-preschool-santa-9fe8@gregkh> Precedence: bulk X-Mailing-List: stable@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit From: Muchun Song [ Upstream commit b1b7c045e808c761b1cc8c19b3040fadedda3fef ] Gigantic bootmem HugeTLB pages are currently initialized from hugetlb_init(), but page_alloc_init_late() runs earlier and walks pageblocks to determine zone contiguity. If a bootmem HugeTLB region is marked noinit, set_zone_contiguous() can observe still-uninitialized struct pages through __pageblock_pfn_to_page(). This may not trigger an immediate failure, but it can make set_zone_contiguous() compute the wrong zone contiguity state. If extra poisoned-page checks are added in this path, such as PF_POISONED_CHECK() in page_zone_id(), it can also trigger an early boot panic. Initialize gigantic bootmem HugeTLB struct pages from page_alloc_init_late(), before zone contiguity is evaluated, so later page allocator setup only sees valid struct page state. This also makes the initialization order more natural, as struct pages should be initialized before later code inspects them. Link: https://lore.kernel.org/20260612035903.2468601-5-songmuchun@bytedance.com Fixes: fde1c4ecf916 ("mm: hugetlb: skip initialization of gigantic tail struct pages if freed by HVO") Signed-off-by: Muchun Song Acked-by: Mike Rapoport (Microsoft) Acked-by: Oscar Salvador Cc: "Aneesh Kumar K.V" Cc: David Hildenbrand Cc: Frank van der Linden Cc: Liam R. Howlett Cc: Lorenzo Stoakes Cc: Madhavan Srinivasan Cc: Michael Ellerman Cc: Nicholas Piggin Cc: Oscar Salvador (SUSE) Cc: "Ritesh Harjani (IBM)" Cc: Usama Arif Cc: Vlastimil Babka Cc: Signed-off-by: Andrew Morton [ added a direct hugetlb.h include and omitted a comment for absent HVO shared-tail code. ] Signed-off-by: Sasha Levin --- include/linux/hugetlb.h | 5 +++++ mm/hugetlb.c | 5 ++--- mm/mm_init.c | 2 ++ 3 files changed, 9 insertions(+), 3 deletions(-) diff --git a/include/linux/hugetlb.h b/include/linux/hugetlb.h index 739bc71c33fd1..fde92c8258e54 100644 --- a/include/linux/hugetlb.h +++ b/include/linux/hugetlb.h @@ -172,6 +172,7 @@ struct address_space *hugetlb_folio_mapping_lock_write(struct folio *folio); extern int sysctl_hugetlb_shm_group; extern struct list_head huge_boot_pages[MAX_NUMNODES]; +void hugetlb_bootmem_struct_page_init(void); /* arch callbacks */ #ifndef CONFIG_HIGHPTE @@ -1263,6 +1264,10 @@ static inline bool hugetlbfs_pagecache_present( { return false; } + +static inline void hugetlb_bootmem_struct_page_init(void) +{ +} #endif /* CONFIG_HUGETLB_PAGE */ static inline spinlock_t *huge_pte_lock(struct hstate *h, diff --git a/mm/hugetlb.c b/mm/hugetlb.c index e910ed0c43d0b..e36033ebad51d 100644 --- a/mm/hugetlb.c +++ b/mm/hugetlb.c @@ -3277,7 +3277,7 @@ static void __init gather_bootmem_prealloc_parallel(unsigned long start, gather_bootmem_prealloc_node(nid); } -static void __init gather_bootmem_prealloc(void) +void __init hugetlb_bootmem_struct_page_init(void) { struct padata_mt_job job = { .thread_fn = gather_bootmem_prealloc_parallel, @@ -3432,7 +3432,7 @@ static unsigned long __init hugetlb_pages_alloc_boot(struct hstate *h) * - For gigantic pages, this is called early in the boot process and * pages are allocated from memblock allocated or something similar. * Gigantic pages are actually added to pools later with the routine - * gather_bootmem_prealloc. + * hugetlb_bootmem_struct_page_init. * - For non-gigantic pages, this is called later in the boot process after * all of mm is up and functional. Pages are allocated from buddy and * then added to hugetlb pools. @@ -4471,7 +4471,6 @@ static int __init hugetlb_init(void) hugetlb_cma_check(); hugetlb_init_hstates(); - gather_bootmem_prealloc(); report_hugepages(); hugetlb_sysfs_init(); diff --git a/mm/mm_init.c b/mm/mm_init.c index 21e01537c9f5f..f9cefbe185ef7 100644 --- a/mm/mm_init.c +++ b/mm/mm_init.c @@ -30,6 +30,7 @@ #include #include #include +#include #include "internal.h" #include "slab.h" #include "shuffle.h" @@ -2313,6 +2314,7 @@ void __init page_alloc_init_late(void) /* Reinit limits that are based on free pages after the kernel is up */ files_maxfiles_init(); #endif + hugetlb_bootmem_struct_page_init(); /* Accounting of total+free memory is stable at this point. */ mem_init_print_info(); -- 2.53.0