All of lore.kernel.org
 help / color / mirror / Atom feed
From: Muchun Song <muchun.song@linux.dev>
To: Mike Rapoport <rppt@kernel.org>
Cc: Andrew Morton <akpm@linux-foundation.org>,
	Oscar Salvador <osalvador@suse.de>,
	David Hildenbrand <david@kernel.org>,
	Vlastimil Babka <vbabka@kernel.org>,
	Lorenzo Stoakes <ljs@kernel.org>, Michal Hocko <mhocko@suse.com>,
	David Laight <david.laight.linux@gmail.com>,
	"Liam R . Howlett" <liam@infradead.org>,
	Suren Baghdasaryan <surenb@google.com>,
	linux-mm@kvack.org, linux-kernel@vger.kernel.org,
	Muchun Song <songmuchun@bytedance.com>
Subject: Re: [PATCH v4 03/17] mm/mm_init: skip initializing shared vmemmap tail pages
Date: Mon, 24 Aug 2026 19:18:37 +0800	[thread overview]
Message-ID: <42b6e1b4-96ed-4364-a502-369b4a96705b@linux.dev> (raw)
In-Reply-To: <178756196748.3606540.14377746709923091802.b4-review@b4>



On 2026/8/24 16:59, Mike Rapoport wrote:
>> memmap_init_range() initializes every struct page in the target range.
>> For compound pages with vmemmap optimization, the tail struct pages are
>> backed by a shared vmemmap page.
>>
>> Initializing those tail struct pages would overwrite the shared
>> vmemmap page contents, requiring users such as HugeTLB to restore the
>> metadata afterwards.
>>
>> Track the compound order for HVO-backed sections and use that metadata
>> to detect struct pages that fall into the shared tail vmemmap range.
>> Skip those shared tail pages in memmap_init_range(), then initialize
>> pageblock migratetypes for the processed range with a helper after the
>> per-page initialization loop.
>>
>> Keep direct mem_section access inside sparse helpers by exposing
>> pfn_to_section_order() to users that only need the order associated with
>> a PFN. This lets memmap_init_range() skip shared tail vmemmap pages
>> without exposing __pfn_to_section() to !SPARSEMEM builds.
>>
>> This is a preparatory change for consolidating handling across users of
>> vmemmap optimization, and it also avoids redundant initialization of
>> shared tail vmemmap pages during early boot.
>>
>> Signed-off-by: Muchun Song <songmuchun@bytedance.com>
>>
>> diff --git a/include/linux/mmzone.h b/include/linux/mmzone.h
>> index 5fb9b37819d5..df31cac12311 100644
>> --- a/include/linux/mmzone.h
>> +++ b/include/linux/mmzone.h
>> @@ -2022,6 +2022,14 @@ struct mem_section {
>>   	unsigned long section_mem_map;
>>   
>>   	struct mem_section_usage *usage;
>> +#ifdef CONFIG_HUGETLB_PAGE_OPTIMIZE_VMEMMAP
>> +	/*
>> +	 * Normally, sections hold regular (order-0) pages. However, for
>> +	 * sections with HVO enabled, this tracks the compound page order
>> +	 * to enable deduplication of redundant vmemmap pages.
>> +	 */
>> +	unsigned int order;
>> +#endif
>>   #ifdef CONFIG_PAGE_EXTENSION
>>   	/*
>>   	 * If SPARSEMEM, pgdat doesn't have page_ext pointer. We use
>> diff --git a/mm/mm_init.c b/mm/mm_init.c
>> index 1533aebafb68..05c09e755e0b 100644
>> --- a/mm/mm_init.c
>> +++ b/mm/mm_init.c
>> @@ -29,6 +29,7 @@
>>   #include <linux/cma.h>
>>   #include <linux/crash_dump.h>
>>   #include <linux/execmem.h>
>> +#include <linux/sizes.h>
>>   #include <linux/vmstat.h>
>>   #include <linux/kexec_handover.h>
>>   #include <linux/hugetlb.h>
>> @@ -677,21 +678,19 @@ static inline void fixup_hashdist(void)
>>   static inline void fixup_hashdist(void) {}
>>   #endif /* CONFIG_NUMA */
>>   
>> -#if defined(CONFIG_ZONE_DEVICE) || defined(CONFIG_DEFERRED_STRUCT_PAGE_INIT)
>>   static __meminit void pageblock_migratetype_init_range(unsigned long pfn,
>> -		unsigned long nr_pages, int migratetype, bool atomic)
>> +		unsigned long nr_pages, int migratetype, bool isolate, bool atomic)
> Growing boolean flags makes the callsites harder to read.
> One way to deal with it is to add comments to the callers saying what
> each true and false mean.

Make sense.

>
>>   {
>>   	const unsigned long end = pfn + nr_pages;
>>   
>>   	for (pfn = pageblock_align(pfn); pfn < end; pfn += pageblock_nr_pages) {
>>   		enum migratetype mt = kho_scratch_migratetype(pfn, migratetype);
>>   
>> -		init_pageblock_migratetype(pfn_to_page(pfn), mt, false);
>> -		if (!atomic && IS_ALIGNED(pfn, PAGES_PER_SECTION))
>> +		init_pageblock_migratetype(pfn_to_page(pfn), mt, isolate);
>> +		if (!atomic && IS_ALIGNED(pfn, PFN_DOWN(SZ_1G)))
>>   			cond_resched();
>>   	}
>>   }
>> -#endif
>>   
>>   #ifdef CONFIG_DEFERRED_STRUCT_PAGE_INIT
>>   static inline void pgdat_set_deferred_range(pg_data_t *pgdat)
>> @@ -886,6 +885,13 @@ void __meminit memmap_init_range(unsigned long size, int nid, unsigned long zone
>>   			}
>>   		}
>>   
>> +		if (vmemmap_optimizable_pfn(pfn)) {
> A short comment above would be nice :)

No problem. Thanks for your review.

Muchun,
Thanks.


  reply	other threads:[~2026-08-24 11:18 UTC|newest]

Thread overview: 26+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-08-19  9:51 [PATCH v4 00/17] mm: Introduce section-based vmemmap optimization for HugeTLB Muchun Song
2026-08-19  9:51 ` [PATCH v4 01/17] mm/sparse: relax struct mem_section size constraints Muchun Song
2026-08-19  9:51 ` [PATCH v4 02/17] mm/sparse-vmemmap: rename HVO order macros Muchun Song
2026-08-19  9:51 ` [PATCH v4 03/17] mm/mm_init: skip initializing shared vmemmap tail pages Muchun Song
2026-08-24  8:59   ` Mike Rapoport
2026-08-24 11:18     ` Muchun Song [this message]
2026-08-19  9:51 ` [PATCH v4 04/17] mm/sparse-vmemmap: initialize shared tail vmemmap pages on allocation Muchun Song
2026-08-19  9:51 ` [PATCH v4 05/17] mm/sparse-vmemmap: support section-based vmemmap accounting Muchun Song
2026-08-24  8:59   ` Mike Rapoport
2026-08-19  9:51 ` [PATCH v4 06/17] mm/mm_init: factor out pfn_to_zone() Muchun Song
2026-08-19  9:51 ` [PATCH v4 07/17] mm/sparse-vmemmap: move vmemmap_get_tail() before PTE population Muchun Song
2026-08-24  8:59   ` Mike Rapoport
2026-08-19  9:51 ` [PATCH v4 08/17] mm/sparse-vmemmap: support section-based vmemmap optimization Muchun Song
2026-08-24  8:59   ` Mike Rapoport
2026-08-24 11:09     ` Muchun Song
2026-08-19  9:51 ` [PATCH v4 09/17] mm/sparse: initialize memory sections earlier Muchun Song
2026-08-24  8:59   ` Mike Rapoport
2026-08-19  9:51 ` [PATCH v4 10/17] mm/hugetlb: switch HugeTLB to section-based vmemmap optimization Muchun Song
2026-08-19  9:51 ` [PATCH v4 11/17] mm/sparse-vmemmap: remove SPARSEMEM_VMEMMAP_PREINIT support Muchun Song
2026-08-19  9:51 ` [PATCH v4 12/17] mm/sparse: inline usemap allocation into sparse_init_nid() Muchun Song
2026-08-19  9:51 ` [PATCH v4 13/17] mm/sparse: remove section_map_size() Muchun Song
2026-08-19  9:51 ` [PATCH v4 14/17] mm/hugetlb: remove HUGE_BOOTMEM_HVO Muchun Song
2026-08-19  9:51 ` [PATCH v4 15/17] mm/hugetlb: remove HUGE_BOOTMEM_CMA Muchun Song
2026-08-19  9:51 ` [PATCH v4 16/17] mm/hugetlb: localize struct huge_bootmem_page Muchun Song
2026-08-19  9:51 ` [PATCH v4 17/17] mm/hugetlb: localize HUGE_BOOTMEM_ZONES_VALID Muchun Song
2026-08-19 11:30 ` [PATCH v4 00/17] mm: Introduce section-based vmemmap optimization for HugeTLB Muchun Song

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=42b6e1b4-96ed-4364-a502-369b4a96705b@linux.dev \
    --to=muchun.song@linux.dev \
    --cc=akpm@linux-foundation.org \
    --cc=david.laight.linux@gmail.com \
    --cc=david@kernel.org \
    --cc=liam@infradead.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=ljs@kernel.org \
    --cc=mhocko@suse.com \
    --cc=osalvador@suse.de \
    --cc=rppt@kernel.org \
    --cc=songmuchun@bytedance.com \
    --cc=surenb@google.com \
    --cc=vbabka@kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.