All of lore.kernel.org
 help / color / mirror / Atom feed
From: Mike Rapoport <rppt@kernel.org>
To: Muchun Song <muchun.song@linux.dev>
Cc: Muchun Song <songmuchun@bytedance.com>,
	Andrew Morton <akpm@linux-foundation.org>,
	Oscar Salvador <osalvador@suse.de>,
	David Hildenbrand <david@kernel.org>,
	linux-mm@kvack.org, Vlastimil Babka <vbabka@kernel.org>,
	Lorenzo Stoakes <ljs@kernel.org>, Michal Hocko <mhocko@suse.com>,
	linux-kernel@vger.kernel.org
Subject: Re: [PATCH 02/17] mm/sparse-vmemmap: track compound page order in struct mem_section
Date: Wed, 15 Jul 2026 12:45:18 +0300	[thread overview]
Message-ID: <aldWrjxWkoXkF6ZM@kernel.org> (raw)
In-Reply-To: <F7B5239C-A5BD-42DD-ACFB-8C9C7AC35DC9@linux.dev>

On Wed, Jul 15, 2026 at 02:42:56PM +0800, Muchun Song wrote:
> 
> 
> > On Jul 15, 2026, at 13:08, Mike Rapoport <rppt@kernel.org> wrote:
> > 
> >> HugeTLB and DAX both rely on vmemmap optimization, but sparsemem does
> >> not record what compound page order a section is populated with.
> >> 
> >> As a result, code that needs this information has to open-code
> >> separate handling across users of vmemmap optimization.  It also
> >> prevents other memory management code, such as struct page
> >> initialization, from skipping initialization of shared vmemmap pages
> >> when needed.
> >> 
> >> Track the compound page order in struct mem_section and provide small
> >> helpers to access it.  A compound page larger than a section naturally
> >> carries the same order across all covered sections.
> >> 
> >> This is a preparatory change for consolidating vmemmap optimization
> >> handling and for letting later code make initialization decisions
> >> based on the section's compound page order.
> >> 
> >> Signed-off-by: Muchun Song <songmuchun@bytedance.com>
> >> 
> >> diff --git a/include/linux/mmzone.h b/include/linux/mmzone.h
> >> index 1353bcf7b712..bacd89572c5c 100644
> >> --- a/include/linux/mmzone.h
> >> +++ b/include/linux/mmzone.h
> >> @@ -2015,6 +2015,14 @@ struct mem_section {
> >>  */
> >> struct page_ext *page_ext;
> >> #endif
> >> +#ifdef CONFIG_SPARSEMEM_VMEMMAP
> >> + 	/*
> >> + 	 * The order of compound pages in this section. Typically, the section
> >> + 	 * holds compound pages of this order; a larger compound page will span
> >> + 	 * multiple sections.
> >> + 	 */
> > 
> > Typically a section holds order-0 pages ;-)
> > 
> > I think this comment should mention that this is for special sections,
> > like hugetlb and DAX.
> 
> I will update the comment to focus on the general concept of HVO as follows:
> 
> 	Normally, sections hold regular (order-0) pages. However, for
> 	sections with HVO enabled, this tracks the compound page order
> 	to enable deduplication of redundant vmemmap pages.
> 
> How does this look to you?
 
LGTM, thanks!
 
> >> + 	unsigned int order;
> >> +#endif
> >> };
> >> 
> >> #ifdef CONFIG_SPARSEMEM_EXTREME
> >> @@ -2361,10 +2369,34 @@ static inline unsigned long next_present_section_nr(unsigned long section_nr)
> >> #endif
> >> 
> >> #else
> >> +struct mem_section;
> >> +
> >> #define sparse_vmemmap_init_nid_early(_nid) do {} while (0)
> >> #define pfn_in_present_section pfn_valid
> >> #endif /* CONFIG_SPARSEMEM */
> >> 
> >> +#ifdef CONFIG_SPARSEMEM_VMEMMAP
> >> +static inline void section_set_order(struct mem_section *section, unsigned int order)
> >> +{
> >> + 	VM_WARN_ON(section->order && order && section->order != order);
> >> + 	section->order = order;
> >> +}
> >> +
> >> +static inline unsigned int section_order(const struct mem_section *section)
> >> +{
> >> + 	return section->order;
> >> +}
> > 
> > You mention open-coded handling, is there any open-coded case that can
> > be replaced with the new helpers right away?
> 
> The term "open-code" in my commit message might not have been clear enough.
> 
> What I intended to convey is that because HVO lacks this specific layer of
> information in both DAX and HugeTLB scenarios, they each handle their own
> cases independently. As a result, there isn't enough code reuse.
> 
> Thank you so much for pointing that out.
> 
> > 
> > We strive to have new APIs and at least some of their users in the same
> > patch.
> 
> All right. Starting with the next version, I'll be introducing the necessary
> fields (i.e. ->order) or interfaces here into each of the upcoming patches.
> In that case, this patch should no longer exist.
> 
> Muchun,
> Thanks.
> 
> > 
> > -- 
> > Sincerely yours,
> > Mike.
> 
> 

-- 
Sincerely yours,
Mike.

  reply	other threads:[~2026-07-15  9:45 UTC|newest]

Thread overview: 47+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-07-02  9:38 [PATCH 00/17] mm: Introduce section-based vmemmap optimization for HugeTLB Muchun Song
2026-07-02  9:38 ` [PATCH 01/17] mm/sparse: drop power-of-2 size requirement for struct mem_section Muchun Song
2026-07-15  5:08   ` Mike Rapoport
2026-07-15  9:34   ` David Laight
2026-07-15 13:15     ` Muchun Song
2026-07-02  9:38 ` [PATCH 02/17] mm/sparse-vmemmap: track compound page order in " Muchun Song
2026-07-15  5:08   ` Mike Rapoport
2026-07-15  6:42     ` Muchun Song
2026-07-15  9:45       ` Mike Rapoport [this message]
2026-07-02  9:38 ` [PATCH 03/17] mm/sparse-vmemmap: introduce folio-oriented vmemmap optimization macros Muchun Song
2026-07-15  5:08   ` Mike Rapoport
2026-07-02  9:38 ` [PATCH 04/17] mm/mm_init: skip initializing shared vmemmap tail pages Muchun Song
2026-07-09 10:45   ` Mike Rapoport
2026-07-09 12:31     ` Muchun Song
2026-07-09 13:05       ` Mike Rapoport
2026-07-09 13:23         ` Muchun Song
2026-07-15  5:08   ` Mike Rapoport
2026-07-15  9:11     ` Muchun Song
2026-07-15  9:47       ` Mike Rapoport
2026-07-02  9:38 ` [PATCH 05/17] mm/sparse-vmemmap: initialize shared tail vmemmap pages on allocation Muchun Song
2026-07-02  9:38 ` [PATCH 06/17] mm/sparse-vmemmap: support section-based vmemmap accounting Muchun Song
2026-07-15  5:08   ` Mike Rapoport
2026-07-15 14:44     ` Muchun Song
2026-07-02  9:38 ` [PATCH 07/17] mm/sparse-vmemmap: support section-based vmemmap optimization Muchun Song
2026-07-15  5:08   ` Mike Rapoport
2026-07-02  9:38 ` [PATCH 08/17] mm/sparse: mark memory sections present earlier Muchun Song
2026-07-09 10:54   ` Mike Rapoport
2026-07-09 12:35     ` Muchun Song
2026-07-15  5:08   ` Mike Rapoport
2026-07-02  9:38 ` [PATCH 09/17] mm/hugetlb: switch HugeTLB to section-based vmemmap optimization Muchun Song
2026-07-15  5:08   ` Mike Rapoport
2026-07-02  9:38 ` [PATCH 10/17] mm/mm_init: factor out pfn_to_zone() Muchun Song
2026-07-15  5:08   ` Mike Rapoport
2026-07-02  9:38 ` [PATCH 11/17] mm/sparse-vmemmap: remove SPARSEMEM_VMEMMAP_PREINIT support Muchun Song
2026-07-15  5:08   ` Mike Rapoport
2026-07-02  9:38 ` [PATCH 12/17] mm/sparse: inline usemap allocation into sparse_init_nid() Muchun Song
2026-07-15  5:08   ` Mike Rapoport
2026-07-02  9:38 ` [PATCH 13/17] mm/sparse: remove section_map_size() Muchun Song
2026-07-15  5:08   ` Mike Rapoport
2026-07-02  9:38 ` [PATCH 14/17] mm/hugetlb: remove HUGE_BOOTMEM_HVO Muchun Song
2026-07-15  5:08   ` Mike Rapoport
2026-07-02  9:38 ` [PATCH 15/17] mm/hugetlb: remove HUGE_BOOTMEM_CMA Muchun Song
2026-07-15  5:08   ` Mike Rapoport
2026-07-02  9:38 ` [PATCH 16/17] mm/hugetlb: localize struct huge_bootmem_page Muchun Song
2026-07-15  5:08   ` Mike Rapoport
2026-07-02  9:38 ` [PATCH 17/17] mm/hugetlb: localize HUGE_BOOTMEM_ZONES_VALID Muchun Song
2026-07-15  5:08   ` Mike Rapoport

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=aldWrjxWkoXkF6ZM@kernel.org \
    --to=rppt@kernel.org \
    --cc=akpm@linux-foundation.org \
    --cc=david@kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=ljs@kernel.org \
    --cc=mhocko@suse.com \
    --cc=muchun.song@linux.dev \
    --cc=osalvador@suse.de \
    --cc=songmuchun@bytedance.com \
    --cc=vbabka@kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.