Linux-mm Archive on lore.kernel.org
 help / color / mirror / Atom feed
From: Muchun Song <muchun.song@linux.dev>
To: David Laight <david.laight.linux@gmail.com>
Cc: Muchun Song <songmuchun@bytedance.com>,
	Andrew Morton <akpm@linux-foundation.org>,
	Oscar Salvador <osalvador@suse.de>,
	David Hildenbrand <david@kernel.org>,
	linux-mm@kvack.org, Mike Rapoport <rppt@kernel.org>,
	Vlastimil Babka <vbabka@kernel.org>,
	Lorenzo Stoakes <ljs@kernel.org>, Michal Hocko <mhocko@suse.com>,
	linux-kernel@vger.kernel.org
Subject: Re: [PATCH 02/17] mm/sparse-vmemmap: track compound page order in struct mem_section
Date: Thu, 16 Jul 2026 18:57:57 +0800	[thread overview]
Message-ID: <7BE734F3-4B0A-4990-9511-C2274C1CFA51@linux.dev> (raw)
In-Reply-To: <20260716101559.2e640e99@pumpkin>



> On Jul 16, 2026, at 17:15, David Laight <david.laight.linux@gmail.com> wrote:
> 
> On Thu,  2 Jul 2026 17:38:06 +0800
> Muchun Song <songmuchun@bytedance.com> wrote:
> 
>> HugeTLB and DAX both rely on vmemmap optimization, but sparsemem does
>> not record what compound page order a section is populated with.
>> 
>> As a result, code that needs this information has to open-code
>> separate handling across users of vmemmap optimization.  It also
>> prevents other memory management code, such as struct page
>> initialization, from skipping initialization of shared vmemmap pages
>> when needed.
>> 
>> Track the compound page order in struct mem_section and provide small
>> helpers to access it.  A compound page larger than a section naturally
>> carries the same order across all covered sections.
>> 
>> This is a preparatory change for consolidating vmemmap optimization
>> handling and for letting later code make initialization decisions
>> based on the section's compound page order.
>> 
>> Signed-off-by: Muchun Song <songmuchun@bytedance.com>
>> ---
>> include/linux/mmzone.h | 32 ++++++++++++++++++++++++++++++++
>> 1 file changed, 32 insertions(+)
>> 
>> diff --git a/include/linux/mmzone.h b/include/linux/mmzone.h
>> index 1353bcf7b712..bacd89572c5c 100644
>> --- a/include/linux/mmzone.h
>> +++ b/include/linux/mmzone.h
>> @@ -2015,6 +2015,14 @@ struct mem_section {
>>  */
>> struct page_ext *page_ext;
>> #endif
>> +#ifdef CONFIG_SPARSEMEM_VMEMMAP
>> + 	/*
>> + 	 * The order of compound pages in this section. Typically, the section
>> + 	 * holds compound pages of this order; a larger compound page will span
>> + 	 * multiple sections.
>> + 	 */
>> + 	unsigned int order;
>> +#endif
>> };
> 
> That increases the size of the structure by 8 bytes for a value that
> would fit in one (or 16 bytes to maintain power-of-2 size).
> I'm pretty sure this array is big - so that is significant.
> 
> I've looked up some constants...
> On x86-64 each section is (1 << 27) bytes or 128M.
> A page contains 256 small 'struct mm_section' so covers 32GB of physical address.
> That is pretty much the memory limit for a 'normal' system.
> So even doubling the structure size only uses 2 pages for 32GB memory.
> Even packing the structure (or making it 48 bytes) would still use 2 pages.
> Of course there are the big servers with TB of memory...
> 
> A more interesting problem is the size of the 'page pointer' array.
> That is sized for physical addresses right at the top of the 52bits
> supported by 5-level page tables.
> I make that 52-27-8+3 = 20 bits or 1MB, doubling to 2MB if struct mem_section
> is increased to 32 bytes.
> However, in practise, I suspect that the actual upper limit for physical
> addresses is much lower.

That was a truly excellent analysis. It is clear that the memory used by the
mem_section occupies a very small percentage of the overall system memory.

> 
> It is also worth noting that CONFIG_PAGE_EXTENSION is a debug option.
> It probably doesn't matter about efficiency if it is enabled.
> 
> You could change the code to use % instead of & - makes no difference if
> the size is a power of 2. That is generally safer.

No problem. My patch 1 has already handled that.

> 
> Then do:
> #if defined(CONFIG_PAGE_EXTENSION) || defined (CONFIG_SPARSEMEM_VMEMMAP)
> 	struct page_ext *page_ext;
> 	unsigned int order;
> #endif
> With an extra comment about keeping power of 2 size for effifiency.

Thanks for the suggestion! I'll use this approach to ensure men_section
is aligned to a power of two again. I'll also add a comment here to explain
the reasoning behind this implementation.

I really appreciate your detailed analysis and insights.

Muchun,
Thanks.

> 
> David




      parent reply	other threads:[~2026-07-16 15:47 UTC|newest]

Thread overview: 16+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
     [not found] <20260702093821.2740183-1-songmuchun@bytedance.com>
     [not found] ` <20260702093821.2740183-9-songmuchun@bytedance.com>
2026-07-09 10:54   ` [PATCH 08/17] mm/sparse: mark memory sections present earlier Mike Rapoport
2026-07-09 12:35     ` Muchun Song
     [not found] ` <20260702093821.2740183-8-songmuchun@bytedance.com>
2026-07-15  5:08   ` [PATCH 07/17] mm/sparse-vmemmap: support section-based vmemmap optimization Mike Rapoport
     [not found] ` <20260702093821.2740183-7-songmuchun@bytedance.com>
2026-07-15  5:08   ` [PATCH 06/17] mm/sparse-vmemmap: support section-based vmemmap accounting Mike Rapoport
2026-07-15 14:44     ` Muchun Song
     [not found] ` <20260702093821.2740183-2-songmuchun@bytedance.com>
2026-07-15  5:08   ` [PATCH 01/17] mm/sparse: drop power-of-2 size requirement for struct mem_section Mike Rapoport
     [not found]   ` <20260715103445.31b2f727@pumpkin>
2026-07-15 13:15     ` Muchun Song
2026-07-15 15:52       ` David Laight
     [not found] ` <20260702093821.2740183-4-songmuchun@bytedance.com>
2026-07-15  5:08   ` [PATCH 03/17] mm/sparse-vmemmap: introduce folio-oriented vmemmap optimization macros Mike Rapoport
     [not found] ` <20260702093821.2740183-5-songmuchun@bytedance.com>
2026-07-09 10:45   ` [PATCH 04/17] mm/mm_init: skip initializing shared vmemmap tail pages Mike Rapoport
2026-07-09 12:31     ` Muchun Song
2026-07-09 13:05       ` Mike Rapoport
2026-07-09 13:23         ` Muchun Song
2026-07-15  5:08   ` Mike Rapoport
     [not found] ` <20260702093821.2740183-3-songmuchun@bytedance.com>
2026-07-15  5:08   ` [PATCH 02/17] mm/sparse-vmemmap: track compound page order in struct mem_section Mike Rapoport
     [not found]   ` <20260716101559.2e640e99@pumpkin>
2026-07-16 10:57     ` Muchun Song [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=7BE734F3-4B0A-4990-9511-C2274C1CFA51@linux.dev \
    --to=muchun.song@linux.dev \
    --cc=akpm@linux-foundation.org \
    --cc=david.laight.linux@gmail.com \
    --cc=david@kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=ljs@kernel.org \
    --cc=mhocko@suse.com \
    --cc=osalvador@suse.de \
    --cc=rppt@kernel.org \
    --cc=songmuchun@bytedance.com \
    --cc=vbabka@kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox