From: David Laight <david.laight.linux@gmail.com>
To: Muchun Song <songmuchun@bytedance.com>
Cc: Andrew Morton <akpm@linux-foundation.org>,
Oscar Salvador <osalvador@suse.de>,
David Hildenbrand <david@kernel.org>,
linux-mm@kvack.org, Mike Rapoport <rppt@kernel.org>,
Vlastimil Babka <vbabka@kernel.org>,
Lorenzo Stoakes <ljs@kernel.org>, Michal Hocko <mhocko@suse.com>,
linux-kernel@vger.kernel.org, muchun.song@linux.dev
Subject: Re: [PATCH 02/17] mm/sparse-vmemmap: track compound page order in struct mem_section
Date: Thu, 16 Jul 2026 10:15:59 +0100 [thread overview]
Message-ID: <20260716101559.2e640e99@pumpkin> (raw)
In-Reply-To: <20260702093821.2740183-3-songmuchun@bytedance.com>
On Thu, 2 Jul 2026 17:38:06 +0800
Muchun Song <songmuchun@bytedance.com> wrote:
> HugeTLB and DAX both rely on vmemmap optimization, but sparsemem does
> not record what compound page order a section is populated with.
>
> As a result, code that needs this information has to open-code
> separate handling across users of vmemmap optimization. It also
> prevents other memory management code, such as struct page
> initialization, from skipping initialization of shared vmemmap pages
> when needed.
>
> Track the compound page order in struct mem_section and provide small
> helpers to access it. A compound page larger than a section naturally
> carries the same order across all covered sections.
>
> This is a preparatory change for consolidating vmemmap optimization
> handling and for letting later code make initialization decisions
> based on the section's compound page order.
>
> Signed-off-by: Muchun Song <songmuchun@bytedance.com>
> ---
> include/linux/mmzone.h | 32 ++++++++++++++++++++++++++++++++
> 1 file changed, 32 insertions(+)
>
> diff --git a/include/linux/mmzone.h b/include/linux/mmzone.h
> index 1353bcf7b712..bacd89572c5c 100644
> --- a/include/linux/mmzone.h
> +++ b/include/linux/mmzone.h
> @@ -2015,6 +2015,14 @@ struct mem_section {
> */
> struct page_ext *page_ext;
> #endif
> +#ifdef CONFIG_SPARSEMEM_VMEMMAP
> + /*
> + * The order of compound pages in this section. Typically, the section
> + * holds compound pages of this order; a larger compound page will span
> + * multiple sections.
> + */
> + unsigned int order;
> +#endif
> };
That increases the size of the structure by 8 bytes for a value that
would fit in one (or 16 bytes to maintain power-of-2 size).
I'm pretty sure this array is big - so that is significant.
I've looked up some constants...
On x86-64 each section is (1 << 27) bytes or 128M.
A page contains 256 small 'struct mm_section' so covers 32GB of physical address.
That is pretty much the memory limit for a 'normal' system.
So even doubling the structure size only uses 2 pages for 32GB memory.
Even packing the structure (or making it 48 bytes) would still use 2 pages.
Of course there are the big servers with TB of memory...
A more interesting problem is the size of the 'page pointer' array.
That is sized for physical addresses right at the top of the 52bits
supported by 5-level page tables.
I make that 52-27-8+3 = 20 bits or 1MB, doubling to 2MB if struct mem_section
is increased to 32 bytes.
However, in practise, I suspect that the actual upper limit for physical
addresses is much lower.
It is also worth noting that CONFIG_PAGE_EXTENSION is a debug option.
It probably doesn't matter about efficiency if it is enabled.
You could change the code to use % instead of & - makes no difference if
the size is a power of 2. That is generally safer.
Then do:
#if defined(CONFIG_PAGE_EXTENSION) || defined (CONFIG_SPARSEMEM_VMEMMAP)
struct page_ext *page_ext;
unsigned int order;
#endif
With an extra comment about keeping power of 2 size for effifiency.
David
next prev parent reply other threads:[~2026-07-16 9:16 UTC|newest]
Thread overview: 57+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-07-02 9:38 [PATCH 00/17] mm: Introduce section-based vmemmap optimization for HugeTLB Muchun Song
2026-07-02 9:38 ` [PATCH 01/17] mm/sparse: drop power-of-2 size requirement for struct mem_section Muchun Song
2026-07-15 5:08 ` Mike Rapoport
2026-07-15 9:34 ` David Laight
2026-07-15 13:15 ` Muchun Song
2026-07-15 15:52 ` David Laight
2026-07-16 6:51 ` Muchun Song
2026-07-02 9:38 ` [PATCH 02/17] mm/sparse-vmemmap: track compound page order in " Muchun Song
2026-07-15 5:08 ` Mike Rapoport
2026-07-15 6:42 ` Muchun Song
2026-07-15 9:45 ` Mike Rapoport
2026-07-16 9:15 ` David Laight [this message]
2026-07-02 9:38 ` [PATCH 03/17] mm/sparse-vmemmap: introduce folio-oriented vmemmap optimization macros Muchun Song
2026-07-15 5:08 ` Mike Rapoport
2026-07-16 7:38 ` Muchun Song
2026-07-16 10:04 ` Mike Rapoport
2026-07-02 9:38 ` [PATCH 04/17] mm/mm_init: skip initializing shared vmemmap tail pages Muchun Song
2026-07-09 10:45 ` Mike Rapoport
2026-07-09 12:31 ` Muchun Song
2026-07-09 13:05 ` Mike Rapoport
2026-07-09 13:23 ` Muchun Song
2026-07-15 5:08 ` Mike Rapoport
2026-07-15 9:11 ` Muchun Song
2026-07-15 9:47 ` Mike Rapoport
2026-07-02 9:38 ` [PATCH 05/17] mm/sparse-vmemmap: initialize shared tail vmemmap pages on allocation Muchun Song
2026-07-02 9:38 ` [PATCH 06/17] mm/sparse-vmemmap: support section-based vmemmap accounting Muchun Song
2026-07-15 5:08 ` Mike Rapoport
2026-07-15 14:44 ` Muchun Song
2026-07-16 6:23 ` Mike Rapoport
2026-07-16 6:48 ` Muchun Song
2026-07-02 9:38 ` [PATCH 07/17] mm/sparse-vmemmap: support section-based vmemmap optimization Muchun Song
2026-07-15 5:08 ` Mike Rapoport
2026-07-16 7:19 ` Muchun Song
2026-07-02 9:38 ` [PATCH 08/17] mm/sparse: mark memory sections present earlier Muchun Song
2026-07-09 10:54 ` Mike Rapoport
2026-07-09 12:35 ` Muchun Song
2026-07-15 5:08 ` Mike Rapoport
2026-07-16 7:15 ` Muchun Song
2026-07-02 9:38 ` [PATCH 09/17] mm/hugetlb: switch HugeTLB to section-based vmemmap optimization Muchun Song
2026-07-15 5:08 ` Mike Rapoport
2026-07-02 9:38 ` [PATCH 10/17] mm/mm_init: factor out pfn_to_zone() Muchun Song
2026-07-15 5:08 ` Mike Rapoport
2026-07-16 7:18 ` Muchun Song
2026-07-02 9:38 ` [PATCH 11/17] mm/sparse-vmemmap: remove SPARSEMEM_VMEMMAP_PREINIT support Muchun Song
2026-07-15 5:08 ` Mike Rapoport
2026-07-02 9:38 ` [PATCH 12/17] mm/sparse: inline usemap allocation into sparse_init_nid() Muchun Song
2026-07-15 5:08 ` Mike Rapoport
2026-07-02 9:38 ` [PATCH 13/17] mm/sparse: remove section_map_size() Muchun Song
2026-07-15 5:08 ` Mike Rapoport
2026-07-02 9:38 ` [PATCH 14/17] mm/hugetlb: remove HUGE_BOOTMEM_HVO Muchun Song
2026-07-15 5:08 ` Mike Rapoport
2026-07-02 9:38 ` [PATCH 15/17] mm/hugetlb: remove HUGE_BOOTMEM_CMA Muchun Song
2026-07-15 5:08 ` Mike Rapoport
2026-07-02 9:38 ` [PATCH 16/17] mm/hugetlb: localize struct huge_bootmem_page Muchun Song
2026-07-15 5:08 ` Mike Rapoport
2026-07-02 9:38 ` [PATCH 17/17] mm/hugetlb: localize HUGE_BOOTMEM_ZONES_VALID Muchun Song
2026-07-15 5:08 ` Mike Rapoport
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20260716101559.2e640e99@pumpkin \
--to=david.laight.linux@gmail.com \
--cc=akpm@linux-foundation.org \
--cc=david@kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=ljs@kernel.org \
--cc=mhocko@suse.com \
--cc=muchun.song@linux.dev \
--cc=osalvador@suse.de \
--cc=rppt@kernel.org \
--cc=songmuchun@bytedance.com \
--cc=vbabka@kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox