From: Muchun Song <muchun.song@linux.dev>
To: Qi Zheng <zhengqi.arch@bytedance.com>
Cc: Qi Zheng <qi.zheng@linux.dev>,
osalvador@suse.de, david@kernel.org, akpm@linux-foundation.org,
linux-mm@kvack.org, linux-kernel@vger.kernel.org
Subject: Re: [PATCH 0/5] mm: hugetlb: add CMA support for PMD-sized page
Date: Mon, 19 Oct 2026 15:50:48 +0800 [thread overview]
Message-ID: <BEADD50D-94AA-4B05-B9AD-136E37247FDD@linux.dev> (raw)
In-Reply-To: <4a7ad39d-fee6-4390-beff-d40ecf49cbdc@bytedance.com>
> On Oct 19, 2026, at 15:37, Qi Zheng <zhengqi.arch@bytedance.com> wrote:
>
> Hi Muchun,
>
> On 10/19/26 2:50 PM, Muchun Song wrote:
>>
>>
>>> On Oct 16, 2026, at 18:07, Qi Zheng <qi.zheng@linux.dev> wrote:
>>>
>>> From: Qi Zheng <zhengqi.arch@bytedance.com>
>>>
>>> Hi all,
>>>
>>> Allocating PMD-sized HugeTLB pages at runtime can become slow or fail
>>> as physical memory becomes fragmented. Reserving HugeTLB pages at boot
>>> avoids this problem, but keeps unused pages unavailable to ordinary
>>> allocations.
>>>
>>> Live upgrades are one example: they need additional HugeTLB pages only
>>> during the upgrade. HugeTLB already supports CMA for gigantic pages,
>>> but reserving a CMA pool for 1 GiB pages can fail when physical KASLR
>>> and other early reservations leave too few suitable 1 GiB-aligned
>>> ranges. At runtime, 1 GiB allocations can also fail when pages cannot
>>> be migrated out of a suitable contiguous range.
>>
>> Yes, that's our use case at ByteDance. Allocating a 1GB HugeTLB page from
>> the CMA pool is more prone to failure than allocating a 2MB one. To improve
>> the probability of successful allocation, we typically configure the CMA
>> size to be larger than our actual requirement, keeping a certain margin to
>> handle cases where temporary kernel operations (such as DMA) prevent successful
>> migration. For 1G HugeTLB pages, since the margin must be an integer multiple
>> of 1G, the extra memory configured as headroom is also relatively large,
>> making it less flexible than 2M pages.
>>
>>>
>>> Extend CMA support to PMD-sized pages so their backing memory can be
>>> reserved at boot while remaining usable for movable allocations until
>>> needed. This relaxes the reservation alignment requirement and reduces
>>> the contiguous range required per allocation.
>>>
>>> The series adds an optional @<page-size> suffix to hugetlb_cma and a
>>> separate PMD-sized pool. For example, on x86-64:
>>>
>>> hugetlb_cma=4G hugetlb_cma=1G@2M
>>
>> Different sizes of gigantic pages already share a single HugeTLB CMA pool.
>> Given that, why not let 2M pages also reuse this same pool? Would that make
>> the overall code implementation simpler? And if it does make things simpler,
>> should we go ahead and do it first?
>
> Sharing the pool would simplify the implementation. My concern is that
> small PMD allocations could fragment the default pool and prevent later
> gigantic allocations.
Yes. However, the premise is that there has to be a mixed-use scenario.
I'm not sure if this kind of mixed usage is a common scenario.
Of course, we don't have much experience to draw on, because on most
architectures there is generally only one kind of gigantic page, and
prior to this, mixed-use scenarios could not arise.
Therefore, I think that before the need arises, a simpler design is
easier to maintain.
Thanks,
Muchun
>
> 32M allocations can already cause this, but 2M allocations can block
> the same number of 1G-aligned ranges with much less allocated memory.
>
> Thanks,
> Qi
>
>>
>> Thanks,
>> Muchun
>>
>>>
>>> This reserves 4G for the existing gigantic-page pool and 1G for the
>>> PMD-sized pool. Existing unsuffixed parameters and gigantic-page pool
>>> sharing are preserved. The new size follows the architecture's PMD
>>> size rather than being fixed at 2M.
>>>
>>> The preparatory patches introduce per-pool state and prevent recursive
>>> CMA allocation during migration before enabling PMD-sized allocation.
>>>
>>> Thanks,
>>> Qi
>>>
>>> Qi Zheng (5):
>>> mm: hugetlb: add explicit page size to hugetlb_cma
>>> mm: hugetlb: group CMA pool and reservation state
>>> mm: hugetlb: track CMA reservations by page order
>>> mm: hugetlb: avoid recursive CMA allocation during migration
>>> mm: hugetlb: enable CMA allocation for PMD-sized pages
>>>
>>> .../admin-guide/kernel-parameters.txt | 39 ++-
>>> include/linux/hugetlb.h | 4 +-
>>> mm/hugetlb.c | 80 +++--
>>> mm/hugetlb_cma.c | 328 ++++++++++++------
>>> mm/hugetlb_cma.h | 11 +-
>>> mm/mempolicy.c | 2 +-
>>> mm/migrate.c | 3 +-
>>> 7 files changed, 306 insertions(+), 161 deletions(-)
>>>
>>>
>>> base-commit: b810335a0699d1810683796b0e3ffe8827ddfe6c
>>> --
>>> 2.54.0
next prev parent reply other threads:[~2026-10-19 7:51 UTC|newest]
Thread overview: 21+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-10-16 10:07 [PATCH 0/5] mm: hugetlb: add CMA support for PMD-sized page Qi Zheng
2026-10-16 10:07 ` [PATCH 1/5] mm: hugetlb: add explicit page size to hugetlb_cma Qi Zheng
2026-10-17 17:31 ` Jose A. Perez de Azpillaga
2026-10-16 10:07 ` [PATCH 2/5] mm: hugetlb: group CMA pool and reservation state Qi Zheng
2026-10-17 17:53 ` Jose A. Perez de Azpillaga
2026-10-16 10:07 ` [PATCH 3/5] mm: hugetlb: track CMA reservations by page order Qi Zheng
2026-10-17 18:41 ` Jose A. Perez de Azpillaga
2026-10-19 7:10 ` Qi Zheng
2026-10-16 10:07 ` [PATCH 4/5] mm: hugetlb: avoid recursive CMA allocation during migration Qi Zheng
2026-10-17 18:54 ` Jose A. Perez de Azpillaga
2026-10-19 7:17 ` Qi Zheng
2026-10-16 10:07 ` [PATCH 5/5] mm: hugetlb: enable CMA allocation for PMD-sized pages Qi Zheng
2026-10-17 19:07 ` Jose A. Perez de Azpillaga
2026-10-19 7:32 ` Qi Zheng
2026-10-19 6:50 ` [PATCH 0/5] mm: hugetlb: add CMA support for PMD-sized page Muchun Song
2026-10-19 7:37 ` Qi Zheng
2026-10-19 7:50 ` Muchun Song [this message]
2026-10-19 8:20 ` Jose A. Perez de Azpillaga
2026-10-19 8:43 ` Muchun Song
2026-10-19 9:17 ` Jose A. Perez de Azpillaga
2026-10-19 12:18 ` David Hildenbrand (Arm)
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=BEADD50D-94AA-4B05-B9AD-136E37247FDD@linux.dev \
--to=muchun.song@linux.dev \
--cc=akpm@linux-foundation.org \
--cc=david@kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=osalvador@suse.de \
--cc=qi.zheng@linux.dev \
--cc=zhengqi.arch@bytedance.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox