From: Lance Yang <lance.yang@linux.dev>
To: luizcap@redhat.com, baolin.wang@linux.alibaba.com
Cc: linux-kernel@vger.kernel.org, linux-mm@kvack.org,
david@kernel.org, ziy@nvidia.com, lance.yang@linux.dev,
corbet@lwn.net, tsbogend@alpha.franken.de, maddy@linux.ibm.com,
mpe@ellerman.id.au, agordeev@linux.ibm.com,
gerald.schaefer@linux.ibm.com, hca@linux.ibm.com,
gor@linux.ibm.com, x86@kernel.org, dave.hansen@linux.intel.com,
djbw@kernel.org, vishal.l.verma@intel.com, dave.jiang@intel.com,
akpm@linux-foundation.org, lorenzo.stoakes@oracle.com
Subject: Re: (sashiko review) Re: [PATCH v4 6/9] mm: shmem: drop has_transparent_hugepage() usage
Date: Sun, 17 May 2026 21:32:39 +0800 [thread overview]
Message-ID: <20260517133239.26416-1-lance.yang@linux.dev> (raw)
In-Reply-To: <ed33dc0f-fcde-42b3-90aa-c20290b06f49@redhat.com>
On Wed, May 06, 2026 at 02:12:41PM -0400, Luiz Capitulino wrote:
>On 2026-05-01 15:18, Luiz Capitulino wrote:
>> Shmem uses has_transparent_hugepage() in the following ways:
>>
>> - shmem_parse_one() and shmem_parse_huge(): Check if THP is built-in and
>> if the CPU supports PMD-sized pages
>>
>> - shmem_init(): Since the CONFIG_TRANSPARENT_HUGEPAGE guard is outside
>> the code block calling has_transparent_hugepage(), the
>> has_transparent_hugepage() call is exclusively checking if the CPU
>> supports PMD-sized pages
>>
>> While it's necessary to check if CONFIG_TRANSPARENT_HUGEPAGE is enabled
>> in all cases, shmem can determine mTHP size support at folio allocation
>> time. Therefore, drop has_transparent_hugepage() usage while keeping the
>> CONFIG_TRANSPARENT_HUGEPAGE checks.
>>
>> Reviewed-by: Baolin Wang <baolin.wang@linux.alibaba.com>
>> Reviewed-by: Lance Yang <lance.yang@linux.dev>
>> Acked-by: Zi Yan <ziy@nvidia.com>
>> Signed-off-by: Luiz Capitulino <luizcap@redhat.com>
>> ---
>> mm/shmem.c | 7 +++----
>> 1 file changed, 3 insertions(+), 4 deletions(-)
>>
>> diff --git a/mm/shmem.c b/mm/shmem.c
>> index 3b5dc21b323c..1948d73fb1e3 100644
>> --- a/mm/shmem.c
>> +++ b/mm/shmem.c
>> @@ -689,7 +689,7 @@ static int shmem_parse_huge(const char *str)
>> else
>> return -EINVAL;
>>
>> - if (!has_transparent_hugepage() &&
>> + if (!IS_ENABLED(CONFIG_TRANSPARENT_HUGEPAGE) &&
>> huge != SHMEM_HUGE_NEVER && huge != SHMEM_HUGE_DENY)
>> return -EINVAL;
>>
>> @@ -4656,8 +4656,7 @@ static int shmem_parse_one(struct fs_context *fc, struct fs_parameter *param)
>> case Opt_huge:
>> ctx->huge = result.uint_32;
>> if (ctx->huge != SHMEM_HUGE_NEVER &&
>> - !(IS_ENABLED(CONFIG_TRANSPARENT_HUGEPAGE) &&
>> - has_transparent_hugepage()))
>> + !IS_ENABLED(CONFIG_TRANSPARENT_HUGEPAGE))
>> goto unsupported_parameter;
>> ctx->seen |= SHMEM_SEEN_HUGE;
>> break;
>
>"""
>By dropping the has_transparent_hugepage() check, will mount -t tmpfs
>-o huge=always now succeed on hardware lacking PMD support?
>
>If so, since hugepage_init() still sets the TRANSPARENT_HUGEPAGE_UNSUPPORTED
>flag, thp_disabled_by_hw() will unconditionally block all large folio
>allocations in shmem_allowable_huge_orders().
>
>Does this create an intermediate state where the mount silently succeeds
>but no huge pages of any size can actually be allocated?
>
>I see this is resolved later in the series by commit cd27430097e8
>("mm: replace thp_disabled_by_hw() with pgtable_has_pmd_leaves()") and
>commit 641a20ae032f ("mm: thp: always enable mTHP support").
>"""
>
>The mount -t tmpfs -o huge=always succeeding on hardware without PMD
>support can happen in this patch, yes. But this seems very minor, the
>impact seems to be someone doing bisection, landing on this patch and
>their reproducer is depedent on mounting tmpfs with -o huge=always on
>hardware without PMD size support? I can fix it if others feel strong
>about this.
>
>> @@ -5449,7 +5448,7 @@ void __init shmem_init(void)
>> #endif
>>
>> #ifdef CONFIG_TRANSPARENT_HUGEPAGE
>> - if (has_transparent_hugepage() && shmem_huge > SHMEM_HUGE_DENY)
>> + if (shmem_huge > SHMEM_HUGE_DENY)
>> SHMEM_SB(shm_mnt->mnt_sb)->huge = shmem_huge;
>> else
>> shmem_huge = SHMEM_HUGE_NEVER; /* just in case it was patched */
>
>"""
>Also, by allowing shmem_huge to be set to SHMEM_HUGE_ALWAYS on systems
>without PMD support, does this incorrectly affect shmem_getattr()?
>
>shmem_getattr() relies on shmem_huge_global_enabled(), which only checks
>the software configuration and not hardware PMD support. Consequently,
>shmem_getattr() will erroneously report stat->blksize = HPAGE_PMD_SIZE
>to userspace.
>
>Since subsequent patches in the series do not appear to update
>shmem_getattr(), could this misleading block size cause userspace tools
>to over-allocate IO buffers on hardware where PMD-sized pages are
>structurally impossible?
>"""
>
>This a real issue (albeit small one), the problem is this check in
>shmem_getattr():
>
> if (shmem_huge_global_enabled(inode, 0, 0, false, NULL, 0))
> stat->blksize = HPAGE_PMD_SIZE;
>
>So, we may report HPAGE_PMD_SIZE even when PMD size is not supported.
>Looks like we may over-report today as well for the
>SHMEM_HUGE_WITHIN_SIZE case? In any case, I'll fix this.
Well spotted.
@Baolin looks like shmem_getattr() might already be buggy?
shmem_huge_global_enabled() returns an order mask. For huge=always and
huge=within_size it can return THP_ORDERS_ALL_FILE_DEFAULT, which is not
PMD-only and can include smaller file mTHP orders as well ...
So shmem_getattr() treating any non-zero mask as HPAGE_PMD_SIZE looks
like an over-report?
Cheers, Lance
next prev parent reply other threads:[~2026-05-17 13:33 UTC|newest]
Thread overview: 36+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-05-01 19:18 [PATCH v4 0/9] mm: thp: always enable mTHP support Luiz Capitulino
2026-05-01 19:18 ` [PATCH v4 1/9] docs: tmpfs: remove implementation detail reference Luiz Capitulino
2026-05-01 19:18 ` [PATCH v4 2/9] mm: introduce pgtable_has_pmd_leaves() Luiz Capitulino
2026-05-06 17:50 ` (sashiko review) " Luiz Capitulino
2026-05-13 15:30 ` David Hildenbrand (Arm)
2026-05-14 1:52 ` Luiz Capitulino
2026-05-17 12:03 ` Lance Yang
2026-05-19 13:10 ` Luiz Capitulino
2026-05-13 15:36 ` David Hildenbrand (Arm)
2026-05-14 2:18 ` Luiz Capitulino
2026-05-17 12:41 ` Lance Yang
2026-05-19 13:14 ` Luiz Capitulino
2026-05-01 19:18 ` [PATCH v4 3/9] drivers: dax: use pgtable_has_pmd_leaves() Luiz Capitulino
2026-05-13 15:40 ` David Hildenbrand (Arm)
2026-05-14 2:25 ` Luiz Capitulino
2026-05-01 19:18 ` [PATCH v4 4/9] drivers: nvdimm: " Luiz Capitulino
2026-05-01 19:18 ` [PATCH v4 5/9] mm: debug_vm_pgtable: " Luiz Capitulino
2026-05-01 19:18 ` [PATCH v4 6/9] mm: shmem: drop has_transparent_hugepage() usage Luiz Capitulino
2026-05-06 18:12 ` (sashiko review) " Luiz Capitulino
2026-05-17 13:32 ` Lance Yang [this message]
2026-05-18 3:47 ` Baolin Wang
2026-05-18 5:00 ` Lance Yang
2026-05-01 19:18 ` [PATCH v4 7/9] treewide: introduce arch_has_pmd_leaves() Luiz Capitulino
2026-05-06 18:22 ` (sashiko review) " Luiz Capitulino
2026-05-06 18:30 ` Luiz Capitulino
2026-05-01 19:18 ` [PATCH v4 8/9] mm: replace thp_disabled_by_hw() with pgtable_has_pmd_leaves() Luiz Capitulino
2026-05-13 15:50 ` David Hildenbrand (Arm)
2026-05-01 19:18 ` [PATCH v4 9/9] mm: thp: always enable mTHP support Luiz Capitulino
2026-05-06 5:46 ` Baolin Wang
2026-05-06 18:34 ` (sashiko review) " Luiz Capitulino
2026-05-13 15:58 ` David Hildenbrand (Arm)
2026-05-14 1:14 ` Baolin Wang
2026-05-03 15:02 ` [PATCH v4 0/9] " Andrew Morton
2026-05-04 19:11 ` Luiz Capitulino
2026-05-14 6:35 ` Lorenzo Stoakes
2026-05-14 12:14 ` Luiz Capitulino
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20260517133239.26416-1-lance.yang@linux.dev \
--to=lance.yang@linux.dev \
--cc=agordeev@linux.ibm.com \
--cc=akpm@linux-foundation.org \
--cc=baolin.wang@linux.alibaba.com \
--cc=corbet@lwn.net \
--cc=dave.hansen@linux.intel.com \
--cc=dave.jiang@intel.com \
--cc=david@kernel.org \
--cc=djbw@kernel.org \
--cc=gerald.schaefer@linux.ibm.com \
--cc=gor@linux.ibm.com \
--cc=hca@linux.ibm.com \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=lorenzo.stoakes@oracle.com \
--cc=luizcap@redhat.com \
--cc=maddy@linux.ibm.com \
--cc=mpe@ellerman.id.au \
--cc=tsbogend@alpha.franken.de \
--cc=vishal.l.verma@intel.com \
--cc=x86@kernel.org \
--cc=ziy@nvidia.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox