All of lore.kernel.org
 help / color / mirror / Atom feed
From: Lance Yang <lance.yang@linux.dev>
To: luizcap@redhat.com, baolin.wang@linux.alibaba.com
Cc: linux-kernel@vger.kernel.org, linux-mm@kvack.org,
	david@kernel.org, ziy@nvidia.com, lance.yang@linux.dev,
	corbet@lwn.net, tsbogend@alpha.franken.de, maddy@linux.ibm.com,
	mpe@ellerman.id.au, agordeev@linux.ibm.com,
	gerald.schaefer@linux.ibm.com, hca@linux.ibm.com,
	gor@linux.ibm.com, x86@kernel.org, dave.hansen@linux.intel.com,
	djbw@kernel.org, vishal.l.verma@intel.com, dave.jiang@intel.com,
	akpm@linux-foundation.org, lorenzo.stoakes@oracle.com
Subject: Re: (sashiko review) Re: [PATCH v4 6/9] mm: shmem: drop has_transparent_hugepage() usage
Date: Sun, 17 May 2026 21:32:39 +0800	[thread overview]
Message-ID: <20260517133239.26416-1-lance.yang@linux.dev> (raw)
In-Reply-To: <ed33dc0f-fcde-42b3-90aa-c20290b06f49@redhat.com>


On Wed, May 06, 2026 at 02:12:41PM -0400, Luiz Capitulino wrote:
>On 2026-05-01 15:18, Luiz Capitulino wrote:
>> Shmem uses has_transparent_hugepage() in the following ways:
>> 
>> - shmem_parse_one() and shmem_parse_huge(): Check if THP is built-in and
>>    if the CPU supports PMD-sized pages
>> 
>> - shmem_init(): Since the CONFIG_TRANSPARENT_HUGEPAGE guard is outside
>>    the code block calling has_transparent_hugepage(), the
>>    has_transparent_hugepage() call is exclusively checking if the CPU
>>    supports PMD-sized pages
>> 
>> While it's necessary to check if CONFIG_TRANSPARENT_HUGEPAGE is enabled
>> in all cases, shmem can determine mTHP size support at folio allocation
>> time. Therefore, drop has_transparent_hugepage() usage while keeping the
>> CONFIG_TRANSPARENT_HUGEPAGE checks.
>> 
>> Reviewed-by: Baolin Wang <baolin.wang@linux.alibaba.com>
>> Reviewed-by: Lance Yang <lance.yang@linux.dev>
>> Acked-by: Zi Yan <ziy@nvidia.com>
>> Signed-off-by: Luiz Capitulino <luizcap@redhat.com>
>> ---
>>   mm/shmem.c | 7 +++----
>>   1 file changed, 3 insertions(+), 4 deletions(-)
>> 
>> diff --git a/mm/shmem.c b/mm/shmem.c
>> index 3b5dc21b323c..1948d73fb1e3 100644
>> --- a/mm/shmem.c
>> +++ b/mm/shmem.c
>> @@ -689,7 +689,7 @@ static int shmem_parse_huge(const char *str)
>>   	else
>>   		return -EINVAL;
>>   
>> -	if (!has_transparent_hugepage() &&
>> +	if (!IS_ENABLED(CONFIG_TRANSPARENT_HUGEPAGE) &&
>>   	    huge != SHMEM_HUGE_NEVER && huge != SHMEM_HUGE_DENY)
>>   		return -EINVAL;
>>   
>> @@ -4656,8 +4656,7 @@ static int shmem_parse_one(struct fs_context *fc, struct fs_parameter *param)
>>   	case Opt_huge:
>>   		ctx->huge = result.uint_32;
>>   		if (ctx->huge != SHMEM_HUGE_NEVER &&
>> -		    !(IS_ENABLED(CONFIG_TRANSPARENT_HUGEPAGE) &&
>> -		      has_transparent_hugepage()))
>> +		    !IS_ENABLED(CONFIG_TRANSPARENT_HUGEPAGE))
>>   			goto unsupported_parameter;
>>   		ctx->seen |= SHMEM_SEEN_HUGE;
>>   		break;
>
>"""
>By dropping the has_transparent_hugepage() check, will mount -t tmpfs
>-o huge=always now succeed on hardware lacking PMD support?
>
>If so, since hugepage_init() still sets the TRANSPARENT_HUGEPAGE_UNSUPPORTED
>flag, thp_disabled_by_hw() will unconditionally block all large folio
>allocations in shmem_allowable_huge_orders().
>
>Does this create an intermediate state where the mount silently succeeds
>but no huge pages of any size can actually be allocated?
>
>I see this is resolved later in the series by commit cd27430097e8
>("mm: replace thp_disabled_by_hw() with pgtable_has_pmd_leaves()") and
>commit 641a20ae032f ("mm: thp: always enable mTHP support").
>"""
>
>The mount -t tmpfs -o huge=always succeeding on hardware without PMD
>support can happen in this patch, yes. But this seems very minor, the
>impact seems to be someone doing bisection, landing on this patch and
>their reproducer is depedent on mounting tmpfs with -o huge=always on
>hardware without PMD size support? I can fix it if others feel strong
>about this.
>
>> @@ -5449,7 +5448,7 @@ void __init shmem_init(void)
>>   #endif
>>   
>>   #ifdef CONFIG_TRANSPARENT_HUGEPAGE
>> -	if (has_transparent_hugepage() && shmem_huge > SHMEM_HUGE_DENY)
>> +	if (shmem_huge > SHMEM_HUGE_DENY)
>>   		SHMEM_SB(shm_mnt->mnt_sb)->huge = shmem_huge;
>>   	else
>>   		shmem_huge = SHMEM_HUGE_NEVER; /* just in case it was patched */
>
>"""
>Also, by allowing shmem_huge to be set to SHMEM_HUGE_ALWAYS on systems
>without PMD support, does this incorrectly affect shmem_getattr()?
>
>shmem_getattr() relies on shmem_huge_global_enabled(), which only checks
>the software configuration and not hardware PMD support. Consequently,
>shmem_getattr() will erroneously report stat->blksize = HPAGE_PMD_SIZE
>to userspace.
>
>Since subsequent patches in the series do not appear to update
>shmem_getattr(), could this misleading block size cause userspace tools
>to over-allocate IO buffers on hardware where PMD-sized pages are
>structurally impossible?
>"""
>
>This a real issue (albeit small one), the problem is this check in
>shmem_getattr():
>
>	if (shmem_huge_global_enabled(inode, 0, 0, false, NULL, 0))
>		stat->blksize = HPAGE_PMD_SIZE;
>
>So, we may report HPAGE_PMD_SIZE even when PMD size is not supported.
>Looks like we may over-report today as well for the
>SHMEM_HUGE_WITHIN_SIZE case? In any case, I'll fix this.

Well spotted.

@Baolin looks like shmem_getattr() might already be buggy?

shmem_huge_global_enabled() returns an order mask. For huge=always and
huge=within_size it can return THP_ORDERS_ALL_FILE_DEFAULT, which is not
PMD-only and can include smaller file mTHP orders as well ...

So shmem_getattr() treating any non-zero mask as HPAGE_PMD_SIZE looks
like an over-report?

Cheers, Lance


  reply	other threads:[~2026-05-17 13:33 UTC|newest]

Thread overview: 36+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-05-01 19:18 [PATCH v4 0/9] mm: thp: always enable mTHP support Luiz Capitulino
2026-05-01 19:18 ` [PATCH v4 1/9] docs: tmpfs: remove implementation detail reference Luiz Capitulino
2026-05-01 19:18 ` [PATCH v4 2/9] mm: introduce pgtable_has_pmd_leaves() Luiz Capitulino
2026-05-06 17:50   ` (sashiko review) " Luiz Capitulino
2026-05-13 15:30   ` David Hildenbrand (Arm)
2026-05-14  1:52     ` Luiz Capitulino
2026-05-17 12:03       ` Lance Yang
2026-05-19 13:10         ` Luiz Capitulino
2026-05-13 15:36   ` David Hildenbrand (Arm)
2026-05-14  2:18     ` Luiz Capitulino
2026-05-17 12:41       ` Lance Yang
2026-05-19 13:14         ` Luiz Capitulino
2026-05-01 19:18 ` [PATCH v4 3/9] drivers: dax: use pgtable_has_pmd_leaves() Luiz Capitulino
2026-05-13 15:40   ` David Hildenbrand (Arm)
2026-05-14  2:25     ` Luiz Capitulino
2026-05-01 19:18 ` [PATCH v4 4/9] drivers: nvdimm: " Luiz Capitulino
2026-05-01 19:18 ` [PATCH v4 5/9] mm: debug_vm_pgtable: " Luiz Capitulino
2026-05-01 19:18 ` [PATCH v4 6/9] mm: shmem: drop has_transparent_hugepage() usage Luiz Capitulino
2026-05-06 18:12   ` (sashiko review) " Luiz Capitulino
2026-05-17 13:32     ` Lance Yang [this message]
2026-05-18  3:47       ` Baolin Wang
2026-05-18  5:00         ` Lance Yang
2026-05-01 19:18 ` [PATCH v4 7/9] treewide: introduce arch_has_pmd_leaves() Luiz Capitulino
2026-05-06 18:22   ` (sashiko review) " Luiz Capitulino
2026-05-06 18:30     ` Luiz Capitulino
2026-05-01 19:18 ` [PATCH v4 8/9] mm: replace thp_disabled_by_hw() with pgtable_has_pmd_leaves() Luiz Capitulino
2026-05-13 15:50   ` David Hildenbrand (Arm)
2026-05-01 19:18 ` [PATCH v4 9/9] mm: thp: always enable mTHP support Luiz Capitulino
2026-05-06  5:46   ` Baolin Wang
2026-05-06 18:34   ` (sashiko review) " Luiz Capitulino
2026-05-13 15:58   ` David Hildenbrand (Arm)
2026-05-14  1:14     ` Baolin Wang
2026-05-03 15:02 ` [PATCH v4 0/9] " Andrew Morton
2026-05-04 19:11   ` Luiz Capitulino
2026-05-14  6:35 ` Lorenzo Stoakes
2026-05-14 12:14   ` Luiz Capitulino

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20260517133239.26416-1-lance.yang@linux.dev \
    --to=lance.yang@linux.dev \
    --cc=agordeev@linux.ibm.com \
    --cc=akpm@linux-foundation.org \
    --cc=baolin.wang@linux.alibaba.com \
    --cc=corbet@lwn.net \
    --cc=dave.hansen@linux.intel.com \
    --cc=dave.jiang@intel.com \
    --cc=david@kernel.org \
    --cc=djbw@kernel.org \
    --cc=gerald.schaefer@linux.ibm.com \
    --cc=gor@linux.ibm.com \
    --cc=hca@linux.ibm.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=lorenzo.stoakes@oracle.com \
    --cc=luizcap@redhat.com \
    --cc=maddy@linux.ibm.com \
    --cc=mpe@ellerman.id.au \
    --cc=tsbogend@alpha.franken.de \
    --cc=vishal.l.verma@intel.com \
    --cc=x86@kernel.org \
    --cc=ziy@nvidia.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.