From: Qi Zheng <qi.zheng@linux.dev>
To: Baolin Wang <baolin.wang@linux.alibaba.com>,
hughd@google.com, akpm@linux-foundation.org,
usama.arif@linux.dev
Cc: linux-mm@kvack.org, linux-kernel@vger.kernel.org,
Qi Zheng <zhengqi.arch@bytedance.com>
Subject: Re: [PATCH] mm: shmem: make unused huge shrinker memcg aware
Date: Wed, 15 Jul 2026 17:55:17 +0800 [thread overview]
Message-ID: <ac0cd32c-8255-41c6-9814-22a02aa50dbf@linux.dev> (raw)
In-Reply-To: <7624107f-6a2d-4959-b2ee-aa362a8972eb@linux.alibaba.com>
Hi Baolin,
On 7/15/26 5:37 PM, Baolin Wang wrote:
> Hi Qi,
>
> On 7/14/26 11:19 AM, Qi Zheng wrote:
>> From: Qi Zheng <zhengqi.arch@bytedance.com>
>>
>> The shmem unused huge shrinker keeps a per-superblock list of inodes
>> whose
>> tail huge folio extends beyond i_size. Since that list is not memcg
>> aware,
>> reclaim triggered by one memcg can scan inodes from the whole superblock
>> and split shmem huge folios charged to unrelated memcgs.
>>
>> Convert the shrink list to a memcg-aware list_lru. Queue each inode on
>> the
>> list_lru sublist matching the memcg and node of the current tail huge
>> folio, so non-root memcg reclaim only walks candidates charged to the
>> reclaiming memcg. Global reclaim, root memcg reclaim and shmem quota
>> reclaim keep global semantics.
>>
>> The list_lru still tracks inodes while the actual split target is the
>> current tail huge folio, so validate the folio memcg/node during scan. If
>> the folio no longer matches the reclaim context or splitting cannot
>> proceed, requeue the inode according to the current tail folio; if the
>> inode is no longer shrinkable, drop the scan entry.
>>
>> This can be tested with the shrinker debugfs interface by allocating 32
>> tmpfs tail THPs in each of two memcgs, then scanning the sb-tmpfs
>> shrinker
>> with memcg A's cgroup id:
>>
>> before A scan after A scan
>> base A=64M, B=64M A=0, B=0
>> patched A=64M, B=64M A=0, B=64M
>>
>> Signed-off-by: Qi Zheng <zhengqi.arch@bytedance.com>
>> ---
>
> Thanks for your patch. This work has been on my TODO list for a while :)
>
> Overall it looks good. I'll take a closer look and run some tests.
Thanks!
>
>> This patch is based on next-20260701 because it doesn't include this
>> patch:
>>
>> https://lore.kernel.org/all/20260609123047.1948242-1-
>> usama.arif@linux.dev/
>>
>> Later on, Usama will consider moving this restriction down into the fs
>> callback.
>>
>> include/linux/shmem_fs.h | 14 +-
>> mm/shmem.c | 379 ++++++++++++++++++++++++++++++---------
>> 2 files changed, 310 insertions(+), 83 deletions(-)
>>
>> diff --git a/include/linux/shmem_fs.h b/include/linux/shmem_fs.h
>> index e729b9b0e38d4..0b14de1e890a9 100644
>> --- a/include/linux/shmem_fs.h
>> +++ b/include/linux/shmem_fs.h
>> @@ -11,6 +11,7 @@
>> #include <linux/fs_parser.h>
>> #include <linux/userfaultfd_k.h>
>> #include <linux/bits.h>
>> +#include <linux/list_lru.h>
>> struct swap_iocb;
>> @@ -56,6 +57,13 @@ struct shmem_inode_info {
>> struct dquot __rcu *i_dquot[MAXQUOTAS];
>> #endif
>> struct inode vfs_inode;
>> +
>> +#ifdef CONFIG_TRANSPARENT_HUGEPAGE
>> + struct list_head shrinklist_scan;
>
> Why introduce another list_head member? Why can't we reuse 'shrinklist'
> in this structure? In other words, if we isolate this inode from
> list_lru, then 'inode_info->shrinklist' can be reused to link it into
> the temporary list, right?
After list_lru isolation, the shrinker drops the list_lru lock and
processes the inode on a local scan list. During that time, shmem
faults can make the inode's current tail huge folio change, and
shmem_unused_huge_add() may need to queue the same inode again on
the active list_lru, possibly under a different memcg/node sublist.
If we reused info->shrinklist for the temporary scan list, then while
the inode is being scanned:
1. info->shrinklist would be non-empty because it is on the local scan
list, so shmem_unused_huge_add() could not tell that the inode is no
longer on the active list_lru.
2. Re-adding it to list_lru with the same list_head would corrupt the
local scan list.
3. Skipping the add would lose the new current tail huge folio if the
scan later drops the old scan entry instead of requeueing it.
So isolation removes the inode from the active list_lru and leaves
info->shrinklist empty. A concurrent fault can safely add the inode back
to the active list_lru with the current folio's memcg/node, while the
shrinker still owns the old scan entry through shrinklist_scan. The scan
loop then detects that re-add and drops the stale scan entry, leaving
the active entry for a later scan.
>
>> + struct mem_cgroup *shrinklist_memcg;
>> + int shrinklist_nid;
>> + bool shrinklist_isolated;
>
> Do we need an extra bool to indicate whether it's isolated? Can't we
> just use 'list_empty(inode_info->shrinklist)'? I may have missed some
> details.
list_empty(info->shrinklist) cannot be used for this. That list node
tracks active list_lru membership only. But you are right that the
explicit bool is not necessary, we can use
list_empty(&info->shrinklist_scan) instead.
Thanks,
Qi
prev parent reply other threads:[~2026-07-15 9:55 UTC|newest]
Thread overview: 5+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-07-14 3:19 [PATCH] mm: shmem: make unused huge shrinker memcg aware Qi Zheng
2026-07-15 4:32 ` Andrew Morton
2026-07-15 6:49 ` Qi Zheng
2026-07-15 9:37 ` Baolin Wang
2026-07-15 9:55 ` Qi Zheng [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=ac0cd32c-8255-41c6-9814-22a02aa50dbf@linux.dev \
--to=qi.zheng@linux.dev \
--cc=akpm@linux-foundation.org \
--cc=baolin.wang@linux.alibaba.com \
--cc=hughd@google.com \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=usama.arif@linux.dev \
--cc=zhengqi.arch@bytedance.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox