From: Baolin Wang <baolin.wang@linux.alibaba.com>
To: Kairui Song <ryncsn@gmail.com>
Cc: linux-mm@kvack.org, Andrew Morton <akpm@linux-foundation.org>,
Barry Song <baohua@kernel.org>,
Axel Rasmussen <axelrasmussen@google.com>,
Yuanchu Xie <yuanchu@google.com>, Wei Xu <weixugc@google.com>,
Baoquan He <baoquan.he@linux.dev>,
Shakeel Butt <shakeel.butt@linux.dev>,
Johannes Weiner <hannes@cmpxchg.org>,
Michal Hocko <mhocko@kernel.org>,
Roman Gushchin <roman.gushchin@linux.dev>,
Muchun Song <muchun.song@linux.dev>, Chris Li <chrisl@kernel.org>,
David Hildenbrand <david@kernel.org>,
Lorenzo Stoakes <ljs@kernel.org>,
"Liam R. Howlett" <liam@infradead.org>,
Vlastimil Babka <vbabka@kernel.org>, Yu Zhao <yuzhao@google.com>,
Zi Yan <ziy@nvidia.com>, Qi Zheng <qi.zheng@linux.dev>,
cgroups@vger.kernel.org, linux-kernel@vger.kernel.org
Subject: Re: [PATCH 6/7] mm/mglru: fix potential generation folio number leak
Date: Thu, 20 Aug 2026 16:53:07 +0800 [thread overview]
Message-ID: <43bbc1de-039d-422d-9119-c7392e0229c6@linux.alibaba.com> (raw)
In-Reply-To: <CAMgjq7Bz5Kz0YxFcVwbWV4bh_T4qQH0vZYbxFCXDtLzeX5hjtQ@mail.gmail.com>
On 8/20/26 11:45 AM, Kairui Song wrote:
> On Thu, Aug 20, 2026 at 9:52 AM Baolin Wang
> <baolin.wang@linux.alibaba.com> wrote:
>> On 8/18/26 1:38 PM, Kairui Song via B4 Relay wrote:
>>> From: Kairui Song <kasong@tencent.com>
>>>
>>> Each generation of MGLRU accounts anon and file folio numbers
>>> separately. The page table walker's update_batch_size() derives the
>>> anon / file type of a folio from its current flags, but the page table
>>> walk holds neither the lruvec lock nor the folio lock, so the type can
>>> change during that period.
>>
>> Right.
>>
>>> MADV_FREE's lazyfree path clears PG_swapbacked under the lruvec lock,
>>> so the folio is no longer considered on the anon LRU list. Lazyfreed
>>> folios can also be changed back to the anon list again. If the flip
>>> lands between folio_update_gen()'s cmpxchg and the type read in
>>> update_batch_size(), the batched delta pair is applied to the wrong
>>> type. The anon and file generation counters then carry phantom deltas
>>> that nothing reconciles, permanently skewing lrugen->nr_pages and the
>>> reclaim budgets derived from it.
>>
>> But I think the problem occurs between update_batch_size() and
>> sort_folio(). update_batch_size() only updates the anon or file folio
>> statistics, while sort_folio() moves promoted folios to the
>> corresponding type's list:
>>
>> /* promoted */
>> if (gen != lru_gen_from_seq(lrugen->min_seq[type])) {
>> list_move(&folio->lru, &lrugen->folios[gen][type][zone]);
>> return true;
>> }
>>
>> If the folio's anon/file type changes between these two steps (e.g., a
>> lazyfree folio), it would lead to what you described: "The anon and file
>> generation counters then carry phantom deltas that nothing reconciles,
>> permanently skewing lrugen->nr_pages and the reclaim budgets derived
>> from it."
>
> Actually no, the counters follow eventual consistency (note the word
> "permanently"), we are fine with a drift as long as it will eventually
> be corrected. Lazy promotions creates counter drift from the physical
> location, but that is actually fixed by the sort_folio.
>
> Now, for the type issue, use the lazyfree case as example (I think
> that's actually the only place,), lru_lazyfree will remove the folio
> form lruvec before marking it !PG_swapbacked, so during that removal
> period, the gen bits are zero (folio's gen == -1), so any lazy
> promotion CAS won't touch the counter, and only folio_update_gen will
> do it since folio_inc_gen only handles on list folios. The
> PG_swapbacked clearing in lazyfree only happens on folio wich has gen
> == -1 (off-list). And it makes sense since update PG_swapbacked need
> to update the counter and move the folio.
>
> And if the CAS happends before the list removal, the list removal, the
> folio is on the anon list, so the CAS is moving a folio in the anon
> list, folio_update_gen will call update_batch_size asking it to update
> the anon counters, we are fine after this commit. (Before this commit,
> the CAS is moving a folio in the anon list but update_batch_size may
> occur on file coutners). The list removal will update the anon
> counter, and the subsequent list addition will account for the right
> file counter.
>
> And if the CAS happens after the list add, we are still fine since the
> file counter is charged and sees a file type here.
Thanks for the expalnation. Now I see the problem and I think your are
right.
(This involves the combination of the gen counter and the folio's type,
so it would be better to have a diagram describing the race, otherwise
it's indeed hard to follow.)
next prev parent reply other threads:[~2026-08-20 8:53 UTC|newest]
Thread overview: 34+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-08-18 5:38 [PATCH 0/7] mm/mglru: clean up folio counters and flag usage Kairui Song via B4 Relay
2026-08-18 5:38 ` [PATCH 1/7] mm/memcontrol: make lru_zone_size atomic and simplify sanity check Kairui Song via B4 Relay
2026-08-19 2:05 ` Ridong Chen
2026-08-18 5:38 ` [PATCH 2/7] mm/mglru: introduce helpers for manipulating gen and refs flags Kairui Song via B4 Relay
2026-08-19 9:03 ` Baolin Wang
2026-08-19 9:37 ` Kairui Song
2026-08-19 9:46 ` Baolin Wang
2026-08-19 9:49 ` Kairui Song
2026-08-20 1:43 ` Ridong Chen
2026-08-20 2:04 ` Ridong Chen
2026-08-20 2:05 ` Ridong Chen
2026-08-18 5:38 ` [PATCH 3/7] mm/migrate: copy the referenced state via folio_migrate_refs() Kairui Song via B4 Relay
2026-08-19 10:12 ` Baoquan He
2026-08-20 18:20 ` David Hildenbrand (Arm)
2026-08-18 5:38 ` [PATCH 4/7] mm/mglru: move max_seq read into walk_update_folio Kairui Song via B4 Relay
2026-08-19 9:18 ` Baolin Wang
2026-08-20 2:13 ` Ridong Chen
2026-08-18 5:38 ` [PATCH 5/7] mm/mglru: use explicit tier range in read_ctrl_pos() Kairui Song via B4 Relay
2026-08-19 9:25 ` Baolin Wang
2026-08-19 10:16 ` Baoquan He
2026-08-19 21:24 ` Barry Song
2026-08-20 2:33 ` Ridong Chen
2026-08-20 3:22 ` Kairui Song
2026-08-18 5:38 ` [PATCH 6/7] mm/mglru: fix potential generation folio number leak Kairui Song via B4 Relay
2026-08-20 1:52 ` Baolin Wang
2026-08-20 3:45 ` Kairui Song
2026-08-20 8:53 ` Baolin Wang [this message]
2026-08-20 9:40 ` Kairui Song
2026-08-18 5:38 ` [PATCH 7/7] mm/mglru: improve code readability and harden folio_inc_gen Kairui Song via B4 Relay
2026-08-19 21:30 ` Barry Song
2026-08-20 0:53 ` Baoquan He
2026-08-20 0:57 ` Baoquan He
2026-08-20 1:02 ` Baolin Wang
2026-08-20 2:27 ` Baoquan He
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=43bbc1de-039d-422d-9119-c7392e0229c6@linux.alibaba.com \
--to=baolin.wang@linux.alibaba.com \
--cc=akpm@linux-foundation.org \
--cc=axelrasmussen@google.com \
--cc=baohua@kernel.org \
--cc=baoquan.he@linux.dev \
--cc=cgroups@vger.kernel.org \
--cc=chrisl@kernel.org \
--cc=david@kernel.org \
--cc=hannes@cmpxchg.org \
--cc=liam@infradead.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=ljs@kernel.org \
--cc=mhocko@kernel.org \
--cc=muchun.song@linux.dev \
--cc=qi.zheng@linux.dev \
--cc=roman.gushchin@linux.dev \
--cc=ryncsn@gmail.com \
--cc=shakeel.butt@linux.dev \
--cc=vbabka@kernel.org \
--cc=weixugc@google.com \
--cc=yuanchu@google.com \
--cc=yuzhao@google.com \
--cc=ziy@nvidia.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox