Linux cgroups development
 help / color / mirror / Atom feed
From: Baolin Wang <baolin.wang@linux.alibaba.com>
To: Kairui Song <ryncsn@gmail.com>
Cc: linux-mm@kvack.org, Andrew Morton <akpm@linux-foundation.org>,
	Barry Song <baohua@kernel.org>,
	Axel Rasmussen <axelrasmussen@google.com>,
	Yuanchu Xie <yuanchu@google.com>, Wei Xu <weixugc@google.com>,
	Baoquan He <baoquan.he@linux.dev>,
	Shakeel Butt <shakeel.butt@linux.dev>,
	Johannes Weiner <hannes@cmpxchg.org>,
	Michal Hocko <mhocko@kernel.org>,
	Roman Gushchin <roman.gushchin@linux.dev>,
	Muchun Song <muchun.song@linux.dev>, Chris Li <chrisl@kernel.org>,
	David Hildenbrand <david@kernel.org>,
	Lorenzo Stoakes <ljs@kernel.org>,
	"Liam R. Howlett" <liam@infradead.org>,
	Vlastimil Babka <vbabka@kernel.org>, Yu Zhao <yuzhao@google.com>,
	Zi Yan <ziy@nvidia.com>, Qi Zheng <qi.zheng@linux.dev>,
	cgroups@vger.kernel.org, linux-kernel@vger.kernel.org
Subject: Re: [PATCH 6/7] mm/mglru: fix potential generation folio number leak
Date: Thu, 20 Aug 2026 16:53:07 +0800	[thread overview]
Message-ID: <43bbc1de-039d-422d-9119-c7392e0229c6@linux.alibaba.com> (raw)
In-Reply-To: <CAMgjq7Bz5Kz0YxFcVwbWV4bh_T4qQH0vZYbxFCXDtLzeX5hjtQ@mail.gmail.com>



On 8/20/26 11:45 AM, Kairui Song wrote:
> On Thu, Aug 20, 2026 at 9:52 AM Baolin Wang
> <baolin.wang@linux.alibaba.com> wrote:
>> On 8/18/26 1:38 PM, Kairui Song via B4 Relay wrote:
>>> From: Kairui Song <kasong@tencent.com>
>>>
>>> Each generation of MGLRU accounts anon and file folio numbers
>>> separately. The page table walker's update_batch_size() derives the
>>> anon / file type of a folio from its current flags, but the page table
>>> walk holds neither the lruvec lock nor the folio lock, so the type can
>>> change during that period.
>>
>> Right.
>>
>>> MADV_FREE's lazyfree path clears PG_swapbacked under the lruvec lock,
>>> so the folio is no longer considered on the anon LRU list. Lazyfreed
>>> folios can also be changed back to the anon list again. If the flip
>>> lands between folio_update_gen()'s cmpxchg and the type read in
>>> update_batch_size(), the batched delta pair is applied to the wrong
>>> type. The anon and file generation counters then carry phantom deltas
>>> that nothing reconciles, permanently skewing lrugen->nr_pages and the
>>> reclaim budgets derived from it.
>>
>> But I think the problem occurs between update_batch_size() and
>> sort_folio(). update_batch_size() only updates the anon or file folio
>> statistics, while sort_folio() moves promoted folios to the
>> corresponding type's list:
>>
>> /* promoted */
>> if (gen != lru_gen_from_seq(lrugen->min_seq[type])) {
>>          list_move(&folio->lru, &lrugen->folios[gen][type][zone]);
>>          return true;
>> }
>>
>> If the folio's anon/file type changes between these two steps (e.g., a
>> lazyfree folio), it would lead to what you described: "The anon and file
>> generation counters then carry phantom deltas that nothing reconciles,
>> permanently skewing lrugen->nr_pages and the reclaim budgets derived
>> from it."
> 
> Actually no, the counters follow eventual consistency (note the word
> "permanently"), we are fine with a drift as long as it will eventually
> be corrected. Lazy promotions creates counter drift from the physical
> location, but that is actually fixed by the sort_folio.
> 
> Now, for the type issue, use the lazyfree case as example (I think
> that's actually the only place,), lru_lazyfree will remove the folio
> form lruvec before marking it !PG_swapbacked, so during that removal
> period, the gen bits are zero (folio's gen == -1), so any lazy
> promotion CAS won't touch the counter, and only folio_update_gen will
> do it since folio_inc_gen only handles on list folios. The
> PG_swapbacked clearing in lazyfree only happens on folio wich has gen
> == -1 (off-list). And it makes sense since update PG_swapbacked need
> to update the counter and move the folio.
> 
> And if the CAS happends before the list removal, the list removal, the
> folio is on the anon list, so the CAS is moving a folio in the anon
> list, folio_update_gen will call update_batch_size asking it to update
> the anon counters, we are fine after this commit. (Before this commit,
> the CAS is moving a folio in the anon list but update_batch_size may
> occur on file coutners). The list removal will update the anon
> counter, and the subsequent list addition will account for the right
> file counter.
> 
> And if the CAS happens after the list add, we are still fine since the
> file counter is charged and sees a file type here.

Thanks for the expalnation. Now I see the problem and I think your are 
right.

(This involves the combination of the gen counter and the folio's type, 
so it would be better to have a diagram describing the race, otherwise 
it's indeed hard to follow.)

  reply	other threads:[~2026-08-20  8:53 UTC|newest]

Thread overview: 34+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-08-18  5:38 [PATCH 0/7] mm/mglru: clean up folio counters and flag usage Kairui Song via B4 Relay
2026-08-18  5:38 ` [PATCH 1/7] mm/memcontrol: make lru_zone_size atomic and simplify sanity check Kairui Song via B4 Relay
2026-08-19  2:05   ` Ridong Chen
2026-08-18  5:38 ` [PATCH 2/7] mm/mglru: introduce helpers for manipulating gen and refs flags Kairui Song via B4 Relay
2026-08-19  9:03   ` Baolin Wang
2026-08-19  9:37     ` Kairui Song
2026-08-19  9:46       ` Baolin Wang
2026-08-19  9:49         ` Kairui Song
2026-08-20  1:43   ` Ridong Chen
2026-08-20  2:04     ` Ridong Chen
2026-08-20  2:05     ` Ridong Chen
2026-08-18  5:38 ` [PATCH 3/7] mm/migrate: copy the referenced state via folio_migrate_refs() Kairui Song via B4 Relay
2026-08-19 10:12   ` Baoquan He
2026-08-20 18:20   ` David Hildenbrand (Arm)
2026-08-18  5:38 ` [PATCH 4/7] mm/mglru: move max_seq read into walk_update_folio Kairui Song via B4 Relay
2026-08-19  9:18   ` Baolin Wang
2026-08-20  2:13   ` Ridong Chen
2026-08-18  5:38 ` [PATCH 5/7] mm/mglru: use explicit tier range in read_ctrl_pos() Kairui Song via B4 Relay
2026-08-19  9:25   ` Baolin Wang
2026-08-19 10:16   ` Baoquan He
2026-08-19 21:24   ` Barry Song
2026-08-20  2:33   ` Ridong Chen
2026-08-20  3:22     ` Kairui Song
2026-08-18  5:38 ` [PATCH 6/7] mm/mglru: fix potential generation folio number leak Kairui Song via B4 Relay
2026-08-20  1:52   ` Baolin Wang
2026-08-20  3:45     ` Kairui Song
2026-08-20  8:53       ` Baolin Wang [this message]
2026-08-20  9:40         ` Kairui Song
2026-08-18  5:38 ` [PATCH 7/7] mm/mglru: improve code readability and harden folio_inc_gen Kairui Song via B4 Relay
2026-08-19 21:30   ` Barry Song
2026-08-20  0:53   ` Baoquan He
2026-08-20  0:57     ` Baoquan He
2026-08-20  1:02       ` Baolin Wang
2026-08-20  2:27         ` Baoquan He

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=43bbc1de-039d-422d-9119-c7392e0229c6@linux.alibaba.com \
    --to=baolin.wang@linux.alibaba.com \
    --cc=akpm@linux-foundation.org \
    --cc=axelrasmussen@google.com \
    --cc=baohua@kernel.org \
    --cc=baoquan.he@linux.dev \
    --cc=cgroups@vger.kernel.org \
    --cc=chrisl@kernel.org \
    --cc=david@kernel.org \
    --cc=hannes@cmpxchg.org \
    --cc=liam@infradead.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=ljs@kernel.org \
    --cc=mhocko@kernel.org \
    --cc=muchun.song@linux.dev \
    --cc=qi.zheng@linux.dev \
    --cc=roman.gushchin@linux.dev \
    --cc=ryncsn@gmail.com \
    --cc=shakeel.butt@linux.dev \
    --cc=vbabka@kernel.org \
    --cc=weixugc@google.com \
    --cc=yuanchu@google.com \
    --cc=yuzhao@google.com \
    --cc=ziy@nvidia.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox