public inbox for linux-kernel@vger.kernel.org
 help / color / mirror / Atom feed
From: Kairui Song <ryncsn@gmail.com>
To: Shakeel Butt <shakeel.butt@linux.dev>
Cc: Baolin Wang <baolin.wang@linux.alibaba.com>,
	akpm@linux-foundation.org,  hannes@cmpxchg.org, david@kernel.org,
	mhocko@kernel.org, zhengqi.arch@bytedance.com,
	 axelrasmussen@google.com, yuanchu@google.com,
	weixugc@google.com, ljs@kernel.org,  baohua@kernel.org,
	kasong@tencent.com, linux-mm@kvack.org,
	 linux-kernel@vger.kernel.org,
	Jingxiang Zeng <linuszeng@tencent.com>
Subject: Re: [PATCH] mm: vmscan: fix dirty folios throttling on cgroup v1 for MGLRU
Date: Thu, 2 Apr 2026 10:44:20 +0800	[thread overview]
Message-ID: <ac3Pqq2WrGTJZLB_@KASONG-MC4> (raw)
In-Reply-To: <ac18iLvF-nNtxk1-@linux.dev>

On Wed, Apr 01, 2026 at 01:32:40PM +0800, Shakeel Butt wrote:
> On Fri, Mar 27, 2026 at 06:21:08PM +0800, Baolin Wang wrote:
> > The balance_dirty_pages() won't do the dirty folios throttling on cgroupv1.
> > See commit 9badce000e2c ("cgroup, writeback: don't enable cgroup writeback
> > on traditional hierarchies").
> > 
> > Moreover, after commit 6b0dfabb3555 ("fs: Remove aops->writepage"), we no
> > longer attempt to write back filesystem folios through reclaim.
> > 
> > On large memory systems, the flusher may not be able to write back quickly
> > enough. Consequently, MGLRU will encounter many folios that are already
> > under writeback. Since we cannot reclaim these dirty folios, the system
> > may run out of memory and trigger the OOM killer.
> > 
> > Hence, for cgroup v1, let's throttle reclaim after waking up the flusher,
> > which is similar to commit 81a70c21d917 ("mm/cgroup/reclaim: fix dirty
> > pages throttling on cgroup v1"), to avoid unnecessary OOM.
> > 
> > The following test program can easily reproduce the OOM issue. With this patch
> > applied, the test passes successfully.
> > 
> > $mkdir /sys/fs/cgroup/memory/test
> > $echo 256M > /sys/fs/cgroup/memory/test/memory.limit_in_bytes
> > $echo $$ > /sys/fs/cgroup/memory/test/cgroup.procs
> > $dd if=/dev/zero of=/mnt/data.bin bs=1M count=800
> > 
> > Fixes: ac35a4902374 ("mm: multi-gen LRU: minimal implementation")
> > Reviewed-by: Barry Song <baohua@kernel.org>
> > Reviewed-by: Kairui Song <kasong@tencent.com>
> > Signed-off-by: Baolin Wang <baolin.wang@linux.alibaba.com>
> > ---
> > Changes from RFC:
> >  - Add the Fixes tag.
> >  - Add reviewed tag from Barry and Kairui. Thanks.
> > ---
> >  mm/vmscan.c | 17 ++++++++++++++++-
> >  1 file changed, 16 insertions(+), 1 deletion(-)
> > 
> > diff --git a/mm/vmscan.c b/mm/vmscan.c
> > index 46657d2cef42..b5fdad1444af 100644
> > --- a/mm/vmscan.c
> > +++ b/mm/vmscan.c
> > @@ -5036,9 +5036,24 @@ static bool try_to_shrink_lruvec(struct lruvec *lruvec, struct scan_control *sc)
> >  	 * If too many file cache in the coldest generation can't be evicted
> >  	 * due to being dirty, wake up the flusher.
> >  	 */
> > -	if (sc->nr.unqueued_dirty && sc->nr.unqueued_dirty == sc->nr.file_taken)
> > +	if (sc->nr.unqueued_dirty && sc->nr.unqueued_dirty == sc->nr.file_taken) {
> > +		struct pglist_data *pgdat = lruvec_pgdat(lruvec);
> > +
> >  		wakeup_flusher_threads(WB_REASON_VMSCAN);
> >  
> > +		/*
> > +		 * For cgroupv1 dirty throttling is achieved by waking up
> > +		 * the kernel flusher here and later waiting on folios
> > +		 * which are in writeback to finish (see shrink_folio_list()).
> > +		 *
> > +		 * Flusher may not be able to issue writeback quickly
> > +		 * enough for cgroupv1 writeback throttling to work
> > +		 * on a large system.
> > +		 */
> > +		if (!writeback_throttling_sane(sc))
> > +			reclaim_throttle(pgdat, VMSCAN_THROTTLE_WRITEBACK);
> 
> This seems fine but note that this throttling is not really the same as the
> throttling happening for traditional LRU. In traditional LRU, the kernel may
> throttle much more due to throttling check happening at each batch within
> shrink_inactive_list() while here the check is happening after full scan for the
> given memcg's lruvec. So, throttling can be much more aggressive for traditional
> LRU.

Right, I think Baolin's fix is great, but to improve the whole trottling
mechanism we need some rework for MGLRU, currently I posted another
series for this.

> 
> This is v1 only and I don't care much but what is stopping you from moving away
> from v1?

For example memsw?

https://lore.kernel.org/linux-mm/q2x4drxpjbxcxgns6bjp446ynsxgl32ckcljqcol7posds4nit@3n3tjq35anvb/

I remember Jingxiang's plan is to improve the page counter first.

  reply	other threads:[~2026-04-02  2:44 UTC|newest]

Thread overview: 10+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-03-27 10:21 [PATCH] mm: vmscan: fix dirty folios throttling on cgroup v1 for MGLRU Baolin Wang
2026-03-27 15:30 ` Andrew Morton
2026-03-28  2:38   ` Baolin Wang
2026-03-27 16:41 ` Johannes Weiner
2026-03-27 17:59   ` Kairui Song
2026-04-01 20:32 ` Shakeel Butt
2026-04-02  2:44   ` Kairui Song [this message]
2026-04-02  2:51     ` Baolin Wang
2026-04-02  3:23       ` Shakeel Butt
2026-04-02  3:35         ` Baolin Wang

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=ac3Pqq2WrGTJZLB_@KASONG-MC4 \
    --to=ryncsn@gmail.com \
    --cc=akpm@linux-foundation.org \
    --cc=axelrasmussen@google.com \
    --cc=baohua@kernel.org \
    --cc=baolin.wang@linux.alibaba.com \
    --cc=david@kernel.org \
    --cc=hannes@cmpxchg.org \
    --cc=kasong@tencent.com \
    --cc=linuszeng@tencent.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=ljs@kernel.org \
    --cc=mhocko@kernel.org \
    --cc=shakeel.butt@linux.dev \
    --cc=weixugc@google.com \
    --cc=yuanchu@google.com \
    --cc=zhengqi.arch@bytedance.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox