From: Johannes Weiner <hannes@cmpxchg.org>
To: Hao Jia <jiahao.kernel@gmail.com>
Cc: Yosry Ahmed <yosry@kernel.org>,
akpm@linux-foundation.org, tj@kernel.org, shakeel.butt@linux.dev,
mhocko@kernel.org, mkoutny@suse.com, nphamcs@gmail.com,
chengming.zhou@linux.dev, muchun.song@linux.dev,
roman.gushchin@linux.dev, linux-mm@kvack.org,
linux-kernel@vger.kernel.org, linux-doc@vger.kernel.org,
Hao Jia <jiahao1@lixiang.com>
Subject: Re: [PATCH v2 2/2] mm/zswap: Support batch writeback in shrink_memcg()
Date: Fri, 24 Jul 2026 14:40:59 -0400 [thread overview]
Message-ID: <amOxu56ibbhKP8qJ@cmpxchg.org> (raw)
In-Reply-To: <d8de419d-0077-c47c-a5f1-37c229a853ed@gmail.com>
On Fri, Jul 24, 2026 at 06:20:50PM +0800, Hao Jia wrote:
>
>
> On 2026/7/24 00:39, Yosry Ahmed wrote:
> > On Thu, Jul 23, 2026 at 6:55 AM Johannes Weiner <hannes@cmpxchg.org> wrote:
> >>
> >> On Wed, Jul 22, 2026 at 09:52:18PM -0700, Yosry Ahmed wrote:
> >>> On Wed, Jul 22, 2026 at 7:27 PM Johannes Weiner <hannes@cmpxchg.org> wrote:
> >>>>
> >>>> On Fri, Jul 17, 2026 at 04:51:51PM +0800, Hao Jia wrote:
> >>>>> @@ -1369,7 +1402,7 @@ static void shrink_worker(struct work_struct *w)
> >>>>> goto resched;
> >>>>> }
> >>>>>
> >>>>> - ret = shrink_memcg(memcg);
> >>>>> + ret = shrink_memcg(memcg, NR_ZSWAP_WB_BATCH);
> >>>>> /* drop the extra reference */
> >>>>> mem_cgroup_put(memcg);
> >>>>>
> >>>>> @@ -1493,7 +1526,7 @@ bool zswap_store(struct folio *folio)
> >>>>> objcg = get_obj_cgroup_from_folio(folio);
> >>>>> if (objcg && !obj_cgroup_may_zswap(objcg)) {
> >>>>> memcg = get_mem_cgroup_from_objcg(objcg);
> >>>>> - if (shrink_memcg(memcg)) {
> >>>>> + if (shrink_memcg(memcg, 1)) {
> >>>>
> >>>> Why 64 for the global limit but only 1 for the cgroup limit? That
> >>>> seems arbitrary in multiple ways.
> >>>
> >>> I suggested that we keep the writeback here without batching and do
> >>> that change separately, mainly out of abundance of caution as
> >>> writeback is done synchronously here so the extra latency could be
> >>> problematic. I think we probably want to measure the performance
> >>> impact of that separately.
> >>>
> >>> That being said, this path is potentially too expensive anyway due to
> >>> the flush, but I would rather we do some basic measurements before
> >>> batching here.
> >>>
> >>> What do you think?
> >>
> >> It's not an unknown, right? We know this works for direct reclaimers,
> >> cgroup limit reclaim e.g., and what the latency implications are.
> >>
> >> Because of how reclaim works, we also know it'll call zswap_store() in
> >> batches of SWAP_CLUSTER_MAX. If we don't batch here, they're likely to
> >> each call shrink_memcg() once we're at the limit - while still risking
> >> rejections due to compressibility differences.
> >>
> >> My worry is that if we start with an inconsistency, we'll be stuck
> >> with it for a long time.
> >>
> >> I'd rather start with the clean, consistent version. Dial it back only
> >> if we have data to justfiy the complication that we can put into a
> >> comment and the changelog that outlines why exactly it's different.
> >
> > I am fine with doing that and basically always using NR_ZSWAP_WB_BATCH
> > as the batch size in shrink_memcg(), but I would be more comfortable
> > if we did some sanity testing.
> >
> > Hao, would you be able to do some smoke testing with NR_ZSWAP_WB_BATCH
> > used for all paths, and memory.zswap.max set in a way that induces
> > writeback? You can probably set memory.zswap.max to 1% of total memory
> > instead of the global pool limit and rerun the same test.
>
> Building on Test Case 2, I set zswap.max=320M (~1% of total system
> memory) and updated both invocation paths of shrink_memcg() to process
> batches of 32 or 64. The resulting benchmark data is shown below.
> (Note: Test Case 2 also sets max_pool_percent=1.)
>
> baseline-cgroup batch-all-32-cgroup
> batch-all-64-cgroup
> shrink_worker wakeups 7,238 766 367
> shrink_memcg calls 12,059,142 1,961,194 983,878
> written_back 28,277 301,157 327,997
> zswap_store calls 1,349,572 1,168,190 1,114,549
> store succeeded 492,861 521,315 459,246
> store rejected 856,712 646,875 655,303
> store reject rate ~63% ~55% ~58%
> pool_limit_hit 510,130 50,096 57,715
> pswpout 884,989 948,032 983,300
> pswpin 1,251,268 1,638,668 1,878,453
Thanks for testing both!
Looks like 32 shows the better matching with the reclaim batches than
64: it writes back less and swaps in less, while still having the
improved rejection rate. It even rejects slightly less than 64, but
that might be noise? Absolute stores win handily in any case - not
sure if that's meaningful in your test design.
prev parent reply other threads:[~2026-07-24 18:41 UTC|newest]
Thread overview: 23+ messages / expand[flat|nested] mbox.gz Atom feed top
[not found] <20260717085151.22822-1-jiahao.kernel@gmail.com>
2026-07-18 1:18 ` [PATCH v2 0/2] mm/zswap: Fixes and improves the zswap global shrinker Andrew Morton
2026-07-18 1:22 ` Yosry Ahmed
2026-07-18 1:28 ` Yosry Ahmed
2026-07-18 4:40 ` Andrew Morton
2026-07-20 1:26 ` Hao Jia
2026-07-23 1:21 ` Hao Jia
2026-07-23 4:49 ` Yosry Ahmed
2026-07-24 10:22 ` Hao Jia
[not found] ` <20260717085151.22822-2-jiahao.kernel@gmail.com>
2026-07-23 2:13 ` [PATCH v2 1/2] mm/zswap: Fix global shrinker when memory cgroup is disabled Johannes Weiner
[not found] ` <20260717085151.22822-3-jiahao.kernel@gmail.com>
2026-07-17 16:45 ` [PATCH v2 2/2] mm/zswap: Support batch writeback in shrink_memcg() Yosry Ahmed
2026-07-17 16:46 ` Nhat Pham
2026-07-23 2:27 ` Johannes Weiner
2026-07-23 4:52 ` Yosry Ahmed
2026-07-23 13:55 ` Johannes Weiner
2026-07-23 16:39 ` Yosry Ahmed
2026-07-23 17:11 ` Johannes Weiner
2026-07-24 10:20 ` Hao Jia
2026-07-24 17:56 ` Yosry Ahmed
2026-07-24 18:37 ` Nhat Pham
2026-07-24 18:39 ` Yosry Ahmed
2026-07-24 19:35 ` Johannes Weiner
2026-07-24 22:22 ` Yosry Ahmed
2026-07-24 18:40 ` Johannes Weiner [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=amOxu56ibbhKP8qJ@cmpxchg.org \
--to=hannes@cmpxchg.org \
--cc=akpm@linux-foundation.org \
--cc=chengming.zhou@linux.dev \
--cc=jiahao.kernel@gmail.com \
--cc=jiahao1@lixiang.com \
--cc=linux-doc@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=mhocko@kernel.org \
--cc=mkoutny@suse.com \
--cc=muchun.song@linux.dev \
--cc=nphamcs@gmail.com \
--cc=roman.gushchin@linux.dev \
--cc=shakeel.butt@linux.dev \
--cc=tj@kernel.org \
--cc=yosry@kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox