From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.subspace.kernel.org (Postfix) with ESMTP id C2AA5606D823 for ; Wed, 4 Nov 2026 13:01:59 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key, unprotected) header.d=kernel.org header.i=@kernel.org header.a=rsa-sha256 header.s=k20260515 header.b=nDAkSE0r Received: by kanga.kvack.org (Postfix) id E28CF6B05B6; Wed, 4 Nov 2026 08:01:58 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id DB3326B05B7; Wed, 4 Nov 2026 08:01:58 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id C7ACD6B05B8; Wed, 4 Nov 2026 08:01:58 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id 9FC7A6B05B6 for ; Wed, 4 Nov 2026 08:01:58 -0500 (EST) Received: from smtpin04.hostedemail.com (lb01a-stub [10.200.18.249]) by unirelay08.hostedemail.com (Postfix) with ESMTP id 241651406FC for ; Wed, 4 Nov 2026 13:01:58 +0000 (UTC) X-FDA: 85397449116.04.16E1420 Received: from sea.source.kernel.org (sea.source.kernel.org [172.234.252.31]) by imf13.hostedemail.com (Postfix) with ESMTP id DA74520005 for ; Wed, 4 Nov 2026 13:01:55 +0000 (UTC) Authentication-Results: imf13.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20260515 header.b=nDAkSE0r; spf=pass (imf13.hostedemail.com: domain of kas@kernel.org designates 172.234.252.31 as permitted sender) smtp.mailfrom=kas@kernel.org; dmarc=pass (policy=quarantine) header.from=kernel.org ARC-Seal: i=1; a=rsa-sha256; d=hostedemail.com; s=arc-20220608; cv=none; t=1793797316; b=ke1sy3LiXEdDJe98zVztyDzYNnyTY2XOpmy0zj/7pQmFkdA4Z2v4w5cXY0eFmY1JRmH+a6 L/NftQ+nAz4VxEhNrw/Yi1FJ63wT5cTOyJx6lPhiLtkYe9c/zrY1XfotjPOw8hOjNoTfN9 PpfR8I4Bqlj63NHZ7IffGsQ4h4oGSpI= ARC-Authentication-Results: i=1; imf13.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20260515 header.b=nDAkSE0r; spf=pass (imf13.hostedemail.com: domain of kas@kernel.org designates 172.234.252.31 as permitted sender) smtp.mailfrom=kas@kernel.org; dmarc=pass (policy=quarantine) header.from=kernel.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1793797316; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=B0IkSILmEXDD5SZITUdfDPnAIvH/qKn4TnRnHPUh0Ts=; b=EEzinDvbz3KJubm7bsWQ3dBVtBptOHwEFSh+NrcDJtdt+8zCABVygFbVeg8sV3XlxTGFFE dRzA5EtuPVJdfjGvQytosDKJJ6uSlMrXSW3nzeafbrYGvEgISP5RmnJaykfxAuHRrlYMON nEmxw4zdakAUQOvsTLMgkQ6KkA/Suww= Received: from smtp.kernel.org (quasi.space.kernel.org [100.103.45.18]) by sea.source.kernel.org (Postfix) with ESMTP id 2207F44808; Wed, 4 Nov 2026 13:01:55 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id 323241F00A17; Wed, 4 Nov 2026 13:01:52 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kernel.org; s=k20260515; t=1793797315; bh=B0IkSILmEXDD5SZITUdfDPnAIvH/qKn4TnRnHPUh0Ts=; h=From:To:Cc:Subject:Date:In-Reply-To:References; b=nDAkSE0r0bCMeADhVieVZuLNlHVDkQd1mLuMqGggDincJ99lZouHuSKF5MJCoF6vE Hcca3DlLynjJQbXJ5rVkuzcwWuI01YBVkFphvO1FKldru9HDDv6dATV3zEWNDlYf71 myoa8IgVePzw2k2dpuJ3NDe0tFLEC1ugkiRrGxYy/GLuvkDMv/JW8ImEOIlL0QBEj2 2VBVeXks6Mrc4uzaPXjrh9Iq+DBB206db4karTJNgM6ccPEgU5f7+BWTnCc72yYGUC S3V8HbttvRfVP5dz4BQCS8FGYxVs3IKeH6Y3WZLUMXKrMjOL0k81+lanIOzTcUzF9T tWWzZ6bCiwMdw== Received: from phl-compute-01.internal (phl-compute-01.internal [10.202.2.41]) by mailfauth.ams.internal (Postfix) with ESMTP id 09C571980052; Wed, 4 Nov 2026 08:01:46 -0500 (EST) Received: from phl-frontend-03 ([10.202.2.162]) by phl-compute-01.internal (MEProxy); Wed, 04 Nov 2026 08:01:50 -0500 X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: dmFkZTGhPc1Yg5t9Q8eRQaKCLT0heVoXQqf6h4uqMuRtXQYzheOI1jp47nBw26mcWoxz9A DH10HnpPYob7RxaCTf32YkHXSpJmh1hLC1IxxzXB90aJAI2wMnFT+nxhjDMKjWZ9Ablulj X6EGhbUdQWvr3vCsmIbyKlTdtYm8QJi2H9b42DzXiIRq27TGzwIAKeq7xgftm17WrW++J+ RK/ZhBFKi/01LbyIuttpTNhw8T5nzUYT3/gbSIkELTYoQfWYa9TU1xDsUR8Sja7r663Vhq dT9Vb6Q8iqTkFCbamg7ObiOCckNJsrzr7UPmHz2jvO2iFJ92ew01ZxP0mcoMzU2JutwOgh Deo/g8HEwAnSd00+Sk/Osdm3LkGjObnA/8QcZNGNOZB+xfOYdGiUNVUf88aFswCacRCBmh hokiHdjKaDT29DPVI5Gwiwh/q+igH0C/vvAF0DQfDnNNnYvNgvu66w2jS7vOo6qH6K+7yt nAK3PvNPliSxNz0oqqpOCzOQhLaohJNb1Vx14bhmF4ydiadh2RekHpyLnGH/Zwua5u6R6F aDL/oG6RE6eKtnqYtU1aAOsrFBDA4f8uYS5E4pjAfQtiTgIi2w20lgAILHMHHRHj2bJ86f yYuNqEQjBPE6f07SQgmnAFPAvn5ztU/tCIiy0YSmAyRxyx7vxhdWM+6YJTRA X-ME-Proxy: Feedback-ID: i10464835:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA; Wed, 4 Nov 2026 08:01:45 -0500 (EST) From: "Kiryl Shutsemau (Meta)" To: Andrew Morton , Linus Torvalds , David Hildenbrand , Matthew Wilcox , Vlastimil Babka , Lorenzo Stoakes , Jan Kara , Hugh Dickins , Christian Brauner , Alexander Viro , Harry Yoo Cc: "Kiryl Shutsemau (Meta)" , Miklos Szeredi , Miaohe Lin , Naoya Horiguchi , Oscar Salvador , "Liam R. Howlett" , Mike Rapoport , Suren Baghdasaryan , Michal Hocko , Brendan Jackman , Johannes Weiner , Zi Yan , Baolin Wang , Nico Pache , Ryan Roberts , Dev Jain , Barry Song , Lance Yang , Usama Arif , Kairui Song , Qi Zheng , Shakeel Butt , Axel Rasmussen , Yuanchu Xie , Wei Xu , Baoquan He , "Paul E. McKenney" , Pedro Falcato , Luis Chamberlain , Ilya Gladyshev , Jaegeuk Kim , linux-mm@kvack.org, linux-kernel@vger.kernel.org, linux-fsdevel@vger.kernel.org, fuse-devel@lists.linux.dev, kernel-team@meta.com Subject: [RFC PATCH v2 04/18] mm: count the pages waiting for a grace period Date: Wed, 4 Nov 2026 13:01:00 +0000 Message-ID: <20261104130118.2507513-5-kas@kernel.org> X-Mailer: git-send-email 2.54.0 In-Reply-To: <20261104130118.2507513-1-kas@kernel.org> References: <20261104130118.2507513-1-kas@kernel.org> X-Archived-By: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Stat-Signature: irmknbjzgh63mz1wp9euddam1pnbcpe8 X-Rspam-User: X-Rspamd-Server: rspam05 X-Rspamd-Queue-Id: DA74520005 X-Spam-Status: No, score=-18.8 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, INCLUDES_CR_TRAILER,INCLUDES_PATCH,MAILING_LIST_MULTI,SPF_HELO_PASS, SPF_PASS,USER_AGENT_GIT autolearn=ham autolearn_force=no version=4.0.1 X-HE-Tag: 1793797315-707935 X-HE-Meta: U2FsdGVkX18OaKpxUZfddEk0+tjwGAFGhKR1GSz8XCxajs6ONZjZLXebDPB+1pXPmCsiBljdeqoV12OpPeRGXhmDFEi6Qd2wCY0DxY2Ibo3FafeCpHRjWyEgtvRifLK9baoGQPvQb39OWPxh561ttqYeH6KGFVai34SL9qBSHcoZYjgR6/qlkNUu8RRzTl03YvuXxSjIZ2OR5OPT6iIB13WWm40KipnRq8w9NYm7eBkLIb8Ng1esmZfjNPcmZZbDJ8RIPvMdfvHnTCVKagFBqWDSGlNJXSsM2715gyVI++T4tb5PMMIhAWde3BhYxJb4SvSprLCGYS8SiCbVzU13eSPghMhc40DoG8ZrJK13Gw1IRfuApkDmLycCsMIks1F6M4NmAb7IRTvXRyCpULUNWMZWBx3Bi2aRkp9wzOffy3RFuXU/E4liW+Wpwg2LlNPirgFbZObbyHRUz0hbU6l9MRzjzjoOhk6/VlkPCzCkDgpmoskdWlEsD3uLheIOuprRcDd5GZKk7L6DzfoWiSrBXseOw29GlKB2FbctUIIVlJG6fBvHkdOZsNWvlqazgGNjmV2uBGxRSh93ao8JgddeXFvpvTNUAYByXAQN+efTgUKIKIwrUjfSbYZa0mQfduj8bw/DmbzW1QVlSHvU0/fsq/6aidmwC1P0mdAhP3lDgU73AQQsEVA887Y4DqnQDstJCvBz9VfQnZjoE1Rqwm62PbyJIZn0gssWN0RTWsLMLGV/lODcvs4oHBgi1hzEsgQ5bbVm0S3ISwiuDO7mZf+GsCvR+wPDrDdqUywGBr2bs+ZeGkRLe6dMo+z3BIHKaqMSTrZOfOk++B95529ef3qilms/btLXOvZFcHMbpAIT0vtCe4i+LVoJ9VQNyazk8bW0XMeQkZjXv3CFwALnjmTWsmAIF3AiQjQuaf4BK5zFB+sj4ib05GZUsEe3bAPuT8Ld+WjJXshD586UklH9Xcv KYhJ4drP t8mKg9UtumPU7g+oRfHMfUj/nu68p4ZkRgOnbSFM0nA/LBrsdTc3UbQlCoLLpJJCcvXq/3A2Er4Q61D3Uhe4Fd/82OYVJkwW/DB5XLJr5Z+vIJZDVYNrPo82nHTPKzZBwnMaON9ocBUaJD84URKuI8RCcVLljPuH38PJAHnOtz9X0yEFlS4xQn5QNOucIcgA+/R0RdHvqtHjDLgDp05X7v1t4UL+wTbkssUfisWclnIv9esktklP4GNqdGKpHraieZbsGP01Al53KiEzT5ey2j3xLmL0w3T4bpc1k6ZNv1i6lSMg8UxN9CAwJhjL7ZxAJTJTF0It30tzcC0BpVAdlTXLf1A== Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: X-Spam-Checker-Version: SpamAssassin 4.0.1 (2024-03-26) on aws-us-west-2-korg-listserv-alma10-1 Deferred folios have refcount 0 and are not on the free lists, so no counter shows them. Memory that waits for a grace period is missing from the free count and from every LRU count. Count it per zone in NR_FREE_RCU_PAGES: nr_free_rcu in /proc/vmstat, free_rcu in show_free_areas(). Preparation for freeing the waiting pages sooner when they hold back memory that is needed. Signed-off-by: Kiryl Shutsemau (Meta) --- include/linux/mmzone.h | 1 + mm/page_alloc.c | 4 ++++ mm/show_mem.c | 9 ++++++--- mm/vmstat.c | 2 ++ 4 files changed, 13 insertions(+), 3 deletions(-) diff --git a/include/linux/mmzone.h b/include/linux/mmzone.h index 94f9c3ff5416..3336b9e5ee99 100644 --- a/include/linux/mmzone.h +++ b/include/linux/mmzone.h @@ -228,6 +228,7 @@ enum zone_stat_item { NR_ZSPAGES, /* allocated in zsmalloc */ #endif NR_FREE_CMA_PAGES, + NR_FREE_RCU_PAGES, /* freed, waiting for an RCU grace period */ #ifdef CONFIG_UNACCEPTED_MEMORY NR_UNACCEPTED, #endif diff --git a/mm/page_alloc.c b/mm/page_alloc.c index a371e92da273..15bb66e36304 100644 --- a/mm/page_alloc.c +++ b/mm/page_alloc.c @@ -1348,6 +1348,8 @@ static void rcu_free_pages(struct list_head *list) folio_batch_init(&fbatch); list_for_each_entry_safe(folio, next, list, lru) { + mod_zone_page_state(folio_zone(folio), NR_FREE_RCU_PAGES, + -folio_nr_pages(folio)); if (!folio_batch_add(&fbatch, folio)) { free_unref_folios(&fbatch); cond_resched_tasks_rcu_qs(); @@ -1375,9 +1377,11 @@ static void rcu_free_workfn(struct work_struct *work) static void rcu_free_defer(struct folio *folio) { struct rcu_free_pcpu *r = raw_cpu_ptr(&rcu_free_pcpu); + struct zone *zone = folio_zone(folio); unsigned long flags; spin_lock_irqsave(&r->lock, flags); + __mod_zone_page_state(zone, NR_FREE_RCU_PAGES, folio_nr_pages(folio)); list_add_tail(&folio->lru, &r->pending); rcu_free_start(r); spin_unlock_irqrestore(&r->lock, flags); diff --git a/mm/show_mem.c b/mm/show_mem.c index b938cbcd774a..0d3bddbda108 100644 --- a/mm/show_mem.c +++ b/mm/show_mem.c @@ -204,7 +204,7 @@ static void show_free_areas(unsigned int filter, const nodemask_t *nodemask, " mapped:%lu shmem:%lu pagetables:%lu\n" " sec_pagetables:%lu bounce:%lu\n" " kernel_misc_reclaimable:%lu\n" - " free:%lu free_pcp:%lu free_cma:%lu\n", + " free:%lu free_pcp:%lu free_cma:%lu free_rcu:%lu\n", global_node_page_state(NR_ACTIVE_ANON), global_node_page_state(NR_INACTIVE_ANON), global_node_page_state(NR_ISOLATED_ANON), @@ -224,7 +224,8 @@ static void show_free_areas(unsigned int filter, const nodemask_t *nodemask, global_node_page_state(NR_KERNEL_MISC_RECLAIMABLE), global_zone_page_state(NR_FREE_PAGES), free_pcp, - global_zone_page_state(NR_FREE_CMA_PAGES)); + global_zone_page_state(NR_FREE_CMA_PAGES), + global_zone_page_state(NR_FREE_RCU_PAGES)); for_each_online_pgdat(pgdat) { if (show_mem_node_skip(filter, pgdat->node_id, nodemask)) @@ -325,6 +326,7 @@ static void show_free_areas(unsigned int filter, const nodemask_t *nodemask, " free_pcp:%lukB" " local_pcp:%lukB" " free_cma:%lukB" + " free_rcu:%lukB" "\n", zone->name, K(zone_page_state(zone, NR_FREE_PAGES)), @@ -351,7 +353,8 @@ static void show_free_areas(unsigned int filter, const nodemask_t *nodemask, 0UL, K(free_pcp), K((unsigned long)this_cpu_read(zone->per_cpu_pageset->count)), - K(zone_page_state(zone, NR_FREE_CMA_PAGES))); + K(zone_page_state(zone, NR_FREE_CMA_PAGES)), + K(zone_page_state(zone, NR_FREE_RCU_PAGES))); printk("lowmem_reserve[]:"); for (i = 0; i < MAX_NR_ZONES; i++) printk(KERN_CONT " %ld", zone->lowmem_reserve[i]); diff --git a/mm/vmstat.c b/mm/vmstat.c index 66ed017bde46..64068d73d6d2 100644 --- a/mm/vmstat.c +++ b/mm/vmstat.c @@ -1212,6 +1212,7 @@ const char * const vmstat_text[] = { [I(NR_ZSPAGES)] = "nr_zspages", #endif [I(NR_FREE_CMA_PAGES)] = "nr_free_cma", + [I(NR_FREE_RCU_PAGES)] = "nr_free_rcu", #ifdef CONFIG_UNACCEPTED_MEMORY [I(NR_UNACCEPTED)] = "nr_unaccepted", #endif @@ -2023,6 +2024,7 @@ static int vmstat_refresh(const struct ctl_table *table, int write, switch (i) { case NR_ZONE_WRITE_PENDING: case NR_FREE_CMA_PAGES: + case NR_FREE_RCU_PAGES: continue; } val = atomic_long_read(&vm_zone_stat[i]); -- 2.54.0