From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from lgeamrelo03.lge.com (lgeamrelo03.lge.com [156.147.51.102]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 3888447AF6E for ; Thu, 6 Aug 2026 19:21:37 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=156.147.51.102 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1786044102; cv=none; b=tRzrcNl3U4+UDwaqgWqs1+FUhf9R0rgJ+XiTBCDx7jZpdkoRdMGlm0cVVGFh4VUR/uXWCfspf/ZRuXGH+ksMvesk1EPJST/AObQUtIkSTYdlss+Pu6twy8FItuQP8gF9VE4lLKKbx/3dylN7a5eCpIAu7DfuQvcCoD3CO/rKAoo= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1786044102; c=relaxed/simple; bh=g+HAfE15XG42K7Lt/AgnJpNQu+rKb8nt+qWRXAVj324=; h=From:To:Cc:Subject:Date:Message-Id:In-Reply-To:References: MIME-Version; b=AsZ5wjSaFbUQGyKbUcUvia3YLdsEV3JwnqKb06qnYfaV1pbQU/N1+du/X4Z2NDhXnmvjIrTqVJlkFpcAbt/vUKW68Cpgn8/Q7gfstm4jRQg4khdX8wobxFCCABmMTLjSHWdXGYEP5EPpySm4cUqPlRyX5iOniHutWtxGL93tE9g= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=lge.com; spf=pass smtp.mailfrom=lge.com; arc=none smtp.client-ip=156.147.51.102 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=lge.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=lge.com Received: from unknown (HELO yjaykim-PowerEdge-T330.lge.net) (10.177.112.156) by 156.147.51.102 with ESMTP; 7 Aug 2026 04:06:36 +0900 X-Original-SENDERIP: 10.177.112.156 X-Original-MAILFROM: youngjun.park@lge.com From: Youngjun Park To: Andrew Morton Cc: Chris Li , Kairui Song , Kemeng Shi , Nhat Pham , Baoquan He , Barry Song , Jianyue Wu , Youngjun Park , her0gyugyu@gmail.com, linux-mm@kvack.org, linux-kernel@vger.kernel.org Subject: [PATCH 2/4] mm, swap: give hibernation swap slots their own swap table entry type Date: Fri, 7 Aug 2026 04:06:34 +0900 Message-Id: <20260806190636.446205-3-youngjun.park@lge.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20260806190636.446205-1-youngjun.park@lge.com> References: <20260806190636.446205-1-youngjun.park@lge.com> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit swap_alloc_hibernation_slot() stores a fake shadow in the slot it hands out. An anon slot swapped out with no workingset shadow looks exactly the same, so nothing in mm can tell the two apart. Give hibernation slots their own type. Bit 4 and every bit above it are set, the same shape as SWP_TB_BAD. Bits 0 to 3 are taken by the shadow, PFN, pointer and bad marks, so bit 4 is the first free one. Neither type holds data, so the value alone says what it is. The entry has no swap count. Hibernation only allocates and frees a slot, so a count would never change. swap_free_hibernation_slot() frees the slot directly, there is no count to put first. The next patch needs these slots to stop looking like shadows. Suggested-by: Kairui Song Link: https://lore.kernel.org/linux-mm/abp7aDgYLrxF3Me8@KASONG-MC4/ Signed-off-by: Youngjun Park --- mm/swap_table.h | 12 ++++++++++++ mm/swapfile.c | 13 +++++++------ 2 files changed, 19 insertions(+), 6 deletions(-) diff --git a/mm/swap_table.h b/mm/swap_table.h index e6613e62f8d0..c1c516bcc17e 100644 --- a/mm/swap_table.h +++ b/mm/swap_table.h @@ -30,6 +30,7 @@ struct swap_memcg_table { * PFN: |SWAP_COUNT|Z|------ PFN -------|10| - Cached slot * Pointer: |----------- Pointer ----------|100| - (Unused) * Bad: |------------- 1 -------------|1000| - Bad slot + * Hibern: |------------ 1 -------------|10000| - Hibernation slot * * COUNT is `SWP_TB_COUNT_BITS` long, Z is the `SWP_TB_ZERO_FLAG` bit, * and together they form the `SWP_TB_FLAGS_BITS` wide flags field. @@ -54,6 +55,9 @@ struct swap_memcg_table { * aligned pointers. * * - Bad: Swap slot is reserved, protects swap header or holes on swap devices. + * + * - Hibern: Swap slot is reserved by hibernation for the suspend image, and + * must never enter the swap cache. */ /* NULL Entry, all 0 */ @@ -81,6 +85,9 @@ struct swap_memcg_table { /* Bad slot: ends with 0b1000 and rests of bits are all 1 */ #define SWP_TB_BAD ((~0UL) << 3) +/* Hibernation slot: ends with 0b10000 and rests of bits are all 1 */ +#define SWP_TB_HIB ((~0UL) << 4) + /* Macro for shadow offset calculation */ #define SWAP_COUNT_SHIFT SWP_TB_FLAGS_BITS @@ -166,6 +173,11 @@ static inline bool swp_tb_is_bad(unsigned long swp_tb) return swp_tb == SWP_TB_BAD; } +static inline bool swp_tb_is_hibernation(unsigned long swp_tb) +{ + return swp_tb == SWP_TB_HIB; +} + static inline bool swp_tb_is_countable(unsigned long swp_tb) { return (swp_tb_is_shadow(swp_tb) || swp_tb_is_folio(swp_tb) || diff --git a/mm/swapfile.c b/mm/swapfile.c index f5dfc7e59191..a337387f7431 100644 --- a/mm/swapfile.c +++ b/mm/swapfile.c @@ -928,7 +928,7 @@ static bool __swap_cluster_alloc_entries(struct swap_info_struct *si, * upon folio unmap. * * Else, it's a exclusive order 0 allocation for hibernation. - * The slot starts with count == 1 and never increases. + * The slot carries no swap count and is freed by offset. */ if (likely(folio)) { order = folio_order(folio); @@ -940,8 +940,8 @@ static bool __swap_cluster_alloc_entries(struct swap_info_struct *si, order = 0; nr_pages = 1; swap_cluster_assert_empty(ci, ci_off, 1, false); - /* Fake shadow placeholder with no flag, hibernation does not use the zeromap */ - __swap_table_set(ci, ci_off, __swp_tb_mk_count(shadow_to_swp_tb(NULL, 0), 1)); + /* Exclusively owned by hibernation, must never enter the swap cache */ + __swap_table_set(ci, ci_off, SWP_TB_HIB); } else { /* Allocation without folio is only possible with hibernation */ WARN_ON_ONCE(1); @@ -1929,9 +1929,11 @@ void __swap_cluster_free_entries(struct swap_info_struct *si, old_tb = __swap_table_get(ci, ci_off); /* * Freeing is done after release of the last swap count - * ref, or after swap cache is dropped + * ref, or after swap cache is dropped. A hibernation slot + * has no count and is freed directly by its owner. */ - VM_WARN_ON(!swp_tb_is_shadow(old_tb) || __swp_tb_get_count(old_tb) > 1); + VM_WARN_ON(!swp_tb_is_hibernation(old_tb) && + (!swp_tb_is_shadow(old_tb) || __swp_tb_get_count(old_tb) > 1)); /* Resetting the slot to NULL also clears the inline flags. */ __swap_table_set(ci, ci_off, null_to_swp_tb()); @@ -2201,7 +2203,6 @@ void swap_free_hibernation_slot(swp_entry_t entry) pgoff_t offset = swp_offset(entry); ci = swap_cluster_lock(si, offset); - __swap_cluster_put_entry(ci, offset % SWAPFILE_CLUSTER); /* * A slot with a folio in the swap cache is freed when the folio * leaves the cache, the same rule swap_put_entries_cluster() follows. -- 2.48.1