From: alexs@kernel.org
To: Vitaly Wool <vitaly.wool@konsulko.com>,
Miaohe Lin <linmiaohe@huawei.com>,
Andrew Morton <akpm@linux-foundation.org>,
linux-kernel@vger.kernel.org, linux-mm@kvack.org,
minchan@kernel.org, willy@infradead.org,
senozhatsky@chromium.org, david@redhat.com, 42.hyeyoo@gmail.com,
Yosry Ahmed <yosryahmed@google.com>,
nphamcs@gmail.com
Cc: Alex Shi <alexs@kernel.org>
Subject: [PATCH v2 10/20] mm/zsmalloc: add zpdesc_is_isolated/zpdesc_zone helper for zs_page_migrate
Date: Wed, 3 Jul 2024 12:06:00 +0800 [thread overview]
Message-ID: <20240703040613.681396-11-alexs@kernel.org> (raw)
In-Reply-To: <20240703040613.681396-1-alexs@kernel.org>
From: Hyeonggon Yoo <42.hyeyoo@gmail.com>
To convert page to zpdesc in zs_page_migrate(), we added
zpdesc_is_isolated/zpdesc_zone helpers. No functional change.
Signed-off-by: Hyeonggon Yoo <42.hyeyoo@gmail.com>
Signed-off-by: Alex Shi <alexs@kernel.org>
---
mm/zpdesc.h | 11 +++++++++++
mm/zsmalloc.c | 30 ++++++++++++++++--------------
2 files changed, 27 insertions(+), 14 deletions(-)
diff --git a/mm/zpdesc.h b/mm/zpdesc.h
index a2e320f24dd4..61d7ba0c626e 100644
--- a/mm/zpdesc.h
+++ b/mm/zpdesc.h
@@ -106,4 +106,15 @@ static inline void __zpdesc_set_movable(struct zpdesc *zpdesc,
{
__SetPageMovable(zpdesc_page(zpdesc), mops);
}
+
+static inline bool zpdesc_is_isolated(struct zpdesc *zpdesc)
+{
+ return PageIsolated(zpdesc_page(zpdesc));
+}
+
+static inline struct zone *zpdesc_zone(struct zpdesc *zpdesc)
+{
+ return page_zone(zpdesc_page(zpdesc));
+}
+
#endif
diff --git a/mm/zsmalloc.c b/mm/zsmalloc.c
index 7aa4a4acaec9..9bc9b14187ed 100644
--- a/mm/zsmalloc.c
+++ b/mm/zsmalloc.c
@@ -1830,19 +1830,21 @@ static int zs_page_migrate(struct page *newpage, struct page *page,
struct size_class *class;
struct zspage *zspage;
struct zpdesc *dummy;
+ struct zpdesc *newzpdesc = page_zpdesc(newpage);
+ struct zpdesc *zpdesc = page_zpdesc(page);
void *s_addr, *d_addr, *addr;
unsigned int offset;
unsigned long handle;
unsigned long old_obj, new_obj;
unsigned int obj_idx;
- VM_BUG_ON_PAGE(!PageIsolated(page), page);
+ VM_BUG_ON_PAGE(!zpdesc_is_isolated(zpdesc), zpdesc_page(zpdesc));
/* We're committed, tell the world that this is a Zsmalloc page. */
- __SetPageZsmalloc(newpage);
+ __SetPageZsmalloc(zpdesc_page(newzpdesc));
/* The page is locked, so this pointer must remain valid */
- zspage = get_zspage(page);
+ zspage = get_zspage(zpdesc_page(zpdesc));
pool = zspage->pool;
/*
@@ -1859,30 +1861,30 @@ static int zs_page_migrate(struct page *newpage, struct page *page,
/* the migrate_write_lock protects zpage access via zs_map_object */
migrate_write_lock(zspage);
- offset = get_first_obj_offset(page);
- s_addr = kmap_atomic(page);
+ offset = get_first_obj_offset(zpdesc_page(zpdesc));
+ s_addr = zpdesc_kmap_atomic(zpdesc);
/*
* Here, any user cannot access all objects in the zspage so let's move.
*/
- d_addr = kmap_atomic(newpage);
+ d_addr = zpdesc_kmap_atomic(newzpdesc);
copy_page(d_addr, s_addr);
kunmap_atomic(d_addr);
for (addr = s_addr + offset; addr < s_addr + PAGE_SIZE;
addr += class->size) {
- if (obj_allocated(page_zpdesc(page), addr, &handle)) {
+ if (obj_allocated(zpdesc, addr, &handle)) {
old_obj = handle_to_obj(handle);
obj_to_location(old_obj, &dummy, &obj_idx);
- new_obj = (unsigned long)location_to_obj(newpage,
+ new_obj = (unsigned long)location_to_obj(zpdesc_page(newzpdesc),
obj_idx);
record_obj(handle, new_obj);
}
}
kunmap_atomic(s_addr);
- replace_sub_page(class, zspage, page_zpdesc(newpage), page_zpdesc(page));
+ replace_sub_page(class, zspage, newzpdesc, zpdesc);
/*
* Since we complete the data copy and set up new zspage structure,
* it's okay to release migration_lock.
@@ -1891,14 +1893,14 @@ static int zs_page_migrate(struct page *newpage, struct page *page,
spin_unlock(&class->lock);
migrate_write_unlock(zspage);
- get_page(newpage);
- if (page_zone(newpage) != page_zone(page)) {
- dec_zone_page_state(page, NR_ZSPAGES);
- inc_zone_page_state(newpage, NR_ZSPAGES);
+ zpdesc_get(newzpdesc);
+ if (zpdesc_zone(newzpdesc) != zpdesc_zone(zpdesc)) {
+ zpdesc_dec_zone_page_state(zpdesc);
+ zpdesc_inc_zone_page_state(newzpdesc);
}
reset_page(page);
- put_page(page);
+ zpdesc_put(zpdesc);
return MIGRATEPAGE_SUCCESS;
}
--
2.43.0
next prev parent reply other threads:[~2024-07-03 4:01 UTC|newest]
Thread overview: 25+ messages / expand[flat|nested] mbox.gz Atom feed top
2024-07-03 4:05 [PATCH v2 00/20] mm/zsmalloc: add zpdesc memory descriptor for zswap.zpool alexs
2024-07-03 4:05 ` [PATCH v2 01/20] " alexs
2024-07-05 13:41 ` kernel test robot
2024-07-05 14:02 ` kernel test robot
2024-07-03 4:05 ` [PATCH v2 02/20] mm/zsmalloc: use zpdesc in trylock_zspage/lock_zspage alexs
2024-07-03 4:05 ` [PATCH v2 03/20] mm/zsmalloc: convert __zs_map_object/__zs_unmap_object to use zpdesc alexs
2024-07-03 4:05 ` [PATCH v2 04/20] mm/zsmalloc: add and use pfn/zpdesc seeking funcs alexs
2024-07-03 4:05 ` [PATCH v2 05/20] mm/zsmalloc: convert obj_malloc() to use zpdesc alexs
2024-07-03 4:05 ` [PATCH v2 06/20] mm/zsmalloc: convert create_page_chain() and its users " alexs
2024-07-03 4:05 ` [PATCH v2 07/20] mm/zsmalloc: convert obj_allocated() and related helpers " alexs
2024-07-03 4:05 ` [PATCH v2 08/20] mm/zsmalloc: convert init_zspage() " alexs
2024-07-03 4:05 ` [PATCH v2 09/20] mm/zsmalloc: convert obj_to_page() and zs_free() " alexs
2024-07-03 4:06 ` alexs [this message]
2024-07-03 4:06 ` [PATCH v2 11/20] mm/zsmalloc: rename reset_page to reset_zpdesc and use zpdesc in it alexs
2024-07-03 4:06 ` [PATCH v2 12/20] mm/zsmalloc: convert __free_zspage() to use zdsesc alexs
2024-07-03 4:06 ` [PATCH v2 13/20] mm/zsmalloc: convert location_to_obj() to take zpdesc alexs
2024-07-03 4:06 ` [PATCH v2 14/20] mm/zsmalloc: convert migrate_zspage() to use zpdesc alexs
2024-07-03 4:06 ` [PATCH v2 15/20] mm/zsmalloc: convert get_zspage() to take zpdesc alexs
2024-07-03 4:06 ` [PATCH v2 16/20] mm/zsmalloc: convert SetZsPageMovable and remove unused funcs alexs
2024-07-03 4:06 ` [PATCH v2 17/20] mm/zsmalloc: convert get/set_first_obj_offset() to take zpdesc alexs
2024-07-05 14:43 ` kernel test robot
2024-07-05 17:15 ` Nathan Chancellor
2024-07-03 4:06 ` [PATCH v2 18/20] mm/zsmalloc: introduce __zpdesc_clear_movable alexs
2024-07-03 4:06 ` [PATCH v2 19/20] mm/zsmalloc: introduce __zpdesc_clear_zsmalloc alexs
2024-07-03 4:06 ` [PATCH v2 20/20] mm/zsmalloc: introduce __zpdesc_set_zsmalloc() alexs
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20240703040613.681396-11-alexs@kernel.org \
--to=alexs@kernel.org \
--cc=42.hyeyoo@gmail.com \
--cc=akpm@linux-foundation.org \
--cc=david@redhat.com \
--cc=linmiaohe@huawei.com \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=minchan@kernel.org \
--cc=nphamcs@gmail.com \
--cc=senozhatsky@chromium.org \
--cc=vitaly.wool@konsulko.com \
--cc=willy@infradead.org \
--cc=yosryahmed@google.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.