* [RFC mm v4 0/2] mm, page_pool: introduce a new page type for page pool in page type
@ 2025-10-23 7:44 Byungchul Park
2025-10-23 7:44 ` [RFC mm v4 1/2] page_pool: check if nmdesc->pp is !NULL to confirm its usage as pp for net_iov Byungchul Park
2025-10-23 7:44 ` [RFC mm v4 2/2] mm: introduce a new page type for page pool in page type Byungchul Park
0 siblings, 2 replies; 10+ messages in thread
From: Byungchul Park @ 2025-10-23 7:44 UTC (permalink / raw)
To: linux-mm, netdev
Cc: linux-kernel, kernel_team, harry.yoo, ast, daniel, davem, kuba,
hawk, john.fastabend, sdf, saeedm, leon, tariqt, mbloch,
andrew+netdev, edumazet, pabeni, akpm, david, lorenzo.stoakes,
Liam.Howlett, vbabka, rppt, surenb, mhocko, horms, jackmanb,
hannes, ziy, ilias.apalodimas, willy, brauner, kas, yuzhao,
usamaarif642, baolin.wang, almasrymina, toke, asml.silence, bpf,
linux-rdma, sfr, dw, ap420073, dtatulea
This patch is supposed to go via the mm tree, but it currently also
depends on patches in the net-next tree. For now, this patch is based
on linux-next, but will apply cleanly (or get rebased) after mm tree was
rebased.
Changes from v3:
1. Rebase on next-20251023 of linux-next.
2. Split into two, mm changes and network changes.
3. Improve the comments (feedbacked by Jakub)
Changes from v2:
1. Rebase on linux-next as of Jul 29.
2. Skip 'niov->pp = NULL' when it's allocated using __GFP_ZERO.
3. Change trivial coding style. (feedbacked by Mina)
4. Add Co-developed-by, Acked-by, and Reviewed-by properly.
Thanks to all.
Changes from v1:
1. Rebase on linux-next.
2. Initialize net_iov->pp = NULL when allocating net_iov in
net_devmem_bind_dmabuf() and io_zcrx_create_area().
3. Use ->pp for net_iov to identify if it's pp rather than
always consider net_iov as pp.
4. Add Suggested-by: David Hildenbrand <david@redhat.com>.
Byungchul Park (2):
page_pool: check if nmdesc->pp is !NULL to confirm its usage as pp for
net_iov
mm: introduce a new page type for page pool in page type
.../net/ethernet/mellanox/mlx5/core/en/xdp.c | 2 +-
include/linux/mm.h | 27 +++----------------
include/linux/page-flags.h | 6 +++++
include/net/netmem.h | 2 +-
mm/page_alloc.c | 8 +++---
net/core/devmem.c | 1 +
net/core/netmem_priv.h | 25 +++++++++--------
net/core/page_pool.c | 14 ++++++++--
8 files changed, 40 insertions(+), 45 deletions(-)
base-commit: efb26a23ed5f5dc3554886ab398f559dcb1de96b
--
2.17.1
^ permalink raw reply [flat|nested] 10+ messages in thread* [RFC mm v4 1/2] page_pool: check if nmdesc->pp is !NULL to confirm its usage as pp for net_iov 2025-10-23 7:44 [RFC mm v4 0/2] mm, page_pool: introduce a new page type for page pool in page type Byungchul Park @ 2025-10-23 7:44 ` Byungchul Park 2025-10-28 1:25 ` Mina Almasry 2025-10-29 1:33 ` Jakub Kicinski 2025-10-23 7:44 ` [RFC mm v4 2/2] mm: introduce a new page type for page pool in page type Byungchul Park 1 sibling, 2 replies; 10+ messages in thread From: Byungchul Park @ 2025-10-23 7:44 UTC (permalink / raw) To: linux-mm, netdev Cc: linux-kernel, kernel_team, harry.yoo, ast, daniel, davem, kuba, hawk, john.fastabend, sdf, saeedm, leon, tariqt, mbloch, andrew+netdev, edumazet, pabeni, akpm, david, lorenzo.stoakes, Liam.Howlett, vbabka, rppt, surenb, mhocko, horms, jackmanb, hannes, ziy, ilias.apalodimas, willy, brauner, kas, yuzhao, usamaarif642, baolin.wang, almasrymina, toke, asml.silence, bpf, linux-rdma, sfr, dw, ap420073, dtatulea ->pp_magic field in struct page is current used to identify if a page belongs to a page pool. However, ->pp_magic will be removed and page type bit in struct page e.g. PGTY_netpp should be used for that purpose. As a preparation, the check for net_iov, that is not page-backed, should avoid using ->pp_magic since net_iov doens't have to do with page type. Instead, nmdesc->pp can be used if a net_iov or its nmdesc belongs to a page pool, by making sure nmdesc->pp is NULL otherwise. For page-backed netmem, just leave unchanged as is, while for net_iov, make sure nmdesc->pp is initialized to NULL and use nmdesc->pp for the check. Signed-off-by: Byungchul Park <byungchul@sk.com> --- net/core/devmem.c | 1 + net/core/netmem_priv.h | 8 ++++++++ net/core/page_pool.c | 16 ++++++++++++++-- 3 files changed, 23 insertions(+), 2 deletions(-) diff --git a/net/core/devmem.c b/net/core/devmem.c index d9de31a6cc7f..f81b700f1fd1 100644 --- a/net/core/devmem.c +++ b/net/core/devmem.c @@ -291,6 +291,7 @@ net_devmem_bind_dmabuf(struct net_device *dev, niov = &owner->area.niovs[i]; niov->type = NET_IOV_DMABUF; niov->owner = &owner->area; + niov->desc.pp = NULL; page_pool_set_dma_addr_netmem(net_iov_to_netmem(niov), net_devmem_get_dma_addr(niov)); if (direction == DMA_TO_DEVICE) diff --git a/net/core/netmem_priv.h b/net/core/netmem_priv.h index 23175cb2bd86..5561fd556bc5 100644 --- a/net/core/netmem_priv.h +++ b/net/core/netmem_priv.h @@ -22,6 +22,14 @@ static inline void netmem_clear_pp_magic(netmem_ref netmem) static inline bool netmem_is_pp(netmem_ref netmem) { + /* net_iov may be part of a page pool. For net_iov, ->pp in + * net_iov.desc can be used to determine if the pages belong to + * a page pool. Ensure that the ->pp either points to its page + * pool or is set to NULL if it does not. + */ + if (netmem_is_net_iov(netmem)) + return !!netmem_to_nmdesc(netmem)->pp; + return (netmem_get_pp_magic(netmem) & PP_MAGIC_MASK) == PP_SIGNATURE; } diff --git a/net/core/page_pool.c b/net/core/page_pool.c index 1a5edec485f1..2756b78754b0 100644 --- a/net/core/page_pool.c +++ b/net/core/page_pool.c @@ -699,7 +699,13 @@ s32 page_pool_inflight(const struct page_pool *pool, bool strict) void page_pool_set_pp_info(struct page_pool *pool, netmem_ref netmem) { netmem_set_pp(netmem, pool); - netmem_or_pp_magic(netmem, PP_SIGNATURE); + + /* For page-backed, pp_magic is used to identify if it's pp. + * For net_iov, it's ensured nmdesc->pp is non-NULL if it's pp + * and nmdesc->pp is NULL if it's not. + */ + if (!netmem_is_net_iov(netmem)) + netmem_or_pp_magic(netmem, PP_SIGNATURE); /* Ensuring all pages have been split into one fragment initially: * page_pool_set_pp_info() is only called once for every page when it @@ -714,7 +720,13 @@ void page_pool_set_pp_info(struct page_pool *pool, netmem_ref netmem) void page_pool_clear_pp_info(netmem_ref netmem) { - netmem_clear_pp_magic(netmem); + /* For page-backed, pp_magic is used to identify if it's pp. + * For net_iov, it's ensured nmdesc->pp is non-NULL if it's pp + * and nmdesc->pp is NULL if it's not. + */ + if (!netmem_is_net_iov(netmem)) + netmem_clear_pp_magic(netmem); + netmem_set_pp(netmem, NULL); } -- 2.17.1 ^ permalink raw reply related [flat|nested] 10+ messages in thread
* Re: [RFC mm v4 1/2] page_pool: check if nmdesc->pp is !NULL to confirm its usage as pp for net_iov 2025-10-23 7:44 ` [RFC mm v4 1/2] page_pool: check if nmdesc->pp is !NULL to confirm its usage as pp for net_iov Byungchul Park @ 2025-10-28 1:25 ` Mina Almasry 2025-10-28 2:24 ` Byungchul Park 2025-10-29 1:33 ` Jakub Kicinski 1 sibling, 1 reply; 10+ messages in thread From: Mina Almasry @ 2025-10-28 1:25 UTC (permalink / raw) To: Byungchul Park Cc: linux-mm, netdev, linux-kernel, kernel_team, harry.yoo, ast, daniel, davem, kuba, hawk, john.fastabend, sdf, saeedm, leon, tariqt, mbloch, andrew+netdev, edumazet, pabeni, akpm, david, lorenzo.stoakes, Liam.Howlett, vbabka, rppt, surenb, mhocko, horms, jackmanb, hannes, ziy, ilias.apalodimas, willy, brauner, kas, yuzhao, usamaarif642, baolin.wang, toke, asml.silence, bpf, linux-rdma, sfr, dw, ap420073, dtatulea On Thu, Oct 23, 2025 at 12:44 AM Byungchul Park <byungchul@sk.com> wrote: > > ->pp_magic field in struct page is current used to identify if a page > belongs to a page pool. However, ->pp_magic will be removed and page > type bit in struct page e.g. PGTY_netpp should be used for that purpose. > > As a preparation, the check for net_iov, that is not page-backed, should > avoid using ->pp_magic since net_iov doens't have to do with page type. > Instead, nmdesc->pp can be used if a net_iov or its nmdesc belongs to a > page pool, by making sure nmdesc->pp is NULL otherwise. > > For page-backed netmem, just leave unchanged as is, while for net_iov, > make sure nmdesc->pp is initialized to NULL and use nmdesc->pp for the > check. > > Signed-off-by: Byungchul Park <byungchul@sk.com> > --- > net/core/devmem.c | 1 + > net/core/netmem_priv.h | 8 ++++++++ > net/core/page_pool.c | 16 ++++++++++++++-- > 3 files changed, 23 insertions(+), 2 deletions(-) > > diff --git a/net/core/devmem.c b/net/core/devmem.c > index d9de31a6cc7f..f81b700f1fd1 100644 > --- a/net/core/devmem.c > +++ b/net/core/devmem.c > @@ -291,6 +291,7 @@ net_devmem_bind_dmabuf(struct net_device *dev, > niov = &owner->area.niovs[i]; > niov->type = NET_IOV_DMABUF; > niov->owner = &owner->area; > + niov->desc.pp = NULL; Don't you also need to = NULL the niov allocations in io_uring zcrx, or is that already done? Maybe mention in commit message. Other than that, looks correct, Reviewed-by: Mina Almasry <almasrymina@google.com> ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [RFC mm v4 1/2] page_pool: check if nmdesc->pp is !NULL to confirm its usage as pp for net_iov 2025-10-28 1:25 ` Mina Almasry @ 2025-10-28 2:24 ` Byungchul Park 0 siblings, 0 replies; 10+ messages in thread From: Byungchul Park @ 2025-10-28 2:24 UTC (permalink / raw) To: Mina Almasry Cc: linux-mm, netdev, linux-kernel, kernel_team, harry.yoo, ast, daniel, davem, kuba, hawk, john.fastabend, sdf, saeedm, leon, tariqt, mbloch, andrew+netdev, edumazet, pabeni, akpm, david, lorenzo.stoakes, Liam.Howlett, vbabka, rppt, surenb, mhocko, horms, jackmanb, hannes, ziy, ilias.apalodimas, willy, brauner, kas, yuzhao, usamaarif642, baolin.wang, toke, asml.silence, bpf, linux-rdma, sfr, dw, ap420073, dtatulea On Mon, Oct 27, 2025 at 06:25:38PM -0700, Mina Almasry wrote: > On Thu, Oct 23, 2025 at 12:44 AM Byungchul Park <byungchul@sk.com> wrote: > > > > ->pp_magic field in struct page is current used to identify if a page > > belongs to a page pool. However, ->pp_magic will be removed and page > > type bit in struct page e.g. PGTY_netpp should be used for that purpose. > > > > As a preparation, the check for net_iov, that is not page-backed, should > > avoid using ->pp_magic since net_iov doens't have to do with page type. > > Instead, nmdesc->pp can be used if a net_iov or its nmdesc belongs to a > > page pool, by making sure nmdesc->pp is NULL otherwise. > > > > For page-backed netmem, just leave unchanged as is, while for net_iov, > > make sure nmdesc->pp is initialized to NULL and use nmdesc->pp for the > > check. > > > > Signed-off-by: Byungchul Park <byungchul@sk.com> > > --- > > net/core/devmem.c | 1 + > > net/core/netmem_priv.h | 8 ++++++++ > > net/core/page_pool.c | 16 ++++++++++++++-- > > 3 files changed, 23 insertions(+), 2 deletions(-) > > > > diff --git a/net/core/devmem.c b/net/core/devmem.c > > index d9de31a6cc7f..f81b700f1fd1 100644 > > --- a/net/core/devmem.c > > +++ b/net/core/devmem.c > > @@ -291,6 +291,7 @@ net_devmem_bind_dmabuf(struct net_device *dev, > > niov = &owner->area.niovs[i]; > > niov->type = NET_IOV_DMABUF; > > niov->owner = &owner->area; > > + niov->desc.pp = NULL; > > Don't you also need to = NULL the niov allocations in io_uring zcrx, > or is that already done? Maybe mention in commit message. Yes, that's been already done by kvmalloc_array(__GFP_ZERO). I want to leave a comment explaining that on io_uring side like: diff --git a/io_uring/zcrx.c b/io_uring/zcrx.c index e5ff49f3425e..f771bb3e756d 100644 --- a/io_uring/zcrx.c +++ b/io_uring/zcrx.c @@ -444,6 +444,10 @@ static int io_zcrx_create_area(struct io_zcrx_ifq *ifq, area->freelist[i] = i; atomic_set(&area->user_refs[i], 0); niov->type = NET_IOV_IOURING; + + /* niov->pp is already initialized to NULL by + * kvmalloc_array(__GFP_ZERO). + */ } area->free_count = nr_iovs; However, I dropped it as Pavel requested: https://lore.kernel.org/lkml/8d833a3f-ae18-4ea6-9092-ddaa48290a63@gmail.com/ I will mention it in commit message then. > Other than that, looks correct, > > Reviewed-by: Mina Almasry <almasrymina@google.com> Thanks. Byungchul ^ permalink raw reply related [flat|nested] 10+ messages in thread
* Re: [RFC mm v4 1/2] page_pool: check if nmdesc->pp is !NULL to confirm its usage as pp for net_iov 2025-10-23 7:44 ` [RFC mm v4 1/2] page_pool: check if nmdesc->pp is !NULL to confirm its usage as pp for net_iov Byungchul Park 2025-10-28 1:25 ` Mina Almasry @ 2025-10-29 1:33 ` Jakub Kicinski 2025-10-29 1:56 ` Byungchul Park 1 sibling, 1 reply; 10+ messages in thread From: Jakub Kicinski @ 2025-10-29 1:33 UTC (permalink / raw) To: Byungchul Park Cc: linux-mm, netdev, linux-kernel, kernel_team, harry.yoo, ast, daniel, davem, hawk, john.fastabend, sdf, saeedm, leon, tariqt, mbloch, andrew+netdev, edumazet, pabeni, akpm, david, lorenzo.stoakes, Liam.Howlett, vbabka, rppt, surenb, mhocko, horms, jackmanb, hannes, ziy, ilias.apalodimas, willy, brauner, kas, yuzhao, usamaarif642, baolin.wang, almasrymina, toke, asml.silence, bpf, linux-rdma, sfr, dw, ap420073, dtatulea On Thu, 23 Oct 2025 16:44:09 +0900 Byungchul Park wrote: > As a preparation, the check for net_iov, that is not page-backed, should > avoid using ->pp_magic since net_iov doens't have to do with page type. doesn't > Instead, nmdesc->pp can be used if a net_iov or its nmdesc belongs to a > page pool, by making sure nmdesc->pp is NULL otherwise. Please explain in the commit message why the new branch in netmem_is_pp() is necessary. We used to identify the pages based on PP_SIGNATURE, now we identify them based on page_type. ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [RFC mm v4 1/2] page_pool: check if nmdesc->pp is !NULL to confirm its usage as pp for net_iov 2025-10-29 1:33 ` Jakub Kicinski @ 2025-10-29 1:56 ` Byungchul Park 0 siblings, 0 replies; 10+ messages in thread From: Byungchul Park @ 2025-10-29 1:56 UTC (permalink / raw) To: Jakub Kicinski Cc: linux-mm, netdev, linux-kernel, kernel_team, harry.yoo, ast, daniel, davem, hawk, john.fastabend, sdf, saeedm, leon, tariqt, mbloch, andrew+netdev, edumazet, pabeni, akpm, david, lorenzo.stoakes, Liam.Howlett, vbabka, rppt, surenb, mhocko, horms, jackmanb, hannes, ziy, ilias.apalodimas, willy, brauner, kas, yuzhao, usamaarif642, baolin.wang, almasrymina, toke, asml.silence, bpf, linux-rdma, sfr, dw, ap420073, dtatulea On Tue, Oct 28, 2025 at 06:33:56PM -0700, Jakub Kicinski wrote: > On Thu, 23 Oct 2025 16:44:09 +0900 Byungchul Park wrote: > > As a preparation, the check for net_iov, that is not page-backed, should > > avoid using ->pp_magic since net_iov doens't have to do with page type. > > doesn't > > > Instead, nmdesc->pp can be used if a net_iov or its nmdesc belongs to a > > page pool, by making sure nmdesc->pp is NULL otherwise. > > Please explain in the commit message why the new branch in > netmem_is_pp() is necessary. We used to identify the pages based > on PP_SIGNATURE, now we identify them based on page_type. Yes, I will. It'd be much better. Thank you very much for the comment. Byungchul ^ permalink raw reply [flat|nested] 10+ messages in thread
* [RFC mm v4 2/2] mm: introduce a new page type for page pool in page type 2025-10-23 7:44 [RFC mm v4 0/2] mm, page_pool: introduce a new page type for page pool in page type Byungchul Park 2025-10-23 7:44 ` [RFC mm v4 1/2] page_pool: check if nmdesc->pp is !NULL to confirm its usage as pp for net_iov Byungchul Park @ 2025-10-23 7:44 ` Byungchul Park 2025-10-28 1:28 ` Mina Almasry 1 sibling, 1 reply; 10+ messages in thread From: Byungchul Park @ 2025-10-23 7:44 UTC (permalink / raw) To: linux-mm, netdev Cc: linux-kernel, kernel_team, harry.yoo, ast, daniel, davem, kuba, hawk, john.fastabend, sdf, saeedm, leon, tariqt, mbloch, andrew+netdev, edumazet, pabeni, akpm, david, lorenzo.stoakes, Liam.Howlett, vbabka, rppt, surenb, mhocko, horms, jackmanb, hannes, ziy, ilias.apalodimas, willy, brauner, kas, yuzhao, usamaarif642, baolin.wang, almasrymina, toke, asml.silence, bpf, linux-rdma, sfr, dw, ap420073, dtatulea ->pp_magic field in struct page is current used to identify if a page belongs to a page pool. However, ->pp_magic will be removed and page type bit in struct page e.i. PGTY_netpp can be used for that purpose. Introduce and use the page type APIs e.g. PageNetpp(), __SetPageNetpp(), and __ClearPageNetpp() instead, and remove the existing APIs accessing ->pp_magic e.g. page_pool_page_is_pp(), netmem_or_pp_magic(), and netmem_clear_pp_magic(). This work was inspired by the following link: [1] https://lore.kernel.org/all/582f41c0-2742-4400-9c81-0d46bf4e8314@gmail.com/ While at it, move the sanity check for page pool to on free. Suggested-by: David Hildenbrand <david@redhat.com> Co-developed-by: Pavel Begunkov <asml.silence@gmail.com> Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> Signed-off-by: Byungchul Park <byungchul@sk.com> Acked-by: David Hildenbrand <david@redhat.com> Acked-by: Zi Yan <ziy@nvidia.com> --- Hi Mina, I dropped your Reviewed-by tag since there are updates on some comments in network part. Can I still keep your Reviewed-by? Byungchul --- .../net/ethernet/mellanox/mlx5/core/en/xdp.c | 2 +- include/linux/mm.h | 27 +++---------------- include/linux/page-flags.h | 6 +++++ include/net/netmem.h | 2 +- mm/page_alloc.c | 8 +++--- net/core/netmem_priv.h | 17 +++--------- net/core/page_pool.c | 14 +++++----- 7 files changed, 25 insertions(+), 51 deletions(-) diff --git a/drivers/net/ethernet/mellanox/mlx5/core/en/xdp.c b/drivers/net/ethernet/mellanox/mlx5/core/en/xdp.c index 5d51600935a6..def274f5c1ca 100644 --- a/drivers/net/ethernet/mellanox/mlx5/core/en/xdp.c +++ b/drivers/net/ethernet/mellanox/mlx5/core/en/xdp.c @@ -707,7 +707,7 @@ static void mlx5e_free_xdpsq_desc(struct mlx5e_xdpsq *sq, xdpi = mlx5e_xdpi_fifo_pop(xdpi_fifo); page = xdpi.page.page; - /* No need to check page_pool_page_is_pp() as we + /* No need to check PageNetpp() as we * know this is a page_pool page. */ page_pool_recycle_direct(pp_page_to_nmdesc(page)->pp, diff --git a/include/linux/mm.h b/include/linux/mm.h index b6fdf3557807..f5155f1c75f5 100644 --- a/include/linux/mm.h +++ b/include/linux/mm.h @@ -4361,10 +4361,9 @@ int arch_lock_shadow_stack_status(struct task_struct *t, unsigned long status); * DMA mapping IDs for page_pool * * When DMA-mapping a page, page_pool allocates an ID (from an xarray) and - * stashes it in the upper bits of page->pp_magic. We always want to be able to - * unambiguously identify page pool pages (using page_pool_page_is_pp()). Non-PP - * pages can have arbitrary kernel pointers stored in the same field as pp_magic - * (since it overlaps with page->lru.next), so we must ensure that we cannot + * stashes it in the upper bits of page->pp_magic. Non-PP pages can have + * arbitrary kernel pointers stored in the same field as pp_magic (since + * it overlaps with page->lru.next), so we must ensure that we cannot * mistake a valid kernel pointer with any of the values we write into this * field. * @@ -4399,26 +4398,6 @@ int arch_lock_shadow_stack_status(struct task_struct *t, unsigned long status); #define PP_DMA_INDEX_MASK GENMASK(PP_DMA_INDEX_BITS + PP_DMA_INDEX_SHIFT - 1, \ PP_DMA_INDEX_SHIFT) -/* Mask used for checking in page_pool_page_is_pp() below. page->pp_magic is - * OR'ed with PP_SIGNATURE after the allocation in order to preserve bit 0 for - * the head page of compound page and bit 1 for pfmemalloc page, as well as the - * bits used for the DMA index. page_is_pfmemalloc() is checked in - * __page_pool_put_page() to avoid recycling the pfmemalloc page. - */ -#define PP_MAGIC_MASK ~(PP_DMA_INDEX_MASK | 0x3UL) - -#ifdef CONFIG_PAGE_POOL -static inline bool page_pool_page_is_pp(const struct page *page) -{ - return (page->pp_magic & PP_MAGIC_MASK) == PP_SIGNATURE; -} -#else -static inline bool page_pool_page_is_pp(const struct page *page) -{ - return false; -} -#endif - #define PAGE_SNAPSHOT_FAITHFUL (1 << 0) #define PAGE_SNAPSHOT_PG_BUDDY (1 << 1) #define PAGE_SNAPSHOT_PG_IDLE (1 << 2) diff --git a/include/linux/page-flags.h b/include/linux/page-flags.h index 0091ad1986bf..edf5418c91dd 100644 --- a/include/linux/page-flags.h +++ b/include/linux/page-flags.h @@ -934,6 +934,7 @@ enum pagetype { PGTY_zsmalloc = 0xf6, PGTY_unaccepted = 0xf7, PGTY_large_kmalloc = 0xf8, + PGTY_netpp = 0xf9, PGTY_mapcount_underflow = 0xff }; @@ -1078,6 +1079,11 @@ PAGE_TYPE_OPS(Zsmalloc, zsmalloc, zsmalloc) PAGE_TYPE_OPS(Unaccepted, unaccepted, unaccepted) FOLIO_TYPE_OPS(large_kmalloc, large_kmalloc) +/* + * Marks page_pool allocated pages. + */ +PAGE_TYPE_OPS(Netpp, netpp, netpp) + /** * PageHuge - Determine if the page belongs to hugetlbfs * @page: The page to test. diff --git a/include/net/netmem.h b/include/net/netmem.h index 651e2c62d1dd..0ec4c7561081 100644 --- a/include/net/netmem.h +++ b/include/net/netmem.h @@ -260,7 +260,7 @@ static inline unsigned long netmem_pfn_trace(netmem_ref netmem) */ #define pp_page_to_nmdesc(p) \ ({ \ - DEBUG_NET_WARN_ON_ONCE(!page_pool_page_is_pp(p)); \ + DEBUG_NET_WARN_ON_ONCE(!PageNetpp(p)); \ __pp_page_to_nmdesc(p); \ }) diff --git a/mm/page_alloc.c b/mm/page_alloc.c index fb91c566327c..c69ed3741bbc 100644 --- a/mm/page_alloc.c +++ b/mm/page_alloc.c @@ -1042,7 +1042,6 @@ static inline bool page_expected_state(struct page *page, #ifdef CONFIG_MEMCG page->memcg_data | #endif - page_pool_page_is_pp(page) | (page->flags.f & check_flags))) return false; @@ -1069,8 +1068,6 @@ static const char *page_bad_reason(struct page *page, unsigned long flags) if (unlikely(page->memcg_data)) bad_reason = "page still charged to cgroup"; #endif - if (unlikely(page_pool_page_is_pp(page))) - bad_reason = "page_pool leak"; return bad_reason; } @@ -1379,9 +1376,12 @@ __always_inline bool free_pages_prepare(struct page *page, mod_mthp_stat(order, MTHP_STAT_NR_ANON, -1); folio->mapping = NULL; } - if (unlikely(page_has_type(page))) + if (unlikely(page_has_type(page))) { + /* networking expects to clear its page type before releasing */ + WARN_ON_ONCE(PageNetpp(page)); /* Reset the page_type (which overlays _mapcount) */ page->page_type = UINT_MAX; + } if (is_check_pages_enabled()) { if (free_page_is_bad(page)) diff --git a/net/core/netmem_priv.h b/net/core/netmem_priv.h index 5561fd556bc5..664a9fe87c66 100644 --- a/net/core/netmem_priv.h +++ b/net/core/netmem_priv.h @@ -8,18 +8,6 @@ static inline unsigned long netmem_get_pp_magic(netmem_ref netmem) return netmem_to_nmdesc(netmem)->pp_magic & ~PP_DMA_INDEX_MASK; } -static inline void netmem_or_pp_magic(netmem_ref netmem, unsigned long pp_magic) -{ - netmem_to_nmdesc(netmem)->pp_magic |= pp_magic; -} - -static inline void netmem_clear_pp_magic(netmem_ref netmem) -{ - WARN_ON_ONCE(netmem_to_nmdesc(netmem)->pp_magic & PP_DMA_INDEX_MASK); - - netmem_to_nmdesc(netmem)->pp_magic = 0; -} - static inline bool netmem_is_pp(netmem_ref netmem) { /* net_iov may be part of a page pool. For net_iov, ->pp in @@ -30,7 +18,10 @@ static inline bool netmem_is_pp(netmem_ref netmem) if (netmem_is_net_iov(netmem)) return !!netmem_to_nmdesc(netmem)->pp; - return (netmem_get_pp_magic(netmem) & PP_MAGIC_MASK) == PP_SIGNATURE; + /* For system memory, page type in struct page can be used to + * determine if the pages belong to a page pool. + */ + return PageNetpp(__netmem_to_page(netmem)); } static inline void netmem_set_pp(netmem_ref netmem, struct page_pool *pool) diff --git a/net/core/page_pool.c b/net/core/page_pool.c index 2756b78754b0..c43a0f4479d4 100644 --- a/net/core/page_pool.c +++ b/net/core/page_pool.c @@ -700,12 +700,11 @@ void page_pool_set_pp_info(struct page_pool *pool, netmem_ref netmem) { netmem_set_pp(netmem, pool); - /* For page-backed, pp_magic is used to identify if it's pp. - * For net_iov, it's ensured nmdesc->pp is non-NULL if it's pp - * and nmdesc->pp is NULL if it's not. + /* For system memory, page type in struct page is used to + * determine if the pages belong to a page pool. */ if (!netmem_is_net_iov(netmem)) - netmem_or_pp_magic(netmem, PP_SIGNATURE); + __SetPageNetpp(__netmem_to_page(netmem)); /* Ensuring all pages have been split into one fragment initially: * page_pool_set_pp_info() is only called once for every page when it @@ -720,12 +719,11 @@ void page_pool_set_pp_info(struct page_pool *pool, netmem_ref netmem) void page_pool_clear_pp_info(netmem_ref netmem) { - /* For page-backed, pp_magic is used to identify if it's pp. - * For net_iov, it's ensured nmdesc->pp is non-NULL if it's pp - * and nmdesc->pp is NULL if it's not. + /* For system memory, page type in struct page is used to + * determine if the pages belong to a page pool. */ if (!netmem_is_net_iov(netmem)) - netmem_clear_pp_magic(netmem); + __ClearPageNetpp(__netmem_to_page(netmem)); netmem_set_pp(netmem, NULL); } -- 2.17.1 ^ permalink raw reply related [flat|nested] 10+ messages in thread
* Re: [RFC mm v4 2/2] mm: introduce a new page type for page pool in page type 2025-10-23 7:44 ` [RFC mm v4 2/2] mm: introduce a new page type for page pool in page type Byungchul Park @ 2025-10-28 1:28 ` Mina Almasry 2025-10-28 1:45 ` Zi Yan 0 siblings, 1 reply; 10+ messages in thread From: Mina Almasry @ 2025-10-28 1:28 UTC (permalink / raw) To: Byungchul Park Cc: linux-mm, netdev, linux-kernel, kernel_team, harry.yoo, ast, daniel, davem, kuba, hawk, john.fastabend, sdf, saeedm, leon, tariqt, mbloch, andrew+netdev, edumazet, pabeni, akpm, david, lorenzo.stoakes, Liam.Howlett, vbabka, rppt, surenb, mhocko, horms, jackmanb, hannes, ziy, ilias.apalodimas, willy, brauner, kas, yuzhao, usamaarif642, baolin.wang, toke, asml.silence, bpf, linux-rdma, sfr, dw, ap420073, dtatulea On Thu, Oct 23, 2025 at 12:45 AM Byungchul Park <byungchul@sk.com> wrote: > > ->pp_magic field in struct page is current used to identify if a page > belongs to a page pool. However, ->pp_magic will be removed and page > type bit in struct page e.i. PGTY_netpp can be used for that purpose. > > Introduce and use the page type APIs e.g. PageNetpp(), __SetPageNetpp(), > and __ClearPageNetpp() instead, and remove the existing APIs accessing > ->pp_magic e.g. page_pool_page_is_pp(), netmem_or_pp_magic(), and > netmem_clear_pp_magic(). > > This work was inspired by the following link: > > [1] https://lore.kernel.org/all/582f41c0-2742-4400-9c81-0d46bf4e8314@gmail.com/ > > While at it, move the sanity check for page pool to on free. > > Suggested-by: David Hildenbrand <david@redhat.com> > Co-developed-by: Pavel Begunkov <asml.silence@gmail.com> > Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> > Signed-off-by: Byungchul Park <byungchul@sk.com> > Acked-by: David Hildenbrand <david@redhat.com> > Acked-by: Zi Yan <ziy@nvidia.com> > --- > Hi Mina, > > I dropped your Reviewed-by tag since there are updates on some comments > in network part. Can I still keep your Reviewed-by? > > Byungchul > --- > .../net/ethernet/mellanox/mlx5/core/en/xdp.c | 2 +- > include/linux/mm.h | 27 +++---------------- > include/linux/page-flags.h | 6 +++++ > include/net/netmem.h | 2 +- > mm/page_alloc.c | 8 +++--- > net/core/netmem_priv.h | 17 +++--------- > net/core/page_pool.c | 14 +++++----- > 7 files changed, 25 insertions(+), 51 deletions(-) > > diff --git a/drivers/net/ethernet/mellanox/mlx5/core/en/xdp.c b/drivers/net/ethernet/mellanox/mlx5/core/en/xdp.c > index 5d51600935a6..def274f5c1ca 100644 > --- a/drivers/net/ethernet/mellanox/mlx5/core/en/xdp.c > +++ b/drivers/net/ethernet/mellanox/mlx5/core/en/xdp.c > @@ -707,7 +707,7 @@ static void mlx5e_free_xdpsq_desc(struct mlx5e_xdpsq *sq, > xdpi = mlx5e_xdpi_fifo_pop(xdpi_fifo); > page = xdpi.page.page; > > - /* No need to check page_pool_page_is_pp() as we > + /* No need to check PageNetpp() as we > * know this is a page_pool page. > */ > page_pool_recycle_direct(pp_page_to_nmdesc(page)->pp, > diff --git a/include/linux/mm.h b/include/linux/mm.h > index b6fdf3557807..f5155f1c75f5 100644 > --- a/include/linux/mm.h > +++ b/include/linux/mm.h > @@ -4361,10 +4361,9 @@ int arch_lock_shadow_stack_status(struct task_struct *t, unsigned long status); > * DMA mapping IDs for page_pool > * > * When DMA-mapping a page, page_pool allocates an ID (from an xarray) and > - * stashes it in the upper bits of page->pp_magic. We always want to be able to > - * unambiguously identify page pool pages (using page_pool_page_is_pp()). Non-PP > - * pages can have arbitrary kernel pointers stored in the same field as pp_magic > - * (since it overlaps with page->lru.next), so we must ensure that we cannot > + * stashes it in the upper bits of page->pp_magic. Non-PP pages can have > + * arbitrary kernel pointers stored in the same field as pp_magic (since > + * it overlaps with page->lru.next), so we must ensure that we cannot > * mistake a valid kernel pointer with any of the values we write into this > * field. > * > @@ -4399,26 +4398,6 @@ int arch_lock_shadow_stack_status(struct task_struct *t, unsigned long status); > #define PP_DMA_INDEX_MASK GENMASK(PP_DMA_INDEX_BITS + PP_DMA_INDEX_SHIFT - 1, \ > PP_DMA_INDEX_SHIFT) > > -/* Mask used for checking in page_pool_page_is_pp() below. page->pp_magic is > - * OR'ed with PP_SIGNATURE after the allocation in order to preserve bit 0 for > - * the head page of compound page and bit 1 for pfmemalloc page, as well as the > - * bits used for the DMA index. page_is_pfmemalloc() is checked in > - * __page_pool_put_page() to avoid recycling the pfmemalloc page. > - */ > -#define PP_MAGIC_MASK ~(PP_DMA_INDEX_MASK | 0x3UL) > - > -#ifdef CONFIG_PAGE_POOL > -static inline bool page_pool_page_is_pp(const struct page *page) > -{ > - return (page->pp_magic & PP_MAGIC_MASK) == PP_SIGNATURE; > -} > -#else > -static inline bool page_pool_page_is_pp(const struct page *page) > -{ > - return false; > -} > -#endif > - > #define PAGE_SNAPSHOT_FAITHFUL (1 << 0) > #define PAGE_SNAPSHOT_PG_BUDDY (1 << 1) > #define PAGE_SNAPSHOT_PG_IDLE (1 << 2) > diff --git a/include/linux/page-flags.h b/include/linux/page-flags.h > index 0091ad1986bf..edf5418c91dd 100644 > --- a/include/linux/page-flags.h > +++ b/include/linux/page-flags.h > @@ -934,6 +934,7 @@ enum pagetype { > PGTY_zsmalloc = 0xf6, > PGTY_unaccepted = 0xf7, > PGTY_large_kmalloc = 0xf8, > + PGTY_netpp = 0xf9, > > PGTY_mapcount_underflow = 0xff > }; > @@ -1078,6 +1079,11 @@ PAGE_TYPE_OPS(Zsmalloc, zsmalloc, zsmalloc) > PAGE_TYPE_OPS(Unaccepted, unaccepted, unaccepted) > FOLIO_TYPE_OPS(large_kmalloc, large_kmalloc) > > +/* > + * Marks page_pool allocated pages. > + */ > +PAGE_TYPE_OPS(Netpp, netpp, netpp) > + > /** > * PageHuge - Determine if the page belongs to hugetlbfs > * @page: The page to test. > diff --git a/include/net/netmem.h b/include/net/netmem.h > index 651e2c62d1dd..0ec4c7561081 100644 > --- a/include/net/netmem.h > +++ b/include/net/netmem.h > @@ -260,7 +260,7 @@ static inline unsigned long netmem_pfn_trace(netmem_ref netmem) > */ > #define pp_page_to_nmdesc(p) \ > ({ \ > - DEBUG_NET_WARN_ON_ONCE(!page_pool_page_is_pp(p)); \ > + DEBUG_NET_WARN_ON_ONCE(!PageNetpp(p)); \ > __pp_page_to_nmdesc(p); \ > }) > > diff --git a/mm/page_alloc.c b/mm/page_alloc.c > index fb91c566327c..c69ed3741bbc 100644 > --- a/mm/page_alloc.c > +++ b/mm/page_alloc.c > @@ -1042,7 +1042,6 @@ static inline bool page_expected_state(struct page *page, > #ifdef CONFIG_MEMCG > page->memcg_data | > #endif > - page_pool_page_is_pp(page) | Shouldn't you replace the page_pool_page_is_pp check with a PageNetpp check in this call site and below? Or is that no longer necessary for some reason? ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [RFC mm v4 2/2] mm: introduce a new page type for page pool in page type 2025-10-28 1:28 ` Mina Almasry @ 2025-10-28 1:45 ` Zi Yan 2025-10-28 16:12 ` Mina Almasry 0 siblings, 1 reply; 10+ messages in thread From: Zi Yan @ 2025-10-28 1:45 UTC (permalink / raw) To: Mina Almasry Cc: Byungchul Park, linux-mm, netdev, linux-kernel, kernel_team, harry.yoo, ast, daniel, davem, kuba, hawk, john.fastabend, sdf, saeedm, leon, tariqt, mbloch, andrew+netdev, edumazet, pabeni, akpm, david, lorenzo.stoakes, Liam.Howlett, vbabka, rppt, surenb, mhocko, horms, jackmanb, hannes, ilias.apalodimas, willy, brauner, kas, yuzhao, usamaarif642, baolin.wang, toke, asml.silence, bpf, linux-rdma, sfr, dw, ap420073, dtatulea On 27 Oct 2025, at 21:28, Mina Almasry wrote: > On Thu, Oct 23, 2025 at 12:45 AM Byungchul Park <byungchul@sk.com> wrote: >> >> ->pp_magic field in struct page is current used to identify if a page >> belongs to a page pool. However, ->pp_magic will be removed and page >> type bit in struct page e.i. PGTY_netpp can be used for that purpose. >> >> Introduce and use the page type APIs e.g. PageNetpp(), __SetPageNetpp(), >> and __ClearPageNetpp() instead, and remove the existing APIs accessing >> ->pp_magic e.g. page_pool_page_is_pp(), netmem_or_pp_magic(), and >> netmem_clear_pp_magic(). >> >> This work was inspired by the following link: >> >> [1] https://lore.kernel.org/all/582f41c0-2742-4400-9c81-0d46bf4e8314@gmail.com/ >> >> While at it, move the sanity check for page pool to on free. >> >> Suggested-by: David Hildenbrand <david@redhat.com> >> Co-developed-by: Pavel Begunkov <asml.silence@gmail.com> >> Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> >> Signed-off-by: Byungchul Park <byungchul@sk.com> >> Acked-by: David Hildenbrand <david@redhat.com> >> Acked-by: Zi Yan <ziy@nvidia.com> >> --- >> Hi Mina, >> >> I dropped your Reviewed-by tag since there are updates on some comments >> in network part. Can I still keep your Reviewed-by? >> >> Byungchul >> --- >> .../net/ethernet/mellanox/mlx5/core/en/xdp.c | 2 +- >> include/linux/mm.h | 27 +++---------------- >> include/linux/page-flags.h | 6 +++++ >> include/net/netmem.h | 2 +- >> mm/page_alloc.c | 8 +++--- >> net/core/netmem_priv.h | 17 +++--------- >> net/core/page_pool.c | 14 +++++----- >> 7 files changed, 25 insertions(+), 51 deletions(-) >> >> diff --git a/drivers/net/ethernet/mellanox/mlx5/core/en/xdp.c b/drivers/net/ethernet/mellanox/mlx5/core/en/xdp.c >> index 5d51600935a6..def274f5c1ca 100644 >> --- a/drivers/net/ethernet/mellanox/mlx5/core/en/xdp.c >> +++ b/drivers/net/ethernet/mellanox/mlx5/core/en/xdp.c >> @@ -707,7 +707,7 @@ static void mlx5e_free_xdpsq_desc(struct mlx5e_xdpsq *sq, >> xdpi = mlx5e_xdpi_fifo_pop(xdpi_fifo); >> page = xdpi.page.page; >> >> - /* No need to check page_pool_page_is_pp() as we >> + /* No need to check PageNetpp() as we >> * know this is a page_pool page. >> */ >> page_pool_recycle_direct(pp_page_to_nmdesc(page)->pp, >> diff --git a/include/linux/mm.h b/include/linux/mm.h >> index b6fdf3557807..f5155f1c75f5 100644 >> --- a/include/linux/mm.h >> +++ b/include/linux/mm.h >> @@ -4361,10 +4361,9 @@ int arch_lock_shadow_stack_status(struct task_struct *t, unsigned long status); >> * DMA mapping IDs for page_pool >> * >> * When DMA-mapping a page, page_pool allocates an ID (from an xarray) and >> - * stashes it in the upper bits of page->pp_magic. We always want to be able to >> - * unambiguously identify page pool pages (using page_pool_page_is_pp()). Non-PP >> - * pages can have arbitrary kernel pointers stored in the same field as pp_magic >> - * (since it overlaps with page->lru.next), so we must ensure that we cannot >> + * stashes it in the upper bits of page->pp_magic. Non-PP pages can have >> + * arbitrary kernel pointers stored in the same field as pp_magic (since >> + * it overlaps with page->lru.next), so we must ensure that we cannot >> * mistake a valid kernel pointer with any of the values we write into this >> * field. >> * >> @@ -4399,26 +4398,6 @@ int arch_lock_shadow_stack_status(struct task_struct *t, unsigned long status); >> #define PP_DMA_INDEX_MASK GENMASK(PP_DMA_INDEX_BITS + PP_DMA_INDEX_SHIFT - 1, \ >> PP_DMA_INDEX_SHIFT) >> >> -/* Mask used for checking in page_pool_page_is_pp() below. page->pp_magic is >> - * OR'ed with PP_SIGNATURE after the allocation in order to preserve bit 0 for >> - * the head page of compound page and bit 1 for pfmemalloc page, as well as the >> - * bits used for the DMA index. page_is_pfmemalloc() is checked in >> - * __page_pool_put_page() to avoid recycling the pfmemalloc page. >> - */ >> -#define PP_MAGIC_MASK ~(PP_DMA_INDEX_MASK | 0x3UL) >> - >> -#ifdef CONFIG_PAGE_POOL >> -static inline bool page_pool_page_is_pp(const struct page *page) >> -{ >> - return (page->pp_magic & PP_MAGIC_MASK) == PP_SIGNATURE; >> -} >> -#else >> -static inline bool page_pool_page_is_pp(const struct page *page) >> -{ >> - return false; >> -} >> -#endif >> - >> #define PAGE_SNAPSHOT_FAITHFUL (1 << 0) >> #define PAGE_SNAPSHOT_PG_BUDDY (1 << 1) >> #define PAGE_SNAPSHOT_PG_IDLE (1 << 2) >> diff --git a/include/linux/page-flags.h b/include/linux/page-flags.h >> index 0091ad1986bf..edf5418c91dd 100644 >> --- a/include/linux/page-flags.h >> +++ b/include/linux/page-flags.h >> @@ -934,6 +934,7 @@ enum pagetype { >> PGTY_zsmalloc = 0xf6, >> PGTY_unaccepted = 0xf7, >> PGTY_large_kmalloc = 0xf8, >> + PGTY_netpp = 0xf9, >> >> PGTY_mapcount_underflow = 0xff >> }; >> @@ -1078,6 +1079,11 @@ PAGE_TYPE_OPS(Zsmalloc, zsmalloc, zsmalloc) >> PAGE_TYPE_OPS(Unaccepted, unaccepted, unaccepted) >> FOLIO_TYPE_OPS(large_kmalloc, large_kmalloc) >> >> +/* >> + * Marks page_pool allocated pages. >> + */ >> +PAGE_TYPE_OPS(Netpp, netpp, netpp) >> + >> /** >> * PageHuge - Determine if the page belongs to hugetlbfs >> * @page: The page to test. >> diff --git a/include/net/netmem.h b/include/net/netmem.h >> index 651e2c62d1dd..0ec4c7561081 100644 >> --- a/include/net/netmem.h >> +++ b/include/net/netmem.h >> @@ -260,7 +260,7 @@ static inline unsigned long netmem_pfn_trace(netmem_ref netmem) >> */ >> #define pp_page_to_nmdesc(p) \ >> ({ \ >> - DEBUG_NET_WARN_ON_ONCE(!page_pool_page_is_pp(p)); \ >> + DEBUG_NET_WARN_ON_ONCE(!PageNetpp(p)); \ >> __pp_page_to_nmdesc(p); \ >> }) >> >> diff --git a/mm/page_alloc.c b/mm/page_alloc.c >> index fb91c566327c..c69ed3741bbc 100644 >> --- a/mm/page_alloc.c >> +++ b/mm/page_alloc.c >> @@ -1042,7 +1042,6 @@ static inline bool page_expected_state(struct page *page, >> #ifdef CONFIG_MEMCG >> page->memcg_data | >> #endif >> - page_pool_page_is_pp(page) | > > Shouldn't you replace the page_pool_page_is_pp check with a PageNetpp > check in this call site and below? Or is that no longer necessary for > some reason? It is done in the hunk below this one: @@ -1379,9 +1376,12 @@ __always_inline bool free_pages_prepare(struct page *page, mod_mthp_stat(order, MTHP_STAT_NR_ANON, -1); folio->mapping = NULL; } - if (unlikely(page_has_type(page))) + if (unlikely(page_has_type(page))) { + /* networking expects to clear its page type before releasing */ + WARN_ON_ONCE(PageNetpp(page)); /* Reset the page_type (which overlays _mapcount) */ page->page_type = UINT_MAX; + } if (is_check_pages_enabled()) { if (free_page_is_bad(page)) where free_pages_prepare() -> free_page_is_bad() -> page_expected_state() -- Best Regards, Yan, Zi ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [RFC mm v4 2/2] mm: introduce a new page type for page pool in page type 2025-10-28 1:45 ` Zi Yan @ 2025-10-28 16:12 ` Mina Almasry 0 siblings, 0 replies; 10+ messages in thread From: Mina Almasry @ 2025-10-28 16:12 UTC (permalink / raw) To: Zi Yan Cc: Byungchul Park, linux-mm, netdev, linux-kernel, kernel_team, harry.yoo, ast, daniel, davem, kuba, hawk, john.fastabend, sdf, saeedm, leon, tariqt, mbloch, andrew+netdev, edumazet, pabeni, akpm, david, lorenzo.stoakes, Liam.Howlett, vbabka, rppt, surenb, mhocko, horms, jackmanb, hannes, ilias.apalodimas, willy, brauner, kas, yuzhao, usamaarif642, baolin.wang, toke, asml.silence, bpf, linux-rdma, sfr, dw, ap420073, dtatulea On Mon, Oct 27, 2025 at 6:45 PM Zi Yan <ziy@nvidia.com> wrote: > > On 27 Oct 2025, at 21:28, Mina Almasry wrote: > > > On Thu, Oct 23, 2025 at 12:45 AM Byungchul Park <byungchul@sk.com> wrote: > >> > >> ->pp_magic field in struct page is current used to identify if a page > >> belongs to a page pool. However, ->pp_magic will be removed and page > >> type bit in struct page e.i. PGTY_netpp can be used for that purpose. > >> > >> Introduce and use the page type APIs e.g. PageNetpp(), __SetPageNetpp(), > >> and __ClearPageNetpp() instead, and remove the existing APIs accessing > >> ->pp_magic e.g. page_pool_page_is_pp(), netmem_or_pp_magic(), and > >> netmem_clear_pp_magic(). > >> > >> This work was inspired by the following link: > >> > >> [1] https://lore.kernel.org/all/582f41c0-2742-4400-9c81-0d46bf4e8314@gmail.com/ > >> > >> While at it, move the sanity check for page pool to on free. > >> > >> Suggested-by: David Hildenbrand <david@redhat.com> > >> Co-developed-by: Pavel Begunkov <asml.silence@gmail.com> > >> Signed-off-by: Pavel Begunkov <asml.silence@gmail.com> > >> Signed-off-by: Byungchul Park <byungchul@sk.com> > >> Acked-by: David Hildenbrand <david@redhat.com> > >> Acked-by: Zi Yan <ziy@nvidia.com> > >> --- > >> Hi Mina, > >> > >> I dropped your Reviewed-by tag since there are updates on some comments > >> in network part. Can I still keep your Reviewed-by? > >> > >> Byungchul > >> --- > >> .../net/ethernet/mellanox/mlx5/core/en/xdp.c | 2 +- > >> include/linux/mm.h | 27 +++---------------- > >> include/linux/page-flags.h | 6 +++++ > >> include/net/netmem.h | 2 +- > >> mm/page_alloc.c | 8 +++--- > >> net/core/netmem_priv.h | 17 +++--------- > >> net/core/page_pool.c | 14 +++++----- > >> 7 files changed, 25 insertions(+), 51 deletions(-) > >> > >> diff --git a/drivers/net/ethernet/mellanox/mlx5/core/en/xdp.c b/drivers/net/ethernet/mellanox/mlx5/core/en/xdp.c > >> index 5d51600935a6..def274f5c1ca 100644 > >> --- a/drivers/net/ethernet/mellanox/mlx5/core/en/xdp.c > >> +++ b/drivers/net/ethernet/mellanox/mlx5/core/en/xdp.c > >> @@ -707,7 +707,7 @@ static void mlx5e_free_xdpsq_desc(struct mlx5e_xdpsq *sq, > >> xdpi = mlx5e_xdpi_fifo_pop(xdpi_fifo); > >> page = xdpi.page.page; > >> > >> - /* No need to check page_pool_page_is_pp() as we > >> + /* No need to check PageNetpp() as we > >> * know this is a page_pool page. > >> */ > >> page_pool_recycle_direct(pp_page_to_nmdesc(page)->pp, > >> diff --git a/include/linux/mm.h b/include/linux/mm.h > >> index b6fdf3557807..f5155f1c75f5 100644 > >> --- a/include/linux/mm.h > >> +++ b/include/linux/mm.h > >> @@ -4361,10 +4361,9 @@ int arch_lock_shadow_stack_status(struct task_struct *t, unsigned long status); > >> * DMA mapping IDs for page_pool > >> * > >> * When DMA-mapping a page, page_pool allocates an ID (from an xarray) and > >> - * stashes it in the upper bits of page->pp_magic. We always want to be able to > >> - * unambiguously identify page pool pages (using page_pool_page_is_pp()). Non-PP > >> - * pages can have arbitrary kernel pointers stored in the same field as pp_magic > >> - * (since it overlaps with page->lru.next), so we must ensure that we cannot > >> + * stashes it in the upper bits of page->pp_magic. Non-PP pages can have > >> + * arbitrary kernel pointers stored in the same field as pp_magic (since > >> + * it overlaps with page->lru.next), so we must ensure that we cannot > >> * mistake a valid kernel pointer with any of the values we write into this > >> * field. > >> * > >> @@ -4399,26 +4398,6 @@ int arch_lock_shadow_stack_status(struct task_struct *t, unsigned long status); > >> #define PP_DMA_INDEX_MASK GENMASK(PP_DMA_INDEX_BITS + PP_DMA_INDEX_SHIFT - 1, \ > >> PP_DMA_INDEX_SHIFT) > >> > >> -/* Mask used for checking in page_pool_page_is_pp() below. page->pp_magic is > >> - * OR'ed with PP_SIGNATURE after the allocation in order to preserve bit 0 for > >> - * the head page of compound page and bit 1 for pfmemalloc page, as well as the > >> - * bits used for the DMA index. page_is_pfmemalloc() is checked in > >> - * __page_pool_put_page() to avoid recycling the pfmemalloc page. > >> - */ > >> -#define PP_MAGIC_MASK ~(PP_DMA_INDEX_MASK | 0x3UL) > >> - > >> -#ifdef CONFIG_PAGE_POOL > >> -static inline bool page_pool_page_is_pp(const struct page *page) > >> -{ > >> - return (page->pp_magic & PP_MAGIC_MASK) == PP_SIGNATURE; > >> -} > >> -#else > >> -static inline bool page_pool_page_is_pp(const struct page *page) > >> -{ > >> - return false; > >> -} > >> -#endif > >> - > >> #define PAGE_SNAPSHOT_FAITHFUL (1 << 0) > >> #define PAGE_SNAPSHOT_PG_BUDDY (1 << 1) > >> #define PAGE_SNAPSHOT_PG_IDLE (1 << 2) > >> diff --git a/include/linux/page-flags.h b/include/linux/page-flags.h > >> index 0091ad1986bf..edf5418c91dd 100644 > >> --- a/include/linux/page-flags.h > >> +++ b/include/linux/page-flags.h > >> @@ -934,6 +934,7 @@ enum pagetype { > >> PGTY_zsmalloc = 0xf6, > >> PGTY_unaccepted = 0xf7, > >> PGTY_large_kmalloc = 0xf8, > >> + PGTY_netpp = 0xf9, > >> > >> PGTY_mapcount_underflow = 0xff > >> }; > >> @@ -1078,6 +1079,11 @@ PAGE_TYPE_OPS(Zsmalloc, zsmalloc, zsmalloc) > >> PAGE_TYPE_OPS(Unaccepted, unaccepted, unaccepted) > >> FOLIO_TYPE_OPS(large_kmalloc, large_kmalloc) > >> > >> +/* > >> + * Marks page_pool allocated pages. > >> + */ > >> +PAGE_TYPE_OPS(Netpp, netpp, netpp) > >> + > >> /** > >> * PageHuge - Determine if the page belongs to hugetlbfs > >> * @page: The page to test. > >> diff --git a/include/net/netmem.h b/include/net/netmem.h > >> index 651e2c62d1dd..0ec4c7561081 100644 > >> --- a/include/net/netmem.h > >> +++ b/include/net/netmem.h > >> @@ -260,7 +260,7 @@ static inline unsigned long netmem_pfn_trace(netmem_ref netmem) > >> */ > >> #define pp_page_to_nmdesc(p) \ > >> ({ \ > >> - DEBUG_NET_WARN_ON_ONCE(!page_pool_page_is_pp(p)); \ > >> + DEBUG_NET_WARN_ON_ONCE(!PageNetpp(p)); \ > >> __pp_page_to_nmdesc(p); \ > >> }) > >> > >> diff --git a/mm/page_alloc.c b/mm/page_alloc.c > >> index fb91c566327c..c69ed3741bbc 100644 > >> --- a/mm/page_alloc.c > >> +++ b/mm/page_alloc.c > >> @@ -1042,7 +1042,6 @@ static inline bool page_expected_state(struct page *page, > >> #ifdef CONFIG_MEMCG > >> page->memcg_data | > >> #endif > >> - page_pool_page_is_pp(page) | > > > > Shouldn't you replace the page_pool_page_is_pp check with a PageNetpp > > check in this call site and below? Or is that no longer necessary for > > some reason? > > It is done in the hunk below this one: > > @@ -1379,9 +1376,12 @@ __always_inline bool free_pages_prepare(struct page *page, > mod_mthp_stat(order, MTHP_STAT_NR_ANON, -1); > folio->mapping = NULL; > } > - if (unlikely(page_has_type(page))) > + if (unlikely(page_has_type(page))) { > + /* networking expects to clear its page type before releasing */ > + WARN_ON_ONCE(PageNetpp(page)); > /* Reset the page_type (which overlays _mapcount) */ > page->page_type = UINT_MAX; > + } > > if (is_check_pages_enabled()) { > if (free_page_is_bad(page)) > > where > free_pages_prepare() > -> free_page_is_bad() > -> page_expected_state() > Thanks, looks fine to me then. I'm not extremely familiar with this code so I won't give a Reviewed-by, but here is an ack, FWIW: Acked-by: Mina Almasry <almasrymina@google.com> -- Thanks, Mina ^ permalink raw reply [flat|nested] 10+ messages in thread
end of thread, other threads:[~2025-10-29 1:56 UTC | newest] Thread overview: 10+ messages (download: mbox.gz follow: Atom feed -- links below jump to the message on this page -- 2025-10-23 7:44 [RFC mm v4 0/2] mm, page_pool: introduce a new page type for page pool in page type Byungchul Park 2025-10-23 7:44 ` [RFC mm v4 1/2] page_pool: check if nmdesc->pp is !NULL to confirm its usage as pp for net_iov Byungchul Park 2025-10-28 1:25 ` Mina Almasry 2025-10-28 2:24 ` Byungchul Park 2025-10-29 1:33 ` Jakub Kicinski 2025-10-29 1:56 ` Byungchul Park 2025-10-23 7:44 ` [RFC mm v4 2/2] mm: introduce a new page type for page pool in page type Byungchul Park 2025-10-28 1:28 ` Mina Almasry 2025-10-28 1:45 ` Zi Yan 2025-10-28 16:12 ` Mina Almasry
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).