* [PATCH] drm/vmwgfx: release imported dma-buf when the BO is freed
@ 2026-09-29 20:59 Adam Lewis
2026-09-29 21:16 ` sashiko-bot
2026-10-01 22:16 ` Adam Lewis
0 siblings, 2 replies; 3+ messages in thread
From: Adam Lewis @ 2026-09-29 20:59 UTC (permalink / raw)
To: Zack Rusin
Cc: Broadcom internal kernel review list, Ian Forbes, dri-devel,
linux-kernel, Adam Lewis, stable
vmw_prime_import_sg_table() creates a BO for a foreign dma-buf through
drm_gem_prime_import_dev(), which attaches to the dma-buf, maps the
attachment and takes a reference on it. vmw_bo_free() never undoes
this, so each foreign import leaks the attachment, its sg table and the
dma-buf reference, and the exporter's pages stay pinned after the GEM
handle, the DRM file and the importing process are gone.
Any client that can open a render node and obtain a dma-buf from
another exporter (udmabuf, V4L2, another DRM device) can pin memory
without bound. KWin does so on its own in VMware guests: it wraps
wl_shm client buffers in udmabufs and imports them, leaking gigabytes
within days.
Call drm_prime_gem_destroy() for imported objects before releasing the
GEM object, as amdgpu, radeon and nouveau do. vmw_bo_free() is TTM's
destroy callback, so TTM is done with the reservation object shared
with the dma-buf by then.
Tested on 7.1.13 and 7.2.7 with a udmabuf import reproducer and on a
Plasma desktop, where KWin's imported client buffers are now released.
The leak was found and the fix written with the help of an LLM coding
assistant.
Fixes: b32233accefff ("drm/vmwgfx: Fix prime import/export")
Cc: stable@vger.kernel.org
Assisted-by: Claude:claude-fable-5.1
Signed-off-by: Adam Lewis <adam.j.lewis@gmail.com>
---
Notes (dropped on apply):
Security note: per Documentation/process/threat-model.rst an unprivileged
user must not be able to make the system unresponsive through unbounded
resource exhaustion. On a default systemd desktop every logged-in user
has a render node (0666) and /dev/udmabuf (uaccess ACL), which is all
this needs, and the pinned memory survives the triggering process. The
bug was found with AI assistance, so per security-bugs.rst it is treated
as public and the reproducer is not attached (available privately).
A CVE request will follow once the fix is in a released kernel.
Environment: VMware Fusion on an Apple M3 Max host, Fedora 44 aarch64
guest, vmwgfx 2.21.0, no swap. Found on 7.1.12/7.1.13 (Mesa 26.1.8,
KWin 6.7.4), confirmed on 7.2.7 (Mesa 26.2.3, KWin 6.7.5). The import
and destructor code is unchanged from v7.1 through v7.3-rc5 and current
drm-misc-fixes; b32233accefff went to stable # v6.6+. Not the same
issue as f739416dc555 ("drm/vmwgfx: drop dma_buf reference on
foreign-fd prime import"), which covers ttm_prime_fd_to_handle()'s
error path and was already in the kernels tested.
How it shows up: KWin wraps every wl_shm client buffer in a udmabuf and
imports it into vmwgfx, for scanout and, when it renders with llvmpipe
because svga reports "No 3D enabled", as a texture. Every import
leaked, so every client buffer stayed pinned: ~6 GB after a few days on
7.1. debugfs bufinfo then listed 961 live udmabufs, 954 of them still
attached to vmwgfx, while kwin_wayland held 35 dma-buf fds. On an
unpatched 7.2.7 boot, nr_foll_pin_released did not move at all in four
hours of desktop use, while MemAvailable fell to 2.8 of 24.5 GB.
Testing:
- reproducer (udmabuf -> PRIME_FD_TO_HANDLE -> GEM_CLOSE -> close the
dma-buf -> close the DRM fd): unpatched, the dma-buf outlives the
process with refcount 1 and vmwgfx still attached; patched (7.1.13
and 7.2.7), the pins are released as soon as the dma-buf fd is
closed;
- imported framebuffer: ADDFB2 + SETPLANE on/off + CLOSEFB through the
screen-target path on 7.1.13, and ADDFB2 + CLOSEFB on 7.2.7, both
release cleanly;
- Plasma desktop on 7.2.7 with the patch, 30 terminal windows opened
and closed: KWin created 298 udmabufs and 296 were freed (the other
two were still in use), drm_prime_gem_destroy() ran for 85 imported
objects, and the pin counters, slab usage and dma-buf census went
back to their baseline;
- builds without warnings with W=1 on drm-misc-fixes (e78a9fb).
Two related leaks on the same desktop, to be reported separately:
- Mesa's kms-dri-sw winsys releases GEM handles with MODE_DESTROY_DUMB,
which is EACCES on render nodes, so a compositor rendering with
llvmpipe on a render node leaks the handle of every imported buffer
(KWin up to 6.7.4; 6.7.5 falls back to the KMS node);
- vmw_buffer_prime_to_surface_base() creates a GEM handle the caller
never sees and WARNs for every foreign dma-buf.
With this fix those leaks last until the owning process exits; without
it they pin memory permanently too.
drivers/gpu/drm/vmwgfx/vmwgfx_bo.c | 3 +++
1 file changed, 3 insertions(+)
diff --git a/drivers/gpu/drm/vmwgfx/vmwgfx_bo.c b/drivers/gpu/drm/vmwgfx/vmwgfx_bo.c
index 9c7a73c..f226b32 100644
--- a/drivers/gpu/drm/vmwgfx/vmwgfx_bo.c
+++ b/drivers/gpu/drm/vmwgfx/vmwgfx_bo.c
@@ -31,6 +31,7 @@
#include "vmwgfx_resource_priv.h"
#include <drm/ttm/ttm_placement.h>
+#include <drm/drm_prime.h>
/**
* vmw_bo_free - vmw_bo destructor
@@ -69,6 +70,8 @@ static void vmw_bo_free(struct ttm_buffer_object *bo)
vmw_surface_unreference(&vbo->dumb_surface);
}
WARN_ON(!RB_EMPTY_ROOT(&vbo->res_tree));
+ if (drm_gem_is_imported(&vbo->tbo.base))
+ drm_prime_gem_destroy(&vbo->tbo.base, vbo->tbo.sg);
drm_gem_object_release(&vbo->tbo.base);
WARN_ON(vbo->dirty);
kfree(vbo);
base-commit: e78a9fb7a40c55ec2a70ae39903dde4f898af2ef
--
2.55.0
^ permalink raw reply related [flat|nested] 3+ messages in thread
* Re: [PATCH] drm/vmwgfx: release imported dma-buf when the BO is freed
2026-09-29 20:59 [PATCH] drm/vmwgfx: release imported dma-buf when the BO is freed Adam Lewis
@ 2026-09-29 21:16 ` sashiko-bot
2026-10-01 22:16 ` Adam Lewis
1 sibling, 0 replies; 3+ messages in thread
From: sashiko-bot @ 2026-09-29 21:16 UTC (permalink / raw)
To: Adam Lewis; +Cc: dri-devel
Thank you for your contribution! Sashiko AI review found 1 potential issue(s) to consider:
- [High] drm/vmwgfx: null pointer dereference and double-free in DMA unmap on prime import teardown
--
commit 5e0534afee105a8ad6c4fdcc95d44acdb11a1c6c
Author: Adam Lewis <adam.j.lewis@gmail.com>
drm/vmwgfx: release imported dma-buf when the BO is freed
vmw_prime_import_sg_table() creates a BO for a foreign dma-buf through
drm_gem_prime_import_dev(), which attaches to the dma-buf, maps the
attachment and takes a reference on it. vmw_bo_free() never undoes
this, so each foreign import leaks the attachment, its sg table and the
dma-buf reference.
> diff --git a/drivers/gpu/drm/vmwgfx/vmwgfx_bo.c b/drivers/gpu/drm/vmwgfx/vmwgfx_bo.c
> index 9c7a73c0b0dc3..f226b32312387 100644
> --- a/drivers/gpu/drm/vmwgfx/vmwgfx_bo.c
> +++ b/drivers/gpu/drm/vmwgfx/vmwgfx_bo.c
[ ... ]
> @@ -69,6 +70,8 @@ static void vmw_bo_free(struct ttm_buffer_object *bo)
> vmw_surface_unreference(&vbo->dumb_surface);
> }
> WARN_ON(!RB_EMPTY_ROOT(&vbo->res_tree));
> + if (drm_gem_is_imported(&vbo->tbo.base))
> + drm_prime_gem_destroy(&vbo->tbo.base, vbo->tbo.sg);
[Severity: High]
Does this trigger a null pointer dereference and double-free during DMA unmap?
For imported dma-bufs, ttm_bo_release() first calls
ttm_bo_cleanup_memtype_use(), which calls vmw_ttm_unmap_dma():
drivers/gpu/drm/vmwgfx/vmwgfx_ttm_buffer.c:vmw_ttm_unmap_dma() {
...
case vmw_dma_map_bind:
case vmw_dma_map_populate:
vmw_ttm_unmap_from_dma(vmw_tt);
sg_free_table(vmw_tt->vsgt.sgt);
vmw_tt->vsgt.sgt = NULL;
break;
...
}
This frees the exporter's sg_table arrays using sg_free_table(), setting
sgt->sgl to NULL but leaving sgt->nents intact.
Later, vmw_bo_free() calls drm_prime_gem_destroy(), prompting the exporter
to call dma_unmap_sgtable(). The unmap function passes sgt->sgl (which is now
NULL) to dma_unmap_sg_attrs(), resulting in a guaranteed null pointer
dereference when iterating over the scatterlist.
> drm_gem_object_release(&vbo->tbo.base);
> WARN_ON(vbo->dirty);
> kfree(vbo);
--
Sashiko AI review · https://sashiko.dev/#/patchset/20260929205928.230301-1-adam.j.lewis@gmail.com?part=1
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: [PATCH] drm/vmwgfx: release imported dma-buf when the BO is freed
2026-09-29 20:59 [PATCH] drm/vmwgfx: release imported dma-buf when the BO is freed Adam Lewis
2026-09-29 21:16 ` sashiko-bot
@ 2026-10-01 22:16 ` Adam Lewis
1 sibling, 0 replies; 3+ messages in thread
From: Adam Lewis @ 2026-10-01 22:16 UTC (permalink / raw)
To: dri-devel
[-- Attachment #1: Type: text/plain, Size: 5883 bytes --]
Sorry this was a dupe and is superseded by Michal TOMAs work here:
https://lists.freedesktop.org/archives/dri-devel/2026-September/595772.html
On Tue, Sep 29, 2026 at 5:02 PM Adam Lewis <adam.j.lewis@gmail.com> wrote:
> vmw_prime_import_sg_table() creates a BO for a foreign dma-buf through
> drm_gem_prime_import_dev(), which attaches to the dma-buf, maps the
> attachment and takes a reference on it. vmw_bo_free() never undoes
> this, so each foreign import leaks the attachment, its sg table and the
> dma-buf reference, and the exporter's pages stay pinned after the GEM
> handle, the DRM file and the importing process are gone.
>
> Any client that can open a render node and obtain a dma-buf from
> another exporter (udmabuf, V4L2, another DRM device) can pin memory
> without bound. KWin does so on its own in VMware guests: it wraps
> wl_shm client buffers in udmabufs and imports them, leaking gigabytes
> within days.
>
> Call drm_prime_gem_destroy() for imported objects before releasing the
> GEM object, as amdgpu, radeon and nouveau do. vmw_bo_free() is TTM's
> destroy callback, so TTM is done with the reservation object shared
> with the dma-buf by then.
>
> Tested on 7.1.13 and 7.2.7 with a udmabuf import reproducer and on a
> Plasma desktop, where KWin's imported client buffers are now released.
> The leak was found and the fix written with the help of an LLM coding
> assistant.
>
> Fixes: b32233accefff ("drm/vmwgfx: Fix prime import/export")
> Cc: stable@vger.kernel.org
> Assisted-by: Claude:claude-fable-5.1
> Signed-off-by: Adam Lewis <adam.j.lewis@gmail.com>
> ---
> Notes (dropped on apply):
>
> Security note: per Documentation/process/threat-model.rst an unprivileged
> user must not be able to make the system unresponsive through unbounded
> resource exhaustion. On a default systemd desktop every logged-in user
> has a render node (0666) and /dev/udmabuf (uaccess ACL), which is all
> this needs, and the pinned memory survives the triggering process. The
> bug was found with AI assistance, so per security-bugs.rst it is treated
> as public and the reproducer is not attached (available privately).
> A CVE request will follow once the fix is in a released kernel.
>
> Environment: VMware Fusion on an Apple M3 Max host, Fedora 44 aarch64
> guest, vmwgfx 2.21.0, no swap. Found on 7.1.12/7.1.13 (Mesa 26.1.8,
> KWin 6.7.4), confirmed on 7.2.7 (Mesa 26.2.3, KWin 6.7.5). The import
> and destructor code is unchanged from v7.1 through v7.3-rc5 and current
> drm-misc-fixes; b32233accefff went to stable # v6.6+. Not the same
> issue as f739416dc555 ("drm/vmwgfx: drop dma_buf reference on
> foreign-fd prime import"), which covers ttm_prime_fd_to_handle()'s
> error path and was already in the kernels tested.
>
> How it shows up: KWin wraps every wl_shm client buffer in a udmabuf and
> imports it into vmwgfx, for scanout and, when it renders with llvmpipe
> because svga reports "No 3D enabled", as a texture. Every import
> leaked, so every client buffer stayed pinned: ~6 GB after a few days on
> 7.1. debugfs bufinfo then listed 961 live udmabufs, 954 of them still
> attached to vmwgfx, while kwin_wayland held 35 dma-buf fds. On an
> unpatched 7.2.7 boot, nr_foll_pin_released did not move at all in four
> hours of desktop use, while MemAvailable fell to 2.8 of 24.5 GB.
>
> Testing:
> - reproducer (udmabuf -> PRIME_FD_TO_HANDLE -> GEM_CLOSE -> close the
> dma-buf -> close the DRM fd): unpatched, the dma-buf outlives the
> process with refcount 1 and vmwgfx still attached; patched (7.1.13
> and 7.2.7), the pins are released as soon as the dma-buf fd is
> closed;
> - imported framebuffer: ADDFB2 + SETPLANE on/off + CLOSEFB through the
> screen-target path on 7.1.13, and ADDFB2 + CLOSEFB on 7.2.7, both
> release cleanly;
> - Plasma desktop on 7.2.7 with the patch, 30 terminal windows opened
> and closed: KWin created 298 udmabufs and 296 were freed (the other
> two were still in use), drm_prime_gem_destroy() ran for 85 imported
> objects, and the pin counters, slab usage and dma-buf census went
> back to their baseline;
> - builds without warnings with W=1 on drm-misc-fixes (e78a9fb).
>
> Two related leaks on the same desktop, to be reported separately:
> - Mesa's kms-dri-sw winsys releases GEM handles with MODE_DESTROY_DUMB,
> which is EACCES on render nodes, so a compositor rendering with
> llvmpipe on a render node leaks the handle of every imported buffer
> (KWin up to 6.7.4; 6.7.5 falls back to the KMS node);
> - vmw_buffer_prime_to_surface_base() creates a GEM handle the caller
> never sees and WARNs for every foreign dma-buf.
> With this fix those leaks last until the owning process exits; without
> it they pin memory permanently too.
>
> drivers/gpu/drm/vmwgfx/vmwgfx_bo.c | 3 +++
> 1 file changed, 3 insertions(+)
>
> diff --git a/drivers/gpu/drm/vmwgfx/vmwgfx_bo.c
> b/drivers/gpu/drm/vmwgfx/vmwgfx_bo.c
> index 9c7a73c..f226b32 100644
> --- a/drivers/gpu/drm/vmwgfx/vmwgfx_bo.c
> +++ b/drivers/gpu/drm/vmwgfx/vmwgfx_bo.c
> @@ -31,6 +31,7 @@
> #include "vmwgfx_resource_priv.h"
>
> #include <drm/ttm/ttm_placement.h>
> +#include <drm/drm_prime.h>
>
> /**
> * vmw_bo_free - vmw_bo destructor
> @@ -69,6 +70,8 @@ static void vmw_bo_free(struct ttm_buffer_object *bo)
> vmw_surface_unreference(&vbo->dumb_surface);
> }
> WARN_ON(!RB_EMPTY_ROOT(&vbo->res_tree));
> + if (drm_gem_is_imported(&vbo->tbo.base))
> + drm_prime_gem_destroy(&vbo->tbo.base, vbo->tbo.sg);
> drm_gem_object_release(&vbo->tbo.base);
> WARN_ON(vbo->dirty);
> kfree(vbo);
>
> base-commit: e78a9fb7a40c55ec2a70ae39903dde4f898af2ef
> --
> 2.55.0
>
>
[-- Attachment #2: Type: text/html, Size: 6913 bytes --]
^ permalink raw reply [flat|nested] 3+ messages in thread
end of thread, other threads:[~2026-10-01 22:16 UTC | newest]
Thread overview: 3+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2026-09-29 20:59 [PATCH] drm/vmwgfx: release imported dma-buf when the BO is freed Adam Lewis
2026-09-29 21:16 ` sashiko-bot
2026-10-01 22:16 ` Adam Lewis
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox