* [PATCH v4 0/6] platform/raspberrypi: Add Broadcom Videocore shared memory support
@ 2026-09-16 14:25 Jai Luthra
2026-09-16 14:25 ` [PATCH v4 1/6] platform/raspberrypi: vchiq-mmal: Reset buffers_with_vpu on port_enable Jai Luthra
` (5 more replies)
0 siblings, 6 replies; 8+ messages in thread
From: Jai Luthra @ 2026-09-16 14:25 UTC (permalink / raw)
To: Florian Fainelli, Raspberry Pi Kernel Maintenance,
bcm-kernel-feedback-list, Greg Kroah-Hartman, Dave Stevenson,
Phil Elwell, Hans Verkuil, Mauro Carvalho Chehab
Cc: Stefan Wahren, Laurent Pinchart, Kieran Bingham, linux-arm-kernel,
linux-kernel, linux-rpi-kernel, linux-media, Jai Luthra, stable,
Dom Cobley, Alexander Winkowski, Juerg Haefliger
Hi,
The vc-sm-cma driver allows contiguous memory blocks to be imported into
the VideoCore VPU memory map. This series adds support for this driver
and changes to VCHIQ MMAL layer required to get it functional.
These changes have lived in the staging directory of the downstream
Raspberry Pi tree since quite some time, but are necessary for getting
the VCHIQ based peripherals like the ISP functional in mainline.
Thanks,
Jai
Signed-off-by: Jai Luthra <jai.luthra@ideasonboard.com>
---
Changes in v4:
- Rebase on v7.3-rc1
- Use Dave's .com email in commits and comments
- Cut out all userspace import and VPU alloc code (from Dave)
- Link to v3: https://lore.kernel.org/r/20260717-b4-vc-sm-cma-v3-0-6c4e77804e5d@ideasonboard.com
Changes in v3:
- Rebase on v7.2-rc1
- Fix lkp bot errors with Kconfig dependencies
- Switch from kzalloc with sizeof to kzalloc_obj
- Link to v2: https://lore.kernel.org/r/20260105-b4-vc-sm-cma-v2-0-4daea749ced9@ideasonboard.com
Changes in v2:
- Drop patches that are not related to vc-sm-cma, or used for codec and
not ISP, so that is v1 PATCH 1, 2, 4, 5, 6, 7, 8, 12
- Move v1 PATCH 11 to the top, adding a Fixes tag
- Don't use global singletons for storing `struct vchiq_device` in
VCHIQ, instead converting the existing device drivers (audio) to be
stored inside `struct vchiq_drv_mgmt`
- Update the vc-sm-cma driver to latest standards, like:
- Replace MODULE_ALIAS call with a proper device id_table
- Add kernel-doc comments for exported functions
- Move exported functions to a header under include/linux for use in
MMAL (and later V4L2 ISP and codec drivers)
- Use xarray instead of deprecated idr to map an integer ID to
imported/allocated buffer pointers
- Drop unnecessary pr_debug calls
- Replacing pr_xxx use with dev_xxx wherever possible
- Clean up stray comments
- Link to v1: https://lore.kernel.org/r/20251031-b4-vc-sm-cma-v1-0-0dd5c0ec3f5c@ideasonboard.com
---
Dave Stevenson (5):
platform/raspberrypi: vchiq-mmal: Reset buffers_with_vpu on port_enable
platform/raspberrypi: Add VideoCore shared memory support
platform/raspberrypi: vchiq-mmal: Use vc-sm-cma to support zero copy
platform/raspberrypi: vchiq-mmal: Support sending data to MMAL ports
platform/raspberrypi: vchiq: Register vc-sm-cma as a platform driver
Jai Luthra (1):
platform/raspberrypi: vchiq: Store audio device in driver management struct
MAINTAINERS | 7 +
drivers/platform/raspberrypi/Kconfig | 2 +
drivers/platform/raspberrypi/Makefile | 1 +
drivers/platform/raspberrypi/vc-sm-cma/Kconfig | 9 +
drivers/platform/raspberrypi/vc-sm-cma/Makefile | 5 +
drivers/platform/raspberrypi/vc-sm-cma/vc_sm.c | 806 +++++++++++++++++++++
drivers/platform/raspberrypi/vc-sm-cma/vc_sm.h | 64 ++
.../raspberrypi/vc-sm-cma/vc_sm_cma_vchi.c | 510 +++++++++++++
.../raspberrypi/vc-sm-cma/vc_sm_cma_vchi.h | 64 ++
.../platform/raspberrypi/vc-sm-cma/vc_sm_defs.h | 298 ++++++++
.../raspberrypi/vchiq-interface/vchiq_arm.c | 13 +-
drivers/platform/raspberrypi/vchiq-mmal/Kconfig | 3 +-
.../platform/raspberrypi/vchiq-mmal/mmal-common.h | 4 +
.../platform/raspberrypi/vchiq-mmal/mmal-vchiq.c | 85 ++-
.../platform/raspberrypi/vchiq-mmal/mmal-vchiq.h | 1 +
include/linux/raspberrypi/vc_sm_cma_ioctl.h | 110 +++
include/linux/raspberrypi/vc_sm_knl.h | 76 ++
include/linux/raspberrypi/vchiq_arm.h | 9 +
18 files changed, 2048 insertions(+), 19 deletions(-)
---
base-commit: e5e04726cdd043e309677071ab1b65a4b18f422b
change-id: 20251030-b4-vc-sm-cma-f6727c39cd25
Best regards,
--
Jai Luthra <jai.luthra@ideasonboard.com>
^ permalink raw reply [flat|nested] 8+ messages in thread* [PATCH v4 1/6] platform/raspberrypi: vchiq-mmal: Reset buffers_with_vpu on port_enable 2026-09-16 14:25 [PATCH v4 0/6] platform/raspberrypi: Add Broadcom Videocore shared memory support Jai Luthra @ 2026-09-16 14:25 ` Jai Luthra 2026-09-16 14:25 ` [PATCH v4 2/6] platform/raspberrypi: vchiq: Store audio device in driver management struct Jai Luthra ` (4 subsequent siblings) 5 siblings, 0 replies; 8+ messages in thread From: Jai Luthra @ 2026-09-16 14:25 UTC (permalink / raw) To: Florian Fainelli, Raspberry Pi Kernel Maintenance, bcm-kernel-feedback-list, Greg Kroah-Hartman, Dave Stevenson, Phil Elwell, Hans Verkuil, Mauro Carvalho Chehab Cc: Stefan Wahren, Laurent Pinchart, Kieran Bingham, linux-arm-kernel, linux-kernel, linux-rpi-kernel, linux-media, Jai Luthra, stable From: Dave Stevenson <dave.stevenson@raspberrypi.com> Should we go through the timeout failure case with port_disable not returning all buffers for whatever reason, the buffers_with_vpu counter gets left at a non-zero value, which will cause reference counting issues should the instance be reused. Reset the count when the port is enabled again, but before any buffers have been sent to the VPU. Fixes: 70ec64ccdaac ("staging: bcm2835-camera: Ensure all buffers are returned on disable") Cc: stable@vger.kernel.org Signed-off-by: Dave Stevenson <dave.stevenson@raspberrypi.com> Signed-off-by: Jai Luthra <jai.luthra@ideasonboard.com> --- drivers/platform/raspberrypi/vchiq-mmal/mmal-vchiq.c | 2 ++ 1 file changed, 2 insertions(+) diff --git a/drivers/platform/raspberrypi/vchiq-mmal/mmal-vchiq.c b/drivers/platform/raspberrypi/vchiq-mmal/mmal-vchiq.c index c89c16fb8b33..918c30d84ba0 100644 --- a/drivers/platform/raspberrypi/vchiq-mmal/mmal-vchiq.c +++ b/drivers/platform/raspberrypi/vchiq-mmal/mmal-vchiq.c @@ -1364,6 +1364,8 @@ static int port_enable(struct vchiq_mmal_instance *instance, port->enabled = true; + atomic_set(&port->buffers_with_vpu, 0); + if (port->buffer_cb) { /* send buffer headers to videocore */ hdr_count = 1; -- 2.55.0 ^ permalink raw reply related [flat|nested] 8+ messages in thread
* [PATCH v4 2/6] platform/raspberrypi: vchiq: Store audio device in driver management struct 2026-09-16 14:25 [PATCH v4 0/6] platform/raspberrypi: Add Broadcom Videocore shared memory support Jai Luthra 2026-09-16 14:25 ` [PATCH v4 1/6] platform/raspberrypi: vchiq-mmal: Reset buffers_with_vpu on port_enable Jai Luthra @ 2026-09-16 14:25 ` Jai Luthra 2026-09-16 14:25 ` [PATCH v4 3/6] platform/raspberrypi: Add VideoCore shared memory support Jai Luthra ` (3 subsequent siblings) 5 siblings, 0 replies; 8+ messages in thread From: Jai Luthra @ 2026-09-16 14:25 UTC (permalink / raw) To: Florian Fainelli, Raspberry Pi Kernel Maintenance, bcm-kernel-feedback-list, Greg Kroah-Hartman, Dave Stevenson, Phil Elwell, Hans Verkuil, Mauro Carvalho Chehab Cc: Stefan Wahren, Laurent Pinchart, Kieran Bingham, linux-arm-kernel, linux-kernel, linux-rpi-kernel, linux-media, Jai Luthra The VCHIQ firmware devices are not discoverable, so they must be tracked manually by the driver. Previously, the bcm2835 audio device was stored in a static global pointer. Move the audio device pointer into struct vchiq_drv_mgmt instead, so it is properly associated with the driver instance and lifecycle. This avoids global state and makes device registration and removal follow the platform device more cleanly. No functional change intended. Signed-off-by: Jai Luthra <jai.luthra@ideasonboard.com> --- drivers/platform/raspberrypi/vchiq-interface/vchiq_arm.c | 11 ++--------- include/linux/raspberrypi/vchiq_arm.h | 8 ++++++++ 2 files changed, 10 insertions(+), 9 deletions(-) diff --git a/drivers/platform/raspberrypi/vchiq-interface/vchiq_arm.c b/drivers/platform/raspberrypi/vchiq-interface/vchiq_arm.c index e78641703252..d5a25033a261 100644 --- a/drivers/platform/raspberrypi/vchiq-interface/vchiq_arm.c +++ b/drivers/platform/raspberrypi/vchiq-interface/vchiq_arm.c @@ -57,13 +57,6 @@ #define KEEPALIVE_VER 1 #define KEEPALIVE_VER_MIN KEEPALIVE_VER -/* - * The devices implemented in the VCHIQ firmware are not discoverable, - * so we need to maintain a list of them in order to register them with - * the interface. - */ -static struct vchiq_device *bcm2835_audio; - static const struct vchiq_platform_info bcm2835_info = { .cache_line_size = 32, }; @@ -1420,7 +1413,7 @@ static int vchiq_probe(struct platform_device *pdev) vchiq_debugfs_init(&mgmt->state); - bcm2835_audio = vchiq_device_register(&pdev->dev, "bcm2835-audio"); + mgmt->audio_dev = vchiq_device_register(&pdev->dev, "bcm2835-audio"); return 0; } @@ -1429,7 +1422,7 @@ static void vchiq_remove(struct platform_device *pdev) { struct vchiq_drv_mgmt *mgmt = dev_get_drvdata(&pdev->dev); - vchiq_device_unregister(bcm2835_audio); + vchiq_device_unregister(mgmt->audio_dev); vchiq_debugfs_deinit(); vchiq_deregister_chrdev(); vchiq_platform_uninit(mgmt); diff --git a/include/linux/raspberrypi/vchiq_arm.h b/include/linux/raspberrypi/vchiq_arm.h index e32b02f99024..541b4efd64d9 100644 --- a/include/linux/raspberrypi/vchiq_arm.h +++ b/include/linux/raspberrypi/vchiq_arm.h @@ -11,6 +11,7 @@ #include <linux/platform_device.h> #include <linux/semaphore.h> #include <linux/atomic.h> +#include "vchiq_bus.h" #include "vchiq_core.h" #include "vchiq_debugfs.h" @@ -54,6 +55,13 @@ struct vchiq_drv_mgmt { void __iomem *regs; struct vchiq_state state; + + /* + * The devices implemented in the VCHIQ firmware are not discoverable, + * so we need to maintain a list of them in order to register them with + * the interface. + */ + struct vchiq_device *audio_dev; }; struct user_service { -- 2.55.0 ^ permalink raw reply related [flat|nested] 8+ messages in thread
* [PATCH v4 3/6] platform/raspberrypi: Add VideoCore shared memory support 2026-09-16 14:25 [PATCH v4 0/6] platform/raspberrypi: Add Broadcom Videocore shared memory support Jai Luthra 2026-09-16 14:25 ` [PATCH v4 1/6] platform/raspberrypi: vchiq-mmal: Reset buffers_with_vpu on port_enable Jai Luthra 2026-09-16 14:25 ` [PATCH v4 2/6] platform/raspberrypi: vchiq: Store audio device in driver management struct Jai Luthra @ 2026-09-16 14:25 ` Jai Luthra 2026-09-17 21:11 ` Stefan Wahren 2026-09-16 14:25 ` [PATCH v4 4/6] platform/raspberrypi: vchiq-mmal: Use vc-sm-cma to support zero copy Jai Luthra ` (2 subsequent siblings) 5 siblings, 1 reply; 8+ messages in thread From: Jai Luthra @ 2026-09-16 14:25 UTC (permalink / raw) To: Florian Fainelli, Raspberry Pi Kernel Maintenance, bcm-kernel-feedback-list, Greg Kroah-Hartman, Dave Stevenson, Phil Elwell, Hans Verkuil, Mauro Carvalho Chehab Cc: Stefan Wahren, Laurent Pinchart, Kieran Bingham, linux-arm-kernel, linux-kernel, linux-rpi-kernel, linux-media, Jai Luthra, Dom Cobley, Alexander Winkowski, Juerg Haefliger From: Dave Stevenson <dave.stevenson@raspberrypi.com> Add support for the vc-sm-cma driver, to enable sharing of contiguous CMA memory allocations with the VideoCore VPU on Raspberry Pi. The driver allocates CMA-backed buffers, imports external dmabufs, and manages their lifetime via VCHIQ messaging to the VPU service, ensuring buffers are not released until both the linux userspace and the VPU confirm completion. VC4 can only physically address the lower 1GB of RAM and requires buffers to be mapped through specific uncached address aliases (0xC0000000). Thus, standard CMA could not be used as it has no mechanism to ensure allocations are visible and valid to VideoCore firmware, or handle cache flushes as VC4 can't see ARM's cache state. The vc-sm-cma driver bridges this gap by allocating memory via CMA on the ARM side and explicitly importing it into VideoCore via VCHI. This driver is primarily used by the wrapper V4L2 drivers for codec and ISP, where firmware running on VC4 does the actual video and image processing, while the linux userspace interacts with standard V4L2 driver interfaces. For example, the ISP driver populates large lens-shading related tables for a particular camera setup, and uses vc-sm-cma to share this buffer with VC4. Signed-off-by: Dave Stevenson <dave.stevenson@raspberrypi.com> Signed-off-by: Dom Cobley <popcornmix@gmail.com> Signed-off-by: Phil Elwell <phil@raspberrypi.com> Signed-off-by: Alexander Winkowski <dereference23@outlook.com> Signed-off-by: Kieran Bingham <kieran.bingham@ideasonboard.com> Signed-off-by: Juerg Haefliger <juerg.haefliger@canonical.com> [clean-up for mainline and switch to xarray instead of idr] Signed-off-by: Jai Luthra <jai.luthra@ideasonboard.com> --- Changes in v4: - Rebase on v7.3-rc1 - Cut out all userspace import and VPU alloc code (from Dave) - Fix most of the overflow lines (> 80) Changes in v3: - Rebase on v7.2-rc1 - Switch from kzalloc with sizeof to kzalloc_obj - Fix lkp bot errors with Kconfig dependencies --- MAINTAINERS | 7 + drivers/platform/raspberrypi/Kconfig | 2 + drivers/platform/raspberrypi/Makefile | 1 + drivers/platform/raspberrypi/vc-sm-cma/Kconfig | 9 + drivers/platform/raspberrypi/vc-sm-cma/Makefile | 5 + drivers/platform/raspberrypi/vc-sm-cma/vc_sm.c | 806 +++++++++++++++++++++ drivers/platform/raspberrypi/vc-sm-cma/vc_sm.h | 64 ++ .../raspberrypi/vc-sm-cma/vc_sm_cma_vchi.c | 510 +++++++++++++ .../raspberrypi/vc-sm-cma/vc_sm_cma_vchi.h | 64 ++ .../platform/raspberrypi/vc-sm-cma/vc_sm_defs.h | 298 ++++++++ include/linux/raspberrypi/vc_sm_cma_ioctl.h | 110 +++ include/linux/raspberrypi/vc_sm_knl.h | 76 ++ 12 files changed, 1952 insertions(+) diff --git a/MAINTAINERS b/MAINTAINERS index 3a19da74d00c..b887ac593088 100644 --- a/MAINTAINERS +++ b/MAINTAINERS @@ -5626,6 +5626,13 @@ L: netdev@vger.kernel.org S: Maintained F: drivers/net/ethernet/broadcom/tg3.* +BROADCOM VIDEOCORE SHARED MEMORY DRIVER +M: Raspberry Pi Kernel Maintenance <kernel-list@raspberrypi.com> +L: linux-kernel@vger.kernel.org +S: Maintained +F: drivers/platform/raspberrypi/vc-sm-cma/* +F: include/linux/raspberrypi/vc_sm_cma* + BROADCOM VK DRIVER M: Scott Branden <scott.branden@broadcom.com> R: Broadcom internal kernel review list <bcm-kernel-feedback-list@broadcom.com> diff --git a/drivers/platform/raspberrypi/Kconfig b/drivers/platform/raspberrypi/Kconfig index 2c928440a47c..68a7a2d5701c 100644 --- a/drivers/platform/raspberrypi/Kconfig +++ b/drivers/platform/raspberrypi/Kconfig @@ -48,5 +48,7 @@ config VCHIQ_CDEV endif source "drivers/platform/raspberrypi/vchiq-mmal/Kconfig" +source "drivers/platform/raspberrypi/vc-sm-cma/Kconfig" + endif diff --git a/drivers/platform/raspberrypi/Makefile b/drivers/platform/raspberrypi/Makefile index 2a7c9511e5d8..1980f618e218 100644 --- a/drivers/platform/raspberrypi/Makefile +++ b/drivers/platform/raspberrypi/Makefile @@ -13,3 +13,4 @@ vchiq-objs += vchiq-interface/vchiq_dev.o endif obj-$(CONFIG_BCM2835_VCHIQ_MMAL) += vchiq-mmal/ +obj-$(CONFIG_BCM_VC_SM_CMA) += vc-sm-cma/ diff --git a/drivers/platform/raspberrypi/vc-sm-cma/Kconfig b/drivers/platform/raspberrypi/vc-sm-cma/Kconfig new file mode 100644 index 000000000000..4af14a0e3458 --- /dev/null +++ b/drivers/platform/raspberrypi/vc-sm-cma/Kconfig @@ -0,0 +1,9 @@ +config BCM_VC_SM_CMA + tristate "VideoCore Shared Memory (CMA) driver" + select BCM2835_VCHIQ if HAS_DMA + select DMA_SHARED_BUFFER + help + Say Y here to enable the shared memory interface that + supports sharing dmabufs with VideoCore. + This operates over the VCHIQ interface to a service + running on VideoCore. diff --git a/drivers/platform/raspberrypi/vc-sm-cma/Makefile b/drivers/platform/raspberrypi/vc-sm-cma/Makefile new file mode 100644 index 000000000000..0419b9770b68 --- /dev/null +++ b/drivers/platform/raspberrypi/vc-sm-cma/Makefile @@ -0,0 +1,5 @@ +# SPDX-License-Identifier: GPL-2.0 +vc-sm-cma-$(CONFIG_BCM_VC_SM_CMA) := \ + vc_sm.o vc_sm_cma_vchi.o + +obj-$(CONFIG_BCM_VC_SM_CMA) += vc-sm-cma.o diff --git a/drivers/platform/raspberrypi/vc-sm-cma/vc_sm.c b/drivers/platform/raspberrypi/vc-sm-cma/vc_sm.c new file mode 100644 index 000000000000..80c13ccd8897 --- /dev/null +++ b/drivers/platform/raspberrypi/vc-sm-cma/vc_sm.c @@ -0,0 +1,806 @@ +// SPDX-License-Identifier: GPL-2.0 +/* + * VideoCore Shared Memory driver using CMA. + * + * Copyright: 2018, Raspberry Pi (Trading) Ltd + * Dave Stevenson <dave.stevenson@raspberrypi.com> + * + * Based on vmcs_sm driver from Broadcom Corporation for some API, + * and taking some code for buffer allocation and dmabuf handling from + * videobuf2. + * + * This driver has 3 main uses: + * 1) Allocating buffers for the kernel or userspace that can be shared with the + * VPU. + * 2) Importing dmabufs from elsewhere for sharing with the VPU. + * 3) Allocating buffers for use by the VPU. + * + * In the first and second cases the native handle is a dmabuf. Releasing the + * resource inherently comes from releasing the dmabuf, and this will trigger + * unmapping on the VPU. The underlying allocation and our buffer structure are + * retained until the VPU has confirmed that it has finished with it. + * + * For the VPU allocations the VPU is responsible for triggering the release, + * and therefore the released message decrements the dma_buf refcount (with the + * VPU mapping having already been marked as released). + */ + +#include <linux/device.h> +#include <linux/debugfs.h> +#include <linux/dma-mapping.h> +#include <linux/dma-buf.h> +#include <linux/fs.h> +#include <linux/list.h> +#include <linux/miscdevice.h> +#include <linux/module.h> +#include <linux/of_device.h> +#include <linux/raspberrypi/vchiq_arm.h> +#include <linux/raspberrypi/vchiq_bus.h> +#include <linux/raspberrypi/vc_sm_cma_ioctl.h> +#include <linux/raspberrypi/vc_sm_knl.h> +#include <linux/slab.h> +#include <linux/seq_file.h> +#include <linux/xarray.h> + +#include "vc_sm_cma_vchi.h" + +#include "vc_sm.h" + +MODULE_IMPORT_NS("DMA_BUF"); + +#define DEVICE_NAME "vcsm-cma" +#define DEVICE_MINOR 0 + +#define VC_SM_RESOURCE_NAME_DEFAULT "sm-host-resource" + +#define VC_SM_DIR_ROOT_NAME "vcsm-cma" +#define VC_SM_STATE "state" + +typedef int (*VC_SM_SHOW) (struct seq_file *s, void *v); +struct sm_pde_t { + VC_SM_SHOW show; /* Debug fs function hookup. */ + struct dentry *dir_entry; /* Debug fs directory entry. */ + void *priv_data; /* Private data */ +}; + +/* Global state information. */ +struct sm_state_t { + struct vchiq_device *device; + + struct miscdevice misc_dev; + + struct sm_instance *sm_handle; /* Handle for videocore service. */ + + struct xarray kernelid_map; + + struct mutex map_lock; /* Global map lock. */ + struct list_head buffer_list; /* List of buffer. */ + + struct dentry *dir_root; /* Debug fs entries root. */ + struct sm_pde_t dir_state; /* Debug fs entries state sub-tree. */ + + bool require_released_callback; /* VPU will send a released msg when it + * has finished with a resource. + */ + /* State for transactions */ + int restart_sys; /* Tracks restart on interrupt. */ + enum vc_sm_msg_type int_action; /* Interrupted action. */ + u32 int_trans_id; /* Interrupted transaction. */ + struct vchiq_instance *vchiq_instance; +}; + +struct vc_sm_dma_buf_attachment { + struct device *dev; + struct sg_table sg_table; + struct list_head list; + enum dma_data_direction dma_dir; +}; + +static struct sm_state_t *sm_state; +static int sm_inited; + +static int get_kernel_id(struct vc_sm_buffer *buffer) +{ + int handle, ret; + + ret = xa_alloc(&sm_state->kernelid_map, &handle, buffer, xa_limit_31b, + GFP_KERNEL); + + return ret < 0 ? ret : handle; +} + +static struct vc_sm_buffer *lookup_kernel_id(int handle) +{ + return xa_load(&sm_state->kernelid_map, handle); +} + +static void free_kernel_id(int handle) +{ + xa_erase(&sm_state->kernelid_map, handle); +} + +static int vc_sm_cma_seq_file_show(struct seq_file *s, void *v) +{ + struct sm_pde_t *sm_pde; + + sm_pde = (struct sm_pde_t *)(s->private); + + if (sm_pde && sm_pde->show) + sm_pde->show(s, v); + + return 0; +} + +static int vc_sm_cma_single_open(struct inode *inode, struct file *file) +{ + return single_open(file, vc_sm_cma_seq_file_show, inode->i_private); +} + +static const struct file_operations vc_sm_cma_debug_fs_fops = { + .open = vc_sm_cma_single_open, + .read = seq_read, + .llseek = seq_lseek, + .release = single_release, +}; + +static int vc_sm_cma_global_state_show(struct seq_file *s, void *v) +{ + struct vc_sm_buffer *resource = NULL; + int resource_count = 0; + + if (!sm_state) + return 0; + + seq_printf(s, "\nVC-ServiceHandle %p\n", sm_state->sm_handle); + + /* Log all applicable mapping(s). */ + + mutex_lock(&sm_state->map_lock); + seq_puts(s, "\nResources\n"); + if (!list_empty(&sm_state->buffer_list)) { + list_for_each_entry(resource, &sm_state->buffer_list, + global_buffer_list) { + resource_count++; + + seq_printf(s, "\nResource %p\n", + resource); + seq_printf(s, " NAME %s\n", + resource->name); + seq_printf(s, " SIZE %zu\n", + resource->size); + seq_printf(s, " DMABUF %p\n", + resource->dma_buf); + seq_printf(s, " IMPORTED_DMABUF %p\n", + resource->imported_dma_buf); + seq_printf(s, " ATTACH %p\n", + resource->attach); + seq_printf(s, " SGT %p\n", + resource->sgt); + seq_printf(s, " DMA_ADDR %pad\n", + &resource->dma_addr); + seq_printf(s, " VC_HANDLE %08x\n", + resource->vc_handle); + seq_printf(s, " VC_MAPPING %d\n", + resource->vpu_state); + } + } + seq_printf(s, "\n\nTotal resource count: %d\n\n", resource_count); + + mutex_unlock(&sm_state->map_lock); + + return 0; +} + +/* + * Adds a buffer to the private data list which tracks all the allocated + * data. + */ +static void vc_sm_add_resource(struct vc_sm_buffer *buffer) +{ + mutex_lock(&sm_state->map_lock); + list_add(&buffer->global_buffer_list, &sm_state->buffer_list); + mutex_unlock(&sm_state->map_lock); +} + +/* + * Cleans up imported dmabuf. + * Should be called with mutex held. + */ +static void vc_sm_clean_up_dmabuf(struct vc_sm_buffer *buffer) +{ + /* Handle cleaning up imported dmabufs */ + if (buffer->sgt) { + dma_buf_unmap_attachment_unlocked(buffer->attach, + buffer->sgt, + DMA_BIDIRECTIONAL); + buffer->sgt = NULL; + } + if (buffer->attach) { + dma_buf_detach(buffer->imported_dma_buf, buffer->attach); + buffer->attach = NULL; + } +} + +/* + * Instructs VPU to decrement the refcount on a buffer. + */ +static void vc_sm_vpu_free(struct vc_sm_buffer *buffer) +{ + if (buffer->vc_handle && buffer->vpu_state == VPU_MAPPED) { + struct vc_sm_free_t free = { buffer->vc_handle, 0 }; + int status = vc_sm_cma_vchi_free(sm_state->sm_handle, &free, + &sm_state->int_trans_id); + if (status != 0 && status != -EINTR) { + dev_err(&sm_state->device->dev, + "%s: failed to free memory on videocore (status: %u, trans_id: %u)\n", + __func__, status, sm_state->int_trans_id); + } + + if (sm_state->require_released_callback) { + /* Need to wait for the VPU to confirm the free. */ + + /* Retain a reference on this until the VPU has + * released it + */ + buffer->vpu_state = VPU_UNMAPPING; + } else { + buffer->vpu_state = VPU_NOT_MAPPED; + buffer->vc_handle = 0; + } + } +} + +/* + * Release an allocation. + * All refcounting is done via the dma buf object. + * + * Must be called with the mutex held. The function will either release the + * mutex (if defering the release) or destroy it. The caller must therefore not + * reuse the buffer on return. + */ +static void vc_sm_release_resource(struct vc_sm_buffer *buffer) +{ + /* We've sent the unmap request but not had the response. */ + if (buffer->vc_handle) + goto defer; + /* dmabuf still in use - we await the release */ + if (buffer->in_use) + goto defer; + + /* Release the allocation */ + if (buffer->imported_dma_buf) + dma_buf_put(buffer->imported_dma_buf); + else + dev_err(&sm_state->device->dev, "%s: Imported dmabuf already been put for buf %p\n", + __func__, buffer); + buffer->imported_dma_buf = NULL; + + /* Free our buffer. Start by removing it from the list */ + mutex_lock(&sm_state->map_lock); + list_del(&buffer->global_buffer_list); + mutex_unlock(&sm_state->map_lock); + + mutex_unlock(&buffer->lock); + mutex_destroy(&buffer->lock); + + kfree(buffer); + return; + +defer: + mutex_unlock(&buffer->lock); +} + +static void vc_sm_dma_buf_release(struct dma_buf *dmabuf) +{ + struct vc_sm_buffer *buffer; + + if (!dmabuf) + return; + + buffer = (struct vc_sm_buffer *)dmabuf->priv; + + mutex_lock(&buffer->lock); + + buffer->in_use = false; + + /* Unmap on the VPU */ + vc_sm_vpu_free(buffer); + + /* Unmap our dma_buf object (the vc_sm_buffer remains until released + * on the VPU). + */ + vc_sm_clean_up_dmabuf(buffer); + + /* buffer->lock will be destroyed by vc_sm_release_resource if finished + * with, otherwise unlocked. Do NOT unlock here. + */ + vc_sm_release_resource(buffer); +} + +/* Dma_buf operations for chaining through to an imported dma_buf */ + +static +int vc_sm_import_dma_buf_attach(struct dma_buf *dmabuf, + struct dma_buf_attachment *attachment) +{ + struct vc_sm_buffer *buf = dmabuf->priv; + + return buf->imported_dma_buf->ops->attach(buf->imported_dma_buf, + attachment); +} + +static +void vc_sm_import_dma_buf_detatch(struct dma_buf *dmabuf, + struct dma_buf_attachment *attachment) +{ + struct vc_sm_buffer *buf = dmabuf->priv; + + buf->imported_dma_buf->ops->detach(buf->imported_dma_buf, attachment); +} + +static +struct sg_table *vc_sm_import_map_dma_buf(struct dma_buf_attachment *attachment, + enum dma_data_direction direction) +{ + struct vc_sm_buffer *buf = attachment->dmabuf->priv; + + return buf->imported_dma_buf->ops->map_dma_buf(attachment, + direction); +} + +static +void vc_sm_import_unmap_dma_buf(struct dma_buf_attachment *attachment, + struct sg_table *table, + enum dma_data_direction direction) +{ + struct vc_sm_buffer *buf = attachment->dmabuf->priv; + + buf->imported_dma_buf->ops->unmap_dma_buf(attachment, table, direction); +} + +static +int vc_sm_import_dmabuf_mmap(struct dma_buf *dmabuf, struct vm_area_struct *vma) +{ + struct vc_sm_buffer *buf = dmabuf->priv; + + return buf->imported_dma_buf->ops->mmap(buf->imported_dma_buf, vma); +} + +static +int vc_sm_import_dma_buf_begin_cpu_access(struct dma_buf *dmabuf, + enum dma_data_direction direction) +{ + struct vc_sm_buffer *buf = dmabuf->priv; + const struct dma_buf_ops *ops = buf->imported_dma_buf->ops; + + return ops->begin_cpu_access(buf->imported_dma_buf, direction); +} + +static +int vc_sm_import_dma_buf_end_cpu_access(struct dma_buf *dmabuf, + enum dma_data_direction direction) +{ + struct vc_sm_buffer *buf = dmabuf->priv; + + return buf->imported_dma_buf->ops->end_cpu_access(buf->imported_dma_buf, + direction); +} + +static const struct dma_buf_ops dma_buf_import_ops = { + .map_dma_buf = vc_sm_import_map_dma_buf, + .unmap_dma_buf = vc_sm_import_unmap_dma_buf, + .mmap = vc_sm_import_dmabuf_mmap, + .release = vc_sm_dma_buf_release, + .attach = vc_sm_import_dma_buf_attach, + .detach = vc_sm_import_dma_buf_detatch, + .begin_cpu_access = vc_sm_import_dma_buf_begin_cpu_access, + .end_cpu_access = vc_sm_import_dma_buf_end_cpu_access, +}; + +/* Import a dma_buf to be shared with VC. */ +static int +vc_sm_cma_import_dmabuf_internal(struct dma_buf *dma_buf, + int fd, + struct dma_buf **imported_buf) +{ + DEFINE_DMA_BUF_EXPORT_INFO(exp_info); + struct vc_sm_buffer *buffer = NULL; + struct vc_sm_import import = { }; + struct vc_sm_import_result result = { }; + struct dma_buf_attachment *attach = NULL; + struct sg_table *sgt = NULL; + dma_addr_t dma_addr; + u32 cache_alias; + int ret = 0; + int status; + + /* Setup our allocation parameters */ + if (fd < 0) + get_dma_buf(dma_buf); + else + dma_buf = dma_buf_get(fd); + + if (!dma_buf) + return -EINVAL; + + attach = dma_buf_attach(dma_buf, &sm_state->device->dev); + if (IS_ERR(attach)) { + ret = PTR_ERR(attach); + goto error; + } + + sgt = dma_buf_map_attachment_unlocked(attach, DMA_BIDIRECTIONAL); + if (IS_ERR(sgt)) { + ret = PTR_ERR(sgt); + goto error; + } + + /* Verify that the address block is contiguous */ + if (sgt->nents != 1) { + ret = -ENOMEM; + goto error; + } + + /* Allocate local buffer to track this allocation. */ + buffer = kzalloc(sizeof(*buffer), GFP_KERNEL); + if (!buffer) { + ret = -ENOMEM; + goto error; + } + + import.type = VC_SM_ALLOC_NON_CACHED; + dma_addr = sg_dma_address(sgt->sgl); + import.addr = (u32)dma_addr; + cache_alias = import.addr & 0xC0000000; + if (cache_alias != 0xC0000000 && cache_alias != 0x80000000) { + dev_err(&sm_state->device->dev, "%s: Expecting an uncached alias for dma_addr %pad\n", + __func__, &dma_addr); + /* Note that this assumes we're on >= Pi2, but it implies a + * DT configuration error. + */ + import.addr |= 0xC0000000; + } + import.size = sg_dma_len(sgt->sgl); + import.allocator = current->tgid; + import.kernel_id = get_kernel_id(buffer); + if (import.kernel_id < 0) { + ret = import.kernel_id; + goto error; + } + + memcpy(import.name, VC_SM_RESOURCE_NAME_DEFAULT, + sizeof(VC_SM_RESOURCE_NAME_DEFAULT)); + + /* Allocate the videocore buffer. */ + status = vc_sm_cma_vchi_import(sm_state->sm_handle, &import, &result, + &sm_state->int_trans_id); + if (status == -EINTR) { + dev_dbg(&sm_state->device->dev, + "%s: requesting import memory action restart (trans_id: %u)\n", + __func__, sm_state->int_trans_id); + ret = -ERESTARTSYS; + sm_state->restart_sys = -EINTR; + sm_state->int_action = VC_SM_MSG_TYPE_IMPORT; + goto error; + } else if (status || !result.res_handle) { + dev_dbg(&sm_state->device->dev, + "%s: failed to import memory on videocore (status: %u, trans_id: %u)\n", + __func__, status, sm_state->int_trans_id); + ret = -ENOMEM; + goto error; + } + + mutex_init(&buffer->lock); + INIT_LIST_HEAD(&buffer->attachments); + memcpy(buffer->name, import.name, + min(sizeof(buffer->name), sizeof(import.name) - 1)); + + /* Keep track of the buffer we created. */ + buffer->vc_handle = result.res_handle; + buffer->size = import.size; + buffer->vpu_state = VPU_MAPPED; + + buffer->imported_dma_buf = dma_buf; + + buffer->attach = attach; + buffer->sgt = sgt; + buffer->dma_addr = dma_addr; + buffer->in_use = true; + buffer->kernel_id = import.kernel_id; + + /* + * We're done - we need to export a new dmabuf chaining through most + * functions, but enabling us to release our own internal references + * here. + */ + exp_info.ops = &dma_buf_import_ops; + exp_info.size = import.size; + exp_info.flags = O_RDWR; + exp_info.priv = buffer; + + buffer->dma_buf = dma_buf_export(&exp_info); + if (IS_ERR(buffer->dma_buf)) { + ret = PTR_ERR(buffer->dma_buf); + goto error; + } + + vc_sm_add_resource(buffer); + + *imported_buf = buffer->dma_buf; + + return 0; + +error: + if (result.res_handle) { + struct vc_sm_free_t free = { result.res_handle, 0 }; + + vc_sm_cma_vchi_free(sm_state->sm_handle, &free, + &sm_state->int_trans_id); + } + free_kernel_id(import.kernel_id); + kfree(buffer); + if (sgt) + dma_buf_unmap_attachment_unlocked(attach, sgt, + DMA_BIDIRECTIONAL); + if (attach) + dma_buf_detach(dma_buf, attach); + dma_buf_put(dma_buf); + return ret; +} + +static void +vc_sm_vpu_event(struct sm_instance *instance, struct vc_sm_result_t *reply, + int reply_len) +{ + switch (reply->trans_id & ~0x80000000) { + case VC_SM_MSG_TYPE_CLIENT_VERSION: + { + /* Acknowledge that the firmware supports the version command */ + sm_state->require_released_callback = true; + } + break; + case VC_SM_MSG_TYPE_RELEASED: + { + struct vc_sm_released *release = (struct vc_sm_released *)reply; + struct vc_sm_buffer *buffer = + lookup_kernel_id(release->kernel_id); + if (!buffer) { + dev_err(&sm_state->device->dev, + "%s: VC released a buffer that is already released, kernel_id %d\n", + __func__, release->kernel_id); + break; + } + mutex_lock(&buffer->lock); + + dev_dbg(&sm_state->device->dev, + "%s: Released addr %08x, size %u, id %08x, mem_handle %08x\n", + __func__, release->addr, release->size, + release->kernel_id, release->vc_handle); + + buffer->vc_handle = 0; + buffer->vpu_state = VPU_NOT_MAPPED; + free_kernel_id(release->kernel_id); + + vc_sm_release_resource(buffer); + } + break; + default: + dev_err(&sm_state->device->dev, "%s: Unknown vpu cmd %x\n", + __func__, reply->trans_id); + break; + } +} + +/* Driver load/unload functions */ +/* Videocore connected. */ +static void vc_sm_connected_init(void) +{ + int ret; + struct vc_sm_version version; + struct vc_sm_result_t version_result; + + /* + * Digging the vchiq_drv_mgmt, so low here and through a global seems + * suspicious. + * + * The callbacks should be able to pass a parameter or context. + */ + struct vchiq_drv_mgmt *mgmt = + dev_get_drvdata(sm_state->device->dev.parent); + + /* + * Initialize and create a VCHI connection for the shared memory service + * running on videocore. + */ + ret = vchiq_initialise(&mgmt->state, &sm_state->vchiq_instance); + if (ret) { + dev_err(&sm_state->device->dev, + "%s: failed to initialise VCHI instance (ret=%d)\n", + __func__, ret); + + return; + } + + ret = vchiq_connect(sm_state->vchiq_instance); + if (ret) { + dev_err(&sm_state->device->dev, + "%s: failed to connect VCHI instance (ret=%d)\n", + __func__, ret); + + return; + } + + /* Initialize an instance of the shared memory service. */ + sm_state->sm_handle = vc_sm_cma_vchi_init(sm_state->vchiq_instance, 1, + vc_sm_vpu_event); + if (!sm_state->sm_handle) { + dev_err(&sm_state->device->dev, + "%s: failed to initialize shared memory service\n", + __func__); + + return; + } + + /* Create a debug fs directory entry (root). */ + sm_state->dir_root = debugfs_create_dir(VC_SM_DIR_ROOT_NAME, NULL); + + sm_state->dir_state.show = &vc_sm_cma_global_state_show; + sm_state->dir_state.dir_entry = + debugfs_create_file(VC_SM_STATE, 0444, sm_state->dir_root, + &sm_state->dir_state, + &vc_sm_cma_debug_fs_fops); + + INIT_LIST_HEAD(&sm_state->buffer_list); + + version.version = 2; + ret = vc_sm_cma_vchi_client_version(sm_state->sm_handle, &version, + &version_result, + &sm_state->int_trans_id); + if (ret) { + dev_err(&sm_state->device->dev, + "%s: Failed to send version request %d\n", __func__, + ret); + } + + /* Done! */ + sm_inited = 1; +} + +/* Driver loading. */ +static int bcm2835_vc_sm_cma_probe(struct vchiq_device *device) +{ + int err; + + err = dma_set_mask_and_coherent(&device->dev, DMA_BIT_MASK(32)); + if (err) { + dev_err(&device->dev, "dma_set_mask_and_coherent failed: %d\n", + err); + return err; + } + + sm_state = devm_kzalloc(&device->dev, sizeof(*sm_state), GFP_KERNEL); + if (!sm_state) + return -ENOMEM; + sm_state->device = device; + mutex_init(&sm_state->map_lock); + + xa_init_flags(&sm_state->kernelid_map, XA_FLAGS_ALLOC1); + + device->dev.dma_parms = devm_kzalloc(&device->dev, + sizeof(*device->dev.dma_parms), + GFP_KERNEL); + /* dma_set_max_seg_size checks if dma_parms is NULL. */ + dma_set_max_seg_size(&device->dev, 0x3FFFFFFF); + + vchiq_add_connected_callback(device, vc_sm_connected_init); + return 0; +} + +/* Driver unloading. */ +static void bcm2835_vc_sm_cma_remove(struct vchiq_device *device) +{ + if (sm_inited) { + misc_deregister(&sm_state->misc_dev); + + /* Remove all proc entries. */ + debugfs_remove_recursive(sm_state->dir_root); + + /* Stop the videocore shared memory service. */ + vc_sm_cma_vchi_stop(sm_state->vchiq_instance, + &sm_state->sm_handle); + } + + if (sm_state) { + xa_destroy(&sm_state->kernelid_map); + + /* Free the memory for the state structure. */ + mutex_destroy(&sm_state->map_lock); + } +} + +/* Get an internal resource handle mapped from the external one. */ +int vc_sm_cma_int_handle(void *handle) +{ + struct dma_buf *dma_buf = (struct dma_buf *)handle; + struct vc_sm_buffer *buf; + + /* Validate we can work with this device. */ + if (!sm_state || !handle) { + pr_err("%s: invalid input\n", __func__); + return 0; + } + + buf = (struct vc_sm_buffer *)dma_buf->priv; + return buf->vc_handle; +} +EXPORT_SYMBOL_GPL(vc_sm_cma_int_handle); + +/* Free a previously allocated shared memory handle and block. */ +int vc_sm_cma_free(void *handle) +{ + struct dma_buf *dma_buf = (struct dma_buf *)handle; + + /* Validate we can work with this device. */ + if (!sm_state || !handle) { + pr_err("%s: invalid input\n", __func__); + return -EPERM; + } + + dma_buf_put(dma_buf); + + return 0; +} +EXPORT_SYMBOL_GPL(vc_sm_cma_free); + +/* Import a dmabuf to be shared with VC. */ +int vc_sm_cma_import_dmabuf(struct dma_buf *src_dmabuf, void **handle) +{ + struct dma_buf *new_dma_buf; + int ret; + + /* Validate we can work with this device. */ + if (!sm_state || !src_dmabuf || !handle) { + pr_err("%s: invalid input\n", __func__); + return -EPERM; + } + + ret = vc_sm_cma_import_dmabuf_internal(src_dmabuf, -1, &new_dma_buf); + + if (!ret) { + /* Assign valid handle at this time.*/ + *handle = new_dma_buf; + } else { + /* + * succeeded in importing the dma_buf, but then + * failed to look it up again. How? + * Release the fd again. + */ + pr_err("%s: imported vc_sm_cma_get_buffer failed %d\n", + __func__, ret); + } + + return ret; +} +EXPORT_SYMBOL_GPL(vc_sm_cma_import_dmabuf); + +static struct vchiq_device_id device_id_table[] = { + { .name = "vcsm-cma" }, + {} +}; +MODULE_DEVICE_TABLE(vchiq, device_id_table); + +static struct vchiq_driver bcm2835_vcsm_cma_driver = { + .probe = bcm2835_vc_sm_cma_probe, + .remove = bcm2835_vc_sm_cma_remove, + .id_table = device_id_table, + .driver = { + .name = DEVICE_NAME, + .owner = THIS_MODULE, + }, +}; + +module_vchiq_driver(bcm2835_vcsm_cma_driver); + +MODULE_AUTHOR("Dave Stevenson"); +MODULE_DESCRIPTION("VideoCore CMA Shared Memory Driver"); +MODULE_LICENSE("GPL"); diff --git a/drivers/platform/raspberrypi/vc-sm-cma/vc_sm.h b/drivers/platform/raspberrypi/vc-sm-cma/vc_sm.h new file mode 100644 index 000000000000..acb00b9fbd8e --- /dev/null +++ b/drivers/platform/raspberrypi/vc-sm-cma/vc_sm.h @@ -0,0 +1,64 @@ +/* SPDX-License-Identifier: GPL-2.0 */ + +/* + * VideoCore Shared Memory driver using CMA. + * + * Copyright: 2018, Raspberry Pi (Trading) Ltd + * + */ + +#ifndef VC_SM_H +#define VC_SM_H + +#include <linux/device.h> +#include <linux/dma-direction.h> +#include <linux/kref.h> +#include <linux/mm_types.h> +#include <linux/mutex.h> +#include <linux/sched.h> +#include <linux/shrinker.h> +#include <linux/types.h> +#include <linux/miscdevice.h> + +#define VC_SM_MAX_NAME_LEN 32 + +enum vc_sm_vpu_mapping_state { + VPU_NOT_MAPPED, + VPU_MAPPED, + VPU_UNMAPPING +}; + +struct vc_sm_buffer { + struct list_head global_buffer_list; /* Global list of buffers. */ + + /* Index in the kernel_id idr so that we can find the + * mmal_msg_context again when servicing the VCHI reply. + */ + int kernel_id; + + size_t size; + + /* Lock over all the following state for this buffer */ + struct mutex lock; + struct list_head attachments; + + char name[VC_SM_MAX_NAME_LEN]; + + bool in_use:1; /* Kernel is still using this resource */ + + enum vc_sm_vpu_mapping_state vpu_state; + u32 vc_handle; /* VideoCore handle for this buffer */ + + /* DMABUF related fields */ + struct dma_buf *dma_buf; + dma_addr_t dma_addr; + void *cookie; + + struct vc_sm_privdata_t *private; + + struct dma_buf *imported_dma_buf; + struct dma_buf_attachment *attach; + struct sg_table *sgt; +}; + +#endif diff --git a/drivers/platform/raspberrypi/vc-sm-cma/vc_sm_cma_vchi.c b/drivers/platform/raspberrypi/vc-sm-cma/vc_sm_cma_vchi.c new file mode 100644 index 000000000000..9a2fc4df1603 --- /dev/null +++ b/drivers/platform/raspberrypi/vc-sm-cma/vc_sm_cma_vchi.c @@ -0,0 +1,510 @@ +// SPDX-License-Identifier: GPL-2.0 +/* + * VideoCore Shared Memory CMA allocator + * + * Copyright: 2018, Raspberry Pi (Trading) Ltd + * Copyright 2011-2012 Broadcom Corporation. All rights reserved. + * + * Based on vmcs_sm driver from Broadcom Corporation. + * + */ + +#include <linux/completion.h> +#include <linux/dev_printk.h> +#include <linux/kernel.h> +#include <linux/kthread.h> +#include <linux/list.h> +#include <linux/mutex.h> +#include <linux/semaphore.h> +#include <linux/slab.h> +#include <linux/raspberrypi/vchiq_arm.h> +#include <linux/types.h> + +#include "vc_sm_cma_vchi.h" + +#define VC_SM_VER 1 +#define VC_SM_MIN_VER 0 + +/* Command blocks come from a pool */ +#define SM_MAX_NUM_CMD_RSP_BLKS 32 + +/* The number of supported connections */ +#define SM_MAX_NUM_CONNECTIONS 3 + +struct sm_cmd_rsp_blk { + struct list_head head; /* To create lists */ + /* To be signaled when the response is there */ + struct completion cmplt; + + u32 id; + u16 length; + + u8 msg[VC_SM_MAX_MSG_LEN]; + + uint32_t wait:1; + uint32_t sent:1; + uint32_t alloc:1; + +}; + +struct sm_instance { + u32 num_connections; + unsigned int service_handle[SM_MAX_NUM_CONNECTIONS]; + struct task_struct *io_thread; + struct completion io_cmplt; + + vpu_event_cb vpu_event; + + /* Mutex over the following lists */ + struct mutex lock; + u32 trans_id; + struct list_head cmd_list; + struct list_head rsp_list; + struct list_head dead_list; + + struct sm_cmd_rsp_blk free_blk[SM_MAX_NUM_CMD_RSP_BLKS]; + + /* Mutex over the free_list */ + struct mutex free_lock; + struct list_head free_list; + + struct semaphore free_sema; + struct vchiq_instance *vchiq_instance; +}; + +static int +bcm2835_vchi_msg_queue(struct vchiq_instance *vchiq_instance, + unsigned int handle, void *data, unsigned int size) +{ + return vchiq_queue_kernel_message(vchiq_instance, handle, data, size); +} + +static struct +sm_cmd_rsp_blk *vc_vchi_cmd_create(struct sm_instance *instance, + enum vc_sm_msg_type id, void *msg, + u32 size, int wait) +{ + struct sm_cmd_rsp_blk *blk; + struct vc_sm_msg_hdr_t *hdr; + + if (down_interruptible(&instance->free_sema)) { + blk = kmalloc_obj(*blk, GFP_KERNEL); + if (!blk) + return NULL; + + blk->alloc = 1; + init_completion(&blk->cmplt); + } else { + mutex_lock(&instance->free_lock); + blk = + list_first_entry(&instance->free_list, + struct sm_cmd_rsp_blk, head); + list_del(&blk->head); + mutex_unlock(&instance->free_lock); + } + + blk->sent = 0; + blk->wait = wait; + blk->length = sizeof(*hdr) + size; + + hdr = (struct vc_sm_msg_hdr_t *)blk->msg; + hdr->type = id; + mutex_lock(&instance->lock); + instance->trans_id++; + /* + * Retain the top bit for identifying asynchronous events, or VPU cmds. + */ + instance->trans_id &= ~0x80000000; + hdr->trans_id = instance->trans_id; + blk->id = instance->trans_id; + mutex_unlock(&instance->lock); + + if (size) + memcpy(hdr->body, msg, size); + + return blk; +} + +static void +vc_vchi_cmd_delete(struct sm_instance *instance, struct sm_cmd_rsp_blk *blk) +{ + if (blk->alloc) { + kfree(blk); + return; + } + + mutex_lock(&instance->free_lock); + list_add(&blk->head, &instance->free_list); + mutex_unlock(&instance->free_lock); + up(&instance->free_sema); +} + +static void vc_sm_cma_vchi_rx_ack(struct sm_instance *instance, + struct sm_cmd_rsp_blk *cmd, + struct vc_sm_result_t *reply, + u32 reply_len) +{ + mutex_lock(&instance->lock); + list_for_each_entry(cmd, + &instance->rsp_list, + head) { + if (cmd->id == reply->trans_id) + break; + } + mutex_unlock(&instance->lock); + + if (&cmd->head == &instance->rsp_list) { + dev_err(instance->vchiq_instance->state->dev, + "%s: received response %u, throw away...", __func__, + reply->trans_id); + } else if (reply_len > sizeof(cmd->msg)) { + dev_err(instance->vchiq_instance->state->dev, + "%s: reply too big (%u) %u, throw away...", __func__, + reply_len, reply->trans_id); + } else { + memcpy(cmd->msg, reply, + reply_len); + complete(&cmd->cmplt); + } +} + +static int vc_sm_cma_vchi_videocore_io(void *arg) +{ + struct sm_instance *instance = arg; + struct sm_cmd_rsp_blk *cmd = NULL, *cmd_tmp; + struct vc_sm_result_t *reply; + struct vchiq_header *header; + s32 status; + int svc_use = 1; + + while (1) { + if (svc_use) + vchiq_release_service(instance->vchiq_instance, + instance->service_handle[0]); + svc_use = 0; + + if (wait_for_completion_interruptible(&instance->io_cmplt)) + continue; + vchiq_use_service(instance->vchiq_instance, + instance->service_handle[0]); + svc_use = 1; + + do { + /* + * Get new command and move it to response list + */ + mutex_lock(&instance->lock); + if (list_empty(&instance->cmd_list)) { + /* no more commands to process */ + mutex_unlock(&instance->lock); + break; + } + cmd = list_first_entry(&instance->cmd_list, + struct sm_cmd_rsp_blk, head); + list_move(&cmd->head, &instance->rsp_list); + cmd->sent = 1; + mutex_unlock(&instance->lock); + /* Send the command */ + status = bcm2835_vchi_msg_queue(instance->vchiq_instance, + instance->service_handle[0], + cmd->msg, cmd->length); + if (status) { + dev_err(instance->vchiq_instance->state->dev, + "%s: failed to queue message (%d)", + __func__, status); + } + + /* If no reply is needed then we're done */ + if (!cmd->wait) { + mutex_lock(&instance->lock); + list_del(&cmd->head); + mutex_unlock(&instance->lock); + vc_vchi_cmd_delete(instance, cmd); + continue; + } + + if (status) { + complete(&cmd->cmplt); + continue; + } + + } while (1); + + while ((header = vchiq_msg_hold(instance->vchiq_instance, + instance->service_handle[0]))) { + reply = (struct vc_sm_result_t *)header->data; + if (reply->trans_id & 0x80000000) { + /* Async event or cmd from the VPU */ + if (instance->vpu_event) + instance->vpu_event(instance, reply, + header->size); + } else { + vc_sm_cma_vchi_rx_ack(instance, cmd, reply, + header->size); + } + + vchiq_release_message(instance->vchiq_instance, + instance->service_handle[0], + header); + } + + /* Go through the dead list and free them */ + mutex_lock(&instance->lock); + list_for_each_entry_safe(cmd, cmd_tmp, &instance->dead_list, + head) { + list_del(&cmd->head); + vc_vchi_cmd_delete(instance, cmd); + } + mutex_unlock(&instance->lock); + } + + return 0; +} + +static int vc_sm_cma_vchi_callback(struct vchiq_instance *vchiq_instance, + enum vchiq_reason reason, + struct vchiq_header *header, + unsigned int handle, void *userdata, + void __user *cb_userdata) +{ + struct sm_instance *instance = + vchiq_get_service_userdata(vchiq_instance, handle); + + switch (reason) { + case VCHIQ_MESSAGE_AVAILABLE: + vchiq_msg_queue_push(vchiq_instance, handle, header); + complete(&instance->io_cmplt); + break; + + case VCHIQ_SERVICE_CLOSED: + dev_info(instance->vchiq_instance->state->dev, + "%s: service CLOSED!!", __func__); + break; + + default: + break; + } + + return 0; +} + +struct sm_instance *vc_sm_cma_vchi_init(struct vchiq_instance *vchiq_instance, + unsigned int num_connections, + vpu_event_cb vpu_event) +{ + u32 i; + struct sm_instance *instance; + int status; + + if (num_connections > SM_MAX_NUM_CONNECTIONS) { + dev_err(vchiq_instance->state->dev, + "%s: unsupported number of connections %u (max=%u)", + __func__, num_connections, SM_MAX_NUM_CONNECTIONS); + + return NULL; + } + /* Allocate memory for this instance */ + instance = kzalloc(sizeof(*instance), GFP_KERNEL); + + /* Misc initialisations */ + mutex_init(&instance->lock); + init_completion(&instance->io_cmplt); + INIT_LIST_HEAD(&instance->cmd_list); + INIT_LIST_HEAD(&instance->rsp_list); + INIT_LIST_HEAD(&instance->dead_list); + INIT_LIST_HEAD(&instance->free_list); + sema_init(&instance->free_sema, SM_MAX_NUM_CMD_RSP_BLKS); + mutex_init(&instance->free_lock); + for (i = 0; i < SM_MAX_NUM_CMD_RSP_BLKS; i++) { + init_completion(&instance->free_blk[i].cmplt); + list_add(&instance->free_blk[i].head, &instance->free_list); + } + + instance->vchiq_instance = vchiq_instance; + + /* Open the VCHI service connections */ + instance->num_connections = num_connections; + for (i = 0; i < num_connections; i++) { + struct vchiq_service_params_kernel params = { + .version = VC_SM_VER, + .version_min = VC_SM_MIN_VER, + .fourcc = VCHIQ_MAKE_FOURCC('S', 'M', 'E', 'M'), + .callback = vc_sm_cma_vchi_callback, + .userdata = instance, + }; + + status = vchiq_open_service(vchiq_instance, ¶ms, + &instance->service_handle[i]); + if (status) { + dev_err(vchiq_instance->state->dev, + "%s: failed to open VCHI service (%d)", + __func__, status); + + goto err_close_services; + } + } + /* Create the thread which takes care of all io to/from videoocore. */ + instance->io_thread = kthread_create(&vc_sm_cma_vchi_videocore_io, + (void *)instance, "SMIO"); + if (!instance->io_thread) { + dev_err(vchiq_instance->state->dev, + "%s: failed to create SMIO thread", __func__); + + goto err_close_services; + } + instance->vpu_event = vpu_event; + set_user_nice(instance->io_thread, -10); + wake_up_process(instance->io_thread); + + return instance; + +err_close_services: + for (i = 0; i < instance->num_connections; i++) { + if (instance->service_handle[i]) + vchiq_close_service(vchiq_instance, + instance->service_handle[i]); + } + kfree(instance); + + return NULL; +} + +int vc_sm_cma_vchi_stop(struct vchiq_instance *vchiq_instance, + struct sm_instance **handle) +{ + struct sm_instance *instance; + u32 i; + + if (!handle) { + pr_err("%s: invalid pointer to handle %p", __func__, handle); + goto lock; + } + + if (!*handle) { + pr_err("%s: invalid handle %p", __func__, *handle); + goto lock; + } + + instance = *handle; + + /* Close all VCHI service connections */ + for (i = 0; i < instance->num_connections; i++) { + vchiq_use_service(vchiq_instance, instance->service_handle[i]); + vchiq_close_service(vchiq_instance, + instance->service_handle[i]); + } + + kfree(instance); + + *handle = NULL; + return 0; + +lock: + return -EINVAL; +} + +static int vc_sm_cma_vchi_send_msg(struct sm_instance *handle, + enum vc_sm_msg_type msg_id, void *msg, + u32 msg_size, void *result, u32 result_size, + u32 *cur_trans_id, u8 wait_reply) +{ + int status = 0; + struct sm_instance *instance = handle; + struct sm_cmd_rsp_blk *cmd_blk; + + if (!handle) { + pr_err("%s: invalid handle", __func__); + return -EINVAL; + } + if (!msg) { + dev_err(instance->vchiq_instance->state->dev, + "%s: invalid msg pointer", __func__); + return -EINVAL; + } + + cmd_blk = + vc_vchi_cmd_create(instance, msg_id, msg, msg_size, wait_reply); + if (!cmd_blk) { + dev_err(instance->vchiq_instance->state->dev, + "[%s]: failed to allocate global tracking resource", + __func__); + return -ENOMEM; + } + + if (cur_trans_id) + *cur_trans_id = cmd_blk->id; + + mutex_lock(&instance->lock); + list_add_tail(&cmd_blk->head, &instance->cmd_list); + mutex_unlock(&instance->lock); + complete(&instance->io_cmplt); + + if (!wait_reply) + /* We're done */ + return 0; + + /* Wait for the response */ + if (wait_for_completion_interruptible(&cmd_blk->cmplt)) { + mutex_lock(&instance->lock); + if (!cmd_blk->sent) { + list_del(&cmd_blk->head); + mutex_unlock(&instance->lock); + vc_vchi_cmd_delete(instance, cmd_blk); + return -ENXIO; + } + + list_move(&cmd_blk->head, &instance->dead_list); + mutex_unlock(&instance->lock); + complete(&instance->io_cmplt); + return -EINTR; /* We're done */ + } + + if (result && result_size) { + memcpy(result, cmd_blk->msg, result_size); + } else { + struct vc_sm_result_t *res = + (struct vc_sm_result_t *)cmd_blk->msg; + status = (res->success == 0) ? 0 : -ENXIO; + } + + mutex_lock(&instance->lock); + list_del(&cmd_blk->head); + mutex_unlock(&instance->lock); + vc_vchi_cmd_delete(instance, cmd_blk); + return status; +} + +int vc_sm_cma_vchi_free(struct sm_instance *handle, struct vc_sm_free_t *msg, + u32 *cur_trans_id) +{ + return vc_sm_cma_vchi_send_msg(handle, VC_SM_MSG_TYPE_FREE, + msg, sizeof(*msg), 0, 0, cur_trans_id, 0); +} + +int vc_sm_cma_vchi_import(struct sm_instance *handle, struct vc_sm_import *msg, + struct vc_sm_import_result *result, u32 *cur_trans_id) +{ + return vc_sm_cma_vchi_send_msg(handle, VC_SM_MSG_TYPE_IMPORT, + msg, sizeof(*msg), result, sizeof(*result), + cur_trans_id, 1); +} + +int vc_sm_cma_vchi_client_version(struct sm_instance *handle, + struct vc_sm_version *msg, + struct vc_sm_result_t *result, + u32 *cur_trans_id) +{ + return vc_sm_cma_vchi_send_msg(handle, VC_SM_MSG_TYPE_CLIENT_VERSION, + msg, sizeof(*msg), NULL, 0, + cur_trans_id, 0); +} + +int vc_sm_vchi_client_vc_mem_req_reply(struct sm_instance *handle, + struct vc_sm_vc_mem_request_result *msg, + uint32_t *cur_trans_id) +{ + return vc_sm_cma_vchi_send_msg(handle, + VC_SM_MSG_TYPE_VC_MEM_REQUEST_REPLY, + msg, sizeof(*msg), 0, 0, cur_trans_id, + 0); +} diff --git a/drivers/platform/raspberrypi/vc-sm-cma/vc_sm_cma_vchi.h b/drivers/platform/raspberrypi/vc-sm-cma/vc_sm_cma_vchi.h new file mode 100644 index 000000000000..6b6fa2837c9f --- /dev/null +++ b/drivers/platform/raspberrypi/vc-sm-cma/vc_sm_cma_vchi.h @@ -0,0 +1,64 @@ +/* SPDX-License-Identifier: GPL-2.0 */ + +/* + * VideoCore Shared Memory CMA allocator + * + * Copyright: 2018, Raspberry Pi (Trading) Ltd + * Copyright 2011-2012 Broadcom Corporation. All rights reserved. + * + * Based on vmcs_sm driver from Broadcom Corporation. + * + */ + +#ifndef __VC_SM_CMA_VCHI_H__INCLUDED__ +#define __VC_SM_CMA_VCHI_H__INCLUDED__ + +#include <linux/raspberrypi/vchiq.h> + +#include "vc_sm_defs.h" + +/* + * Forward declare. + */ +struct sm_instance; + +typedef void (*vpu_event_cb)(struct sm_instance *instance, + struct vc_sm_result_t *reply, int reply_len); + +/* + * Initialize the shared memory service, opens up vchi connection to talk to it. + */ +struct sm_instance *vc_sm_cma_vchi_init(struct vchiq_instance *vchi_instance, + unsigned int num_connections, + vpu_event_cb vpu_event); + +/* + * Terminates the shared memory service. + */ +int vc_sm_cma_vchi_stop(struct vchiq_instance *vchi_instance, + struct sm_instance **handle); + +/* + * Ask the shared memory service to free up some memory that was previously + * allocated by the vc_sm_cma_vchi_alloc function call. + */ +int vc_sm_cma_vchi_free(struct sm_instance *handle, struct vc_sm_free_t *msg, + u32 *cur_trans_id); + +/* + * Import a contiguous block of memory and wrap it in a GPU MEM_HANDLE_T. + */ +int vc_sm_cma_vchi_import(struct sm_instance *handle, struct vc_sm_import *msg, + struct vc_sm_import_result *result, + u32 *cur_trans_id); + +int vc_sm_cma_vchi_client_version(struct sm_instance *handle, + struct vc_sm_version *msg, + struct vc_sm_result_t *result, + u32 *cur_trans_id); + +int vc_sm_vchi_client_vc_mem_req_reply(struct sm_instance *handle, + struct vc_sm_vc_mem_request_result *msg, + uint32_t *cur_trans_id); + +#endif /* __VC_SM_CMA_VCHI_H__INCLUDED__ */ diff --git a/drivers/platform/raspberrypi/vc-sm-cma/vc_sm_defs.h b/drivers/platform/raspberrypi/vc-sm-cma/vc_sm_defs.h new file mode 100644 index 000000000000..7cabbadfe7ca --- /dev/null +++ b/drivers/platform/raspberrypi/vc-sm-cma/vc_sm_defs.h @@ -0,0 +1,298 @@ +/* SPDX-License-Identifier: GPL-2.0 */ + +/* + * VideoCore Shared Memory CMA allocator + * + * Copyright: 2018, Raspberry Pi (Trading) Ltd + * + * Based on vc_sm_defs.h from the vmcs_sm driver Copyright Broadcom Corporation. + * All IPC messages are copied across to this file, even if the vc-sm-cma + * driver is not currently using them. + * + **************************************************************************** + */ + +#ifndef __VC_SM_DEFS_H__INCLUDED__ +#define __VC_SM_DEFS_H__INCLUDED__ + +#include <linux/types.h> + +/* Maximum message length */ +#define VC_SM_MAX_MSG_LEN (sizeof(union vc_sm_msg_union_t) + \ + sizeof(struct vc_sm_msg_hdr_t)) +#define VC_SM_MAX_RSP_LEN (sizeof(union vc_sm_msg_union_t)) + +/* Resource name maximum size */ +#define VC_SM_RESOURCE_NAME 32 + +/* + * Version to be reported to the VPU + * VPU assumes 0 (aka 1) which does not require the released callback, nor + * expect the client to handle VC_MEM_REQUESTS. + * Version 2 requires the released callback, and must support VC_MEM_REQUESTS. + */ +#define VC_SM_PROTOCOL_VERSION 2 + +enum vc_sm_msg_type { + /* Message types supported for HOST->VC direction */ + + /* Allocate shared memory block */ + VC_SM_MSG_TYPE_ALLOC, + /* Lock allocated shared memory block */ + VC_SM_MSG_TYPE_LOCK, + /* Unlock allocated shared memory block */ + VC_SM_MSG_TYPE_UNLOCK, + /* Unlock allocated shared memory block, do not answer command */ + VC_SM_MSG_TYPE_UNLOCK_NOANS, + /* Free shared memory block */ + VC_SM_MSG_TYPE_FREE, + /* Resize a shared memory block */ + VC_SM_MSG_TYPE_RESIZE, + /* Walk the allocated shared memory block(s) */ + VC_SM_MSG_TYPE_WALK_ALLOC, + + /* A previously applied action will need to be reverted */ + VC_SM_MSG_TYPE_ACTION_CLEAN, + + /* + * Import a physical address and wrap into a MEM_HANDLE_T. + * Release with VC_SM_MSG_TYPE_FREE. + */ + VC_SM_MSG_TYPE_IMPORT, + /* + *Tells VC the protocol version supported by this client. + * 2 supports the async/cmd messages from the VPU for final release + * of memory, and for VC allocations. + */ + VC_SM_MSG_TYPE_CLIENT_VERSION, + /* Response to VC request for memory */ + VC_SM_MSG_TYPE_VC_MEM_REQUEST_REPLY, + + /* + * Asynchronous/cmd messages supported for VC->HOST direction. + * Signalled by setting the top bit in vc_sm_result_t trans_id. + */ + + /* + * VC has finished with an imported memory allocation. + * Release any Linux reference counts on the underlying block. + */ + VC_SM_MSG_TYPE_RELEASED, + /* VC request for memory */ + VC_SM_MSG_TYPE_VC_MEM_REQUEST, + + VC_SM_MSG_TYPE_MAX +}; + +/* Type of memory to be allocated */ +enum vc_sm_alloc_type_t { + VC_SM_ALLOC_CACHED, + VC_SM_ALLOC_NON_CACHED, +}; + +/* Message header for all messages in HOST->VC direction */ +struct vc_sm_msg_hdr_t { + u32 type; + u32 trans_id; + u8 body[]; +}; + +/* Request to allocate memory (HOST->VC) */ +struct vc_sm_alloc_t { + /* type of memory to allocate */ + enum vc_sm_alloc_type_t type; + /* byte amount of data to allocate per unit */ + u32 base_unit; + /* number of unit to allocate */ + u32 num_unit; + /* alignment to be applied on allocation */ + u32 alignment; + /* identity of who allocated this block */ + u32 allocator; + /* resource name (for easier tracking on vc side) */ + char name[VC_SM_RESOURCE_NAME]; + +}; + +/* Result of a requested memory allocation (VC->HOST) */ +struct vc_sm_alloc_result_t { + /* Transaction identifier */ + u32 trans_id; + + /* Resource handle */ + u32 res_handle; + /* Pointer to resource buffer */ + u32 res_mem; + /* Resource base size (bytes) */ + u32 res_base_size; + /* Resource number */ + u32 res_num; + +}; + +/* Request to free a previously allocated memory (HOST->VC) */ +struct vc_sm_free_t { + /* Resource handle (returned from alloc) */ + u32 res_handle; + /* Resource buffer (returned from alloc) */ + u32 res_mem; + +}; + +/* Request to lock a previously allocated memory (HOST->VC) */ +struct vc_sm_lock_unlock_t { + /* Resource handle (returned from alloc) */ + u32 res_handle; + /* Resource buffer (returned from alloc) */ + u32 res_mem; + +}; + +/* Request to resize a previously allocated memory (HOST->VC) */ +struct vc_sm_resize_t { + /* Resource handle (returned from alloc) */ + u32 res_handle; + /* Resource buffer (returned from alloc) */ + u32 res_mem; + /* Resource *new* size requested (bytes) */ + u32 res_new_size; + +}; + +/* Result of a requested memory lock (VC->HOST) */ +struct vc_sm_lock_result_t { + /* Transaction identifier */ + u32 trans_id; + + /* Resource handle */ + u32 res_handle; + /* Pointer to resource buffer */ + u32 res_mem; + /* + * Pointer to former resource buffer if the memory + * was reallocated + */ + u32 res_old_mem; + +}; + +/* Generic result for a request (VC->HOST) */ +struct vc_sm_result_t { + /* Transaction identifier */ + u32 trans_id; + + s32 success; + +}; + +/* Request to revert a previously applied action (HOST->VC) */ +struct vc_sm_action_clean_t { + /* Action of interest */ + enum vc_sm_msg_type res_action; + /* Transaction identifier for the action of interest */ + u32 action_trans_id; + +}; + +/* Request to remove all data associated with a given allocator (HOST->VC) */ +struct vc_sm_free_all_t { + /* Allocator identifier */ + u32 allocator; +}; + +/* Request to import memory (HOST->VC) */ +struct vc_sm_import { + /* type of memory to allocate */ + enum vc_sm_alloc_type_t type; + /* pointer to the VC (ie physical) address of the allocated memory */ + u32 addr; + /* size of buffer */ + u32 size; + /* opaque handle returned in RELEASED messages */ + u32 kernel_id; + /* Allocator identifier */ + u32 allocator; + /* resource name (for easier tracking on vc side) */ + char name[VC_SM_RESOURCE_NAME]; +}; + +/* Result of a requested memory import (VC->HOST) */ +struct vc_sm_import_result { + /* Transaction identifier */ + u32 trans_id; + + /* Resource handle */ + u32 res_handle; +}; + +/* Notification that VC has finished with an allocation (VC->HOST) */ +struct vc_sm_released { + /* cmd type / trans_id */ + u32 cmd; + + /* pointer to the VC (ie physical) address of the allocated memory */ + u32 addr; + /* size of buffer */ + u32 size; + /* opaque handle returned in RELEASED messages */ + u32 kernel_id; + u32 vc_handle; +}; + +/* + * Client informing VC as to the protocol version it supports. + * >=2 requires the released callback, and supports VC asking for memory. + * Failure means that the firmware doesn't support this call, and therefore the + * client should either fail, or NOT rely on getting the released callback. + */ +struct vc_sm_version { + u32 version; +}; + +/* Request FROM VideoCore for some memory */ +struct vc_sm_vc_mem_request { + /* cmd type */ + u32 cmd; + + /* trans_id (from VPU) */ + u32 trans_id; + /* size of buffer */ + u32 size; + /* alignment of buffer */ + u32 align; + /* resource name (for easier tracking) */ + char name[VC_SM_RESOURCE_NAME]; + /* VPU handle for the resource */ + u32 vc_handle; +}; + +/* Response from the kernel to provide the VPU with some memory */ +struct vc_sm_vc_mem_request_result { + /* Transaction identifier for the VPU */ + u32 trans_id; + /* pointer to the physical address of the allocated memory */ + u32 addr; + /* opaque handle returned in RELEASED messages */ + u32 kernel_id; +}; + +/* Union of ALL messages */ +union vc_sm_msg_union_t { + struct vc_sm_alloc_t alloc; + struct vc_sm_alloc_result_t alloc_result; + struct vc_sm_free_t free; + struct vc_sm_lock_unlock_t lock_unlock; + struct vc_sm_action_clean_t action_clean; + struct vc_sm_resize_t resize; + struct vc_sm_lock_result_t lock_result; + struct vc_sm_result_t result; + struct vc_sm_free_all_t free_all; + struct vc_sm_import import; + struct vc_sm_import_result import_result; + struct vc_sm_version version; + struct vc_sm_released released; + struct vc_sm_vc_mem_request vc_request; + struct vc_sm_vc_mem_request_result vc_request_result; +}; + +#endif /* __VC_SM_DEFS_H__INCLUDED__ */ diff --git a/include/linux/raspberrypi/vc_sm_cma_ioctl.h b/include/linux/raspberrypi/vc_sm_cma_ioctl.h new file mode 100644 index 000000000000..4dc006d8057a --- /dev/null +++ b/include/linux/raspberrypi/vc_sm_cma_ioctl.h @@ -0,0 +1,110 @@ +/* SPDX-License-Identifier: GPL-2.0 */ + +/* + * Copyright 2019 Raspberry Pi (Trading) Ltd. All rights reserved. + * + * Based on vmcs_sm_ioctl.h Copyright Broadcom Corporation. + */ + +#ifndef __VC_SM_CMA_IOCTL_H +#define __VC_SM_CMA_IOCTL_H + +#if defined(__KERNEL__) +#include <linux/types.h> /* Needed for standard types */ +#else +#include <stdint.h> +#endif + +#include <linux/ioctl.h> + +#define VC_SM_CMA_RESOURCE_NAME 32 +#define VC_SM_CMA_RESOURCE_NAME_DEFAULT "sm-host-resource" + +/* Type define used to create unique IOCTL number */ +#define VC_SM_CMA_MAGIC_TYPE 'J' + +/* IOCTL commands on /dev/vc-sm-cma */ +enum vc_sm_cma_cmd_e { + VC_SM_CMA_CMD_ALLOC = 0x5A, /* Start at 0x5A arbitrarily */ + + VC_SM_CMA_CMD_IMPORT_DMABUF, + + VC_SM_CMA_CMD_CLEAN_INVALID2, + + VC_SM_CMA_CMD_LAST /* Do not delete */ +}; + +/* Cache type supported, conveniently matches the user space definition in + * user-vcsm.h. + */ +enum vc_sm_cma_cache_e { + VC_SM_CMA_CACHE_NONE, + VC_SM_CMA_CACHE_HOST, + VC_SM_CMA_CACHE_VC, + VC_SM_CMA_CACHE_BOTH, +}; + +/* IOCTL Data structures */ +struct vc_sm_cma_ioctl_alloc { + /* user -> kernel */ + __u32 size; + __u32 num; + __u32 cached; /* enum vc_sm_cma_cache_e */ + __u32 pad; + __u8 name[VC_SM_CMA_RESOURCE_NAME]; + + /* kernel -> user */ + __s32 handle; + __u32 vc_handle; + __u64 dma_addr; +}; + +struct vc_sm_cma_ioctl_import_dmabuf { + /* user -> kernel */ + __s32 dmabuf_fd; + __u32 cached; /* enum vc_sm_cma_cache_e */ + __u8 name[VC_SM_CMA_RESOURCE_NAME]; + + /* kernel -> user */ + __s32 handle; + __u32 vc_handle; + __u32 size; + __u32 pad; + __u64 dma_addr; +}; + +/* + * Cache functions to be set to struct vc_sm_cma_ioctl_clean_invalid2 + * invalidate_mode. + */ +#define VC_SM_CACHE_OP_NOP 0x00 +#define VC_SM_CACHE_OP_INV 0x01 +#define VC_SM_CACHE_OP_CLEAN 0x02 +#define VC_SM_CACHE_OP_FLUSH 0x03 + +struct vc_sm_cma_ioctl_clean_invalid2 { + __u32 op_count; + __u32 pad; + struct vc_sm_cma_ioctl_clean_invalid_block { + __u32 invalidate_mode; + __u32 block_count; + void * __user start_address; + __u32 block_size; + __u32 inter_block_stride; + } s[]; +}; + +/* IOCTL numbers */ +#define VC_SM_CMA_IOCTL_MEM_ALLOC\ + _IOR(VC_SM_CMA_MAGIC_TYPE, VC_SM_CMA_CMD_ALLOC,\ + struct vc_sm_cma_ioctl_alloc) + +#define VC_SM_CMA_IOCTL_MEM_IMPORT_DMABUF\ + _IOR(VC_SM_CMA_MAGIC_TYPE, VC_SM_CMA_CMD_IMPORT_DMABUF,\ + struct vc_sm_cma_ioctl_import_dmabuf) + +#define VC_SM_CMA_IOCTL_MEM_CLEAN_INVALID2\ + _IOR(VC_SM_CMA_MAGIC_TYPE, VC_SM_CMA_CMD_CLEAN_INVALID2,\ + struct vc_sm_cma_ioctl_clean_invalid2) + +#endif /* __VC_SM_CMA_IOCTL_H */ diff --git a/include/linux/raspberrypi/vc_sm_knl.h b/include/linux/raspberrypi/vc_sm_knl.h new file mode 100644 index 000000000000..f3e6b5648b23 --- /dev/null +++ b/include/linux/raspberrypi/vc_sm_knl.h @@ -0,0 +1,76 @@ +/* SPDX-License-Identifier: GPL-2.0 */ + +/* + * VideoCore Shared Memory CMA allocator + * + * Copyright: 2018, Raspberry Pi (Trading) Ltd + * + * Based on vc_sm_defs.h from the vmcs_sm driver Copyright Broadcom Corporation. + * + */ + +#ifndef __VC_SM_KNL_H__INCLUDED__ +#define __VC_SM_KNL_H__INCLUDED__ + +#include <linux/dma-buf.h> + +/** + * vc_sm_cma_free() - Release a VideoCore shared memory buffer + * @handle: Pointer to dmabuf representing the buffer to free + * + * This function should be called to release handles obtained from + * vc_sm_cma_import_dmabuf(). It decrements the dmabuf reference count, + * which triggers the cleanup sequence if this was the last reference. + * + * The actual memory deallocation is deferred until both the ARM-side + * references are released AND VideoCore confirms it has finished accessing + * the buffer. This ensures safe cleanup even if VideoCore operations are + * still in progress. + * + * Returns 0 on success, -%EPERM if the device is not initialized or handle is + * invalid. + */ +int vc_sm_cma_free(void *handle); + +/** + * vc_sm_cma_int_handle() - Get VideoCore handle from dmabuf handle + * @handle: Pointer to dmabuf representing the shared memory buffer + * + * This function retrieves the VideoCore firmware handle associated with + * a dmabuf that was previously allocated or imported through this driver. + * The VideoCore handle is required when communicating with VideoCore + * firmware to reference the shared buffer. + * + * The handle parameter must be a dmabuf pointer that was obtained from + * either vc_sm_cma_import_dmabuf() or through the /dev/vcsm-cma device + * allocation ioctls. + * + * Returns VideoCore handle (non-zero) on success, 0 on failure or invalid + * input. + */ +int vc_sm_cma_int_handle(void *handle); + +/** + * vc_sm_cma_import_dmabuf() - Import a dmabuf for sharing with VideoCore + * @src_dmabuf: DMA-BUF to import + * @handle: Output pointer to receive the new dmabuf handle + * + * Imports an existing dmabuf into the VideoCore shared memory subsystem, + * making it accessible to VideoCore firmware. This allows sharing of + * buffers allocated by other kernel drivers (such as V4L2) with VideoCore. + * + * The returned handle must be freed with vc_sm_cma_free() when no longer + * needed. The handle can be passed to vc_sm_cma_int_handle() to obtain + * the VideoCore firmware handle for use in MMAL or other VideoCore APIs. + * + * The imported buffer must be physically contiguous and located in memory + * addressable by VideoCore. + * + * Returns 0 on success and @handle is set to the new dmabuf pointer, + * -%EPERM if the device is not initialized or input is invalid, + * -%ENOMEM if allocation fails, + * -%ERESTARTSYS if interrupted by signal during VCHI communication. + */ +int vc_sm_cma_import_dmabuf(struct dma_buf *dmabuf, void **handle); + +#endif /* __VC_SM_KNL_H__INCLUDED__ */ -- 2.55.0 ^ permalink raw reply related [flat|nested] 8+ messages in thread
* Re: [PATCH v4 3/6] platform/raspberrypi: Add VideoCore shared memory support 2026-09-16 14:25 ` [PATCH v4 3/6] platform/raspberrypi: Add VideoCore shared memory support Jai Luthra @ 2026-09-17 21:11 ` Stefan Wahren 0 siblings, 0 replies; 8+ messages in thread From: Stefan Wahren @ 2026-09-17 21:11 UTC (permalink / raw) To: Jai Luthra, Florian Fainelli, Raspberry Pi Kernel Maintenance, bcm-kernel-feedback-list, Greg Kroah-Hartman, Dave Stevenson, Phil Elwell, Hans Verkuil, Mauro Carvalho Chehab Cc: Laurent Pinchart, Kieran Bingham, linux-arm-kernel, linux-kernel, linux-rpi-kernel, linux-media, Dom Cobley, Alexander Winkowski, Juerg Haefliger Hi Jai, Am 16.09.26 um 16:25 schrieb Jai Luthra: > From: Dave Stevenson <dave.stevenson@raspberrypi.com> > > Add support for the vc-sm-cma driver, to enable sharing of contiguous > CMA memory allocations with the VideoCore VPU on Raspberry Pi. The > driver allocates CMA-backed buffers, imports external dmabufs, and > manages their lifetime via VCHIQ messaging to the VPU service, ensuring > buffers are not released until both the linux userspace and the VPU > confirm completion. > > VC4 can only physically address the lower 1GB of RAM and requires > buffers to be mapped through specific uncached address aliases > (0xC0000000). Thus, standard CMA could not be used as it has no > mechanism to ensure allocations are visible and valid to VideoCore > firmware, or handle cache flushes as VC4 can't see ARM's cache state. > > The vc-sm-cma driver bridges this gap by allocating memory via CMA on > the ARM side and explicitly importing it into VideoCore via VCHI. > > This driver is primarily used by the wrapper V4L2 drivers for codec and > ISP, where firmware running on VC4 does the actual video and image > processing, while the linux userspace interacts with standard V4L2 > driver interfaces. For example, the ISP driver populates large > lens-shading related tables for a particular camera setup, and uses > vc-sm-cma to share this buffer with VC4. > > Signed-off-by: Dave Stevenson <dave.stevenson@raspberrypi.com> > Signed-off-by: Dom Cobley <popcornmix@gmail.com> > Signed-off-by: Phil Elwell <phil@raspberrypi.com> > Signed-off-by: Alexander Winkowski <dereference23@outlook.com> > Signed-off-by: Kieran Bingham <kieran.bingham@ideasonboard.com> > Signed-off-by: Juerg Haefliger <juerg.haefliger@canonical.com> > [clean-up for mainline and switch to xarray instead of idr] > Signed-off-by: Jai Luthra <jai.luthra@ideasonboard.com> > --- > Changes in v4: > - Rebase on v7.3-rc1 > - Cut out all userspace import and VPU alloc code (from Dave) > - Fix most of the overflow lines (> 80) > Changes in v3: > - Rebase on v7.2-rc1 > - Switch from kzalloc with sizeof to kzalloc_obj > - Fix lkp bot errors with Kconfig dependencies > --- > MAINTAINERS | 7 + > drivers/platform/raspberrypi/Kconfig | 2 + > drivers/platform/raspberrypi/Makefile | 1 + > drivers/platform/raspberrypi/vc-sm-cma/Kconfig | 9 + > drivers/platform/raspberrypi/vc-sm-cma/Makefile | 5 + > drivers/platform/raspberrypi/vc-sm-cma/vc_sm.c | 806 +++++++++++++++++++++ > drivers/platform/raspberrypi/vc-sm-cma/vc_sm.h | 64 ++ > .../raspberrypi/vc-sm-cma/vc_sm_cma_vchi.c | 510 +++++++++++++ > .../raspberrypi/vc-sm-cma/vc_sm_cma_vchi.h | 64 ++ > .../platform/raspberrypi/vc-sm-cma/vc_sm_defs.h | 298 ++++++++ > include/linux/raspberrypi/vc_sm_cma_ioctl.h | 110 +++ > include/linux/raspberrypi/vc_sm_knl.h | 76 ++ > 12 files changed, 1952 insertions(+) > > diff --git a/MAINTAINERS b/MAINTAINERS > index 3a19da74d00c..b887ac593088 100644 > --- a/MAINTAINERS > +++ b/MAINTAINERS > @@ -5626,6 +5626,13 @@ L: netdev@vger.kernel.org > S: Maintained > F: drivers/net/ethernet/broadcom/tg3.* > > +BROADCOM VIDEOCORE SHARED MEMORY DRIVER > +M: Raspberry Pi Kernel Maintenance <kernel-list@raspberrypi.com> > +L: linux-kernel@vger.kernel.org > +S: Maintained > +F: drivers/platform/raspberrypi/vc-sm-cma/* > +F: include/linux/raspberrypi/vc_sm_cma* > + > BROADCOM VK DRIVER > M: Scott Branden <scott.branden@broadcom.com> > R: Broadcom internal kernel review list <bcm-kernel-feedback-list@broadcom.com> > diff --git a/drivers/platform/raspberrypi/Kconfig b/drivers/platform/raspberrypi/Kconfig > index 2c928440a47c..68a7a2d5701c 100644 > --- a/drivers/platform/raspberrypi/Kconfig > +++ b/drivers/platform/raspberrypi/Kconfig > @@ -48,5 +48,7 @@ config VCHIQ_CDEV > endif > > source "drivers/platform/raspberrypi/vchiq-mmal/Kconfig" > +source "drivers/platform/raspberrypi/vc-sm-cma/Kconfig" > + > > endif > diff --git a/drivers/platform/raspberrypi/Makefile b/drivers/platform/raspberrypi/Makefile > index 2a7c9511e5d8..1980f618e218 100644 > --- a/drivers/platform/raspberrypi/Makefile > +++ b/drivers/platform/raspberrypi/Makefile > @@ -13,3 +13,4 @@ vchiq-objs += vchiq-interface/vchiq_dev.o > endif > > obj-$(CONFIG_BCM2835_VCHIQ_MMAL) += vchiq-mmal/ > +obj-$(CONFIG_BCM_VC_SM_CMA) += vc-sm-cma/ > diff --git a/drivers/platform/raspberrypi/vc-sm-cma/Kconfig b/drivers/platform/raspberrypi/vc-sm-cma/Kconfig > new file mode 100644 > index 000000000000..4af14a0e3458 > --- /dev/null > +++ b/drivers/platform/raspberrypi/vc-sm-cma/Kconfig > @@ -0,0 +1,9 @@ > +config BCM_VC_SM_CMA > + tristate "VideoCore Shared Memory (CMA) driver" > + select BCM2835_VCHIQ if HAS_DMA > + select DMA_SHARED_BUFFER > + help > + Say Y here to enable the shared memory interface that > + supports sharing dmabufs with VideoCore. > + This operates over the VCHIQ interface to a service > + running on VideoCore. > diff --git a/drivers/platform/raspberrypi/vc-sm-cma/Makefile b/drivers/platform/raspberrypi/vc-sm-cma/Makefile > new file mode 100644 > index 000000000000..0419b9770b68 > --- /dev/null > +++ b/drivers/platform/raspberrypi/vc-sm-cma/Makefile > @@ -0,0 +1,5 @@ > +# SPDX-License-Identifier: GPL-2.0 > +vc-sm-cma-$(CONFIG_BCM_VC_SM_CMA) := \ > + vc_sm.o vc_sm_cma_vchi.o > + > +obj-$(CONFIG_BCM_VC_SM_CMA) += vc-sm-cma.o > diff --git a/drivers/platform/raspberrypi/vc-sm-cma/vc_sm.c b/drivers/platform/raspberrypi/vc-sm-cma/vc_sm.c > new file mode 100644 > index 000000000000..80c13ccd8897 > --- /dev/null > +++ b/drivers/platform/raspberrypi/vc-sm-cma/vc_sm.c > @@ -0,0 +1,806 @@ > +// SPDX-License-Identifier: GPL-2.0 > +/* > + * VideoCore Shared Memory driver using CMA. > + * > + * Copyright: 2018, Raspberry Pi (Trading) Ltd > + * Dave Stevenson <dave.stevenson@raspberrypi.com> > + * > + * Based on vmcs_sm driver from Broadcom Corporation for some API, > + * and taking some code for buffer allocation and dmabuf handling from > + * videobuf2. > + * > + * This driver has 3 main uses: > + * 1) Allocating buffers for the kernel or userspace that can be shared with the > + * VPU. > + * 2) Importing dmabufs from elsewhere for sharing with the VPU. > + * 3) Allocating buffers for use by the VPU. > + * > + * In the first and second cases the native handle is a dmabuf. Releasing the > + * resource inherently comes from releasing the dmabuf, and this will trigger > + * unmapping on the VPU. The underlying allocation and our buffer structure are > + * retained until the VPU has confirmed that it has finished with it. > + * > + * For the VPU allocations the VPU is responsible for triggering the release, > + * and therefore the released message decrements the dma_buf refcount (with the > + * VPU mapping having already been marked as released). > + */ > + > +#include <linux/device.h> > +#include <linux/debugfs.h> > +#include <linux/dma-mapping.h> > +#include <linux/dma-buf.h> > +#include <linux/fs.h> > +#include <linux/list.h> > +#include <linux/miscdevice.h> > +#include <linux/module.h> > +#include <linux/of_device.h> > +#include <linux/raspberrypi/vchiq_arm.h> > +#include <linux/raspberrypi/vchiq_bus.h> > +#include <linux/raspberrypi/vc_sm_cma_ioctl.h> > +#include <linux/raspberrypi/vc_sm_knl.h> > +#include <linux/slab.h> > +#include <linux/seq_file.h> > +#include <linux/xarray.h> > + > +#include "vc_sm_cma_vchi.h" > + > +#include "vc_sm.h" > + > +MODULE_IMPORT_NS("DMA_BUF"); > + > +#define DEVICE_NAME "vcsm-cma" > +#define DEVICE_MINOR 0 > + > +#define VC_SM_RESOURCE_NAME_DEFAULT "sm-host-resource" > + > +#define VC_SM_DIR_ROOT_NAME "vcsm-cma" > +#define VC_SM_STATE "state" > + > +typedef int (*VC_SM_SHOW) (struct seq_file *s, void *v); AFAIR we should avoid typedefs > +struct sm_pde_t { > + VC_SM_SHOW show; /* Debug fs function hookup. */ > + struct dentry *dir_entry; /* Debug fs directory entry. */ > + void *priv_data; /* Private data */ > +}; > + > +/* Global state information. */ > +struct sm_state_t { > + struct vchiq_device *device; > + > + struct miscdevice misc_dev; > + > + struct sm_instance *sm_handle; /* Handle for videocore service. */ > + > + struct xarray kernelid_map; > + > + struct mutex map_lock; /* Global map lock. */ > + struct list_head buffer_list; /* List of buffer. */ > + > + struct dentry *dir_root; /* Debug fs entries root. */ > + struct sm_pde_t dir_state; /* Debug fs entries state sub-tree. */ > + > + bool require_released_callback; /* VPU will send a released msg when it > + * has finished with a resource. > + */ > + /* State for transactions */ > + int restart_sys; /* Tracks restart on interrupt. */ > + enum vc_sm_msg_type int_action; /* Interrupted action. */ > + u32 int_trans_id; /* Interrupted transaction. */ > + struct vchiq_instance *vchiq_instance; > +}; > + > +struct vc_sm_dma_buf_attachment { > + struct device *dev; > + struct sg_table sg_table; > + struct list_head list; > + enum dma_data_direction dma_dir; > +}; > + > +static struct sm_state_t *sm_state; > +static int sm_inited; > + > +static int get_kernel_id(struct vc_sm_buffer *buffer) > +{ > + int handle, ret; > + > + ret = xa_alloc(&sm_state->kernelid_map, &handle, buffer, xa_limit_31b, > + GFP_KERNEL); > + > + return ret < 0 ? ret : handle; > +} > + > +static struct vc_sm_buffer *lookup_kernel_id(int handle) > +{ > + return xa_load(&sm_state->kernelid_map, handle); > +} > + > +static void free_kernel_id(int handle) > +{ > + xa_erase(&sm_state->kernelid_map, handle); > +} > + > +static int vc_sm_cma_seq_file_show(struct seq_file *s, void *v) > +{ > + struct sm_pde_t *sm_pde; > + > + sm_pde = (struct sm_pde_t *)(s->private); > + > + if (sm_pde && sm_pde->show) > + sm_pde->show(s, v); > + > + return 0; > +} > + > +static int vc_sm_cma_single_open(struct inode *inode, struct file *file) > +{ > + return single_open(file, vc_sm_cma_seq_file_show, inode->i_private); > +} > + > +static const struct file_operations vc_sm_cma_debug_fs_fops = { > + .open = vc_sm_cma_single_open, > + .read = seq_read, > + .llseek = seq_lseek, > + .release = single_release, > +}; > + > +static int vc_sm_cma_global_state_show(struct seq_file *s, void *v) > +{ > + struct vc_sm_buffer *resource = NULL; > + int resource_count = 0; > + > + if (!sm_state) > + return 0; > + > + seq_printf(s, "\nVC-ServiceHandle %p\n", sm_state->sm_handle); Is %p really necessary? > + > + /* Log all applicable mapping(s). */ > + > + mutex_lock(&sm_state->map_lock); > + seq_puts(s, "\nResources\n"); > + if (!list_empty(&sm_state->buffer_list)) { > + list_for_each_entry(resource, &sm_state->buffer_list, > + global_buffer_list) { > + resource_count++; > + > + seq_printf(s, "\nResource %p\n", > + resource); > + seq_printf(s, " NAME %s\n", > + resource->name); > + seq_printf(s, " SIZE %zu\n", > + resource->size); > + seq_printf(s, " DMABUF %p\n", > + resource->dma_buf); > + seq_printf(s, " IMPORTED_DMABUF %p\n", > + resource->imported_dma_buf); > + seq_printf(s, " ATTACH %p\n", > + resource->attach); > + seq_printf(s, " SGT %p\n", > + resource->sgt); > + seq_printf(s, " DMA_ADDR %pad\n", > + &resource->dma_addr); > + seq_printf(s, " VC_HANDLE %08x\n", > + resource->vc_handle); > + seq_printf(s, " VC_MAPPING %d\n", > + resource->vpu_state); > + } > + } > + seq_printf(s, "\n\nTotal resource count: %d\n\n", resource_count); > + > + mutex_unlock(&sm_state->map_lock); > + > + return 0; > +} > + > +/* > + * Adds a buffer to the private data list which tracks all the allocated > + * data. > + */ > +static void vc_sm_add_resource(struct vc_sm_buffer *buffer) > +{ > + mutex_lock(&sm_state->map_lock); > + list_add(&buffer->global_buffer_list, &sm_state->buffer_list); > + mutex_unlock(&sm_state->map_lock); > +} > + > +/* > + * Cleans up imported dmabuf. > + * Should be called with mutex held. > + */ > +static void vc_sm_clean_up_dmabuf(struct vc_sm_buffer *buffer) > +{ > + /* Handle cleaning up imported dmabufs */ > + if (buffer->sgt) { > + dma_buf_unmap_attachment_unlocked(buffer->attach, > + buffer->sgt, > + DMA_BIDIRECTIONAL); > + buffer->sgt = NULL; > + } > + if (buffer->attach) { > + dma_buf_detach(buffer->imported_dma_buf, buffer->attach); > + buffer->attach = NULL; > + } > +} > + > +/* > + * Instructs VPU to decrement the refcount on a buffer. > + */ > +static void vc_sm_vpu_free(struct vc_sm_buffer *buffer) > +{ > + if (buffer->vc_handle && buffer->vpu_state == VPU_MAPPED) { > + struct vc_sm_free_t free = { buffer->vc_handle, 0 }; > + int status = vc_sm_cma_vchi_free(sm_state->sm_handle, &free, > + &sm_state->int_trans_id); > + if (status != 0 && status != -EINTR) { > + dev_err(&sm_state->device->dev, > + "%s: failed to free memory on videocore (status: %u, trans_id: %u)\n", > + __func__, status, sm_state->int_trans_id); > + } > + > + if (sm_state->require_released_callback) { > + /* Need to wait for the VPU to confirm the free. */ > + > + /* Retain a reference on this until the VPU has > + * released it > + */ This comment style looks strange > + buffer->vpu_state = VPU_UNMAPPING; > + } else { > + buffer->vpu_state = VPU_NOT_MAPPED; > + buffer->vc_handle = 0; > + } > + } > +} > + > +/* > + * Release an allocation. > + * All refcounting is done via the dma buf object. > + * > + * Must be called with the mutex held. The function will either release the > + * mutex (if defering the release) or destroy it. The caller must therefore not > + * reuse the buffer on return. > + */ > +static void vc_sm_release_resource(struct vc_sm_buffer *buffer) > +{ > + /* We've sent the unmap request but not had the response. */ > + if (buffer->vc_handle) > + goto defer; > + /* dmabuf still in use - we await the release */ > + if (buffer->in_use) > + goto defer; > + > + /* Release the allocation */ > + if (buffer->imported_dma_buf) > + dma_buf_put(buffer->imported_dma_buf); > + else > + dev_err(&sm_state->device->dev, "%s: Imported dmabuf already been put for buf %p\n", > + __func__, buffer); > + buffer->imported_dma_buf = NULL; > + > + /* Free our buffer. Start by removing it from the list */ > + mutex_lock(&sm_state->map_lock); > + list_del(&buffer->global_buffer_list); > + mutex_unlock(&sm_state->map_lock); > + > + mutex_unlock(&buffer->lock); > + mutex_destroy(&buffer->lock); > + > + kfree(buffer); > + return; > + > +defer: > + mutex_unlock(&buffer->lock); > +} > + > +static void vc_sm_dma_buf_release(struct dma_buf *dmabuf) > +{ > + struct vc_sm_buffer *buffer; > + > + if (!dmabuf) > + return; > + > + buffer = (struct vc_sm_buffer *)dmabuf->priv; > + > + mutex_lock(&buffer->lock); > + > + buffer->in_use = false; > + > + /* Unmap on the VPU */ > + vc_sm_vpu_free(buffer); > + > + /* Unmap our dma_buf object (the vc_sm_buffer remains until released > + * on the VPU). > + */ > + vc_sm_clean_up_dmabuf(buffer); > + > + /* buffer->lock will be destroyed by vc_sm_release_resource if finished > + * with, otherwise unlocked. Do NOT unlock here. > + */ > + vc_sm_release_resource(buffer); > +} > + > +/* Dma_buf operations for chaining through to an imported dma_buf */ > + > +static > +int vc_sm_import_dma_buf_attach(struct dma_buf *dmabuf, > + struct dma_buf_attachment *attachment) > +{ > + struct vc_sm_buffer *buf = dmabuf->priv; > + > + return buf->imported_dma_buf->ops->attach(buf->imported_dma_buf, > + attachment); > +} > + > +static > +void vc_sm_import_dma_buf_detatch(struct dma_buf *dmabuf, > + struct dma_buf_attachment *attachment) > +{ > + struct vc_sm_buffer *buf = dmabuf->priv; > + > + buf->imported_dma_buf->ops->detach(buf->imported_dma_buf, attachment); > +} > + > +static > +struct sg_table *vc_sm_import_map_dma_buf(struct dma_buf_attachment *attachment, > + enum dma_data_direction direction) > +{ > + struct vc_sm_buffer *buf = attachment->dmabuf->priv; > + > + return buf->imported_dma_buf->ops->map_dma_buf(attachment, > + direction); > +} > + > +static > +void vc_sm_import_unmap_dma_buf(struct dma_buf_attachment *attachment, > + struct sg_table *table, > + enum dma_data_direction direction) > +{ > + struct vc_sm_buffer *buf = attachment->dmabuf->priv; > + > + buf->imported_dma_buf->ops->unmap_dma_buf(attachment, table, direction); > +} > + > +static > +int vc_sm_import_dmabuf_mmap(struct dma_buf *dmabuf, struct vm_area_struct *vma) > +{ > + struct vc_sm_buffer *buf = dmabuf->priv; > + > + return buf->imported_dma_buf->ops->mmap(buf->imported_dma_buf, vma); > +} > + > +static > +int vc_sm_import_dma_buf_begin_cpu_access(struct dma_buf *dmabuf, > + enum dma_data_direction direction) > +{ > + struct vc_sm_buffer *buf = dmabuf->priv; > + const struct dma_buf_ops *ops = buf->imported_dma_buf->ops; > + > + return ops->begin_cpu_access(buf->imported_dma_buf, direction); > +} > + > +static > +int vc_sm_import_dma_buf_end_cpu_access(struct dma_buf *dmabuf, > + enum dma_data_direction direction) > +{ > + struct vc_sm_buffer *buf = dmabuf->priv; > + > + return buf->imported_dma_buf->ops->end_cpu_access(buf->imported_dma_buf, > + direction); > +} > + > +static const struct dma_buf_ops dma_buf_import_ops = { > + .map_dma_buf = vc_sm_import_map_dma_buf, > + .unmap_dma_buf = vc_sm_import_unmap_dma_buf, > + .mmap = vc_sm_import_dmabuf_mmap, > + .release = vc_sm_dma_buf_release, > + .attach = vc_sm_import_dma_buf_attach, > + .detach = vc_sm_import_dma_buf_detatch, > + .begin_cpu_access = vc_sm_import_dma_buf_begin_cpu_access, > + .end_cpu_access = vc_sm_import_dma_buf_end_cpu_access, > +}; > + > +/* Import a dma_buf to be shared with VC. */ > +static int > +vc_sm_cma_import_dmabuf_internal(struct dma_buf *dma_buf, > + int fd, > + struct dma_buf **imported_buf) > +{ > + DEFINE_DMA_BUF_EXPORT_INFO(exp_info); > + struct vc_sm_buffer *buffer = NULL; > + struct vc_sm_import import = { }; > + struct vc_sm_import_result result = { }; > + struct dma_buf_attachment *attach = NULL; > + struct sg_table *sgt = NULL; > + dma_addr_t dma_addr; > + u32 cache_alias; > + int ret = 0; > + int status; > + > + /* Setup our allocation parameters */ > + if (fd < 0) > + get_dma_buf(dma_buf); > + else > + dma_buf = dma_buf_get(fd); > + > + if (!dma_buf) > + return -EINVAL; > + > + attach = dma_buf_attach(dma_buf, &sm_state->device->dev); > + if (IS_ERR(attach)) { > + ret = PTR_ERR(attach); > + goto error; > + } > + > + sgt = dma_buf_map_attachment_unlocked(attach, DMA_BIDIRECTIONAL); > + if (IS_ERR(sgt)) { > + ret = PTR_ERR(sgt); > + goto error; > + } > + > + /* Verify that the address block is contiguous */ > + if (sgt->nents != 1) { > + ret = -ENOMEM; > + goto error; > + } > + > + /* Allocate local buffer to track this allocation. */ > + buffer = kzalloc(sizeof(*buffer), GFP_KERNEL); > + if (!buffer) { > + ret = -ENOMEM; > + goto error; > + } > + > + import.type = VC_SM_ALLOC_NON_CACHED; > + dma_addr = sg_dma_address(sgt->sgl); > + import.addr = (u32)dma_addr; > + cache_alias = import.addr & 0xC0000000; > + if (cache_alias != 0xC0000000 && cache_alias != 0x80000000) { > + dev_err(&sm_state->device->dev, "%s: Expecting an uncached alias for dma_addr %pad\n", > + __func__, &dma_addr); > + /* Note that this assumes we're on >= Pi2, but it implies a > + * DT configuration error. > + */ > + import.addr |= 0xC0000000; > + } It would be nice to replace these magic hex values > + import.size = sg_dma_len(sgt->sgl); > + import.allocator = current->tgid; > + import.kernel_id = get_kernel_id(buffer); > + if (import.kernel_id < 0) { > + ret = import.kernel_id; > + goto error; > + } > + > + memcpy(import.name, VC_SM_RESOURCE_NAME_DEFAULT, > + sizeof(VC_SM_RESOURCE_NAME_DEFAULT)); > + > + /* Allocate the videocore buffer. */ > + status = vc_sm_cma_vchi_import(sm_state->sm_handle, &import, &result, > + &sm_state->int_trans_id); > + if (status == -EINTR) { > + dev_dbg(&sm_state->device->dev, > + "%s: requesting import memory action restart (trans_id: %u)\n", > + __func__, sm_state->int_trans_id); > + ret = -ERESTARTSYS; > + sm_state->restart_sys = -EINTR; > + sm_state->int_action = VC_SM_MSG_TYPE_IMPORT; > + goto error; > + } else if (status || !result.res_handle) { > + dev_dbg(&sm_state->device->dev, > + "%s: failed to import memory on videocore (status: %u, trans_id: %u)\n", > + __func__, status, sm_state->int_trans_id); > + ret = -ENOMEM; > + goto error; > + } > + > + mutex_init(&buffer->lock); > + INIT_LIST_HEAD(&buffer->attachments); > + memcpy(buffer->name, import.name, > + min(sizeof(buffer->name), sizeof(import.name) - 1)); > + > + /* Keep track of the buffer we created. */ > + buffer->vc_handle = result.res_handle; > + buffer->size = import.size; > + buffer->vpu_state = VPU_MAPPED; > + > + buffer->imported_dma_buf = dma_buf; > + > + buffer->attach = attach; > + buffer->sgt = sgt; > + buffer->dma_addr = dma_addr; > + buffer->in_use = true; > + buffer->kernel_id = import.kernel_id; > + > + /* > + * We're done - we need to export a new dmabuf chaining through most > + * functions, but enabling us to release our own internal references > + * here. > + */ > + exp_info.ops = &dma_buf_import_ops; > + exp_info.size = import.size; > + exp_info.flags = O_RDWR; > + exp_info.priv = buffer; > + > + buffer->dma_buf = dma_buf_export(&exp_info); > + if (IS_ERR(buffer->dma_buf)) { > + ret = PTR_ERR(buffer->dma_buf); > + goto error; > + } > + > + vc_sm_add_resource(buffer); > + > + *imported_buf = buffer->dma_buf; > + > + return 0; > + > +error: > + if (result.res_handle) { > + struct vc_sm_free_t free = { result.res_handle, 0 }; > + > + vc_sm_cma_vchi_free(sm_state->sm_handle, &free, > + &sm_state->int_trans_id); > + } > + free_kernel_id(import.kernel_id); > + kfree(buffer); > + if (sgt) > + dma_buf_unmap_attachment_unlocked(attach, sgt, > + DMA_BIDIRECTIONAL); > + if (attach) > + dma_buf_detach(dma_buf, attach); > + dma_buf_put(dma_buf); > + return ret; > +} > + > +static void > +vc_sm_vpu_event(struct sm_instance *instance, struct vc_sm_result_t *reply, > + int reply_len) > +{ > + switch (reply->trans_id & ~0x80000000) { Please make this special number a define > + case VC_SM_MSG_TYPE_CLIENT_VERSION: > + { > + /* Acknowledge that the firmware supports the version command */ > + sm_state->require_released_callback = true; > + } > + break; > + case VC_SM_MSG_TYPE_RELEASED: > + { > + struct vc_sm_released *release = (struct vc_sm_released *)reply; > + struct vc_sm_buffer *buffer = > + lookup_kernel_id(release->kernel_id); > + if (!buffer) { > + dev_err(&sm_state->device->dev, > + "%s: VC released a buffer that is already released, kernel_id %d\n", > + __func__, release->kernel_id); > + break; > + } > + mutex_lock(&buffer->lock); > + > + dev_dbg(&sm_state->device->dev, > + "%s: Released addr %08x, size %u, id %08x, mem_handle %08x\n", > + __func__, release->addr, release->size, > + release->kernel_id, release->vc_handle); > + > + buffer->vc_handle = 0; > + buffer->vpu_state = VPU_NOT_MAPPED; > + free_kernel_id(release->kernel_id); > + > + vc_sm_release_resource(buffer); > + } > + break; > + default: > + dev_err(&sm_state->device->dev, "%s: Unknown vpu cmd %x\n", > + __func__, reply->trans_id); > + break; > + } > +} > + > +/* Driver load/unload functions */ > +/* Videocore connected. */ > +static void vc_sm_connected_init(void) > +{ > + int ret; > + struct vc_sm_version version; > + struct vc_sm_result_t version_result; reverse christmas tree please > + > + /* > + * Digging the vchiq_drv_mgmt, so low here and through a global seems > + * suspicious. > + * > + * The callbacks should be able to pass a parameter or context. > + */ > + struct vchiq_drv_mgmt *mgmt = > + dev_get_drvdata(sm_state->device->dev.parent); > + > + /* > + * Initialize and create a VCHI connection for the shared memory service > + * running on videocore. > + */ > + ret = vchiq_initialise(&mgmt->state, &sm_state->vchiq_instance); > + if (ret) { > + dev_err(&sm_state->device->dev, > + "%s: failed to initialise VCHI instance (ret=%d)\n", > + __func__, ret); > + > + return; > + } > + > + ret = vchiq_connect(sm_state->vchiq_instance); > + if (ret) { > + dev_err(&sm_state->device->dev, > + "%s: failed to connect VCHI instance (ret=%d)\n", > + __func__, ret); > + > + return; > + } > + > + /* Initialize an instance of the shared memory service. */ > + sm_state->sm_handle = vc_sm_cma_vchi_init(sm_state->vchiq_instance, 1, > + vc_sm_vpu_event); > + if (!sm_state->sm_handle) { > + dev_err(&sm_state->device->dev, > + "%s: failed to initialize shared memory service\n", > + __func__); > + > + return; > + } > + > + /* Create a debug fs directory entry (root). */ > + sm_state->dir_root = debugfs_create_dir(VC_SM_DIR_ROOT_NAME, NULL); > + > + sm_state->dir_state.show = &vc_sm_cma_global_state_show; > + sm_state->dir_state.dir_entry = > + debugfs_create_file(VC_SM_STATE, 0444, sm_state->dir_root, > + &sm_state->dir_state, > + &vc_sm_cma_debug_fs_fops); > + > + INIT_LIST_HEAD(&sm_state->buffer_list); > + > + version.version = 2; > + ret = vc_sm_cma_vchi_client_version(sm_state->sm_handle, &version, > + &version_result, > + &sm_state->int_trans_id); > + if (ret) { > + dev_err(&sm_state->device->dev, > + "%s: Failed to send version request %d\n", __func__, > + ret); > + } > + > + /* Done! */ > + sm_inited = 1; > +} > + > +/* Driver loading. */ Not sure this is a benefit > +static int bcm2835_vc_sm_cma_probe(struct vchiq_device *device) > +{ > + int err; > + > + err = dma_set_mask_and_coherent(&device->dev, DMA_BIT_MASK(32)); > + if (err) { > + dev_err(&device->dev, "dma_set_mask_and_coherent failed: %d\n", > + err); > + return err; > + } > + > + sm_state = devm_kzalloc(&device->dev, sizeof(*sm_state), GFP_KERNEL); > + if (!sm_state) > + return -ENOMEM; > + sm_state->device = device; > + mutex_init(&sm_state->map_lock); > + > + xa_init_flags(&sm_state->kernelid_map, XA_FLAGS_ALLOC1); > + > + device->dev.dma_parms = devm_kzalloc(&device->dev, > + sizeof(*device->dev.dma_parms), > + GFP_KERNEL); > + /* dma_set_max_seg_size checks if dma_parms is NULL. */ > + dma_set_max_seg_size(&device->dev, 0x3FFFFFFF); > + > + vchiq_add_connected_callback(device, vc_sm_connected_init); > + return 0; > +} > + > +/* Driver unloading. */ ditto > +static void bcm2835_vc_sm_cma_remove(struct vchiq_device *device) > +{ > + if (sm_inited) { > + misc_deregister(&sm_state->misc_dev); > + > + /* Remove all proc entries. */ > + debugfs_remove_recursive(sm_state->dir_root); > + > + /* Stop the videocore shared memory service. */ > + vc_sm_cma_vchi_stop(sm_state->vchiq_instance, > + &sm_state->sm_handle); > + } > + > + if (sm_state) { > + xa_destroy(&sm_state->kernelid_map); > + > + /* Free the memory for the state structure. */ > + mutex_destroy(&sm_state->map_lock); > + } > +} > + > +/* Get an internal resource handle mapped from the external one. */ > +int vc_sm_cma_int_handle(void *handle) According to the defintion the vc_handle is u32. Maybe we should name it vc_sm_cma_get_vc_handle() or something similiar? > +{ > + struct dma_buf *dma_buf = (struct dma_buf *)handle; > + struct vc_sm_buffer *buf; > + > + /* Validate we can work with this device. */ > + if (!sm_state || !handle) { > + pr_err("%s: invalid input\n", __func__); > + return 0; > + } > + > + buf = (struct vc_sm_buffer *)dma_buf->priv; > + return buf->vc_handle; > +} > +EXPORT_SYMBOL_GPL(vc_sm_cma_int_handle); > + > +/* Free a previously allocated shared memory handle and block. */ > +int vc_sm_cma_free(void *handle) > +{ > + struct dma_buf *dma_buf = (struct dma_buf *)handle; > + > + /* Validate we can work with this device. */ > + if (!sm_state || !handle) { > + pr_err("%s: invalid input\n", __func__); > + return -EPERM; > + } > + > + dma_buf_put(dma_buf); > + > + return 0; > +} > +EXPORT_SYMBOL_GPL(vc_sm_cma_free); > + > +/* Import a dmabuf to be shared with VC. */ > +int vc_sm_cma_import_dmabuf(struct dma_buf *src_dmabuf, void **handle) > +{ > + struct dma_buf *new_dma_buf; > + int ret; > + > + /* Validate we can work with this device. */ > + if (!sm_state || !src_dmabuf || !handle) { > + pr_err("%s: invalid input\n", __func__); > + return -EPERM; > + } > + > + ret = vc_sm_cma_import_dmabuf_internal(src_dmabuf, -1, &new_dma_buf); > + > + if (!ret) { > + /* Assign valid handle at this time.*/ > + *handle = new_dma_buf; > + } else { > + /* > + * succeeded in importing the dma_buf, but then > + * failed to look it up again. How? > + * Release the fd again. > + */ > + pr_err("%s: imported vc_sm_cma_get_buffer failed %d\n", > + __func__, ret); dev_err() ? > + } > + > + return ret; > +} > +EXPORT_SYMBOL_GPL(vc_sm_cma_import_dmabuf); > + > +static struct vchiq_device_id device_id_table[] = { > + { .name = "vcsm-cma" }, > + {} > +}; > +MODULE_DEVICE_TABLE(vchiq, device_id_table); > + > +static struct vchiq_driver bcm2835_vcsm_cma_driver = { > + .probe = bcm2835_vc_sm_cma_probe, > + .remove = bcm2835_vc_sm_cma_remove, > + .id_table = device_id_table, > + .driver = { > + .name = DEVICE_NAME, > + .owner = THIS_MODULE, > + }, > +}; > + > +module_vchiq_driver(bcm2835_vcsm_cma_driver); > + > +MODULE_AUTHOR("Dave Stevenson"); > +MODULE_DESCRIPTION("VideoCore CMA Shared Memory Driver"); > +MODULE_LICENSE("GPL"); > diff --git a/drivers/platform/raspberrypi/vc-sm-cma/vc_sm.h b/drivers/platform/raspberrypi/vc-sm-cma/vc_sm.h > new file mode 100644 > index 000000000000..acb00b9fbd8e > --- /dev/null > +++ b/drivers/platform/raspberrypi/vc-sm-cma/vc_sm.h > @@ -0,0 +1,64 @@ > +/* SPDX-License-Identifier: GPL-2.0 */ > + > +/* > + * VideoCore Shared Memory driver using CMA. > + * > + * Copyright: 2018, Raspberry Pi (Trading) Ltd > + * > + */ > + > +#ifndef VC_SM_H > +#define VC_SM_H > + > +#include <linux/device.h> > +#include <linux/dma-direction.h> > +#include <linux/kref.h> > +#include <linux/mm_types.h> > +#include <linux/mutex.h> > +#include <linux/sched.h> > +#include <linux/shrinker.h> > +#include <linux/types.h> > +#include <linux/miscdevice.h> > + > +#define VC_SM_MAX_NAME_LEN 32 > + > +enum vc_sm_vpu_mapping_state { > + VPU_NOT_MAPPED, > + VPU_MAPPED, > + VPU_UNMAPPING > +}; > + > +struct vc_sm_buffer { > + struct list_head global_buffer_list; /* Global list of buffers. */ > + > + /* Index in the kernel_id idr so that we can find the > + * mmal_msg_context again when servicing the VCHI reply. > + */ > + int kernel_id; > + > + size_t size; > + > + /* Lock over all the following state for this buffer */ > + struct mutex lock; > + struct list_head attachments; > + > + char name[VC_SM_MAX_NAME_LEN]; > + > + bool in_use:1; /* Kernel is still using this resource */ > + > + enum vc_sm_vpu_mapping_state vpu_state; > + u32 vc_handle; /* VideoCore handle for this buffer */ > + > + /* DMABUF related fields */ > + struct dma_buf *dma_buf; > + dma_addr_t dma_addr; > + void *cookie; > + > + struct vc_sm_privdata_t *private; > + > + struct dma_buf *imported_dma_buf; > + struct dma_buf_attachment *attach; > + struct sg_table *sgt; > +}; > + > +#endif > diff --git a/drivers/platform/raspberrypi/vc-sm-cma/vc_sm_cma_vchi.c b/drivers/platform/raspberrypi/vc-sm-cma/vc_sm_cma_vchi.c > new file mode 100644 > index 000000000000..9a2fc4df1603 > --- /dev/null > +++ b/drivers/platform/raspberrypi/vc-sm-cma/vc_sm_cma_vchi.c > @@ -0,0 +1,510 @@ > +// SPDX-License-Identifier: GPL-2.0 > +/* > + * VideoCore Shared Memory CMA allocator > + * > + * Copyright: 2018, Raspberry Pi (Trading) Ltd > + * Copyright 2011-2012 Broadcom Corporation. All rights reserved. > + * > + * Based on vmcs_sm driver from Broadcom Corporation. > + * > + */ > + > +#include <linux/completion.h> > +#include <linux/dev_printk.h> > +#include <linux/kernel.h> > +#include <linux/kthread.h> > +#include <linux/list.h> > +#include <linux/mutex.h> > +#include <linux/semaphore.h> > +#include <linux/slab.h> > +#include <linux/raspberrypi/vchiq_arm.h> > +#include <linux/types.h> > + > +#include "vc_sm_cma_vchi.h" > + > +#define VC_SM_VER 1 > +#define VC_SM_MIN_VER 0 > + > +/* Command blocks come from a pool */ > +#define SM_MAX_NUM_CMD_RSP_BLKS 32 > + > +/* The number of supported connections */ > +#define SM_MAX_NUM_CONNECTIONS 3 > + > +struct sm_cmd_rsp_blk { > + struct list_head head; /* To create lists */ > + /* To be signaled when the response is there */ > + struct completion cmplt; > + > + u32 id; > + u16 length; > + > + u8 msg[VC_SM_MAX_MSG_LEN]; > + > + uint32_t wait:1; > + uint32_t sent:1; > + uint32_t alloc:1; > + > +}; > + > +struct sm_instance { > + u32 num_connections; > + unsigned int service_handle[SM_MAX_NUM_CONNECTIONS]; > + struct task_struct *io_thread; > + struct completion io_cmplt; > + > + vpu_event_cb vpu_event; > + > + /* Mutex over the following lists */ > + struct mutex lock; > + u32 trans_id; > + struct list_head cmd_list; > + struct list_head rsp_list; > + struct list_head dead_list; > + > + struct sm_cmd_rsp_blk free_blk[SM_MAX_NUM_CMD_RSP_BLKS]; > + > + /* Mutex over the free_list */ > + struct mutex free_lock; > + struct list_head free_list; > + > + struct semaphore free_sema; > + struct vchiq_instance *vchiq_instance; > +}; > + > +static int > +bcm2835_vchi_msg_queue(struct vchiq_instance *vchiq_instance, > + unsigned int handle, void *data, unsigned int size) > +{ > + return vchiq_queue_kernel_message(vchiq_instance, handle, data, size); > +} > + > +static struct > +sm_cmd_rsp_blk *vc_vchi_cmd_create(struct sm_instance *instance, > + enum vc_sm_msg_type id, void *msg, > + u32 size, int wait) > +{ > + struct sm_cmd_rsp_blk *blk; > + struct vc_sm_msg_hdr_t *hdr; > + > + if (down_interruptible(&instance->free_sema)) { > + blk = kmalloc_obj(*blk, GFP_KERNEL); > + if (!blk) > + return NULL; > + > + blk->alloc = 1; > + init_completion(&blk->cmplt); > + } else { > + mutex_lock(&instance->free_lock); > + blk = > + list_first_entry(&instance->free_list, > + struct sm_cmd_rsp_blk, head); > + list_del(&blk->head); > + mutex_unlock(&instance->free_lock); > + } > + > + blk->sent = 0; > + blk->wait = wait; > + blk->length = sizeof(*hdr) + size; > + > + hdr = (struct vc_sm_msg_hdr_t *)blk->msg; > + hdr->type = id; > + mutex_lock(&instance->lock); > + instance->trans_id++; > + /* > + * Retain the top bit for identifying asynchronous events, or VPU cmds. > + */ > + instance->trans_id &= ~0x80000000; > + hdr->trans_id = instance->trans_id; > + blk->id = instance->trans_id; > + mutex_unlock(&instance->lock); > + > + if (size) > + memcpy(hdr->body, msg, size); > + > + return blk; > +} > + > +static void > +vc_vchi_cmd_delete(struct sm_instance *instance, struct sm_cmd_rsp_blk *blk) > +{ > + if (blk->alloc) { > + kfree(blk); > + return; > + } > + > + mutex_lock(&instance->free_lock); > + list_add(&blk->head, &instance->free_list); > + mutex_unlock(&instance->free_lock); > + up(&instance->free_sema); > +} > + > +static void vc_sm_cma_vchi_rx_ack(struct sm_instance *instance, > + struct sm_cmd_rsp_blk *cmd, > + struct vc_sm_result_t *reply, > + u32 reply_len) > +{ > + mutex_lock(&instance->lock); > + list_for_each_entry(cmd, > + &instance->rsp_list, > + head) { > + if (cmd->id == reply->trans_id) > + break; > + } > + mutex_unlock(&instance->lock); > + > + if (&cmd->head == &instance->rsp_list) { > + dev_err(instance->vchiq_instance->state->dev, > + "%s: received response %u, throw away...", __func__, > + reply->trans_id); > + } else if (reply_len > sizeof(cmd->msg)) { > + dev_err(instance->vchiq_instance->state->dev, > + "%s: reply too big (%u) %u, throw away...", __func__, > + reply_len, reply->trans_id); > + } else { > + memcpy(cmd->msg, reply, > + reply_len); > + complete(&cmd->cmplt); > + } > +} > + > +static int vc_sm_cma_vchi_videocore_io(void *arg) > +{ > + struct sm_instance *instance = arg; > + struct sm_cmd_rsp_blk *cmd = NULL, *cmd_tmp; > + struct vc_sm_result_t *reply; > + struct vchiq_header *header; > + s32 status; bcm2835_vchi_msg_queue / vchiq_queue_kernel_message returns an int > + int svc_use = 1; > + > + while (1) { > + if (svc_use) > + vchiq_release_service(instance->vchiq_instance, > + instance->service_handle[0]); > + svc_use = 0; > + > + if (wait_for_completion_interruptible(&instance->io_cmplt)) > + continue; > + vchiq_use_service(instance->vchiq_instance, > + instance->service_handle[0]); > + svc_use = 1; > + > + do { > + /* > + * Get new command and move it to response list > + */ > + mutex_lock(&instance->lock); > + if (list_empty(&instance->cmd_list)) { > + /* no more commands to process */ > + mutex_unlock(&instance->lock); > + break; > + } > + cmd = list_first_entry(&instance->cmd_list, > + struct sm_cmd_rsp_blk, head); > + list_move(&cmd->head, &instance->rsp_list); > + cmd->sent = 1; > + mutex_unlock(&instance->lock); > + /* Send the command */ > + status = bcm2835_vchi_msg_queue(instance->vchiq_instance, > + instance->service_handle[0], > + cmd->msg, cmd->length); > + if (status) { > + dev_err(instance->vchiq_instance->state->dev, > + "%s: failed to queue message (%d)", > + __func__, status); > + } > + > + /* If no reply is needed then we're done */ > + if (!cmd->wait) { > + mutex_lock(&instance->lock); > + list_del(&cmd->head); > + mutex_unlock(&instance->lock); > + vc_vchi_cmd_delete(instance, cmd); > + continue; > + } > + > + if (status) { > + complete(&cmd->cmplt); > + continue; > + } > + > + } while (1); > + > + while ((header = vchiq_msg_hold(instance->vchiq_instance, > + instance->service_handle[0]))) { > + reply = (struct vc_sm_result_t *)header->data; > + if (reply->trans_id & 0x80000000) { > + /* Async event or cmd from the VPU */ > + if (instance->vpu_event) > + instance->vpu_event(instance, reply, > + header->size); > + } else { > + vc_sm_cma_vchi_rx_ack(instance, cmd, reply, > + header->size); > + } > + > + vchiq_release_message(instance->vchiq_instance, > + instance->service_handle[0], > + header); > + } > + > + /* Go through the dead list and free them */ > + mutex_lock(&instance->lock); > + list_for_each_entry_safe(cmd, cmd_tmp, &instance->dead_list, > + head) { > + list_del(&cmd->head); > + vc_vchi_cmd_delete(instance, cmd); > + } > + mutex_unlock(&instance->lock); > + } > + > + return 0; > +} > + > +static int vc_sm_cma_vchi_callback(struct vchiq_instance *vchiq_instance, > + enum vchiq_reason reason, > + struct vchiq_header *header, > + unsigned int handle, void *userdata, > + void __user *cb_userdata) > +{ > + struct sm_instance *instance = > + vchiq_get_service_userdata(vchiq_instance, handle); > + > + switch (reason) { > + case VCHIQ_MESSAGE_AVAILABLE: > + vchiq_msg_queue_push(vchiq_instance, handle, header); > + complete(&instance->io_cmplt); > + break; > + > + case VCHIQ_SERVICE_CLOSED: > + dev_info(instance->vchiq_instance->state->dev, > + "%s: service CLOSED!!", __func__); > + break; > + > + default: > + break; > + } > + > + return 0; > +} > + > +struct sm_instance *vc_sm_cma_vchi_init(struct vchiq_instance *vchiq_instance, > + unsigned int num_connections, > + vpu_event_cb vpu_event) > +{ > + u32 i; > + struct sm_instance *instance; > + int status; reverse christmas tree please > + > + if (num_connections > SM_MAX_NUM_CONNECTIONS) { > + dev_err(vchiq_instance->state->dev, > + "%s: unsupported number of connections %u (max=%u)", > + __func__, num_connections, SM_MAX_NUM_CONNECTIONS); > + > + return NULL; > + } > + /* Allocate memory for this instance */ > + instance = kzalloc(sizeof(*instance), GFP_KERNEL); Shouldn't we check the result? > + > + /* Misc initialisations */ > + mutex_init(&instance->lock); > + init_completion(&instance->io_cmplt); > + INIT_LIST_HEAD(&instance->cmd_list); > + INIT_LIST_HEAD(&instance->rsp_list); > + INIT_LIST_HEAD(&instance->dead_list); > + INIT_LIST_HEAD(&instance->free_list); > + sema_init(&instance->free_sema, SM_MAX_NUM_CMD_RSP_BLKS); > + mutex_init(&instance->free_lock); > + for (i = 0; i < SM_MAX_NUM_CMD_RSP_BLKS; i++) { > + init_completion(&instance->free_blk[i].cmplt); > + list_add(&instance->free_blk[i].head, &instance->free_list); > + } > + > + instance->vchiq_instance = vchiq_instance; > + > + /* Open the VCHI service connections */ > + instance->num_connections = num_connections; > + for (i = 0; i < num_connections; i++) { > + struct vchiq_service_params_kernel params = { > + .version = VC_SM_VER, > + .version_min = VC_SM_MIN_VER, > + .fourcc = VCHIQ_MAKE_FOURCC('S', 'M', 'E', 'M'), > + .callback = vc_sm_cma_vchi_callback, > + .userdata = instance, > + }; > + > + status = vchiq_open_service(vchiq_instance, ¶ms, > + &instance->service_handle[i]); > + if (status) { > + dev_err(vchiq_instance->state->dev, > + "%s: failed to open VCHI service (%d)", > + __func__, status); > + > + goto err_close_services; > + } > + } > + /* Create the thread which takes care of all io to/from videoocore. */ s/videoocore/videocore > + instance->io_thread = kthread_create(&vc_sm_cma_vchi_videocore_io, > + (void *)instance, "SMIO"); It would be nice to make the thread name to give a hint this is related to videocore. Also lowercase would be nice in order to align with vchiq. > + if (!instance->io_thread) { > + dev_err(vchiq_instance->state->dev, > + "%s: failed to create SMIO thread", __func__); > + > + goto err_close_services; > + } > + instance->vpu_event = vpu_event; > + set_user_nice(instance->io_thread, -10); > + wake_up_process(instance->io_thread); > + > + return instance; > + > +err_close_services: > + for (i = 0; i < instance->num_connections; i++) { > + if (instance->service_handle[i]) > + vchiq_close_service(vchiq_instance, > + instance->service_handle[i]); > + } > + kfree(instance); > + > + return NULL; > +} > + > +int vc_sm_cma_vchi_stop(struct vchiq_instance *vchiq_instance, > + struct sm_instance **handle) > +{ > + struct sm_instance *instance; > + u32 i; > + > + if (!handle) { > + pr_err("%s: invalid pointer to handle %p", __func__, handle); %p isn't helpful here > + goto lock; > + } > + > + if (!*handle) { > + pr_err("%s: invalid handle %p", __func__, *handle); > + goto lock; > + } > + > + instance = *handle; > + > + /* Close all VCHI service connections */ > + for (i = 0; i < instance->num_connections; i++) { > + vchiq_use_service(vchiq_instance, instance->service_handle[i]); > + vchiq_close_service(vchiq_instance, > + instance->service_handle[i]); > + } > + > + kfree(instance); > + > + *handle = NULL; > + return 0; > + > +lock: > + return -EINVAL; > +} > + > +static int vc_sm_cma_vchi_send_msg(struct sm_instance *handle, > + enum vc_sm_msg_type msg_id, void *msg, > + u32 msg_size, void *result, u32 result_size, > + u32 *cur_trans_id, u8 wait_reply) > +{ > + int status = 0; > + struct sm_instance *instance = handle; > + struct sm_cmd_rsp_blk *cmd_blk; reverse christmas tree > + > + if (!handle) { > + pr_err("%s: invalid handle", __func__); > + return -EINVAL; > + } > + if (!msg) { > + dev_err(instance->vchiq_instance->state->dev, > + "%s: invalid msg pointer", __func__); > + return -EINVAL; > + } > + > + cmd_blk = > + vc_vchi_cmd_create(instance, msg_id, msg, msg_size, wait_reply); > + if (!cmd_blk) { > + dev_err(instance->vchiq_instance->state->dev, > + "[%s]: failed to allocate global tracking resource", > + __func__); > + return -ENOMEM; > + } > + > + if (cur_trans_id) > + *cur_trans_id = cmd_blk->id; > + > + mutex_lock(&instance->lock); > + list_add_tail(&cmd_blk->head, &instance->cmd_list); > + mutex_unlock(&instance->lock); > + complete(&instance->io_cmplt); > + > + if (!wait_reply) > + /* We're done */ > + return 0; > + > + /* Wait for the response */ > + if (wait_for_completion_interruptible(&cmd_blk->cmplt)) { > + mutex_lock(&instance->lock); > + if (!cmd_blk->sent) { > + list_del(&cmd_blk->head); > + mutex_unlock(&instance->lock); > + vc_vchi_cmd_delete(instance, cmd_blk); > + return -ENXIO; > + } > + > + list_move(&cmd_blk->head, &instance->dead_list); > + mutex_unlock(&instance->lock); > + complete(&instance->io_cmplt); > + return -EINTR; /* We're done */ > + } > + > + if (result && result_size) { > + memcpy(result, cmd_blk->msg, result_size); > + } else { > + struct vc_sm_result_t *res = > + (struct vc_sm_result_t *)cmd_blk->msg; > + status = (res->success == 0) ? 0 : -ENXIO; > + } > + > + mutex_lock(&instance->lock); > + list_del(&cmd_blk->head); > + mutex_unlock(&instance->lock); > + vc_vchi_cmd_delete(instance, cmd_blk); > + return status; > +} > + > +int vc_sm_cma_vchi_free(struct sm_instance *handle, struct vc_sm_free_t *msg, > + u32 *cur_trans_id) > +{ > + return vc_sm_cma_vchi_send_msg(handle, VC_SM_MSG_TYPE_FREE, > + msg, sizeof(*msg), 0, 0, cur_trans_id, 0); > +} > + > +int vc_sm_cma_vchi_import(struct sm_instance *handle, struct vc_sm_import *msg, > + struct vc_sm_import_result *result, u32 *cur_trans_id) > +{ > + return vc_sm_cma_vchi_send_msg(handle, VC_SM_MSG_TYPE_IMPORT, > + msg, sizeof(*msg), result, sizeof(*result), > + cur_trans_id, 1); > +} > + > +int vc_sm_cma_vchi_client_version(struct sm_instance *handle, > + struct vc_sm_version *msg, > + struct vc_sm_result_t *result, > + u32 *cur_trans_id) > +{ > + return vc_sm_cma_vchi_send_msg(handle, VC_SM_MSG_TYPE_CLIENT_VERSION, > + msg, sizeof(*msg), NULL, 0, > + cur_trans_id, 0); > +} > + > +int vc_sm_vchi_client_vc_mem_req_reply(struct sm_instance *handle, > + struct vc_sm_vc_mem_request_result *msg, > + uint32_t *cur_trans_id) > +{ > + return vc_sm_cma_vchi_send_msg(handle, > + VC_SM_MSG_TYPE_VC_MEM_REQUEST_REPLY, > + msg, sizeof(*msg), 0, 0, cur_trans_id, > + 0); > +} > diff --git a/drivers/platform/raspberrypi/vc-sm-cma/vc_sm_cma_vchi.h b/drivers/platform/raspberrypi/vc-sm-cma/vc_sm_cma_vchi.h > new file mode 100644 > index 000000000000..6b6fa2837c9f > --- /dev/null > +++ b/drivers/platform/raspberrypi/vc-sm-cma/vc_sm_cma_vchi.h > @@ -0,0 +1,64 @@ > +/* SPDX-License-Identifier: GPL-2.0 */ > + > +/* > + * VideoCore Shared Memory CMA allocator > + * > + * Copyright: 2018, Raspberry Pi (Trading) Ltd > + * Copyright 2011-2012 Broadcom Corporation. All rights reserved. > + * > + * Based on vmcs_sm driver from Broadcom Corporation. > + * > + */ > + > +#ifndef __VC_SM_CMA_VCHI_H__INCLUDED__ > +#define __VC_SM_CMA_VCHI_H__INCLUDED__ > + > +#include <linux/raspberrypi/vchiq.h> > + > +#include "vc_sm_defs.h" > + > +/* > + * Forward declare. > + */ > +struct sm_instance; > + > +typedef void (*vpu_event_cb)(struct sm_instance *instance, > + struct vc_sm_result_t *reply, int reply_len); > + > +/* > + * Initialize the shared memory service, opens up vchi connection to talk to it. > + */ > +struct sm_instance *vc_sm_cma_vchi_init(struct vchiq_instance *vchi_instance, > + unsigned int num_connections, > + vpu_event_cb vpu_event); > + > +/* > + * Terminates the shared memory service. > + */ > +int vc_sm_cma_vchi_stop(struct vchiq_instance *vchi_instance, > + struct sm_instance **handle); > + > +/* > + * Ask the shared memory service to free up some memory that was previously > + * allocated by the vc_sm_cma_vchi_alloc function call. > + */ > +int vc_sm_cma_vchi_free(struct sm_instance *handle, struct vc_sm_free_t *msg, > + u32 *cur_trans_id); > + > +/* > + * Import a contiguous block of memory and wrap it in a GPU MEM_HANDLE_T. > + */ > +int vc_sm_cma_vchi_import(struct sm_instance *handle, struct vc_sm_import *msg, > + struct vc_sm_import_result *result, > + u32 *cur_trans_id); > + > +int vc_sm_cma_vchi_client_version(struct sm_instance *handle, > + struct vc_sm_version *msg, > + struct vc_sm_result_t *result, > + u32 *cur_trans_id); > + > +int vc_sm_vchi_client_vc_mem_req_reply(struct sm_instance *handle, > + struct vc_sm_vc_mem_request_result *msg, > + uint32_t *cur_trans_id); > + > +#endif /* __VC_SM_CMA_VCHI_H__INCLUDED__ */ > diff --git a/drivers/platform/raspberrypi/vc-sm-cma/vc_sm_defs.h b/drivers/platform/raspberrypi/vc-sm-cma/vc_sm_defs.h > new file mode 100644 > index 000000000000..7cabbadfe7ca > --- /dev/null > +++ b/drivers/platform/raspberrypi/vc-sm-cma/vc_sm_defs.h > @@ -0,0 +1,298 @@ > +/* SPDX-License-Identifier: GPL-2.0 */ > + > +/* > + * VideoCore Shared Memory CMA allocator > + * > + * Copyright: 2018, Raspberry Pi (Trading) Ltd > + * > + * Based on vc_sm_defs.h from the vmcs_sm driver Copyright Broadcom Corporation. > + * All IPC messages are copied across to this file, even if the vc-sm-cma > + * driver is not currently using them. > + * > + **************************************************************************** > + */ > + > +#ifndef __VC_SM_DEFS_H__INCLUDED__ > +#define __VC_SM_DEFS_H__INCLUDED__ > + > +#include <linux/types.h> > + > +/* Maximum message length */ > +#define VC_SM_MAX_MSG_LEN (sizeof(union vc_sm_msg_union_t) + \ > + sizeof(struct vc_sm_msg_hdr_t)) > +#define VC_SM_MAX_RSP_LEN (sizeof(union vc_sm_msg_union_t)) > + > +/* Resource name maximum size */ > +#define VC_SM_RESOURCE_NAME 32 > + > +/* > + * Version to be reported to the VPU > + * VPU assumes 0 (aka 1) which does not require the released callback, nor > + * expect the client to handle VC_MEM_REQUESTS. > + * Version 2 requires the released callback, and must support VC_MEM_REQUESTS. > + */ > +#define VC_SM_PROTOCOL_VERSION 2 > + > +enum vc_sm_msg_type { > + /* Message types supported for HOST->VC direction */ > + > + /* Allocate shared memory block */ > + VC_SM_MSG_TYPE_ALLOC, > + /* Lock allocated shared memory block */ > + VC_SM_MSG_TYPE_LOCK, > + /* Unlock allocated shared memory block */ > + VC_SM_MSG_TYPE_UNLOCK, > + /* Unlock allocated shared memory block, do not answer command */ > + VC_SM_MSG_TYPE_UNLOCK_NOANS, > + /* Free shared memory block */ > + VC_SM_MSG_TYPE_FREE, > + /* Resize a shared memory block */ > + VC_SM_MSG_TYPE_RESIZE, > + /* Walk the allocated shared memory block(s) */ > + VC_SM_MSG_TYPE_WALK_ALLOC, > + > + /* A previously applied action will need to be reverted */ > + VC_SM_MSG_TYPE_ACTION_CLEAN, > + > + /* > + * Import a physical address and wrap into a MEM_HANDLE_T. > + * Release with VC_SM_MSG_TYPE_FREE. > + */ > + VC_SM_MSG_TYPE_IMPORT, > + /* > + *Tells VC the protocol version supported by this client. > + * 2 supports the async/cmd messages from the VPU for final release > + * of memory, and for VC allocations. > + */ > + VC_SM_MSG_TYPE_CLIENT_VERSION, > + /* Response to VC request for memory */ > + VC_SM_MSG_TYPE_VC_MEM_REQUEST_REPLY, > + > + /* > + * Asynchronous/cmd messages supported for VC->HOST direction. > + * Signalled by setting the top bit in vc_sm_result_t trans_id. > + */ > + > + /* > + * VC has finished with an imported memory allocation. > + * Release any Linux reference counts on the underlying block. > + */ > + VC_SM_MSG_TYPE_RELEASED, > + /* VC request for memory */ > + VC_SM_MSG_TYPE_VC_MEM_REQUEST, > + > + VC_SM_MSG_TYPE_MAX > +}; > + > +/* Type of memory to be allocated */ > +enum vc_sm_alloc_type_t { > + VC_SM_ALLOC_CACHED, > + VC_SM_ALLOC_NON_CACHED, > +}; > + > +/* Message header for all messages in HOST->VC direction */ > +struct vc_sm_msg_hdr_t { > + u32 type; > + u32 trans_id; > + u8 body[]; > +}; > + > +/* Request to allocate memory (HOST->VC) */ > +struct vc_sm_alloc_t { > + /* type of memory to allocate */ > + enum vc_sm_alloc_type_t type; > + /* byte amount of data to allocate per unit */ > + u32 base_unit; > + /* number of unit to allocate */ > + u32 num_unit; > + /* alignment to be applied on allocation */ > + u32 alignment; > + /* identity of who allocated this block */ > + u32 allocator; > + /* resource name (for easier tracking on vc side) */ > + char name[VC_SM_RESOURCE_NAME]; > + > +}; > + > +/* Result of a requested memory allocation (VC->HOST) */ > +struct vc_sm_alloc_result_t { > + /* Transaction identifier */ > + u32 trans_id; > + > + /* Resource handle */ > + u32 res_handle; > + /* Pointer to resource buffer */ > + u32 res_mem; > + /* Resource base size (bytes) */ > + u32 res_base_size; > + /* Resource number */ > + u32 res_num; > + > +}; > + > +/* Request to free a previously allocated memory (HOST->VC) */ > +struct vc_sm_free_t { > + /* Resource handle (returned from alloc) */ > + u32 res_handle; > + /* Resource buffer (returned from alloc) */ > + u32 res_mem; > + > +}; > + > +/* Request to lock a previously allocated memory (HOST->VC) */ > +struct vc_sm_lock_unlock_t { > + /* Resource handle (returned from alloc) */ > + u32 res_handle; > + /* Resource buffer (returned from alloc) */ > + u32 res_mem; > + > +}; > + > +/* Request to resize a previously allocated memory (HOST->VC) */ > +struct vc_sm_resize_t { > + /* Resource handle (returned from alloc) */ > + u32 res_handle; > + /* Resource buffer (returned from alloc) */ > + u32 res_mem; > + /* Resource *new* size requested (bytes) */ > + u32 res_new_size; > + > +}; > + > +/* Result of a requested memory lock (VC->HOST) */ > +struct vc_sm_lock_result_t { > + /* Transaction identifier */ > + u32 trans_id; > + > + /* Resource handle */ > + u32 res_handle; > + /* Pointer to resource buffer */ > + u32 res_mem; > + /* > + * Pointer to former resource buffer if the memory > + * was reallocated > + */ > + u32 res_old_mem; > + > +}; > + > +/* Generic result for a request (VC->HOST) */ > +struct vc_sm_result_t { > + /* Transaction identifier */ > + u32 trans_id; > + > + s32 success; > + > +}; > + > +/* Request to revert a previously applied action (HOST->VC) */ > +struct vc_sm_action_clean_t { > + /* Action of interest */ > + enum vc_sm_msg_type res_action; > + /* Transaction identifier for the action of interest */ > + u32 action_trans_id; > + > +}; > + > +/* Request to remove all data associated with a given allocator (HOST->VC) */ > +struct vc_sm_free_all_t { > + /* Allocator identifier */ > + u32 allocator; > +}; > + > +/* Request to import memory (HOST->VC) */ > +struct vc_sm_import { > + /* type of memory to allocate */ > + enum vc_sm_alloc_type_t type; > + /* pointer to the VC (ie physical) address of the allocated memory */ > + u32 addr; > + /* size of buffer */ > + u32 size; > + /* opaque handle returned in RELEASED messages */ > + u32 kernel_id; > + /* Allocator identifier */ > + u32 allocator; > + /* resource name (for easier tracking on vc side) */ > + char name[VC_SM_RESOURCE_NAME]; > +}; > + > +/* Result of a requested memory import (VC->HOST) */ > +struct vc_sm_import_result { > + /* Transaction identifier */ > + u32 trans_id; > + > + /* Resource handle */ > + u32 res_handle; > +}; > + > +/* Notification that VC has finished with an allocation (VC->HOST) */ > +struct vc_sm_released { > + /* cmd type / trans_id */ > + u32 cmd; > + > + /* pointer to the VC (ie physical) address of the allocated memory */ > + u32 addr; > + /* size of buffer */ > + u32 size; > + /* opaque handle returned in RELEASED messages */ > + u32 kernel_id; > + u32 vc_handle; > +}; > + > +/* > + * Client informing VC as to the protocol version it supports. > + * >=2 requires the released callback, and supports VC asking for memory. > + * Failure means that the firmware doesn't support this call, and therefore the > + * client should either fail, or NOT rely on getting the released callback. > + */ > +struct vc_sm_version { > + u32 version; > +}; > + > +/* Request FROM VideoCore for some memory */ > +struct vc_sm_vc_mem_request { > + /* cmd type */ > + u32 cmd; > + > + /* trans_id (from VPU) */ > + u32 trans_id; > + /* size of buffer */ > + u32 size; > + /* alignment of buffer */ > + u32 align; > + /* resource name (for easier tracking) */ > + char name[VC_SM_RESOURCE_NAME]; > + /* VPU handle for the resource */ > + u32 vc_handle; > +}; > + > +/* Response from the kernel to provide the VPU with some memory */ > +struct vc_sm_vc_mem_request_result { > + /* Transaction identifier for the VPU */ > + u32 trans_id; > + /* pointer to the physical address of the allocated memory */ > + u32 addr; > + /* opaque handle returned in RELEASED messages */ > + u32 kernel_id; > +}; > + > +/* Union of ALL messages */ > +union vc_sm_msg_union_t { > + struct vc_sm_alloc_t alloc; > + struct vc_sm_alloc_result_t alloc_result; > + struct vc_sm_free_t free; > + struct vc_sm_lock_unlock_t lock_unlock; > + struct vc_sm_action_clean_t action_clean; > + struct vc_sm_resize_t resize; > + struct vc_sm_lock_result_t lock_result; > + struct vc_sm_result_t result; > + struct vc_sm_free_all_t free_all; > + struct vc_sm_import import; > + struct vc_sm_import_result import_result; > + struct vc_sm_version version; > + struct vc_sm_released released; > + struct vc_sm_vc_mem_request vc_request; > + struct vc_sm_vc_mem_request_result vc_request_result; > +}; > + > +#endif /* __VC_SM_DEFS_H__INCLUDED__ */ > diff --git a/include/linux/raspberrypi/vc_sm_cma_ioctl.h b/include/linux/raspberrypi/vc_sm_cma_ioctl.h > new file mode 100644 > index 000000000000..4dc006d8057a > --- /dev/null > +++ b/include/linux/raspberrypi/vc_sm_cma_ioctl.h > @@ -0,0 +1,110 @@ > +/* SPDX-License-Identifier: GPL-2.0 */ > + > +/* > + * Copyright 2019 Raspberry Pi (Trading) Ltd. All rights reserved. > + * > + * Based on vmcs_sm_ioctl.h Copyright Broadcom Corporation. > + */ > + > +#ifndef __VC_SM_CMA_IOCTL_H > +#define __VC_SM_CMA_IOCTL_H > + > +#if defined(__KERNEL__) ? > +#include <linux/types.h> /* Needed for standard types */ > +#else > +#include <stdint.h> > +#endif > + > +#include <linux/ioctl.h> > + > +#define VC_SM_CMA_RESOURCE_NAME 32 > +#define VC_SM_CMA_RESOURCE_NAME_DEFAULT "sm-host-resource" > + > +/* Type define used to create unique IOCTL number */ > +#define VC_SM_CMA_MAGIC_TYPE 'J' > + > +/* IOCTL commands on /dev/vc-sm-cma */ > +enum vc_sm_cma_cmd_e { > + VC_SM_CMA_CMD_ALLOC = 0x5A, /* Start at 0x5A arbitrarily */ > + > + VC_SM_CMA_CMD_IMPORT_DMABUF, > + > + VC_SM_CMA_CMD_CLEAN_INVALID2, > + > + VC_SM_CMA_CMD_LAST /* Do not delete */ > +}; > + > +/* Cache type supported, conveniently matches the user space definition in > + * user-vcsm.h. > + */ > +enum vc_sm_cma_cache_e { > + VC_SM_CMA_CACHE_NONE, > + VC_SM_CMA_CACHE_HOST, > + VC_SM_CMA_CACHE_VC, > + VC_SM_CMA_CACHE_BOTH, > +}; > + > +/* IOCTL Data structures */ > +struct vc_sm_cma_ioctl_alloc { > + /* user -> kernel */ > + __u32 size; > + __u32 num; > + __u32 cached; /* enum vc_sm_cma_cache_e */ > + __u32 pad; > + __u8 name[VC_SM_CMA_RESOURCE_NAME]; > + > + /* kernel -> user */ > + __s32 handle; > + __u32 vc_handle; > + __u64 dma_addr; > +}; > + > +struct vc_sm_cma_ioctl_import_dmabuf { > + /* user -> kernel */ > + __s32 dmabuf_fd; > + __u32 cached; /* enum vc_sm_cma_cache_e */ > + __u8 name[VC_SM_CMA_RESOURCE_NAME]; > + > + /* kernel -> user */ > + __s32 handle; > + __u32 vc_handle; > + __u32 size; > + __u32 pad; > + __u64 dma_addr; > +}; > + > +/* > + * Cache functions to be set to struct vc_sm_cma_ioctl_clean_invalid2 > + * invalidate_mode. > + */ > +#define VC_SM_CACHE_OP_NOP 0x00 > +#define VC_SM_CACHE_OP_INV 0x01 > +#define VC_SM_CACHE_OP_CLEAN 0x02 > +#define VC_SM_CACHE_OP_FLUSH 0x03 > + > +struct vc_sm_cma_ioctl_clean_invalid2 { > + __u32 op_count; > + __u32 pad; > + struct vc_sm_cma_ioctl_clean_invalid_block { > + __u32 invalidate_mode; > + __u32 block_count; > + void * __user start_address; > + __u32 block_size; > + __u32 inter_block_stride; > + } s[]; > +}; > + > +/* IOCTL numbers */ > +#define VC_SM_CMA_IOCTL_MEM_ALLOC\ > + _IOR(VC_SM_CMA_MAGIC_TYPE, VC_SM_CMA_CMD_ALLOC,\ > + struct vc_sm_cma_ioctl_alloc) > + > +#define VC_SM_CMA_IOCTL_MEM_IMPORT_DMABUF\ > + _IOR(VC_SM_CMA_MAGIC_TYPE, VC_SM_CMA_CMD_IMPORT_DMABUF,\ > + struct vc_sm_cma_ioctl_import_dmabuf) > + > +#define VC_SM_CMA_IOCTL_MEM_CLEAN_INVALID2\ > + _IOR(VC_SM_CMA_MAGIC_TYPE, VC_SM_CMA_CMD_CLEAN_INVALID2,\ > + struct vc_sm_cma_ioctl_clean_invalid2) > + > +#endif /* __VC_SM_CMA_IOCTL_H */ > diff --git a/include/linux/raspberrypi/vc_sm_knl.h b/include/linux/raspberrypi/vc_sm_knl.h > new file mode 100644 > index 000000000000..f3e6b5648b23 > --- /dev/null > +++ b/include/linux/raspberrypi/vc_sm_knl.h > @@ -0,0 +1,76 @@ > +/* SPDX-License-Identifier: GPL-2.0 */ > + > +/* > + * VideoCore Shared Memory CMA allocator > + * > + * Copyright: 2018, Raspberry Pi (Trading) Ltd > + * > + * Based on vc_sm_defs.h from the vmcs_sm driver Copyright Broadcom Corporation. > + * > + */ > + > +#ifndef __VC_SM_KNL_H__INCLUDED__ > +#define __VC_SM_KNL_H__INCLUDED__ > + > +#include <linux/dma-buf.h> > + > +/** > + * vc_sm_cma_free() - Release a VideoCore shared memory buffer > + * @handle: Pointer to dmabuf representing the buffer to free > + * > + * This function should be called to release handles obtained from > + * vc_sm_cma_import_dmabuf(). It decrements the dmabuf reference count, > + * which triggers the cleanup sequence if this was the last reference. > + * > + * The actual memory deallocation is deferred until both the ARM-side > + * references are released AND VideoCore confirms it has finished accessing > + * the buffer. This ensures safe cleanup even if VideoCore operations are > + * still in progress. > + * > + * Returns 0 on success, -%EPERM if the device is not initialized or handle is > + * invalid. > + */ > +int vc_sm_cma_free(void *handle); > + > +/** > + * vc_sm_cma_int_handle() - Get VideoCore handle from dmabuf handle > + * @handle: Pointer to dmabuf representing the shared memory buffer > + * > + * This function retrieves the VideoCore firmware handle associated with > + * a dmabuf that was previously allocated or imported through this driver. > + * The VideoCore handle is required when communicating with VideoCore > + * firmware to reference the shared buffer. > + * > + * The handle parameter must be a dmabuf pointer that was obtained from > + * either vc_sm_cma_import_dmabuf() or through the /dev/vcsm-cma device > + * allocation ioctls. > + * > + * Returns VideoCore handle (non-zero) on success, 0 on failure or invalid > + * input. > + */ > +int vc_sm_cma_int_handle(void *handle); > + > +/** > + * vc_sm_cma_import_dmabuf() - Import a dmabuf for sharing with VideoCore > + * @src_dmabuf: DMA-BUF to import > + * @handle: Output pointer to receive the new dmabuf handle > + * > + * Imports an existing dmabuf into the VideoCore shared memory subsystem, > + * making it accessible to VideoCore firmware. This allows sharing of > + * buffers allocated by other kernel drivers (such as V4L2) with VideoCore. > + * > + * The returned handle must be freed with vc_sm_cma_free() when no longer > + * needed. The handle can be passed to vc_sm_cma_int_handle() to obtain > + * the VideoCore firmware handle for use in MMAL or other VideoCore APIs. > + * > + * The imported buffer must be physically contiguous and located in memory > + * addressable by VideoCore. > + * > + * Returns 0 on success and @handle is set to the new dmabuf pointer, > + * -%EPERM if the device is not initialized or input is invalid, > + * -%ENOMEM if allocation fails, > + * -%ERESTARTSYS if interrupted by signal during VCHI communication. > + */ > +int vc_sm_cma_import_dmabuf(struct dma_buf *dmabuf, void **handle); > + > +#endif /* __VC_SM_KNL_H__INCLUDED__ */ > ^ permalink raw reply [flat|nested] 8+ messages in thread
* [PATCH v4 4/6] platform/raspberrypi: vchiq-mmal: Use vc-sm-cma to support zero copy 2026-09-16 14:25 [PATCH v4 0/6] platform/raspberrypi: Add Broadcom Videocore shared memory support Jai Luthra ` (2 preceding siblings ...) 2026-09-16 14:25 ` [PATCH v4 3/6] platform/raspberrypi: Add VideoCore shared memory support Jai Luthra @ 2026-09-16 14:25 ` Jai Luthra 2026-09-16 14:25 ` [PATCH v4 5/6] platform/raspberrypi: vchiq-mmal: Support sending data to MMAL ports Jai Luthra 2026-09-16 14:25 ` [PATCH v4 6/6] platform/raspberrypi: vchiq: Register vc-sm-cma as a platform driver Jai Luthra 5 siblings, 0 replies; 8+ messages in thread From: Jai Luthra @ 2026-09-16 14:25 UTC (permalink / raw) To: Florian Fainelli, Raspberry Pi Kernel Maintenance, bcm-kernel-feedback-list, Greg Kroah-Hartman, Dave Stevenson, Phil Elwell, Hans Verkuil, Mauro Carvalho Chehab Cc: Stefan Wahren, Laurent Pinchart, Kieran Bingham, linux-arm-kernel, linux-kernel, linux-rpi-kernel, linux-media, Jai Luthra From: Dave Stevenson <dave.stevenson@raspberrypi.com> With the vc-sm-cma driver we can support zero copy of buffers between the kernel and VPU. Add this support to mmal-vchiq. Signed-off-by: Dave Stevenson <dave.stevenson@raspberrypi.com> Signed-off-by: Jai Luthra <jai.luthra@ideasonboard.com> --- drivers/platform/raspberrypi/vchiq-mmal/Kconfig | 3 +- .../platform/raspberrypi/vchiq-mmal/mmal-common.h | 4 ++ .../platform/raspberrypi/vchiq-mmal/mmal-vchiq.c | 65 ++++++++++++++++++++-- .../platform/raspberrypi/vchiq-mmal/mmal-vchiq.h | 1 + 4 files changed, 68 insertions(+), 5 deletions(-) diff --git a/drivers/platform/raspberrypi/vchiq-mmal/Kconfig b/drivers/platform/raspberrypi/vchiq-mmal/Kconfig index c99525a0bb45..8a798dae408c 100644 --- a/drivers/platform/raspberrypi/vchiq-mmal/Kconfig +++ b/drivers/platform/raspberrypi/vchiq-mmal/Kconfig @@ -1,6 +1,7 @@ config BCM2835_VCHIQ_MMAL tristate "BCM2835 MMAL VCHIQ service" - depends on BCM2835_VCHIQ + select BCM2835_VCHIQ if HAS_DMA + select BCM_VC_SM_CMA help Enables the MMAL API over VCHIQ interface as used for the majority of the multimedia services on VideoCore. diff --git a/drivers/platform/raspberrypi/vchiq-mmal/mmal-common.h b/drivers/platform/raspberrypi/vchiq-mmal/mmal-common.h index b33129403a30..6c5092a68b99 100644 --- a/drivers/platform/raspberrypi/vchiq-mmal/mmal-common.h +++ b/drivers/platform/raspberrypi/vchiq-mmal/mmal-common.h @@ -50,6 +50,10 @@ struct mmal_buffer { struct mmal_msg_context *msg_context; + struct dma_buf *dma_buf;/* Exported dmabuf fd from videobuf2 */ + void *vcsm_handle; /* VCSM handle having imported the dmabuf */ + u32 vc_handle; /* VC handle to that dmabuf */ + unsigned long length; u32 mmal_flags; s64 dts; diff --git a/drivers/platform/raspberrypi/vchiq-mmal/mmal-vchiq.c b/drivers/platform/raspberrypi/vchiq-mmal/mmal-vchiq.c index 918c30d84ba0..a64b5175e1a9 100644 --- a/drivers/platform/raspberrypi/vchiq-mmal/mmal-vchiq.c +++ b/drivers/platform/raspberrypi/vchiq-mmal/mmal-vchiq.c @@ -23,12 +23,13 @@ #include <linux/slab.h> #include <linux/completion.h> #include <linux/raspberrypi/vchiq.h> +#include <linux/raspberrypi/vchiq_arm.h> +#include <linux/raspberrypi/vc_sm_knl.h> #include <linux/vmalloc.h> #include <media/videobuf2-vmalloc.h> -#include <linux/raspberrypi/vchiq_arm.h> - #include "mmal-common.h" +#include "mmal-parameters.h" #include "mmal-vchiq.h" #include "mmal-msg.h" @@ -422,8 +423,12 @@ buffer_from_host(struct vchiq_mmal_instance *instance, /* buffer header */ m.u.buffer_from_host.buffer_header.cmd = 0; - m.u.buffer_from_host.buffer_header.data = - (u32)(unsigned long)buf->buffer; + if (port->zero_copy) + m.u.buffer_from_host.buffer_header.data = buf->vc_handle; + else + m.u.buffer_from_host.buffer_header.data = + (u32)(unsigned long)buf->buffer; + m.u.buffer_from_host.buffer_header.alloc_size = buf->buffer_size; m.u.buffer_from_host.buffer_header.length = 0; /* nothing used yet */ m.u.buffer_from_host.buffer_header.offset = 0; /* no offset */ @@ -484,6 +489,20 @@ static void buffer_to_host_cb(struct vchiq_mmal_instance *instance, msg_context->u.bulk.status = msg->h.status; + } else if (msg->u.buffer_from_host.is_zero_copy) { + /* + * Zero copy buffer, so nothing to do. + * Copy buffer info and make callback. + */ + msg_context->u.bulk.buffer_used = + msg->u.buffer_from_host.buffer_header.length; + msg_context->u.bulk.mmal_flags = + msg->u.buffer_from_host.buffer_header.flags; + msg_context->u.bulk.dts = + msg->u.buffer_from_host.buffer_header.dts; + msg_context->u.bulk.pts = + msg->u.buffer_from_host.buffer_header.pts; + } else if (msg->u.buffer_from_host.buffer_header.length == 0) { /* empty buffer */ if (msg->u.buffer_from_host.buffer_header.flags & @@ -1431,6 +1450,9 @@ int vchiq_mmal_port_parameter_set(struct vchiq_mmal_instance *instance, mutex_unlock(&instance->vchiq_mutex); + if (parameter == MMAL_PARAMETER_ZERO_COPY && !ret) + port->zero_copy = !!(*(bool *)value); + return ret; } EXPORT_SYMBOL_GPL(vchiq_mmal_port_parameter_set); @@ -1599,6 +1621,31 @@ int vchiq_mmal_submit_buffer(struct vchiq_mmal_instance *instance, unsigned long flags = 0; int ret; + /* + * We really want to do this in mmal_vchi_buffer_init but can't as + * videobuf2 won't let us have the dmabuf there. + */ + if (port->zero_copy && buffer->dma_buf && !buffer->vcsm_handle) { + pr_debug("%s: import dmabuf %p\n", __func__, buffer->dma_buf); + ret = vc_sm_cma_import_dmabuf(buffer->dma_buf, + &buffer->vcsm_handle); + if (ret) { + pr_err("%s: vc_sm_import_dmabuf_fd failed, ret %d\n", + __func__, ret); + return ret; + } + + buffer->vc_handle = vc_sm_cma_int_handle(buffer->vcsm_handle); + if (!buffer->vc_handle) { + pr_err("%s: vc_sm_int_handle failed %d\n", + __func__, ret); + vc_sm_cma_free(buffer->vcsm_handle); + return ret; + } + pr_debug("%s: import dmabuf %p - got vc handle %08X\n", + __func__, buffer->dma_buf, buffer->vc_handle); + } + ret = buffer_from_host(instance, port, buffer); if (ret == -EINVAL) { /* Port is disabled. Queue for when it is enabled. */ @@ -1632,6 +1679,16 @@ int mmal_vchi_buffer_cleanup(struct mmal_buffer *buf) release_msg_context(msg_context); buf->msg_context = NULL; + if (buf->vcsm_handle) { + int ret; + + pr_debug("%s: vc_sm_cma_free on handle %p\n", __func__, + buf->vcsm_handle); + ret = vc_sm_cma_free(buf->vcsm_handle); + if (ret) + pr_err("%s: vcsm_free failed, ret %d\n", __func__, ret); + buf->vcsm_handle = 0; + } return 0; } EXPORT_SYMBOL_GPL(mmal_vchi_buffer_cleanup); diff --git a/drivers/platform/raspberrypi/vchiq-mmal/mmal-vchiq.h b/drivers/platform/raspberrypi/vchiq-mmal/mmal-vchiq.h index 8c3959f6f97f..9d31816f5be5 100644 --- a/drivers/platform/raspberrypi/vchiq-mmal/mmal-vchiq.h +++ b/drivers/platform/raspberrypi/vchiq-mmal/mmal-vchiq.h @@ -49,6 +49,7 @@ typedef void (*vchiq_mmal_buffer_cb)(struct vchiq_mmal_instance *instance, struct vchiq_mmal_port { bool enabled; + u32 zero_copy:1; u32 handle; u32 type; /* port type, cached to use on port info set */ u32 index; /* port index, cached to use on port info set */ -- 2.55.0 ^ permalink raw reply related [flat|nested] 8+ messages in thread
* [PATCH v4 5/6] platform/raspberrypi: vchiq-mmal: Support sending data to MMAL ports 2026-09-16 14:25 [PATCH v4 0/6] platform/raspberrypi: Add Broadcom Videocore shared memory support Jai Luthra ` (3 preceding siblings ...) 2026-09-16 14:25 ` [PATCH v4 4/6] platform/raspberrypi: vchiq-mmal: Use vc-sm-cma to support zero copy Jai Luthra @ 2026-09-16 14:25 ` Jai Luthra 2026-09-16 14:25 ` [PATCH v4 6/6] platform/raspberrypi: vchiq: Register vc-sm-cma as a platform driver Jai Luthra 5 siblings, 0 replies; 8+ messages in thread From: Jai Luthra @ 2026-09-16 14:25 UTC (permalink / raw) To: Florian Fainelli, Raspberry Pi Kernel Maintenance, bcm-kernel-feedback-list, Greg Kroah-Hartman, Dave Stevenson, Phil Elwell, Hans Verkuil, Mauro Carvalho Chehab Cc: Stefan Wahren, Laurent Pinchart, Kieran Bingham, linux-arm-kernel, linux-kernel, linux-rpi-kernel, linux-media, Jai Luthra From: Dave Stevenson <dave.stevenson@raspberrypi.com> Add the ability to send data to ports. This only supports zero copy mode as the required bulk transfer setup calls are not done. Signed-off-by: Dave Stevenson <dave.stevenson@raspberrypi.com> Signed-off-by: Jai Luthra <jai.luthra@ideasonboard.com> --- drivers/platform/raspberrypi/vchiq-mmal/mmal-vchiq.c | 18 +++++++++++++----- 1 file changed, 13 insertions(+), 5 deletions(-) diff --git a/drivers/platform/raspberrypi/vchiq-mmal/mmal-vchiq.c b/drivers/platform/raspberrypi/vchiq-mmal/mmal-vchiq.c index a64b5175e1a9..ccd8910c315f 100644 --- a/drivers/platform/raspberrypi/vchiq-mmal/mmal-vchiq.c +++ b/drivers/platform/raspberrypi/vchiq-mmal/mmal-vchiq.c @@ -430,11 +430,19 @@ buffer_from_host(struct vchiq_mmal_instance *instance, (u32)(unsigned long)buf->buffer; m.u.buffer_from_host.buffer_header.alloc_size = buf->buffer_size; - m.u.buffer_from_host.buffer_header.length = 0; /* nothing used yet */ - m.u.buffer_from_host.buffer_header.offset = 0; /* no offset */ - m.u.buffer_from_host.buffer_header.flags = 0; /* no flags */ - m.u.buffer_from_host.buffer_header.pts = MMAL_TIME_UNKNOWN; - m.u.buffer_from_host.buffer_header.dts = MMAL_TIME_UNKNOWN; + if (port->type == MMAL_PORT_TYPE_OUTPUT) { + m.u.buffer_from_host.buffer_header.length = 0; + m.u.buffer_from_host.buffer_header.offset = 0; + m.u.buffer_from_host.buffer_header.flags = 0; + m.u.buffer_from_host.buffer_header.pts = MMAL_TIME_UNKNOWN; + m.u.buffer_from_host.buffer_header.dts = MMAL_TIME_UNKNOWN; + } else { + m.u.buffer_from_host.buffer_header.length = buf->length; + m.u.buffer_from_host.buffer_header.offset = 0; + m.u.buffer_from_host.buffer_header.flags = buf->mmal_flags; + m.u.buffer_from_host.buffer_header.pts = buf->pts; + m.u.buffer_from_host.buffer_header.dts = buf->dts; + } /* clear buffer type specific data */ memset(&m.u.buffer_from_host.buffer_header_type_specific, 0, -- 2.55.0 ^ permalink raw reply related [flat|nested] 8+ messages in thread
* [PATCH v4 6/6] platform/raspberrypi: vchiq: Register vc-sm-cma as a platform driver 2026-09-16 14:25 [PATCH v4 0/6] platform/raspberrypi: Add Broadcom Videocore shared memory support Jai Luthra ` (4 preceding siblings ...) 2026-09-16 14:25 ` [PATCH v4 5/6] platform/raspberrypi: vchiq-mmal: Support sending data to MMAL ports Jai Luthra @ 2026-09-16 14:25 ` Jai Luthra 5 siblings, 0 replies; 8+ messages in thread From: Jai Luthra @ 2026-09-16 14:25 UTC (permalink / raw) To: Florian Fainelli, Raspberry Pi Kernel Maintenance, bcm-kernel-feedback-list, Greg Kroah-Hartman, Dave Stevenson, Phil Elwell, Hans Verkuil, Mauro Carvalho Chehab Cc: Stefan Wahren, Laurent Pinchart, Kieran Bingham, linux-arm-kernel, linux-kernel, linux-rpi-kernel, linux-media, Jai Luthra From: Dave Stevenson <dave.stevenson@raspberrypi.com> Register the vc-sm-cma driver as a platform driver under vchiq. Signed-off-by: Dave Stevenson <dave.stevenson@raspberrypi.com> Signed-off-by: Jai Luthra <jai.luthra@ideasonboard.com> --- drivers/platform/raspberrypi/vchiq-interface/vchiq_arm.c | 2 ++ include/linux/raspberrypi/vchiq_arm.h | 1 + 2 files changed, 3 insertions(+) diff --git a/drivers/platform/raspberrypi/vchiq-interface/vchiq_arm.c b/drivers/platform/raspberrypi/vchiq-interface/vchiq_arm.c index d5a25033a261..ec951ab19d67 100644 --- a/drivers/platform/raspberrypi/vchiq-interface/vchiq_arm.c +++ b/drivers/platform/raspberrypi/vchiq-interface/vchiq_arm.c @@ -1414,6 +1414,7 @@ static int vchiq_probe(struct platform_device *pdev) vchiq_debugfs_init(&mgmt->state); mgmt->audio_dev = vchiq_device_register(&pdev->dev, "bcm2835-audio"); + mgmt->vcsm_cma_dev = vchiq_device_register(&pdev->dev, "vcsm-cma"); return 0; } @@ -1422,6 +1423,7 @@ static void vchiq_remove(struct platform_device *pdev) { struct vchiq_drv_mgmt *mgmt = dev_get_drvdata(&pdev->dev); + vchiq_device_unregister(mgmt->vcsm_cma_dev); vchiq_device_unregister(mgmt->audio_dev); vchiq_debugfs_deinit(); vchiq_deregister_chrdev(); diff --git a/include/linux/raspberrypi/vchiq_arm.h b/include/linux/raspberrypi/vchiq_arm.h index 541b4efd64d9..d59837eaaa8c 100644 --- a/include/linux/raspberrypi/vchiq_arm.h +++ b/include/linux/raspberrypi/vchiq_arm.h @@ -62,6 +62,7 @@ struct vchiq_drv_mgmt { * the interface. */ struct vchiq_device *audio_dev; + struct vchiq_device *vcsm_cma_dev; }; struct user_service { -- 2.55.0 ^ permalink raw reply related [flat|nested] 8+ messages in thread
end of thread, other threads:[~2026-09-17 21:12 UTC | newest] Thread overview: 8+ messages (download: mbox.gz follow: Atom feed -- links below jump to the message on this page -- 2026-09-16 14:25 [PATCH v4 0/6] platform/raspberrypi: Add Broadcom Videocore shared memory support Jai Luthra 2026-09-16 14:25 ` [PATCH v4 1/6] platform/raspberrypi: vchiq-mmal: Reset buffers_with_vpu on port_enable Jai Luthra 2026-09-16 14:25 ` [PATCH v4 2/6] platform/raspberrypi: vchiq: Store audio device in driver management struct Jai Luthra 2026-09-16 14:25 ` [PATCH v4 3/6] platform/raspberrypi: Add VideoCore shared memory support Jai Luthra 2026-09-17 21:11 ` Stefan Wahren 2026-09-16 14:25 ` [PATCH v4 4/6] platform/raspberrypi: vchiq-mmal: Use vc-sm-cma to support zero copy Jai Luthra 2026-09-16 14:25 ` [PATCH v4 5/6] platform/raspberrypi: vchiq-mmal: Support sending data to MMAL ports Jai Luthra 2026-09-16 14:25 ` [PATCH v4 6/6] platform/raspberrypi: vchiq: Register vc-sm-cma as a platform driver Jai Luthra
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox