[ANNv4] Media Summit on May 26th in Nice, France

[ANNv4] Media Summit on May 26th in Nice, France

[Hans Verkuil]

(Please pass this on to anyone you think might be interested in this!)

Hi all,

This is the fourth version of this announcement, updating the list of attendees
and the tentative agenda at the end: please let me know if you see mistakes.
Note that there is still time for one or two other topics. Also please check
the agenda if you need more (or perhaps less) time for your topic.

This year's Media Summit will be held on Tuesday May 26th the day before the
Embedded Recipes Conference in Nice, France:

https://embedded-recipes.org/2026/

The Media Summit will be held at Hotel Campanile and in the same meeting room
as last year (Nikaia):

https://nice-aeroport.campanile.com/en-us/

It is close to the Airport and to the Embedded Recipes venue.

The meeting room can hold up to 30 people and I will provide video conferencing support,
just like last year. The location and the meeting room was quite nice last year, so
I saw no need to change it.

That said, in-person participation is very much preferred. This yearly summit is meant
for active media developers to meet face-to-face and to discuss media subsystem issues.

And it is also a good opportunity to talk to each other during the Embedded Recipes
conference to discuss topics in a smaller group. But if you are an active media developer
and are really not able to attend in person, then remote participation is an option.

If you want to attend the meeting (either in person or remote), then send an email to me
directly. The deadline for in-person attendance is May 14 as the hotel needs to know the
final number of attendees by then.

There is no registration fee, the meeting room is sponsored by Cisco and Collabora, and
the lunch is sponsored by Ideas on Board! Many thanks to our sponsors, it's very much
appreciated.

If you have a topic that you want to discuss, just 'Reply All' to this announcement
and give the topic title, a short description and a guesstimate of the time you need
for your topic.

See last year's Media Summit Report as an example of what to expect:

https://lore.kernel.org/linux-media/21769183-ca57-4f8f-818a-6a1ad089298d@jjverkuil.nl/

Regards,

	Hans

PS: Be aware that May 24 and 25 are public holidays in France. So many shops may be
closed those days.

In-person attendees:
Sakari Ailus <sakari.ailus@linux.intel.com>
Kieran Bingham <kieran.bingham@ideasonboard.com>
Brandon Brnich <b-brnich@ti.com>
Rouven Czerwinski <rouven.czerwinski@linaro.org>
Mehdi Djait <mehdi.djait@linux.intel.com>
Bryan O'Donoghue <bryan.odonoghue@linaro.org>
Nicolas Dufresne <nicolas.dufresne@collabora.com>
Marco Felsch <m.felsch@pengutronix.de>
Paul Kocialkowski <paulk@sys-base.io>
Jai Luthra <jai.luthra@ideasonboard.com>
Jacopo Mondi <jacopo.mondi@ideasonboard.com>
Benjamin Mugnier <benjamin.mugnier@foss.st.com>
Beleswar Padhi <b-padhi@ti.com>
Laurent Pinchart <laurent.pinchart@ideasonboard.com>
Loic Poulain <loic.poulain@oss.qualcomm.com>
Sven Püschel <s.pueschel@pengutronix.de>
Ricardo Ribalda <ribalda@chromium.org>
Michael Riesch <michael.riesch@collabora.com>
Devarsh Thakkar <devarsht@ti.com>
Michael Tretter <m.tretter@pengutronix.de>
Hans Verkuil <hverkuil@kernel.org>

Remote attendees:
Yemike Abhilash Chandra <y-abhilashchandra@ti.com>
Rishikesh Donadkar <r-donadkar@ti.com>
Jackson Lee <jackson.lee@chipsnmedia.com>
Dave Stevenson <dave.stevenson@raspberrypi.com> (tentative)


Agenda (tentative):

8:45-9:20: Arrive, settle in

9:20-9:30: Short intro (Hans Verkuil)

9:30-9:45: Status of ISP support in V4L2
	Presenter: Laurent Pinchart
	Description: Summary of ISP-related development in V4L2 since the last
	Linux Media Summit. This includes a brief overview of technical
	developments, and a summary of the efforts to engage with vendors.

9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
	Presenter: Paul Kocialkowski
	Description: An update on the ongonig work to support stateless codecs in V4L2.
	Some of the remaining open topics will be presented and discussed.

10:45-11:00: break

11:00-11:30: Vulkan Video Codecs
	Presenter: Nicolas Dufresne
	Description: Vulkan video codecs: what are the viable options for Linux Media
	and what is in preparation outside of our subsystem. The second aspect is
	informative as these discussions don't seem to lean toward our subsystem as the
	foundation. But I think it's rather useful for everyone to understand why and
	what is included.

11:30-12:00: Protected Video playback on i.MX8MQ
	Presenter: Rouven Czerwinski
	Description: Introduction to protected video playback
	on i.MX8MQ and missing bits for linux-media & protected heap interoperability.

12:00-13:30: Lunch

13:30-14:00: HDCP support for HDMI receivers
	Presenter: Hans Verkuil
	Description: I have been working on adding HDCP support for HDMI receivers.
	Specifically the HDCP negotiation between sources and sinks.

14:00-14:30: AI patches
	Presenter: Sakari Ailus
	Description: What is our policy w.r.t. AI generated patches?

14:30-15:00 Overview of Media CI: where do pipelines run?
	Presenter: Ricardo Ribalda
	Description: How are jobs in pipelines assigned? How does the infrastructure
	for Media CI work? Are there things that can be tweaked to make it more
	reliable?

15:00-15:15: Break

15:15-16:15: Discussion of the media subsystem development process
	Presenter: Hans Verkuil
	Description: Review of the multi-committer model: current status and next steps.
	Are there any bottlenecks, any ideas for improvements, w.r.t. the development process?

As you can see, there is still some available time for other topics.

Re: [ANNv4] Media Summit on May 26th in Nice, France

[Sakari Ailus]

Hi Hans,

On Sun, Apr 12, 2026 at 12:25:39PM +0200, Hans Verkuil wrote:
> As you can see, there is still some available time for other topics.

I'd like to add:

Title: Common raw sensor model, streams, metadata and metadata series status
Presenter: Sakari Ailus
Time estimate: 45 minutes (depends heavily on how much there will be
discussion)
Descriptition: The Common Raw Sensor Model defines a new UAPI for camera
sensors in Linux. It provides a more useful UAPI for configuring camera
sensors than the existing practice is. The metadata series includes the
Common Raw Sensor Model and a number of other improvements, such as generic
raw formats, metadata support and finally enabling the streams UAPI.

-- 
Kind regards,

Sakari Ailus

Re: [ANNv4] Media Summit on May 26th in Nice, France

[Hans Verkuil]

On 12/04/2026 15:56, Sakari Ailus wrote:
> Title: Common raw sensor model, streams, metadata and metadata series status
> Presenter: Sakari Ailus
> Time estimate: 45 minutes (depends heavily on how much there will be
> discussion)
> Descriptition: The Common Raw Sensor Model defines a new UAPI for camera
> sensors in Linux. It provides a more useful UAPI for configuring camera
> sensors than the existing practice is. The metadata series includes the
> Common Raw Sensor Model and a number of other improvements, such as generic
> raw formats, metadata support and finally enabling the streams UAPI.

Added!

	Hans

Re: [ANNv4] Media Summit on May 26th in Nice, France

[Michael Riesch]

Hi Hans,

On 4/12/26 12:25, Hans Verkuil wrote:
> [...]
> Agenda (tentative):
> 
> 8:45-9:20: Arrive, settle in
> 
> 9:20-9:30: Short intro (Hans Verkuil)
> 
> 9:30-9:45: Status of ISP support in V4L2
> 	Presenter: Laurent Pinchart
> 	Description: Summary of ISP-related development in V4L2 since the last
> 	Linux Media Summit. This includes a brief overview of technical
> 	developments, and a summary of the efforts to engage with vendors.
> 
> 9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
> 	Presenter: Paul Kocialkowski
> 	Description: An update on the ongonig work to support stateless codecs in V4L2.
> 	Some of the remaining open topics will be presented and discussed.
> 
> 10:45-11:00: break
> 
> 11:00-11:30: Vulkan Video Codecs
> 	Presenter: Nicolas Dufresne
> 	Description: Vulkan video codecs: what are the viable options for Linux Media
> 	and what is in preparation outside of our subsystem. The second aspect is
> 	informative as these discussions don't seem to lean toward our subsystem as the
> 	foundation. But I think it's rather useful for everyone to understand why and
> 	what is included.
> 
> 11:30-12:00: Protected Video playback on i.MX8MQ
> 	Presenter: Rouven Czerwinski
> 	Description: Introduction to protected video playback
> 	on i.MX8MQ and missing bits for linux-media & protected heap interoperability.
> 
> 12:00-13:30: Lunch
> 
> 13:30-14:00: HDCP support for HDMI receivers
> 	Presenter: Hans Verkuil
> 	Description: I have been working on adding HDCP support for HDMI receivers.
> 	Specifically the HDCP negotiation between sources and sinks.
> 
> 14:00-14:30: AI patches
> 	Presenter: Sakari Ailus
> 	Description: What is our policy w.r.t. AI generated patches?
> 
> 14:30-15:00 Overview of Media CI: where do pipelines run?
> 	Presenter: Ricardo Ribalda
> 	Description: How are jobs in pipelines assigned? How does the infrastructure
> 	for Media CI work? Are there things that can be tweaked to make it more
> 	reliable?
> 
> 15:00-15:15: Break
> 
> 15:15-16:15: Discussion of the media subsystem development process
> 	Presenter: Hans Verkuil
> 	Description: Review of the multi-committer model: current status and next steps.
> 	Are there any bottlenecks, any ideas for improvements, w.r.t. the development process?
> 
> As you can see, there is still some available time for other topics.

If there is still a bit of time left, maybe we can reserve some 15-30
minutes for the following:

-------%<---snip--------------------------------------------------------

The Butterfly Effect or How Support for Complex Hardware may affect the uAPI

Video capture and camera hardware in recent SoCs is exceedingly complex
and the assumption that there is one central V4L2 driver that registers
the media device does not necessarily hold anymore. IMHO we need a
central media device to rule them all and adaptations to the
v4l2_{async,device}_register_subdev code. The discussion [0, 1] quickly
escalated:
 - Dynamic (de)registration of media entities is desired
 - This requires considerations about the uAPI
 - There is significant overlap with the notion of fault-tolerant V4L2
 - There is also a ton of cleanup work, but the resulting patches must
   not break anything existing
 - So we need to talk about possible migration strategies in order to
   achieve reasonable progress without interfering too much with
   existing and working parts

TL;DR: This short talk outlines the effects of upstreaming Rockchip
RK3588 video capture and camera support on the V4L2/MC uAPI and on the
(linux-media) universe as we know it today.

[0]
https://linuxtv.org/irc/oftc/irclogger_log/linux-media?date=2026-02-17,Tue&sel=72#l68
[1]
https://linuxtv.org/irc/oftc/irclogger_log/linux-media?date=2026-02-18,Wed&sel=14#l10

-------%<---snip--------------------------------------------------------

If desired, I'll try to find the time to describe the issue in more
detail on the list *before* everyone travels to Nice. Then, we can use
the time on site more effectively to discuss it.

Best regards,
Michael

Re: [ANNv4] Media Summit on May 26th in Nice, France

[Loic Poulain]

Hi Hans,

I would be happy to discuss this if a slot is available:

Title: Generic V4L2 ISP M2M framework
Presenter: Loic Poulain
Time estimate: ~20min
Description: During early development of a Qualcomm Offline Image
Processing Engine (OPE), we relied on the V4L2 memory‑to‑memory
(v4l2‑m2m) framework, which is widely used and provides solid support
for buffer management and scheduling. However, applying it to an ISP
use case exposes limitations: ISP engines often require a richer media
graph, with multiple pads and metadata flows, similar to inline ISP
pipelines (params, stats, outputs). This talk proposes discussing the
need for and design of a common V4L2 ISP M2M framework to factor out
shared functionality across drivers, particularly around buffer/queue
management and job scheduling.

Regards,
Loic


On Sun, Apr 12, 2026 at 12:25 PM Hans Verkuil <hverkuil+cisco@kernel.org> wrote:
>
> (Please pass this on to anyone you think might be interested in this!)
>
> Hi all,
>
> This is the fourth version of this announcement, updating the list of attendees
> and the tentative agenda at the end: please let me know if you see mistakes.
> Note that there is still time for one or two other topics. Also please check
> the agenda if you need more (or perhaps less) time for your topic.
>
> This year's Media Summit will be held on Tuesday May 26th the day before the
> Embedded Recipes Conference in Nice, France:
>
> https://embedded-recipes.org/2026/
>
> The Media Summit will be held at Hotel Campanile and in the same meeting room
> as last year (Nikaia):
>
> https://nice-aeroport.campanile.com/en-us/
>
> It is close to the Airport and to the Embedded Recipes venue.
>
> The meeting room can hold up to 30 people and I will provide video conferencing support,
> just like last year. The location and the meeting room was quite nice last year, so
> I saw no need to change it.
>
> That said, in-person participation is very much preferred. This yearly summit is meant
> for active media developers to meet face-to-face and to discuss media subsystem issues.
>
> And it is also a good opportunity to talk to each other during the Embedded Recipes
> conference to discuss topics in a smaller group. But if you are an active media developer
> and are really not able to attend in person, then remote participation is an option.
>
> If you want to attend the meeting (either in person or remote), then send an email to me
> directly. The deadline for in-person attendance is May 14 as the hotel needs to know the
> final number of attendees by then.
>
> There is no registration fee, the meeting room is sponsored by Cisco and Collabora, and
> the lunch is sponsored by Ideas on Board! Many thanks to our sponsors, it's very much
> appreciated.
>
> If you have a topic that you want to discuss, just 'Reply All' to this announcement
> and give the topic title, a short description and a guesstimate of the time you need
> for your topic.
>
> See last year's Media Summit Report as an example of what to expect:
>
> https://lore.kernel.org/linux-media/21769183-ca57-4f8f-818a-6a1ad089298d@jjverkuil.nl/
>
> Regards,
>
>         Hans
>
> PS: Be aware that May 24 and 25 are public holidays in France. So many shops may be
> closed those days.
>
> In-person attendees:
> Sakari Ailus <sakari.ailus@linux.intel.com>
> Kieran Bingham <kieran.bingham@ideasonboard.com>
> Brandon Brnich <b-brnich@ti.com>
> Rouven Czerwinski <rouven.czerwinski@linaro.org>
> Mehdi Djait <mehdi.djait@linux.intel.com>
> Bryan O'Donoghue <bryan.odonoghue@linaro.org>
> Nicolas Dufresne <nicolas.dufresne@collabora.com>
> Marco Felsch <m.felsch@pengutronix.de>
> Paul Kocialkowski <paulk@sys-base.io>
> Jai Luthra <jai.luthra@ideasonboard.com>
> Jacopo Mondi <jacopo.mondi@ideasonboard.com>
> Benjamin Mugnier <benjamin.mugnier@foss.st.com>
> Beleswar Padhi <b-padhi@ti.com>
> Laurent Pinchart <laurent.pinchart@ideasonboard.com>
> Loic Poulain <loic.poulain@oss.qualcomm.com>
> Sven Püschel <s.pueschel@pengutronix.de>
> Ricardo Ribalda <ribalda@chromium.org>
> Michael Riesch <michael.riesch@collabora.com>
> Devarsh Thakkar <devarsht@ti.com>
> Michael Tretter <m.tretter@pengutronix.de>
> Hans Verkuil <hverkuil@kernel.org>
>
> Remote attendees:
> Yemike Abhilash Chandra <y-abhilashchandra@ti.com>
> Rishikesh Donadkar <r-donadkar@ti.com>
> Jackson Lee <jackson.lee@chipsnmedia.com>
> Dave Stevenson <dave.stevenson@raspberrypi.com> (tentative)
>
>
> Agenda (tentative):
>
> 8:45-9:20: Arrive, settle in
>
> 9:20-9:30: Short intro (Hans Verkuil)
>
> 9:30-9:45: Status of ISP support in V4L2
>         Presenter: Laurent Pinchart
>         Description: Summary of ISP-related development in V4L2 since the last
>         Linux Media Summit. This includes a brief overview of technical
>         developments, and a summary of the efforts to engage with vendors.
>
> 9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
>         Presenter: Paul Kocialkowski
>         Description: An update on the ongonig work to support stateless codecs in V4L2.
>         Some of the remaining open topics will be presented and discussed.
>
> 10:45-11:00: break
>
> 11:00-11:30: Vulkan Video Codecs
>         Presenter: Nicolas Dufresne
>         Description: Vulkan video codecs: what are the viable options for Linux Media
>         and what is in preparation outside of our subsystem. The second aspect is
>         informative as these discussions don't seem to lean toward our subsystem as the
>         foundation. But I think it's rather useful for everyone to understand why and
>         what is included.
>
> 11:30-12:00: Protected Video playback on i.MX8MQ
>         Presenter: Rouven Czerwinski
>         Description: Introduction to protected video playback
>         on i.MX8MQ and missing bits for linux-media & protected heap interoperability.
>
> 12:00-13:30: Lunch
>
> 13:30-14:00: HDCP support for HDMI receivers
>         Presenter: Hans Verkuil
>         Description: I have been working on adding HDCP support for HDMI receivers.
>         Specifically the HDCP negotiation between sources and sinks.
>
> 14:00-14:30: AI patches
>         Presenter: Sakari Ailus
>         Description: What is our policy w.r.t. AI generated patches?
>
> 14:30-15:00 Overview of Media CI: where do pipelines run?
>         Presenter: Ricardo Ribalda
>         Description: How are jobs in pipelines assigned? How does the infrastructure
>         for Media CI work? Are there things that can be tweaked to make it more
>         reliable?
>
> 15:00-15:15: Break
>
> 15:15-16:15: Discussion of the media subsystem development process
>         Presenter: Hans Verkuil
>         Description: Review of the multi-committer model: current status and next steps.
>         Are there any bottlenecks, any ideas for improvements, w.r.t. the development process?
>
> As you can see, there is still some available time for other topics.

Re: [ANNv4] Media Summit on May 26th in Nice, France

[Laurent Pinchart]

On Mon, Apr 13, 2026 at 10:03:52PM +0200, Loic Poulain wrote:
> Hi Hans,
> 
> I would be happy to discuss this if a slot is available:
> 
> Title: Generic V4L2 ISP M2M framework
> Presenter: Loic Poulain
> Time estimate: ~20min
> Description: During early development of a Qualcomm Offline Image
> Processing Engine (OPE), we relied on the V4L2 memory‑to‑memory
> (v4l2‑m2m) framework, which is widely used and provides solid support
> for buffer management and scheduling. However, applying it to an ISP
> use case exposes limitations: ISP engines often require a richer media
> graph, with multiple pads and metadata flows, similar to inline ISP
> pipelines (params, stats, outputs). This talk proposes discussing the
> need for and design of a common V4L2 ISP M2M framework to factor out
> shared functionality across drivers, particularly around buffer/queue
> management and job scheduling.

That's well aligned with the v4l2-isp framework that Jacopo started, and
to the multi-context and media-jobs APIs that we have proposed. I
wonder, however, if a short session at the media summit will be enough,
or if we should try to organize a half day brainstorming workshop at
some point. Depending on when the people interested in this topic plan
to arrive, Monday could be an option.

> On Sun, Apr 12, 2026 at 12:25 PM Hans Verkuil <hverkuil+cisco@kernel.org> wrote:
> >
> > (Please pass this on to anyone you think might be interested in this!)
> >
> > Hi all,
> >
> > This is the fourth version of this announcement, updating the list of attendees
> > and the tentative agenda at the end: please let me know if you see mistakes.
> > Note that there is still time for one or two other topics. Also please check
> > the agenda if you need more (or perhaps less) time for your topic.
> >
> > This year's Media Summit will be held on Tuesday May 26th the day before the
> > Embedded Recipes Conference in Nice, France:
> >
> > https://embedded-recipes.org/2026/
> >
> > The Media Summit will be held at Hotel Campanile and in the same meeting room
> > as last year (Nikaia):
> >
> > https://nice-aeroport.campanile.com/en-us/
> >
> > It is close to the Airport and to the Embedded Recipes venue.
> >
> > The meeting room can hold up to 30 people and I will provide video conferencing support,
> > just like last year. The location and the meeting room was quite nice last year, so
> > I saw no need to change it.
> >
> > That said, in-person participation is very much preferred. This yearly summit is meant
> > for active media developers to meet face-to-face and to discuss media subsystem issues.
> >
> > And it is also a good opportunity to talk to each other during the Embedded Recipes
> > conference to discuss topics in a smaller group. But if you are an active media developer
> > and are really not able to attend in person, then remote participation is an option.
> >
> > If you want to attend the meeting (either in person or remote), then send an email to me
> > directly. The deadline for in-person attendance is May 14 as the hotel needs to know the
> > final number of attendees by then.
> >
> > There is no registration fee, the meeting room is sponsored by Cisco and Collabora, and
> > the lunch is sponsored by Ideas on Board! Many thanks to our sponsors, it's very much
> > appreciated.
> >
> > If you have a topic that you want to discuss, just 'Reply All' to this announcement
> > and give the topic title, a short description and a guesstimate of the time you need
> > for your topic.
> >
> > See last year's Media Summit Report as an example of what to expect:
> >
> > https://lore.kernel.org/linux-media/21769183-ca57-4f8f-818a-6a1ad089298d@jjverkuil.nl/
> >
> > Regards,
> >
> >         Hans
> >
> > PS: Be aware that May 24 and 25 are public holidays in France. So many shops may be
> > closed those days.
> >
> > In-person attendees:
> > Sakari Ailus <sakari.ailus@linux.intel.com>
> > Kieran Bingham <kieran.bingham@ideasonboard.com>
> > Brandon Brnich <b-brnich@ti.com>
> > Rouven Czerwinski <rouven.czerwinski@linaro.org>
> > Mehdi Djait <mehdi.djait@linux.intel.com>
> > Bryan O'Donoghue <bryan.odonoghue@linaro.org>
> > Nicolas Dufresne <nicolas.dufresne@collabora.com>
> > Marco Felsch <m.felsch@pengutronix.de>
> > Paul Kocialkowski <paulk@sys-base.io>
> > Jai Luthra <jai.luthra@ideasonboard.com>
> > Jacopo Mondi <jacopo.mondi@ideasonboard.com>
> > Benjamin Mugnier <benjamin.mugnier@foss.st.com>
> > Beleswar Padhi <b-padhi@ti.com>
> > Laurent Pinchart <laurent.pinchart@ideasonboard.com>
> > Loic Poulain <loic.poulain@oss.qualcomm.com>
> > Sven Püschel <s.pueschel@pengutronix.de>
> > Ricardo Ribalda <ribalda@chromium.org>
> > Michael Riesch <michael.riesch@collabora.com>
> > Devarsh Thakkar <devarsht@ti.com>
> > Michael Tretter <m.tretter@pengutronix.de>
> > Hans Verkuil <hverkuil@kernel.org>
> >
> > Remote attendees:
> > Yemike Abhilash Chandra <y-abhilashchandra@ti.com>
> > Rishikesh Donadkar <r-donadkar@ti.com>
> > Jackson Lee <jackson.lee@chipsnmedia.com>
> > Dave Stevenson <dave.stevenson@raspberrypi.com> (tentative)
> >
> >
> > Agenda (tentative):
> >
> > 8:45-9:20: Arrive, settle in
> >
> > 9:20-9:30: Short intro (Hans Verkuil)
> >
> > 9:30-9:45: Status of ISP support in V4L2
> >         Presenter: Laurent Pinchart
> >         Description: Summary of ISP-related development in V4L2 since the last
> >         Linux Media Summit. This includes a brief overview of technical
> >         developments, and a summary of the efforts to engage with vendors.
> >
> > 9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
> >         Presenter: Paul Kocialkowski
> >         Description: An update on the ongonig work to support stateless codecs in V4L2.
> >         Some of the remaining open topics will be presented and discussed.
> >
> > 10:45-11:00: break
> >
> > 11:00-11:30: Vulkan Video Codecs
> >         Presenter: Nicolas Dufresne
> >         Description: Vulkan video codecs: what are the viable options for Linux Media
> >         and what is in preparation outside of our subsystem. The second aspect is
> >         informative as these discussions don't seem to lean toward our subsystem as the
> >         foundation. But I think it's rather useful for everyone to understand why and
> >         what is included.
> >
> > 11:30-12:00: Protected Video playback on i.MX8MQ
> >         Presenter: Rouven Czerwinski
> >         Description: Introduction to protected video playback
> >         on i.MX8MQ and missing bits for linux-media & protected heap interoperability.
> >
> > 12:00-13:30: Lunch
> >
> > 13:30-14:00: HDCP support for HDMI receivers
> >         Presenter: Hans Verkuil
> >         Description: I have been working on adding HDCP support for HDMI receivers.
> >         Specifically the HDCP negotiation between sources and sinks.
> >
> > 14:00-14:30: AI patches
> >         Presenter: Sakari Ailus
> >         Description: What is our policy w.r.t. AI generated patches?
> >
> > 14:30-15:00 Overview of Media CI: where do pipelines run?
> >         Presenter: Ricardo Ribalda
> >         Description: How are jobs in pipelines assigned? How does the infrastructure
> >         for Media CI work? Are there things that can be tweaked to make it more
> >         reliable?
> >
> > 15:00-15:15: Break
> >
> > 15:15-16:15: Discussion of the media subsystem development process
> >         Presenter: Hans Verkuil
> >         Description: Review of the multi-committer model: current status and next steps.
> >         Are there any bottlenecks, any ideas for improvements, w.r.t. the development process?
> >
> > As you can see, there is still some available time for other topics.

-- 
Regards,

Laurent Pinchart

Re: [ANNv4] Media Summit on May 26th in Nice, France

[Nicolas Dufresne]

[-- Attachment #1: Type: text/plain, Size: 9166 bytes --]

Hi,

Le lundi 13 avril 2026 à 23:19 +0300, Laurent Pinchart a écrit :
> On Mon, Apr 13, 2026 at 10:03:52PM +0200, Loic Poulain wrote:
> > Hi Hans,
> > 
> > I would be happy to discuss this if a slot is available:
> > 
> > Title: Generic V4L2 ISP M2M framework
> > Presenter: Loic Poulain
> > Time estimate: ~20min
> > Description: During early development of a Qualcomm Offline Image
> > Processing Engine (OPE), we relied on the V4L2 memory‑to‑memory
> > (v4l2‑m2m) framework, which is widely used and provides solid support
> > for buffer management and scheduling. However, applying it to an ISP
> > use case exposes limitations: ISP engines often require a richer media
> > graph, with multiple pads and metadata flows, similar to inline ISP
> > pipelines (params, stats, outputs). This talk proposes discussing the
> > need for and design of a common V4L2 ISP M2M framework to factor out
> > shared functionality across drivers, particularly around buffer/queue
> > management and job scheduling.
> 
> That's well aligned with the v4l2-isp framework that Jacopo started, and
> to the multi-context and media-jobs APIs that we have proposed. I
> wonder, however, if a short session at the media summit will be enough,
> or if we should try to organize a half day brainstorming workshop at
> some point. Depending on when the people interested in this topic plan
> to arrive, Monday could be an option.

I'm also/still interested in the multi-context for m2m decoders that have inline
post-processing capabilities (current model forces us to waste a lot of RAM). We
just restarted some design discussion with the team, with an increased
confidence that multi-context is the way. The scheduler could come handy in the
future if we get to deal with more multi-stage codecs in the future. I'll be in
Nice all day Monday.

Nicolas

> 
> > On Sun, Apr 12, 2026 at 12:25 PM Hans Verkuil <hverkuil+cisco@kernel.org>
> > wrote:
> > > 
> > > (Please pass this on to anyone you think might be interested in this!)
> > > 
> > > Hi all,
> > > 
> > > This is the fourth version of this announcement, updating the list of
> > > attendees
> > > and the tentative agenda at the end: please let me know if you see
> > > mistakes.
> > > Note that there is still time for one or two other topics. Also please
> > > check
> > > the agenda if you need more (or perhaps less) time for your topic.
> > > 
> > > This year's Media Summit will be held on Tuesday May 26th the day before
> > > the
> > > Embedded Recipes Conference in Nice, France:
> > > 
> > > https://embedded-recipes.org/2026/
> > > 
> > > The Media Summit will be held at Hotel Campanile and in the same meeting
> > > room
> > > as last year (Nikaia):
> > > 
> > > https://nice-aeroport.campanile.com/en-us/
> > > 
> > > It is close to the Airport and to the Embedded Recipes venue.
> > > 
> > > The meeting room can hold up to 30 people and I will provide video
> > > conferencing support,
> > > just like last year. The location and the meeting room was quite nice last
> > > year, so
> > > I saw no need to change it.
> > > 
> > > That said, in-person participation is very much preferred. This yearly
> > > summit is meant
> > > for active media developers to meet face-to-face and to discuss media
> > > subsystem issues.
> > > 
> > > And it is also a good opportunity to talk to each other during the
> > > Embedded Recipes
> > > conference to discuss topics in a smaller group. But if you are an active
> > > media developer
> > > and are really not able to attend in person, then remote participation is
> > > an option.
> > > 
> > > If you want to attend the meeting (either in person or remote), then send
> > > an email to me
> > > directly. The deadline for in-person attendance is May 14 as the hotel
> > > needs to know the
> > > final number of attendees by then.
> > > 
> > > There is no registration fee, the meeting room is sponsored by Cisco and
> > > Collabora, and
> > > the lunch is sponsored by Ideas on Board! Many thanks to our sponsors,
> > > it's very much
> > > appreciated.
> > > 
> > > If you have a topic that you want to discuss, just 'Reply All' to this
> > > announcement
> > > and give the topic title, a short description and a guesstimate of the
> > > time you need
> > > for your topic.
> > > 
> > > See last year's Media Summit Report as an example of what to expect:
> > > 
> > > https://lore.kernel.org/linux-media/21769183-ca57-4f8f-818a-6a1ad089298d@jjverkuil.nl/
> > > 
> > > Regards,
> > > 
> > >         Hans
> > > 
> > > PS: Be aware that May 24 and 25 are public holidays in France. So many
> > > shops may be
> > > closed those days.
> > > 
> > > In-person attendees:
> > > Sakari Ailus <sakari.ailus@linux.intel.com>
> > > Kieran Bingham <kieran.bingham@ideasonboard.com>
> > > Brandon Brnich <b-brnich@ti.com>
> > > Rouven Czerwinski <rouven.czerwinski@linaro.org>
> > > Mehdi Djait <mehdi.djait@linux.intel.com>
> > > Bryan O'Donoghue <bryan.odonoghue@linaro.org>
> > > Nicolas Dufresne <nicolas.dufresne@collabora.com>
> > > Marco Felsch <m.felsch@pengutronix.de>
> > > Paul Kocialkowski <paulk@sys-base.io>
> > > Jai Luthra <jai.luthra@ideasonboard.com>
> > > Jacopo Mondi <jacopo.mondi@ideasonboard.com>
> > > Benjamin Mugnier <benjamin.mugnier@foss.st.com>
> > > Beleswar Padhi <b-padhi@ti.com>
> > > Laurent Pinchart <laurent.pinchart@ideasonboard.com>
> > > Loic Poulain <loic.poulain@oss.qualcomm.com>
> > > Sven Püschel <s.pueschel@pengutronix.de>
> > > Ricardo Ribalda <ribalda@chromium.org>
> > > Michael Riesch <michael.riesch@collabora.com>
> > > Devarsh Thakkar <devarsht@ti.com>
> > > Michael Tretter <m.tretter@pengutronix.de>
> > > Hans Verkuil <hverkuil@kernel.org>
> > > 
> > > Remote attendees:
> > > Yemike Abhilash Chandra <y-abhilashchandra@ti.com>
> > > Rishikesh Donadkar <r-donadkar@ti.com>
> > > Jackson Lee <jackson.lee@chipsnmedia.com>
> > > Dave Stevenson <dave.stevenson@raspberrypi.com> (tentative)
> > > 
> > > 
> > > Agenda (tentative):
> > > 
> > > 8:45-9:20: Arrive, settle in
> > > 
> > > 9:20-9:30: Short intro (Hans Verkuil)
> > > 
> > > 9:30-9:45: Status of ISP support in V4L2
> > >         Presenter: Laurent Pinchart
> > >         Description: Summary of ISP-related development in V4L2 since the
> > > last
> > >         Linux Media Summit. This includes a brief overview of technical
> > >         developments, and a summary of the efforts to engage with vendors.
> > > 
> > > 9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
> > >         Presenter: Paul Kocialkowski
> > >         Description: An update on the ongonig work to support stateless
> > > codecs in V4L2.
> > >         Some of the remaining open topics will be presented and discussed.
> > > 
> > > 10:45-11:00: break
> > > 
> > > 11:00-11:30: Vulkan Video Codecs
> > >         Presenter: Nicolas Dufresne
> > >         Description: Vulkan video codecs: what are the viable options for
> > > Linux Media
> > >         and what is in preparation outside of our subsystem. The second
> > > aspect is
> > >         informative as these discussions don't seem to lean toward our
> > > subsystem as the
> > >         foundation. But I think it's rather useful for everyone to
> > > understand why and
> > >         what is included.
> > > 
> > > 11:30-12:00: Protected Video playback on i.MX8MQ
> > >         Presenter: Rouven Czerwinski
> > >         Description: Introduction to protected video playback
> > >         on i.MX8MQ and missing bits for linux-media & protected heap
> > > interoperability.
> > > 
> > > 12:00-13:30: Lunch
> > > 
> > > 13:30-14:00: HDCP support for HDMI receivers
> > >         Presenter: Hans Verkuil
> > >         Description: I have been working on adding HDCP support for HDMI
> > > receivers.
> > >         Specifically the HDCP negotiation between sources and sinks.
> > > 
> > > 14:00-14:30: AI patches
> > >         Presenter: Sakari Ailus
> > >         Description: What is our policy w.r.t. AI generated patches?
> > > 
> > > 14:30-15:00 Overview of Media CI: where do pipelines run?
> > >         Presenter: Ricardo Ribalda
> > >         Description: How are jobs in pipelines assigned? How does the
> > > infrastructure
> > >         for Media CI work? Are there things that can be tweaked to make it
> > > more
> > >         reliable?
> > > 
> > > 15:00-15:15: Break
> > > 
> > > 15:15-16:15: Discussion of the media subsystem development process
> > >         Presenter: Hans Verkuil
> > >         Description: Review of the multi-committer model: current status
> > > and next steps.
> > >         Are there any bottlenecks, any ideas for improvements, w.r.t. the
> > > development process?
> > > 
> > > As you can see, there is still some available time for other topics.

[-- Attachment #2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 228 bytes --]

Re: [ANNv4] Media Summit on May 26th in Nice, France

[Laurent Pinchart]

On Mon, Apr 13, 2026 at 04:25:54PM -0400, Nicolas Dufresne wrote:
> Le lundi 13 avril 2026 à 23:19 +0300, Laurent Pinchart a écrit :
> > On Mon, Apr 13, 2026 at 10:03:52PM +0200, Loic Poulain wrote:
> > > Hi Hans,
> > > 
> > > I would be happy to discuss this if a slot is available:
> > > 
> > > Title: Generic V4L2 ISP M2M framework
> > > Presenter: Loic Poulain
> > > Time estimate: ~20min
> > > Description: During early development of a Qualcomm Offline Image
> > > Processing Engine (OPE), we relied on the V4L2 memory‑to‑memory
> > > (v4l2‑m2m) framework, which is widely used and provides solid support
> > > for buffer management and scheduling. However, applying it to an ISP
> > > use case exposes limitations: ISP engines often require a richer media
> > > graph, with multiple pads and metadata flows, similar to inline ISP
> > > pipelines (params, stats, outputs). This talk proposes discussing the
> > > need for and design of a common V4L2 ISP M2M framework to factor out
> > > shared functionality across drivers, particularly around buffer/queue
> > > management and job scheduling.
> > 
> > That's well aligned with the v4l2-isp framework that Jacopo started, and
> > to the multi-context and media-jobs APIs that we have proposed. I
> > wonder, however, if a short session at the media summit will be enough,
> > or if we should try to organize a half day brainstorming workshop at
> > some point. Depending on when the people interested in this topic plan
> > to arrive, Monday could be an option.
> 
> I'm also/still interested in the multi-context for m2m decoders that have inline
> post-processing capabilities (current model forces us to waste a lot of RAM). We
> just restarted some design discussion with the team, with an increased
> confidence that multi-context is the way. The scheduler could come handy in the
> future if we get to deal with more multi-stage codecs in the future. I'll be in
> Nice all day Monday.

I will unfortunately be available only until 15:00 on Monday, but Jacopo
should be available through the day. Let's see who would be interested
and available, and try to organize something.

> > > On Sun, Apr 12, 2026 at 12:25 PM Hans Verkuil wrote:
> > > > 
> > > > (Please pass this on to anyone you think might be interested in this!)
> > > > 
> > > > Hi all,
> > > > 
> > > > This is the fourth version of this announcement, updating the list of
> > > > attendees
> > > > and the tentative agenda at the end: please let me know if you see
> > > > mistakes.
> > > > Note that there is still time for one or two other topics. Also please
> > > > check
> > > > the agenda if you need more (or perhaps less) time for your topic.
> > > > 
> > > > This year's Media Summit will be held on Tuesday May 26th the day before
> > > > the
> > > > Embedded Recipes Conference in Nice, France:
> > > > 
> > > > https://embedded-recipes.org/2026/
> > > > 
> > > > The Media Summit will be held at Hotel Campanile and in the same meeting
> > > > room
> > > > as last year (Nikaia):
> > > > 
> > > > https://nice-aeroport.campanile.com/en-us/
> > > > 
> > > > It is close to the Airport and to the Embedded Recipes venue.
> > > > 
> > > > The meeting room can hold up to 30 people and I will provide video
> > > > conferencing support,
> > > > just like last year. The location and the meeting room was quite nice last
> > > > year, so
> > > > I saw no need to change it.
> > > > 
> > > > That said, in-person participation is very much preferred. This yearly
> > > > summit is meant
> > > > for active media developers to meet face-to-face and to discuss media
> > > > subsystem issues.
> > > > 
> > > > And it is also a good opportunity to talk to each other during the
> > > > Embedded Recipes
> > > > conference to discuss topics in a smaller group. But if you are an active
> > > > media developer
> > > > and are really not able to attend in person, then remote participation is
> > > > an option.
> > > > 
> > > > If you want to attend the meeting (either in person or remote), then send
> > > > an email to me
> > > > directly. The deadline for in-person attendance is May 14 as the hotel
> > > > needs to know the
> > > > final number of attendees by then.
> > > > 
> > > > There is no registration fee, the meeting room is sponsored by Cisco and
> > > > Collabora, and
> > > > the lunch is sponsored by Ideas on Board! Many thanks to our sponsors,
> > > > it's very much
> > > > appreciated.
> > > > 
> > > > If you have a topic that you want to discuss, just 'Reply All' to this
> > > > announcement
> > > > and give the topic title, a short description and a guesstimate of the
> > > > time you need
> > > > for your topic.
> > > > 
> > > > See last year's Media Summit Report as an example of what to expect:
> > > > 
> > > > https://lore.kernel.org/linux-media/21769183-ca57-4f8f-818a-6a1ad089298d@jjverkuil.nl/
> > > > 
> > > > Regards,
> > > > 
> > > >         Hans
> > > > 
> > > > PS: Be aware that May 24 and 25 are public holidays in France. So many
> > > > shops may be
> > > > closed those days.
> > > > 
> > > > In-person attendees:
> > > > Sakari Ailus <sakari.ailus@linux.intel.com>
> > > > Kieran Bingham <kieran.bingham@ideasonboard.com>
> > > > Brandon Brnich <b-brnich@ti.com>
> > > > Rouven Czerwinski <rouven.czerwinski@linaro.org>
> > > > Mehdi Djait <mehdi.djait@linux.intel.com>
> > > > Bryan O'Donoghue <bryan.odonoghue@linaro.org>
> > > > Nicolas Dufresne <nicolas.dufresne@collabora.com>
> > > > Marco Felsch <m.felsch@pengutronix.de>
> > > > Paul Kocialkowski <paulk@sys-base.io>
> > > > Jai Luthra <jai.luthra@ideasonboard.com>
> > > > Jacopo Mondi <jacopo.mondi@ideasonboard.com>
> > > > Benjamin Mugnier <benjamin.mugnier@foss.st.com>
> > > > Beleswar Padhi <b-padhi@ti.com>
> > > > Laurent Pinchart <laurent.pinchart@ideasonboard.com>
> > > > Loic Poulain <loic.poulain@oss.qualcomm.com>
> > > > Sven Püschel <s.pueschel@pengutronix.de>
> > > > Ricardo Ribalda <ribalda@chromium.org>
> > > > Michael Riesch <michael.riesch@collabora.com>
> > > > Devarsh Thakkar <devarsht@ti.com>
> > > > Michael Tretter <m.tretter@pengutronix.de>
> > > > Hans Verkuil <hverkuil@kernel.org>
> > > > 
> > > > Remote attendees:
> > > > Yemike Abhilash Chandra <y-abhilashchandra@ti.com>
> > > > Rishikesh Donadkar <r-donadkar@ti.com>
> > > > Jackson Lee <jackson.lee@chipsnmedia.com>
> > > > Dave Stevenson <dave.stevenson@raspberrypi.com> (tentative)
> > > > 
> > > > 
> > > > Agenda (tentative):
> > > > 
> > > > 8:45-9:20: Arrive, settle in
> > > > 
> > > > 9:20-9:30: Short intro (Hans Verkuil)
> > > > 
> > > > 9:30-9:45: Status of ISP support in V4L2
> > > >         Presenter: Laurent Pinchart
> > > >         Description: Summary of ISP-related development in V4L2 since the
> > > > last
> > > >         Linux Media Summit. This includes a brief overview of technical
> > > >         developments, and a summary of the efforts to engage with vendors.
> > > > 
> > > > 9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
> > > >         Presenter: Paul Kocialkowski
> > > >         Description: An update on the ongonig work to support stateless
> > > > codecs in V4L2.
> > > >         Some of the remaining open topics will be presented and discussed.
> > > > 
> > > > 10:45-11:00: break
> > > > 
> > > > 11:00-11:30: Vulkan Video Codecs
> > > >         Presenter: Nicolas Dufresne
> > > >         Description: Vulkan video codecs: what are the viable options for
> > > > Linux Media
> > > >         and what is in preparation outside of our subsystem. The second
> > > > aspect is
> > > >         informative as these discussions don't seem to lean toward our
> > > > subsystem as the
> > > >         foundation. But I think it's rather useful for everyone to
> > > > understand why and
> > > >         what is included.
> > > > 
> > > > 11:30-12:00: Protected Video playback on i.MX8MQ
> > > >         Presenter: Rouven Czerwinski
> > > >         Description: Introduction to protected video playback
> > > >         on i.MX8MQ and missing bits for linux-media & protected heap
> > > > interoperability.
> > > > 
> > > > 12:00-13:30: Lunch
> > > > 
> > > > 13:30-14:00: HDCP support for HDMI receivers
> > > >         Presenter: Hans Verkuil
> > > >         Description: I have been working on adding HDCP support for HDMI
> > > > receivers.
> > > >         Specifically the HDCP negotiation between sources and sinks.
> > > > 
> > > > 14:00-14:30: AI patches
> > > >         Presenter: Sakari Ailus
> > > >         Description: What is our policy w.r.t. AI generated patches?
> > > > 
> > > > 14:30-15:00 Overview of Media CI: where do pipelines run?
> > > >         Presenter: Ricardo Ribalda
> > > >         Description: How are jobs in pipelines assigned? How does the
> > > > infrastructure
> > > >         for Media CI work? Are there things that can be tweaked to make it
> > > > more
> > > >         reliable?
> > > > 
> > > > 15:00-15:15: Break
> > > > 
> > > > 15:15-16:15: Discussion of the media subsystem development process
> > > >         Presenter: Hans Verkuil
> > > >         Description: Review of the multi-committer model: current status
> > > > and next steps.
> > > >         Are there any bottlenecks, any ideas for improvements, w.r.t. the
> > > > development process?
> > > > 
> > > > As you can see, there is still some available time for other topics.

-- 
Regards,

Laurent Pinchart

Re: [ANNv4] Media Summit on May 26th in Nice, France

[Hans Verkuil]

On 13/04/2026 23:16, Laurent Pinchart wrote:
> On Mon, Apr 13, 2026 at 04:25:54PM -0400, Nicolas Dufresne wrote:
>> Le lundi 13 avril 2026 à 23:19 +0300, Laurent Pinchart a écrit :
>>> On Mon, Apr 13, 2026 at 10:03:52PM +0200, Loic Poulain wrote:
>>>> Hi Hans,
>>>>
>>>> I would be happy to discuss this if a slot is available:
>>>>
>>>> Title: Generic V4L2 ISP M2M framework
>>>> Presenter: Loic Poulain
>>>> Time estimate: ~20min
>>>> Description: During early development of a Qualcomm Offline Image
>>>> Processing Engine (OPE), we relied on the V4L2 memory‑to‑memory
>>>> (v4l2‑m2m) framework, which is widely used and provides solid support
>>>> for buffer management and scheduling. However, applying it to an ISP
>>>> use case exposes limitations: ISP engines often require a richer media
>>>> graph, with multiple pads and metadata flows, similar to inline ISP
>>>> pipelines (params, stats, outputs). This talk proposes discussing the
>>>> need for and design of a common V4L2 ISP M2M framework to factor out
>>>> shared functionality across drivers, particularly around buffer/queue
>>>> management and job scheduling.
>>>
>>> That's well aligned with the v4l2-isp framework that Jacopo started, and
>>> to the multi-context and media-jobs APIs that we have proposed. I
>>> wonder, however, if a short session at the media summit will be enough,
>>> or if we should try to organize a half day brainstorming workshop at
>>> some point. Depending on when the people interested in this topic plan
>>> to arrive, Monday could be an option.
>>
>> I'm also/still interested in the multi-context for m2m decoders that have inline
>> post-processing capabilities (current model forces us to waste a lot of RAM). We
>> just restarted some design discussion with the team, with an increased
>> confidence that multi-context is the way. The scheduler could come handy in the
>> future if we get to deal with more multi-stage codecs in the future. I'll be in
>> Nice all day Monday.
> 
> I will unfortunately be available only until 15:00 on Monday, but Jacopo
> should be available through the day. Let's see who would be interested
> and available, and try to organize something.

I'm available on Monday as well. I think this is a topic that is well suited
to a brainstorm session.

The agenda for the media summit is getting quite full, and I agree with Laurent
that 20 minutes is likely not enough. If we can so a session on Monday instead,
then that would be a good solution.

I have never been very enthusiastic about the m2m framework: it's fine for e.g.
simple scalers, but it's awkward to use for codecs let alone ISPs.

I always felt that we really need variants of the m2m framework that are customized
to specific use-cases: i.e. a codec m2m framework, and (perhaps) an ISP m2m framework.

The big problem with that is of course who will do the work. Making new frameworks
is difficult and takes a long time.

Regards,

	Hans

> 
>>>> On Sun, Apr 12, 2026 at 12:25 PM Hans Verkuil wrote:
>>>>>
>>>>> (Please pass this on to anyone you think might be interested in this!)
>>>>>
>>>>> Hi all,
>>>>>
>>>>> This is the fourth version of this announcement, updating the list of
>>>>> attendees
>>>>> and the tentative agenda at the end: please let me know if you see
>>>>> mistakes.
>>>>> Note that there is still time for one or two other topics. Also please
>>>>> check
>>>>> the agenda if you need more (or perhaps less) time for your topic.
>>>>>
>>>>> This year's Media Summit will be held on Tuesday May 26th the day before
>>>>> the
>>>>> Embedded Recipes Conference in Nice, France:
>>>>>
>>>>> https://embedded-recipes.org/2026/
>>>>>
>>>>> The Media Summit will be held at Hotel Campanile and in the same meeting
>>>>> room
>>>>> as last year (Nikaia):
>>>>>
>>>>> https://nice-aeroport.campanile.com/en-us/
>>>>>
>>>>> It is close to the Airport and to the Embedded Recipes venue.
>>>>>
>>>>> The meeting room can hold up to 30 people and I will provide video
>>>>> conferencing support,
>>>>> just like last year. The location and the meeting room was quite nice last
>>>>> year, so
>>>>> I saw no need to change it.
>>>>>
>>>>> That said, in-person participation is very much preferred. This yearly
>>>>> summit is meant
>>>>> for active media developers to meet face-to-face and to discuss media
>>>>> subsystem issues.
>>>>>
>>>>> And it is also a good opportunity to talk to each other during the
>>>>> Embedded Recipes
>>>>> conference to discuss topics in a smaller group. But if you are an active
>>>>> media developer
>>>>> and are really not able to attend in person, then remote participation is
>>>>> an option.
>>>>>
>>>>> If you want to attend the meeting (either in person or remote), then send
>>>>> an email to me
>>>>> directly. The deadline for in-person attendance is May 14 as the hotel
>>>>> needs to know the
>>>>> final number of attendees by then.
>>>>>
>>>>> There is no registration fee, the meeting room is sponsored by Cisco and
>>>>> Collabora, and
>>>>> the lunch is sponsored by Ideas on Board! Many thanks to our sponsors,
>>>>> it's very much
>>>>> appreciated.
>>>>>
>>>>> If you have a topic that you want to discuss, just 'Reply All' to this
>>>>> announcement
>>>>> and give the topic title, a short description and a guesstimate of the
>>>>> time you need
>>>>> for your topic.
>>>>>
>>>>> See last year's Media Summit Report as an example of what to expect:
>>>>>
>>>>> https://lore.kernel.org/linux-media/21769183-ca57-4f8f-818a-6a1ad089298d@jjverkuil.nl/
>>>>>
>>>>> Regards,
>>>>>
>>>>>         Hans
>>>>>
>>>>> PS: Be aware that May 24 and 25 are public holidays in France. So many
>>>>> shops may be
>>>>> closed those days.
>>>>>
>>>>> In-person attendees:
>>>>> Sakari Ailus <sakari.ailus@linux.intel.com>
>>>>> Kieran Bingham <kieran.bingham@ideasonboard.com>
>>>>> Brandon Brnich <b-brnich@ti.com>
>>>>> Rouven Czerwinski <rouven.czerwinski@linaro.org>
>>>>> Mehdi Djait <mehdi.djait@linux.intel.com>
>>>>> Bryan O'Donoghue <bryan.odonoghue@linaro.org>
>>>>> Nicolas Dufresne <nicolas.dufresne@collabora.com>
>>>>> Marco Felsch <m.felsch@pengutronix.de>
>>>>> Paul Kocialkowski <paulk@sys-base.io>
>>>>> Jai Luthra <jai.luthra@ideasonboard.com>
>>>>> Jacopo Mondi <jacopo.mondi@ideasonboard.com>
>>>>> Benjamin Mugnier <benjamin.mugnier@foss.st.com>
>>>>> Beleswar Padhi <b-padhi@ti.com>
>>>>> Laurent Pinchart <laurent.pinchart@ideasonboard.com>
>>>>> Loic Poulain <loic.poulain@oss.qualcomm.com>
>>>>> Sven Püschel <s.pueschel@pengutronix.de>
>>>>> Ricardo Ribalda <ribalda@chromium.org>
>>>>> Michael Riesch <michael.riesch@collabora.com>
>>>>> Devarsh Thakkar <devarsht@ti.com>
>>>>> Michael Tretter <m.tretter@pengutronix.de>
>>>>> Hans Verkuil <hverkuil@kernel.org>
>>>>>
>>>>> Remote attendees:
>>>>> Yemike Abhilash Chandra <y-abhilashchandra@ti.com>
>>>>> Rishikesh Donadkar <r-donadkar@ti.com>
>>>>> Jackson Lee <jackson.lee@chipsnmedia.com>
>>>>> Dave Stevenson <dave.stevenson@raspberrypi.com> (tentative)
>>>>>
>>>>>
>>>>> Agenda (tentative):
>>>>>
>>>>> 8:45-9:20: Arrive, settle in
>>>>>
>>>>> 9:20-9:30: Short intro (Hans Verkuil)
>>>>>
>>>>> 9:30-9:45: Status of ISP support in V4L2
>>>>>         Presenter: Laurent Pinchart
>>>>>         Description: Summary of ISP-related development in V4L2 since the
>>>>> last
>>>>>         Linux Media Summit. This includes a brief overview of technical
>>>>>         developments, and a summary of the efforts to engage with vendors.
>>>>>
>>>>> 9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
>>>>>         Presenter: Paul Kocialkowski
>>>>>         Description: An update on the ongonig work to support stateless
>>>>> codecs in V4L2.
>>>>>         Some of the remaining open topics will be presented and discussed.
>>>>>
>>>>> 10:45-11:00: break
>>>>>
>>>>> 11:00-11:30: Vulkan Video Codecs
>>>>>         Presenter: Nicolas Dufresne
>>>>>         Description: Vulkan video codecs: what are the viable options for
>>>>> Linux Media
>>>>>         and what is in preparation outside of our subsystem. The second
>>>>> aspect is
>>>>>         informative as these discussions don't seem to lean toward our
>>>>> subsystem as the
>>>>>         foundation. But I think it's rather useful for everyone to
>>>>> understand why and
>>>>>         what is included.
>>>>>
>>>>> 11:30-12:00: Protected Video playback on i.MX8MQ
>>>>>         Presenter: Rouven Czerwinski
>>>>>         Description: Introduction to protected video playback
>>>>>         on i.MX8MQ and missing bits for linux-media & protected heap
>>>>> interoperability.
>>>>>
>>>>> 12:00-13:30: Lunch
>>>>>
>>>>> 13:30-14:00: HDCP support for HDMI receivers
>>>>>         Presenter: Hans Verkuil
>>>>>         Description: I have been working on adding HDCP support for HDMI
>>>>> receivers.
>>>>>         Specifically the HDCP negotiation between sources and sinks.
>>>>>
>>>>> 14:00-14:30: AI patches
>>>>>         Presenter: Sakari Ailus
>>>>>         Description: What is our policy w.r.t. AI generated patches?
>>>>>
>>>>> 14:30-15:00 Overview of Media CI: where do pipelines run?
>>>>>         Presenter: Ricardo Ribalda
>>>>>         Description: How are jobs in pipelines assigned? How does the
>>>>> infrastructure
>>>>>         for Media CI work? Are there things that can be tweaked to make it
>>>>> more
>>>>>         reliable?
>>>>>
>>>>> 15:00-15:15: Break
>>>>>
>>>>> 15:15-16:15: Discussion of the media subsystem development process
>>>>>         Presenter: Hans Verkuil
>>>>>         Description: Review of the multi-committer model: current status
>>>>> and next steps.
>>>>>         Are there any bottlenecks, any ideas for improvements, w.r.t. the
>>>>> development process?
>>>>>
>>>>> As you can see, there is still some available time for other topics.
> 

Re: [ANNv4] Media Summit on May 26th in Nice, France

[Hans Verkuil]

On 13/04/2026 11:57, Michael Riesch wrote:
> Hi Hans,
> 
> On 4/12/26 12:25, Hans Verkuil wrote:
>> [...]
>> Agenda (tentative):
>>
>> 8:45-9:20: Arrive, settle in
>>
>> 9:20-9:30: Short intro (Hans Verkuil)
>>
>> 9:30-9:45: Status of ISP support in V4L2
>> 	Presenter: Laurent Pinchart
>> 	Description: Summary of ISP-related development in V4L2 since the last
>> 	Linux Media Summit. This includes a brief overview of technical
>> 	developments, and a summary of the efforts to engage with vendors.
>>
>> 9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
>> 	Presenter: Paul Kocialkowski
>> 	Description: An update on the ongonig work to support stateless codecs in V4L2.
>> 	Some of the remaining open topics will be presented and discussed.
>>
>> 10:45-11:00: break
>>
>> 11:00-11:30: Vulkan Video Codecs
>> 	Presenter: Nicolas Dufresne
>> 	Description: Vulkan video codecs: what are the viable options for Linux Media
>> 	and what is in preparation outside of our subsystem. The second aspect is
>> 	informative as these discussions don't seem to lean toward our subsystem as the
>> 	foundation. But I think it's rather useful for everyone to understand why and
>> 	what is included.
>>
>> 11:30-12:00: Protected Video playback on i.MX8MQ
>> 	Presenter: Rouven Czerwinski
>> 	Description: Introduction to protected video playback
>> 	on i.MX8MQ and missing bits for linux-media & protected heap interoperability.
>>
>> 12:00-13:30: Lunch
>>
>> 13:30-14:00: HDCP support for HDMI receivers
>> 	Presenter: Hans Verkuil
>> 	Description: I have been working on adding HDCP support for HDMI receivers.
>> 	Specifically the HDCP negotiation between sources and sinks.
>>
>> 14:00-14:30: AI patches
>> 	Presenter: Sakari Ailus
>> 	Description: What is our policy w.r.t. AI generated patches?
>>
>> 14:30-15:00 Overview of Media CI: where do pipelines run?
>> 	Presenter: Ricardo Ribalda
>> 	Description: How are jobs in pipelines assigned? How does the infrastructure
>> 	for Media CI work? Are there things that can be tweaked to make it more
>> 	reliable?
>>
>> 15:00-15:15: Break
>>
>> 15:15-16:15: Discussion of the media subsystem development process
>> 	Presenter: Hans Verkuil
>> 	Description: Review of the multi-committer model: current status and next steps.
>> 	Are there any bottlenecks, any ideas for improvements, w.r.t. the development process?
>>
>> As you can see, there is still some available time for other topics.
> 
> If there is still a bit of time left, maybe we can reserve some 15-30
> minutes for the following:

I added this to the agenda. Thanks!

Regards,

	Hans

> 
> -------%<---snip--------------------------------------------------------
> 
> The Butterfly Effect or How Support for Complex Hardware may affect the uAPI
> 
> Video capture and camera hardware in recent SoCs is exceedingly complex
> and the assumption that there is one central V4L2 driver that registers
> the media device does not necessarily hold anymore. IMHO we need a
> central media device to rule them all and adaptations to the
> v4l2_{async,device}_register_subdev code. The discussion [0, 1] quickly
> escalated:
>  - Dynamic (de)registration of media entities is desired
>  - This requires considerations about the uAPI
>  - There is significant overlap with the notion of fault-tolerant V4L2
>  - There is also a ton of cleanup work, but the resulting patches must
>    not break anything existing
>  - So we need to talk about possible migration strategies in order to
>    achieve reasonable progress without interfering too much with
>    existing and working parts
> 
> TL;DR: This short talk outlines the effects of upstreaming Rockchip
> RK3588 video capture and camera support on the V4L2/MC uAPI and on the
> (linux-media) universe as we know it today.
> 
> [0]
> https://linuxtv.org/irc/oftc/irclogger_log/linux-media?date=2026-02-17,Tue&sel=72#l68
> [1]
> https://linuxtv.org/irc/oftc/irclogger_log/linux-media?date=2026-02-18,Wed&sel=14#l10
> 
> -------%<---snip--------------------------------------------------------
> 
> If desired, I'll try to find the time to describe the issue in more
> detail on the list *before* everyone travels to Nice. Then, we can use
> the time on site more effectively to discuss it.
> 
> Best regards,
> Michael

Re: [ANNv4] Media Summit on May 26th in Nice, France

[Ricardo Ribalda]

Hi

On Tue, 14 Apr 2026 at 08:47, Hans Verkuil <hverkuil+cisco@kernel.org> wrote:
>
> On 13/04/2026 23:16, Laurent Pinchart wrote:
> > On Mon, Apr 13, 2026 at 04:25:54PM -0400, Nicolas Dufresne wrote:
> >> Le lundi 13 avril 2026 à 23:19 +0300, Laurent Pinchart a écrit :
> >>> On Mon, Apr 13, 2026 at 10:03:52PM +0200, Loic Poulain wrote:
> >>>> Hi Hans,
> >>>>
> >>>> I would be happy to discuss this if a slot is available:
> >>>>
> >>>> Title: Generic V4L2 ISP M2M framework
> >>>> Presenter: Loic Poulain
> >>>> Time estimate: ~20min
> >>>> Description: During early development of a Qualcomm Offline Image
> >>>> Processing Engine (OPE), we relied on the V4L2 memory‑to‑memory
> >>>> (v4l2‑m2m) framework, which is widely used and provides solid support
> >>>> for buffer management and scheduling. However, applying it to an ISP
> >>>> use case exposes limitations: ISP engines often require a richer media
> >>>> graph, with multiple pads and metadata flows, similar to inline ISP
> >>>> pipelines (params, stats, outputs). This talk proposes discussing the
> >>>> need for and design of a common V4L2 ISP M2M framework to factor out
> >>>> shared functionality across drivers, particularly around buffer/queue
> >>>> management and job scheduling.
> >>>
> >>> That's well aligned with the v4l2-isp framework that Jacopo started, and
> >>> to the multi-context and media-jobs APIs that we have proposed. I
> >>> wonder, however, if a short session at the media summit will be enough,
> >>> or if we should try to organize a half day brainstorming workshop at
> >>> some point. Depending on when the people interested in this topic plan
> >>> to arrive, Monday could be an option.
> >>
> >> I'm also/still interested in the multi-context for m2m decoders that have inline
> >> post-processing capabilities (current model forces us to waste a lot of RAM). We
> >> just restarted some design discussion with the team, with an increased
> >> confidence that multi-context is the way. The scheduler could come handy in the
> >> future if we get to deal with more multi-stage codecs in the future. I'll be in
> >> Nice all day Monday.
> >
> > I will unfortunately be available only until 15:00 on Monday, but Jacopo
> > should be available through the day. Let's see who would be interested
> > and available, and try to organize something.
>
> I'm available on Monday as well. I think this is a topic that is well suited
> to a brainstorm session.

I am also available on Monday and would like to attend the session.

Regards!

>
> The agenda for the media summit is getting quite full, and I agree with Laurent
> that 20 minutes is likely not enough. If we can so a session on Monday instead,
> then that would be a good solution.
>
> I have never been very enthusiastic about the m2m framework: it's fine for e.g.
> simple scalers, but it's awkward to use for codecs let alone ISPs.
>
> I always felt that we really need variants of the m2m framework that are customized
> to specific use-cases: i.e. a codec m2m framework, and (perhaps) an ISP m2m framework.
>
> The big problem with that is of course who will do the work. Making new frameworks
> is difficult and takes a long time.
>
> Regards,
>
>         Hans
>
> >
> >>>> On Sun, Apr 12, 2026 at 12:25 PM Hans Verkuil wrote:
> >>>>>
> >>>>> (Please pass this on to anyone you think might be interested in this!)
> >>>>>
> >>>>> Hi all,
> >>>>>
> >>>>> This is the fourth version of this announcement, updating the list of
> >>>>> attendees
> >>>>> and the tentative agenda at the end: please let me know if you see
> >>>>> mistakes.
> >>>>> Note that there is still time for one or two other topics. Also please
> >>>>> check
> >>>>> the agenda if you need more (or perhaps less) time for your topic.
> >>>>>
> >>>>> This year's Media Summit will be held on Tuesday May 26th the day before
> >>>>> the
> >>>>> Embedded Recipes Conference in Nice, France:
> >>>>>
> >>>>> https://embedded-recipes.org/2026/
> >>>>>
> >>>>> The Media Summit will be held at Hotel Campanile and in the same meeting
> >>>>> room
> >>>>> as last year (Nikaia):
> >>>>>
> >>>>> https://nice-aeroport.campanile.com/en-us/
> >>>>>
> >>>>> It is close to the Airport and to the Embedded Recipes venue.
> >>>>>
> >>>>> The meeting room can hold up to 30 people and I will provide video
> >>>>> conferencing support,
> >>>>> just like last year. The location and the meeting room was quite nice last
> >>>>> year, so
> >>>>> I saw no need to change it.
> >>>>>
> >>>>> That said, in-person participation is very much preferred. This yearly
> >>>>> summit is meant
> >>>>> for active media developers to meet face-to-face and to discuss media
> >>>>> subsystem issues.
> >>>>>
> >>>>> And it is also a good opportunity to talk to each other during the
> >>>>> Embedded Recipes
> >>>>> conference to discuss topics in a smaller group. But if you are an active
> >>>>> media developer
> >>>>> and are really not able to attend in person, then remote participation is
> >>>>> an option.
> >>>>>
> >>>>> If you want to attend the meeting (either in person or remote), then send
> >>>>> an email to me
> >>>>> directly. The deadline for in-person attendance is May 14 as the hotel
> >>>>> needs to know the
> >>>>> final number of attendees by then.
> >>>>>
> >>>>> There is no registration fee, the meeting room is sponsored by Cisco and
> >>>>> Collabora, and
> >>>>> the lunch is sponsored by Ideas on Board! Many thanks to our sponsors,
> >>>>> it's very much
> >>>>> appreciated.
> >>>>>
> >>>>> If you have a topic that you want to discuss, just 'Reply All' to this
> >>>>> announcement
> >>>>> and give the topic title, a short description and a guesstimate of the
> >>>>> time you need
> >>>>> for your topic.
> >>>>>
> >>>>> See last year's Media Summit Report as an example of what to expect:
> >>>>>
> >>>>> https://lore.kernel.org/linux-media/21769183-ca57-4f8f-818a-6a1ad089298d@jjverkuil.nl/
> >>>>>
> >>>>> Regards,
> >>>>>
> >>>>>         Hans
> >>>>>
> >>>>> PS: Be aware that May 24 and 25 are public holidays in France. So many
> >>>>> shops may be
> >>>>> closed those days.
> >>>>>
> >>>>> In-person attendees:
> >>>>> Sakari Ailus <sakari.ailus@linux.intel.com>
> >>>>> Kieran Bingham <kieran.bingham@ideasonboard.com>
> >>>>> Brandon Brnich <b-brnich@ti.com>
> >>>>> Rouven Czerwinski <rouven.czerwinski@linaro.org>
> >>>>> Mehdi Djait <mehdi.djait@linux.intel.com>
> >>>>> Bryan O'Donoghue <bryan.odonoghue@linaro.org>
> >>>>> Nicolas Dufresne <nicolas.dufresne@collabora.com>
> >>>>> Marco Felsch <m.felsch@pengutronix.de>
> >>>>> Paul Kocialkowski <paulk@sys-base.io>
> >>>>> Jai Luthra <jai.luthra@ideasonboard.com>
> >>>>> Jacopo Mondi <jacopo.mondi@ideasonboard.com>
> >>>>> Benjamin Mugnier <benjamin.mugnier@foss.st.com>
> >>>>> Beleswar Padhi <b-padhi@ti.com>
> >>>>> Laurent Pinchart <laurent.pinchart@ideasonboard.com>
> >>>>> Loic Poulain <loic.poulain@oss.qualcomm.com>
> >>>>> Sven Püschel <s.pueschel@pengutronix.de>
> >>>>> Ricardo Ribalda <ribalda@chromium.org>
> >>>>> Michael Riesch <michael.riesch@collabora.com>
> >>>>> Devarsh Thakkar <devarsht@ti.com>
> >>>>> Michael Tretter <m.tretter@pengutronix.de>
> >>>>> Hans Verkuil <hverkuil@kernel.org>
> >>>>>
> >>>>> Remote attendees:
> >>>>> Yemike Abhilash Chandra <y-abhilashchandra@ti.com>
> >>>>> Rishikesh Donadkar <r-donadkar@ti.com>
> >>>>> Jackson Lee <jackson.lee@chipsnmedia.com>
> >>>>> Dave Stevenson <dave.stevenson@raspberrypi.com> (tentative)
> >>>>>
> >>>>>
> >>>>> Agenda (tentative):
> >>>>>
> >>>>> 8:45-9:20: Arrive, settle in
> >>>>>
> >>>>> 9:20-9:30: Short intro (Hans Verkuil)
> >>>>>
> >>>>> 9:30-9:45: Status of ISP support in V4L2
> >>>>>         Presenter: Laurent Pinchart
> >>>>>         Description: Summary of ISP-related development in V4L2 since the
> >>>>> last
> >>>>>         Linux Media Summit. This includes a brief overview of technical
> >>>>>         developments, and a summary of the efforts to engage with vendors.
> >>>>>
> >>>>> 9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
> >>>>>         Presenter: Paul Kocialkowski
> >>>>>         Description: An update on the ongonig work to support stateless
> >>>>> codecs in V4L2.
> >>>>>         Some of the remaining open topics will be presented and discussed.
> >>>>>
> >>>>> 10:45-11:00: break
> >>>>>
> >>>>> 11:00-11:30: Vulkan Video Codecs
> >>>>>         Presenter: Nicolas Dufresne
> >>>>>         Description: Vulkan video codecs: what are the viable options for
> >>>>> Linux Media
> >>>>>         and what is in preparation outside of our subsystem. The second
> >>>>> aspect is
> >>>>>         informative as these discussions don't seem to lean toward our
> >>>>> subsystem as the
> >>>>>         foundation. But I think it's rather useful for everyone to
> >>>>> understand why and
> >>>>>         what is included.
> >>>>>
> >>>>> 11:30-12:00: Protected Video playback on i.MX8MQ
> >>>>>         Presenter: Rouven Czerwinski
> >>>>>         Description: Introduction to protected video playback
> >>>>>         on i.MX8MQ and missing bits for linux-media & protected heap
> >>>>> interoperability.
> >>>>>
> >>>>> 12:00-13:30: Lunch
> >>>>>
> >>>>> 13:30-14:00: HDCP support for HDMI receivers
> >>>>>         Presenter: Hans Verkuil
> >>>>>         Description: I have been working on adding HDCP support for HDMI
> >>>>> receivers.
> >>>>>         Specifically the HDCP negotiation between sources and sinks.
> >>>>>
> >>>>> 14:00-14:30: AI patches
> >>>>>         Presenter: Sakari Ailus
> >>>>>         Description: What is our policy w.r.t. AI generated patches?
> >>>>>
> >>>>> 14:30-15:00 Overview of Media CI: where do pipelines run?
> >>>>>         Presenter: Ricardo Ribalda
> >>>>>         Description: How are jobs in pipelines assigned? How does the
> >>>>> infrastructure
> >>>>>         for Media CI work? Are there things that can be tweaked to make it
> >>>>> more
> >>>>>         reliable?
> >>>>>
> >>>>> 15:00-15:15: Break
> >>>>>
> >>>>> 15:15-16:15: Discussion of the media subsystem development process
> >>>>>         Presenter: Hans Verkuil
> >>>>>         Description: Review of the multi-committer model: current status
> >>>>> and next steps.
> >>>>>         Are there any bottlenecks, any ideas for improvements, w.r.t. the
> >>>>> development process?
> >>>>>
> >>>>> As you can see, there is still some available time for other topics.
> >
>


-- 
Ricardo Ribalda

Re: [ANNv4] Media Summit on May 26th in Nice, France

[Jacopo Mondi]

Hi

On Tue, Apr 14, 2026 at 08:47:39AM +0200, Hans Verkuil wrote:
> On 13/04/2026 23:16, Laurent Pinchart wrote:
> > On Mon, Apr 13, 2026 at 04:25:54PM -0400, Nicolas Dufresne wrote:
> >> Le lundi 13 avril 2026 à 23:19 +0300, Laurent Pinchart a écrit :
> >>> On Mon, Apr 13, 2026 at 10:03:52PM +0200, Loic Poulain wrote:
> >>>> Hi Hans,
> >>>>
> >>>> I would be happy to discuss this if a slot is available:
> >>>>
> >>>> Title: Generic V4L2 ISP M2M framework
> >>>> Presenter: Loic Poulain
> >>>> Time estimate: ~20min
> >>>> Description: During early development of a Qualcomm Offline Image
> >>>> Processing Engine (OPE), we relied on the V4L2 memory‑to‑memory
> >>>> (v4l2‑m2m) framework, which is widely used and provides solid support
> >>>> for buffer management and scheduling. However, applying it to an ISP
> >>>> use case exposes limitations: ISP engines often require a richer media
> >>>> graph, with multiple pads and metadata flows, similar to inline ISP
> >>>> pipelines (params, stats, outputs). This talk proposes discussing the
> >>>> need for and design of a common V4L2 ISP M2M framework to factor out
> >>>> shared functionality across drivers, particularly around buffer/queue
> >>>> management and job scheduling.
> >>>
> >>> That's well aligned with the v4l2-isp framework that Jacopo started, and
> >>> to the multi-context and media-jobs APIs that we have proposed. I
> >>> wonder, however, if a short session at the media summit will be enough,
> >>> or if we should try to organize a half day brainstorming workshop at
> >>> some point. Depending on when the people interested in this topic plan
> >>> to arrive, Monday could be an option.
> >>
> >> I'm also/still interested in the multi-context for m2m decoders that have inline
> >> post-processing capabilities (current model forces us to waste a lot of RAM). We
> >> just restarted some design discussion with the team, with an increased
> >> confidence that multi-context is the way. The scheduler could come handy in the
> >> future if we get to deal with more multi-stage codecs in the future. I'll be in
> >> Nice all day Monday.
> >
> > I will unfortunately be available only until 15:00 on Monday, but Jacopo
> > should be available through the day. Let's see who would be interested
> > and available, and try to organize something.
>
> I'm available on Monday as well. I think this is a topic that is well suited
> to a brainstorm session.
>
> The agenda for the media summit is getting quite full, and I agree with Laurent
> that 20 minutes is likely not enough. If we can so a session on Monday instead,
> then that would be a good solution.

I agree a longer time for discussion would be ideal

>
> I have never been very enthusiastic about the m2m framework: it's fine for e.g.
> simple scalers, but it's awkward to use for codecs let alone ISPs.
>
> I always felt that we really need variants of the m2m framework that are customized
> to specific use-cases: i.e. a codec m2m framework, and (perhaps) an ISP m2m framework.
>
> The big problem with that is of course who will do the work. Making new frameworks
> is difficult and takes a long time.

I would have liked to propose for the media summit a quick discussion
about the job scheduler.

--------------------------------------------------------------------------------
A case for a media-job scheduler
================================

A quick 15 minutes presentation of a use case for a media job
scheduler.

Dan has proposed last year a framework for scheduling operations
across multiple drivers that compose a capture pipeline:
https://www.spinics.net/lists/linux-media/msg279502.html

To better clarify why this is useful, I would like to discuss and
describe a practical use case based around the Mali-C55 ISP as
integrated in the Renesas RZ/V2H(P) SoC.
--------------------------------------------------------------------------------

I think this could be useful for the linux-media summit, but I can
quickly show this on Monday as well as going through the last year
presentation about the multi-context framework ?


>
> Regards,
>
> 	Hans
>
> >
> >>>> On Sun, Apr 12, 2026 at 12:25 PM Hans Verkuil wrote:
> >>>>>
> >>>>> (Please pass this on to anyone you think might be interested in this!)
> >>>>>
> >>>>> Hi all,
> >>>>>
> >>>>> This is the fourth version of this announcement, updating the list of
> >>>>> attendees
> >>>>> and the tentative agenda at the end: please let me know if you see
> >>>>> mistakes.
> >>>>> Note that there is still time for one or two other topics. Also please
> >>>>> check
> >>>>> the agenda if you need more (or perhaps less) time for your topic.
> >>>>>
> >>>>> This year's Media Summit will be held on Tuesday May 26th the day before
> >>>>> the
> >>>>> Embedded Recipes Conference in Nice, France:
> >>>>>
> >>>>> https://embedded-recipes.org/2026/
> >>>>>
> >>>>> The Media Summit will be held at Hotel Campanile and in the same meeting
> >>>>> room
> >>>>> as last year (Nikaia):
> >>>>>
> >>>>> https://nice-aeroport.campanile.com/en-us/
> >>>>>
> >>>>> It is close to the Airport and to the Embedded Recipes venue.
> >>>>>
> >>>>> The meeting room can hold up to 30 people and I will provide video
> >>>>> conferencing support,
> >>>>> just like last year. The location and the meeting room was quite nice last
> >>>>> year, so
> >>>>> I saw no need to change it.
> >>>>>
> >>>>> That said, in-person participation is very much preferred. This yearly
> >>>>> summit is meant
> >>>>> for active media developers to meet face-to-face and to discuss media
> >>>>> subsystem issues.
> >>>>>
> >>>>> And it is also a good opportunity to talk to each other during the
> >>>>> Embedded Recipes
> >>>>> conference to discuss topics in a smaller group. But if you are an active
> >>>>> media developer
> >>>>> and are really not able to attend in person, then remote participation is
> >>>>> an option.
> >>>>>
> >>>>> If you want to attend the meeting (either in person or remote), then send
> >>>>> an email to me
> >>>>> directly. The deadline for in-person attendance is May 14 as the hotel
> >>>>> needs to know the
> >>>>> final number of attendees by then.
> >>>>>
> >>>>> There is no registration fee, the meeting room is sponsored by Cisco and
> >>>>> Collabora, and
> >>>>> the lunch is sponsored by Ideas on Board! Many thanks to our sponsors,
> >>>>> it's very much
> >>>>> appreciated.
> >>>>>
> >>>>> If you have a topic that you want to discuss, just 'Reply All' to this
> >>>>> announcement
> >>>>> and give the topic title, a short description and a guesstimate of the
> >>>>> time you need
> >>>>> for your topic.
> >>>>>
> >>>>> See last year's Media Summit Report as an example of what to expect:
> >>>>>
> >>>>> https://lore.kernel.org/linux-media/21769183-ca57-4f8f-818a-6a1ad089298d@jjverkuil.nl/
> >>>>>
> >>>>> Regards,
> >>>>>
> >>>>>         Hans
> >>>>>
> >>>>> PS: Be aware that May 24 and 25 are public holidays in France. So many
> >>>>> shops may be
> >>>>> closed those days.
> >>>>>
> >>>>> In-person attendees:
> >>>>> Sakari Ailus <sakari.ailus@linux.intel.com>
> >>>>> Kieran Bingham <kieran.bingham@ideasonboard.com>
> >>>>> Brandon Brnich <b-brnich@ti.com>
> >>>>> Rouven Czerwinski <rouven.czerwinski@linaro.org>
> >>>>> Mehdi Djait <mehdi.djait@linux.intel.com>
> >>>>> Bryan O'Donoghue <bryan.odonoghue@linaro.org>
> >>>>> Nicolas Dufresne <nicolas.dufresne@collabora.com>
> >>>>> Marco Felsch <m.felsch@pengutronix.de>
> >>>>> Paul Kocialkowski <paulk@sys-base.io>
> >>>>> Jai Luthra <jai.luthra@ideasonboard.com>
> >>>>> Jacopo Mondi <jacopo.mondi@ideasonboard.com>
> >>>>> Benjamin Mugnier <benjamin.mugnier@foss.st.com>
> >>>>> Beleswar Padhi <b-padhi@ti.com>
> >>>>> Laurent Pinchart <laurent.pinchart@ideasonboard.com>
> >>>>> Loic Poulain <loic.poulain@oss.qualcomm.com>
> >>>>> Sven Püschel <s.pueschel@pengutronix.de>
> >>>>> Ricardo Ribalda <ribalda@chromium.org>
> >>>>> Michael Riesch <michael.riesch@collabora.com>
> >>>>> Devarsh Thakkar <devarsht@ti.com>
> >>>>> Michael Tretter <m.tretter@pengutronix.de>
> >>>>> Hans Verkuil <hverkuil@kernel.org>
> >>>>>
> >>>>> Remote attendees:
> >>>>> Yemike Abhilash Chandra <y-abhilashchandra@ti.com>
> >>>>> Rishikesh Donadkar <r-donadkar@ti.com>
> >>>>> Jackson Lee <jackson.lee@chipsnmedia.com>
> >>>>> Dave Stevenson <dave.stevenson@raspberrypi.com> (tentative)
> >>>>>
> >>>>>
> >>>>> Agenda (tentative):
> >>>>>
> >>>>> 8:45-9:20: Arrive, settle in
> >>>>>
> >>>>> 9:20-9:30: Short intro (Hans Verkuil)
> >>>>>
> >>>>> 9:30-9:45: Status of ISP support in V4L2
> >>>>>         Presenter: Laurent Pinchart
> >>>>>         Description: Summary of ISP-related development in V4L2 since the
> >>>>> last
> >>>>>         Linux Media Summit. This includes a brief overview of technical
> >>>>>         developments, and a summary of the efforts to engage with vendors.
> >>>>>
> >>>>> 9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
> >>>>>         Presenter: Paul Kocialkowski
> >>>>>         Description: An update on the ongonig work to support stateless
> >>>>> codecs in V4L2.
> >>>>>         Some of the remaining open topics will be presented and discussed.
> >>>>>
> >>>>> 10:45-11:00: break
> >>>>>
> >>>>> 11:00-11:30: Vulkan Video Codecs
> >>>>>         Presenter: Nicolas Dufresne
> >>>>>         Description: Vulkan video codecs: what are the viable options for
> >>>>> Linux Media
> >>>>>         and what is in preparation outside of our subsystem. The second
> >>>>> aspect is
> >>>>>         informative as these discussions don't seem to lean toward our
> >>>>> subsystem as the
> >>>>>         foundation. But I think it's rather useful for everyone to
> >>>>> understand why and
> >>>>>         what is included.
> >>>>>
> >>>>> 11:30-12:00: Protected Video playback on i.MX8MQ
> >>>>>         Presenter: Rouven Czerwinski
> >>>>>         Description: Introduction to protected video playback
> >>>>>         on i.MX8MQ and missing bits for linux-media & protected heap
> >>>>> interoperability.
> >>>>>
> >>>>> 12:00-13:30: Lunch
> >>>>>
> >>>>> 13:30-14:00: HDCP support for HDMI receivers
> >>>>>         Presenter: Hans Verkuil
> >>>>>         Description: I have been working on adding HDCP support for HDMI
> >>>>> receivers.
> >>>>>         Specifically the HDCP negotiation between sources and sinks.
> >>>>>
> >>>>> 14:00-14:30: AI patches
> >>>>>         Presenter: Sakari Ailus
> >>>>>         Description: What is our policy w.r.t. AI generated patches?
> >>>>>
> >>>>> 14:30-15:00 Overview of Media CI: where do pipelines run?
> >>>>>         Presenter: Ricardo Ribalda
> >>>>>         Description: How are jobs in pipelines assigned? How does the
> >>>>> infrastructure
> >>>>>         for Media CI work? Are there things that can be tweaked to make it
> >>>>> more
> >>>>>         reliable?
> >>>>>
> >>>>> 15:00-15:15: Break
> >>>>>
> >>>>> 15:15-16:15: Discussion of the media subsystem development process
> >>>>>         Presenter: Hans Verkuil
> >>>>>         Description: Review of the multi-committer model: current status
> >>>>> and next steps.
> >>>>>         Are there any bottlenecks, any ideas for improvements, w.r.t. the
> >>>>> development process?
> >>>>>
> >>>>> As you can see, there is still some available time for other topics.
> >
>

Re: [ANNv4] Media Summit on May 26th in Nice, France

[Michael Riesch]

Hi all,

On 4/14/26 08:55, Ricardo Ribalda wrote:
> Hi
> 
> On Tue, 14 Apr 2026 at 08:47, Hans Verkuil <hverkuil+cisco@kernel.org> wrote:
>>
>> On 13/04/2026 23:16, Laurent Pinchart wrote:
>>> On Mon, Apr 13, 2026 at 04:25:54PM -0400, Nicolas Dufresne wrote:
>>>> Le lundi 13 avril 2026 à 23:19 +0300, Laurent Pinchart a écrit :
>>>>> On Mon, Apr 13, 2026 at 10:03:52PM +0200, Loic Poulain wrote:
>>>>>> Hi Hans,
>>>>>>
>>>>>> I would be happy to discuss this if a slot is available:
>>>>>>
>>>>>> Title: Generic V4L2 ISP M2M framework
>>>>>> Presenter: Loic Poulain
>>>>>> Time estimate: ~20min
>>>>>> Description: During early development of a Qualcomm Offline Image
>>>>>> Processing Engine (OPE), we relied on the V4L2 memory‑to‑memory
>>>>>> (v4l2‑m2m) framework, which is widely used and provides solid support
>>>>>> for buffer management and scheduling. However, applying it to an ISP
>>>>>> use case exposes limitations: ISP engines often require a richer media
>>>>>> graph, with multiple pads and metadata flows, similar to inline ISP
>>>>>> pipelines (params, stats, outputs). This talk proposes discussing the
>>>>>> need for and design of a common V4L2 ISP M2M framework to factor out
>>>>>> shared functionality across drivers, particularly around buffer/queue
>>>>>> management and job scheduling.

It seems that we share some pain points.. :-) :-/

Over the last year, some ideas have been brewing in my mind. Not
necessarily *my* ideas, mind you, rather ideas that have been around in
linux-media for quite a while, actually. What I would like to prepare
for the Media Summit goes along the same lines.

>>>>> That's well aligned with the v4l2-isp framework that Jacopo started, and
>>>>> to the multi-context and media-jobs APIs that we have proposed. I
>>>>> wonder, however, if a short session at the media summit will be enough,
>>>>> or if we should try to organize a half day brainstorming workshop at
>>>>> some point. Depending on when the people interested in this topic plan
>>>>> to arrive, Monday could be an option.
>>>>
>>>> I'm also/still interested in the multi-context for m2m decoders that have inline
>>>> post-processing capabilities (current model forces us to waste a lot of RAM). We
>>>> just restarted some design discussion with the team, with an increased
>>>> confidence that multi-context is the way. The scheduler could come handy in the
>>>> future if we get to deal with more multi-stage codecs in the future. I'll be in
>>>> Nice all day Monday.
>>>
>>> I will unfortunately be available only until 15:00 on Monday, but Jacopo
>>> should be available through the day. Let's see who would be interested
>>> and available, and try to organize something.
>>
>> I'm available on Monday as well. I think this is a topic that is well suited
>> to a brainstorm session.
> 
> I am also available on Monday and would like to attend the session.

I'd be interested too. Right now the plan is to arrive on Monday
afternoon. Depending on what time you agree on it may work out anyway.
It would be great to know the exact time this session will start (as I
might need to adjust my travel arrangements).

> 
> Regards!
> 
>>
>> The agenda for the media summit is getting quite full, and I agree with Laurent
>> that 20 minutes is likely not enough. If we can so a session on Monday instead,
>> then that would be a good solution.

Apart from the time and date the scope of this session would be interesting.

Will this be a birds of a feather session in which the next generation
kernel ISP framework will be discussed? Or even the next generation
kernel video processing framework, where video processing is image
signal processing, encoding/decoding, 2D graphics processing (fisheye
correction units, 2D GPU such as the Rockchip RGA3, ...)?

>>
>> I have never been very enthusiastic about the m2m framework: it's fine for e.g.
>> simple scalers, but it's awkward to use for codecs let alone ISPs.
>>
>> I always felt that we really need variants of the m2m framework that are customized
>> to specific use-cases: i.e. a codec m2m framework, and (perhaps) an ISP m2m framework.
>>
>> The big problem with that is of course who will do the work. Making new frameworks
>> is difficult and takes a long time.

This may be naive and overly optimistic, but I feel there is quite a
number of people sharing the same pain points (which are similar to
those Loic pointed out). Maybe (hopefully) this birds of a feather
session leads to the formation of some work group?

Best regards,
Michael


>>
>> Regards,
>>
>>         Hans
>>
>>>
>>>>>> On Sun, Apr 12, 2026 at 12:25 PM Hans Verkuil wrote:
>>>>>>>
>>>>>>> (Please pass this on to anyone you think might be interested in this!)
>>>>>>>
>>>>>>> Hi all,
>>>>>>>
>>>>>>> This is the fourth version of this announcement, updating the list of
>>>>>>> attendees
>>>>>>> and the tentative agenda at the end: please let me know if you see
>>>>>>> mistakes.
>>>>>>> Note that there is still time for one or two other topics. Also please
>>>>>>> check
>>>>>>> the agenda if you need more (or perhaps less) time for your topic.
>>>>>>>
>>>>>>> This year's Media Summit will be held on Tuesday May 26th the day before
>>>>>>> the
>>>>>>> Embedded Recipes Conference in Nice, France:
>>>>>>>
>>>>>>> https://embedded-recipes.org/2026/
>>>>>>>
>>>>>>> The Media Summit will be held at Hotel Campanile and in the same meeting
>>>>>>> room
>>>>>>> as last year (Nikaia):
>>>>>>>
>>>>>>> https://nice-aeroport.campanile.com/en-us/
>>>>>>>
>>>>>>> It is close to the Airport and to the Embedded Recipes venue.
>>>>>>>
>>>>>>> The meeting room can hold up to 30 people and I will provide video
>>>>>>> conferencing support,
>>>>>>> just like last year. The location and the meeting room was quite nice last
>>>>>>> year, so
>>>>>>> I saw no need to change it.
>>>>>>>
>>>>>>> That said, in-person participation is very much preferred. This yearly
>>>>>>> summit is meant
>>>>>>> for active media developers to meet face-to-face and to discuss media
>>>>>>> subsystem issues.
>>>>>>>
>>>>>>> And it is also a good opportunity to talk to each other during the
>>>>>>> Embedded Recipes
>>>>>>> conference to discuss topics in a smaller group. But if you are an active
>>>>>>> media developer
>>>>>>> and are really not able to attend in person, then remote participation is
>>>>>>> an option.
>>>>>>>
>>>>>>> If you want to attend the meeting (either in person or remote), then send
>>>>>>> an email to me
>>>>>>> directly. The deadline for in-person attendance is May 14 as the hotel
>>>>>>> needs to know the
>>>>>>> final number of attendees by then.
>>>>>>>
>>>>>>> There is no registration fee, the meeting room is sponsored by Cisco and
>>>>>>> Collabora, and
>>>>>>> the lunch is sponsored by Ideas on Board! Many thanks to our sponsors,
>>>>>>> it's very much
>>>>>>> appreciated.
>>>>>>>
>>>>>>> If you have a topic that you want to discuss, just 'Reply All' to this
>>>>>>> announcement
>>>>>>> and give the topic title, a short description and a guesstimate of the
>>>>>>> time you need
>>>>>>> for your topic.
>>>>>>>
>>>>>>> See last year's Media Summit Report as an example of what to expect:
>>>>>>>
>>>>>>> https://lore.kernel.org/linux-media/21769183-ca57-4f8f-818a-6a1ad089298d@jjverkuil.nl/
>>>>>>>
>>>>>>> Regards,
>>>>>>>
>>>>>>>         Hans
>>>>>>>
>>>>>>> PS: Be aware that May 24 and 25 are public holidays in France. So many
>>>>>>> shops may be
>>>>>>> closed those days.
>>>>>>>
>>>>>>> In-person attendees:
>>>>>>> Sakari Ailus <sakari.ailus@linux.intel.com>
>>>>>>> Kieran Bingham <kieran.bingham@ideasonboard.com>
>>>>>>> Brandon Brnich <b-brnich@ti.com>
>>>>>>> Rouven Czerwinski <rouven.czerwinski@linaro.org>
>>>>>>> Mehdi Djait <mehdi.djait@linux.intel.com>
>>>>>>> Bryan O'Donoghue <bryan.odonoghue@linaro.org>
>>>>>>> Nicolas Dufresne <nicolas.dufresne@collabora.com>
>>>>>>> Marco Felsch <m.felsch@pengutronix.de>
>>>>>>> Paul Kocialkowski <paulk@sys-base.io>
>>>>>>> Jai Luthra <jai.luthra@ideasonboard.com>
>>>>>>> Jacopo Mondi <jacopo.mondi@ideasonboard.com>
>>>>>>> Benjamin Mugnier <benjamin.mugnier@foss.st.com>
>>>>>>> Beleswar Padhi <b-padhi@ti.com>
>>>>>>> Laurent Pinchart <laurent.pinchart@ideasonboard.com>
>>>>>>> Loic Poulain <loic.poulain@oss.qualcomm.com>
>>>>>>> Sven Püschel <s.pueschel@pengutronix.de>
>>>>>>> Ricardo Ribalda <ribalda@chromium.org>
>>>>>>> Michael Riesch <michael.riesch@collabora.com>
>>>>>>> Devarsh Thakkar <devarsht@ti.com>
>>>>>>> Michael Tretter <m.tretter@pengutronix.de>
>>>>>>> Hans Verkuil <hverkuil@kernel.org>
>>>>>>>
>>>>>>> Remote attendees:
>>>>>>> Yemike Abhilash Chandra <y-abhilashchandra@ti.com>
>>>>>>> Rishikesh Donadkar <r-donadkar@ti.com>
>>>>>>> Jackson Lee <jackson.lee@chipsnmedia.com>
>>>>>>> Dave Stevenson <dave.stevenson@raspberrypi.com> (tentative)
>>>>>>>
>>>>>>>
>>>>>>> Agenda (tentative):
>>>>>>>
>>>>>>> 8:45-9:20: Arrive, settle in
>>>>>>>
>>>>>>> 9:20-9:30: Short intro (Hans Verkuil)
>>>>>>>
>>>>>>> 9:30-9:45: Status of ISP support in V4L2
>>>>>>>         Presenter: Laurent Pinchart
>>>>>>>         Description: Summary of ISP-related development in V4L2 since the
>>>>>>> last
>>>>>>>         Linux Media Summit. This includes a brief overview of technical
>>>>>>>         developments, and a summary of the efforts to engage with vendors.
>>>>>>>
>>>>>>> 9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
>>>>>>>         Presenter: Paul Kocialkowski
>>>>>>>         Description: An update on the ongonig work to support stateless
>>>>>>> codecs in V4L2.
>>>>>>>         Some of the remaining open topics will be presented and discussed.
>>>>>>>
>>>>>>> 10:45-11:00: break
>>>>>>>
>>>>>>> 11:00-11:30: Vulkan Video Codecs
>>>>>>>         Presenter: Nicolas Dufresne
>>>>>>>         Description: Vulkan video codecs: what are the viable options for
>>>>>>> Linux Media
>>>>>>>         and what is in preparation outside of our subsystem. The second
>>>>>>> aspect is
>>>>>>>         informative as these discussions don't seem to lean toward our
>>>>>>> subsystem as the
>>>>>>>         foundation. But I think it's rather useful for everyone to
>>>>>>> understand why and
>>>>>>>         what is included.
>>>>>>>
>>>>>>> 11:30-12:00: Protected Video playback on i.MX8MQ
>>>>>>>         Presenter: Rouven Czerwinski
>>>>>>>         Description: Introduction to protected video playback
>>>>>>>         on i.MX8MQ and missing bits for linux-media & protected heap
>>>>>>> interoperability.
>>>>>>>
>>>>>>> 12:00-13:30: Lunch
>>>>>>>
>>>>>>> 13:30-14:00: HDCP support for HDMI receivers
>>>>>>>         Presenter: Hans Verkuil
>>>>>>>         Description: I have been working on adding HDCP support for HDMI
>>>>>>> receivers.
>>>>>>>         Specifically the HDCP negotiation between sources and sinks.
>>>>>>>
>>>>>>> 14:00-14:30: AI patches
>>>>>>>         Presenter: Sakari Ailus
>>>>>>>         Description: What is our policy w.r.t. AI generated patches?
>>>>>>>
>>>>>>> 14:30-15:00 Overview of Media CI: where do pipelines run?
>>>>>>>         Presenter: Ricardo Ribalda
>>>>>>>         Description: How are jobs in pipelines assigned? How does the
>>>>>>> infrastructure
>>>>>>>         for Media CI work? Are there things that can be tweaked to make it
>>>>>>> more
>>>>>>>         reliable?
>>>>>>>
>>>>>>> 15:00-15:15: Break
>>>>>>>
>>>>>>> 15:15-16:15: Discussion of the media subsystem development process
>>>>>>>         Presenter: Hans Verkuil
>>>>>>>         Description: Review of the multi-committer model: current status
>>>>>>> and next steps.
>>>>>>>         Are there any bottlenecks, any ideas for improvements, w.r.t. the
>>>>>>> development process?
>>>>>>>
>>>>>>> As you can see, there is still some available time for other topics.
>>>
>>
> 
> 

Re: [ANNv4] Media Summit on May 26th in Nice, France

[Laurent Pinchart]

On Tue, Apr 14, 2026 at 09:20:56AM +0200, Michael Riesch wrote:
> On 4/14/26 08:55, Ricardo Ribalda wrote:
> > On Tue, 14 Apr 2026 at 08:47, Hans Verkuil <hverkuil+cisco@kernel.org> wrote:
> >> On 13/04/2026 23:16, Laurent Pinchart wrote:
> >>> On Mon, Apr 13, 2026 at 04:25:54PM -0400, Nicolas Dufresne wrote:
> >>>> Le lundi 13 avril 2026 à 23:19 +0300, Laurent Pinchart a écrit :
> >>>>> On Mon, Apr 13, 2026 at 10:03:52PM +0200, Loic Poulain wrote:
> >>>>>> Hi Hans,
> >>>>>>
> >>>>>> I would be happy to discuss this if a slot is available:
> >>>>>>
> >>>>>> Title: Generic V4L2 ISP M2M framework
> >>>>>> Presenter: Loic Poulain
> >>>>>> Time estimate: ~20min
> >>>>>> Description: During early development of a Qualcomm Offline Image
> >>>>>> Processing Engine (OPE), we relied on the V4L2 memory‑to‑memory
> >>>>>> (v4l2‑m2m) framework, which is widely used and provides solid support
> >>>>>> for buffer management and scheduling. However, applying it to an ISP
> >>>>>> use case exposes limitations: ISP engines often require a richer media
> >>>>>> graph, with multiple pads and metadata flows, similar to inline ISP
> >>>>>> pipelines (params, stats, outputs). This talk proposes discussing the
> >>>>>> need for and design of a common V4L2 ISP M2M framework to factor out
> >>>>>> shared functionality across drivers, particularly around buffer/queue
> >>>>>> management and job scheduling.
> 
> It seems that we share some pain points.. :-) :-/
> 
> Over the last year, some ideas have been brewing in my mind. Not
> necessarily *my* ideas, mind you, rather ideas that have been around in
> linux-media for quite a while, actually. What I would like to prepare
> for the Media Summit goes along the same lines.
> 
> >>>>> That's well aligned with the v4l2-isp framework that Jacopo started, and
> >>>>> to the multi-context and media-jobs APIs that we have proposed. I
> >>>>> wonder, however, if a short session at the media summit will be enough,
> >>>>> or if we should try to organize a half day brainstorming workshop at
> >>>>> some point. Depending on when the people interested in this topic plan
> >>>>> to arrive, Monday could be an option.
> >>>>
> >>>> I'm also/still interested in the multi-context for m2m decoders that have inline
> >>>> post-processing capabilities (current model forces us to waste a lot of RAM). We
> >>>> just restarted some design discussion with the team, with an increased
> >>>> confidence that multi-context is the way. The scheduler could come handy in the
> >>>> future if we get to deal with more multi-stage codecs in the future. I'll be in
> >>>> Nice all day Monday.
> >>>
> >>> I will unfortunately be available only until 15:00 on Monday, but Jacopo
> >>> should be available through the day. Let's see who would be interested
> >>> and available, and try to organize something.
> >>
> >> I'm available on Monday as well. I think this is a topic that is well suited
> >> to a brainstorm session.
> > 
> > I am also available on Monday and would like to attend the session.
> 
> I'd be interested too. Right now the plan is to arrive on Monday
> afternoon. Depending on what time you agree on it may work out anyway.
> It would be great to know the exact time this session will start (as I
> might need to adjust my travel arrangements).

We need a volunteer to organize this, as in finding and booking a
meeting space. Note that Monday is a public holiday in France (Monday
the 25th of May in particular, not all Mondays).

If the number of attendees was small I was thinking of hosting the event
in the place where the Ideas on Board team will be staying, but it looks
like we're already reaching a fair number of people.

> > Regards!
> > 
> >> The agenda for the media summit is getting quite full, and I agree with Laurent
> >> that 20 minutes is likely not enough. If we can so a session on Monday instead,
> >> then that would be a good solution.
> 
> Apart from the time and date the scope of this session would be interesting.
> 
> Will this be a birds of a feather session in which the next generation
> kernel ISP framework will be discussed? Or even the next generation
> kernel video processing framework, where video processing is image
> signal processing, encoding/decoding, 2D graphics processing (fisheye
> correction units, 2D GPU such as the Rockchip RGA3, ...)?

I would focus on Loic's original scope. If the solution can be used for
other devices that's great too. I believe that the current multi-context
patch series is a good fit for codecs. If we broaden the scope too much
right away we'll achieve nothing.

> >> I have never been very enthusiastic about the m2m framework: it's fine for e.g.
> >> simple scalers, but it's awkward to use for codecs let alone ISPs.
> >>
> >> I always felt that we really need variants of the m2m framework that are customized
> >> to specific use-cases: i.e. a codec m2m framework, and (perhaps) an ISP m2m framework.
> >>
> >> The big problem with that is of course who will do the work. Making new frameworks
> >> is difficult and takes a long time.
> 
> This may be naive and overly optimistic, but I feel there is quite a
> number of people sharing the same pain points (which are similar to
> those Loic pointed out). Maybe (hopefully) this birds of a feather
> session leads to the formation of some work group?
> 
> >>>>>> On Sun, Apr 12, 2026 at 12:25 PM Hans Verkuil wrote:
> >>>>>>>
> >>>>>>> (Please pass this on to anyone you think might be interested in this!)
> >>>>>>>
> >>>>>>> Hi all,
> >>>>>>>
> >>>>>>> This is the fourth version of this announcement, updating the list of attendees
> >>>>>>> and the tentative agenda at the end: please let me know if you see mistakes.
> >>>>>>> Note that there is still time for one or two other topics. Also please check
> >>>>>>> the agenda if you need more (or perhaps less) time for your topic.
> >>>>>>>
> >>>>>>> This year's Media Summit will be held on Tuesday May 26th the day before the
> >>>>>>> Embedded Recipes Conference in Nice, France:
> >>>>>>>
> >>>>>>> https://embedded-recipes.org/2026/
> >>>>>>>
> >>>>>>> The Media Summit will be held at Hotel Campanile and in the same meeting room
> >>>>>>> as last year (Nikaia):
> >>>>>>>
> >>>>>>> https://nice-aeroport.campanile.com/en-us/
> >>>>>>>
> >>>>>>> It is close to the Airport and to the Embedded Recipes venue.
> >>>>>>>
> >>>>>>> The meeting room can hold up to 30 people and I will provide video conferencing support,
> >>>>>>> just like last year. The location and the meeting room was quite nice last year, so
> >>>>>>> I saw no need to change it.
> >>>>>>>
> >>>>>>> That said, in-person participation is very much preferred. This yearly summit is meant
> >>>>>>> for active media developers to meet face-to-face and to discuss media subsystem issues.
> >>>>>>>
> >>>>>>> And it is also a good opportunity to talk to each other during the Embedded Recipes
> >>>>>>> conference to discuss topics in a smaller group. But if you are an active media developer
> >>>>>>> and are really not able to attend in person, then remote participation is an option.
> >>>>>>>
> >>>>>>> If you want to attend the meeting (either in person or remote), then send an email to me
> >>>>>>> directly. The deadline for in-person attendance is May 14 as the hotel needs to know the
> >>>>>>> final number of attendees by then.
> >>>>>>>
> >>>>>>> There is no registration fee, the meeting room is sponsored by Cisco and Collabora, and
> >>>>>>> the lunch is sponsored by Ideas on Board! Many thanks to our sponsors, it's very much
> >>>>>>> appreciated.
> >>>>>>>
> >>>>>>> If you have a topic that you want to discuss, just 'Reply All' to this announcement
> >>>>>>> and give the topic title, a short description and a guesstimate of the time you need
> >>>>>>> for your topic.
> >>>>>>>
> >>>>>>> See last year's Media Summit Report as an example of what to expect:
> >>>>>>>
> >>>>>>> https://lore.kernel.org/linux-media/21769183-ca57-4f8f-818a-6a1ad089298d@jjverkuil.nl/
> >>>>>>>
> >>>>>>> Regards,
> >>>>>>>
> >>>>>>>         Hans
> >>>>>>>
> >>>>>>> PS: Be aware that May 24 and 25 are public holidays in France. So many
> >>>>>>> shops may be
> >>>>>>> closed those days.
> >>>>>>>
> >>>>>>> In-person attendees:
> >>>>>>> Sakari Ailus <sakari.ailus@linux.intel.com>
> >>>>>>> Kieran Bingham <kieran.bingham@ideasonboard.com>
> >>>>>>> Brandon Brnich <b-brnich@ti.com>
> >>>>>>> Rouven Czerwinski <rouven.czerwinski@linaro.org>
> >>>>>>> Mehdi Djait <mehdi.djait@linux.intel.com>
> >>>>>>> Bryan O'Donoghue <bryan.odonoghue@linaro.org>
> >>>>>>> Nicolas Dufresne <nicolas.dufresne@collabora.com>
> >>>>>>> Marco Felsch <m.felsch@pengutronix.de>
> >>>>>>> Paul Kocialkowski <paulk@sys-base.io>
> >>>>>>> Jai Luthra <jai.luthra@ideasonboard.com>
> >>>>>>> Jacopo Mondi <jacopo.mondi@ideasonboard.com>
> >>>>>>> Benjamin Mugnier <benjamin.mugnier@foss.st.com>
> >>>>>>> Beleswar Padhi <b-padhi@ti.com>
> >>>>>>> Laurent Pinchart <laurent.pinchart@ideasonboard.com>
> >>>>>>> Loic Poulain <loic.poulain@oss.qualcomm.com>
> >>>>>>> Sven Püschel <s.pueschel@pengutronix.de>
> >>>>>>> Ricardo Ribalda <ribalda@chromium.org>
> >>>>>>> Michael Riesch <michael.riesch@collabora.com>
> >>>>>>> Devarsh Thakkar <devarsht@ti.com>
> >>>>>>> Michael Tretter <m.tretter@pengutronix.de>
> >>>>>>> Hans Verkuil <hverkuil@kernel.org>
> >>>>>>>
> >>>>>>> Remote attendees:
> >>>>>>> Yemike Abhilash Chandra <y-abhilashchandra@ti.com>
> >>>>>>> Rishikesh Donadkar <r-donadkar@ti.com>
> >>>>>>> Jackson Lee <jackson.lee@chipsnmedia.com>
> >>>>>>> Dave Stevenson <dave.stevenson@raspberrypi.com> (tentative)
> >>>>>>>
> >>>>>>>
> >>>>>>> Agenda (tentative):
> >>>>>>>
> >>>>>>> 8:45-9:20: Arrive, settle in
> >>>>>>>
> >>>>>>> 9:20-9:30: Short intro (Hans Verkuil)
> >>>>>>>
> >>>>>>> 9:30-9:45: Status of ISP support in V4L2
> >>>>>>>         Presenter: Laurent Pinchart
> >>>>>>>         Description: Summary of ISP-related development in V4L2 since the last
> >>>>>>>         Linux Media Summit. This includes a brief overview of technical
> >>>>>>>         developments, and a summary of the efforts to engage with vendors.
> >>>>>>>
> >>>>>>> 9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
> >>>>>>>         Presenter: Paul Kocialkowski
> >>>>>>>         Description: An update on the ongonig work to support stateless codecs in V4L2.
> >>>>>>>         Some of the remaining open topics will be presented and discussed.
> >>>>>>>
> >>>>>>> 10:45-11:00: break
> >>>>>>>
> >>>>>>> 11:00-11:30: Vulkan Video Codecs
> >>>>>>>         Presenter: Nicolas Dufresne
> >>>>>>>         Description: Vulkan video codecs: what are the viable options for Linux Media
> >>>>>>>         and what is in preparation outside of our subsystem. The second aspect is
> >>>>>>>         informative as these discussions don't seem to lean toward our subsystem as the
> >>>>>>>         foundation. But I think it's rather useful for everyone to understand why and
> >>>>>>>         what is included.
> >>>>>>>
> >>>>>>> 11:30-12:00: Protected Video playback on i.MX8MQ
> >>>>>>>         Presenter: Rouven Czerwinski
> >>>>>>>         Description: Introduction to protected video playback
> >>>>>>>         on i.MX8MQ and missing bits for linux-media & protected heap interoperability.
> >>>>>>>
> >>>>>>> 12:00-13:30: Lunch
> >>>>>>>
> >>>>>>> 13:30-14:00: HDCP support for HDMI receivers
> >>>>>>>         Presenter: Hans Verkuil
> >>>>>>>         Description: I have been working on adding HDCP support for HDMI receivers.
> >>>>>>>         Specifically the HDCP negotiation between sources and sinks.
> >>>>>>>
> >>>>>>> 14:00-14:30: AI patches
> >>>>>>>         Presenter: Sakari Ailus
> >>>>>>>         Description: What is our policy w.r.t. AI generated patches?
> >>>>>>>
> >>>>>>> 14:30-15:00 Overview of Media CI: where do pipelines run?
> >>>>>>>         Presenter: Ricardo Ribalda
> >>>>>>>         Description: How are jobs in pipelines assigned? How does the infrastructure
> >>>>>>>         for Media CI work? Are there things that can be tweaked to make it more
> >>>>>>>         reliable?
> >>>>>>>
> >>>>>>> 15:00-15:15: Break
> >>>>>>>
> >>>>>>> 15:15-16:15: Discussion of the media subsystem development process
> >>>>>>>         Presenter: Hans Verkuil
> >>>>>>>         Description: Review of the multi-committer model: current status and next steps.
> >>>>>>>         Are there any bottlenecks, any ideas for improvements, w.r.t. the development process?
> >>>>>>>
> >>>>>>> As you can see, there is still some available time for other topics.

-- 
Regards,

Laurent Pinchart

Re: [ANNv4] Media Summit on May 26th in Nice, France

[Loic Poulain]

On Tue, Apr 14, 2026 at 9:42 AM Laurent Pinchart
<laurent.pinchart@ideasonboard.com> wrote:
>
> On Tue, Apr 14, 2026 at 09:20:56AM +0200, Michael Riesch wrote:
> > On 4/14/26 08:55, Ricardo Ribalda wrote:
> > > On Tue, 14 Apr 2026 at 08:47, Hans Verkuil <hverkuil+cisco@kernel.org> wrote:
> > >> On 13/04/2026 23:16, Laurent Pinchart wrote:
> > >>> On Mon, Apr 13, 2026 at 04:25:54PM -0400, Nicolas Dufresne wrote:
> > >>>> Le lundi 13 avril 2026 à 23:19 +0300, Laurent Pinchart a écrit :
> > >>>>> On Mon, Apr 13, 2026 at 10:03:52PM +0200, Loic Poulain wrote:
> > >>>>>> Hi Hans,
> > >>>>>>
> > >>>>>> I would be happy to discuss this if a slot is available:
> > >>>>>>
> > >>>>>> Title: Generic V4L2 ISP M2M framework
> > >>>>>> Presenter: Loic Poulain
> > >>>>>> Time estimate: ~20min
> > >>>>>> Description: During early development of a Qualcomm Offline Image
> > >>>>>> Processing Engine (OPE), we relied on the V4L2 memory‑to‑memory
> > >>>>>> (v4l2‑m2m) framework, which is widely used and provides solid support
> > >>>>>> for buffer management and scheduling. However, applying it to an ISP
> > >>>>>> use case exposes limitations: ISP engines often require a richer media
> > >>>>>> graph, with multiple pads and metadata flows, similar to inline ISP
> > >>>>>> pipelines (params, stats, outputs). This talk proposes discussing the
> > >>>>>> need for and design of a common V4L2 ISP M2M framework to factor out
> > >>>>>> shared functionality across drivers, particularly around buffer/queue
> > >>>>>> management and job scheduling.
> >
> > It seems that we share some pain points.. :-) :-/
> >
> > Over the last year, some ideas have been brewing in my mind. Not
> > necessarily *my* ideas, mind you, rather ideas that have been around in
> > linux-media for quite a while, actually. What I would like to prepare
> > for the Media Summit goes along the same lines.
> >
> > >>>>> That's well aligned with the v4l2-isp framework that Jacopo started, and
> > >>>>> to the multi-context and media-jobs APIs that we have proposed. I
> > >>>>> wonder, however, if a short session at the media summit will be enough,
> > >>>>> or if we should try to organize a half day brainstorming workshop at
> > >>>>> some point. Depending on when the people interested in this topic plan
> > >>>>> to arrive, Monday could be an option.
> > >>>>
> > >>>> I'm also/still interested in the multi-context for m2m decoders that have inline
> > >>>> post-processing capabilities (current model forces us to waste a lot of RAM). We
> > >>>> just restarted some design discussion with the team, with an increased
> > >>>> confidence that multi-context is the way. The scheduler could come handy in the
> > >>>> future if we get to deal with more multi-stage codecs in the future. I'll be in
> > >>>> Nice all day Monday.
> > >>>
> > >>> I will unfortunately be available only until 15:00 on Monday, but Jacopo
> > >>> should be available through the day. Let's see who would be interested
> > >>> and available, and try to organize something.
> > >>
> > >> I'm available on Monday as well. I think this is a topic that is well suited
> > >> to a brainstorm session.
> > >
> > > I am also available on Monday and would like to attend the session.
> >
> > I'd be interested too. Right now the plan is to arrive on Monday
> > afternoon. Depending on what time you agree on it may work out anyway.
> > It would be great to know the exact time this session will start (as I
> > might need to adjust my travel arrangements).

I can arrive on Monday, with a preference for the afternoon.

>
> We need a volunteer to organize this, as in finding and booking a
> meeting space. Note that Monday is a public holiday in France (Monday
> the 25th of May in particular, not all Mondays).
>
> If the number of attendees was small I was thinking of hosting the event
> in the place where the Ideas on Board team will be staying, but it looks
> like we're already reaching a fair number of people.
>
> > > Regards!
> > >
> > >> The agenda for the media summit is getting quite full, and I agree with Laurent
> > >> that 20 minutes is likely not enough. If we can so a session on Monday instead,
> > >> then that would be a good solution.
> >
> > Apart from the time and date the scope of this session would be interesting.
> >
> > Will this be a birds of a feather session in which the next generation
> > kernel ISP framework will be discussed? Or even the next generation
> > kernel video processing framework, where video processing is image
> > signal processing, encoding/decoding, 2D graphics processing (fisheye
> > correction units, 2D GPU such as the Rockchip RGA3, ...)?
>
> I would focus on Loic's original scope. If the solution can be used for
> other devices that's great too. I believe that the current multi-context
> patch series is a good fit for codecs. If we broaden the scope too much
> right away we'll achieve nothing.
>
> > >> I have never been very enthusiastic about the m2m framework: it's fine for e.g.
> > >> simple scalers, but it's awkward to use for codecs let alone ISPs.
> > >>
> > >> I always felt that we really need variants of the m2m framework that are customized
> > >> to specific use-cases: i.e. a codec m2m framework, and (perhaps) an ISP m2m framework.
> > >>
> > >> The big problem with that is of course who will do the work. Making new frameworks
> > >> is difficult and takes a long time.

A couple of weeks ago, I submitted an initial driver for a Qualcomm
Offline ISP based on the standard v4l2-m2m framework. Following
discussions around which parts could be generalized, I started
migrating this work to a new v4l2-isp-m2m framework:
(https://github.com/loicpoulain/linux/commit/5d575d7eff8f2371e91d8237148ffdb44b0af5b0).

The API and overall logic closely mirror v4l2-m2m.c, but are extended
to address ISP‑specific requirements such as multi‑device support and
multiple queue handling. I am planning to submit this work as an RFC
before the Media Summit. At this stage, the framework is still fairly
basic and primarily tailored to the Qualcomm use case. There is
definitely room for improvement, for example, integrating Jacopo’s
multi‑context support, since for now, the Qualcomm driver simply
instantiates a single ISP‑M2M context.

As I am still getting familiar with the media subsystem, this work may
overlap with or conflict with ongoing efforts. Synchronizing seems
indeed important. Based on my current understanding, there are several
related areas of work that appear either complementary or orthogonal:
- Multi‑context support, to instantiate multiple processing sessions
on shared hardware/driver.
- Media jobs, to synchronize work across multiple drivers within the
same media pipeline.
- ISP M2M, aiming to provide a v4l2-m2m‑like framework specifically
for memory‑to‑memory ISP devices.

> >
> > This may be naive and overly optimistic, but I feel there is quite a
> > number of people sharing the same pain points (which are similar to
> > those Loic pointed out). Maybe (hopefully) this birds of a feather
> > session leads to the formation of some work group?
> >
> > >>>>>> On Sun, Apr 12, 2026 at 12:25 PM Hans Verkuil wrote:
> > >>>>>>>
> > >>>>>>> (Please pass this on to anyone you think might be interested in this!)
> > >>>>>>>
> > >>>>>>> Hi all,
> > >>>>>>>
> > >>>>>>> This is the fourth version of this announcement, updating the list of attendees
> > >>>>>>> and the tentative agenda at the end: please let me know if you see mistakes.
> > >>>>>>> Note that there is still time for one or two other topics. Also please check
> > >>>>>>> the agenda if you need more (or perhaps less) time for your topic.
> > >>>>>>>
> > >>>>>>> This year's Media Summit will be held on Tuesday May 26th the day before the
> > >>>>>>> Embedded Recipes Conference in Nice, France:
> > >>>>>>>
> > >>>>>>> https://embedded-recipes.org/2026/
> > >>>>>>>
> > >>>>>>> The Media Summit will be held at Hotel Campanile and in the same meeting room
> > >>>>>>> as last year (Nikaia):
> > >>>>>>>
> > >>>>>>> https://nice-aeroport.campanile.com/en-us/
> > >>>>>>>
> > >>>>>>> It is close to the Airport and to the Embedded Recipes venue.
> > >>>>>>>
> > >>>>>>> The meeting room can hold up to 30 people and I will provide video conferencing support,
> > >>>>>>> just like last year. The location and the meeting room was quite nice last year, so
> > >>>>>>> I saw no need to change it.
> > >>>>>>>
> > >>>>>>> That said, in-person participation is very much preferred. This yearly summit is meant
> > >>>>>>> for active media developers to meet face-to-face and to discuss media subsystem issues.
> > >>>>>>>
> > >>>>>>> And it is also a good opportunity to talk to each other during the Embedded Recipes
> > >>>>>>> conference to discuss topics in a smaller group. But if you are an active media developer
> > >>>>>>> and are really not able to attend in person, then remote participation is an option.
> > >>>>>>>
> > >>>>>>> If you want to attend the meeting (either in person or remote), then send an email to me
> > >>>>>>> directly. The deadline for in-person attendance is May 14 as the hotel needs to know the
> > >>>>>>> final number of attendees by then.
> > >>>>>>>
> > >>>>>>> There is no registration fee, the meeting room is sponsored by Cisco and Collabora, and
> > >>>>>>> the lunch is sponsored by Ideas on Board! Many thanks to our sponsors, it's very much
> > >>>>>>> appreciated.
> > >>>>>>>
> > >>>>>>> If you have a topic that you want to discuss, just 'Reply All' to this announcement
> > >>>>>>> and give the topic title, a short description and a guesstimate of the time you need
> > >>>>>>> for your topic.
> > >>>>>>>
> > >>>>>>> See last year's Media Summit Report as an example of what to expect:
> > >>>>>>>
> > >>>>>>> https://lore.kernel.org/linux-media/21769183-ca57-4f8f-818a-6a1ad089298d@jjverkuil.nl/
> > >>>>>>>
> > >>>>>>> Regards,
> > >>>>>>>
> > >>>>>>>         Hans
> > >>>>>>>
> > >>>>>>> PS: Be aware that May 24 and 25 are public holidays in France. So many
> > >>>>>>> shops may be
> > >>>>>>> closed those days.
> > >>>>>>>
> > >>>>>>> In-person attendees:
> > >>>>>>> Sakari Ailus <sakari.ailus@linux.intel.com>
> > >>>>>>> Kieran Bingham <kieran.bingham@ideasonboard.com>
> > >>>>>>> Brandon Brnich <b-brnich@ti.com>
> > >>>>>>> Rouven Czerwinski <rouven.czerwinski@linaro.org>
> > >>>>>>> Mehdi Djait <mehdi.djait@linux.intel.com>
> > >>>>>>> Bryan O'Donoghue <bryan.odonoghue@linaro.org>
> > >>>>>>> Nicolas Dufresne <nicolas.dufresne@collabora.com>
> > >>>>>>> Marco Felsch <m.felsch@pengutronix.de>
> > >>>>>>> Paul Kocialkowski <paulk@sys-base.io>
> > >>>>>>> Jai Luthra <jai.luthra@ideasonboard.com>
> > >>>>>>> Jacopo Mondi <jacopo.mondi@ideasonboard.com>
> > >>>>>>> Benjamin Mugnier <benjamin.mugnier@foss.st.com>
> > >>>>>>> Beleswar Padhi <b-padhi@ti.com>
> > >>>>>>> Laurent Pinchart <laurent.pinchart@ideasonboard.com>
> > >>>>>>> Loic Poulain <loic.poulain@oss.qualcomm.com>
> > >>>>>>> Sven Püschel <s.pueschel@pengutronix.de>
> > >>>>>>> Ricardo Ribalda <ribalda@chromium.org>
> > >>>>>>> Michael Riesch <michael.riesch@collabora.com>
> > >>>>>>> Devarsh Thakkar <devarsht@ti.com>
> > >>>>>>> Michael Tretter <m.tretter@pengutronix.de>
> > >>>>>>> Hans Verkuil <hverkuil@kernel.org>
> > >>>>>>>
> > >>>>>>> Remote attendees:
> > >>>>>>> Yemike Abhilash Chandra <y-abhilashchandra@ti.com>
> > >>>>>>> Rishikesh Donadkar <r-donadkar@ti.com>
> > >>>>>>> Jackson Lee <jackson.lee@chipsnmedia.com>
> > >>>>>>> Dave Stevenson <dave.stevenson@raspberrypi.com> (tentative)
> > >>>>>>>
> > >>>>>>>
> > >>>>>>> Agenda (tentative):
> > >>>>>>>
> > >>>>>>> 8:45-9:20: Arrive, settle in
> > >>>>>>>
> > >>>>>>> 9:20-9:30: Short intro (Hans Verkuil)
> > >>>>>>>
> > >>>>>>> 9:30-9:45: Status of ISP support in V4L2
> > >>>>>>>         Presenter: Laurent Pinchart
> > >>>>>>>         Description: Summary of ISP-related development in V4L2 since the last
> > >>>>>>>         Linux Media Summit. This includes a brief overview of technical
> > >>>>>>>         developments, and a summary of the efforts to engage with vendors.
> > >>>>>>>
> > >>>>>>> 9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
> > >>>>>>>         Presenter: Paul Kocialkowski
> > >>>>>>>         Description: An update on the ongonig work to support stateless codecs in V4L2.
> > >>>>>>>         Some of the remaining open topics will be presented and discussed.
> > >>>>>>>
> > >>>>>>> 10:45-11:00: break
> > >>>>>>>
> > >>>>>>> 11:00-11:30: Vulkan Video Codecs
> > >>>>>>>         Presenter: Nicolas Dufresne
> > >>>>>>>         Description: Vulkan video codecs: what are the viable options for Linux Media
> > >>>>>>>         and what is in preparation outside of our subsystem. The second aspect is
> > >>>>>>>         informative as these discussions don't seem to lean toward our subsystem as the
> > >>>>>>>         foundation. But I think it's rather useful for everyone to understand why and
> > >>>>>>>         what is included.
> > >>>>>>>
> > >>>>>>> 11:30-12:00: Protected Video playback on i.MX8MQ
> > >>>>>>>         Presenter: Rouven Czerwinski
> > >>>>>>>         Description: Introduction to protected video playback
> > >>>>>>>         on i.MX8MQ and missing bits for linux-media & protected heap interoperability.
> > >>>>>>>
> > >>>>>>> 12:00-13:30: Lunch
> > >>>>>>>
> > >>>>>>> 13:30-14:00: HDCP support for HDMI receivers
> > >>>>>>>         Presenter: Hans Verkuil
> > >>>>>>>         Description: I have been working on adding HDCP support for HDMI receivers.
> > >>>>>>>         Specifically the HDCP negotiation between sources and sinks.
> > >>>>>>>
> > >>>>>>> 14:00-14:30: AI patches
> > >>>>>>>         Presenter: Sakari Ailus
> > >>>>>>>         Description: What is our policy w.r.t. AI generated patches?
> > >>>>>>>
> > >>>>>>> 14:30-15:00 Overview of Media CI: where do pipelines run?
> > >>>>>>>         Presenter: Ricardo Ribalda
> > >>>>>>>         Description: How are jobs in pipelines assigned? How does the infrastructure
> > >>>>>>>         for Media CI work? Are there things that can be tweaked to make it more
> > >>>>>>>         reliable?
> > >>>>>>>
> > >>>>>>> 15:00-15:15: Break
> > >>>>>>>
> > >>>>>>> 15:15-16:15: Discussion of the media subsystem development process
> > >>>>>>>         Presenter: Hans Verkuil
> > >>>>>>>         Description: Review of the multi-committer model: current status and next steps.
> > >>>>>>>         Are there any bottlenecks, any ideas for improvements, w.r.t. the development process?
> > >>>>>>>
> > >>>>>>> As you can see, there is still some available time for other topics.

Regards,
Loic

Re: [ANNv4] Media Summit on May 26th in Nice, France

[Laurent Pinchart]

On Tue, Apr 14, 2026 at 10:34:13AM +0200, Loic Poulain wrote:
> On Tue, Apr 14, 2026 at 9:42 AM Laurent Pinchart wrote:
> > On Tue, Apr 14, 2026 at 09:20:56AM +0200, Michael Riesch wrote:
> > > On 4/14/26 08:55, Ricardo Ribalda wrote:
> > > > On Tue, 14 Apr 2026 at 08:47, Hans Verkuil <hverkuil+cisco@kernel.org> wrote:
> > > >> On 13/04/2026 23:16, Laurent Pinchart wrote:
> > > >>> On Mon, Apr 13, 2026 at 04:25:54PM -0400, Nicolas Dufresne wrote:
> > > >>>> Le lundi 13 avril 2026 à 23:19 +0300, Laurent Pinchart a écrit :
> > > >>>>> On Mon, Apr 13, 2026 at 10:03:52PM +0200, Loic Poulain wrote:
> > > >>>>>> Hi Hans,
> > > >>>>>>
> > > >>>>>> I would be happy to discuss this if a slot is available:
> > > >>>>>>
> > > >>>>>> Title: Generic V4L2 ISP M2M framework
> > > >>>>>> Presenter: Loic Poulain
> > > >>>>>> Time estimate: ~20min
> > > >>>>>> Description: During early development of a Qualcomm Offline Image
> > > >>>>>> Processing Engine (OPE), we relied on the V4L2 memory‑to‑memory
> > > >>>>>> (v4l2‑m2m) framework, which is widely used and provides solid support
> > > >>>>>> for buffer management and scheduling. However, applying it to an ISP
> > > >>>>>> use case exposes limitations: ISP engines often require a richer media
> > > >>>>>> graph, with multiple pads and metadata flows, similar to inline ISP
> > > >>>>>> pipelines (params, stats, outputs). This talk proposes discussing the
> > > >>>>>> need for and design of a common V4L2 ISP M2M framework to factor out
> > > >>>>>> shared functionality across drivers, particularly around buffer/queue
> > > >>>>>> management and job scheduling.
> > >
> > > It seems that we share some pain points.. :-) :-/
> > >
> > > Over the last year, some ideas have been brewing in my mind. Not
> > > necessarily *my* ideas, mind you, rather ideas that have been around in
> > > linux-media for quite a while, actually. What I would like to prepare
> > > for the Media Summit goes along the same lines.
> > >
> > > >>>>> That's well aligned with the v4l2-isp framework that Jacopo started, and
> > > >>>>> to the multi-context and media-jobs APIs that we have proposed. I
> > > >>>>> wonder, however, if a short session at the media summit will be enough,
> > > >>>>> or if we should try to organize a half day brainstorming workshop at
> > > >>>>> some point. Depending on when the people interested in this topic plan
> > > >>>>> to arrive, Monday could be an option.
> > > >>>>
> > > >>>> I'm also/still interested in the multi-context for m2m decoders that have inline
> > > >>>> post-processing capabilities (current model forces us to waste a lot of RAM). We
> > > >>>> just restarted some design discussion with the team, with an increased
> > > >>>> confidence that multi-context is the way. The scheduler could come handy in the
> > > >>>> future if we get to deal with more multi-stage codecs in the future. I'll be in
> > > >>>> Nice all day Monday.
> > > >>>
> > > >>> I will unfortunately be available only until 15:00 on Monday, but Jacopo
> > > >>> should be available through the day. Let's see who would be interested
> > > >>> and available, and try to organize something.
> > > >>
> > > >> I'm available on Monday as well. I think this is a topic that is well suited
> > > >> to a brainstorm session.
> > > >
> > > > I am also available on Monday and would like to attend the session.
> > >
> > > I'd be interested too. Right now the plan is to arrive on Monday
> > > afternoon. Depending on what time you agree on it may work out anyway.
> > > It would be great to know the exact time this session will start (as I
> > > might need to adjust my travel arrangements).
> 
> I can arrive on Monday, with a preference for the afternoon.
> 
> > We need a volunteer to organize this, as in finding and booking a
> > meeting space. Note that Monday is a public holiday in France (Monday
> > the 25th of May in particular, not all Mondays).
> >
> > If the number of attendees was small I was thinking of hosting the event
> > in the place where the Ideas on Board team will be staying, but it looks
> > like we're already reaching a fair number of people.
> >
> > > > Regards!
> > > >
> > > >> The agenda for the media summit is getting quite full, and I agree with Laurent
> > > >> that 20 minutes is likely not enough. If we can so a session on Monday instead,
> > > >> then that would be a good solution.
> > >
> > > Apart from the time and date the scope of this session would be interesting.
> > >
> > > Will this be a birds of a feather session in which the next generation
> > > kernel ISP framework will be discussed? Or even the next generation
> > > kernel video processing framework, where video processing is image
> > > signal processing, encoding/decoding, 2D graphics processing (fisheye
> > > correction units, 2D GPU such as the Rockchip RGA3, ...)?
> >
> > I would focus on Loic's original scope. If the solution can be used for
> > other devices that's great too. I believe that the current multi-context
> > patch series is a good fit for codecs. If we broaden the scope too much
> > right away we'll achieve nothing.
> >
> > > >> I have never been very enthusiastic about the m2m framework: it's fine for e.g.
> > > >> simple scalers, but it's awkward to use for codecs let alone ISPs.
> > > >>
> > > >> I always felt that we really need variants of the m2m framework that are customized
> > > >> to specific use-cases: i.e. a codec m2m framework, and (perhaps) an ISP m2m framework.
> > > >>
> > > >> The big problem with that is of course who will do the work. Making new frameworks
> > > >> is difficult and takes a long time.
> 
> A couple of weeks ago, I submitted an initial driver for a Qualcomm
> Offline ISP based on the standard v4l2-m2m framework. Following
> discussions around which parts could be generalized, I started
> migrating this work to a new v4l2-isp-m2m framework:
> (https://github.com/loicpoulain/linux/commit/5d575d7eff8f2371e91d8237148ffdb44b0af5b0).

I definitely want to discuss this, but I will be available on Monday
until 15:00 only.

> The API and overall logic closely mirror v4l2-m2m.c, but are extended
> to address ISP‑specific requirements such as multi‑device support and
> multiple queue handling.

That part I don't like. The V4L2 M2M framework is a big mid-layer that
prevents drivers from having control of how operations are handled. It
does too much, and doesn't give enough flexibility to drivers. It may
have been fine when the framework was designed, for the devices we had
back then, but today it's just painful. I want to turn this around and
give control to the drivers, with helpers they can use to implement
parts that are not driver-specific. This needs to be opt-in, not a layer
that takes completely control between the uAPI and driver operations.

Let's not reproduce the design mistakes made in the V4L2 M2M framework.

I also think you need to decouple the context handling and scheduling in
two separate components. They need to work together, but shouldn't be
bundled into a monolithic system. Very importantly, a driver should be
able to implement contexts with the multi-context helpers, and implement
custom scheduling itself.

> I am planning to submit this work as an RFC
> before the Media Summit. At this stage, the framework is still fairly
> basic and primarily tailored to the Qualcomm use case. There is
> definitely room for improvement, for example, integrating Jacopo’s
> multi‑context support, since for now, the Qualcomm driver simply
> instantiates a single ISP‑M2M context.
> 
> As I am still getting familiar with the media subsystem, this work may
> overlap with or conflict with ongoing efforts. Synchronizing seems
> indeed important. Based on my current understanding, there are several
> related areas of work that appear either complementary or orthogonal:
> - Multi‑context support, to instantiate multiple processing sessions
> on shared hardware/driver.
> - Media jobs, to synchronize work across multiple drivers within the
> same media pipeline.
> - ISP M2M, aiming to provide a v4l2-m2m‑like framework specifically
> for memory‑to‑memory ISP devices.
> 
> > > This may be naive and overly optimistic, but I feel there is quite a
> > > number of people sharing the same pain points (which are similar to
> > > those Loic pointed out). Maybe (hopefully) this birds of a feather
> > > session leads to the formation of some work group?
> > >
> > > >>>>>> On Sun, Apr 12, 2026 at 12:25 PM Hans Verkuil wrote:
> > > >>>>>>>
> > > >>>>>>> (Please pass this on to anyone you think might be interested in this!)
> > > >>>>>>>
> > > >>>>>>> Hi all,
> > > >>>>>>>
> > > >>>>>>> This is the fourth version of this announcement, updating the list of attendees
> > > >>>>>>> and the tentative agenda at the end: please let me know if you see mistakes.
> > > >>>>>>> Note that there is still time for one or two other topics. Also please check
> > > >>>>>>> the agenda if you need more (or perhaps less) time for your topic.
> > > >>>>>>>
> > > >>>>>>> This year's Media Summit will be held on Tuesday May 26th the day before the
> > > >>>>>>> Embedded Recipes Conference in Nice, France:
> > > >>>>>>>
> > > >>>>>>> https://embedded-recipes.org/2026/
> > > >>>>>>>
> > > >>>>>>> The Media Summit will be held at Hotel Campanile and in the same meeting room
> > > >>>>>>> as last year (Nikaia):
> > > >>>>>>>
> > > >>>>>>> https://nice-aeroport.campanile.com/en-us/
> > > >>>>>>>
> > > >>>>>>> It is close to the Airport and to the Embedded Recipes venue.
> > > >>>>>>>
> > > >>>>>>> The meeting room can hold up to 30 people and I will provide video conferencing support,
> > > >>>>>>> just like last year. The location and the meeting room was quite nice last year, so
> > > >>>>>>> I saw no need to change it.
> > > >>>>>>>
> > > >>>>>>> That said, in-person participation is very much preferred. This yearly summit is meant
> > > >>>>>>> for active media developers to meet face-to-face and to discuss media subsystem issues.
> > > >>>>>>>
> > > >>>>>>> And it is also a good opportunity to talk to each other during the Embedded Recipes
> > > >>>>>>> conference to discuss topics in a smaller group. But if you are an active media developer
> > > >>>>>>> and are really not able to attend in person, then remote participation is an option.
> > > >>>>>>>
> > > >>>>>>> If you want to attend the meeting (either in person or remote), then send an email to me
> > > >>>>>>> directly. The deadline for in-person attendance is May 14 as the hotel needs to know the
> > > >>>>>>> final number of attendees by then.
> > > >>>>>>>
> > > >>>>>>> There is no registration fee, the meeting room is sponsored by Cisco and Collabora, and
> > > >>>>>>> the lunch is sponsored by Ideas on Board! Many thanks to our sponsors, it's very much
> > > >>>>>>> appreciated.
> > > >>>>>>>
> > > >>>>>>> If you have a topic that you want to discuss, just 'Reply All' to this announcement
> > > >>>>>>> and give the topic title, a short description and a guesstimate of the time you need
> > > >>>>>>> for your topic.
> > > >>>>>>>
> > > >>>>>>> See last year's Media Summit Report as an example of what to expect:
> > > >>>>>>>
> > > >>>>>>> https://lore.kernel.org/linux-media/21769183-ca57-4f8f-818a-6a1ad089298d@jjverkuil.nl/
> > > >>>>>>>
> > > >>>>>>> Regards,
> > > >>>>>>>
> > > >>>>>>>         Hans
> > > >>>>>>>
> > > >>>>>>> PS: Be aware that May 24 and 25 are public holidays in France. So many
> > > >>>>>>> shops may be
> > > >>>>>>> closed those days.
> > > >>>>>>>
> > > >>>>>>> In-person attendees:
> > > >>>>>>> Sakari Ailus <sakari.ailus@linux.intel.com>
> > > >>>>>>> Kieran Bingham <kieran.bingham@ideasonboard.com>
> > > >>>>>>> Brandon Brnich <b-brnich@ti.com>
> > > >>>>>>> Rouven Czerwinski <rouven.czerwinski@linaro.org>
> > > >>>>>>> Mehdi Djait <mehdi.djait@linux.intel.com>
> > > >>>>>>> Bryan O'Donoghue <bryan.odonoghue@linaro.org>
> > > >>>>>>> Nicolas Dufresne <nicolas.dufresne@collabora.com>
> > > >>>>>>> Marco Felsch <m.felsch@pengutronix.de>
> > > >>>>>>> Paul Kocialkowski <paulk@sys-base.io>
> > > >>>>>>> Jai Luthra <jai.luthra@ideasonboard.com>
> > > >>>>>>> Jacopo Mondi <jacopo.mondi@ideasonboard.com>
> > > >>>>>>> Benjamin Mugnier <benjamin.mugnier@foss.st.com>
> > > >>>>>>> Beleswar Padhi <b-padhi@ti.com>
> > > >>>>>>> Laurent Pinchart <laurent.pinchart@ideasonboard.com>
> > > >>>>>>> Loic Poulain <loic.poulain@oss.qualcomm.com>
> > > >>>>>>> Sven Püschel <s.pueschel@pengutronix.de>
> > > >>>>>>> Ricardo Ribalda <ribalda@chromium.org>
> > > >>>>>>> Michael Riesch <michael.riesch@collabora.com>
> > > >>>>>>> Devarsh Thakkar <devarsht@ti.com>
> > > >>>>>>> Michael Tretter <m.tretter@pengutronix.de>
> > > >>>>>>> Hans Verkuil <hverkuil@kernel.org>
> > > >>>>>>>
> > > >>>>>>> Remote attendees:
> > > >>>>>>> Yemike Abhilash Chandra <y-abhilashchandra@ti.com>
> > > >>>>>>> Rishikesh Donadkar <r-donadkar@ti.com>
> > > >>>>>>> Jackson Lee <jackson.lee@chipsnmedia.com>
> > > >>>>>>> Dave Stevenson <dave.stevenson@raspberrypi.com> (tentative)
> > > >>>>>>>
> > > >>>>>>>
> > > >>>>>>> Agenda (tentative):
> > > >>>>>>>
> > > >>>>>>> 8:45-9:20: Arrive, settle in
> > > >>>>>>>
> > > >>>>>>> 9:20-9:30: Short intro (Hans Verkuil)
> > > >>>>>>>
> > > >>>>>>> 9:30-9:45: Status of ISP support in V4L2
> > > >>>>>>>         Presenter: Laurent Pinchart
> > > >>>>>>>         Description: Summary of ISP-related development in V4L2 since the last
> > > >>>>>>>         Linux Media Summit. This includes a brief overview of technical
> > > >>>>>>>         developments, and a summary of the efforts to engage with vendors.
> > > >>>>>>>
> > > >>>>>>> 9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
> > > >>>>>>>         Presenter: Paul Kocialkowski
> > > >>>>>>>         Description: An update on the ongonig work to support stateless codecs in V4L2.
> > > >>>>>>>         Some of the remaining open topics will be presented and discussed.
> > > >>>>>>>
> > > >>>>>>> 10:45-11:00: break
> > > >>>>>>>
> > > >>>>>>> 11:00-11:30: Vulkan Video Codecs
> > > >>>>>>>         Presenter: Nicolas Dufresne
> > > >>>>>>>         Description: Vulkan video codecs: what are the viable options for Linux Media
> > > >>>>>>>         and what is in preparation outside of our subsystem. The second aspect is
> > > >>>>>>>         informative as these discussions don't seem to lean toward our subsystem as the
> > > >>>>>>>         foundation. But I think it's rather useful for everyone to understand why and
> > > >>>>>>>         what is included.
> > > >>>>>>>
> > > >>>>>>> 11:30-12:00: Protected Video playback on i.MX8MQ
> > > >>>>>>>         Presenter: Rouven Czerwinski
> > > >>>>>>>         Description: Introduction to protected video playback
> > > >>>>>>>         on i.MX8MQ and missing bits for linux-media & protected heap interoperability.
> > > >>>>>>>
> > > >>>>>>> 12:00-13:30: Lunch
> > > >>>>>>>
> > > >>>>>>> 13:30-14:00: HDCP support for HDMI receivers
> > > >>>>>>>         Presenter: Hans Verkuil
> > > >>>>>>>         Description: I have been working on adding HDCP support for HDMI receivers.
> > > >>>>>>>         Specifically the HDCP negotiation between sources and sinks.
> > > >>>>>>>
> > > >>>>>>> 14:00-14:30: AI patches
> > > >>>>>>>         Presenter: Sakari Ailus
> > > >>>>>>>         Description: What is our policy w.r.t. AI generated patches?
> > > >>>>>>>
> > > >>>>>>> 14:30-15:00 Overview of Media CI: where do pipelines run?
> > > >>>>>>>         Presenter: Ricardo Ribalda
> > > >>>>>>>         Description: How are jobs in pipelines assigned? How does the infrastructure
> > > >>>>>>>         for Media CI work? Are there things that can be tweaked to make it more
> > > >>>>>>>         reliable?
> > > >>>>>>>
> > > >>>>>>> 15:00-15:15: Break
> > > >>>>>>>
> > > >>>>>>> 15:15-16:15: Discussion of the media subsystem development process
> > > >>>>>>>         Presenter: Hans Verkuil
> > > >>>>>>>         Description: Review of the multi-committer model: current status and next steps.
> > > >>>>>>>         Are there any bottlenecks, any ideas for improvements, w.r.t. the development process?
> > > >>>>>>>
> > > >>>>>>> As you can see, there is still some available time for other topics.

-- 
Regards,

Laurent Pinchart

Re: [ANNv4] Media Summit on May 26th in Nice, France

[Nicolas Dufresne]

[-- Attachment #1: Type: text/plain, Size: 1176 bytes --]

Hey,

Le mardi 14 avril 2026 à 11:42 +0300, Laurent Pinchart a écrit :
> Let's not reproduce the design mistakes made in the V4L2 M2M framework.
> 
> I also think you need to decouple the context handling and scheduling in
> two separate components. They need to work together, but shouldn't be
> bundled into a monolithic system. Very importantly, a driver should be
> able to implement contexts with the multi-context helpers, and implement
> custom scheduling itself.

Note that the v4l2_m2m_dev is juts miss-named, it does not wrap a specific dev
instance anymore. I'll rename and clean that up eventually, but I agree its not
meant for your purpose, and it will be a good fight to use. Its already a pretty
big miss-fit for stateful codec, which don't really have the notion of "active
central job". Jacopo's proposal is to have multi-context MC (as you already
know), making the media device as the central source of context, so I think
that's a path in the right direction.

But I'll be honest, I would see a future where we actually drop (or break down
into pieces) VB2, which is I read you well, its not miss-aligned with your say.

Nicolas

[-- Attachment #2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 228 bytes --]

Re: [ANNv4] Media Summit on May 26th in Nice, France

[Laurent Pinchart]

On Tue, Apr 14, 2026 at 01:55:20PM -0400, Nicolas Dufresne wrote:
> Hey,
> 
> Le mardi 14 avril 2026 à 11:42 +0300, Laurent Pinchart a écrit :
> > Let's not reproduce the design mistakes made in the V4L2 M2M framework.
> > 
> > I also think you need to decouple the context handling and scheduling in
> > two separate components. They need to work together, but shouldn't be
> > bundled into a monolithic system. Very importantly, a driver should be
> > able to implement contexts with the multi-context helpers, and implement
> > custom scheduling itself.
> 
> Note that the v4l2_m2m_dev is juts miss-named, it does not wrap a specific dev
> instance anymore. I'll rename and clean that up eventually, but I agree its not
> meant for your purpose, and it will be a good fight to use. Its already a pretty
> big miss-fit for stateful codec, which don't really have the notion of "active
> central job". Jacopo's proposal is to have multi-context MC (as you already
> know), making the media device as the central source of context, so I think
> that's a path in the right direction.
> 
> But I'll be honest, I would see a future where we actually drop (or break down
> into pieces) VB2, which is I read you well, its not miss-aligned with your say.

I won't object :-) vb2 was designed as a midlayer, and that causes
headaches (I'm thinking in particular about how .start_streaming() is
delayed until buffers get queued). I have less issues with vb2 than with
the M2M midlayer, as vb2 gets less in the way, but I think we should
overall favour for new developments smaller helpers that drivers can
assemble based on their needs over monolithic midlayers.

-- 
Regards,

Laurent Pinchart

Re: [ANNv4] Media Summit on May 26th in Nice, France

[Loic Poulain]

On Tue, Apr 14, 2026 at 10:43 AM Laurent Pinchart
<laurent.pinchart@ideasonboard.com> wrote:
>
> On Tue, Apr 14, 2026 at 10:34:13AM +0200, Loic Poulain wrote:
> > On Tue, Apr 14, 2026 at 9:42 AM Laurent Pinchart wrote:
> > > On Tue, Apr 14, 2026 at 09:20:56AM +0200, Michael Riesch wrote:
> > > > On 4/14/26 08:55, Ricardo Ribalda wrote:
> > > > > On Tue, 14 Apr 2026 at 08:47, Hans Verkuil <hverkuil+cisco@kernel.org> wrote:
> > > > >> On 13/04/2026 23:16, Laurent Pinchart wrote:
> > > > >>> On Mon, Apr 13, 2026 at 04:25:54PM -0400, Nicolas Dufresne wrote:
> > > > >>>> Le lundi 13 avril 2026 à 23:19 +0300, Laurent Pinchart a écrit :
> > > > >>>>> On Mon, Apr 13, 2026 at 10:03:52PM +0200, Loic Poulain wrote:
> > > > >>>>>> Hi Hans,
> > > > >>>>>>
> > > > >>>>>> I would be happy to discuss this if a slot is available:
> > > > >>>>>>
> > > > >>>>>> Title: Generic V4L2 ISP M2M framework
> > > > >>>>>> Presenter: Loic Poulain
> > > > >>>>>> Time estimate: ~20min
> > > > >>>>>> Description: During early development of a Qualcomm Offline Image
> > > > >>>>>> Processing Engine (OPE), we relied on the V4L2 memory‑to‑memory
> > > > >>>>>> (v4l2‑m2m) framework, which is widely used and provides solid support
> > > > >>>>>> for buffer management and scheduling. However, applying it to an ISP
> > > > >>>>>> use case exposes limitations: ISP engines often require a richer media
> > > > >>>>>> graph, with multiple pads and metadata flows, similar to inline ISP
> > > > >>>>>> pipelines (params, stats, outputs). This talk proposes discussing the
> > > > >>>>>> need for and design of a common V4L2 ISP M2M framework to factor out
> > > > >>>>>> shared functionality across drivers, particularly around buffer/queue
> > > > >>>>>> management and job scheduling.
> > > >
> > > > It seems that we share some pain points.. :-) :-/
> > > >
> > > > Over the last year, some ideas have been brewing in my mind. Not
> > > > necessarily *my* ideas, mind you, rather ideas that have been around in
> > > > linux-media for quite a while, actually. What I would like to prepare
> > > > for the Media Summit goes along the same lines.
> > > >
> > > > >>>>> That's well aligned with the v4l2-isp framework that Jacopo started, and
> > > > >>>>> to the multi-context and media-jobs APIs that we have proposed. I
> > > > >>>>> wonder, however, if a short session at the media summit will be enough,
> > > > >>>>> or if we should try to organize a half day brainstorming workshop at
> > > > >>>>> some point. Depending on when the people interested in this topic plan
> > > > >>>>> to arrive, Monday could be an option.
> > > > >>>>
> > > > >>>> I'm also/still interested in the multi-context for m2m decoders that have inline
> > > > >>>> post-processing capabilities (current model forces us to waste a lot of RAM). We
> > > > >>>> just restarted some design discussion with the team, with an increased
> > > > >>>> confidence that multi-context is the way. The scheduler could come handy in the
> > > > >>>> future if we get to deal with more multi-stage codecs in the future. I'll be in
> > > > >>>> Nice all day Monday.
> > > > >>>
> > > > >>> I will unfortunately be available only until 15:00 on Monday, but Jacopo
> > > > >>> should be available through the day. Let's see who would be interested
> > > > >>> and available, and try to organize something.
> > > > >>
> > > > >> I'm available on Monday as well. I think this is a topic that is well suited
> > > > >> to a brainstorm session.
> > > > >
> > > > > I am also available on Monday and would like to attend the session.
> > > >
> > > > I'd be interested too. Right now the plan is to arrive on Monday
> > > > afternoon. Depending on what time you agree on it may work out anyway.
> > > > It would be great to know the exact time this session will start (as I
> > > > might need to adjust my travel arrangements).
> >
> > I can arrive on Monday, with a preference for the afternoon.
> >
> > > We need a volunteer to organize this, as in finding and booking a
> > > meeting space. Note that Monday is a public holiday in France (Monday
> > > the 25th of May in particular, not all Mondays).
> > >
> > > If the number of attendees was small I was thinking of hosting the event
> > > in the place where the Ideas on Board team will be staying, but it looks
> > > like we're already reaching a fair number of people.
> > >
> > > > > Regards!
> > > > >
> > > > >> The agenda for the media summit is getting quite full, and I agree with Laurent
> > > > >> that 20 minutes is likely not enough. If we can so a session on Monday instead,
> > > > >> then that would be a good solution.
> > > >
> > > > Apart from the time and date the scope of this session would be interesting.
> > > >
> > > > Will this be a birds of a feather session in which the next generation
> > > > kernel ISP framework will be discussed? Or even the next generation
> > > > kernel video processing framework, where video processing is image
> > > > signal processing, encoding/decoding, 2D graphics processing (fisheye
> > > > correction units, 2D GPU such as the Rockchip RGA3, ...)?
> > >
> > > I would focus on Loic's original scope. If the solution can be used for
> > > other devices that's great too. I believe that the current multi-context
> > > patch series is a good fit for codecs. If we broaden the scope too much
> > > right away we'll achieve nothing.
> > >
> > > > >> I have never been very enthusiastic about the m2m framework: it's fine for e.g.
> > > > >> simple scalers, but it's awkward to use for codecs let alone ISPs.
> > > > >>
> > > > >> I always felt that we really need variants of the m2m framework that are customized
> > > > >> to specific use-cases: i.e. a codec m2m framework, and (perhaps) an ISP m2m framework.
> > > > >>
> > > > >> The big problem with that is of course who will do the work. Making new frameworks
> > > > >> is difficult and takes a long time.
> >
> > A couple of weeks ago, I submitted an initial driver for a Qualcomm
> > Offline ISP based on the standard v4l2-m2m framework. Following
> > discussions around which parts could be generalized, I started
> > migrating this work to a new v4l2-isp-m2m framework:
> > (https://github.com/loicpoulain/linux/commit/5d575d7eff8f2371e91d8237148ffdb44b0af5b0).
>
> I definitely want to discuss this, but I will be available on Monday
> until 15:00 only.

I think I can arrange to arrive in the morning if 10am works.

>
> > The API and overall logic closely mirror v4l2-m2m.c, but are extended
> > to address ISP‑specific requirements such as multi‑device support and
> > multiple queue handling.
>
> That part I don't like. The V4L2 M2M framework is a big mid-layer that
> prevents drivers from having control of how operations are handled. It
> does too much, and doesn't give enough flexibility to drivers. It may
> have been fine when the framework was designed, for the devices we had
> back then, but today it's just painful. I want to turn this around and
> give control to the drivers, with helpers they can use to implement
> parts that are not driver-specific. This needs to be opt-in, not a layer
> that takes completely control between the uAPI and driver operations.
>
> Let's not reproduce the design mistakes made in the V4L2 M2M framework.
>
> I also think you need to decouple the context handling and scheduling in
> two separate components. They need to work together, but shouldn't be
> bundled into a monolithic system. Very importantly, a driver should be
> able to implement contexts with the multi-context helpers, and implement
> custom scheduling itself.

Understood, thanks for the feedback, these are important points.
Decoupling should be straightforward to address, and I will make sure
to take Jacopo’s multi‑context work into account as part of the
design.

I also need to find the right balance between what can be easily
generalized and moved out of the driver, and raising issues or
discussions that, while valid, could branch into too many parallel
topics and significantly delay integration. I guess this can be
addressed in multiple steps: starting with an initial driver, followed
by a gradual split and migration toward a common framework, as long as
the user‑facing API remains stable (video devices, media graph, etc.).



>
> > I am planning to submit this work as an RFC
> > before the Media Summit. At this stage, the framework is still fairly
> > basic and primarily tailored to the Qualcomm use case. There is
> > definitely room for improvement, for example, integrating Jacopo’s
> > multi‑context support, since for now, the Qualcomm driver simply
> > instantiates a single ISP‑M2M context.
> >
> > As I am still getting familiar with the media subsystem, this work may
> > overlap with or conflict with ongoing efforts. Synchronizing seems
> > indeed important. Based on my current understanding, there are several
> > related areas of work that appear either complementary or orthogonal:
> > - Multi‑context support, to instantiate multiple processing sessions
> > on shared hardware/driver.
> > - Media jobs, to synchronize work across multiple drivers within the
> > same media pipeline.
> > - ISP M2M, aiming to provide a v4l2-m2m‑like framework specifically
> > for memory‑to‑memory ISP devices.
> >
> > > > This may be naive and overly optimistic, but I feel there is quite a
> > > > number of people sharing the same pain points (which are similar to
> > > > those Loic pointed out). Maybe (hopefully) this birds of a feather
> > > > session leads to the formation of some work group?
> > > >
> > > > >>>>>> On Sun, Apr 12, 2026 at 12:25 PM Hans Verkuil wrote:
> > > > >>>>>>>
> > > > >>>>>>> (Please pass this on to anyone you think might be interested in this!)
> > > > >>>>>>>
> > > > >>>>>>> Hi all,
> > > > >>>>>>>
> > > > >>>>>>> This is the fourth version of this announcement, updating the list of attendees
> > > > >>>>>>> and the tentative agenda at the end: please let me know if you see mistakes.
> > > > >>>>>>> Note that there is still time for one or two other topics. Also please check
> > > > >>>>>>> the agenda if you need more (or perhaps less) time for your topic.
> > > > >>>>>>>
> > > > >>>>>>> This year's Media Summit will be held on Tuesday May 26th the day before the
> > > > >>>>>>> Embedded Recipes Conference in Nice, France:
> > > > >>>>>>>
> > > > >>>>>>> https://embedded-recipes.org/2026/
> > > > >>>>>>>
> > > > >>>>>>> The Media Summit will be held at Hotel Campanile and in the same meeting room
> > > > >>>>>>> as last year (Nikaia):
> > > > >>>>>>>
> > > > >>>>>>> https://nice-aeroport.campanile.com/en-us/
> > > > >>>>>>>
> > > > >>>>>>> It is close to the Airport and to the Embedded Recipes venue.
> > > > >>>>>>>
> > > > >>>>>>> The meeting room can hold up to 30 people and I will provide video conferencing support,
> > > > >>>>>>> just like last year. The location and the meeting room was quite nice last year, so
> > > > >>>>>>> I saw no need to change it.
> > > > >>>>>>>
> > > > >>>>>>> That said, in-person participation is very much preferred. This yearly summit is meant
> > > > >>>>>>> for active media developers to meet face-to-face and to discuss media subsystem issues.
> > > > >>>>>>>
> > > > >>>>>>> And it is also a good opportunity to talk to each other during the Embedded Recipes
> > > > >>>>>>> conference to discuss topics in a smaller group. But if you are an active media developer
> > > > >>>>>>> and are really not able to attend in person, then remote participation is an option.
> > > > >>>>>>>
> > > > >>>>>>> If you want to attend the meeting (either in person or remote), then send an email to me
> > > > >>>>>>> directly. The deadline for in-person attendance is May 14 as the hotel needs to know the
> > > > >>>>>>> final number of attendees by then.
> > > > >>>>>>>
> > > > >>>>>>> There is no registration fee, the meeting room is sponsored by Cisco and Collabora, and
> > > > >>>>>>> the lunch is sponsored by Ideas on Board! Many thanks to our sponsors, it's very much
> > > > >>>>>>> appreciated.
> > > > >>>>>>>
> > > > >>>>>>> If you have a topic that you want to discuss, just 'Reply All' to this announcement
> > > > >>>>>>> and give the topic title, a short description and a guesstimate of the time you need
> > > > >>>>>>> for your topic.
> > > > >>>>>>>
> > > > >>>>>>> See last year's Media Summit Report as an example of what to expect:
> > > > >>>>>>>
> > > > >>>>>>> https://lore.kernel.org/linux-media/21769183-ca57-4f8f-818a-6a1ad089298d@jjverkuil.nl/
> > > > >>>>>>>
> > > > >>>>>>> Regards,
> > > > >>>>>>>
> > > > >>>>>>>         Hans
> > > > >>>>>>>
> > > > >>>>>>> PS: Be aware that May 24 and 25 are public holidays in France. So many
> > > > >>>>>>> shops may be
> > > > >>>>>>> closed those days.
> > > > >>>>>>>
> > > > >>>>>>> In-person attendees:
> > > > >>>>>>> Sakari Ailus <sakari.ailus@linux.intel.com>
> > > > >>>>>>> Kieran Bingham <kieran.bingham@ideasonboard.com>
> > > > >>>>>>> Brandon Brnich <b-brnich@ti.com>
> > > > >>>>>>> Rouven Czerwinski <rouven.czerwinski@linaro.org>
> > > > >>>>>>> Mehdi Djait <mehdi.djait@linux.intel.com>
> > > > >>>>>>> Bryan O'Donoghue <bryan.odonoghue@linaro.org>
> > > > >>>>>>> Nicolas Dufresne <nicolas.dufresne@collabora.com>
> > > > >>>>>>> Marco Felsch <m.felsch@pengutronix.de>
> > > > >>>>>>> Paul Kocialkowski <paulk@sys-base.io>
> > > > >>>>>>> Jai Luthra <jai.luthra@ideasonboard.com>
> > > > >>>>>>> Jacopo Mondi <jacopo.mondi@ideasonboard.com>
> > > > >>>>>>> Benjamin Mugnier <benjamin.mugnier@foss.st.com>
> > > > >>>>>>> Beleswar Padhi <b-padhi@ti.com>
> > > > >>>>>>> Laurent Pinchart <laurent.pinchart@ideasonboard.com>
> > > > >>>>>>> Loic Poulain <loic.poulain@oss.qualcomm.com>
> > > > >>>>>>> Sven Püschel <s.pueschel@pengutronix.de>
> > > > >>>>>>> Ricardo Ribalda <ribalda@chromium.org>
> > > > >>>>>>> Michael Riesch <michael.riesch@collabora.com>
> > > > >>>>>>> Devarsh Thakkar <devarsht@ti.com>
> > > > >>>>>>> Michael Tretter <m.tretter@pengutronix.de>
> > > > >>>>>>> Hans Verkuil <hverkuil@kernel.org>
> > > > >>>>>>>
> > > > >>>>>>> Remote attendees:
> > > > >>>>>>> Yemike Abhilash Chandra <y-abhilashchandra@ti.com>
> > > > >>>>>>> Rishikesh Donadkar <r-donadkar@ti.com>
> > > > >>>>>>> Jackson Lee <jackson.lee@chipsnmedia.com>
> > > > >>>>>>> Dave Stevenson <dave.stevenson@raspberrypi.com> (tentative)
> > > > >>>>>>>
> > > > >>>>>>>
> > > > >>>>>>> Agenda (tentative):
> > > > >>>>>>>
> > > > >>>>>>> 8:45-9:20: Arrive, settle in
> > > > >>>>>>>
> > > > >>>>>>> 9:20-9:30: Short intro (Hans Verkuil)
> > > > >>>>>>>
> > > > >>>>>>> 9:30-9:45: Status of ISP support in V4L2
> > > > >>>>>>>         Presenter: Laurent Pinchart
> > > > >>>>>>>         Description: Summary of ISP-related development in V4L2 since the last
> > > > >>>>>>>         Linux Media Summit. This includes a brief overview of technical
> > > > >>>>>>>         developments, and a summary of the efforts to engage with vendors.
> > > > >>>>>>>
> > > > >>>>>>> 9:45-10:45: V4L2 Stateless Video Encoding uAPI Progress Update
> > > > >>>>>>>         Presenter: Paul Kocialkowski
> > > > >>>>>>>         Description: An update on the ongonig work to support stateless codecs in V4L2.
> > > > >>>>>>>         Some of the remaining open topics will be presented and discussed.
> > > > >>>>>>>
> > > > >>>>>>> 10:45-11:00: break
> > > > >>>>>>>
> > > > >>>>>>> 11:00-11:30: Vulkan Video Codecs
> > > > >>>>>>>         Presenter: Nicolas Dufresne
> > > > >>>>>>>         Description: Vulkan video codecs: what are the viable options for Linux Media
> > > > >>>>>>>         and what is in preparation outside of our subsystem. The second aspect is
> > > > >>>>>>>         informative as these discussions don't seem to lean toward our subsystem as the
> > > > >>>>>>>         foundation. But I think it's rather useful for everyone to understand why and
> > > > >>>>>>>         what is included.
> > > > >>>>>>>
> > > > >>>>>>> 11:30-12:00: Protected Video playback on i.MX8MQ
> > > > >>>>>>>         Presenter: Rouven Czerwinski
> > > > >>>>>>>         Description: Introduction to protected video playback
> > > > >>>>>>>         on i.MX8MQ and missing bits for linux-media & protected heap interoperability.
> > > > >>>>>>>
> > > > >>>>>>> 12:00-13:30: Lunch
> > > > >>>>>>>
> > > > >>>>>>> 13:30-14:00: HDCP support for HDMI receivers
> > > > >>>>>>>         Presenter: Hans Verkuil
> > > > >>>>>>>         Description: I have been working on adding HDCP support for HDMI receivers.
> > > > >>>>>>>         Specifically the HDCP negotiation between sources and sinks.
> > > > >>>>>>>
> > > > >>>>>>> 14:00-14:30: AI patches
> > > > >>>>>>>         Presenter: Sakari Ailus
> > > > >>>>>>>         Description: What is our policy w.r.t. AI generated patches?
> > > > >>>>>>>
> > > > >>>>>>> 14:30-15:00 Overview of Media CI: where do pipelines run?
> > > > >>>>>>>         Presenter: Ricardo Ribalda
> > > > >>>>>>>         Description: How are jobs in pipelines assigned? How does the infrastructure
> > > > >>>>>>>         for Media CI work? Are there things that can be tweaked to make it more
> > > > >>>>>>>         reliable?
> > > > >>>>>>>
> > > > >>>>>>> 15:00-15:15: Break
> > > > >>>>>>>
> > > > >>>>>>> 15:15-16:15: Discussion of the media subsystem development process
> > > > >>>>>>>         Presenter: Hans Verkuil
> > > > >>>>>>>         Description: Review of the multi-committer model: current status and next steps.
> > > > >>>>>>>         Are there any bottlenecks, any ideas for improvements, w.r.t. the development process?
> > > > >>>>>>>
> > > > >>>>>>> As you can see, there is still some available time for other topics.
>
> --
> Regards,
>
> Laurent Pinchart