public inbox for linux-rockchip@lists.infradead.org
 help / color / mirror / Atom feed
From: Benjamin Gaignard <benjamin.gaignard@collabora.com>
To: Hans Verkuil <hverkuil@xs4all.nl>,
	mchehab@kernel.org, ezequiel@vanguardiasur.com.ar,
	p.zabel@pengutronix.de, gregkh@linuxfoundation.org,
	mripard@kernel.org, paul.kocialkowski@bootlin.com, wens@csie.org,
	jernej.skrabec@gmail.com, samuel@sholland.org,
	nicolas.dufresne@collabora.com, andrzej.p@collabora.com
Cc: linux-media@vger.kernel.org, linux-kernel@vger.kernel.org,
	linux-rockchip@lists.infradead.org,
	linux-staging@lists.linux.dev,
	linux-arm-kernel@lists.infradead.org,
	linux-sunxi@lists.linux.dev, kernel@collabora.com,
	Hans Verkuil <hverkuil-cisco@xs4all.nl>
Subject: Re: [PATCH v8 01/17] videodev2.h: add V4L2_CTRL_FLAG_DYNAMIC_ARRAY
Date: Wed, 15 Jun 2022 12:18:19 +0200	[thread overview]
Message-ID: <6cb4ab4f-1132-f386-6dd0-bf4eeab4433c@collabora.com> (raw)
In-Reply-To: <63052d74-d3c7-a9cc-cb18-a58f8937ec06@xs4all.nl>


Le 15/06/2022 à 11:33, Hans Verkuil a écrit :
> Hi Benjamin,
>
> On 6/14/22 10:35, Benjamin Gaignard wrote:
>> From: Hans Verkuil <hverkuil-cisco@xs4all.nl>
>>
>> Add a new flag that indicates that this control is a dynamically sized
>> array. Also document this flag.
>>
>> Currently dynamically sized arrays are limited to one dimensional arrays,
>> but that might change in the future if there is a need for it.
>>
>> The initial use-case of dynamic arrays are stateless codecs. A frame
>> can be divided in many slices, so you want to provide an array containing
>> slice information for each slice. Typically the number of slices is small,
>> but the standard allow for hundreds or thousands of slices. Dynamic arrays
>> are a good solution since sizing the array for the worst case would waste
>> substantial amounts of memory.
>>
>> Signed-off-by: Hans Verkuil <hverkuil-cisco@xs4all.nl>
>> ---
>>   .../userspace-api/media/v4l/vidioc-queryctrl.rst          | 8 ++++++++
>>   include/uapi/linux/videodev2.h                            | 1 +
>>   2 files changed, 9 insertions(+)
>>
>> diff --git a/Documentation/userspace-api/media/v4l/vidioc-queryctrl.rst b/Documentation/userspace-api/media/v4l/vidioc-queryctrl.rst
>> index 88f630252d98..a20dfa2a933b 100644
>> --- a/Documentation/userspace-api/media/v4l/vidioc-queryctrl.rst
>> +++ b/Documentation/userspace-api/media/v4l/vidioc-queryctrl.rst
>> @@ -625,6 +625,14 @@ See also the examples in :ref:`control`.
>>   	``V4L2_CTRL_FLAG_GRABBED`` flag when buffers are allocated or
>>   	streaming is in progress since most drivers do not support changing
>>   	the format in that case.
>> +    * - ``V4L2_CTRL_FLAG_DYNAMIC_ARRAY``
>> +      - 0x0800
>> +      - This control is a dynamically sized 1-dimensional array. It
>> +        behaves the same as a regular array, except that the number
>> +	of elements as reported by the ``elems`` field is between 1 and
>> +	``dims[0]``. So setting the control with a differently sized
>> +	array will change the ``elems`` field when the control is
>> +	queried afterwards.
> I am proposing a change to the dynamic array implementation: initially
> dynamic array controls start off as empty arrays (0 elements). This also
> allows userspace to set a dynamic array control to an empty array.
>
> It probably would also make sense to add a min_dyn_elems to set the minimum
> allowed number of elements for a dynamic array. This would most likely be
> either 0 or 1.
>
> In the context of this HEVC series, does it help to allow empty dynamic arrays?
>
> For V4L2_CID_STATELESS_HEVC_ENTRY_POINT_OFFSETS in particular it looks like
> it would make sense since I think (correct me if I am wrong) there can be 0
> entry point offsets. So with empty arrays supported would the field
> num_entry_point_offsets still be needed?

yes it possible to have 0 entry point offsets in bitstream but in this case
I think the stack won't use V4L2_CID_STATELESS_HEVC_ENTRY_POINT_OFFSETS because
it have not data to send.
I have introduce num_entry_point_offsets field because most of the drivers
only need this information and not the full offsets array so I think it is needed.
For now none of the drivers use V4L2_CID_STATELESS_HEVC_ENTRY_POINT_OFFSETS
control, it is here to be future proof.

Regards,
Benjamin

>
> If you want to test, then let me know and I mail a very simple patch adding
> support for empty arrays (not yet min_dyn_elems, though).
>
> Regards,
>
> 	Hans
>
>>   
>>   Return Value
>>   ============
>> diff --git a/include/uapi/linux/videodev2.h b/include/uapi/linux/videodev2.h
>> index 5311ac4fde35..9018aa984db3 100644
>> --- a/include/uapi/linux/videodev2.h
>> +++ b/include/uapi/linux/videodev2.h
>> @@ -1890,6 +1890,7 @@ struct v4l2_querymenu {
>>   #define V4L2_CTRL_FLAG_HAS_PAYLOAD	0x0100
>>   #define V4L2_CTRL_FLAG_EXECUTE_ON_WRITE	0x0200
>>   #define V4L2_CTRL_FLAG_MODIFY_LAYOUT	0x0400
>> +#define V4L2_CTRL_FLAG_DYNAMIC_ARRAY	0x0800
>>   
>>   /*  Query flags, to be ORed with the control ID */
>>   #define V4L2_CTRL_FLAG_NEXT_CTRL	0x80000000

_______________________________________________
Linux-rockchip mailing list
Linux-rockchip@lists.infradead.org
http://lists.infradead.org/mailman/listinfo/linux-rockchip

  reply	other threads:[~2022-06-15 10:18 UTC|newest]

Thread overview: 36+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2022-06-14  8:35 [PATCH v8 00/17] Move HEVC stateless controls out of staging Benjamin Gaignard
2022-06-14  8:35 ` [PATCH v8 01/17] videodev2.h: add V4L2_CTRL_FLAG_DYNAMIC_ARRAY Benjamin Gaignard
2022-06-15  9:33   ` Hans Verkuil
2022-06-15 10:18     ` Benjamin Gaignard [this message]
2022-06-15 10:21     ` John Cox
2022-06-14  8:35 ` [PATCH v8 02/17] v4l2-ctrls: add support for dynamically allocated arrays Benjamin Gaignard
2022-06-14  8:36 ` [PATCH v8 03/17] vivid: add dynamic array test control Benjamin Gaignard
2022-06-14  8:36 ` [PATCH v8 04/17] media: uapi: HEVC: Add missing fields in HEVC controls Benjamin Gaignard
2022-06-14 12:28   ` Hans Verkuil
2022-06-14  8:36 ` [PATCH v8 05/17] media: uapi: HEVC: Rename HEVC stateless controls with STATELESS prefix Benjamin Gaignard
2022-06-14  8:36 ` [PATCH v8 06/17] media: uapi: HEVC: Change pic_order_cnt definition in v4l2_hevc_dpb_entry Benjamin Gaignard
2022-06-14  8:36 ` [PATCH v8 07/17] media: uapi: HEVC: Add SEI pic struct flags Benjamin Gaignard
2022-06-14  8:36 ` [PATCH v8 08/17] media: uapi: HEVC: Add documentation to uAPI structure Benjamin Gaignard
2022-06-14 13:39   ` Hans Verkuil
2022-06-14 15:20     ` Benjamin Gaignard
2022-06-14  8:36 ` [PATCH v8 09/17] media: uapi: HEVC: Define V4L2_CID_STATELESS_HEVC_SLICE_PARAMS as a dynamic array Benjamin Gaignard
2022-06-14 13:50   ` Hans Verkuil
2022-06-14 15:35     ` Jernej Škrabec
2022-06-14 17:50       ` John Cox
2022-06-14  8:36 ` [PATCH v8 10/17] media: uapi: Move parsed HEVC pixel format out of staging Benjamin Gaignard
2022-06-14  8:36 ` [PATCH v8 11/17] media: uapi: Add V4L2_CID_STATELESS_HEVC_ENTRY_POINT_OFFSETS control Benjamin Gaignard
2022-06-14  8:36 ` [PATCH v8 12/17] media: uapi: Move the HEVC stateless control type out of staging Benjamin Gaignard
2022-06-14  8:36 ` [PATCH v8 13/17] media: controls: Log HEVC stateless control in .std_log Benjamin Gaignard
2022-06-14  8:36 ` [PATCH v8 14/17] media: hantro: Stop using Hantro dedicated control Benjamin Gaignard
2022-06-14 13:58   ` Hans Verkuil
2022-06-14 15:43     ` Nicolas Dufresne
2022-06-14 15:47       ` Hans Verkuil
2022-06-14 16:23         ` Nicolas Dufresne
2022-06-14 16:46           ` Benjamin Gaignard
2022-06-21 14:50             ` Nicolas Dufresne
2022-06-14  8:36 ` [PATCH v8 15/17] media: uapi: HEVC: fix padding in v4l2 control structures Benjamin Gaignard
2022-06-14 14:09   ` Hans Verkuil
2022-06-14 15:19     ` Benjamin Gaignard
2022-06-14  8:36 ` [PATCH v8 16/17] media: uapi: Change data_bit_offset definition Benjamin Gaignard
2022-06-14  8:36 ` [PATCH v8 17/17] media: uapi: move HEVC stateless controls out of staging Benjamin Gaignard
2022-06-14 10:28 ` [PATCH v8 00/17] Move " Hans Verkuil

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=6cb4ab4f-1132-f386-6dd0-bf4eeab4433c@collabora.com \
    --to=benjamin.gaignard@collabora.com \
    --cc=andrzej.p@collabora.com \
    --cc=ezequiel@vanguardiasur.com.ar \
    --cc=gregkh@linuxfoundation.org \
    --cc=hverkuil-cisco@xs4all.nl \
    --cc=hverkuil@xs4all.nl \
    --cc=jernej.skrabec@gmail.com \
    --cc=kernel@collabora.com \
    --cc=linux-arm-kernel@lists.infradead.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-media@vger.kernel.org \
    --cc=linux-rockchip@lists.infradead.org \
    --cc=linux-staging@lists.linux.dev \
    --cc=linux-sunxi@lists.linux.dev \
    --cc=mchehab@kernel.org \
    --cc=mripard@kernel.org \
    --cc=nicolas.dufresne@collabora.com \
    --cc=p.zabel@pengutronix.de \
    --cc=paul.kocialkowski@bootlin.com \
    --cc=samuel@sholland.org \
    --cc=wens@csie.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox