public inbox for linux-media@vger.kernel.org
 help / color / mirror / Atom feed
From: Vikash Garodia <quic_vgarodia@quicinc.com>
To: Dmitry Baryshkov <dmitry.baryshkov@oss.qualcomm.com>
Cc: Dikshita Agarwal <quic_dikshita@quicinc.com>,
	Abhinav Kumar <abhinav.kumar@linux.dev>,
	Bryan O'Donoghue <bryan.odonoghue@linaro.org>,
	Mauro Carvalho Chehab <mchehab@kernel.org>,
	Rob Herring <robh@kernel.org>,
	Krzysztof Kozlowski <krzk+dt@kernel.org>,
	Conor Dooley <conor+dt@kernel.org>, <linux-media@vger.kernel.org>,
	<linux-arm-msm@vger.kernel.org>, <devicetree@vger.kernel.org>,
	<linux-kernel@vger.kernel.org>
Subject: Re: [PATCH 1/5] dt-bindings: media: qcom,sm8550-iris: add non_pixel and resv_region properties
Date: Tue, 24 Jun 2025 21:41:35 +0530	[thread overview]
Message-ID: <85137a8e-45be-3bb2-d094-79754fa2a8be@quicinc.com> (raw)
In-Reply-To: <x7xskkv6nviz3j7sr5qgs7yt7z6txqwdemfammufwdf6ji3sla@gi2a4aadt6wc>


On 6/21/2025 3:09 AM, Dmitry Baryshkov wrote:
> On Fri, Jun 20, 2025 at 11:50:51AM +0530, Vikash Garodia wrote:
>> Existing definition limits the IOVA to an addressable range of 4GiB, and
>> even within that range, some of the space is used by IO registers,
>> thereby limiting the available IOVA to even lesser. Video hardware is
>> designed to emit different stream-ID for pixel and non_pixel buffers,
>> thereby introduce a non_pixel sub node to handle non_pixel stream-ID.
>>
>> With this, both iris and non_pixel device can have IOVA range of 0-4GiB
>> individually. Certain video usecases like higher video concurrency needs
>> IOVA higher than 4GiB.
>>
>> Add the "resv_region" property, which defines reserved IOVA regions that
>> are *excluded* from addressable range. Video hardware generates
>> different stream IDs based on the range of IOVA addresses. Thereby IOVA
>> addresses for firmware and data buffers need to be non overlapping. For
>> ex. 0x0-0x25800000 address range is reserved for firmware stream-ID,
>> while non_pixel (bitstream ) stream-ID can be generated by hardware only
>> when bitstream buffers IOVA address is from 0x25800000-0xe0000000.
>>
>> Signed-off-by: Vikash Garodia <quic_vgarodia@quicinc.com>
>> ---
>>  .../bindings/media/qcom,sm8550-iris.yaml           | 35 ++++++++++++++++++++++
>>  1 file changed, 35 insertions(+)
>>
>> diff --git a/Documentation/devicetree/bindings/media/qcom,sm8550-iris.yaml b/Documentation/devicetree/bindings/media/qcom,sm8550-iris.yaml
>> index c79bf2101812d83b99704f38b7348a9f728dff44..a1e83bae3c36f3a4c58b212ef457905e38091b97 100644
>> --- a/Documentation/devicetree/bindings/media/qcom,sm8550-iris.yaml
>> +++ b/Documentation/devicetree/bindings/media/qcom,sm8550-iris.yaml
>> @@ -65,10 +65,45 @@ properties:
>>        - const: core
>>  
>>    iommus:
>> +    minItems: 1
>>      maxItems: 2
>>  
>>    dma-coherent: true
>>  
>> +  resv_region:
> 
> Ugh. Underscores...
ACK
> 
>> +    type: object
>> +    additionalProperties: false
>> +
>> +    description:
>> +      Reserve region specifies regions which should be excluded from IOVA.
>> +
>> +    properties:
>> +      iommu-addresses:
> 
> Missing type / ref. Also they are only described for reserved memory
> regions.
yes, looks like we can drop them from iris schema and rather reference it from
reserved-memory schema. Awaiting comments on the ongoing discussion here [1]

[1] https://lore.kernel.org/all/4c6233d9-be7b-baf3-fb05-3ea007e35330@quicinc.com/
> 
>> +        minItems: 1
>> +        maxItems: 4
>> +
>> +    required:
>> +      - iommu-addresses
>> +
>> +  non_pixel:
>> +    type: object
>> +    additionalProperties: false
> 
> 
> I still think that these usecases should be described with iommu-maps
> rather than subnodes. You have a limited set of usecases: "non-pixel",
> secure buffers, etc. Define an ID for each of those and then allocate a
> subdevice internally, mapping it to a corresponding set of IOMMUs.
In secure buffers category, there would be 3 categories -
pixel/non-pixel/internal. Adding it up with non secure, we would be having 4 sub
nodes eventually.
Reading about the usage of iommu-maps, I see there are below limitations. If you
could suggest a way to handle these,
1. let say there are 4 stream-ids, iommu-maps does not provide a way to tell
which stream-id is for which sub hardware block(device) within video, so that
driver can use it for mapping the corresponding buffers.
2. defining the masks for different stream-ids.
3. IOVA address regions - Different stream-ids have non-mappable range, which i
am specifying via iommu-addresses in sub nodes.

Again, iommu-maps was invented for PCIe case where different stream-id can be
routed to different iommus. In this case, all stream-id would be managed by same
iommu.

Regards,
Vikash
> 
>> +
>> +    description:
>> +      Non pixel context bank is needed when video hardware have distinct iommus
>> +      for non pixel buffers.
> 
> What does non-pixel mean? Compressed data?
> 
>> +
>> +    properties:
>> +      iommus:
>> +        maxItems: 1
>> +
>> +      memory-region:
>> +        maxItems: 1
>> +
>> +    required:
>> +      - iommus
>> +      - memory-region
>> +
>>    operating-points-v2: true
>>  
>>    opp-table:
>>
>> -- 
>> 2.34.1
>>
> 

  reply	other threads:[~2025-06-24 16:11 UTC|newest]

Thread overview: 14+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2025-06-20  6:20 [PATCH 0/5] Introduce "non_pixel" sub node within iris video node Vikash Garodia
2025-06-20  6:20 ` [PATCH 1/5] dt-bindings: media: qcom,sm8550-iris: add non_pixel and resv_region properties Vikash Garodia
2025-06-20  6:39   ` Krzysztof Kozlowski
2025-06-20 17:27     ` Konrad Dybcio
2025-06-24  8:33       ` Krzysztof Kozlowski
2025-06-27 19:51       ` Rob Herring
2025-06-23 10:01     ` Vikash Garodia
2025-06-20  6:41   ` Krzysztof Kozlowski
2025-06-20 21:39   ` Dmitry Baryshkov
2025-06-24 16:11     ` Vikash Garodia [this message]
2025-06-20  6:20 ` [PATCH 2/5] media: iris: register and configure non-pixel node as platform device Vikash Garodia
2025-06-20  6:20 ` [PATCH 3/5] media: iris: use np_dev as preferred DMA device in HFI queue management Vikash Garodia
2025-06-20  6:20 ` [PATCH 4/5] media: iris: select appropriate DMA device for internal buffers Vikash Garodia
2025-06-20  6:20 ` [PATCH 5/5] media: iris: configure DMA device for vb2 queue on OUTPUT plane Vikash Garodia

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=85137a8e-45be-3bb2-d094-79754fa2a8be@quicinc.com \
    --to=quic_vgarodia@quicinc.com \
    --cc=abhinav.kumar@linux.dev \
    --cc=bryan.odonoghue@linaro.org \
    --cc=conor+dt@kernel.org \
    --cc=devicetree@vger.kernel.org \
    --cc=dmitry.baryshkov@oss.qualcomm.com \
    --cc=krzk+dt@kernel.org \
    --cc=linux-arm-msm@vger.kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-media@vger.kernel.org \
    --cc=mchehab@kernel.org \
    --cc=quic_dikshita@quicinc.com \
    --cc=robh@kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox