From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id 9ACFEC433EF for ; Thu, 30 Jun 2022 22:24:22 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230130AbiF3WYV (ORCPT ); Thu, 30 Jun 2022 18:24:21 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:52724 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229531AbiF3WYU (ORCPT ); Thu, 30 Jun 2022 18:24:20 -0400 Received: from mail-il1-f177.google.com (mail-il1-f177.google.com [209.85.166.177]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 4C9BE2873F; Thu, 30 Jun 2022 15:24:19 -0700 (PDT) Received: by mail-il1-f177.google.com with SMTP id p14so319492ile.1; Thu, 30 Jun 2022 15:24:19 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=QCIN9X+au2FWfJK4vD7gv31EP7AOrK4M9CuPs1cmp3w=; b=Qc/+i4oBp5ffKAgWYwt3LY36/kINbsJiS4E0RTwIfV4VtuZch+NJX1daCndX3aEjTk jtpErd44L9jqDkipWwz22nYYF/4qMPJ5mtGdVIOlQzbgHtl8aL2R8JpEdFhxVTiLFxO2 gK/CVxFtpVbe0OkBgqzBL/KY2YTr3SbkWXzvSzU+Cs6Ey68JGMutkqFps/zxqfPGEVB4 L/3jnPULgC2+EoDfwqj4pTzsjymQQUTngW38SP0yV9rvogQRmbeVogHCfGLDxRb5QAae MvCVjwH90lia1vw9lek7Vyj3UBe5xVK0h2YaS6PR1cuQ+TA8n2QljnzwrD786vKhjnob 3oog== X-Gm-Message-State: AJIora+SKtynfqCpavgshasgzxbgIZYs/OSbNNI+lAAShqkqACHsBnF0 xFb9CjmvrOmg7ljgADVYXA== X-Google-Smtp-Source: AGRyM1vuc7JqudR/4gKzjExLt1n+/E0hzumEYFNUOrWm+0+DOzzs3jZYqzgptf8ybdjqJZ1rz6Cqyg== X-Received: by 2002:a92:c567:0:b0:2d1:6268:2fd5 with SMTP id b7-20020a92c567000000b002d162682fd5mr6456227ilj.255.1656627858397; Thu, 30 Jun 2022 15:24:18 -0700 (PDT) Received: from robh.at.kernel.org ([64.188.179.248]) by smtp.gmail.com with ESMTPSA id k16-20020a023350000000b00339cb105ae7sm9241387jak.92.2022.06.30.15.24.16 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 30 Jun 2022 15:24:18 -0700 (PDT) Received: (nullmailer pid 3431797 invoked by uid 1000); Thu, 30 Jun 2022 22:24:14 -0000 Date: Thu, 30 Jun 2022 16:24:14 -0600 From: Rob Herring To: Irui Wang Cc: Hans Verkuil , Mauro Carvalho Chehab , Matthias Brugger , Tomasz Figa , Tzung-Bi Shih , Alexandre Courbot , Tiffany Lin , Andrew-CT Chen , angelogioacchino.delregno@collabora.com, nicolas.dufresne@collabora.com, Hsin-Yi Wang , Maoguang Meng , Longfei Wang , Yunfei Dong , linux-media@vger.kernel.org, devicetree@vger.kernel.org, linux-kernel@vger.kernel.org, linux-arm-kernel@lists.infradead.org, srv_heupstream@mediatek.com, linux-mediatek@lists.infradead.org, Project_Global_Chrome_Upstream_Group@mediatek.com Subject: Re: [PATCH v4, 1/8] dt-bindings: media: mediatek: vcodec: Adds encoder cores dt-bindings for mt8195 Message-ID: <20220630222414.GA3419242-robh@kernel.org> References: <20220624082335.10165-1-irui.wang@mediatek.com> <20220624082335.10165-2-irui.wang@mediatek.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20220624082335.10165-2-irui.wang@mediatek.com> Precedence: bulk List-ID: X-Mailing-List: devicetree@vger.kernel.org On Fri, Jun 24, 2022 at 04:23:28PM +0800, Irui Wang wrote: > mt8195 has two H264 encoder hardware, which are named core0 and core1. > The two encoder cores are independent, we can just enable one core to > do encoding or enable both of them to achieve higher performance. We > pick core0 as main device and core1 as its subdevice, it just a way to > to manage the two encoder hardware, because they are two equal encoder > hardware with the same function. If the h/w is symmetrical, why did you do this? > > Signed-off-by: Irui Wang > --- > .../media/mediatek,vcodec-encoder-core.yaml | 225 ++++++++++++++++++ > .../media/mediatek,vcodec-encoder.yaml | 1 - > 2 files changed, 225 insertions(+), 1 deletion(-) > create mode 100644 Documentation/devicetree/bindings/media/mediatek,vcodec-encoder-core.yaml > > diff --git a/Documentation/devicetree/bindings/media/mediatek,vcodec-encoder-core.yaml b/Documentation/devicetree/bindings/media/mediatek,vcodec-encoder-core.yaml > new file mode 100644 > index 000000000000..afd7d645aa80 > --- /dev/null > +++ b/Documentation/devicetree/bindings/media/mediatek,vcodec-encoder-core.yaml > @@ -0,0 +1,225 @@ > +# SPDX-License-Identifier: (GPL-2.0-only OR BSD-2-Clause) > + > +%YAML 1.2 > +--- > +$id: "http://devicetree.org/schemas/media/mediatek,vcodec-encoder-core.yaml#" > +$schema: "http://devicetree.org/meta-schemas/core.yaml#" > + > +title: MediaTek Video Encoder Accelerator With Multi Core > + > +maintainers: > + - Irui Wang > + > +description: | > + MediaTek Video Encoder is the video encoder hardware present in MediaTek > + SoCs which supports high resolution encoding functionalities. To meet higher > + encoder performance, there will be one or more encoder hardware inside SoC, > + which named core0, core1, etc.. For example, mt8195 has two encoder hardware, > + the two encoder cores block diagram, can check below. > + -------------------------------------------------------------- > + Input frame 0 1 2 3 4 5 6 > + | | | | | | | > + v | v | v | v > + +-------+ | +-------+ | +-------+ | +-------+ > + | core0 | | | core0 | | | core0 | | | core0 | > + +-------+ | +-------+ | +-------+ | +-------+ > + | | | | | | | > + | v | v | v | > + | +-------+ | +-------+ | +-------+ | > + | | core1 | | | core1 | | | core1 | | > + | +-------+ | +-------+ | +-------+ | > + | | | | | | | > + v v v v v v v > + -------------------------------------------------------------- > + core || index > + \/ > + +--------------------------------------------------+ > + | core0/core1 | > + | enable/disable power/clk/irq | > + +--------------------------------------------------+ > + -------------------------------------------------------------- > + As above, there are two cores child devices, they are two encoder hardware > + which can encode input frames in order. When start encoding, input frame 0 > + will be encoded by core0, and input frame 1 can be encoded by core1 even if > + frame 0 has not been encoded done yet, after frame 0 encoded done, frame 2 > + will be encoded by core0, even input frames are encoded by core0 and odd > + input frames are encoded by core1, these two encoder cores encode ench input > + frames in this overlapping manner. > + > +properties: > + compatible: > + items: > + - enum: > + - mediatek,mt8195-vcodec-enc > + > + reg: > + maxItems: 1 > + > + mediatek,scp: > + $ref: /schemas/types.yaml#/definitions/phandle > + description: | > + The node of system control processor (SCP), using > + the remoteproc & rpmsg framework. > + > + mediatek,venc-multi-core: Can't you detect this with presence of child nodes? > + type: boolean > + description: | > + Indicates whether the encoder has multiple cores or not. We use this > + to probe additional encoder cores device. > + > + iommus: > + minItems: 1 > + maxItems: 32 > + description: | > + List of the hardware port in respective IOMMU block for current Socs. > + Refer to bindings/iommu/mediatek,iommu.yaml. > + > + interrupts: > + maxItems: 1 > + > + clocks: > + maxItems: 1 > + > + clock-names: > + maxItems: 1 > + > + power-domains: > + maxItems: 1 > + > + dma-ranges: > + maxItems: 1 > + description: | > + Describes the physical address space of IOMMU maps to memory. > + > + "#address-cells": > + const: 2 > + > + "#size-cells": > + const: 2 > + > + ranges: true > + > +# Required child node: > +patternProperties: > + "^venc-core@[0-9a-f]+$": > + type: object > + description: | > + The video encoder core device node which should be added as subnodes to > + the main venc node, it represents a encoder hardware. > + > + properties: > + compatible: > + items: > + - const: mediatek,mtk-venc-hw > + > + reg: > + maxItems: 1 > + > + mediatek,hw-id: > + $ref: /schemas/types.yaml#/definitions/uint32 > + description: | > + Current encoder core id. We use it to pick which one encoder core > + will be used to encoding current input frame. > + > + iommus: > + minItems: 1 > + maxItems: 32 It looks like there are 9 iommus. How does this vary on an mt8195 SoC? > + description: | > + List of the hardware port in respective IOMMU block for current Socs. > + Refer to bindings/iommu/mediatek,iommu.yaml. > + > + interrupts: > + maxItems: 1 > + > + clocks: > + maxItems: 1 > + > + clock-names: > + maxItems: 1 > + > + power-domains: > + maxItems: 1 > + > + required: > + - compatible > + - reg > + - mediatek,hw-id > + - iommus > + - interrupts > + - clocks > + - clock-names > + - assigned-clocks > + - assigned-clock-parents > + - power-domains > + > + additionalProperties: false > + > +required: > + - compatible > + - reg > + - mediatek,scp > + - iommus > + - interrupts > + - clocks > + - clock-names > + - dma-ranges > + > +additionalProperties: false > + > +examples: > + - | > + #include > + #include > + #include > + #include > + #include > + > + soc { > + #address-cells = <2>; > + #size-cells = <2>; > + > + venc: venc@1a020000 { > + compatible = "mediatek,mt8195-vcodec-enc"; > + reg = <0 0x1a020000 0 0x10000>; > + mediatek,scp = <&scp>; > + mediatek,venc-multi-core; > + iommus = <&iommu_vdo M4U_PORT_L19_VENC_RCPU>, > + <&iommu_vdo M4U_PORT_L19_VENC_REC>, > + <&iommu_vdo M4U_PORT_L19_VENC_BSDMA>, > + <&iommu_vdo M4U_PORT_L19_VENC_SV_COMV>, > + <&iommu_vdo M4U_PORT_L19_VENC_RD_COMV>, > + <&iommu_vdo M4U_PORT_L19_VENC_CUR_LUMA>, > + <&iommu_vdo M4U_PORT_L19_VENC_CUR_CHROMA>, > + <&iommu_vdo M4U_PORT_L19_VENC_REF_LUMA>, > + <&iommu_vdo M4U_PORT_L19_VENC_REF_CHROMA>; > + interrupts = ; > + clocks = <&vencsys CLK_VENC_VENC>; > + clock-names = "clk_venc"; > + power-domains = <&spm MT8195_POWER_DOMAIN_VENC>; > + dma-ranges = <0x1 0x0 0x0 0x40000000 0x0 0xfff00000>; > + #address-cells = <2>; > + #size-cells = <2>; > + ranges; > + > + venc-core@1b020000 { > + compatible = "mediatek,mtk-venc-hw"; > + reg = <0 0x1b020000 0 0x10000>; > + mediatek,hw-id = <1>; > + iommus = <&iommu_vpp M4U_PORT_L20_VENC_RCPU>, > + <&iommu_vpp M4U_PORT_L20_VENC_REC>, > + <&iommu_vpp M4U_PORT_L20_VENC_BSDMA>, > + <&iommu_vpp M4U_PORT_L20_VENC_SV_COMV>, > + <&iommu_vpp M4U_PORT_L20_VENC_RD_COMV>, > + <&iommu_vpp M4U_PORT_L20_VENC_CUR_LUMA>, > + <&iommu_vpp M4U_PORT_L20_VENC_CUR_CHROMA>, > + <&iommu_vpp M4U_PORT_L20_VENC_REF_LUMA>, > + <&iommu_vpp M4U_PORT_L20_VENC_REF_CHROMA>; > + interrupts = ; > + clocks = <&vencsys_core1 CLK_VENC_CORE1_VENC>; > + clock-names = "clk_venc_core1"; > + assigned-clocks = <&topckgen CLK_TOP_VENC>; > + assigned-clock-parents = <&topckgen CLK_TOP_UNIVPLL_D4>; > + power-domains = <&spm MT8195_POWER_DOMAIN_VENC_CORE1>; > + }; > + }; > + }; > diff --git a/Documentation/devicetree/bindings/media/mediatek,vcodec-encoder.yaml b/Documentation/devicetree/bindings/media/mediatek,vcodec-encoder.yaml > index d36fcca04cbc..11682659c4c4 100644 > --- a/Documentation/devicetree/bindings/media/mediatek,vcodec-encoder.yaml > +++ b/Documentation/devicetree/bindings/media/mediatek,vcodec-encoder.yaml > @@ -21,7 +21,6 @@ properties: > - mediatek,mt8173-vcodec-enc > - mediatek,mt8183-vcodec-enc > - mediatek,mt8192-vcodec-enc > - - mediatek,mt8195-vcodec-enc > > reg: > maxItems: 1 > -- > 2.18.0 > >