From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 7C72CC433EF for ; Thu, 14 Oct 2021 17:44:12 +0000 (UTC) Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 3776161037 for ; Thu, 14 Oct 2021 17:44:12 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.4.1 mail.kernel.org 3776161037 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=gmail.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=lists.infradead.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender: Content-Transfer-Encoding:Content-Type:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:MIME-Version:References:In-Reply-To: Message-ID:Date:Subject:Cc:To:From:Reply-To:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: List-Owner; bh=zPyx0CbnzbzRs3lzLf4d04wcOgdczGgZSTooAgjkbto=; b=YBOQ3ze5vWFb08 5vlpvFnkRiBqmkBeVZKSdudvMsTFMUwSe52Txo7wnoqb428mTxjzx+iqAO+67oNN8B9bj5jJbTpbd qj6W1qELgO6vyc5Lvpcw/kb1k2pWuETyh5F0QiUIiI9GhPGDCdHr52AuiAnEwjZJ2ctOFMsy3ArRG kkdBUj/d0wKxIXJcipiKE7w7RuZx64J9XnZtvpeQe38HtD/l7s7im7KVuzreOsvjutl0Yd9KdLjNa xoWSZtLOVqIh2Vtg/Lr7Io32ouYBfYNvbSylaQ1txsbYME3/5oxTw9/WkPjDv/RdE6yNMNGMqXssB dsbK5Wiz8VheXzq7z8wA==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.94.2 #2 (Red Hat Linux)) id 1mb4kk-003yoS-EV; Thu, 14 Oct 2021 17:42:50 +0000 Received: from mail-ed1-x52b.google.com ([2a00:1450:4864:20::52b]) by bombadil.infradead.org with esmtps (Exim 4.94.2 #2 (Red Hat Linux)) id 1mb4kg-003ymg-98; Thu, 14 Oct 2021 17:42:48 +0000 Received: by mail-ed1-x52b.google.com with SMTP id w19so27247631edd.2; Thu, 14 Oct 2021 10:42:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=zLI8UuR3pkgHeZM4V6sxJZ+Ut+m2H9imLdrhh7Q8s0A=; b=KSrQmbHIMByWq+kaSnKMxl49Tl7+DIUKXzoYdMSjLTE8PA02qmYYGgEaa4+1fyQoin +K0OxKMAt0AUxIYOJdaJbmNKj/q2HEeWLxu710tVRw1xLlYmNt14PLAXVQRUkN0lPElS jweK9Fi/vqVAnqUlfputkZxCU+CWEY4akAeWXqBCxQQC+F46eo9YnVkdErB3oHn6wodO CK9wMnLkw29IHbbLCqjRqM+oLb/6JTCVpyuHkLx/QymKZ2NbeXkivn3HP0inkrbMyR4D +LO8k4ZPbjfdU27vp4ZlWr3vp4r/CafZ566n9nR+TZaCBKCkqOAYxP2yPcFGs7gRz9D7 BsJw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=zLI8UuR3pkgHeZM4V6sxJZ+Ut+m2H9imLdrhh7Q8s0A=; b=k8l2YoCIYYEkRkS2L8mTNCSMS8Nz8iISmKPFgRiEgCIrW/fVtOlBfmozuddfe7LSO/ sxHOD2qbIlt+NodHXdiQ48snO6ORq816hGIzImgZYYThPzaZLN+HZqFfxW/qwv1IJPJm QzE9Uc9j3k8sZA3KxgkMYUFq8PLjo8nxcv+EuQQ5Ev+yNGuDr56vXfuxB3FV/X9AttbD 2WSJc4OyS8KAGWKUMQPSsm5C/izXSZtVMBbO3SNJ8M85iYE7xa30UWvm05k0xgYlawRV QblcKFpGz9SvfAucDCri6ATSVyFp7X8gG/ZTkQBuFl5+A/Er8K6/UNqZsYgTL6fA1ayN Xg5Q== X-Gm-Message-State: AOAM5337nmSfl9rJwxYelj2n1FgLYLL8Im5fP1XlApRXdUvhT0lvDKPi F4PKyBslN9XKaFXKIh6XnXk= X-Google-Smtp-Source: ABdhPJx+5lUPz0Zrs/u7w8M2h7iss+VIvuoxVbEYwB9BVAuNqx933yzdI2ytQiPPyPv7qKowp47NLQ== X-Received: by 2002:a17:906:1491:: with SMTP id x17mr482051ejc.50.1634233363450; Thu, 14 Oct 2021 10:42:43 -0700 (PDT) Received: from kista.localnet (cpe-86-58-29-253.static.triera.net. [86.58.29.253]) by smtp.gmail.com with ESMTPSA id r1sm2503846edp.56.2021.10.14.10.42.41 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 14 Oct 2021 10:42:42 -0700 (PDT) From: Jernej =?utf-8?B?xaBrcmFiZWM=?= To: linux-media@vger.kernel.org, linux-arm-kernel@lists.infradead.org, linux-kernel@vger.kernel.org, linux-rockchip@lists.infradead.org, linux-staging@lists.linux.dev, Andrzej Pietrasiewicz Cc: Andrzej Pietrasiewicz , Benjamin Gaignard , Boris Brezillon , Ezequiel Garcia , Fabio Estevam , Greg Kroah-Hartman , Hans Verkuil , Heiko Stuebner , Mauro Carvalho Chehab , Nicolas Dufresne , NXP Linux Team , Pengutronix Kernel Team , Philipp Zabel , Sascha Hauer , Shawn Guo , kernel@collabora.com, Ezequiel Garcia Subject: Re: [PATCH v7 11/11] media: hantro: Support NV12 on the G2 core Date: Thu, 14 Oct 2021 19:42:41 +0200 Message-ID: <3448839.R56niFO833@kista> In-Reply-To: <20210929160439.6601-12-andrzej.p@collabora.com> References: <20210929160439.6601-1-andrzej.p@collabora.com> <20210929160439.6601-12-andrzej.p@collabora.com> MIME-Version: 1.0 X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20211014_104246_386881_64B0783B X-CRM114-Status: GOOD ( 26.96 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org Hi Andrzej! Dne sreda, 29. september 2021 ob 18:04:39 CEST je Andrzej Pietrasiewicz napisal(a): > The G2 decoder block produces NV12 4x4 tiled format (NV12_4L4). > Enable the G2 post-processor block, in order to produce regular NV12. > > The logic in hantro_postproc.c is leveraged to take care of allocating > the extra buffers and configure the post-processor, which is > significantly simpler than the one on the G1. Quick summary of discussion on LibreELEC Slack: When using NV12 format on Allwinner H6 variant of G2 (needs some driver changes), I get frames out of order. If I use native NV12 tiled format, frames are ordered correctly. Currently I'm not sure if this is issue with my changes or is this general issue. I would be grateful if anyone can test frame order with and without postprocessing enabled on imx8. Take some dynamic video with a lot of short scenes. It's pretty obvious when frames are out of order. However, given that frames themself are correctly decoded and without postprocessing in right order, that shouldn't block merging previous patches. I tried few different videos and frames were all decoded correctly. Best regards, Jernej > > Signed-off-by: Ezequiel Garcia > Signed-off-by: Andrzej Pietrasiewicz > --- > .../staging/media/hantro/hantro_g2_vp9_dec.c | 6 ++-- > drivers/staging/media/hantro/hantro_hw.h | 1 + > .../staging/media/hantro/hantro_postproc.c | 31 +++++++++++++++++++ > drivers/staging/media/hantro/imx8m_vpu_hw.c | 11 +++++++ > 4 files changed, 46 insertions(+), 3 deletions(-) > > diff --git a/drivers/staging/media/hantro/hantro_g2_vp9_dec.c b/drivers/ staging/media/hantro/hantro_g2_vp9_dec.c > index 7f827b9f0133..1a26be72c878 100644 > --- a/drivers/staging/media/hantro/hantro_g2_vp9_dec.c > +++ b/drivers/staging/media/hantro/hantro_g2_vp9_dec.c > @@ -152,7 +152,7 @@ static void config_output(struct hantro_ctx *ctx, > hantro_reg_write(ctx->dev, &g2_out_dis, 0); > hantro_reg_write(ctx->dev, &g2_output_format, 0); > > - luma_addr = vb2_dma_contig_plane_dma_addr(&dst->base.vb.vb2_buf, 0); > + luma_addr = hantro_get_dec_buf_addr(ctx, &dst->base.vb.vb2_buf); > hantro_write_addr(ctx->dev, G2_OUT_LUMA_ADDR, luma_addr); > > chroma_addr = luma_addr + chroma_offset(ctx, dec_params); > @@ -191,7 +191,7 @@ static void config_ref(struct hantro_ctx *ctx, > hantro_reg_write(ctx->dev, &ref_reg->hor_scale, (refw << 14) / dst->vp9.width); > hantro_reg_write(ctx->dev, &ref_reg->ver_scale, (refh << 14) / dst->vp9.height); > > - luma_addr = vb2_dma_contig_plane_dma_addr(&buf->base.vb.vb2_buf, 0); > + luma_addr = hantro_get_dec_buf_addr(ctx, &buf->base.vb.vb2_buf); > hantro_write_addr(ctx->dev, ref_reg->y_base, luma_addr); > > chroma_addr = luma_addr + chroma_offset(ctx, dec_params); > @@ -236,7 +236,7 @@ static void config_ref_registers(struct hantro_ctx *ctx, > config_ref(ctx, dst, &ref_regs[1], dec_params, dec_params- >golden_frame_ts); > config_ref(ctx, dst, &ref_regs[2], dec_params, dec_params- >alt_frame_ts); > > - mv_addr = vb2_dma_contig_plane_dma_addr(&mv_ref->base.vb.vb2_buf, 0) + > + mv_addr = hantro_get_dec_buf_addr(ctx, &mv_ref->base.vb.vb2_buf) + > mv_offset(ctx, dec_params); > hantro_write_addr(ctx->dev, G2_REF_MV_ADDR(0), mv_addr); > > diff --git a/drivers/staging/media/hantro/hantro_hw.h b/drivers/staging/ media/hantro/hantro_hw.h > index 2961d399fd60..3d4a5dc1e6d5 100644 > --- a/drivers/staging/media/hantro/hantro_hw.h > +++ b/drivers/staging/media/hantro/hantro_hw.h > @@ -274,6 +274,7 @@ extern const struct hantro_variant rk3399_vpu_variant; > extern const struct hantro_variant sama5d4_vdec_variant; > > extern const struct hantro_postproc_ops hantro_g1_postproc_ops; > +extern const struct hantro_postproc_ops hantro_g2_postproc_ops; > > extern const u32 hantro_vp8_dec_mc_filter[8][6]; > > diff --git a/drivers/staging/media/hantro/hantro_postproc.c b/drivers/ staging/media/hantro/hantro_postproc.c > index 4549aec08feb..79a66d001738 100644 > --- a/drivers/staging/media/hantro/hantro_postproc.c > +++ b/drivers/staging/media/hantro/hantro_postproc.c > @@ -11,6 +11,7 @@ > #include "hantro.h" > #include "hantro_hw.h" > #include "hantro_g1_regs.h" > +#include "hantro_g2_regs.h" > > #define HANTRO_PP_REG_WRITE(vpu, reg_name, val) \ > { \ > @@ -99,6 +100,21 @@ static void hantro_postproc_g1_enable(struct hantro_ctx *ctx) > HANTRO_PP_REG_WRITE(vpu, display_width, ctx->dst_fmt.width); > } > > +static void hantro_postproc_g2_enable(struct hantro_ctx *ctx) > +{ > + struct hantro_dev *vpu = ctx->dev; > + struct vb2_v4l2_buffer *dst_buf; > + size_t chroma_offset = ctx->dst_fmt.width * ctx->dst_fmt.height; > + dma_addr_t dst_dma; > + > + dst_buf = hantro_get_dst_buf(ctx); > + dst_dma = vb2_dma_contig_plane_dma_addr(&dst_buf->vb2_buf, 0); > + > + hantro_write_addr(vpu, G2_RS_OUT_LUMA_ADDR, dst_dma); > + hantro_write_addr(vpu, G2_RS_OUT_CHROMA_ADDR, dst_dma + chroma_offset); > + hantro_reg_write(vpu, &g2_out_rs_e, 1); > +} > + > void hantro_postproc_free(struct hantro_ctx *ctx) > { > struct hantro_dev *vpu = ctx->dev; > @@ -127,6 +143,9 @@ int hantro_postproc_alloc(struct hantro_ctx *ctx) > if (ctx->vpu_src_fmt->fourcc == V4L2_PIX_FMT_H264_SLICE) > buf_size += hantro_h264_mv_size(ctx->dst_fmt.width, > ctx- >dst_fmt.height); > + else if (ctx->vpu_src_fmt->fourcc == V4L2_PIX_FMT_VP9_FRAME) > + buf_size += hantro_vp9_mv_size(ctx->dst_fmt.width, > + ctx- >dst_fmt.height); > > for (i = 0; i < num_buffers; ++i) { > struct hantro_aux_buf *priv = &ctx->postproc.dec_q[i]; > @@ -152,6 +171,13 @@ static void hantro_postproc_g1_disable(struct hantro_ctx *ctx) > HANTRO_PP_REG_WRITE_S(vpu, pipeline_en, 0x0); > } > > +static void hantro_postproc_g2_disable(struct hantro_ctx *ctx) > +{ > + struct hantro_dev *vpu = ctx->dev; > + > + hantro_reg_write(vpu, &g2_out_rs_e, 0); > +} > + > void hantro_postproc_disable(struct hantro_ctx *ctx) > { > struct hantro_dev *vpu = ctx->dev; > @@ -172,3 +198,8 @@ const struct hantro_postproc_ops hantro_g1_postproc_ops = { > .enable = hantro_postproc_g1_enable, > .disable = hantro_postproc_g1_disable, > }; > + > +const struct hantro_postproc_ops hantro_g2_postproc_ops = { > + .enable = hantro_postproc_g2_enable, > + .disable = hantro_postproc_g2_disable, > +}; > diff --git a/drivers/staging/media/hantro/imx8m_vpu_hw.c b/drivers/staging/ media/hantro/imx8m_vpu_hw.c > index 455a107ffb02..1a43f6fceef9 100644 > --- a/drivers/staging/media/hantro/imx8m_vpu_hw.c > +++ b/drivers/staging/media/hantro/imx8m_vpu_hw.c > @@ -132,6 +132,14 @@ static const struct hantro_fmt imx8m_vpu_dec_fmts[] = { > }, > }; > > +static const struct hantro_fmt imx8m_vpu_g2_postproc_fmts[] = { > + { > + .fourcc = V4L2_PIX_FMT_NV12, > + .codec_mode = HANTRO_MODE_NONE, > + .postprocessed = true, > + }, > +}; > + > static const struct hantro_fmt imx8m_vpu_g2_dec_fmts[] = { > { > .fourcc = V4L2_PIX_FMT_NV12_4L4, > @@ -301,6 +309,9 @@ const struct hantro_variant imx8mq_vpu_g2_variant = { > .dec_offset = 0x0, > .dec_fmts = imx8m_vpu_g2_dec_fmts, > .num_dec_fmts = ARRAY_SIZE(imx8m_vpu_g2_dec_fmts), > + .postproc_fmts = imx8m_vpu_g2_postproc_fmts, > + .num_postproc_fmts = ARRAY_SIZE(imx8m_vpu_g2_postproc_fmts), > + .postproc_ops = &hantro_g2_postproc_ops, > .codec = HANTRO_HEVC_DECODER | HANTRO_VP9_DECODER, > .codec_ops = imx8mq_vpu_g2_codec_ops, > .init = imx8mq_vpu_hw_init, > -- > 2.17.1 > > _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel