public inbox for linux-kernel@vger.kernel.org
 help / color / mirror / Atom feed
From: Jacopo Mondi <jacopo.mondi@ideasonboard.com>
To: Antoine Bouyer <antoine.bouyer@nxp.com>
Cc: "Niklas Söderlund" <niklas.soderlund+renesas@ragnatech.se>,
	"Jai Luthra" <jai.luthra+renesas@ideasonboard.com>,
	"Mauro Carvalho Chehab" <mchehab@kernel.org>,
	"Kuninori Morimoto" <kuninori.morimoto.gx@renesas.com>,
	"Jacopo Mondi" <jacopo.mondi@ideasonboard.com>,
	"Laurent Pinchart" <laurent.pinchart@ideasonboard.com>,
	linux-media@vger.kernel.org, linux-renesas-soc@vger.kernel.org,
	linux-kernel@vger.kernel.org
Subject: Re: [v8 04/14] media: rppx1: wbmeas: Add support for white balance measurement
Date: Wed, 6 May 2026 16:22:30 +0200	[thread overview]
Message-ID: <aftOSBQ6qk0v73Tx@zed> (raw)
In-Reply-To: <e542034a-a3f2-4998-b581-70246fa7026e@nxp.com>

Hi Antoine

On Wed, May 06, 2026 at 03:58:30PM +0200, Antoine Bouyer wrote:
> On 5/4/26 3:05 AM, Niklas Söderlund wrote:
> > Extend the RPPX1 driver to allow setting the white balance measurement
> > configuration and consuming the resulting statistics. It uses the RPPX1
> > framework for parameters and its writer abstraction to allow the user to
> > control how, and when, configuration is applied to the RPPX1.
> >
> > Signed-off-by: Niklas Söderlund <niklas.soderlund+renesas@ragnatech.se>
> > Co-developed-by: Jai Luthra <jai.luthra+renesas@ideasonboard.com>
> > Signed-off-by: Jai Luthra <jai.luthra+renesas@ideasonboard.com>
> > ---
> >   .../platform/dreamchip/rppx1/rpp_module.h     |   2 +
> >   .../platform/dreamchip/rppx1/rpp_params.c     |   4 +
> >   .../platform/dreamchip/rppx1/rpp_stats.c      |  18 +++
> >   .../platform/dreamchip/rppx1/rppx1_wbmeas.c   | 103 ++++++++++++++++++
> >   .../uapi/linux/media/dreamchip/rppx1-config.h | 101 ++++++++++++++++-
> >   5 files changed, 226 insertions(+), 2 deletions(-)
> >
> > diff --git a/drivers/media/platform/dreamchip/rppx1/rpp_module.h b/drivers/media/platform/dreamchip/rppx1/rpp_module.h
> > index 742904973e35..85fb23174e57 100644
> > --- a/drivers/media/platform/dreamchip/rppx1/rpp_module.h
> > +++ b/drivers/media/platform/dreamchip/rppx1/rpp_module.h
> > @@ -85,10 +85,12 @@ void rpp_module_clrset(struct rpp_module *mod, u32 offset, u32 mask, u32 value);
> >
> >   union rppx1_params_block {
> >          struct v4l2_isp_params_block_header header;
> > +       struct rppx1_wbmeas_params wbmeas;
> >   };
> >
> >   union rppx1_stats_block {
> >          struct v4l2_isp_params_block_header header;
> > +       struct rppx1_wbmeas_stats wbmeas;
> >   };
> >
> >   struct rpp_module_ops {
> > diff --git a/drivers/media/platform/dreamchip/rppx1/rpp_params.c b/drivers/media/platform/dreamchip/rppx1/rpp_params.c
> > index a5feb18f3bd5..1262350d2190 100644
> > --- a/drivers/media/platform/dreamchip/rppx1/rpp_params.c
> > +++ b/drivers/media/platform/dreamchip/rppx1/rpp_params.c
> > @@ -16,6 +16,7 @@
> >
> >   static const struct v4l2_isp_block_type_info
> >   rppx1_ext_params_blocks_info[] = {
> > +       RPPX1_PARAMS_BLOCK_INFO(WBMEAS_POST, wbmeas),
> >   };
> >
> >   int rppx1_params(struct rppx1 *rpp, struct vb2_buffer *vb, size_t max_size,
> > @@ -50,6 +51,9 @@ int rppx1_params(struct rppx1 *rpp, struct vb2_buffer *vb, size_t max_size,
> >                  block_offset += block->header.size;
> >
> >                  switch (block->header.type) {
> > +               case RPPX1_PARAMS_BLOCK_TYPE_WBMEAS_POST:
> > +                       module = &rpp->post.wbmeas;
> > +                       break;
> >                  default:
> >                          module = NULL;
> >                          break;
> > diff --git a/drivers/media/platform/dreamchip/rppx1/rpp_stats.c b/drivers/media/platform/dreamchip/rppx1/rpp_stats.c
> > index 8f43e56ba361..4c38e657e5f0 100644
> > --- a/drivers/media/platform/dreamchip/rppx1/rpp_stats.c
> > +++ b/drivers/media/platform/dreamchip/rppx1/rpp_stats.c
> > @@ -14,6 +14,11 @@
> >                  .size = sizeof(struct rppx1_ ## block ## _stats), \
> >          }
> >
> > +static const struct v4l2_isp_block_type_info
> > +rppx1_stats_blocks_info[] = {
> > +       RPPX1_STATS_BLOCK_INFO(WBMEAS_POST, wbmeas),
> > +};
> > +
> >   #define rppx1_init_stats_block(rpp, buf, type)                         \
> >          ((union rppx1_stats_block *)                                    \
> >          v4l2_isp_stats_init_block((rpp)->dev, (buf),                    \
> > @@ -23,5 +28,18 @@
> >
> >   void rppx1_stats_fill_isr(struct rppx1 *rpp, u32 isc, void *buf)
> >   {
> > +       struct v4l2_isp_buffer *stats = buf;
> > +       union rppx1_stats_block *block;
> > +
> > +       v4l2_isp_stats_init_buffer(stats);
> > +
> > +       if (isc & RPPX1_IRQ_ID_POST_AWB_MEAS) {
> > +               block = rppx1_init_stats_block(rpp, stats,
> > +                                              RPPX1_STATS_BLOCK_TYPE_WBMEAS_POST);
> > +               if (!block)
>
> Hi Niklas
>
> I assume you need to use IS_ERR() here, instead of null pointer check, since
> v4l2_isp_stats_init_block() does return an error from this series [1].
>
> Same applies to other stats blocks.

Duh, thanks for catching! This is defintely my bad and not Niklas' has
I didn't update these callers when I changed the return value of
v4l2_isp_stats_init_block() ...

>
> BR
> Antoine
>
> [1] https://lore.kernel.org/linux-media/20260505-extensible-stats-v1-6-e16f326b8dad@ideasonboard.com/
>
> > +                       return;
> > +
> > +               rpp_module_call(&rpp->post.wbmeas, fill_stats, block);
> > +       }
> >   }
> >   EXPORT_SYMBOL_GPL(rppx1_stats_fill_isr);
> > diff --git a/drivers/media/platform/dreamchip/rppx1/rppx1_wbmeas.c b/drivers/media/platform/dreamchip/rppx1/rppx1_wbmeas.c
> > index 3d197d914d07..53263bc96280 100644
> > --- a/drivers/media/platform/dreamchip/rppx1/rppx1_wbmeas.c
> > +++ b/drivers/media/platform/dreamchip/rppx1/rppx1_wbmeas.c
> > @@ -56,6 +56,109 @@ static int rppx1_wbmeas_probe(struct rpp_module *mod)
> >          return 0;
> >   }
> >
> > +static int
> > +rppx1_wbmeas_fill_params(struct rpp_module *mod,
> > +                        const union rppx1_params_block *block,
> > +                        rppx1_reg_write write, void *priv)
> > +{
> > +       const struct rppx1_wbmeas_params *cfg = &block->wbmeas;
> > +       u32 awb_meas_props;
> > +
> > +       /* If the modules is disabled, simply bypass it. */
> > +       if (cfg->header.flags & V4L2_ISP_PARAMS_FL_BLOCK_DISABLE) {
> > +               write(priv, mod->base + AWB_MEAS_PROP_REG, 0);
> > +               return 0;
> > +       }
> > +
> > +       /* Program measurement window. */
> > +       write(priv, mod->base + AWB_MEAS_H_OFFS_REG, cfg->wnd.h_offs);
> > +       write(priv, mod->base + AWB_MEAS_V_OFFS_REG, cfg->wnd.v_offs);
> > +       write(priv, mod->base + AWB_MEAS_H_SIZE_REG, cfg->wnd.h_size);
> > +       write(priv, mod->base + AWB_MEAS_V_SIZE_REG, cfg->wnd.v_size);
> > +
> > +       /* Set number of frames to sample. */
> > +       write(priv, mod->base + AWB_MEAS_FRAMES_REG, cfg->frames);
> > +
> > +       if (cfg->mode == RPPX1_WBMEAS_MODE_YCBCR) {
> > +               write(priv, mod->base + AWB_MEAS_REF_CB_MAX_B_REG,
> > +                     cfg->ref_cb_max_b);
> > +               write(priv, mod->base + AWB_MEAS_REF_CR_MAX_R_REG,
> > +                     cfg->ref_cr_max_r);
> > +               write(priv, mod->base + AWB_MEAS_MAX_Y_REG, cfg->max_y);
> > +               write(priv, mod->base + AWB_MEAS_MIN_Y_MAX_G_REG,
> > +                     cfg->min_y_max_g);
> > +               write(priv, mod->base + AWB_MEAS_MAX_CSUM_REG, cfg->max_csum);
> > +               write(priv, mod->base + AWB_MEAS_MIN_C_REG, cfg->min_c);
> > +
> > +               /*
> > +                * Program the color conversion matrix coefficients and the
> > +                * per-color channel offsets.
> > +                */
> > +               for (unsigned int i = 0; i < 3; i++) {
> > +                       for (unsigned int j = 0; j < 3; j++) {
> > +                               unsigned int index = i * 3 + j;
> > +
> > +                               write(priv,
> > +                                     mod->base + AWB_MEAS_CCOR_COEFF_REG(index),
> > +                                     cfg->ccor_coeff[i][j]);
> > +                       }
> > +               }
> > +
> > +               write(priv, mod->base + AWB_MEAS_CCOR_OFFSET_R_REG,
> > +                     cfg->ccor_offs[0]);
> > +               write(priv, mod->base + AWB_MEAS_CCOR_OFFSET_G_REG,
> > +                     cfg->ccor_offs[1]);
> > +               write(priv, mod->base + AWB_MEAS_CCOR_OFFSET_B_REG,
> > +                     cfg->ccor_offs[2]);
> > +
> > +               awb_meas_props = cfg->ymax_cmp ? AWB_MEAS_PROP_YMAX : 0;
> > +       } else {
> > +               write(priv, mod->base + AWB_MEAS_REF_CB_MAX_B_REG,
> > +                     cfg->ref_cb_max_b);
> > +               write(priv, mod->base + AWB_MEAS_REF_CR_MAX_R_REG,
> > +                     cfg->ref_cr_max_r);
> > +               write(priv, mod->base + AWB_MEAS_MIN_Y_MAX_G_REG,
> > +                     cfg->min_y_max_g);
> > +
> > +               /* Bypass color conversion matrix and color offsets. */
> > +               write(priv, mod->base + AWB_MEAS_CCOR_COEFF_REG(0), 0x1000);
> > +               write(priv, mod->base + AWB_MEAS_CCOR_COEFF_REG(1), 0x0000);
> > +               write(priv, mod->base + AWB_MEAS_CCOR_COEFF_REG(2), 0x0000);
> > +               write(priv, mod->base + AWB_MEAS_CCOR_COEFF_REG(3), 0x0000);
> > +               write(priv, mod->base + AWB_MEAS_CCOR_COEFF_REG(4), 0x1000);
> > +               write(priv, mod->base + AWB_MEAS_CCOR_COEFF_REG(5), 0x0000);
> > +               write(priv, mod->base + AWB_MEAS_CCOR_COEFF_REG(6), 0x0000);
> > +               write(priv, mod->base + AWB_MEAS_CCOR_COEFF_REG(7), 0x0000);
> > +               write(priv, mod->base + AWB_MEAS_CCOR_COEFF_REG(8), 0x1000);
> > +               write(priv, mod->base + AWB_MEAS_CCOR_OFFSET_R_REG, 0x00000000);
> > +               write(priv, mod->base + AWB_MEAS_CCOR_OFFSET_G_REG, 0x00000000);
> > +               write(priv, mod->base + AWB_MEAS_CCOR_OFFSET_B_REG, 0x00000000);
> > +
> > +               awb_meas_props = AWB_MEAS_PROP_MEAS_MODE_RGB;
> > +       }
> > +
> > +       write(priv, mod->base + AWB_MEAS_PROP_REG,
> > +             awb_meas_props | AWB_MEAS_PROP_AWB_MODE_ON);
> > +
> > +       return 0;
> > +}
> > +
> > +static int rppx1_wbmeas_fill_stats(struct rpp_module *mod,
> > +                                  union rppx1_stats_block *block)
> > +{
> > +       struct rppx1_wbmeas_stats *stats = &block->wbmeas;
> > +
> > +       /* Return measurements at native hardware precision. */
> > +       stats->cnt = rpp_module_read(mod, AWB_MEAS_WHITE_CNT_REG);
> > +       stats->mean_y_or_g = rpp_module_read(mod, AWB_MEAS_MEAN_Y_G_REG);
> > +       stats->mean_cb_or_b = rpp_module_read(mod, AWB_MEAS_MEAN_CB_B_REG);
> > +       stats->mean_cr_or_r = rpp_module_read(mod, AWB_MEAS_MEAN_CR_R_REG);
> > +
> > +       return 0;
> > +}
> > +
> >   const struct rpp_module_ops rppx1_wbmeas_ops = {
> >          .probe = rppx1_wbmeas_probe,
> > +       .fill_params = rppx1_wbmeas_fill_params,
> > +       .fill_stats = rppx1_wbmeas_fill_stats
> >   };
> > diff --git a/include/uapi/linux/media/dreamchip/rppx1-config.h b/include/uapi/linux/media/dreamchip/rppx1-config.h
> > index 26627be6f483..1d76a85164c8 100644
> > --- a/include/uapi/linux/media/dreamchip/rppx1-config.h
> > +++ b/include/uapi/linux/media/dreamchip/rppx1-config.h
> > @@ -40,13 +40,81 @@ struct rppx1_window {
> >    * wider-than-8-bit results.
> >    */
> >
> > +/**
> > + * enum rppx1_params_block_type - RPP-X1 extensible params block types
> > + *
> > + * NOTE: Only append to the enumeration as the numbers are uAPI.
> > + *
> > + * @RPPX1_PARAMS_BLOCK_TYPE_WBMEAS_POST: AWB Measurement Configuration
> > + */
> > +enum rppx1_params_block_type {
> > +       RPPX1_PARAMS_BLOCK_TYPE_WBMEAS_POST,
> > +};
> > +
> > +/**
> > + * enum rppx1_wbmeas_mode - AWB measurement mode
> > + *
> > + * @RPPX1_WBMEAS_MODE_YCBCR: YCbCr measurement mode
> > + * @RPPX1_WBMEAS_MODE_RGB: RGB measurement mode
> > + */
> > +enum rppx1_wbmeas_mode {
> > +       RPPX1_WBMEAS_MODE_YCBCR,
> > +       RPPX1_WBMEAS_MODE_RGB,
> > +};
> > +
> > +/**
> > + * struct rppx1_wbmeas_params - AWB measurement configuration
> > + *
> > + * The Auto-White Balance measurement module is available on the MAIN_POST pipe.
> > + * It supports two measurement modes, selected by the @mode field. The
> > + * measurement window is programmed through the @wnd field.
> > + *
> > + * To support measurement in YCbCr mode a color conversion matrix with
> > + * programmable offset is available in the @ccor_coeff and @ccor_offs fields.
> > + * The color conversion matrix coefficients are represented as 16 bits signed
> > + * Q4.12 numbers ranging from -8 to +7.99. The per-color channel offsets are
> > + * represented as 25 bits 2's complement integer numbers ranging from -16777216
> > + * to +16777215.
> > + *
> > + * @header: block header (type = RPPX1_PARAMS_BLOCK_TYPE_WBMEAS_POST)
> > + * @mode: measurement mode (from enum rppx1_wbmeas_mode)
> > + * @ymax_cmp: enable Y_MAX compare using @max_y
> > + * @wnd: measurement window
> > + * @frames: number of frames for mean value calculation (0 = 1 frame)
> > + * @ref_cr_max_r: reference Cr or max red value in RGB mode, 24 bits
> > + * @ref_cb_max_b: reference Cb or max blue value in RGB mode, 24 bits
> > + * @min_y_max_g: luminance minimum value or max green value in RGB mode, 24 bits
> > + * @max_y: luminance maximum value, only valid if @mode is set to YCbCr and
> > + *        @ymax_cmp is set to enabled, 24 bits
> > + * @max_csum: chrominance sum maximum value, 24 bits
> > + * @min_c: chrominance minimum value, 24 bits
> > + * @ccor_coeff: coefficients for color conversion matrix, signed 16 bits Q4.6
> > + * @ccor_offs: R-G-B color conversion coefficients, signed 25 bits 2's complement
> > + */
> > +struct rppx1_wbmeas_params {
> > +       struct v4l2_isp_params_block_header header;
> > +       __u8 mode;
> > +       __u8 ymax_cmp;
> > +       struct rppx1_window wnd;
> > +       __u8 frames;
> > +       __u32 ref_cr_max_r;
> > +       __u32 ref_cb_max_b;
> > +       __u32 min_y_max_g;
> > +       __u32 max_y;
> > +       __u32 max_csum;
> > +       __u32 min_c;
> > +       __u16 ccor_coeff[3][3];
> > +       __u32 ccor_offs[3];
> > +};
> > +
> >   /**
> >    * RPPX1_PARAMS_MAX_SIZE - Maximum size of all RPP-X1 parameter blocks
> >    *
> >    * Some types are reported twice as the same block might be instantiated in
> >    * multiple pipes.
> >    */
> > -#define RPPX1_PARAMS_MAX_SIZE 0
> > +#define RPPX1_PARAMS_MAX_SIZE                                          \
> > +       (sizeof(struct rppx1_wbmeas_params))
> >
> >   /* ---------------------------------------------------------------------------
> >    * Statistics Structures
> > @@ -55,12 +123,41 @@ struct rppx1_window {
> >    * wider-than-8-bit results.
> >    */
> >
> > +/**
> > + * enum rppx1_stats_block_type - RPP-X1 extensible stats block types
> > + *
> > + * NOTE: Only append to the enumeration as the numbers are uAPI.
> > + *
> > + * @RPPX1_STATS_BLOCK_TYPE_WBMEAS_POST: post-fusion white-balance measurement
> > + */
> > +enum rppx1_stats_block_type {
> > +       RPPX1_STATS_BLOCK_TYPE_WBMEAS_POST,
> > +};
> > +
> > +/**
> > + * struct rppx1_wbmeas_stats - AWB statistics
> > + *
> > + * @header: block header (type = RPPX1_STATS_BLOCK_TYPE_WBMEAS)
> > + * @cnt: Number of pixels matched
> > + * @mean_y_or_g: mean Y (or G in RGB mode) value, 24-bit
> > + * @mean_cb_or_b: mean Cb (or B in RGB mode) value, 24-bit
> > + * @mean_cr_or_r: mean Cr (or R in RGB mode) value, 24-bit
> > + */
> > +struct rppx1_wbmeas_stats {
> > +       struct v4l2_isp_block_header header;
> > +       __u32 cnt;
> > +       __u32 mean_y_or_g;
> > +       __u32 mean_cb_or_b;
> > +       __u32 mean_cr_or_r;
> > +};
> > +
> >   /**
> >    * RPPX1_STATS_MAX_SIZE - Maximum size of all RPP-X1 statistics
> >    *
> >    * Some types are reported twice as the same block might be instantiated in
> >    * multiple pipes.
> >    */
> > -#define RPPX1_STATS_MAX_SIZE 0
> > +#define RPPX1_STATS_MAX_SIZE                                           \
> > +       (sizeof(struct rppx1_wbmeas_stats))
> >
> >   #endif /* __UAPI_RPP_X1_CONFIG_H */
> > --
> > 2.54.0
> >
> >
>

  reply	other threads:[~2026-05-06 14:22 UTC|newest]

Thread overview: 28+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-05-04  1:05 [v8 00/14] media: Add support for R-Car ISP using Dreamchip RPPX1 ISP Niklas Söderlund
2026-05-04  1:05 ` [v8 01/14] media: Add RPP_X1_PARAMS and RPP_X1_STATS meta formats Niklas Söderlund
2026-05-06  7:45   ` Jacopo Mondi
2026-05-04  1:05 ` [v8 02/14] media: rppx1: Add framework to support Dreamchip RPPX1 ISP Niklas Söderlund
2026-05-06  8:53   ` Jacopo Mondi
2026-05-04  1:05 ` [v8 03/14] media: rcar-isp: Add support for ISPCORE Niklas Söderlund
2026-05-06 15:02   ` Jacopo Mondi
2026-05-04  1:05 ` [v8 04/14] media: rppx1: wbmeas: Add support for white balance measurement Niklas Söderlund
2026-05-06 13:58   ` Antoine Bouyer
2026-05-06 14:22     ` Jacopo Mondi [this message]
2026-05-04  1:05 ` [v8 05/14] media: rppx1: awbg: Add support for white balance gain settings Niklas Söderlund
2026-05-04  1:05 ` [v8 06/14] media: rppx1: exm: Add support for exposure measurement Niklas Söderlund
2026-05-04  1:05 ` [v8 07/14] media: rppx1: hist: Add support histogram measurement Niklas Söderlund
2026-05-06 15:51   ` Jacopo Mondi
2026-05-04  1:05 ` [v8 08/14] media: rppx1: bls: Add support for black level compensation Niklas Söderlund
2026-05-06 15:25   ` Jacopo Mondi
2026-05-04  1:05 ` [v8 09/14] media: rppx1: ccor: Add support for color correction matrix Niklas Söderlund
2026-05-04  1:05 ` [v8 10/14] media: rppx1: lsc: Add support for lens shade correction Niklas Söderlund
2026-05-04  1:05 ` [v8 11/14] media: rppx1: ga: Add support for gamma out correction Niklas Söderlund
2026-05-04  1:05 ` [v8 12/14] media: rppx1: db: Add support for debayering filters Niklas Söderlund
2026-05-06 15:54   ` Jacopo Mondi
2026-05-04  1:05 ` [v8 13/14] media: rppx1: bd: Add support for bilateral denoising Niklas Söderlund
2026-05-04  1:05 ` [v8 14/14] media: rppx1: lin: Add support for gamma sensor linearization Niklas Söderlund
2026-05-06 15:57   ` Jacopo Mondi
2026-05-06 12:19 ` [v8 00/14] media: Add support for R-Car ISP using Dreamchip RPPX1 ISP Geert Uytterhoeven
2026-05-06 12:29   ` Niklas Söderlund
2026-05-06 12:49     ` Jacopo Mondi
2026-05-06 12:56       ` Geert Uytterhoeven

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=aftOSBQ6qk0v73Tx@zed \
    --to=jacopo.mondi@ideasonboard.com \
    --cc=antoine.bouyer@nxp.com \
    --cc=jai.luthra+renesas@ideasonboard.com \
    --cc=kuninori.morimoto.gx@renesas.com \
    --cc=laurent.pinchart@ideasonboard.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-media@vger.kernel.org \
    --cc=linux-renesas-soc@vger.kernel.org \
    --cc=mchehab@kernel.org \
    --cc=niklas.soderlund+renesas@ragnatech.se \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox