From: Frank Li <Frank.li@oss.nxp.com>
To: Nas Chung <nas.chung@chipsnmedia.com>
Cc: mchehab@kernel.org, hverkuil@kernel.org, robh@kernel.org,
krzk+dt@kernel.org, conor+dt@kernel.org, Frank.Li@nxp.com,
s.hauer@pengutronix.de, linux-media@vger.kernel.org,
devicetree@vger.kernel.org, linux-kernel@vger.kernel.org,
imx@lists.linux.dev, linux-arm-kernel@lists.infradead.org,
festevam@gmail.com, kernel@pengutronix.de,
nicolas.dufresne@collabora.com, ming.qian@oss.nxp.com,
marek.vasut@mailbox.org, jackson.lee@chipsnmedia.com,
lafley.kim@chipsnmedia.com
Subject: Re: [PATCH v8 09/11] media: chips-media: wave6: Add performance profiling
Date: Thu, 19 Nov 2026 14:56:09 -0600 [thread overview]
Message-ID: <av9iadpXveXGb0R0@SMW015318> (raw)
In-Reply-To: <5702baa6ed97eb30dec14bddba2919252ec8f3c8.1795075582.git.nas.chung@chipsnmedia.com>
On Thu, Nov 19, 2026 at 06:00:03PM +0900, Nas Chung wrote:
> Add per-instance performance profiling to help identify whether a
> throughput problem comes from the firmware or from the host side.
why not register as perf interface?
Frank
>
> Record per-frame timestamps and the firmware-reported processing time,
> and report the frame rates and latencies in the per-instance debugfs
> file.
>
> Tested-by: Ming Qian <ming.qian@oss.nxp.com>
> Tested-by: Marek Vasut <marek.vasut@mailbox.org>
> Signed-off-by: Nas Chung <nas.chung@chipsnmedia.com>
> ---
> .../platform/chips-media/wave6/wave6-hw.c | 28 ++++++
> .../platform/chips-media/wave6/wave6-hw.h | 2 +
> .../chips-media/wave6/wave6-regdefine.h | 6 ++
> .../chips-media/wave6/wave6-vpu-core.h | 10 ++
> .../chips-media/wave6/wave6-vpu-dbg.c | 36 ++++++++
> .../chips-media/wave6/wave6-vpu-dec.c | 15 +++
> .../chips-media/wave6/wave6-vpu-enc.c | 13 +++
> .../chips-media/wave6/wave6-vpu-v4l2.c | 91 +++++++++++++++++++
> .../platform/chips-media/wave6/wave6-vpuapi.h | 28 ++++++
> 9 files changed, 229 insertions(+)
>
> diff --git a/drivers/media/platform/chips-media/wave6/wave6-hw.c b/drivers/media/platform/chips-media/wave6/wave6-hw.c
> index a53a87745366..8d590d8e74e4 100644
> --- a/drivers/media/platform/chips-media/wave6/wave6-hw.c
> +++ b/drivers/media/platform/chips-media/wave6/wave6-hw.c
> @@ -872,6 +872,20 @@ int wave6_vpu_dec_get_output_info(struct vpu_instance *inst, struct dec_output_i
> info->timestamp = vpu_read_reg_relaxed(inst->dev, W6_RET_DEC_TIMESTAMP_HIGH);
> info->timestamp = (info->timestamp << 32) | reg_val;
>
> + info->cycle.host_cmd_s = vpu_read_reg_relaxed(inst->dev, W6_RET_CQ_IN_TICK);
> + info->cycle.host_cmd_e = vpu_read_reg_relaxed(inst->dev, W6_RET_RQ_OUT_TICK);
> + info->cycle.proc_s = vpu_read_reg_relaxed(inst->dev, W6_RET_HW_RUN_TICK);
> + info->cycle.proc_e = vpu_read_reg_relaxed(inst->dev, W6_RET_HW_DONE_TICK);
> + info->cycle.vpu_s = vpu_read_reg_relaxed(inst->dev, W6_RET_FW_RUN_TICK);
> + info->cycle.vpu_e = vpu_read_reg_relaxed(inst->dev, W6_RET_FW_DONE_TICK);
> + info->cycle.frame_cycle = (info->cycle.vpu_e - info->cycle.host_cmd_s) *
> + CYCLE_PER_TICK_VALUE;
> + info->cycle.proc_cycle = (info->cycle.proc_e - info->cycle.proc_s) *
> + CYCLE_PER_TICK_VALUE;
> + info->cycle.vpu_cycle = ((info->cycle.vpu_e - info->cycle.vpu_s) -
> + (info->cycle.proc_e - info->cycle.proc_s)) *
> + CYCLE_PER_TICK_VALUE;
> +
> if (decoded_idx >= 0 && decoded_idx < WAVE6_MAX_FBS)
> p_dec_info->dec_out_info[decoded_idx].decoded_poc = info->decoded_poc;
>
> @@ -1882,6 +1896,20 @@ int wave6_vpu_enc_get_output_info(struct vpu_instance *inst, struct enc_output_i
> info->timestamp = vpu_read_reg_relaxed(inst->dev, W6_RET_ENC_TIMESTAMP_HIGH);
> info->timestamp = (info->timestamp << 32) | reg_val;
>
> + info->cycle.host_cmd_s = vpu_read_reg_relaxed(inst->dev, W6_RET_CQ_IN_TICK);
> + info->cycle.host_cmd_e = vpu_read_reg_relaxed(inst->dev, W6_RET_RQ_OUT_TICK);
> + info->cycle.proc_s = vpu_read_reg_relaxed(inst->dev, W6_RET_HW_RUN_TICK);
> + info->cycle.proc_e = vpu_read_reg_relaxed(inst->dev, W6_RET_HW_DONE_TICK);
> + info->cycle.vpu_s = vpu_read_reg_relaxed(inst->dev, W6_RET_FW_RUN_TICK);
> + info->cycle.vpu_e = vpu_read_reg_relaxed(inst->dev, W6_RET_FW_DONE_TICK);
> + info->cycle.frame_cycle = (info->cycle.vpu_e - info->cycle.host_cmd_s) *
> + CYCLE_PER_TICK_VALUE;
> + info->cycle.proc_cycle = (info->cycle.proc_e - info->cycle.proc_s) *
> + CYCLE_PER_TICK_VALUE;
> + info->cycle.vpu_cycle = ((info->cycle.vpu_e - info->cycle.vpu_s) -
> + (info->cycle.proc_e - info->cycle.proc_s)) *
> + CYCLE_PER_TICK_VALUE;
> +
> return 0;
> }
>
> diff --git a/drivers/media/platform/chips-media/wave6/wave6-hw.h b/drivers/media/platform/chips-media/wave6/wave6-hw.h
> index 7adb0a07390e..fe2a09ec4c0f 100644
> --- a/drivers/media/platform/chips-media/wave6/wave6-hw.h
> +++ b/drivers/media/platform/chips-media/wave6/wave6-hw.h
> @@ -34,6 +34,8 @@ enum product_id {
>
> #define MAX_CSC_COEFF_NUM 4
>
> +#define CYCLE_PER_TICK_VALUE 256
> +
> #define H265_NAL_UNIT_TYPE_IDR_W_RADL 19
> #define H265_NAL_UNIT_TYPE_IDR_N_LP 20
>
> diff --git a/drivers/media/platform/chips-media/wave6/wave6-regdefine.h b/drivers/media/platform/chips-media/wave6/wave6-regdefine.h
> index 1038b87b2ff9..55395d3fa4a4 100644
> --- a/drivers/media/platform/chips-media/wave6/wave6-regdefine.h
> +++ b/drivers/media/platform/chips-media/wave6/wave6-regdefine.h
> @@ -110,6 +110,12 @@ enum wave6_interrupt_bit {
> #define W6_RET_INT_INSTANCE_INFO (W6_REG_BASE + 0x21C)
> #define INT_INSTANCE_INFO_CLEAR 0
> #define W6_RET_INSTANCE_ID (W6_REG_BASE + 0x220)
> +#define W6_RET_CQ_IN_TICK (W6_REG_BASE + 0x23C)
> +#define W6_RET_FW_RUN_TICK (W6_REG_BASE + 0x240)
> +#define W6_RET_HW_RUN_TICK (W6_REG_BASE + 0x244)
> +#define W6_RET_HW_DONE_TICK (W6_REG_BASE + 0x248)
> +#define W6_RET_FW_DONE_TICK (W6_REG_BASE + 0x24C)
> +#define W6_RET_RQ_OUT_TICK (W6_REG_BASE + 0x250)
>
> /* COMMON - QUERY : GET_VPU_INFO */
> #define W6_RET_FW_VERSION (W6_REG_BASE + 0x300)
> diff --git a/drivers/media/platform/chips-media/wave6/wave6-vpu-core.h b/drivers/media/platform/chips-media/wave6/wave6-vpu-core.h
> index dc0b9867ca37..1c352016a688 100644
> --- a/drivers/media/platform/chips-media/wave6/wave6-vpu-core.h
> +++ b/drivers/media/platform/chips-media/wave6/wave6-vpu-core.h
> @@ -32,6 +32,11 @@ struct vpu_buffer {
> u32 force_i_frame_qp;
> u32 force_p_frame_qp;
> u32 force_b_frame_qp;
> + ktime_t ts_input;
> + ktime_t ts_start;
> + ktime_t ts_finish;
> + ktime_t ts_output;
> + u64 hw_time;
> u32 average_qp;
> };
>
> @@ -101,6 +106,7 @@ enum codec_std wave6_to_codec_std(enum vpu_instance_type type, unsigned int v4l2
> const char *wave6_vpu_instance_state_name(enum vpu_instance_state state);
> void wave6_vpu_set_instance_state(struct vpu_instance *inst,
> enum vpu_instance_state state);
> +u64 wave6_vpu_cycle_to_ns(struct vpu_core_device *core, u64 cycle);
> int wave6_vpu_wait_interrupt(struct vpu_instance *inst, unsigned int timeout);
> int wave6_vpu_dec_register_device(struct vpu_core_device *core);
> void wave6_vpu_dec_unregister_device(struct vpu_core_device *core);
> @@ -108,6 +114,10 @@ int wave6_vpu_enc_register_device(struct vpu_core_device *core);
> void wave6_vpu_enc_unregister_device(struct vpu_core_device *core);
> void wave6_vpu_device_run_timeout(struct work_struct *work);
> void wave6_vpu_finish_job(struct vpu_instance *inst);
> +void wave6_vpu_record_performance_timestamps(struct vpu_instance *inst);
> +void wave6_vpu_handle_performance(struct vpu_instance *inst,
> + struct vpu_buffer *vpu_buf);
> +void wave6_vpu_reset_performance(struct vpu_instance *inst);
> int wave6_vpu_init_m2m_dev(struct vpu_core_device *core);
> void wave6_vpu_release_m2m_dev(struct vpu_core_device *core);
> int wave6_vpu_subscribe_event(struct v4l2_fh *fh,
> diff --git a/drivers/media/platform/chips-media/wave6/wave6-vpu-dbg.c b/drivers/media/platform/chips-media/wave6/wave6-vpu-dbg.c
> index 525e047ecebf..be1061b2b39f 100644
> --- a/drivers/media/platform/chips-media/wave6/wave6-vpu-dbg.c
> +++ b/drivers/media/platform/chips-media/wave6/wave6-vpu-dbg.c
> @@ -15,7 +15,13 @@
> static int wave6_vpu_dbg_instance(struct seq_file *s, void *data)
> {
> struct vpu_instance *inst = s->private;
> + struct vpu_performance_info *perf = &inst->performance;
> struct vb2_queue *vq;
> + s64 tmp;
> + s64 fps;
> + s64 duration;
> + s64 ms[3];
> + s32 ns[3];
>
> if (!inst->v4l2_fh.m2m_ctx)
> return 0;
> @@ -77,6 +83,36 @@ static int wave6_vpu_dbg_instance(struct seq_file *s, void *data)
> inst->error_buf_num,
> v4l2_m2m_has_stopped(inst->v4l2_fh.m2m_ctx));
>
> + seq_puts(s, "fps");
> + tmp = MSEC_PER_SEC * inst->processed_buf_num;
> + if (perf->ts_last > perf->ts_first + NSEC_PER_MSEC) {
> + duration = ktime_ms_delta(perf->ts_last, perf->ts_first);
> + fps = DIV64_U64_ROUND_CLOSEST(tmp, duration);
> + seq_printf(s, " actual: %lld;", fps);
> + }
> + duration = div_u64(perf->total_sw_time, NSEC_PER_MSEC);
> + if (duration > 0) {
> + fps = DIV64_U64_ROUND_CLOSEST(tmp, duration);
> + seq_printf(s, " sw: %lld;", fps);
> + }
> + duration = div_u64(perf->total_hw_time, NSEC_PER_MSEC);
> + if (duration > 0) {
> + fps = DIV64_U64_ROUND_CLOSEST(tmp, duration);
> + seq_printf(s, " hw: %lld", fps);
> + }
> + seq_putc(s, '\n');
> +
> + ms[0] = div_s64_rem(perf->latency_first, NSEC_PER_MSEC, &ns[0]);
> + ms[1] = div_s64_rem(perf->latency_max, NSEC_PER_MSEC, &ns[1]);
> + ms[2] = div_s64_rem(ktime_sub(perf->ts_first, perf->ts_start), NSEC_PER_MSEC, &ns[2]);
> + seq_printf(s, "latency(ms) first: %lld.%06d, max %lld.%06d, setup %lld.%06d\n",
> + ms[0], ns[0], ms[1], ns[1], ms[2], ns[2]);
> +
> + ms[0] = div_s64_rem(perf->min_process_time, NSEC_PER_MSEC, &ns[0]);
> + ms[1] = div_s64_rem(perf->max_process_time, NSEC_PER_MSEC, &ns[1]);
> + seq_printf(s, "process frame time(ms) min: %lld.%06d, max %lld.%06d\n",
> + ms[0], ns[0], ms[1], ns[1]);
> +
> if (inst->type == VPU_INST_TYPE_DEC) {
> seq_printf(s, "%s order\n",
> inst->disp_mode == DISP_MODE_DISP_ORDER ? "display" : "decode");
> diff --git a/drivers/media/platform/chips-media/wave6/wave6-vpu-dec.c b/drivers/media/platform/chips-media/wave6/wave6-vpu-dec.c
> index 7eab283ec9e7..4fa4371545f9 100644
> --- a/drivers/media/platform/chips-media/wave6/wave6-vpu-dec.c
> +++ b/drivers/media/platform/chips-media/wave6/wave6-vpu-dec.c
> @@ -181,6 +181,7 @@ static void wave6_handle_bitstream_buffer(struct vpu_instance *inst,
> return;
> }
>
> + vpu_buf->ts_start = ktime_get_raw();
> vpu_buf->consumed = true;
> wave6_vpu_dec_set_rd_ptr(inst, rd_ptr, true);
>
> @@ -304,6 +305,8 @@ static int wave6_vpu_dec_prepare_fb(struct vpu_instance *inst)
>
> wave6_vpu_set_instance_state(inst, VPU_INST_STATE_PIC_RUN);
>
> + wave6_vpu_record_performance_timestamps(inst);
> +
> return 0;
>
> error:
> @@ -606,6 +609,10 @@ static void wave6_handle_decoded_frame(struct vpu_instance *inst,
> dst_vpu_buf->used = true;
> if (state == VB2_BUF_STATE_ERROR)
> dst_vpu_buf->error = true;
> + dst_vpu_buf->ts_input = vpu_buf->ts_input;
> + dst_vpu_buf->ts_start = vpu_buf->ts_start;
> + dst_vpu_buf->ts_finish = ktime_get_raw();
> + dst_vpu_buf->hw_time = wave6_vpu_cycle_to_ns(inst->dev, info->cycle.frame_cycle);
> }
>
> if (state == VB2_BUF_STATE_ERROR) {
> @@ -658,6 +665,9 @@ static void wave6_handle_display_frame(struct vpu_instance *inst,
> vb2_set_plane_payload(&dst_buf->vb2_buf, i,
> inst->dst_fmt.plane_fmt[i].sizeimage);
>
> + vpu_buf->ts_output = ktime_get_raw();
> + wave6_vpu_handle_performance(inst, vpu_buf);
> +
> if (vpu_buf->error)
> state = VB2_BUF_STATE_ERROR;
> dst_buf->sequence = inst->sequence++;
> @@ -1404,6 +1414,8 @@ static int wave6_vpu_dec_create_instance(struct vpu_instance *inst)
>
> memset(&open_param, 0, sizeof(struct dec_open_param));
>
> + wave6_vpu_record_performance_timestamps(inst);
> +
> wave6_vpu_core_activate(inst->dev);
> ret = pm_runtime_resume_and_get(inst->dev->dev);
> if (ret) {
> @@ -1567,6 +1579,7 @@ static int wave6_vpu_dec_prepare_decode(struct vpu_instance *inst)
> static void wave6_vpu_dec_buf_queue_src(struct vb2_buffer *vb)
> {
> struct vb2_v4l2_buffer *vbuf = to_vb2_v4l2_buffer(vb);
> + struct vpu_buffer *vpu_buf = wave6_to_vpu_buf(vbuf);
> struct vpu_instance *inst = vb2_get_drv_priv(vb->vb2_queue);
>
> dev_dbg(inst->dev->dev, "type %4d index %4d size[0] %4ld size[1] : %4ld | size[2] : %4ld\n",
> @@ -1574,6 +1587,7 @@ static void wave6_vpu_dec_buf_queue_src(struct vb2_buffer *vb)
> vb2_plane_size(&vbuf->vb2_buf, 1), vb2_plane_size(&vbuf->vb2_buf, 2));
>
> vbuf->sequence = inst->queued_src_buf_num++;
> + vpu_buf->ts_input = ktime_get_raw();
>
> v4l2_m2m_buf_queue(inst->v4l2_fh.m2m_ctx, vbuf);
> }
> @@ -1670,6 +1684,7 @@ static void wave6_vpu_dec_stop_streaming(struct vb2_queue *q)
> goto exit;
>
> if (V4L2_TYPE_IS_OUTPUT(q->type)) {
> + wave6_vpu_reset_performance(inst);
> inst->queued_src_buf_num = 0;
> inst->processed_buf_num = 0;
> inst->error_buf_num = 0;
> diff --git a/drivers/media/platform/chips-media/wave6/wave6-vpu-enc.c b/drivers/media/platform/chips-media/wave6/wave6-vpu-enc.c
> index 4a0739033d1a..ca2d4051f9ad 100644
> --- a/drivers/media/platform/chips-media/wave6/wave6-vpu-enc.c
> +++ b/drivers/media/platform/chips-media/wave6/wave6-vpu-enc.c
> @@ -791,6 +791,7 @@ static int wave6_vpu_enc_start_encode(struct vpu_instance *inst)
>
> src_vbuf = wave6_to_vpu_buf(src_buf);
> src_vbuf->consumed = true;
> + src_vbuf->ts_start = ktime_get_raw();
> if (inst->src_fmt.num_planes == 1) {
> frame_buf.buf_y = wave6_get_dma_addr(src_buf, 0);
> frame_buf.buf_cb = frame_buf.buf_y + luma_size;
> @@ -887,6 +888,12 @@ static void wave6_handle_encoded_frame(struct vpu_instance *inst,
> dst_vpu_buf = wave6_to_vpu_buf(dst_buf);
>
> dst_vpu_buf->average_qp = info->avg_ctu_qp;
> + dst_vpu_buf->ts_input = vpu_buf->ts_input;
> + dst_vpu_buf->ts_start = vpu_buf->ts_start;
> + dst_vpu_buf->ts_finish = ktime_get_raw();
> + dst_vpu_buf->hw_time = wave6_vpu_cycle_to_ns(inst->dev, info->cycle.frame_cycle);
> + dst_vpu_buf->ts_output = ktime_get_raw();
> + wave6_vpu_handle_performance(inst, dst_vpu_buf);
>
> if (v4l2_m2m_is_last_draining_src_buf(inst->v4l2_fh.m2m_ctx, src_buf)) {
> dst_buf->flags |= V4L2_BUF_FLAG_LAST;
> @@ -2023,6 +2030,8 @@ static int wave6_vpu_enc_create_instance(struct vpu_instance *inst)
>
> memset(&open_param, 0, sizeof(struct enc_open_param));
>
> + wave6_vpu_record_performance_timestamps(inst);
> +
> wave6_vpu_core_activate(inst->dev);
> ret = pm_runtime_resume_and_get(inst->dev->dev);
> if (ret) {
> @@ -2179,6 +2188,8 @@ static int wave6_vpu_enc_prepare_fb(struct vpu_instance *inst)
>
> wave6_vpu_set_instance_state(inst, VPU_INST_STATE_PIC_RUN);
>
> + wave6_vpu_record_performance_timestamps(inst);
> +
> return 0;
>
> error:
> @@ -2267,6 +2278,7 @@ static void wave6_vpu_enc_buf_queue(struct vb2_buffer *vb)
> if (V4L2_TYPE_IS_OUTPUT(vb->type)) {
> vbuf->sequence = inst->queued_src_buf_num++;
>
> + vpu_buf->ts_input = ktime_get_raw();
> vpu_buf->force_key_frame = inst->enc_ctrls.force_key_frame;
> inst->enc_ctrls.force_key_frame = false;
> vpu_buf->force_frame_qp = !inst->enc_ctrls.frame_rc_enable;
> @@ -2363,6 +2375,7 @@ static void wave6_vpu_enc_stop_streaming(struct vb2_queue *q)
> goto exit;
>
> if (V4L2_TYPE_IS_OUTPUT(q->type)) {
> + wave6_vpu_reset_performance(inst);
> inst->queued_src_buf_num = 0;
> inst->processed_buf_num = 0;
> inst->error_buf_num = 0;
> diff --git a/drivers/media/platform/chips-media/wave6/wave6-vpu-v4l2.c b/drivers/media/platform/chips-media/wave6/wave6-vpu-v4l2.c
> index 6980b126dee5..3ec01ec867df 100644
> --- a/drivers/media/platform/chips-media/wave6/wave6-vpu-v4l2.c
> +++ b/drivers/media/platform/chips-media/wave6/wave6-vpu-v4l2.c
> @@ -5,6 +5,9 @@
> * Copyright (C) 2026 CHIPS&MEDIA INC
> */
>
> +#include <linux/clk.h>
> +#include <linux/math64.h>
> +
> #include "wave6-vpu.h"
> #include "wave6-vpu-core.h"
> #include "wave6-trace.h"
> @@ -228,6 +231,20 @@ void wave6_vpu_set_instance_state(struct vpu_instance *inst,
> inst->state = state;
> }
>
> +u64 wave6_vpu_cycle_to_ns(struct vpu_core_device *core, u64 cycle)
> +{
> + unsigned long rate;
> +
> + if (!core->num_clks || !core->clks)
> + return 0;
> +
> + rate = clk_get_rate(core->clks[0].clk);
> + if (!rate)
> + return 0;
> +
> + return div64_ul(cycle * NSEC_PER_SEC, rate);
> +}
> +
> int wave6_vpu_wait_interrupt(struct vpu_instance *inst, unsigned int timeout)
> {
> int ret;
> @@ -387,6 +404,80 @@ void wave6_vpu_finish_job(struct vpu_instance *inst)
> v4l2_m2m_job_finish(inst->dev->m2m_dev, inst->v4l2_fh.m2m_ctx);
> }
>
> +void wave6_vpu_record_performance_timestamps(struct vpu_instance *inst)
> +{
> + if (WARN_ON(!inst))
> + return;
> +
> + if (inst->state == VPU_INST_STATE_NONE &&
> + !inst->performance.ts_start)
> + inst->performance.ts_start = ktime_get_raw();
> +
> + if (inst->state == VPU_INST_STATE_PIC_RUN &&
> + !inst->performance.ts_first)
> + inst->performance.ts_first = ktime_get_raw();
> +}
> +
> +void wave6_vpu_handle_performance(struct vpu_instance *inst, struct vpu_buffer *vpu_buf)
> +{
> + s64 latency, time_spent;
> +
> + if (WARN_ON(!inst || !vpu_buf))
> + return;
> +
> + inst->performance.ts_last = vpu_buf->ts_output;
> +
> + latency = vpu_buf->ts_output - vpu_buf->ts_input;
> + time_spent = vpu_buf->ts_finish - vpu_buf->ts_start;
> +
> + if (!inst->performance.latency_first)
> + inst->performance.latency_first = latency;
> + inst->performance.latency_max = max_t(s64, latency, inst->performance.latency_max);
> +
> + if (!inst->performance.min_process_time)
> + inst->performance.min_process_time = time_spent;
> + else if (inst->performance.min_process_time > time_spent)
> + inst->performance.min_process_time = time_spent;
> +
> + if (inst->performance.max_process_time < time_spent)
> + inst->performance.max_process_time = time_spent;
> +
> + inst->performance.total_sw_time += time_spent;
> + inst->performance.total_hw_time += vpu_buf->hw_time;
> +}
> +
> +void wave6_vpu_reset_performance(struct vpu_instance *inst)
> +{
> + if (WARN_ON(!inst))
> + return;
> +
> + if (inst->processed_buf_num) {
> + s64 tmp;
> + s64 fps_act = 0, fps_sw = 0, fps_hw = 0;
> + s64 duration;
> + s64 latency_ms;
> + s32 latency_ns;
> + struct vpu_performance_info *perf = &inst->performance;
> +
> + tmp = MSEC_PER_SEC * inst->processed_buf_num;
> + duration = ktime_ms_delta(perf->ts_last, perf->ts_first);
> + if (duration > 0)
> + fps_act = DIV64_U64_ROUND_CLOSEST(tmp, duration);
> + duration = div_u64(perf->total_sw_time, NSEC_PER_MSEC);
> + if (duration > 0)
> + fps_sw = DIV64_U64_ROUND_CLOSEST(tmp, duration);
> + duration = div_u64(perf->total_hw_time, NSEC_PER_MSEC);
> + if (duration)
> + fps_hw = DIV64_U64_ROUND_CLOSEST(tmp, duration);
> + latency_ms = div_s64_rem(perf->latency_first, NSEC_PER_MSEC, &latency_ns);
> + dev_dbg(inst->dev->dev,
> + "[%d] fps actual: %lld, sw: %lld, hw: %lld, latency(ms) %lld.%06d\n",
> + inst->id, fps_act, fps_sw, fps_hw, latency_ms, latency_ns);
> + }
> +
> + memset(&inst->performance, 0, sizeof(inst->performance));
> +}
> +
> static const struct v4l2_m2m_ops wave6_vpu_m2m_ops = {
> .device_run = wave6_vpu_device_run,
> .job_ready = wave6_vpu_job_ready,
> diff --git a/drivers/media/platform/chips-media/wave6/wave6-vpuapi.h b/drivers/media/platform/chips-media/wave6/wave6-vpuapi.h
> index bc3d7e192904..00596504c3f5 100644
> --- a/drivers/media/platform/chips-media/wave6/wave6-vpuapi.h
> +++ b/drivers/media/platform/chips-media/wave6/wave6-vpuapi.h
> @@ -339,6 +339,18 @@ struct instance_buffer {
> dma_addr_t ar_base;
> };
>
> +struct report_cycle {
> + u32 host_cmd_s;
> + u32 host_cmd_e;
> + u32 proc_s;
> + u32 proc_e;
> + u32 vpu_s;
> + u32 vpu_e;
> + u32 frame_cycle;
> + u32 proc_cycle;
> + u32 vpu_cycle;
> +};
> +
> struct color_param {
> u32 color_range;
> u32 matrix_coefficients;
> @@ -423,6 +435,7 @@ struct dec_output_info {
> int error_reason;
> int warn_info;
> unsigned int sequence_no;
> + struct report_cycle cycle;
> dma_addr_t release_disp_frame_addr[WAVE6_MAX_FBS];
> dma_addr_t disp_frame_addr[WAVE6_MAX_FBS];
> u64 timestamp;
> @@ -671,6 +684,7 @@ struct enc_output_info {
> bool encoding_success;
> struct enc_report_fme_sum fme_sum;
> struct enc_report_mv_histo mv_histo;
> + struct report_cycle cycle;
> u64 timestamp;
> dma_addr_t src_y_addr;
> dma_addr_t custom_map_addr;
> @@ -839,6 +853,18 @@ struct vpu_instance_ops {
> void (*finish_process)(struct vpu_instance *inst, bool error);
> };
>
> +struct vpu_performance_info {
> + ktime_t ts_start;
> + ktime_t ts_first;
> + ktime_t ts_last;
> + s64 latency_first;
> + s64 latency_max;
> + s64 min_process_time;
> + s64 max_process_time;
> + u64 total_sw_time;
> + u64 total_hw_time;
> +};
> +
> /**
> * struct vpu_instance - VPU instance structure
> * @list: List head for VPU core device instance list
> @@ -883,6 +909,7 @@ struct vpu_instance_ops {
> * @error_recovery: Error recovery flag
> * @disp_mode: Display mode for decoder V4L2 control
> * @enc_ctrls: Encoder V4L2 control and streaming parameters
> + * @performance: Performance information
> * @debugfs: Debugfs entry
> */
> struct vpu_instance {
> @@ -943,6 +970,7 @@ struct vpu_instance {
> enum display_mode disp_mode;
> struct enc_controls enc_ctrls;
>
> + struct vpu_performance_info performance;
> struct dentry *debugfs;
> };
>
> --
> 2.41.0.windows.3
>
>
next prev parent reply other threads:[~2026-11-19 20:56 UTC|newest]
Thread overview: 18+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-11-19 8:59 [PATCH v8 00/11] Add support for Wave6 video codec driver Nas Chung
2026-11-19 8:59 ` [PATCH v8 01/11] dt-bindings: media: nxp: Add Wave6 video codec device Nas Chung
2026-11-19 8:59 ` [PATCH v8 02/11] media: chips-media: wave6: Add Wave6 control driver Nas Chung
2026-11-19 20:07 ` Frank Li
2026-11-19 8:59 ` [PATCH v8 03/11] media: chips-media: wave6: Add Wave6 core driver Nas Chung
2026-11-19 20:27 ` Frank Li
2026-11-19 8:59 ` [PATCH v8 04/11] media: chips-media: wave6: Add Wave6 decoder firmware interface Nas Chung
2026-11-19 20:37 ` Frank Li
2026-11-19 8:59 ` [PATCH v8 05/11] media: chips-media: wave6: Add Wave6 m2m decoder Nas Chung
2026-11-19 9:00 ` [PATCH v8 06/11] media: chips-media: wave6: Add Wave6 encoder firmware interface Nas Chung
2026-11-19 9:00 ` [PATCH v8 07/11] media: chips-media: wave6: Add Wave6 m2m encoder Nas Chung
2026-11-19 9:00 ` [PATCH v8 08/11] media: chips-media: wave6: Add trace and debugfs Nas Chung
2026-11-19 9:00 ` [PATCH v8 09/11] media: chips-media: wave6: Add performance profiling Nas Chung
2026-11-19 20:56 ` Frank Li [this message]
2026-11-19 9:00 ` [PATCH v8 10/11] media: chips-media: wave6: Add Wave6 thermal cooling device Nas Chung
2026-11-19 21:03 ` Frank Li
2026-11-19 9:00 ` [PATCH v8 11/11] arm64: dts: freescale: imx95: Add video codec node Nas Chung
2026-11-19 21:05 ` Frank Li
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=av9iadpXveXGb0R0@SMW015318 \
--to=frank.li@oss.nxp.com \
--cc=Frank.Li@nxp.com \
--cc=conor+dt@kernel.org \
--cc=devicetree@vger.kernel.org \
--cc=festevam@gmail.com \
--cc=hverkuil@kernel.org \
--cc=imx@lists.linux.dev \
--cc=jackson.lee@chipsnmedia.com \
--cc=kernel@pengutronix.de \
--cc=krzk+dt@kernel.org \
--cc=lafley.kim@chipsnmedia.com \
--cc=linux-arm-kernel@lists.infradead.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-media@vger.kernel.org \
--cc=marek.vasut@mailbox.org \
--cc=mchehab@kernel.org \
--cc=ming.qian@oss.nxp.com \
--cc=nas.chung@chipsnmedia.com \
--cc=nicolas.dufresne@collabora.com \
--cc=robh@kernel.org \
--cc=s.hauer@pengutronix.de \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).