[PATCH v6 00/11] Only timeout jobs if they run longer than timeout period

[PATCH v6 00/11] Only timeout jobs if they run longer than timeout period

[Matthew Brost]

Debugging [1] hit a known flaw in the job timeout mechanism - jobs
timeout after a period of time in which they have been submitted to the
GuC not how long they have actually been running on the hardware.
Attempt to fix this.

Algorithm is as follows:
- Copy ctx timestamp from LRC to saved location at beginning of every
  job
- On TDR kick jobs off hardware via schedule disable so ctx timestamp is
  updated
- Compare ctx timestamp to saved ctx timestamp, if jobs having been
  running less than timeout period re-enable scheduling are restart TDR

New job cancel IGT [2] for testing.

v2:
- Promote to non-RFC as issues which I view as blockers have been resolved
- Address Jani and Michal v1 feedback
- Add GT clock timer calculation
v3:
- More testing
- Fix TDR state machine bugs exposed in testing
- Rebase for CI
v4:
- Address a few comments by John H
- Fix CI failure [3]
v5:
- Include all the patches
v6:
- Address John H's latest feedback including a new patch
- Fix CI hooks failure
- Fix assertion failure [4]

Matt

[1] https://gitlab.freedesktop.org/drm/xe/kernel/-/issues/799
[2] https://patchwork.freedesktop.org/series/134640/
[3] https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134642v1/shard-dg2-433/igt@xe_exec_threads@threads-hang-fd-rebind.html
[4] https://gitlab.freedesktop.org/drm/xe/kernel/-/issues/799#note_2445590

Matthew Brost (11):
  drm/xe: Add LRC ctx timestamp support functions
  drm/xe: Add MI_COPY_MEM_MEM GPU instruction definitions
  drm/xe: Emit ctx timestamp copy in ring ops
  drm/xe: Add ctx timestamp to LRC snapshot
  drm/xe: Add xe_gt_clock_interval_to_ms helper
  drm/xe: Improve unexpected state error messages
  drm/xe: Assert runnable state in handle_sched_done
  drm/xe: Add GuC state asserts to deregister_exec_queue
  drm/xe: Add pending disable assert to handle_sched_done
  drm/xe: Add killed, banned, or wedged as stick bit during GuC reset
  drm/xe: Sample ctx timestamp to determine if jobs have timed out

 .../gpu/drm/xe/instructions/xe_mi_commands.h  |   4 +
 drivers/gpu/drm/xe/xe_gt_clock.c              |  20 ++
 drivers/gpu/drm/xe/xe_gt_clock.h              |   1 +
 drivers/gpu/drm/xe/xe_guc_submit.c            | 334 ++++++++++++++----
 drivers/gpu/drm/xe/xe_lrc.c                   |  84 ++++-
 drivers/gpu/drm/xe/xe_lrc.h                   |   5 +
 drivers/gpu/drm/xe/xe_ring_ops.c              |  21 ++
 7 files changed, 400 insertions(+), 69 deletions(-)

-- 
2.34.1

[PATCH v6 01/11] drm/xe: Add LRC ctx timestamp support functions

[Matthew Brost]

LRC ctx timestamp support functions are used to determine how long a job
has run on the hardware.

v2:
 - Don't use static inlines (Jani)
 - Kernel doc
 - s/ctx_timestamp_job/ctx_job_timestamp
v6:
 - Add kernel doc for xe_lrc_update_timestamp (Lucas)
 - Call xe_lrc_ctx_timestamp() in xe_lrc_update_timestamp (Lucas)

Signed-off-by: Matthew Brost <matthew.brost@intel.com>
Reviewed-by: Jonathan Cavitt <jonathan.cavitt@intel.com>
---
 drivers/gpu/drm/xe/xe_lrc.c | 78 ++++++++++++++++++++++++++++++++++++-
 drivers/gpu/drm/xe/xe_lrc.h |  5 +++
 2 files changed, 82 insertions(+), 1 deletion(-)

diff --git a/drivers/gpu/drm/xe/xe_lrc.c b/drivers/gpu/drm/xe/xe_lrc.c
index c1bb85d2e243..2ad645f49ec9 100644
--- a/drivers/gpu/drm/xe/xe_lrc.c
+++ b/drivers/gpu/drm/xe/xe_lrc.c
@@ -652,6 +652,7 @@ u32 xe_lrc_pphwsp_offset(struct xe_lrc *lrc)
 
 #define LRC_SEQNO_PPHWSP_OFFSET 512
 #define LRC_START_SEQNO_PPHWSP_OFFSET (LRC_SEQNO_PPHWSP_OFFSET + 8)
+#define LRC_CTX_JOB_TIMESTAMP_OFFSET (LRC_START_SEQNO_PPHWSP_OFFSET + 8)
 #define LRC_PARALLEL_PPHWSP_OFFSET 2048
 #define LRC_PPHWSP_SIZE SZ_4K
 
@@ -680,6 +681,12 @@ static inline u32 __xe_lrc_start_seqno_offset(struct xe_lrc *lrc)
 	return xe_lrc_pphwsp_offset(lrc) + LRC_START_SEQNO_PPHWSP_OFFSET;
 }
 
+static u32 __xe_lrc_ctx_job_timestamp_offset(struct xe_lrc *lrc)
+{
+	/* The start seqno is stored in the driver-defined portion of PPHWSP */
+	return xe_lrc_pphwsp_offset(lrc) + LRC_CTX_JOB_TIMESTAMP_OFFSET;
+}
+
 static inline u32 __xe_lrc_parallel_offset(struct xe_lrc *lrc)
 {
 	/* The parallel is stored in the driver-defined portion of PPHWSP */
@@ -691,6 +698,11 @@ static inline u32 __xe_lrc_regs_offset(struct xe_lrc *lrc)
 	return xe_lrc_pphwsp_offset(lrc) + LRC_PPHWSP_SIZE;
 }
 
+static u32 __xe_lrc_ctx_timestamp_offset(struct xe_lrc *lrc)
+{
+	return __xe_lrc_regs_offset(lrc) + CTX_TIMESTAMP * sizeof(u32);
+}
+
 static inline u32 __xe_lrc_indirect_ring_offset(struct xe_lrc *lrc)
 {
 	/* Indirect ring state page is at the very end of LRC */
@@ -716,11 +728,65 @@ DECL_MAP_ADDR_HELPERS(pphwsp)
 DECL_MAP_ADDR_HELPERS(seqno)
 DECL_MAP_ADDR_HELPERS(regs)
 DECL_MAP_ADDR_HELPERS(start_seqno)
+DECL_MAP_ADDR_HELPERS(ctx_job_timestamp)
+DECL_MAP_ADDR_HELPERS(ctx_timestamp)
 DECL_MAP_ADDR_HELPERS(parallel)
 DECL_MAP_ADDR_HELPERS(indirect_ring)
 
 #undef DECL_MAP_ADDR_HELPERS
 
+/**
+ * xe_lrc_ctx_timestamp_ggtt_addr() - Get ctx timestamp GGTT address
+ * @lrc: Pointer to the lrc.
+ *
+ * Returns: ctx timestamp GGTT address
+ */
+u32 xe_lrc_ctx_timestamp_ggtt_addr(struct xe_lrc *lrc)
+{
+	return __xe_lrc_ctx_timestamp_ggtt_addr(lrc);
+}
+
+/**
+ * xe_lrc_ctx_timestamp() - Read ctx timestamp value
+ * @lrc: Pointer to the lrc.
+ *
+ * Returns: ctx timestamp value
+ */
+u32 xe_lrc_ctx_timestamp(struct xe_lrc *lrc)
+{
+	struct xe_device *xe = lrc_to_xe(lrc);
+	struct iosys_map map;
+
+	map = __xe_lrc_ctx_timestamp_map(lrc);
+	return xe_map_read32(xe, &map);
+}
+
+/**
+ * xe_lrc_ctx_job_timestamp_ggtt_addr() - Get ctx job timestamp GGTT address
+ * @lrc: Pointer to the lrc.
+ *
+ * Returns: ctx timestamp job GGTT address
+ */
+u32 xe_lrc_ctx_job_timestamp_ggtt_addr(struct xe_lrc *lrc)
+{
+	return __xe_lrc_ctx_job_timestamp_ggtt_addr(lrc);
+}
+
+/**
+ * xe_lrc_ctx_job_timestamp() - Read ctx job timestamp value
+ * @lrc: Pointer to the lrc.
+ *
+ * Returns: ctx timestamp job value
+ */
+u32 xe_lrc_ctx_job_timestamp(struct xe_lrc *lrc)
+{
+	struct xe_device *xe = lrc_to_xe(lrc);
+	struct iosys_map map;
+
+	map = __xe_lrc_ctx_job_timestamp_map(lrc);
+	return xe_map_read32(xe, &map);
+}
+
 u32 xe_lrc_ggtt_addr(struct xe_lrc *lrc)
 {
 	return __xe_lrc_pphwsp_ggtt_addr(lrc);
@@ -1659,11 +1725,21 @@ void xe_lrc_snapshot_free(struct xe_lrc_snapshot *snapshot)
 	kfree(snapshot);
 }
 
+/**
+ * xe_lrc_update_timestamp() - Update ctx timestamp
+ * @lrc: Pointer to the lrc.
+ * @old_ts: Old timestamp value
+ *
+ * Populate @old_ts current saved ctx timestamp, read new ctx timestamp and
+ * update saved value.
+ *
+ * Returns: New ctx timestamp value
+ */
 u32 xe_lrc_update_timestamp(struct xe_lrc *lrc, u32 *old_ts)
 {
 	*old_ts = lrc->ctx_timestamp;
 
-	lrc->ctx_timestamp = xe_lrc_read_ctx_reg(lrc, CTX_TIMESTAMP);
+	lrc->ctx_timestamp = xe_lrc_ctx_timestamp(lrc);
 
 	return lrc->ctx_timestamp;
 }
diff --git a/drivers/gpu/drm/xe/xe_lrc.h b/drivers/gpu/drm/xe/xe_lrc.h
index 882c3437ba5c..001af6c79454 100644
--- a/drivers/gpu/drm/xe/xe_lrc.h
+++ b/drivers/gpu/drm/xe/xe_lrc.h
@@ -94,6 +94,11 @@ void xe_lrc_snapshot_capture_delayed(struct xe_lrc_snapshot *snapshot);
 void xe_lrc_snapshot_print(struct xe_lrc_snapshot *snapshot, struct drm_printer *p);
 void xe_lrc_snapshot_free(struct xe_lrc_snapshot *snapshot);
 
+u32 xe_lrc_ctx_timestamp_ggtt_addr(struct xe_lrc *lrc);
+u32 xe_lrc_ctx_timestamp(struct xe_lrc *lrc);
+u32 xe_lrc_ctx_job_timestamp_ggtt_addr(struct xe_lrc *lrc);
+u32 xe_lrc_ctx_job_timestamp(struct xe_lrc *lrc);
+
 /**
  * xe_lrc_update_timestamp - readout LRC timestamp and update cached value
  * @lrc: logical ring context for this exec queue
-- 
2.34.1

[PATCH v6 02/11] drm/xe: Add MI_COPY_MEM_MEM GPU instruction definitions

[Matthew Brost]

MI_COPY_MEM_MEM GPU instructions are used to copy ctx timestamp from a
LRC registers to another location at the beginning of every jobs
execution. Add MI_COPY_MEM_MEM GPU instruction definitions.

v2:
 - Include MI_COPY_MEM_MEM based on instruction order (Michal)
 - Fix tabs/spaces issue (Michal)
 - Use macro for DW definition (Michal)

Signed-off-by: Matthew Brost <matthew.brost@intel.com>
Reviewed-by: Jonathan Cavitt <jonathan.cavitt@intel.com>
---
 drivers/gpu/drm/xe/instructions/xe_mi_commands.h | 4 ++++
 1 file changed, 4 insertions(+)

diff --git a/drivers/gpu/drm/xe/instructions/xe_mi_commands.h b/drivers/gpu/drm/xe/instructions/xe_mi_commands.h
index c74ceb550dce..b7bf99dd4848 100644
--- a/drivers/gpu/drm/xe/instructions/xe_mi_commands.h
+++ b/drivers/gpu/drm/xe/instructions/xe_mi_commands.h
@@ -59,6 +59,10 @@
 #define MI_LOAD_REGISTER_MEM		(__MI_INSTR(0x29) | XE_INSTR_NUM_DW(4))
 #define   MI_LRM_USE_GGTT		REG_BIT(22)
 
+#define MI_COPY_MEM_MEM			(__MI_INSTR(0x2e) | XE_INSTR_NUM_DW(5))
+#define   MI_COPY_MEM_MEM_SRC_GGTT	REG_BIT(22)
+#define   MI_COPY_MEM_MEM_DST_GGTT	REG_BIT(21)
+
 #define MI_BATCH_BUFFER_START		__MI_INSTR(0x31)
 
 #endif
-- 
2.34.1

[PATCH v6 03/11] drm/xe: Emit ctx timestamp copy in ring ops

[Matthew Brost]

Copy ctx timestamp at beginning of every GPU job to a saved location.
Used to determine how long a job has been running on the hardware.

v2:
 - - s/ctx_timestamp_job/ctx_job_timestamp

Signed-off-by: Matthew Brost <matthew.brost@intel.com>
Reviewed-by: Jonathan Cavitt <jonathan.cavitt@intel.com>
---
 drivers/gpu/drm/xe/xe_ring_ops.c | 21 +++++++++++++++++++++
 1 file changed, 21 insertions(+)

diff --git a/drivers/gpu/drm/xe/xe_ring_ops.c b/drivers/gpu/drm/xe/xe_ring_ops.c
index db630d27beba..0be4f489d3e1 100644
--- a/drivers/gpu/drm/xe/xe_ring_ops.c
+++ b/drivers/gpu/drm/xe/xe_ring_ops.c
@@ -224,6 +224,19 @@ static u32 get_ppgtt_flag(struct xe_sched_job *job)
 	return job->q->vm ? BIT(8) : 0;
 }
 
+static int emit_copy_timestamp(struct xe_lrc *lrc, u32 *dw, int i)
+{
+	dw[i++] = MI_COPY_MEM_MEM | MI_COPY_MEM_MEM_SRC_GGTT |
+		MI_COPY_MEM_MEM_DST_GGTT;
+	dw[i++] = xe_lrc_ctx_job_timestamp_ggtt_addr(lrc);
+	dw[i++] = 0;
+	dw[i++] = xe_lrc_ctx_timestamp_ggtt_addr(lrc);
+	dw[i++] = 0;
+	dw[i++] = MI_NOOP;
+
+	return i;
+}
+
 /* for engines that don't require any special HW handling (no EUs, no aux inval, etc) */
 static void __emit_job_gen12_simple(struct xe_sched_job *job, struct xe_lrc *lrc,
 				    u64 batch_addr, u32 seqno)
@@ -232,6 +245,8 @@ static void __emit_job_gen12_simple(struct xe_sched_job *job, struct xe_lrc *lrc
 	u32 ppgtt_flag = get_ppgtt_flag(job);
 	struct xe_gt *gt = job->q->gt;
 
+	i = emit_copy_timestamp(lrc, dw, i);
+
 	if (job->ring_ops_flush_tlb) {
 		dw[i++] = preparser_disable(true);
 		i = emit_flush_imm_ggtt(xe_lrc_start_seqno_ggtt_addr(lrc),
@@ -283,6 +298,8 @@ static void __emit_job_gen12_video(struct xe_sched_job *job, struct xe_lrc *lrc,
 	struct xe_device *xe = gt_to_xe(gt);
 	bool decode = job->q->class == XE_ENGINE_CLASS_VIDEO_DECODE;
 
+	i = emit_copy_timestamp(lrc, dw, i);
+
 	dw[i++] = preparser_disable(true);
 
 	/* hsdes: 1809175790 */
@@ -332,6 +349,8 @@ static void __emit_job_gen12_render_compute(struct xe_sched_job *job,
 	bool lacks_render = !(gt->info.engine_mask & XE_HW_ENGINE_RCS_MASK);
 	u32 mask_flags = 0;
 
+	i = emit_copy_timestamp(lrc, dw, i);
+
 	dw[i++] = preparser_disable(true);
 	if (lacks_render)
 		mask_flags = PIPE_CONTROL_3D_ARCH_FLAGS;
@@ -375,6 +394,8 @@ static void emit_migration_job_gen12(struct xe_sched_job *job,
 {
 	u32 dw[MAX_JOB_SIZE_DW], i = 0;
 
+	i = emit_copy_timestamp(lrc, dw, i);
+
 	i = emit_store_imm_ggtt(xe_lrc_start_seqno_ggtt_addr(lrc),
 				seqno, dw, i);
 
-- 
2.34.1

[PATCH v6 04/11] drm/xe: Add ctx timestamp to LRC snapshot

[Matthew Brost]

The ctx timestamp is useful information, add to LRC snapshot.

v2:
  - s/ctx_timestamp_job/ctx_job_timestamp

Signed-off-by: Matthew Brost <matthew.brost@intel.com>
Reviewed-by: Jonathan Cavitt <jonathan.cavitt@intel.com>
---
 drivers/gpu/drm/xe/xe_lrc.c | 6 ++++++
 1 file changed, 6 insertions(+)

diff --git a/drivers/gpu/drm/xe/xe_lrc.c b/drivers/gpu/drm/xe/xe_lrc.c
index 2ad645f49ec9..43bc5e33a6c7 100644
--- a/drivers/gpu/drm/xe/xe_lrc.c
+++ b/drivers/gpu/drm/xe/xe_lrc.c
@@ -49,6 +49,8 @@ struct xe_lrc_snapshot {
 	} tail;
 	u32 start_seqno;
 	u32 seqno;
+	u32 ctx_timestamp;
+	u32 ctx_job_timestamp;
 };
 
 static struct xe_device *
@@ -1642,6 +1644,8 @@ struct xe_lrc_snapshot *xe_lrc_snapshot_capture(struct xe_lrc *lrc)
 	snapshot->lrc_offset = xe_lrc_pphwsp_offset(lrc);
 	snapshot->lrc_size = lrc->bo->size - snapshot->lrc_offset;
 	snapshot->lrc_snapshot = NULL;
+	snapshot->ctx_timestamp = xe_lrc_ctx_timestamp(lrc);
+	snapshot->ctx_job_timestamp = xe_lrc_ctx_job_timestamp(lrc);
 	return snapshot;
 }
 
@@ -1690,6 +1694,8 @@ void xe_lrc_snapshot_print(struct xe_lrc_snapshot *snapshot, struct drm_printer
 		   snapshot->tail.internal, snapshot->tail.memory);
 	drm_printf(p, "\tStart seqno: (memory) %d\n", snapshot->start_seqno);
 	drm_printf(p, "\tSeqno: (memory) %d\n", snapshot->seqno);
+	drm_printf(p, "\tTimestamp: 0x%08x\n", snapshot->ctx_timestamp);
+	drm_printf(p, "\tJob Timestamp: 0x%08x\n", snapshot->ctx_job_timestamp);
 
 	if (!snapshot->lrc_snapshot)
 		return;
-- 
2.34.1

[PATCH v6 05/11] drm/xe: Add xe_gt_clock_interval_to_ms helper

[Matthew Brost]

Add helper to convert GT clock ticks to msec. Useful for determining if
timeouts occur by examing GT clock ticks.

v6:
- s/nom/n , s/dom/d (Jonathan)
- include math64 (CI)

Signed-off-by: Matthew Brost <matthew.brost@intel.com>
Reviewed-by: Jonathan Cavitt <jonathan.cavitt@intel.com>
---
 drivers/gpu/drm/xe/xe_gt_clock.c | 20 ++++++++++++++++++++
 drivers/gpu/drm/xe/xe_gt_clock.h |  1 +
 2 files changed, 21 insertions(+)

diff --git a/drivers/gpu/drm/xe/xe_gt_clock.c b/drivers/gpu/drm/xe/xe_gt_clock.c
index 9ff2061133df..86c2d62b4bdc 100644
--- a/drivers/gpu/drm/xe/xe_gt_clock.c
+++ b/drivers/gpu/drm/xe/xe_gt_clock.c
@@ -3,6 +3,8 @@
  * Copyright © 2022 Intel Corporation
  */
 
+#include <linux/math64.h>
+
 #include "xe_gt_clock.h"
 
 #include "regs/xe_gt_regs.h"
@@ -79,3 +81,21 @@ int xe_gt_clock_init(struct xe_gt *gt)
 	gt->info.reference_clock = freq;
 	return 0;
 }
+
+static u64 div_u64_roundup(u64 n, u32 d)
+{
+	return div_u64(n + d - 1, d);
+}
+
+/**
+ * xe_gt_clock_interval_to_ms - Convert sampled GT clock ticks to msec
+ *
+ * @gt: the &xe_gt
+ * @count: count of GT clock ticks
+ *
+ * Returns: time in msec
+ */
+u64 xe_gt_clock_interval_to_ms(struct xe_gt *gt, u64 count)
+{
+	return div_u64_roundup(count * MSEC_PER_SEC, gt->info.reference_clock);
+}
diff --git a/drivers/gpu/drm/xe/xe_gt_clock.h b/drivers/gpu/drm/xe/xe_gt_clock.h
index 44fa0371b973..3adeb7baaca4 100644
--- a/drivers/gpu/drm/xe/xe_gt_clock.h
+++ b/drivers/gpu/drm/xe/xe_gt_clock.h
@@ -11,5 +11,6 @@
 struct xe_gt;
 
 int xe_gt_clock_init(struct xe_gt *gt);
+u64 xe_gt_clock_interval_to_ms(struct xe_gt *gt, u64 count);
 
 #endif
-- 
2.34.1

[PATCH v6 06/11] drm/xe: Improve unexpected state error messages

[Matthew Brost]

Include G2H handler name when an unexpected error state messages.

v6:
- Use xe_gt_err (Michal)
- Print runnable state (John H)

Signed-off-by: Matthew Brost <matthew.brost@intel.com>
Reviewed-by: Jonathan Cavitt <jonathan.cavitt@intel.com>
---
 drivers/gpu/drm/xe/xe_guc_submit.c | 12 ++++++++----
 1 file changed, 8 insertions(+), 4 deletions(-)

diff --git a/drivers/gpu/drm/xe/xe_guc_submit.c b/drivers/gpu/drm/xe/xe_guc_submit.c
index 4464ba337d12..afd22a8d815d 100644
--- a/drivers/gpu/drm/xe/xe_guc_submit.c
+++ b/drivers/gpu/drm/xe/xe_guc_submit.c
@@ -1620,6 +1620,7 @@ int xe_guc_sched_done_handler(struct xe_guc *guc, u32 *msg, u32 len)
 	struct xe_device *xe = guc_to_xe(guc);
 	struct xe_exec_queue *q;
 	u32 guc_id = msg[0];
+	u32 runnable_state = msg[1];
 
 	if (unlikely(len < 2)) {
 		drm_err(&xe->drm, "Invalid length %u", len);
@@ -1632,8 +1633,10 @@ int xe_guc_sched_done_handler(struct xe_guc *guc, u32 *msg, u32 len)
 
 	if (unlikely(!exec_queue_pending_enable(q) &&
 		     !exec_queue_pending_disable(q))) {
-		drm_err(&xe->drm, "Unexpected engine state 0x%04x",
-			atomic_read(&q->guc->state));
+		xe_gt_err(guc_to_gt(guc),
+			  "SCHED_DONE: Unexpected engine state 0x%04x, guc_id=%d, runnable_state=%u",
+			  atomic_read(&q->guc->state), q->guc->id,
+			  runnable_state);
 		return -EPROTO;
 	}
 
@@ -1671,8 +1674,9 @@ int xe_guc_deregister_done_handler(struct xe_guc *guc, u32 *msg, u32 len)
 
 	if (!exec_queue_destroyed(q) || exec_queue_pending_disable(q) ||
 	    exec_queue_pending_enable(q) || exec_queue_enabled(q)) {
-		drm_err(&xe->drm, "Unexpected engine state 0x%04x",
-			atomic_read(&q->guc->state));
+		xe_gt_err(guc_to_gt(guc),
+			  "DEREGISTER_DONE: Unexpected engine state 0x%04x, guc_id=%d",
+			  atomic_read(&q->guc->state), q->guc->id);
 		return -EPROTO;
 	}
 
-- 
2.34.1

[PATCH v6 07/11] drm/xe: Assert runnable state in handle_sched_done

[Matthew Brost]

Ensure G2H and KMD GuC machine match.

Signed-off-by: Matthew Brost <matthew.brost@intel.com>
---
 drivers/gpu/drm/xe/xe_guc_submit.c | 9 +++++++--
 1 file changed, 7 insertions(+), 2 deletions(-)

diff --git a/drivers/gpu/drm/xe/xe_guc_submit.c b/drivers/gpu/drm/xe/xe_guc_submit.c
index afd22a8d815d..ab0dc93d7740 100644
--- a/drivers/gpu/drm/xe/xe_guc_submit.c
+++ b/drivers/gpu/drm/xe/xe_guc_submit.c
@@ -1592,16 +1592,21 @@ static void deregister_exec_queue(struct xe_guc *guc, struct xe_exec_queue *q)
 	xe_guc_ct_send_g2h_handler(&guc->ct, action, ARRAY_SIZE(action));
 }
 
-static void handle_sched_done(struct xe_guc *guc, struct xe_exec_queue *q)
+static void handle_sched_done(struct xe_guc *guc, struct xe_exec_queue *q,
+			      u32 runnable_state)
 {
 	trace_xe_exec_queue_scheduling_done(q);
 
 	if (exec_queue_pending_enable(q)) {
+		xe_gt_assert(guc_to_gt(guc), runnable_state == 1);
+
 		q->guc->resume_time = ktime_get();
 		clear_exec_queue_pending_enable(q);
 		smp_wmb();
 		wake_up_all(&guc->ct.wq);
 	} else {
+		xe_gt_assert(guc_to_gt(guc), runnable_state == 0);
+
 		clear_exec_queue_pending_disable(q);
 		if (q->guc->suspend_pending) {
 			suspend_fence_signal(q);
@@ -1640,7 +1645,7 @@ int xe_guc_sched_done_handler(struct xe_guc *guc, u32 *msg, u32 len)
 		return -EPROTO;
 	}
 
-	handle_sched_done(guc, q);
+	handle_sched_done(guc, q, runnable_state);
 
 	return 0;
 }
-- 
2.34.1

RE: [PATCH v6 07/11] drm/xe: Assert runnable state in handle_sched_done

[Cavitt, Jonathan]

-----Original Message-----
From: Intel-xe <intel-xe-bounces@lists.freedesktop.org> On Behalf Of Matthew Brost
Sent: Tuesday, June 11, 2024 7:41 AM
To: intel-xe@lists.freedesktop.org
Subject: [PATCH v6 07/11] drm/xe: Assert runnable state in handle_sched_done
> 
> Ensure G2H and KMD GuC machine match.
> 
> Signed-off-by: Matthew Brost <matthew.brost@intel.com>

Reviewed-by: Jonathan Cavitt <jonathan.cavitt@intel.com>
-Jonathan Cavitt

> ---
>  drivers/gpu/drm/xe/xe_guc_submit.c | 9 +++++++--
>  1 file changed, 7 insertions(+), 2 deletions(-)
> 
> diff --git a/drivers/gpu/drm/xe/xe_guc_submit.c b/drivers/gpu/drm/xe/xe_guc_submit.c
> index afd22a8d815d..ab0dc93d7740 100644
> --- a/drivers/gpu/drm/xe/xe_guc_submit.c
> +++ b/drivers/gpu/drm/xe/xe_guc_submit.c
> @@ -1592,16 +1592,21 @@ static void deregister_exec_queue(struct xe_guc *guc, struct xe_exec_queue *q)
>  	xe_guc_ct_send_g2h_handler(&guc->ct, action, ARRAY_SIZE(action));
>  }
>  
> -static void handle_sched_done(struct xe_guc *guc, struct xe_exec_queue *q)
> +static void handle_sched_done(struct xe_guc *guc, struct xe_exec_queue *q,
> +			      u32 runnable_state)
>  {
>  	trace_xe_exec_queue_scheduling_done(q);
>  
>  	if (exec_queue_pending_enable(q)) {
> +		xe_gt_assert(guc_to_gt(guc), runnable_state == 1);
> +
>  		q->guc->resume_time = ktime_get();
>  		clear_exec_queue_pending_enable(q);
>  		smp_wmb();
>  		wake_up_all(&guc->ct.wq);
>  	} else {
> +		xe_gt_assert(guc_to_gt(guc), runnable_state == 0);
> +
>  		clear_exec_queue_pending_disable(q);
>  		if (q->guc->suspend_pending) {
>  			suspend_fence_signal(q);
> @@ -1640,7 +1645,7 @@ int xe_guc_sched_done_handler(struct xe_guc *guc, u32 *msg, u32 len)
>  		return -EPROTO;
>  	}
>  
> -	handle_sched_done(guc, q);
> +	handle_sched_done(guc, q, runnable_state);
>  
>  	return 0;
>  }
> -- 
> 2.34.1
> 
> 

Re: [PATCH v6 07/11] drm/xe: Assert runnable state in handle_sched_done

[John Harrison]

On 6/11/2024 07:40, Matthew Brost wrote:
> Ensure G2H and KMD GuC machine match.
>
> Signed-off-by: Matthew Brost <matthew.brost@intel.com>
> ---
>   drivers/gpu/drm/xe/xe_guc_submit.c | 9 +++++++--
>   1 file changed, 7 insertions(+), 2 deletions(-)
>
> diff --git a/drivers/gpu/drm/xe/xe_guc_submit.c b/drivers/gpu/drm/xe/xe_guc_submit.c
> index afd22a8d815d..ab0dc93d7740 100644
> --- a/drivers/gpu/drm/xe/xe_guc_submit.c
> +++ b/drivers/gpu/drm/xe/xe_guc_submit.c
> @@ -1592,16 +1592,21 @@ static void deregister_exec_queue(struct xe_guc *guc, struct xe_exec_queue *q)
>   	xe_guc_ct_send_g2h_handler(&guc->ct, action, ARRAY_SIZE(action));
>   }
>   
> -static void handle_sched_done(struct xe_guc *guc, struct xe_exec_queue *q)
> +static void handle_sched_done(struct xe_guc *guc, struct xe_exec_queue *q,
> +			      u32 runnable_state)
>   {
>   	trace_xe_exec_queue_scheduling_done(q);
>   
>   	if (exec_queue_pending_enable(q)) {
> +		xe_gt_assert(guc_to_gt(guc), runnable_state == 1);
> +
>   		q->guc->resume_time = ktime_get();
>   		clear_exec_queue_pending_enable(q);
>   		smp_wmb();
>   		wake_up_all(&guc->ct.wq);
>   	} else {
> +		xe_gt_assert(guc_to_gt(guc), runnable_state == 0);
> +
Isn't this the wrong way around?

You made an earlier comment that sounded like it is legal for an enable 
to be queued while a disable is still pending? If so, then you would get 
in here for the disable notification but with both enable_pending and 
disable_pending flags set. That would hit the assert. Whereas, if the if 
checks the runnable_state parameter and the assert then checks for 
pending, you will not hit the assert and the code will do the correct thing.

John.

>   		clear_exec_queue_pending_disable(q);
>   		if (q->guc->suspend_pending) {
>   			suspend_fence_signal(q);
> @@ -1640,7 +1645,7 @@ int xe_guc_sched_done_handler(struct xe_guc *guc, u32 *msg, u32 len)
>   		return -EPROTO;
>   	}
>   
> -	handle_sched_done(guc, q);
> +	handle_sched_done(guc, q, runnable_state);
>   
>   	return 0;
>   }

Re: [PATCH v6 07/11] drm/xe: Assert runnable state in handle_sched_done

[Matthew Brost]

On Wed, Jun 12, 2024 at 02:25:40PM -0700, John Harrison wrote:
> On 6/11/2024 07:40, Matthew Brost wrote:
> > Ensure G2H and KMD GuC machine match.
> > 
> > Signed-off-by: Matthew Brost <matthew.brost@intel.com>
> > ---
> >   drivers/gpu/drm/xe/xe_guc_submit.c | 9 +++++++--
> >   1 file changed, 7 insertions(+), 2 deletions(-)
> > 
> > diff --git a/drivers/gpu/drm/xe/xe_guc_submit.c b/drivers/gpu/drm/xe/xe_guc_submit.c
> > index afd22a8d815d..ab0dc93d7740 100644
> > --- a/drivers/gpu/drm/xe/xe_guc_submit.c
> > +++ b/drivers/gpu/drm/xe/xe_guc_submit.c
> > @@ -1592,16 +1592,21 @@ static void deregister_exec_queue(struct xe_guc *guc, struct xe_exec_queue *q)
> >   	xe_guc_ct_send_g2h_handler(&guc->ct, action, ARRAY_SIZE(action));
> >   }
> > -static void handle_sched_done(struct xe_guc *guc, struct xe_exec_queue *q)
> > +static void handle_sched_done(struct xe_guc *guc, struct xe_exec_queue *q,
> > +			      u32 runnable_state)
> >   {
> >   	trace_xe_exec_queue_scheduling_done(q);
> >   	if (exec_queue_pending_enable(q)) {
> > +		xe_gt_assert(guc_to_gt(guc), runnable_state == 1);
> > +
> >   		q->guc->resume_time = ktime_get();
> >   		clear_exec_queue_pending_enable(q);
> >   		smp_wmb();
> >   		wake_up_all(&guc->ct.wq);
> >   	} else {
> > +		xe_gt_assert(guc_to_gt(guc), runnable_state == 0);
> > +
> Isn't this the wrong way around?
> 

These asserts are per my testing and CI.

> You made an earlier comment that sounded like it is legal for an enable to
> be queued while a disable is still pending? If so, then you would get in

Other way around, a disable can be sent when an enable is still in
flight in the case of a preempt fence.

Enables cannot be issued when a pending disable is in flight.

So I believe this patch is correct.

Matt

> here for the disable notification but with both enable_pending and
> disable_pending flags set. That would hit the assert. Whereas, if the if
> checks the runnable_state parameter and the assert then checks for pending,
> you will not hit the assert and the code will do the correct thing.
> 
> John.
> 
> >   		clear_exec_queue_pending_disable(q);
> >   		if (q->guc->suspend_pending) {
> >   			suspend_fence_signal(q);
> > @@ -1640,7 +1645,7 @@ int xe_guc_sched_done_handler(struct xe_guc *guc, u32 *msg, u32 len)
> >   		return -EPROTO;
> >   	}
> > -	handle_sched_done(guc, q);
> > +	handle_sched_done(guc, q, runnable_state);
> >   	return 0;
> >   }
> 

Re: [PATCH v6 07/11] drm/xe: Assert runnable state in handle_sched_done

[John Harrison]

On 6/12/2024 15:27, Matthew Brost wrote:
> On Wed, Jun 12, 2024 at 02:25:40PM -0700, John Harrison wrote:
>> On 6/11/2024 07:40, Matthew Brost wrote:
>>> Ensure G2H and KMD GuC machine match.
>>>
>>> Signed-off-by: Matthew Brost <matthew.brost@intel.com>
>>> ---
>>>    drivers/gpu/drm/xe/xe_guc_submit.c | 9 +++++++--
>>>    1 file changed, 7 insertions(+), 2 deletions(-)
>>>
>>> diff --git a/drivers/gpu/drm/xe/xe_guc_submit.c b/drivers/gpu/drm/xe/xe_guc_submit.c
>>> index afd22a8d815d..ab0dc93d7740 100644
>>> --- a/drivers/gpu/drm/xe/xe_guc_submit.c
>>> +++ b/drivers/gpu/drm/xe/xe_guc_submit.c
>>> @@ -1592,16 +1592,21 @@ static void deregister_exec_queue(struct xe_guc *guc, struct xe_exec_queue *q)
>>>    	xe_guc_ct_send_g2h_handler(&guc->ct, action, ARRAY_SIZE(action));
>>>    }
>>> -static void handle_sched_done(struct xe_guc *guc, struct xe_exec_queue *q)
>>> +static void handle_sched_done(struct xe_guc *guc, struct xe_exec_queue *q,
>>> +			      u32 runnable_state)
>>>    {
>>>    	trace_xe_exec_queue_scheduling_done(q);
>>>    	if (exec_queue_pending_enable(q)) {
>>> +		xe_gt_assert(guc_to_gt(guc), runnable_state == 1);
>>> +
>>>    		q->guc->resume_time = ktime_get();
>>>    		clear_exec_queue_pending_enable(q);
>>>    		smp_wmb();
>>>    		wake_up_all(&guc->ct.wq);
>>>    	} else {
>>> +		xe_gt_assert(guc_to_gt(guc), runnable_state == 0);
>>> +
>> Isn't this the wrong way around?
>>
> These asserts are per my testing and CI.
>
>> You made an earlier comment that sounded like it is legal for an enable to
>> be queued while a disable is still pending? If so, then you would get in
> Other way around, a disable can be sent when an enable is still in
> flight in the case of a preempt fence.
>
> Enables cannot be issued when a pending disable is in flight.
>
> So I believe this patch is correct.
It might work but it does not feel correct.

On receipt of a disable notification, the code first checks to see if 
there is a pending enable. That just seems backwards. It is more logical 
to process the message according to the message type actually received 
rather than according to the message type that is expected.

If there is ever a valid reason for sending back to back 
disable-then-enable, then this will break. Whereas, coding it according 
to the notification type rather than the internal state would allow that 
sequence to work just fine.

As I mentioned earlier, this code is basically broken in i915 and can't 
be fixed without a significant re-write of the upper layers. It would be 
greatly preferable to do it properly in Xe.

John.


>
> Matt
>
>> here for the disable notification but with both enable_pending and
>> disable_pending flags set. That would hit the assert. Whereas, if the if
>> checks the runnable_state parameter and the assert then checks for pending,
>> you will not hit the assert and the code will do the correct thing.
>>
>> John.
>>
>>>    		clear_exec_queue_pending_disable(q);
>>>    		if (q->guc->suspend_pending) {
>>>    			suspend_fence_signal(q);
>>> @@ -1640,7 +1645,7 @@ int xe_guc_sched_done_handler(struct xe_guc *guc, u32 *msg, u32 len)
>>>    		return -EPROTO;
>>>    	}
>>> -	handle_sched_done(guc, q);
>>> +	handle_sched_done(guc, q, runnable_state);
>>>    	return 0;
>>>    }

Re: [PATCH v6 07/11] drm/xe: Assert runnable state in handle_sched_done

[Matthew Brost]

On Wed, Jun 12, 2024 at 05:54:30PM -0700, John Harrison wrote:
> On 6/12/2024 15:27, Matthew Brost wrote:
> > On Wed, Jun 12, 2024 at 02:25:40PM -0700, John Harrison wrote:
> > > On 6/11/2024 07:40, Matthew Brost wrote:
> > > > Ensure G2H and KMD GuC machine match.
> > > > 
> > > > Signed-off-by: Matthew Brost <matthew.brost@intel.com>
> > > > ---
> > > >    drivers/gpu/drm/xe/xe_guc_submit.c | 9 +++++++--
> > > >    1 file changed, 7 insertions(+), 2 deletions(-)
> > > > 
> > > > diff --git a/drivers/gpu/drm/xe/xe_guc_submit.c b/drivers/gpu/drm/xe/xe_guc_submit.c
> > > > index afd22a8d815d..ab0dc93d7740 100644
> > > > --- a/drivers/gpu/drm/xe/xe_guc_submit.c
> > > > +++ b/drivers/gpu/drm/xe/xe_guc_submit.c
> > > > @@ -1592,16 +1592,21 @@ static void deregister_exec_queue(struct xe_guc *guc, struct xe_exec_queue *q)
> > > >    	xe_guc_ct_send_g2h_handler(&guc->ct, action, ARRAY_SIZE(action));
> > > >    }
> > > > -static void handle_sched_done(struct xe_guc *guc, struct xe_exec_queue *q)
> > > > +static void handle_sched_done(struct xe_guc *guc, struct xe_exec_queue *q,
> > > > +			      u32 runnable_state)
> > > >    {
> > > >    	trace_xe_exec_queue_scheduling_done(q);
> > > >    	if (exec_queue_pending_enable(q)) {
> > > > +		xe_gt_assert(guc_to_gt(guc), runnable_state == 1);
> > > > +
> > > >    		q->guc->resume_time = ktime_get();
> > > >    		clear_exec_queue_pending_enable(q);
> > > >    		smp_wmb();
> > > >    		wake_up_all(&guc->ct.wq);
> > > >    	} else {
> > > > +		xe_gt_assert(guc_to_gt(guc), runnable_state == 0);
> > > > +
> > > Isn't this the wrong way around?
> > > 
> > These asserts are per my testing and CI.
> > 
> > > You made an earlier comment that sounded like it is legal for an enable to
> > > be queued while a disable is still pending? If so, then you would get in
> > Other way around, a disable can be sent when an enable is still in
> > flight in the case of a preempt fence.
> > 
> > Enables cannot be issued when a pending disable is in flight.
> > 
> > So I believe this patch is correct.
> It might work but it does not feel correct.
> 
> On receipt of a disable notification, the code first checks to see if there
> is a pending enable. That just seems backwards. It is more logical to
> process the message according to the message type actually received rather
> than according to the message type that is expected.
> 
> If there is ever a valid reason for sending back to back
> disable-then-enable, then this will break. Whereas, coding it according to
> the notification type rather than the internal state would allow that
> sequence to work just fine.
> 

Can I do this in a follow up? Like immediately after merging this? I
suggest this as this series has green CI, RBs, will help stablize the
stack for VK (issue #799), ack'd by Paulo, and fixes a known gap in our
job timeout mechanism.

Matt

> As I mentioned earlier, this code is basically broken in i915 and can't be
> fixed without a significant re-write of the upper layers. It would be
> greatly preferable to do it properly in Xe.
> 
> John.
> 
> 
> > 
> > Matt
> > 
> > > here for the disable notification but with both enable_pending and
> > > disable_pending flags set. That would hit the assert. Whereas, if the if
> > > checks the runnable_state parameter and the assert then checks for pending,
> > > you will not hit the assert and the code will do the correct thing.
> > > 
> > > John.
> > > 
> > > >    		clear_exec_queue_pending_disable(q);
> > > >    		if (q->guc->suspend_pending) {
> > > >    			suspend_fence_signal(q);
> > > > @@ -1640,7 +1645,7 @@ int xe_guc_sched_done_handler(struct xe_guc *guc, u32 *msg, u32 len)
> > > >    		return -EPROTO;
> > > >    	}
> > > > -	handle_sched_done(guc, q);
> > > > +	handle_sched_done(guc, q, runnable_state);
> > > >    	return 0;
> > > >    }
> 

Re: [PATCH v6 07/11] drm/xe: Assert runnable state in handle_sched_done

[John Harrison]

On 6/12/2024 18:47, Matthew Brost wrote:
> On Wed, Jun 12, 2024 at 05:54:30PM -0700, John Harrison wrote:
>> On 6/12/2024 15:27, Matthew Brost wrote:
>>> On Wed, Jun 12, 2024 at 02:25:40PM -0700, John Harrison wrote:
>>>> On 6/11/2024 07:40, Matthew Brost wrote:
>>>>> Ensure G2H and KMD GuC machine match.
>>>>>
>>>>> Signed-off-by: Matthew Brost <matthew.brost@intel.com>
>>>>> ---
>>>>>     drivers/gpu/drm/xe/xe_guc_submit.c | 9 +++++++--
>>>>>     1 file changed, 7 insertions(+), 2 deletions(-)
>>>>>
>>>>> diff --git a/drivers/gpu/drm/xe/xe_guc_submit.c b/drivers/gpu/drm/xe/xe_guc_submit.c
>>>>> index afd22a8d815d..ab0dc93d7740 100644
>>>>> --- a/drivers/gpu/drm/xe/xe_guc_submit.c
>>>>> +++ b/drivers/gpu/drm/xe/xe_guc_submit.c
>>>>> @@ -1592,16 +1592,21 @@ static void deregister_exec_queue(struct xe_guc *guc, struct xe_exec_queue *q)
>>>>>     	xe_guc_ct_send_g2h_handler(&guc->ct, action, ARRAY_SIZE(action));
>>>>>     }
>>>>> -static void handle_sched_done(struct xe_guc *guc, struct xe_exec_queue *q)
>>>>> +static void handle_sched_done(struct xe_guc *guc, struct xe_exec_queue *q,
>>>>> +			      u32 runnable_state)
>>>>>     {
>>>>>     	trace_xe_exec_queue_scheduling_done(q);
>>>>>     	if (exec_queue_pending_enable(q)) {
>>>>> +		xe_gt_assert(guc_to_gt(guc), runnable_state == 1);
>>>>> +
>>>>>     		q->guc->resume_time = ktime_get();
>>>>>     		clear_exec_queue_pending_enable(q);
>>>>>     		smp_wmb();
>>>>>     		wake_up_all(&guc->ct.wq);
>>>>>     	} else {
>>>>> +		xe_gt_assert(guc_to_gt(guc), runnable_state == 0);
>>>>> +
>>>> Isn't this the wrong way around?
>>>>
>>> These asserts are per my testing and CI.
>>>
>>>> You made an earlier comment that sounded like it is legal for an enable to
>>>> be queued while a disable is still pending? If so, then you would get in
>>> Other way around, a disable can be sent when an enable is still in
>>> flight in the case of a preempt fence.
>>>
>>> Enables cannot be issued when a pending disable is in flight.
>>>
>>> So I believe this patch is correct.
>> It might work but it does not feel correct.
>>
>> On receipt of a disable notification, the code first checks to see if there
>> is a pending enable. That just seems backwards. It is more logical to
>> process the message according to the message type actually received rather
>> than according to the message type that is expected.
>>
>> If there is ever a valid reason for sending back to back
>> disable-then-enable, then this will break. Whereas, coding it according to
>> the notification type rather than the internal state would allow that
>> sequence to work just fine.
>>
> Can I do this in a follow up? Like immediately after merging this? I
> suggest this as this series has green CI, RBs, will help stablize the
> stack for VK (issue #799), ack'd by Paulo, and fixes a known gap in our
> job timeout mechanism.
>
> Matt
Sure. Like you say, the current version will work as the driver stands.

John.

>
>> As I mentioned earlier, this code is basically broken in i915 and can't be
>> fixed without a significant re-write of the upper layers. It would be
>> greatly preferable to do it properly in Xe.
>>
>> John.
>>
>>
>>> Matt
>>>
>>>> here for the disable notification but with both enable_pending and
>>>> disable_pending flags set. That would hit the assert. Whereas, if the if
>>>> checks the runnable_state parameter and the assert then checks for pending,
>>>> you will not hit the assert and the code will do the correct thing.
>>>>
>>>> John.
>>>>
>>>>>     		clear_exec_queue_pending_disable(q);
>>>>>     		if (q->guc->suspend_pending) {
>>>>>     			suspend_fence_signal(q);
>>>>> @@ -1640,7 +1645,7 @@ int xe_guc_sched_done_handler(struct xe_guc *guc, u32 *msg, u32 len)
>>>>>     		return -EPROTO;
>>>>>     	}
>>>>> -	handle_sched_done(guc, q);
>>>>> +	handle_sched_done(guc, q, runnable_state);
>>>>>     	return 0;
>>>>>     }

[PATCH v6 08/11] drm/xe: Add GuC state asserts to deregister_exec_queue

[Matthew Brost]

Will help catch bugs in GuC state machine.

Signed-off-by: Matthew Brost <matthew.brost@intel.com>
Reviewed-by: Jonathan Cavitt <jonathan.cavitt@intel.com>
---
 drivers/gpu/drm/xe/xe_guc_submit.c | 5 +++++
 1 file changed, 5 insertions(+)

diff --git a/drivers/gpu/drm/xe/xe_guc_submit.c b/drivers/gpu/drm/xe/xe_guc_submit.c
index ab0dc93d7740..26c27ca51b2e 100644
--- a/drivers/gpu/drm/xe/xe_guc_submit.c
+++ b/drivers/gpu/drm/xe/xe_guc_submit.c
@@ -1587,6 +1587,11 @@ static void deregister_exec_queue(struct xe_guc *guc, struct xe_exec_queue *q)
 		q->guc->id,
 	};
 
+	xe_gt_assert(guc_to_gt(guc), exec_queue_destroyed(q));
+	xe_gt_assert(guc_to_gt(guc), exec_queue_registered(q));
+	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_disable(q));
+	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_enable(q));
+
 	trace_xe_exec_queue_deregister(q);
 
 	xe_guc_ct_send_g2h_handler(&guc->ct, action, ARRAY_SIZE(action));
-- 
2.34.1

[PATCH v6 09/11] drm/xe: Add pending disable assert to handle_sched_done

[Matthew Brost]

Will help catch bugs in GuC state machine.

Signed-off-by: Matthew Brost <matthew.brost@intel.com>
Reviewed-by: Jonathan Cavitt <jonathan.cavitt@intel.com>
---
 drivers/gpu/drm/xe/xe_guc_submit.c | 1 +
 1 file changed, 1 insertion(+)

diff --git a/drivers/gpu/drm/xe/xe_guc_submit.c b/drivers/gpu/drm/xe/xe_guc_submit.c
index 26c27ca51b2e..25240b50a59c 100644
--- a/drivers/gpu/drm/xe/xe_guc_submit.c
+++ b/drivers/gpu/drm/xe/xe_guc_submit.c
@@ -1611,6 +1611,7 @@ static void handle_sched_done(struct xe_guc *guc, struct xe_exec_queue *q,
 		wake_up_all(&guc->ct.wq);
 	} else {
 		xe_gt_assert(guc_to_gt(guc), runnable_state == 0);
+		xe_gt_assert(guc_to_gt(guc), exec_queue_pending_disable(q));
 
 		clear_exec_queue_pending_disable(q);
 		if (q->guc->suspend_pending) {
-- 
2.34.1

[PATCH v6 10/11] drm/xe: Add killed, banned, or wedged as stick bit during GuC reset

[Matthew Brost]

These bits should be persistent across reset, treat them as such.

Signed-off-by: Matthew Brost <matthew.brost@intel.com>
Reviewed-by: Jonathan Cavitt <jonathan.cavitt@intel.com>
---
 drivers/gpu/drm/xe/xe_guc_submit.c | 4 +++-
 1 file changed, 3 insertions(+), 1 deletion(-)

diff --git a/drivers/gpu/drm/xe/xe_guc_submit.c b/drivers/gpu/drm/xe/xe_guc_submit.c
index 25240b50a59c..671c72caf0ff 100644
--- a/drivers/gpu/drm/xe/xe_guc_submit.c
+++ b/drivers/gpu/drm/xe/xe_guc_submit.c
@@ -1444,7 +1444,9 @@ static void guc_exec_queue_stop(struct xe_guc *guc, struct xe_exec_queue *q)
 		set_exec_queue_suspended(q);
 		suspend_fence_signal(q);
 	}
-	atomic_and(EXEC_QUEUE_STATE_DESTROYED | EXEC_QUEUE_STATE_SUSPENDED,
+	atomic_and(EXEC_QUEUE_STATE_WEDGED | EXEC_QUEUE_STATE_BANNED |
+		   EXEC_QUEUE_STATE_KILLED | EXEC_QUEUE_STATE_DESTROYED |
+		   EXEC_QUEUE_STATE_SUSPENDED,
 		   &q->guc->state);
 	q->guc->resume_time = 0;
 	trace_xe_exec_queue_stop(q);
-- 
2.34.1

[PATCH v6 11/11] drm/xe: Sample ctx timestamp to determine if jobs have timed out

[Matthew Brost]

In GuC TDR sample ctx timestamp to determine if jobs have timed out. The
scheduling enable needs to be toggled to properly sample the timestamp.
If a job has not been running for longer than the timeout period,
re-enable scheduling and restart the TDR.

v2:
 - Use GT clock to msec helper (Umesh, off list)
 - s/ctx_timestamp_job/ctx_job_timestamp
v3:
 - Fix state machine for TDR, mainly decouple sched disable and
   deregister (testing)
 - Rebase (CI)
v4:
 - Fix checkpatch && newline issue (CI)
 - Do not deregister on wedged or unregistered (CI)
 - Fix refcounting bugs (CI)
 - Move devcoredump above VM / kernel job check (John H)
 - Add comment for check_timeout state usage (John H)
 - Assert pending disable not inflight when enabling scheduling (John H)
 - Use enable_scheduling in other scheduling enable code (John H)
 - Add comments on a few steps in TDR (John H)
 - Add assert for timestamp overflow protection (John H)
v6:
 - Use mul_u64_u32_div (CI, checkpath)
 - Change check time to dbg level (Paulo)
 - Add immediate mode to sched disable (inspection)
 - Use xe_gt_* messages (John H)
 - Fix typo in comment (John H)
 - Check timeout before clearing pending disable (Paulo)

Signed-off-by: Matthew Brost <matthew.brost@intel.com>
Reviewed-by: Jonathan Cavitt <jonathan.cavitt@intel.com>
---
 drivers/gpu/drm/xe/xe_guc_submit.c | 303 +++++++++++++++++++++++------
 1 file changed, 242 insertions(+), 61 deletions(-)

diff --git a/drivers/gpu/drm/xe/xe_guc_submit.c b/drivers/gpu/drm/xe/xe_guc_submit.c
index 671c72caf0ff..cddb391888b6 100644
--- a/drivers/gpu/drm/xe/xe_guc_submit.c
+++ b/drivers/gpu/drm/xe/xe_guc_submit.c
@@ -10,6 +10,7 @@
 #include <linux/circ_buf.h>
 #include <linux/delay.h>
 #include <linux/dma-fence-array.h>
+#include <linux/math64.h>
 
 #include <drm/drm_managed.h>
 
@@ -23,6 +24,7 @@
 #include "xe_force_wake.h"
 #include "xe_gpu_scheduler.h"
 #include "xe_gt.h"
+#include "xe_gt_clock.h"
 #include "xe_gt_printk.h"
 #include "xe_guc.h"
 #include "xe_guc_ct.h"
@@ -62,6 +64,8 @@ exec_queue_to_guc(struct xe_exec_queue *q)
 #define EXEC_QUEUE_STATE_KILLED			(1 << 7)
 #define EXEC_QUEUE_STATE_WEDGED			(1 << 8)
 #define EXEC_QUEUE_STATE_BANNED			(1 << 9)
+#define EXEC_QUEUE_STATE_CHECK_TIMEOUT		(1 << 10)
+#define EXEC_QUEUE_STATE_EXTRA_REF		(1 << 11)
 
 static bool exec_queue_registered(struct xe_exec_queue *q)
 {
@@ -188,6 +192,31 @@ static void set_exec_queue_wedged(struct xe_exec_queue *q)
 	atomic_or(EXEC_QUEUE_STATE_WEDGED, &q->guc->state);
 }
 
+static bool exec_queue_check_timeout(struct xe_exec_queue *q)
+{
+	return atomic_read(&q->guc->state) & EXEC_QUEUE_STATE_CHECK_TIMEOUT;
+}
+
+static void set_exec_queue_check_timeout(struct xe_exec_queue *q)
+{
+	atomic_or(EXEC_QUEUE_STATE_CHECK_TIMEOUT, &q->guc->state);
+}
+
+static void clear_exec_queue_check_timeout(struct xe_exec_queue *q)
+{
+	atomic_and(~EXEC_QUEUE_STATE_CHECK_TIMEOUT, &q->guc->state);
+}
+
+static bool exec_queue_extra_ref(struct xe_exec_queue *q)
+{
+	return atomic_read(&q->guc->state) & EXEC_QUEUE_STATE_EXTRA_REF;
+}
+
+static void set_exec_queue_extra_ref(struct xe_exec_queue *q)
+{
+	atomic_or(EXEC_QUEUE_STATE_EXTRA_REF, &q->guc->state);
+}
+
 static bool exec_queue_killed_or_banned_or_wedged(struct xe_exec_queue *q)
 {
 	return (atomic_read(&q->guc->state) &
@@ -920,6 +949,109 @@ static void xe_guc_exec_queue_lr_cleanup(struct work_struct *w)
 	xe_sched_submission_start(sched);
 }
 
+#define ADJUST_FIVE_PERCENT(__t)	mul_u64_u32_div((__t), 105, 100)
+
+static bool check_timeout(struct xe_exec_queue *q, struct xe_sched_job *job)
+{
+	struct xe_gt *gt = guc_to_gt(exec_queue_to_guc(q));
+	u32 ctx_timestamp = xe_lrc_ctx_timestamp(q->lrc[0]);
+	u32 ctx_job_timestamp = xe_lrc_ctx_job_timestamp(q->lrc[0]);
+	u32 timeout_ms = q->sched_props.job_timeout_ms;
+	u32 diff;
+	u64 running_time_ms;
+
+	/*
+	 * Counter wraps at ~223s at the usual 19.2MHz, be paranoid catch
+	 * possible overflows with a high timeout.
+	 */
+	xe_gt_assert(gt, timeout_ms < 100 * MSEC_PER_SEC);
+
+	if (ctx_timestamp < ctx_job_timestamp)
+		diff = ctx_timestamp + U32_MAX - ctx_job_timestamp;
+	else
+		diff = ctx_timestamp - ctx_job_timestamp;
+
+	/*
+	 * Ensure timeout is within 5% to account for an GuC scheduling latency
+	 */
+	running_time_ms =
+		ADJUST_FIVE_PERCENT(xe_gt_clock_interval_to_ms(gt, diff));
+
+	xe_gt_dbg(gt,
+		  "Check job timeout: seqno=%u, lrc_seqno=%u, guc_id=%d, running_time_ms=%llu, timeout_ms=%u, diff=0x%08x",
+		  xe_sched_job_seqno(job), xe_sched_job_lrc_seqno(job),
+		  q->guc->id, running_time_ms, timeout_ms, diff);
+
+	return running_time_ms >= timeout_ms;
+}
+
+static void enable_scheduling(struct xe_exec_queue *q)
+{
+	MAKE_SCHED_CONTEXT_ACTION(q, ENABLE);
+	struct xe_guc *guc = exec_queue_to_guc(q);
+	int ret;
+
+	xe_gt_assert(guc_to_gt(guc), !exec_queue_destroyed(q));
+	xe_gt_assert(guc_to_gt(guc), exec_queue_registered(q));
+	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_disable(q));
+	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_enable(q));
+
+	set_exec_queue_pending_enable(q);
+	set_exec_queue_enabled(q);
+	trace_xe_exec_queue_scheduling_enable(q);
+
+	xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
+		       G2H_LEN_DW_SCHED_CONTEXT_MODE_SET, 1);
+
+	ret = wait_event_timeout(guc->ct.wq,
+				 !exec_queue_pending_enable(q) ||
+				 guc_read_stopped(guc), HZ * 5);
+	if (!ret || guc_read_stopped(guc)) {
+		xe_gt_warn(guc_to_gt(guc), "Schedule enable failed to respond");
+		set_exec_queue_banned(q);
+		xe_gt_reset_async(q->gt);
+		xe_sched_tdr_queue_imm(&q->guc->sched);
+	}
+}
+
+static void disable_scheduling(struct xe_exec_queue *q, bool immediate)
+{
+	MAKE_SCHED_CONTEXT_ACTION(q, DISABLE);
+	struct xe_guc *guc = exec_queue_to_guc(q);
+
+	xe_gt_assert(guc_to_gt(guc), !exec_queue_destroyed(q));
+	xe_gt_assert(guc_to_gt(guc), exec_queue_registered(q));
+	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_disable(q));
+
+	if (immediate)
+		set_min_preemption_timeout(guc, q);
+	clear_exec_queue_enabled(q);
+	set_exec_queue_pending_disable(q);
+	trace_xe_exec_queue_scheduling_disable(q);
+
+	xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
+		       G2H_LEN_DW_SCHED_CONTEXT_MODE_SET, 1);
+}
+
+static void __deregister_exec_queue(struct xe_guc *guc, struct xe_exec_queue *q)
+{
+	u32 action[] = {
+		XE_GUC_ACTION_DEREGISTER_CONTEXT,
+		q->guc->id,
+	};
+
+	xe_gt_assert(guc_to_gt(guc), !exec_queue_destroyed(q));
+	xe_gt_assert(guc_to_gt(guc), exec_queue_registered(q));
+	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_enable(q));
+	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_disable(q));
+
+	set_exec_queue_destroyed(q);
+	trace_xe_exec_queue_deregister(q);
+
+	xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
+		       G2H_LEN_DW_DEREGISTER_CONTEXT, 1);
+}
+
 static enum drm_gpu_sched_stat
 guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
 {
@@ -927,10 +1059,10 @@ guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
 	struct xe_sched_job *tmp_job;
 	struct xe_exec_queue *q = job->q;
 	struct xe_gpu_scheduler *sched = &q->guc->sched;
-	struct xe_device *xe = guc_to_xe(exec_queue_to_guc(q));
+	struct xe_guc *guc = exec_queue_to_guc(q);
 	int err = -ETIME;
 	int i = 0;
-	bool wedged;
+	bool wedged, skip_timeout_check;
 
 	/*
 	 * TDR has fired before free job worker. Common if exec queue
@@ -942,49 +1074,53 @@ guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
 		return DRM_GPU_SCHED_STAT_NOMINAL;
 	}
 
-	drm_notice(&xe->drm, "Timedout job: seqno=%u, lrc_seqno=%u, guc_id=%d, flags=0x%lx",
-		   xe_sched_job_seqno(job), xe_sched_job_lrc_seqno(job),
-		   q->guc->id, q->flags);
-	xe_gt_WARN(q->gt, q->flags & EXEC_QUEUE_FLAG_KERNEL,
-		   "Kernel-submitted job timed out\n");
-	xe_gt_WARN(q->gt, q->flags & EXEC_QUEUE_FLAG_VM && !exec_queue_killed(q),
-		   "VM job timed out on non-killed execqueue\n");
-
-	if (!exec_queue_killed(q))
-		xe_devcoredump(job);
-
-	trace_xe_sched_job_timedout(job);
-
-	wedged = guc_submit_hint_wedged(exec_queue_to_guc(q));
-
 	/* Kill the run_job entry point */
 	xe_sched_submission_stop(sched);
 
+	/* Must check all state after stopping scheduler */
+	skip_timeout_check = exec_queue_reset(q) ||
+		exec_queue_killed_or_banned_or_wedged(q) ||
+		exec_queue_destroyed(q);
+
+	/* Job hasn't started, can't be timed out */
+	if (!skip_timeout_check && !xe_sched_job_started(job))
+		goto rearm;
+
 	/*
-	 * Kernel jobs should never fail, nor should VM jobs if they do
-	 * somethings has gone wrong and the GT needs a reset
+	 * XXX: Sampling timeout doesn't work in wedged mode as we have to
+	 * modify scheduling state to read timestamp. We could read the
+	 * timestamp from a register to accumulate current running time but this
+	 * doesn't work for SRIOV. For now assuming timeouts in wedged mode are
+	 * genuine timeouts.
 	 */
-	if (!wedged && (q->flags & EXEC_QUEUE_FLAG_KERNEL ||
-			(q->flags & EXEC_QUEUE_FLAG_VM && !exec_queue_killed(q)))) {
-		if (!xe_sched_invalidate_job(job, 2)) {
-			xe_sched_add_pending_job(sched, job);
-			xe_sched_submission_start(sched);
-			xe_gt_reset_async(q->gt);
-			goto out;
-		}
-	}
+	wedged = guc_submit_hint_wedged(exec_queue_to_guc(q));
 
-	/* Engine state now stable, disable scheduling if needed */
+	/* Engine state now stable, disable scheduling to check timestamp */
 	if (!wedged && exec_queue_registered(q)) {
-		struct xe_guc *guc = exec_queue_to_guc(q);
 		int ret;
 
 		if (exec_queue_reset(q))
 			err = -EIO;
-		set_exec_queue_banned(q);
+
 		if (!exec_queue_destroyed(q)) {
-			xe_exec_queue_get(q);
-			disable_scheduling_deregister(guc, q);
+			/*
+			 * Wait for any pending G2H to flush out before
+			 * modifying state
+			 */
+			ret = wait_event_timeout(guc->ct.wq,
+						 !exec_queue_pending_enable(q) ||
+						 guc_read_stopped(guc), HZ * 5);
+			if (!ret || guc_read_stopped(guc))
+				goto trigger_reset;
+
+			/*
+			 * Flag communicates to G2H handler that schedule
+			 * disable originated from a timeout check. The G2H then
+			 * avoid triggering cleanup or deregistering the exec
+			 * queue.
+			 */
+			set_exec_queue_check_timeout(q);
+			disable_scheduling(q, skip_timeout_check);
 		}
 
 		/*
@@ -1000,15 +1136,60 @@ guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
 					 !exec_queue_pending_disable(q) ||
 					 guc_read_stopped(guc), HZ * 5);
 		if (!ret || guc_read_stopped(guc)) {
-			drm_warn(&xe->drm, "Schedule disable failed to respond");
-			xe_sched_add_pending_job(sched, job);
-			xe_sched_submission_start(sched);
+trigger_reset:
+			xe_gt_warn(guc_to_gt(guc), "Schedule disable failed to respond");
+			set_exec_queue_extra_ref(q);
+			xe_exec_queue_get(q);	/* GT reset owns this */
+			set_exec_queue_banned(q);
 			xe_gt_reset_async(q->gt);
 			xe_sched_tdr_queue_imm(sched);
-			goto out;
+			goto rearm;
+		}
+	}
+
+	/*
+	 * Check if job is actually timed out, if so restart job execution and TDR
+	 */
+	if (!wedged && !skip_timeout_check && !check_timeout(q, job) &&
+	    !exec_queue_reset(q) && exec_queue_registered(q)) {
+		clear_exec_queue_check_timeout(q);
+		goto sched_enable;
+	}
+
+	xe_gt_notice(guc_to_gt(guc), "Timedout job: seqno=%u, lrc_seqno=%u, guc_id=%d, flags=0x%lx",
+		     xe_sched_job_seqno(job), xe_sched_job_lrc_seqno(job),
+		     q->guc->id, q->flags);
+	xe_gt_WARN(q->gt, q->flags & EXEC_QUEUE_FLAG_KERNEL,
+		   "Kernel-submitted job timed out\n");
+	xe_gt_WARN(q->gt, q->flags & EXEC_QUEUE_FLAG_VM && !exec_queue_killed(q),
+		   "VM job timed out on non-killed execqueue\n");
+
+	trace_xe_sched_job_timedout(job);
+
+	if (!exec_queue_killed(q))
+		xe_devcoredump(job);
+
+	/*
+	 * Kernel jobs should never fail, nor should VM jobs if they do
+	 * somethings has gone wrong and the GT needs a reset
+	 */
+	if (!wedged && (q->flags & EXEC_QUEUE_FLAG_KERNEL ||
+			(q->flags & EXEC_QUEUE_FLAG_VM && !exec_queue_killed(q)))) {
+		if (!xe_sched_invalidate_job(job, 2)) {
+			clear_exec_queue_check_timeout(q);
+			xe_gt_reset_async(q->gt);
+			goto rearm;
 		}
 	}
 
+	/* Finish cleaning up exec queue via deregister */
+	set_exec_queue_banned(q);
+	if (!wedged && exec_queue_registered(q) && !exec_queue_destroyed(q)) {
+		set_exec_queue_extra_ref(q);
+		xe_exec_queue_get(q);
+		__deregister_exec_queue(guc, q);
+	}
+
 	/* Stop fence signaling */
 	xe_hw_fence_irq_stop(q->fence_irq);
 
@@ -1030,7 +1211,19 @@ guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
 	/* Start fence signaling */
 	xe_hw_fence_irq_start(q->fence_irq);
 
-out:
+	return DRM_GPU_SCHED_STAT_NOMINAL;
+
+sched_enable:
+	enable_scheduling(q);
+rearm:
+	/*
+	 * XXX: Ideally want to adjust timeout based on current exection time
+	 * but there is not currently an easy way to do in DRM scheduler. With
+	 * some thought, do this in a follow up.
+	 */
+	xe_sched_add_pending_job(sched, job);
+	xe_sched_submission_start(sched);
+
 	return DRM_GPU_SCHED_STAT_NOMINAL;
 }
 
@@ -1133,7 +1326,6 @@ static void __guc_exec_queue_process_msg_suspend(struct xe_sched_msg *msg)
 			   guc_read_stopped(guc));
 
 		if (!guc_read_stopped(guc)) {
-			MAKE_SCHED_CONTEXT_ACTION(q, DISABLE);
 			s64 since_resume_ms =
 				ktime_ms_delta(ktime_get(),
 					       q->guc->resume_time);
@@ -1144,12 +1336,7 @@ static void __guc_exec_queue_process_msg_suspend(struct xe_sched_msg *msg)
 				msleep(wait_ms);
 
 			set_exec_queue_suspended(q);
-			clear_exec_queue_enabled(q);
-			set_exec_queue_pending_disable(q);
-			trace_xe_exec_queue_scheduling_disable(q);
-
-			xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
-				       G2H_LEN_DW_SCHED_CONTEXT_MODE_SET, 1);
+			disable_scheduling(q, false);
 		}
 	} else if (q->guc->suspend_pending) {
 		set_exec_queue_suspended(q);
@@ -1160,19 +1347,11 @@ static void __guc_exec_queue_process_msg_suspend(struct xe_sched_msg *msg)
 static void __guc_exec_queue_process_msg_resume(struct xe_sched_msg *msg)
 {
 	struct xe_exec_queue *q = msg->private_data;
-	struct xe_guc *guc = exec_queue_to_guc(q);
 
 	if (guc_exec_queue_allowed_to_change_state(q)) {
-		MAKE_SCHED_CONTEXT_ACTION(q, ENABLE);
-
 		q->guc->resume_time = RESUME_PENDING;
 		clear_exec_queue_suspended(q);
-		set_exec_queue_pending_enable(q);
-		set_exec_queue_enabled(q);
-		trace_xe_exec_queue_scheduling_enable(q);
-
-		xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
-			       G2H_LEN_DW_SCHED_CONTEXT_MODE_SET, 1);
+		enable_scheduling(q);
 	} else {
 		clear_exec_queue_suspended(q);
 	}
@@ -1434,8 +1613,7 @@ static void guc_exec_queue_stop(struct xe_guc *guc, struct xe_exec_queue *q)
 
 	/* Clean up lost G2H + reset engine state */
 	if (exec_queue_registered(q)) {
-		if ((exec_queue_banned(q) && exec_queue_destroyed(q)) ||
-		    xe_exec_queue_is_lr(q))
+		if (exec_queue_extra_ref(q) || xe_exec_queue_is_lr(q))
 			xe_exec_queue_put(q);
 		else if (exec_queue_destroyed(q))
 			__guc_exec_queue_fini(guc, q);
@@ -1612,6 +1790,8 @@ static void handle_sched_done(struct xe_guc *guc, struct xe_exec_queue *q,
 		smp_wmb();
 		wake_up_all(&guc->ct.wq);
 	} else {
+		bool check_timeout = exec_queue_check_timeout(q);
+
 		xe_gt_assert(guc_to_gt(guc), runnable_state == 0);
 		xe_gt_assert(guc_to_gt(guc), exec_queue_pending_disable(q));
 
@@ -1619,11 +1799,12 @@ static void handle_sched_done(struct xe_guc *guc, struct xe_exec_queue *q,
 		if (q->guc->suspend_pending) {
 			suspend_fence_signal(q);
 		} else {
-			if (exec_queue_banned(q)) {
+			if (exec_queue_banned(q) || check_timeout) {
 				smp_wmb();
 				wake_up_all(&guc->ct.wq);
 			}
-			deregister_exec_queue(guc, q);
+			if (!check_timeout)
+				deregister_exec_queue(guc, q);
 		}
 	}
 }
@@ -1664,7 +1845,7 @@ static void handle_deregister_done(struct xe_guc *guc, struct xe_exec_queue *q)
 
 	clear_exec_queue_registered(q);
 
-	if (exec_queue_banned(q) || xe_exec_queue_is_lr(q))
+	if (exec_queue_extra_ref(q) || xe_exec_queue_is_lr(q))
 		xe_exec_queue_put(q);
 	else
 		__guc_exec_queue_fini(guc, q);
@@ -1728,7 +1909,7 @@ int xe_guc_exec_queue_reset_handler(struct xe_guc *guc, u32 *msg, u32 len)
 	 * guc_exec_queue_timedout_job.
 	 */
 	set_exec_queue_reset(q);
-	if (!exec_queue_banned(q))
+	if (!exec_queue_banned(q) && !exec_queue_check_timeout(q))
 		xe_guc_exec_queue_trigger_cleanup(q);
 
 	return 0;
@@ -1758,7 +1939,7 @@ int xe_guc_exec_queue_memory_cat_error_handler(struct xe_guc *guc, u32 *msg,
 
 	/* Treat the same as engine reset */
 	set_exec_queue_reset(q);
-	if (!exec_queue_banned(q))
+	if (!exec_queue_banned(q) && !exec_queue_check_timeout(q))
 		xe_guc_exec_queue_trigger_cleanup(q);
 
 	return 0;
-- 
2.34.1

Re: [PATCH v6 11/11] drm/xe: Sample ctx timestamp to determine if jobs have timed out

[John Harrison]

On 6/11/2024 07:40, Matthew Brost wrote:
> In GuC TDR sample ctx timestamp to determine if jobs have timed out. The
> scheduling enable needs to be toggled to properly sample the timestamp.
> If a job has not been running for longer than the timeout period,
> re-enable scheduling and restart the TDR.
>
> v2:
>   - Use GT clock to msec helper (Umesh, off list)
>   - s/ctx_timestamp_job/ctx_job_timestamp
> v3:
>   - Fix state machine for TDR, mainly decouple sched disable and
>     deregister (testing)
>   - Rebase (CI)
> v4:
>   - Fix checkpatch && newline issue (CI)
>   - Do not deregister on wedged or unregistered (CI)
>   - Fix refcounting bugs (CI)
>   - Move devcoredump above VM / kernel job check (John H)
>   - Add comment for check_timeout state usage (John H)
>   - Assert pending disable not inflight when enabling scheduling (John H)
>   - Use enable_scheduling in other scheduling enable code (John H)
>   - Add comments on a few steps in TDR (John H)
>   - Add assert for timestamp overflow protection (John H)
> v6:
>   - Use mul_u64_u32_div (CI, checkpath)
>   - Change check time to dbg level (Paulo)
>   - Add immediate mode to sched disable (inspection)
>   - Use xe_gt_* messages (John H)
>   - Fix typo in comment (John H)
>   - Check timeout before clearing pending disable (Paulo)
>
> Signed-off-by: Matthew Brost <matthew.brost@intel.com>
> Reviewed-by: Jonathan Cavitt <jonathan.cavitt@intel.com>
> ---
>   drivers/gpu/drm/xe/xe_guc_submit.c | 303 +++++++++++++++++++++++------
>   1 file changed, 242 insertions(+), 61 deletions(-)
>
> diff --git a/drivers/gpu/drm/xe/xe_guc_submit.c b/drivers/gpu/drm/xe/xe_guc_submit.c
> index 671c72caf0ff..cddb391888b6 100644
> --- a/drivers/gpu/drm/xe/xe_guc_submit.c
> +++ b/drivers/gpu/drm/xe/xe_guc_submit.c
> @@ -10,6 +10,7 @@
>   #include <linux/circ_buf.h>
>   #include <linux/delay.h>
>   #include <linux/dma-fence-array.h>
> +#include <linux/math64.h>
>   
>   #include <drm/drm_managed.h>
>   
> @@ -23,6 +24,7 @@
>   #include "xe_force_wake.h"
>   #include "xe_gpu_scheduler.h"
>   #include "xe_gt.h"
> +#include "xe_gt_clock.h"
>   #include "xe_gt_printk.h"
>   #include "xe_guc.h"
>   #include "xe_guc_ct.h"
> @@ -62,6 +64,8 @@ exec_queue_to_guc(struct xe_exec_queue *q)
>   #define EXEC_QUEUE_STATE_KILLED			(1 << 7)
>   #define EXEC_QUEUE_STATE_WEDGED			(1 << 8)
>   #define EXEC_QUEUE_STATE_BANNED			(1 << 9)
> +#define EXEC_QUEUE_STATE_CHECK_TIMEOUT		(1 << 10)
> +#define EXEC_QUEUE_STATE_EXTRA_REF		(1 << 11)
>   
>   static bool exec_queue_registered(struct xe_exec_queue *q)
>   {
> @@ -188,6 +192,31 @@ static void set_exec_queue_wedged(struct xe_exec_queue *q)
>   	atomic_or(EXEC_QUEUE_STATE_WEDGED, &q->guc->state);
>   }
>   
> +static bool exec_queue_check_timeout(struct xe_exec_queue *q)
> +{
> +	return atomic_read(&q->guc->state) & EXEC_QUEUE_STATE_CHECK_TIMEOUT;
> +}
> +
> +static void set_exec_queue_check_timeout(struct xe_exec_queue *q)
> +{
> +	atomic_or(EXEC_QUEUE_STATE_CHECK_TIMEOUT, &q->guc->state);
> +}
> +
> +static void clear_exec_queue_check_timeout(struct xe_exec_queue *q)
> +{
> +	atomic_and(~EXEC_QUEUE_STATE_CHECK_TIMEOUT, &q->guc->state);
> +}
> +
> +static bool exec_queue_extra_ref(struct xe_exec_queue *q)
> +{
> +	return atomic_read(&q->guc->state) & EXEC_QUEUE_STATE_EXTRA_REF;
> +}
> +
> +static void set_exec_queue_extra_ref(struct xe_exec_queue *q)
> +{
> +	atomic_or(EXEC_QUEUE_STATE_EXTRA_REF, &q->guc->state);
> +}
> +
>   static bool exec_queue_killed_or_banned_or_wedged(struct xe_exec_queue *q)
>   {
>   	return (atomic_read(&q->guc->state) &
> @@ -920,6 +949,109 @@ static void xe_guc_exec_queue_lr_cleanup(struct work_struct *w)
>   	xe_sched_submission_start(sched);
>   }
>   
> +#define ADJUST_FIVE_PERCENT(__t)	mul_u64_u32_div((__t), 105, 100)
> +
> +static bool check_timeout(struct xe_exec_queue *q, struct xe_sched_job *job)
> +{
> +	struct xe_gt *gt = guc_to_gt(exec_queue_to_guc(q));
> +	u32 ctx_timestamp = xe_lrc_ctx_timestamp(q->lrc[0]);
> +	u32 ctx_job_timestamp = xe_lrc_ctx_job_timestamp(q->lrc[0]);
> +	u32 timeout_ms = q->sched_props.job_timeout_ms;
> +	u32 diff;
> +	u64 running_time_ms;
> +
> +	/*
> +	 * Counter wraps at ~223s at the usual 19.2MHz, be paranoid catch
> +	 * possible overflows with a high timeout.
> +	 */
> +	xe_gt_assert(gt, timeout_ms < 100 * MSEC_PER_SEC);
> +
> +	if (ctx_timestamp < ctx_job_timestamp)
> +		diff = ctx_timestamp + U32_MAX - ctx_job_timestamp;
> +	else
> +		diff = ctx_timestamp - ctx_job_timestamp;
> +
> +	/*
> +	 * Ensure timeout is within 5% to account for an GuC scheduling latency
> +	 */
> +	running_time_ms =
> +		ADJUST_FIVE_PERCENT(xe_gt_clock_interval_to_ms(gt, diff));
> +
> +	xe_gt_dbg(gt,
> +		  "Check job timeout: seqno=%u, lrc_seqno=%u, guc_id=%d, running_time_ms=%llu, timeout_ms=%u, diff=0x%08x",
> +		  xe_sched_job_seqno(job), xe_sched_job_lrc_seqno(job),
> +		  q->guc->id, running_time_ms, timeout_ms, diff);
> +
> +	return running_time_ms >= timeout_ms;
> +}
> +
> +static void enable_scheduling(struct xe_exec_queue *q)
> +{
> +	MAKE_SCHED_CONTEXT_ACTION(q, ENABLE);
> +	struct xe_guc *guc = exec_queue_to_guc(q);
> +	int ret;
> +
> +	xe_gt_assert(guc_to_gt(guc), !exec_queue_destroyed(q));
> +	xe_gt_assert(guc_to_gt(guc), exec_queue_registered(q));
> +	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_disable(q));
> +	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_enable(q));
> +
> +	set_exec_queue_pending_enable(q);
> +	set_exec_queue_enabled(q);
> +	trace_xe_exec_queue_scheduling_enable(q);
> +
> +	xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
> +		       G2H_LEN_DW_SCHED_CONTEXT_MODE_SET, 1);
> +
> +	ret = wait_event_timeout(guc->ct.wq,
> +				 !exec_queue_pending_enable(q) ||
> +				 guc_read_stopped(guc), HZ * 5);
> +	if (!ret || guc_read_stopped(guc)) {
> +		xe_gt_warn(guc_to_gt(guc), "Schedule enable failed to respond");
> +		set_exec_queue_banned(q);
> +		xe_gt_reset_async(q->gt);
> +		xe_sched_tdr_queue_imm(&q->guc->sched);
> +	}
> +}
> +
> +static void disable_scheduling(struct xe_exec_queue *q, bool immediate)
> +{
> +	MAKE_SCHED_CONTEXT_ACTION(q, DISABLE);
> +	struct xe_guc *guc = exec_queue_to_guc(q);
> +
> +	xe_gt_assert(guc_to_gt(guc), !exec_queue_destroyed(q));
> +	xe_gt_assert(guc_to_gt(guc), exec_queue_registered(q));
> +	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_disable(q));
> +
> +	if (immediate)
> +		set_min_preemption_timeout(guc, q);
> +	clear_exec_queue_enabled(q);
> +	set_exec_queue_pending_disable(q);
> +	trace_xe_exec_queue_scheduling_disable(q);
> +
> +	xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
> +		       G2H_LEN_DW_SCHED_CONTEXT_MODE_SET, 1);
> +}
> +
> +static void __deregister_exec_queue(struct xe_guc *guc, struct xe_exec_queue *q)
> +{
> +	u32 action[] = {
> +		XE_GUC_ACTION_DEREGISTER_CONTEXT,
> +		q->guc->id,
> +	};
> +
> +	xe_gt_assert(guc_to_gt(guc), !exec_queue_destroyed(q));
> +	xe_gt_assert(guc_to_gt(guc), exec_queue_registered(q));
> +	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_enable(q));
> +	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_disable(q));
> +
> +	set_exec_queue_destroyed(q);
> +	trace_xe_exec_queue_deregister(q);
> +
> +	xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
> +		       G2H_LEN_DW_DEREGISTER_CONTEXT, 1);
> +}
> +
>   static enum drm_gpu_sched_stat
>   guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
>   {
> @@ -927,10 +1059,10 @@ guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
>   	struct xe_sched_job *tmp_job;
>   	struct xe_exec_queue *q = job->q;
>   	struct xe_gpu_scheduler *sched = &q->guc->sched;
> -	struct xe_device *xe = guc_to_xe(exec_queue_to_guc(q));
> +	struct xe_guc *guc = exec_queue_to_guc(q);
>   	int err = -ETIME;
>   	int i = 0;
> -	bool wedged;
> +	bool wedged, skip_timeout_check;
>   
>   	/*
>   	 * TDR has fired before free job worker. Common if exec queue
> @@ -942,49 +1074,53 @@ guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
>   		return DRM_GPU_SCHED_STAT_NOMINAL;
>   	}
>   
> -	drm_notice(&xe->drm, "Timedout job: seqno=%u, lrc_seqno=%u, guc_id=%d, flags=0x%lx",
> -		   xe_sched_job_seqno(job), xe_sched_job_lrc_seqno(job),
> -		   q->guc->id, q->flags);
> -	xe_gt_WARN(q->gt, q->flags & EXEC_QUEUE_FLAG_KERNEL,
> -		   "Kernel-submitted job timed out\n");
> -	xe_gt_WARN(q->gt, q->flags & EXEC_QUEUE_FLAG_VM && !exec_queue_killed(q),
> -		   "VM job timed out on non-killed execqueue\n");
> -
> -	if (!exec_queue_killed(q))
> -		xe_devcoredump(job);
> -
> -	trace_xe_sched_job_timedout(job);
> -
> -	wedged = guc_submit_hint_wedged(exec_queue_to_guc(q));
> -
>   	/* Kill the run_job entry point */
>   	xe_sched_submission_stop(sched);
>   
> +	/* Must check all state after stopping scheduler */
> +	skip_timeout_check = exec_queue_reset(q) ||
> +		exec_queue_killed_or_banned_or_wedged(q) ||
> +		exec_queue_destroyed(q);
> +
> +	/* Job hasn't started, can't be timed out */
> +	if (!skip_timeout_check && !xe_sched_job_started(job))
> +		goto rearm;
> +
>   	/*
> -	 * Kernel jobs should never fail, nor should VM jobs if they do
> -	 * somethings has gone wrong and the GT needs a reset
> +	 * XXX: Sampling timeout doesn't work in wedged mode as we have to
> +	 * modify scheduling state to read timestamp. We could read the
> +	 * timestamp from a register to accumulate current running time but this
> +	 * doesn't work for SRIOV. For now assuming timeouts in wedged mode are
> +	 * genuine timeouts.
>   	 */
> -	if (!wedged && (q->flags & EXEC_QUEUE_FLAG_KERNEL ||
> -			(q->flags & EXEC_QUEUE_FLAG_VM && !exec_queue_killed(q)))) {
> -		if (!xe_sched_invalidate_job(job, 2)) {
> -			xe_sched_add_pending_job(sched, job);
> -			xe_sched_submission_start(sched);
> -			xe_gt_reset_async(q->gt);
> -			goto out;
> -		}
> -	}
> +	wedged = guc_submit_hint_wedged(exec_queue_to_guc(q));
>   
> -	/* Engine state now stable, disable scheduling if needed */
> +	/* Engine state now stable, disable scheduling to check timestamp */
>   	if (!wedged && exec_queue_registered(q)) {
> -		struct xe_guc *guc = exec_queue_to_guc(q);
>   		int ret;
>   
>   		if (exec_queue_reset(q))
>   			err = -EIO;
> -		set_exec_queue_banned(q);
> +
>   		if (!exec_queue_destroyed(q)) {
> -			xe_exec_queue_get(q);
> -			disable_scheduling_deregister(guc, q);
> +			/*
> +			 * Wait for any pending G2H to flush out before
> +			 * modifying state
> +			 */
> +			ret = wait_event_timeout(guc->ct.wq,
> +						 !exec_queue_pending_enable(q) ||
> +						 guc_read_stopped(guc), HZ * 5);
> +			if (!ret || guc_read_stopped(guc))
> +				goto trigger_reset;
> +
> +			/*
> +			 * Flag communicates to G2H handler that schedule
> +			 * disable originated from a timeout check. The G2H then
> +			 * avoid triggering cleanup or deregistering the exec
> +			 * queue.
> +			 */
> +			set_exec_queue_check_timeout(q);
> +			disable_scheduling(q, skip_timeout_check);
>   		}
>   
>   		/*
> @@ -1000,15 +1136,60 @@ guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
>   					 !exec_queue_pending_disable(q) ||
>   					 guc_read_stopped(guc), HZ * 5);
>   		if (!ret || guc_read_stopped(guc)) {
> -			drm_warn(&xe->drm, "Schedule disable failed to respond");
> -			xe_sched_add_pending_job(sched, job);
> -			xe_sched_submission_start(sched);
> +trigger_reset:
> +			xe_gt_warn(guc_to_gt(guc), "Schedule disable failed to respond");
Not a problem introduced in this patch set so maybe not necessary to fix 
here either. But we have seen what look like false hits on this warning 
in some of the reset tests. The code gets here if the schedule disable 
genuinely times out which is what the warning is saying. But it also 
gets here if guc_read_stopped() is true and that happens if a reset 
occurs asynchronously to this timeout check. In that situation, there is 
no need to fire a warning - the abort is intentional and expected. It is 
also not necessary to queue up another reset just below. It seems like 
the warning and the reset should be inside a further 'if(!ret)' check.

> +			set_exec_queue_extra_ref(q);
> +			xe_exec_queue_get(q);	/* GT reset owns this */
> +			set_exec_queue_banned(q);
>   			xe_gt_reset_async(q->gt);
>   			xe_sched_tdr_queue_imm(sched);
> -			goto out;
> +			goto rearm;
> +		}
> +	}
> +
> +	/*
> +	 * Check if job is actually timed out, if so restart job execution and TDR
> +	 */
> +	if (!wedged && !skip_timeout_check && !check_timeout(q, job) &&
> +	    !exec_queue_reset(q) && exec_queue_registered(q)) {
> +		clear_exec_queue_check_timeout(q);
> +		goto sched_enable;
> +	}
> +
> +	xe_gt_notice(guc_to_gt(guc), "Timedout job: seqno=%u, lrc_seqno=%u, guc_id=%d, flags=0x%lx",
> +		     xe_sched_job_seqno(job), xe_sched_job_lrc_seqno(job),
> +		     q->guc->id, q->flags);
> +	xe_gt_WARN(q->gt, q->flags & EXEC_QUEUE_FLAG_KERNEL,
> +		   "Kernel-submitted job timed out\n");
> +	xe_gt_WARN(q->gt, q->flags & EXEC_QUEUE_FLAG_VM && !exec_queue_killed(q),
> +		   "VM job timed out on non-killed execqueue\n");
I still think it makes more sense to have these two warnings next to the 
comment that says why these are unexpected errors...

> +
> +	trace_xe_sched_job_timedout(job);
> +
> +	if (!exec_queue_killed(q))
> +		xe_devcoredump(job);
> +
> +	/*
> +	 * Kernel jobs should never fail, nor should VM jobs if they do
> +	 * somethings has gone wrong and the GT needs a reset
> +	 */
... i.e. the warning about kernel jobs and VM jobs not failing should be 
here.

John.

> +	if (!wedged && (q->flags & EXEC_QUEUE_FLAG_KERNEL ||
> +			(q->flags & EXEC_QUEUE_FLAG_VM && !exec_queue_killed(q)))) {
> +		if (!xe_sched_invalidate_job(job, 2)) {
> +			clear_exec_queue_check_timeout(q);
> +			xe_gt_reset_async(q->gt);
> +			goto rearm;
>   		}
>   	}
>   
> +	/* Finish cleaning up exec queue via deregister */
> +	set_exec_queue_banned(q);
> +	if (!wedged && exec_queue_registered(q) && !exec_queue_destroyed(q)) {
> +		set_exec_queue_extra_ref(q);
> +		xe_exec_queue_get(q);
> +		__deregister_exec_queue(guc, q);
> +	}
> +
>   	/* Stop fence signaling */
>   	xe_hw_fence_irq_stop(q->fence_irq);
>   
> @@ -1030,7 +1211,19 @@ guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
>   	/* Start fence signaling */
>   	xe_hw_fence_irq_start(q->fence_irq);
>   
> -out:
> +	return DRM_GPU_SCHED_STAT_NOMINAL;
> +
> +sched_enable:
> +	enable_scheduling(q);
> +rearm:
> +	/*
> +	 * XXX: Ideally want to adjust timeout based on current exection time
> +	 * but there is not currently an easy way to do in DRM scheduler. With
> +	 * some thought, do this in a follow up.
> +	 */
> +	xe_sched_add_pending_job(sched, job);
> +	xe_sched_submission_start(sched);
> +
>   	return DRM_GPU_SCHED_STAT_NOMINAL;
>   }
>   
> @@ -1133,7 +1326,6 @@ static void __guc_exec_queue_process_msg_suspend(struct xe_sched_msg *msg)
>   			   guc_read_stopped(guc));
>   
>   		if (!guc_read_stopped(guc)) {
> -			MAKE_SCHED_CONTEXT_ACTION(q, DISABLE);
>   			s64 since_resume_ms =
>   				ktime_ms_delta(ktime_get(),
>   					       q->guc->resume_time);
> @@ -1144,12 +1336,7 @@ static void __guc_exec_queue_process_msg_suspend(struct xe_sched_msg *msg)
>   				msleep(wait_ms);
>   
>   			set_exec_queue_suspended(q);
> -			clear_exec_queue_enabled(q);
> -			set_exec_queue_pending_disable(q);
> -			trace_xe_exec_queue_scheduling_disable(q);
> -
> -			xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
> -				       G2H_LEN_DW_SCHED_CONTEXT_MODE_SET, 1);
> +			disable_scheduling(q, false);
>   		}
>   	} else if (q->guc->suspend_pending) {
>   		set_exec_queue_suspended(q);
> @@ -1160,19 +1347,11 @@ static void __guc_exec_queue_process_msg_suspend(struct xe_sched_msg *msg)
>   static void __guc_exec_queue_process_msg_resume(struct xe_sched_msg *msg)
>   {
>   	struct xe_exec_queue *q = msg->private_data;
> -	struct xe_guc *guc = exec_queue_to_guc(q);
>   
>   	if (guc_exec_queue_allowed_to_change_state(q)) {
> -		MAKE_SCHED_CONTEXT_ACTION(q, ENABLE);
> -
>   		q->guc->resume_time = RESUME_PENDING;
>   		clear_exec_queue_suspended(q);
> -		set_exec_queue_pending_enable(q);
> -		set_exec_queue_enabled(q);
> -		trace_xe_exec_queue_scheduling_enable(q);
> -
> -		xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
> -			       G2H_LEN_DW_SCHED_CONTEXT_MODE_SET, 1);
> +		enable_scheduling(q);
>   	} else {
>   		clear_exec_queue_suspended(q);
>   	}
> @@ -1434,8 +1613,7 @@ static void guc_exec_queue_stop(struct xe_guc *guc, struct xe_exec_queue *q)
>   
>   	/* Clean up lost G2H + reset engine state */
>   	if (exec_queue_registered(q)) {
> -		if ((exec_queue_banned(q) && exec_queue_destroyed(q)) ||
> -		    xe_exec_queue_is_lr(q))
> +		if (exec_queue_extra_ref(q) || xe_exec_queue_is_lr(q))
>   			xe_exec_queue_put(q);
>   		else if (exec_queue_destroyed(q))
>   			__guc_exec_queue_fini(guc, q);
> @@ -1612,6 +1790,8 @@ static void handle_sched_done(struct xe_guc *guc, struct xe_exec_queue *q,
>   		smp_wmb();
>   		wake_up_all(&guc->ct.wq);
>   	} else {
> +		bool check_timeout = exec_queue_check_timeout(q);
> +
>   		xe_gt_assert(guc_to_gt(guc), runnable_state == 0);
>   		xe_gt_assert(guc_to_gt(guc), exec_queue_pending_disable(q));
>   
> @@ -1619,11 +1799,12 @@ static void handle_sched_done(struct xe_guc *guc, struct xe_exec_queue *q,
>   		if (q->guc->suspend_pending) {
>   			suspend_fence_signal(q);
>   		} else {
> -			if (exec_queue_banned(q)) {
> +			if (exec_queue_banned(q) || check_timeout) {
>   				smp_wmb();
>   				wake_up_all(&guc->ct.wq);
>   			}
> -			deregister_exec_queue(guc, q);
> +			if (!check_timeout)
> +				deregister_exec_queue(guc, q);
>   		}
>   	}
>   }
> @@ -1664,7 +1845,7 @@ static void handle_deregister_done(struct xe_guc *guc, struct xe_exec_queue *q)
>   
>   	clear_exec_queue_registered(q);
>   
> -	if (exec_queue_banned(q) || xe_exec_queue_is_lr(q))
> +	if (exec_queue_extra_ref(q) || xe_exec_queue_is_lr(q))
>   		xe_exec_queue_put(q);
>   	else
>   		__guc_exec_queue_fini(guc, q);
> @@ -1728,7 +1909,7 @@ int xe_guc_exec_queue_reset_handler(struct xe_guc *guc, u32 *msg, u32 len)
>   	 * guc_exec_queue_timedout_job.
>   	 */
>   	set_exec_queue_reset(q);
> -	if (!exec_queue_banned(q))
> +	if (!exec_queue_banned(q) && !exec_queue_check_timeout(q))
>   		xe_guc_exec_queue_trigger_cleanup(q);
>   
>   	return 0;
> @@ -1758,7 +1939,7 @@ int xe_guc_exec_queue_memory_cat_error_handler(struct xe_guc *guc, u32 *msg,
>   
>   	/* Treat the same as engine reset */
>   	set_exec_queue_reset(q);
> -	if (!exec_queue_banned(q))
> +	if (!exec_queue_banned(q) && !exec_queue_check_timeout(q))
>   		xe_guc_exec_queue_trigger_cleanup(q);
>   
>   	return 0;

Re: [PATCH v6 11/11] drm/xe: Sample ctx timestamp to determine if jobs have timed out

[Matthew Brost]

On Wed, Jun 12, 2024 at 02:56:42PM -0700, John Harrison wrote:
> On 6/11/2024 07:40, Matthew Brost wrote:
> > In GuC TDR sample ctx timestamp to determine if jobs have timed out. The
> > scheduling enable needs to be toggled to properly sample the timestamp.
> > If a job has not been running for longer than the timeout period,
> > re-enable scheduling and restart the TDR.
> > 
> > v2:
> >   - Use GT clock to msec helper (Umesh, off list)
> >   - s/ctx_timestamp_job/ctx_job_timestamp
> > v3:
> >   - Fix state machine for TDR, mainly decouple sched disable and
> >     deregister (testing)
> >   - Rebase (CI)
> > v4:
> >   - Fix checkpatch && newline issue (CI)
> >   - Do not deregister on wedged or unregistered (CI)
> >   - Fix refcounting bugs (CI)
> >   - Move devcoredump above VM / kernel job check (John H)
> >   - Add comment for check_timeout state usage (John H)
> >   - Assert pending disable not inflight when enabling scheduling (John H)
> >   - Use enable_scheduling in other scheduling enable code (John H)
> >   - Add comments on a few steps in TDR (John H)
> >   - Add assert for timestamp overflow protection (John H)
> > v6:
> >   - Use mul_u64_u32_div (CI, checkpath)
> >   - Change check time to dbg level (Paulo)
> >   - Add immediate mode to sched disable (inspection)
> >   - Use xe_gt_* messages (John H)
> >   - Fix typo in comment (John H)
> >   - Check timeout before clearing pending disable (Paulo)
> > 
> > Signed-off-by: Matthew Brost <matthew.brost@intel.com>
> > Reviewed-by: Jonathan Cavitt <jonathan.cavitt@intel.com>
> > ---
> >   drivers/gpu/drm/xe/xe_guc_submit.c | 303 +++++++++++++++++++++++------
> >   1 file changed, 242 insertions(+), 61 deletions(-)
> > 
> > diff --git a/drivers/gpu/drm/xe/xe_guc_submit.c b/drivers/gpu/drm/xe/xe_guc_submit.c
> > index 671c72caf0ff..cddb391888b6 100644
> > --- a/drivers/gpu/drm/xe/xe_guc_submit.c
> > +++ b/drivers/gpu/drm/xe/xe_guc_submit.c
> > @@ -10,6 +10,7 @@
> >   #include <linux/circ_buf.h>
> >   #include <linux/delay.h>
> >   #include <linux/dma-fence-array.h>
> > +#include <linux/math64.h>
> >   #include <drm/drm_managed.h>
> > @@ -23,6 +24,7 @@
> >   #include "xe_force_wake.h"
> >   #include "xe_gpu_scheduler.h"
> >   #include "xe_gt.h"
> > +#include "xe_gt_clock.h"
> >   #include "xe_gt_printk.h"
> >   #include "xe_guc.h"
> >   #include "xe_guc_ct.h"
> > @@ -62,6 +64,8 @@ exec_queue_to_guc(struct xe_exec_queue *q)
> >   #define EXEC_QUEUE_STATE_KILLED			(1 << 7)
> >   #define EXEC_QUEUE_STATE_WEDGED			(1 << 8)
> >   #define EXEC_QUEUE_STATE_BANNED			(1 << 9)
> > +#define EXEC_QUEUE_STATE_CHECK_TIMEOUT		(1 << 10)
> > +#define EXEC_QUEUE_STATE_EXTRA_REF		(1 << 11)
> >   static bool exec_queue_registered(struct xe_exec_queue *q)
> >   {
> > @@ -188,6 +192,31 @@ static void set_exec_queue_wedged(struct xe_exec_queue *q)
> >   	atomic_or(EXEC_QUEUE_STATE_WEDGED, &q->guc->state);
> >   }
> > +static bool exec_queue_check_timeout(struct xe_exec_queue *q)
> > +{
> > +	return atomic_read(&q->guc->state) & EXEC_QUEUE_STATE_CHECK_TIMEOUT;
> > +}
> > +
> > +static void set_exec_queue_check_timeout(struct xe_exec_queue *q)
> > +{
> > +	atomic_or(EXEC_QUEUE_STATE_CHECK_TIMEOUT, &q->guc->state);
> > +}
> > +
> > +static void clear_exec_queue_check_timeout(struct xe_exec_queue *q)
> > +{
> > +	atomic_and(~EXEC_QUEUE_STATE_CHECK_TIMEOUT, &q->guc->state);
> > +}
> > +
> > +static bool exec_queue_extra_ref(struct xe_exec_queue *q)
> > +{
> > +	return atomic_read(&q->guc->state) & EXEC_QUEUE_STATE_EXTRA_REF;
> > +}
> > +
> > +static void set_exec_queue_extra_ref(struct xe_exec_queue *q)
> > +{
> > +	atomic_or(EXEC_QUEUE_STATE_EXTRA_REF, &q->guc->state);
> > +}
> > +
> >   static bool exec_queue_killed_or_banned_or_wedged(struct xe_exec_queue *q)
> >   {
> >   	return (atomic_read(&q->guc->state) &
> > @@ -920,6 +949,109 @@ static void xe_guc_exec_queue_lr_cleanup(struct work_struct *w)
> >   	xe_sched_submission_start(sched);
> >   }
> > +#define ADJUST_FIVE_PERCENT(__t)	mul_u64_u32_div((__t), 105, 100)
> > +
> > +static bool check_timeout(struct xe_exec_queue *q, struct xe_sched_job *job)
> > +{
> > +	struct xe_gt *gt = guc_to_gt(exec_queue_to_guc(q));
> > +	u32 ctx_timestamp = xe_lrc_ctx_timestamp(q->lrc[0]);
> > +	u32 ctx_job_timestamp = xe_lrc_ctx_job_timestamp(q->lrc[0]);
> > +	u32 timeout_ms = q->sched_props.job_timeout_ms;
> > +	u32 diff;
> > +	u64 running_time_ms;
> > +
> > +	/*
> > +	 * Counter wraps at ~223s at the usual 19.2MHz, be paranoid catch
> > +	 * possible overflows with a high timeout.
> > +	 */
> > +	xe_gt_assert(gt, timeout_ms < 100 * MSEC_PER_SEC);
> > +
> > +	if (ctx_timestamp < ctx_job_timestamp)
> > +		diff = ctx_timestamp + U32_MAX - ctx_job_timestamp;
> > +	else
> > +		diff = ctx_timestamp - ctx_job_timestamp;
> > +
> > +	/*
> > +	 * Ensure timeout is within 5% to account for an GuC scheduling latency
> > +	 */
> > +	running_time_ms =
> > +		ADJUST_FIVE_PERCENT(xe_gt_clock_interval_to_ms(gt, diff));
> > +
> > +	xe_gt_dbg(gt,
> > +		  "Check job timeout: seqno=%u, lrc_seqno=%u, guc_id=%d, running_time_ms=%llu, timeout_ms=%u, diff=0x%08x",
> > +		  xe_sched_job_seqno(job), xe_sched_job_lrc_seqno(job),
> > +		  q->guc->id, running_time_ms, timeout_ms, diff);
> > +
> > +	return running_time_ms >= timeout_ms;
> > +}
> > +
> > +static void enable_scheduling(struct xe_exec_queue *q)
> > +{
> > +	MAKE_SCHED_CONTEXT_ACTION(q, ENABLE);
> > +	struct xe_guc *guc = exec_queue_to_guc(q);
> > +	int ret;
> > +
> > +	xe_gt_assert(guc_to_gt(guc), !exec_queue_destroyed(q));
> > +	xe_gt_assert(guc_to_gt(guc), exec_queue_registered(q));
> > +	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_disable(q));
> > +	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_enable(q));
> > +
> > +	set_exec_queue_pending_enable(q);
> > +	set_exec_queue_enabled(q);
> > +	trace_xe_exec_queue_scheduling_enable(q);
> > +
> > +	xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
> > +		       G2H_LEN_DW_SCHED_CONTEXT_MODE_SET, 1);
> > +
> > +	ret = wait_event_timeout(guc->ct.wq,
> > +				 !exec_queue_pending_enable(q) ||
> > +				 guc_read_stopped(guc), HZ * 5);
> > +	if (!ret || guc_read_stopped(guc)) {
> > +		xe_gt_warn(guc_to_gt(guc), "Schedule enable failed to respond");
> > +		set_exec_queue_banned(q);
> > +		xe_gt_reset_async(q->gt);
> > +		xe_sched_tdr_queue_imm(&q->guc->sched);
> > +	}
> > +}
> > +
> > +static void disable_scheduling(struct xe_exec_queue *q, bool immediate)
> > +{
> > +	MAKE_SCHED_CONTEXT_ACTION(q, DISABLE);
> > +	struct xe_guc *guc = exec_queue_to_guc(q);
> > +
> > +	xe_gt_assert(guc_to_gt(guc), !exec_queue_destroyed(q));
> > +	xe_gt_assert(guc_to_gt(guc), exec_queue_registered(q));
> > +	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_disable(q));
> > +
> > +	if (immediate)
> > +		set_min_preemption_timeout(guc, q);
> > +	clear_exec_queue_enabled(q);
> > +	set_exec_queue_pending_disable(q);
> > +	trace_xe_exec_queue_scheduling_disable(q);
> > +
> > +	xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
> > +		       G2H_LEN_DW_SCHED_CONTEXT_MODE_SET, 1);
> > +}
> > +
> > +static void __deregister_exec_queue(struct xe_guc *guc, struct xe_exec_queue *q)
> > +{
> > +	u32 action[] = {
> > +		XE_GUC_ACTION_DEREGISTER_CONTEXT,
> > +		q->guc->id,
> > +	};
> > +
> > +	xe_gt_assert(guc_to_gt(guc), !exec_queue_destroyed(q));
> > +	xe_gt_assert(guc_to_gt(guc), exec_queue_registered(q));
> > +	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_enable(q));
> > +	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_disable(q));
> > +
> > +	set_exec_queue_destroyed(q);
> > +	trace_xe_exec_queue_deregister(q);
> > +
> > +	xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
> > +		       G2H_LEN_DW_DEREGISTER_CONTEXT, 1);
> > +}
> > +
> >   static enum drm_gpu_sched_stat
> >   guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
> >   {
> > @@ -927,10 +1059,10 @@ guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
> >   	struct xe_sched_job *tmp_job;
> >   	struct xe_exec_queue *q = job->q;
> >   	struct xe_gpu_scheduler *sched = &q->guc->sched;
> > -	struct xe_device *xe = guc_to_xe(exec_queue_to_guc(q));
> > +	struct xe_guc *guc = exec_queue_to_guc(q);
> >   	int err = -ETIME;
> >   	int i = 0;
> > -	bool wedged;
> > +	bool wedged, skip_timeout_check;
> >   	/*
> >   	 * TDR has fired before free job worker. Common if exec queue
> > @@ -942,49 +1074,53 @@ guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
> >   		return DRM_GPU_SCHED_STAT_NOMINAL;
> >   	}
> > -	drm_notice(&xe->drm, "Timedout job: seqno=%u, lrc_seqno=%u, guc_id=%d, flags=0x%lx",
> > -		   xe_sched_job_seqno(job), xe_sched_job_lrc_seqno(job),
> > -		   q->guc->id, q->flags);
> > -	xe_gt_WARN(q->gt, q->flags & EXEC_QUEUE_FLAG_KERNEL,
> > -		   "Kernel-submitted job timed out\n");
> > -	xe_gt_WARN(q->gt, q->flags & EXEC_QUEUE_FLAG_VM && !exec_queue_killed(q),
> > -		   "VM job timed out on non-killed execqueue\n");
> > -
> > -	if (!exec_queue_killed(q))
> > -		xe_devcoredump(job);
> > -
> > -	trace_xe_sched_job_timedout(job);
> > -
> > -	wedged = guc_submit_hint_wedged(exec_queue_to_guc(q));
> > -
> >   	/* Kill the run_job entry point */
> >   	xe_sched_submission_stop(sched);
> > +	/* Must check all state after stopping scheduler */
> > +	skip_timeout_check = exec_queue_reset(q) ||
> > +		exec_queue_killed_or_banned_or_wedged(q) ||
> > +		exec_queue_destroyed(q);
> > +
> > +	/* Job hasn't started, can't be timed out */
> > +	if (!skip_timeout_check && !xe_sched_job_started(job))
> > +		goto rearm;
> > +
> >   	/*
> > -	 * Kernel jobs should never fail, nor should VM jobs if they do
> > -	 * somethings has gone wrong and the GT needs a reset
> > +	 * XXX: Sampling timeout doesn't work in wedged mode as we have to
> > +	 * modify scheduling state to read timestamp. We could read the
> > +	 * timestamp from a register to accumulate current running time but this
> > +	 * doesn't work for SRIOV. For now assuming timeouts in wedged mode are
> > +	 * genuine timeouts.
> >   	 */
> > -	if (!wedged && (q->flags & EXEC_QUEUE_FLAG_KERNEL ||
> > -			(q->flags & EXEC_QUEUE_FLAG_VM && !exec_queue_killed(q)))) {
> > -		if (!xe_sched_invalidate_job(job, 2)) {
> > -			xe_sched_add_pending_job(sched, job);
> > -			xe_sched_submission_start(sched);
> > -			xe_gt_reset_async(q->gt);
> > -			goto out;
> > -		}
> > -	}
> > +	wedged = guc_submit_hint_wedged(exec_queue_to_guc(q));
> > -	/* Engine state now stable, disable scheduling if needed */
> > +	/* Engine state now stable, disable scheduling to check timestamp */
> >   	if (!wedged && exec_queue_registered(q)) {
> > -		struct xe_guc *guc = exec_queue_to_guc(q);
> >   		int ret;
> >   		if (exec_queue_reset(q))
> >   			err = -EIO;
> > -		set_exec_queue_banned(q);
> > +
> >   		if (!exec_queue_destroyed(q)) {
> > -			xe_exec_queue_get(q);
> > -			disable_scheduling_deregister(guc, q);
> > +			/*
> > +			 * Wait for any pending G2H to flush out before
> > +			 * modifying state
> > +			 */
> > +			ret = wait_event_timeout(guc->ct.wq,
> > +						 !exec_queue_pending_enable(q) ||
> > +						 guc_read_stopped(guc), HZ * 5);
> > +			if (!ret || guc_read_stopped(guc))
> > +				goto trigger_reset;
> > +
> > +			/*
> > +			 * Flag communicates to G2H handler that schedule
> > +			 * disable originated from a timeout check. The G2H then
> > +			 * avoid triggering cleanup or deregistering the exec
> > +			 * queue.
> > +			 */
> > +			set_exec_queue_check_timeout(q);
> > +			disable_scheduling(q, skip_timeout_check);
> >   		}
> >   		/*
> > @@ -1000,15 +1136,60 @@ guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
> >   					 !exec_queue_pending_disable(q) ||
> >   					 guc_read_stopped(guc), HZ * 5);
> >   		if (!ret || guc_read_stopped(guc)) {
> > -			drm_warn(&xe->drm, "Schedule disable failed to respond");
> > -			xe_sched_add_pending_job(sched, job);
> > -			xe_sched_submission_start(sched);
> > +trigger_reset:
> > +			xe_gt_warn(guc_to_gt(guc), "Schedule disable failed to respond");
> Not a problem introduced in this patch set so maybe not necessary to fix
> here either. But we have seen what look like false hits on this warning in
> some of the reset tests. The code gets here if the schedule disable
> genuinely times out which is what the warning is saying. But it also gets
> here if guc_read_stopped() is true and that happens if a reset occurs
> asynchronously to this timeout check. In that situation, there is no need to
> fire a warning - the abort is intentional and expected. It is also not
> necessary to queue up another reset just below. It seems like the warning
> and the reset should be inside a further 'if(!ret)' check.
> 

Agree. It should be:

if (!ret)
	xe_gt_warn(guc_to_gt(guc), "Schedule disable failed to respond");


Will fix in next rev or before merging.

> > +			set_exec_queue_extra_ref(q);
> > +			xe_exec_queue_get(q);	/* GT reset owns this */
> > +			set_exec_queue_banned(q);
> >   			xe_gt_reset_async(q->gt);
> >   			xe_sched_tdr_queue_imm(sched);
> > -			goto out;
> > +			goto rearm;
> > +		}
> > +	}
> > +
> > +	/*
> > +	 * Check if job is actually timed out, if so restart job execution and TDR
> > +	 */
> > +	if (!wedged && !skip_timeout_check && !check_timeout(q, job) &&
> > +	    !exec_queue_reset(q) && exec_queue_registered(q)) {
> > +		clear_exec_queue_check_timeout(q);
> > +		goto sched_enable;
> > +	}
> > +
> > +	xe_gt_notice(guc_to_gt(guc), "Timedout job: seqno=%u, lrc_seqno=%u, guc_id=%d, flags=0x%lx",
> > +		     xe_sched_job_seqno(job), xe_sched_job_lrc_seqno(job),
> > +		     q->guc->id, q->flags);
> > +	xe_gt_WARN(q->gt, q->flags & EXEC_QUEUE_FLAG_KERNEL,
> > +		   "Kernel-submitted job timed out\n");
> > +	xe_gt_WARN(q->gt, q->flags & EXEC_QUEUE_FLAG_VM && !exec_queue_killed(q),
> > +		   "VM job timed out on non-killed execqueue\n");
> I still think it makes more sense to have these two warnings next to the
> comment that says why these are unexpected errors...
> 
> > +
> > +	trace_xe_sched_job_timedout(job);
> > +
> > +	if (!exec_queue_killed(q))
> > +		xe_devcoredump(job);
> > +
> > +	/*
> > +	 * Kernel jobs should never fail, nor should VM jobs if they do
> > +	 * somethings has gone wrong and the GT needs a reset
> > +	 */
> ... i.e. the warning about kernel jobs and VM jobs not failing should be
> here.
>

Sure, can move these warn below this comment. Do you mind if I just fix
this at merge time?

Matt

> John.
> 
> > +	if (!wedged && (q->flags & EXEC_QUEUE_FLAG_KERNEL ||
> > +			(q->flags & EXEC_QUEUE_FLAG_VM && !exec_queue_killed(q)))) {
> > +		if (!xe_sched_invalidate_job(job, 2)) {
> > +			clear_exec_queue_check_timeout(q);
> > +			xe_gt_reset_async(q->gt);
> > +			goto rearm;
> >   		}
> >   	}
> > +	/* Finish cleaning up exec queue via deregister */
> > +	set_exec_queue_banned(q);
> > +	if (!wedged && exec_queue_registered(q) && !exec_queue_destroyed(q)) {
> > +		set_exec_queue_extra_ref(q);
> > +		xe_exec_queue_get(q);
> > +		__deregister_exec_queue(guc, q);
> > +	}
> > +
> >   	/* Stop fence signaling */
> >   	xe_hw_fence_irq_stop(q->fence_irq);
> > @@ -1030,7 +1211,19 @@ guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
> >   	/* Start fence signaling */
> >   	xe_hw_fence_irq_start(q->fence_irq);
> > -out:
> > +	return DRM_GPU_SCHED_STAT_NOMINAL;
> > +
> > +sched_enable:
> > +	enable_scheduling(q);
> > +rearm:
> > +	/*
> > +	 * XXX: Ideally want to adjust timeout based on current exection time
> > +	 * but there is not currently an easy way to do in DRM scheduler. With
> > +	 * some thought, do this in a follow up.
> > +	 */
> > +	xe_sched_add_pending_job(sched, job);
> > +	xe_sched_submission_start(sched);
> > +
> >   	return DRM_GPU_SCHED_STAT_NOMINAL;
> >   }
> > @@ -1133,7 +1326,6 @@ static void __guc_exec_queue_process_msg_suspend(struct xe_sched_msg *msg)
> >   			   guc_read_stopped(guc));
> >   		if (!guc_read_stopped(guc)) {
> > -			MAKE_SCHED_CONTEXT_ACTION(q, DISABLE);
> >   			s64 since_resume_ms =
> >   				ktime_ms_delta(ktime_get(),
> >   					       q->guc->resume_time);
> > @@ -1144,12 +1336,7 @@ static void __guc_exec_queue_process_msg_suspend(struct xe_sched_msg *msg)
> >   				msleep(wait_ms);
> >   			set_exec_queue_suspended(q);
> > -			clear_exec_queue_enabled(q);
> > -			set_exec_queue_pending_disable(q);
> > -			trace_xe_exec_queue_scheduling_disable(q);
> > -
> > -			xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
> > -				       G2H_LEN_DW_SCHED_CONTEXT_MODE_SET, 1);
> > +			disable_scheduling(q, false);
> >   		}
> >   	} else if (q->guc->suspend_pending) {
> >   		set_exec_queue_suspended(q);
> > @@ -1160,19 +1347,11 @@ static void __guc_exec_queue_process_msg_suspend(struct xe_sched_msg *msg)
> >   static void __guc_exec_queue_process_msg_resume(struct xe_sched_msg *msg)
> >   {
> >   	struct xe_exec_queue *q = msg->private_data;
> > -	struct xe_guc *guc = exec_queue_to_guc(q);
> >   	if (guc_exec_queue_allowed_to_change_state(q)) {
> > -		MAKE_SCHED_CONTEXT_ACTION(q, ENABLE);
> > -
> >   		q->guc->resume_time = RESUME_PENDING;
> >   		clear_exec_queue_suspended(q);
> > -		set_exec_queue_pending_enable(q);
> > -		set_exec_queue_enabled(q);
> > -		trace_xe_exec_queue_scheduling_enable(q);
> > -
> > -		xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
> > -			       G2H_LEN_DW_SCHED_CONTEXT_MODE_SET, 1);
> > +		enable_scheduling(q);
> >   	} else {
> >   		clear_exec_queue_suspended(q);
> >   	}
> > @@ -1434,8 +1613,7 @@ static void guc_exec_queue_stop(struct xe_guc *guc, struct xe_exec_queue *q)
> >   	/* Clean up lost G2H + reset engine state */
> >   	if (exec_queue_registered(q)) {
> > -		if ((exec_queue_banned(q) && exec_queue_destroyed(q)) ||
> > -		    xe_exec_queue_is_lr(q))
> > +		if (exec_queue_extra_ref(q) || xe_exec_queue_is_lr(q))
> >   			xe_exec_queue_put(q);
> >   		else if (exec_queue_destroyed(q))
> >   			__guc_exec_queue_fini(guc, q);
> > @@ -1612,6 +1790,8 @@ static void handle_sched_done(struct xe_guc *guc, struct xe_exec_queue *q,
> >   		smp_wmb();
> >   		wake_up_all(&guc->ct.wq);
> >   	} else {
> > +		bool check_timeout = exec_queue_check_timeout(q);
> > +
> >   		xe_gt_assert(guc_to_gt(guc), runnable_state == 0);
> >   		xe_gt_assert(guc_to_gt(guc), exec_queue_pending_disable(q));
> > @@ -1619,11 +1799,12 @@ static void handle_sched_done(struct xe_guc *guc, struct xe_exec_queue *q,
> >   		if (q->guc->suspend_pending) {
> >   			suspend_fence_signal(q);
> >   		} else {
> > -			if (exec_queue_banned(q)) {
> > +			if (exec_queue_banned(q) || check_timeout) {
> >   				smp_wmb();
> >   				wake_up_all(&guc->ct.wq);
> >   			}
> > -			deregister_exec_queue(guc, q);
> > +			if (!check_timeout)
> > +				deregister_exec_queue(guc, q);
> >   		}
> >   	}
> >   }
> > @@ -1664,7 +1845,7 @@ static void handle_deregister_done(struct xe_guc *guc, struct xe_exec_queue *q)
> >   	clear_exec_queue_registered(q);
> > -	if (exec_queue_banned(q) || xe_exec_queue_is_lr(q))
> > +	if (exec_queue_extra_ref(q) || xe_exec_queue_is_lr(q))
> >   		xe_exec_queue_put(q);
> >   	else
> >   		__guc_exec_queue_fini(guc, q);
> > @@ -1728,7 +1909,7 @@ int xe_guc_exec_queue_reset_handler(struct xe_guc *guc, u32 *msg, u32 len)
> >   	 * guc_exec_queue_timedout_job.
> >   	 */
> >   	set_exec_queue_reset(q);
> > -	if (!exec_queue_banned(q))
> > +	if (!exec_queue_banned(q) && !exec_queue_check_timeout(q))
> >   		xe_guc_exec_queue_trigger_cleanup(q);
> >   	return 0;
> > @@ -1758,7 +1939,7 @@ int xe_guc_exec_queue_memory_cat_error_handler(struct xe_guc *guc, u32 *msg,
> >   	/* Treat the same as engine reset */
> >   	set_exec_queue_reset(q);
> > -	if (!exec_queue_banned(q))
> > +	if (!exec_queue_banned(q) && !exec_queue_check_timeout(q))
> >   		xe_guc_exec_queue_trigger_cleanup(q);
> >   	return 0;
> 

Re: [PATCH v6 11/11] drm/xe: Sample ctx timestamp to determine if jobs have timed out

[John Harrison]

On 6/12/2024 15:30, Matthew Brost wrote:
> On Wed, Jun 12, 2024 at 02:56:42PM -0700, John Harrison wrote:
>> On 6/11/2024 07:40, Matthew Brost wrote:
>>> In GuC TDR sample ctx timestamp to determine if jobs have timed out. The
>>> scheduling enable needs to be toggled to properly sample the timestamp.
>>> If a job has not been running for longer than the timeout period,
>>> re-enable scheduling and restart the TDR.
>>>
>>> v2:
>>>    - Use GT clock to msec helper (Umesh, off list)
>>>    - s/ctx_timestamp_job/ctx_job_timestamp
>>> v3:
>>>    - Fix state machine for TDR, mainly decouple sched disable and
>>>      deregister (testing)
>>>    - Rebase (CI)
>>> v4:
>>>    - Fix checkpatch && newline issue (CI)
>>>    - Do not deregister on wedged or unregistered (CI)
>>>    - Fix refcounting bugs (CI)
>>>    - Move devcoredump above VM / kernel job check (John H)
>>>    - Add comment for check_timeout state usage (John H)
>>>    - Assert pending disable not inflight when enabling scheduling (John H)
>>>    - Use enable_scheduling in other scheduling enable code (John H)
>>>    - Add comments on a few steps in TDR (John H)
>>>    - Add assert for timestamp overflow protection (John H)
>>> v6:
>>>    - Use mul_u64_u32_div (CI, checkpath)
>>>    - Change check time to dbg level (Paulo)
>>>    - Add immediate mode to sched disable (inspection)
>>>    - Use xe_gt_* messages (John H)
>>>    - Fix typo in comment (John H)
>>>    - Check timeout before clearing pending disable (Paulo)
>>>
>>> Signed-off-by: Matthew Brost <matthew.brost@intel.com>
>>> Reviewed-by: Jonathan Cavitt <jonathan.cavitt@intel.com>
>>> ---
>>>    drivers/gpu/drm/xe/xe_guc_submit.c | 303 +++++++++++++++++++++++------
>>>    1 file changed, 242 insertions(+), 61 deletions(-)
>>>
>>> diff --git a/drivers/gpu/drm/xe/xe_guc_submit.c b/drivers/gpu/drm/xe/xe_guc_submit.c
>>> index 671c72caf0ff..cddb391888b6 100644
>>> --- a/drivers/gpu/drm/xe/xe_guc_submit.c
>>> +++ b/drivers/gpu/drm/xe/xe_guc_submit.c
>>> @@ -10,6 +10,7 @@
>>>    #include <linux/circ_buf.h>
>>>    #include <linux/delay.h>
>>>    #include <linux/dma-fence-array.h>
>>> +#include <linux/math64.h>
>>>    #include <drm/drm_managed.h>
>>> @@ -23,6 +24,7 @@
>>>    #include "xe_force_wake.h"
>>>    #include "xe_gpu_scheduler.h"
>>>    #include "xe_gt.h"
>>> +#include "xe_gt_clock.h"
>>>    #include "xe_gt_printk.h"
>>>    #include "xe_guc.h"
>>>    #include "xe_guc_ct.h"
>>> @@ -62,6 +64,8 @@ exec_queue_to_guc(struct xe_exec_queue *q)
>>>    #define EXEC_QUEUE_STATE_KILLED			(1 << 7)
>>>    #define EXEC_QUEUE_STATE_WEDGED			(1 << 8)
>>>    #define EXEC_QUEUE_STATE_BANNED			(1 << 9)
>>> +#define EXEC_QUEUE_STATE_CHECK_TIMEOUT		(1 << 10)
>>> +#define EXEC_QUEUE_STATE_EXTRA_REF		(1 << 11)
>>>    static bool exec_queue_registered(struct xe_exec_queue *q)
>>>    {
>>> @@ -188,6 +192,31 @@ static void set_exec_queue_wedged(struct xe_exec_queue *q)
>>>    	atomic_or(EXEC_QUEUE_STATE_WEDGED, &q->guc->state);
>>>    }
>>> +static bool exec_queue_check_timeout(struct xe_exec_queue *q)
>>> +{
>>> +	return atomic_read(&q->guc->state) & EXEC_QUEUE_STATE_CHECK_TIMEOUT;
>>> +}
>>> +
>>> +static void set_exec_queue_check_timeout(struct xe_exec_queue *q)
>>> +{
>>> +	atomic_or(EXEC_QUEUE_STATE_CHECK_TIMEOUT, &q->guc->state);
>>> +}
>>> +
>>> +static void clear_exec_queue_check_timeout(struct xe_exec_queue *q)
>>> +{
>>> +	atomic_and(~EXEC_QUEUE_STATE_CHECK_TIMEOUT, &q->guc->state);
>>> +}
>>> +
>>> +static bool exec_queue_extra_ref(struct xe_exec_queue *q)
>>> +{
>>> +	return atomic_read(&q->guc->state) & EXEC_QUEUE_STATE_EXTRA_REF;
>>> +}
>>> +
>>> +static void set_exec_queue_extra_ref(struct xe_exec_queue *q)
>>> +{
>>> +	atomic_or(EXEC_QUEUE_STATE_EXTRA_REF, &q->guc->state);
>>> +}
>>> +
>>>    static bool exec_queue_killed_or_banned_or_wedged(struct xe_exec_queue *q)
>>>    {
>>>    	return (atomic_read(&q->guc->state) &
>>> @@ -920,6 +949,109 @@ static void xe_guc_exec_queue_lr_cleanup(struct work_struct *w)
>>>    	xe_sched_submission_start(sched);
>>>    }
>>> +#define ADJUST_FIVE_PERCENT(__t)	mul_u64_u32_div((__t), 105, 100)
>>> +
>>> +static bool check_timeout(struct xe_exec_queue *q, struct xe_sched_job *job)
>>> +{
>>> +	struct xe_gt *gt = guc_to_gt(exec_queue_to_guc(q));
>>> +	u32 ctx_timestamp = xe_lrc_ctx_timestamp(q->lrc[0]);
>>> +	u32 ctx_job_timestamp = xe_lrc_ctx_job_timestamp(q->lrc[0]);
>>> +	u32 timeout_ms = q->sched_props.job_timeout_ms;
>>> +	u32 diff;
>>> +	u64 running_time_ms;
>>> +
>>> +	/*
>>> +	 * Counter wraps at ~223s at the usual 19.2MHz, be paranoid catch
>>> +	 * possible overflows with a high timeout.
>>> +	 */
>>> +	xe_gt_assert(gt, timeout_ms < 100 * MSEC_PER_SEC);
>>> +
>>> +	if (ctx_timestamp < ctx_job_timestamp)
>>> +		diff = ctx_timestamp + U32_MAX - ctx_job_timestamp;
>>> +	else
>>> +		diff = ctx_timestamp - ctx_job_timestamp;
>>> +
>>> +	/*
>>> +	 * Ensure timeout is within 5% to account for an GuC scheduling latency
>>> +	 */
>>> +	running_time_ms =
>>> +		ADJUST_FIVE_PERCENT(xe_gt_clock_interval_to_ms(gt, diff));
>>> +
>>> +	xe_gt_dbg(gt,
>>> +		  "Check job timeout: seqno=%u, lrc_seqno=%u, guc_id=%d, running_time_ms=%llu, timeout_ms=%u, diff=0x%08x",
>>> +		  xe_sched_job_seqno(job), xe_sched_job_lrc_seqno(job),
>>> +		  q->guc->id, running_time_ms, timeout_ms, diff);
>>> +
>>> +	return running_time_ms >= timeout_ms;
>>> +}
>>> +
>>> +static void enable_scheduling(struct xe_exec_queue *q)
>>> +{
>>> +	MAKE_SCHED_CONTEXT_ACTION(q, ENABLE);
>>> +	struct xe_guc *guc = exec_queue_to_guc(q);
>>> +	int ret;
>>> +
>>> +	xe_gt_assert(guc_to_gt(guc), !exec_queue_destroyed(q));
>>> +	xe_gt_assert(guc_to_gt(guc), exec_queue_registered(q));
>>> +	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_disable(q));
>>> +	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_enable(q));
>>> +
>>> +	set_exec_queue_pending_enable(q);
>>> +	set_exec_queue_enabled(q);
>>> +	trace_xe_exec_queue_scheduling_enable(q);
>>> +
>>> +	xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
>>> +		       G2H_LEN_DW_SCHED_CONTEXT_MODE_SET, 1);
>>> +
>>> +	ret = wait_event_timeout(guc->ct.wq,
>>> +				 !exec_queue_pending_enable(q) ||
>>> +				 guc_read_stopped(guc), HZ * 5);
>>> +	if (!ret || guc_read_stopped(guc)) {
>>> +		xe_gt_warn(guc_to_gt(guc), "Schedule enable failed to respond");
>>> +		set_exec_queue_banned(q);
>>> +		xe_gt_reset_async(q->gt);
>>> +		xe_sched_tdr_queue_imm(&q->guc->sched);
>>> +	}
>>> +}
>>> +
>>> +static void disable_scheduling(struct xe_exec_queue *q, bool immediate)
>>> +{
>>> +	MAKE_SCHED_CONTEXT_ACTION(q, DISABLE);
>>> +	struct xe_guc *guc = exec_queue_to_guc(q);
>>> +
>>> +	xe_gt_assert(guc_to_gt(guc), !exec_queue_destroyed(q));
>>> +	xe_gt_assert(guc_to_gt(guc), exec_queue_registered(q));
>>> +	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_disable(q));
>>> +
>>> +	if (immediate)
>>> +		set_min_preemption_timeout(guc, q);
>>> +	clear_exec_queue_enabled(q);
>>> +	set_exec_queue_pending_disable(q);
>>> +	trace_xe_exec_queue_scheduling_disable(q);
>>> +
>>> +	xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
>>> +		       G2H_LEN_DW_SCHED_CONTEXT_MODE_SET, 1);
>>> +}
>>> +
>>> +static void __deregister_exec_queue(struct xe_guc *guc, struct xe_exec_queue *q)
>>> +{
>>> +	u32 action[] = {
>>> +		XE_GUC_ACTION_DEREGISTER_CONTEXT,
>>> +		q->guc->id,
>>> +	};
>>> +
>>> +	xe_gt_assert(guc_to_gt(guc), !exec_queue_destroyed(q));
>>> +	xe_gt_assert(guc_to_gt(guc), exec_queue_registered(q));
>>> +	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_enable(q));
>>> +	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_disable(q));
>>> +
>>> +	set_exec_queue_destroyed(q);
>>> +	trace_xe_exec_queue_deregister(q);
>>> +
>>> +	xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
>>> +		       G2H_LEN_DW_DEREGISTER_CONTEXT, 1);
>>> +}
>>> +
>>>    static enum drm_gpu_sched_stat
>>>    guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
>>>    {
>>> @@ -927,10 +1059,10 @@ guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
>>>    	struct xe_sched_job *tmp_job;
>>>    	struct xe_exec_queue *q = job->q;
>>>    	struct xe_gpu_scheduler *sched = &q->guc->sched;
>>> -	struct xe_device *xe = guc_to_xe(exec_queue_to_guc(q));
>>> +	struct xe_guc *guc = exec_queue_to_guc(q);
>>>    	int err = -ETIME;
>>>    	int i = 0;
>>> -	bool wedged;
>>> +	bool wedged, skip_timeout_check;
>>>    	/*
>>>    	 * TDR has fired before free job worker. Common if exec queue
>>> @@ -942,49 +1074,53 @@ guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
>>>    		return DRM_GPU_SCHED_STAT_NOMINAL;
>>>    	}
>>> -	drm_notice(&xe->drm, "Timedout job: seqno=%u, lrc_seqno=%u, guc_id=%d, flags=0x%lx",
>>> -		   xe_sched_job_seqno(job), xe_sched_job_lrc_seqno(job),
>>> -		   q->guc->id, q->flags);
>>> -	xe_gt_WARN(q->gt, q->flags & EXEC_QUEUE_FLAG_KERNEL,
>>> -		   "Kernel-submitted job timed out\n");
>>> -	xe_gt_WARN(q->gt, q->flags & EXEC_QUEUE_FLAG_VM && !exec_queue_killed(q),
>>> -		   "VM job timed out on non-killed execqueue\n");
>>> -
>>> -	if (!exec_queue_killed(q))
>>> -		xe_devcoredump(job);
>>> -
>>> -	trace_xe_sched_job_timedout(job);
>>> -
>>> -	wedged = guc_submit_hint_wedged(exec_queue_to_guc(q));
>>> -
>>>    	/* Kill the run_job entry point */
>>>    	xe_sched_submission_stop(sched);
>>> +	/* Must check all state after stopping scheduler */
>>> +	skip_timeout_check = exec_queue_reset(q) ||
>>> +		exec_queue_killed_or_banned_or_wedged(q) ||
>>> +		exec_queue_destroyed(q);
>>> +
>>> +	/* Job hasn't started, can't be timed out */
>>> +	if (!skip_timeout_check && !xe_sched_job_started(job))
>>> +		goto rearm;
>>> +
>>>    	/*
>>> -	 * Kernel jobs should never fail, nor should VM jobs if they do
>>> -	 * somethings has gone wrong and the GT needs a reset
>>> +	 * XXX: Sampling timeout doesn't work in wedged mode as we have to
>>> +	 * modify scheduling state to read timestamp. We could read the
>>> +	 * timestamp from a register to accumulate current running time but this
>>> +	 * doesn't work for SRIOV. For now assuming timeouts in wedged mode are
>>> +	 * genuine timeouts.
>>>    	 */
>>> -	if (!wedged && (q->flags & EXEC_QUEUE_FLAG_KERNEL ||
>>> -			(q->flags & EXEC_QUEUE_FLAG_VM && !exec_queue_killed(q)))) {
>>> -		if (!xe_sched_invalidate_job(job, 2)) {
>>> -			xe_sched_add_pending_job(sched, job);
>>> -			xe_sched_submission_start(sched);
>>> -			xe_gt_reset_async(q->gt);
>>> -			goto out;
>>> -		}
>>> -	}
>>> +	wedged = guc_submit_hint_wedged(exec_queue_to_guc(q));
>>> -	/* Engine state now stable, disable scheduling if needed */
>>> +	/* Engine state now stable, disable scheduling to check timestamp */
>>>    	if (!wedged && exec_queue_registered(q)) {
>>> -		struct xe_guc *guc = exec_queue_to_guc(q);
>>>    		int ret;
>>>    		if (exec_queue_reset(q))
>>>    			err = -EIO;
>>> -		set_exec_queue_banned(q);
>>> +
>>>    		if (!exec_queue_destroyed(q)) {
>>> -			xe_exec_queue_get(q);
>>> -			disable_scheduling_deregister(guc, q);
>>> +			/*
>>> +			 * Wait for any pending G2H to flush out before
>>> +			 * modifying state
>>> +			 */
>>> +			ret = wait_event_timeout(guc->ct.wq,
>>> +						 !exec_queue_pending_enable(q) ||
>>> +						 guc_read_stopped(guc), HZ * 5);
>>> +			if (!ret || guc_read_stopped(guc))
>>> +				goto trigger_reset;
>>> +
>>> +			/*
>>> +			 * Flag communicates to G2H handler that schedule
>>> +			 * disable originated from a timeout check. The G2H then
>>> +			 * avoid triggering cleanup or deregistering the exec
>>> +			 * queue.
>>> +			 */
>>> +			set_exec_queue_check_timeout(q);
>>> +			disable_scheduling(q, skip_timeout_check);
>>>    		}
>>>    		/*
>>> @@ -1000,15 +1136,60 @@ guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
>>>    					 !exec_queue_pending_disable(q) ||
>>>    					 guc_read_stopped(guc), HZ * 5);
>>>    		if (!ret || guc_read_stopped(guc)) {
>>> -			drm_warn(&xe->drm, "Schedule disable failed to respond");
>>> -			xe_sched_add_pending_job(sched, job);
>>> -			xe_sched_submission_start(sched);
>>> +trigger_reset:
>>> +			xe_gt_warn(guc_to_gt(guc), "Schedule disable failed to respond");
>> Not a problem introduced in this patch set so maybe not necessary to fix
>> here either. But we have seen what look like false hits on this warning in
>> some of the reset tests. The code gets here if the schedule disable
>> genuinely times out which is what the warning is saying. But it also gets
>> here if guc_read_stopped() is true and that happens if a reset occurs
>> asynchronously to this timeout check. In that situation, there is no need to
>> fire a warning - the abort is intentional and expected. It is also not
>> necessary to queue up another reset just below. It seems like the warning
>> and the reset should be inside a further 'if(!ret)' check.
>>
> Agree. It should be:
>
> if (!ret)
> 	xe_gt_warn(guc_to_gt(guc), "Schedule disable failed to respond");
>
>
> Will fix in next rev or before merging.
What about the xe_gt_reset_async call? Should that be only in the case 
of genuine timeout or is there a reason to keep it in the case of an 
abort as well?

>
>>> +			set_exec_queue_extra_ref(q);
>>> +			xe_exec_queue_get(q);	/* GT reset owns this */
>>> +			set_exec_queue_banned(q);
>>>    			xe_gt_reset_async(q->gt);
>>>    			xe_sched_tdr_queue_imm(sched);
>>> -			goto out;
>>> +			goto rearm;
>>> +		}
>>> +	}
>>> +
>>> +	/*
>>> +	 * Check if job is actually timed out, if so restart job execution and TDR
>>> +	 */
>>> +	if (!wedged && !skip_timeout_check && !check_timeout(q, job) &&
>>> +	    !exec_queue_reset(q) && exec_queue_registered(q)) {
>>> +		clear_exec_queue_check_timeout(q);
>>> +		goto sched_enable;
>>> +	}
>>> +
>>> +	xe_gt_notice(guc_to_gt(guc), "Timedout job: seqno=%u, lrc_seqno=%u, guc_id=%d, flags=0x%lx",
>>> +		     xe_sched_job_seqno(job), xe_sched_job_lrc_seqno(job),
>>> +		     q->guc->id, q->flags);
>>> +	xe_gt_WARN(q->gt, q->flags & EXEC_QUEUE_FLAG_KERNEL,
>>> +		   "Kernel-submitted job timed out\n");
>>> +	xe_gt_WARN(q->gt, q->flags & EXEC_QUEUE_FLAG_VM && !exec_queue_killed(q),
>>> +		   "VM job timed out on non-killed execqueue\n");
>> I still think it makes more sense to have these two warnings next to the
>> comment that says why these are unexpected errors...
>>
>>> +
>>> +	trace_xe_sched_job_timedout(job);
>>> +
>>> +	if (!exec_queue_killed(q))
>>> +		xe_devcoredump(job);
>>> +
>>> +	/*
>>> +	 * Kernel jobs should never fail, nor should VM jobs if they do
>>> +	 * somethings has gone wrong and the GT needs a reset
>>> +	 */
>> ... i.e. the warning about kernel jobs and VM jobs not failing should be
>> here.
>>
> Sure, can move these warn below this comment. Do you mind if I just fix
> this at merge time?
Sure.

John.

>
> Matt
>
>> John.
>>
>>> +	if (!wedged && (q->flags & EXEC_QUEUE_FLAG_KERNEL ||
>>> +			(q->flags & EXEC_QUEUE_FLAG_VM && !exec_queue_killed(q)))) {
>>> +		if (!xe_sched_invalidate_job(job, 2)) {
>>> +			clear_exec_queue_check_timeout(q);
>>> +			xe_gt_reset_async(q->gt);
>>> +			goto rearm;
>>>    		}
>>>    	}
>>> +	/* Finish cleaning up exec queue via deregister */
>>> +	set_exec_queue_banned(q);
>>> +	if (!wedged && exec_queue_registered(q) && !exec_queue_destroyed(q)) {
>>> +		set_exec_queue_extra_ref(q);
>>> +		xe_exec_queue_get(q);
>>> +		__deregister_exec_queue(guc, q);
>>> +	}
>>> +
>>>    	/* Stop fence signaling */
>>>    	xe_hw_fence_irq_stop(q->fence_irq);
>>> @@ -1030,7 +1211,19 @@ guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
>>>    	/* Start fence signaling */
>>>    	xe_hw_fence_irq_start(q->fence_irq);
>>> -out:
>>> +	return DRM_GPU_SCHED_STAT_NOMINAL;
>>> +
>>> +sched_enable:
>>> +	enable_scheduling(q);
>>> +rearm:
>>> +	/*
>>> +	 * XXX: Ideally want to adjust timeout based on current exection time
>>> +	 * but there is not currently an easy way to do in DRM scheduler. With
>>> +	 * some thought, do this in a follow up.
>>> +	 */
>>> +	xe_sched_add_pending_job(sched, job);
>>> +	xe_sched_submission_start(sched);
>>> +
>>>    	return DRM_GPU_SCHED_STAT_NOMINAL;
>>>    }
>>> @@ -1133,7 +1326,6 @@ static void __guc_exec_queue_process_msg_suspend(struct xe_sched_msg *msg)
>>>    			   guc_read_stopped(guc));
>>>    		if (!guc_read_stopped(guc)) {
>>> -			MAKE_SCHED_CONTEXT_ACTION(q, DISABLE);
>>>    			s64 since_resume_ms =
>>>    				ktime_ms_delta(ktime_get(),
>>>    					       q->guc->resume_time);
>>> @@ -1144,12 +1336,7 @@ static void __guc_exec_queue_process_msg_suspend(struct xe_sched_msg *msg)
>>>    				msleep(wait_ms);
>>>    			set_exec_queue_suspended(q);
>>> -			clear_exec_queue_enabled(q);
>>> -			set_exec_queue_pending_disable(q);
>>> -			trace_xe_exec_queue_scheduling_disable(q);
>>> -
>>> -			xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
>>> -				       G2H_LEN_DW_SCHED_CONTEXT_MODE_SET, 1);
>>> +			disable_scheduling(q, false);
>>>    		}
>>>    	} else if (q->guc->suspend_pending) {
>>>    		set_exec_queue_suspended(q);
>>> @@ -1160,19 +1347,11 @@ static void __guc_exec_queue_process_msg_suspend(struct xe_sched_msg *msg)
>>>    static void __guc_exec_queue_process_msg_resume(struct xe_sched_msg *msg)
>>>    {
>>>    	struct xe_exec_queue *q = msg->private_data;
>>> -	struct xe_guc *guc = exec_queue_to_guc(q);
>>>    	if (guc_exec_queue_allowed_to_change_state(q)) {
>>> -		MAKE_SCHED_CONTEXT_ACTION(q, ENABLE);
>>> -
>>>    		q->guc->resume_time = RESUME_PENDING;
>>>    		clear_exec_queue_suspended(q);
>>> -		set_exec_queue_pending_enable(q);
>>> -		set_exec_queue_enabled(q);
>>> -		trace_xe_exec_queue_scheduling_enable(q);
>>> -
>>> -		xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
>>> -			       G2H_LEN_DW_SCHED_CONTEXT_MODE_SET, 1);
>>> +		enable_scheduling(q);
>>>    	} else {
>>>    		clear_exec_queue_suspended(q);
>>>    	}
>>> @@ -1434,8 +1613,7 @@ static void guc_exec_queue_stop(struct xe_guc *guc, struct xe_exec_queue *q)
>>>    	/* Clean up lost G2H + reset engine state */
>>>    	if (exec_queue_registered(q)) {
>>> -		if ((exec_queue_banned(q) && exec_queue_destroyed(q)) ||
>>> -		    xe_exec_queue_is_lr(q))
>>> +		if (exec_queue_extra_ref(q) || xe_exec_queue_is_lr(q))
>>>    			xe_exec_queue_put(q);
>>>    		else if (exec_queue_destroyed(q))
>>>    			__guc_exec_queue_fini(guc, q);
>>> @@ -1612,6 +1790,8 @@ static void handle_sched_done(struct xe_guc *guc, struct xe_exec_queue *q,
>>>    		smp_wmb();
>>>    		wake_up_all(&guc->ct.wq);
>>>    	} else {
>>> +		bool check_timeout = exec_queue_check_timeout(q);
>>> +
>>>    		xe_gt_assert(guc_to_gt(guc), runnable_state == 0);
>>>    		xe_gt_assert(guc_to_gt(guc), exec_queue_pending_disable(q));
>>> @@ -1619,11 +1799,12 @@ static void handle_sched_done(struct xe_guc *guc, struct xe_exec_queue *q,
>>>    		if (q->guc->suspend_pending) {
>>>    			suspend_fence_signal(q);
>>>    		} else {
>>> -			if (exec_queue_banned(q)) {
>>> +			if (exec_queue_banned(q) || check_timeout) {
>>>    				smp_wmb();
>>>    				wake_up_all(&guc->ct.wq);
>>>    			}
>>> -			deregister_exec_queue(guc, q);
>>> +			if (!check_timeout)
>>> +				deregister_exec_queue(guc, q);
>>>    		}
>>>    	}
>>>    }
>>> @@ -1664,7 +1845,7 @@ static void handle_deregister_done(struct xe_guc *guc, struct xe_exec_queue *q)
>>>    	clear_exec_queue_registered(q);
>>> -	if (exec_queue_banned(q) || xe_exec_queue_is_lr(q))
>>> +	if (exec_queue_extra_ref(q) || xe_exec_queue_is_lr(q))
>>>    		xe_exec_queue_put(q);
>>>    	else
>>>    		__guc_exec_queue_fini(guc, q);
>>> @@ -1728,7 +1909,7 @@ int xe_guc_exec_queue_reset_handler(struct xe_guc *guc, u32 *msg, u32 len)
>>>    	 * guc_exec_queue_timedout_job.
>>>    	 */
>>>    	set_exec_queue_reset(q);
>>> -	if (!exec_queue_banned(q))
>>> +	if (!exec_queue_banned(q) && !exec_queue_check_timeout(q))
>>>    		xe_guc_exec_queue_trigger_cleanup(q);
>>>    	return 0;
>>> @@ -1758,7 +1939,7 @@ int xe_guc_exec_queue_memory_cat_error_handler(struct xe_guc *guc, u32 *msg,
>>>    	/* Treat the same as engine reset */
>>>    	set_exec_queue_reset(q);
>>> -	if (!exec_queue_banned(q))
>>> +	if (!exec_queue_banned(q) && !exec_queue_check_timeout(q))
>>>    		xe_guc_exec_queue_trigger_cleanup(q);
>>>    	return 0;

Re: [PATCH v6 11/11] drm/xe: Sample ctx timestamp to determine if jobs have timed out

[Matthew Brost]

On Wed, Jun 12, 2024 at 05:57:26PM -0700, John Harrison wrote:
> On 6/12/2024 15:30, Matthew Brost wrote:
> > On Wed, Jun 12, 2024 at 02:56:42PM -0700, John Harrison wrote:
> > > On 6/11/2024 07:40, Matthew Brost wrote:
> > > > In GuC TDR sample ctx timestamp to determine if jobs have timed out. The
> > > > scheduling enable needs to be toggled to properly sample the timestamp.
> > > > If a job has not been running for longer than the timeout period,
> > > > re-enable scheduling and restart the TDR.
> > > > 
> > > > v2:
> > > >    - Use GT clock to msec helper (Umesh, off list)
> > > >    - s/ctx_timestamp_job/ctx_job_timestamp
> > > > v3:
> > > >    - Fix state machine for TDR, mainly decouple sched disable and
> > > >      deregister (testing)
> > > >    - Rebase (CI)
> > > > v4:
> > > >    - Fix checkpatch && newline issue (CI)
> > > >    - Do not deregister on wedged or unregistered (CI)
> > > >    - Fix refcounting bugs (CI)
> > > >    - Move devcoredump above VM / kernel job check (John H)
> > > >    - Add comment for check_timeout state usage (John H)
> > > >    - Assert pending disable not inflight when enabling scheduling (John H)
> > > >    - Use enable_scheduling in other scheduling enable code (John H)
> > > >    - Add comments on a few steps in TDR (John H)
> > > >    - Add assert for timestamp overflow protection (John H)
> > > > v6:
> > > >    - Use mul_u64_u32_div (CI, checkpath)
> > > >    - Change check time to dbg level (Paulo)
> > > >    - Add immediate mode to sched disable (inspection)
> > > >    - Use xe_gt_* messages (John H)
> > > >    - Fix typo in comment (John H)
> > > >    - Check timeout before clearing pending disable (Paulo)
> > > > 
> > > > Signed-off-by: Matthew Brost <matthew.brost@intel.com>
> > > > Reviewed-by: Jonathan Cavitt <jonathan.cavitt@intel.com>
> > > > ---
> > > >    drivers/gpu/drm/xe/xe_guc_submit.c | 303 +++++++++++++++++++++++------
> > > >    1 file changed, 242 insertions(+), 61 deletions(-)
> > > > 
> > > > diff --git a/drivers/gpu/drm/xe/xe_guc_submit.c b/drivers/gpu/drm/xe/xe_guc_submit.c
> > > > index 671c72caf0ff..cddb391888b6 100644
> > > > --- a/drivers/gpu/drm/xe/xe_guc_submit.c
> > > > +++ b/drivers/gpu/drm/xe/xe_guc_submit.c
> > > > @@ -10,6 +10,7 @@
> > > >    #include <linux/circ_buf.h>
> > > >    #include <linux/delay.h>
> > > >    #include <linux/dma-fence-array.h>
> > > > +#include <linux/math64.h>
> > > >    #include <drm/drm_managed.h>
> > > > @@ -23,6 +24,7 @@
> > > >    #include "xe_force_wake.h"
> > > >    #include "xe_gpu_scheduler.h"
> > > >    #include "xe_gt.h"
> > > > +#include "xe_gt_clock.h"
> > > >    #include "xe_gt_printk.h"
> > > >    #include "xe_guc.h"
> > > >    #include "xe_guc_ct.h"
> > > > @@ -62,6 +64,8 @@ exec_queue_to_guc(struct xe_exec_queue *q)
> > > >    #define EXEC_QUEUE_STATE_KILLED			(1 << 7)
> > > >    #define EXEC_QUEUE_STATE_WEDGED			(1 << 8)
> > > >    #define EXEC_QUEUE_STATE_BANNED			(1 << 9)
> > > > +#define EXEC_QUEUE_STATE_CHECK_TIMEOUT		(1 << 10)
> > > > +#define EXEC_QUEUE_STATE_EXTRA_REF		(1 << 11)
> > > >    static bool exec_queue_registered(struct xe_exec_queue *q)
> > > >    {
> > > > @@ -188,6 +192,31 @@ static void set_exec_queue_wedged(struct xe_exec_queue *q)
> > > >    	atomic_or(EXEC_QUEUE_STATE_WEDGED, &q->guc->state);
> > > >    }
> > > > +static bool exec_queue_check_timeout(struct xe_exec_queue *q)
> > > > +{
> > > > +	return atomic_read(&q->guc->state) & EXEC_QUEUE_STATE_CHECK_TIMEOUT;
> > > > +}
> > > > +
> > > > +static void set_exec_queue_check_timeout(struct xe_exec_queue *q)
> > > > +{
> > > > +	atomic_or(EXEC_QUEUE_STATE_CHECK_TIMEOUT, &q->guc->state);
> > > > +}
> > > > +
> > > > +static void clear_exec_queue_check_timeout(struct xe_exec_queue *q)
> > > > +{
> > > > +	atomic_and(~EXEC_QUEUE_STATE_CHECK_TIMEOUT, &q->guc->state);
> > > > +}
> > > > +
> > > > +static bool exec_queue_extra_ref(struct xe_exec_queue *q)
> > > > +{
> > > > +	return atomic_read(&q->guc->state) & EXEC_QUEUE_STATE_EXTRA_REF;
> > > > +}
> > > > +
> > > > +static void set_exec_queue_extra_ref(struct xe_exec_queue *q)
> > > > +{
> > > > +	atomic_or(EXEC_QUEUE_STATE_EXTRA_REF, &q->guc->state);
> > > > +}
> > > > +
> > > >    static bool exec_queue_killed_or_banned_or_wedged(struct xe_exec_queue *q)
> > > >    {
> > > >    	return (atomic_read(&q->guc->state) &
> > > > @@ -920,6 +949,109 @@ static void xe_guc_exec_queue_lr_cleanup(struct work_struct *w)
> > > >    	xe_sched_submission_start(sched);
> > > >    }
> > > > +#define ADJUST_FIVE_PERCENT(__t)	mul_u64_u32_div((__t), 105, 100)
> > > > +
> > > > +static bool check_timeout(struct xe_exec_queue *q, struct xe_sched_job *job)
> > > > +{
> > > > +	struct xe_gt *gt = guc_to_gt(exec_queue_to_guc(q));
> > > > +	u32 ctx_timestamp = xe_lrc_ctx_timestamp(q->lrc[0]);
> > > > +	u32 ctx_job_timestamp = xe_lrc_ctx_job_timestamp(q->lrc[0]);
> > > > +	u32 timeout_ms = q->sched_props.job_timeout_ms;
> > > > +	u32 diff;
> > > > +	u64 running_time_ms;
> > > > +
> > > > +	/*
> > > > +	 * Counter wraps at ~223s at the usual 19.2MHz, be paranoid catch
> > > > +	 * possible overflows with a high timeout.
> > > > +	 */
> > > > +	xe_gt_assert(gt, timeout_ms < 100 * MSEC_PER_SEC);
> > > > +
> > > > +	if (ctx_timestamp < ctx_job_timestamp)
> > > > +		diff = ctx_timestamp + U32_MAX - ctx_job_timestamp;
> > > > +	else
> > > > +		diff = ctx_timestamp - ctx_job_timestamp;
> > > > +
> > > > +	/*
> > > > +	 * Ensure timeout is within 5% to account for an GuC scheduling latency
> > > > +	 */
> > > > +	running_time_ms =
> > > > +		ADJUST_FIVE_PERCENT(xe_gt_clock_interval_to_ms(gt, diff));
> > > > +
> > > > +	xe_gt_dbg(gt,
> > > > +		  "Check job timeout: seqno=%u, lrc_seqno=%u, guc_id=%d, running_time_ms=%llu, timeout_ms=%u, diff=0x%08x",
> > > > +		  xe_sched_job_seqno(job), xe_sched_job_lrc_seqno(job),
> > > > +		  q->guc->id, running_time_ms, timeout_ms, diff);
> > > > +
> > > > +	return running_time_ms >= timeout_ms;
> > > > +}
> > > > +
> > > > +static void enable_scheduling(struct xe_exec_queue *q)
> > > > +{
> > > > +	MAKE_SCHED_CONTEXT_ACTION(q, ENABLE);
> > > > +	struct xe_guc *guc = exec_queue_to_guc(q);
> > > > +	int ret;
> > > > +
> > > > +	xe_gt_assert(guc_to_gt(guc), !exec_queue_destroyed(q));
> > > > +	xe_gt_assert(guc_to_gt(guc), exec_queue_registered(q));
> > > > +	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_disable(q));
> > > > +	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_enable(q));
> > > > +
> > > > +	set_exec_queue_pending_enable(q);
> > > > +	set_exec_queue_enabled(q);
> > > > +	trace_xe_exec_queue_scheduling_enable(q);
> > > > +
> > > > +	xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
> > > > +		       G2H_LEN_DW_SCHED_CONTEXT_MODE_SET, 1);
> > > > +
> > > > +	ret = wait_event_timeout(guc->ct.wq,
> > > > +				 !exec_queue_pending_enable(q) ||
> > > > +				 guc_read_stopped(guc), HZ * 5);
> > > > +	if (!ret || guc_read_stopped(guc)) {
> > > > +		xe_gt_warn(guc_to_gt(guc), "Schedule enable failed to respond");
> > > > +		set_exec_queue_banned(q);
> > > > +		xe_gt_reset_async(q->gt);
> > > > +		xe_sched_tdr_queue_imm(&q->guc->sched);
> > > > +	}
> > > > +}
> > > > +
> > > > +static void disable_scheduling(struct xe_exec_queue *q, bool immediate)
> > > > +{
> > > > +	MAKE_SCHED_CONTEXT_ACTION(q, DISABLE);
> > > > +	struct xe_guc *guc = exec_queue_to_guc(q);
> > > > +
> > > > +	xe_gt_assert(guc_to_gt(guc), !exec_queue_destroyed(q));
> > > > +	xe_gt_assert(guc_to_gt(guc), exec_queue_registered(q));
> > > > +	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_disable(q));
> > > > +
> > > > +	if (immediate)
> > > > +		set_min_preemption_timeout(guc, q);
> > > > +	clear_exec_queue_enabled(q);
> > > > +	set_exec_queue_pending_disable(q);
> > > > +	trace_xe_exec_queue_scheduling_disable(q);
> > > > +
> > > > +	xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
> > > > +		       G2H_LEN_DW_SCHED_CONTEXT_MODE_SET, 1);
> > > > +}
> > > > +
> > > > +static void __deregister_exec_queue(struct xe_guc *guc, struct xe_exec_queue *q)
> > > > +{
> > > > +	u32 action[] = {
> > > > +		XE_GUC_ACTION_DEREGISTER_CONTEXT,
> > > > +		q->guc->id,
> > > > +	};
> > > > +
> > > > +	xe_gt_assert(guc_to_gt(guc), !exec_queue_destroyed(q));
> > > > +	xe_gt_assert(guc_to_gt(guc), exec_queue_registered(q));
> > > > +	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_enable(q));
> > > > +	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_disable(q));
> > > > +
> > > > +	set_exec_queue_destroyed(q);
> > > > +	trace_xe_exec_queue_deregister(q);
> > > > +
> > > > +	xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
> > > > +		       G2H_LEN_DW_DEREGISTER_CONTEXT, 1);
> > > > +}
> > > > +
> > > >    static enum drm_gpu_sched_stat
> > > >    guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
> > > >    {
> > > > @@ -927,10 +1059,10 @@ guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
> > > >    	struct xe_sched_job *tmp_job;
> > > >    	struct xe_exec_queue *q = job->q;
> > > >    	struct xe_gpu_scheduler *sched = &q->guc->sched;
> > > > -	struct xe_device *xe = guc_to_xe(exec_queue_to_guc(q));
> > > > +	struct xe_guc *guc = exec_queue_to_guc(q);
> > > >    	int err = -ETIME;
> > > >    	int i = 0;
> > > > -	bool wedged;
> > > > +	bool wedged, skip_timeout_check;
> > > >    	/*
> > > >    	 * TDR has fired before free job worker. Common if exec queue
> > > > @@ -942,49 +1074,53 @@ guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
> > > >    		return DRM_GPU_SCHED_STAT_NOMINAL;
> > > >    	}
> > > > -	drm_notice(&xe->drm, "Timedout job: seqno=%u, lrc_seqno=%u, guc_id=%d, flags=0x%lx",
> > > > -		   xe_sched_job_seqno(job), xe_sched_job_lrc_seqno(job),
> > > > -		   q->guc->id, q->flags);
> > > > -	xe_gt_WARN(q->gt, q->flags & EXEC_QUEUE_FLAG_KERNEL,
> > > > -		   "Kernel-submitted job timed out\n");
> > > > -	xe_gt_WARN(q->gt, q->flags & EXEC_QUEUE_FLAG_VM && !exec_queue_killed(q),
> > > > -		   "VM job timed out on non-killed execqueue\n");
> > > > -
> > > > -	if (!exec_queue_killed(q))
> > > > -		xe_devcoredump(job);
> > > > -
> > > > -	trace_xe_sched_job_timedout(job);
> > > > -
> > > > -	wedged = guc_submit_hint_wedged(exec_queue_to_guc(q));
> > > > -
> > > >    	/* Kill the run_job entry point */
> > > >    	xe_sched_submission_stop(sched);
> > > > +	/* Must check all state after stopping scheduler */
> > > > +	skip_timeout_check = exec_queue_reset(q) ||
> > > > +		exec_queue_killed_or_banned_or_wedged(q) ||
> > > > +		exec_queue_destroyed(q);
> > > > +
> > > > +	/* Job hasn't started, can't be timed out */
> > > > +	if (!skip_timeout_check && !xe_sched_job_started(job))
> > > > +		goto rearm;
> > > > +
> > > >    	/*
> > > > -	 * Kernel jobs should never fail, nor should VM jobs if they do
> > > > -	 * somethings has gone wrong and the GT needs a reset
> > > > +	 * XXX: Sampling timeout doesn't work in wedged mode as we have to
> > > > +	 * modify scheduling state to read timestamp. We could read the
> > > > +	 * timestamp from a register to accumulate current running time but this
> > > > +	 * doesn't work for SRIOV. For now assuming timeouts in wedged mode are
> > > > +	 * genuine timeouts.
> > > >    	 */
> > > > -	if (!wedged && (q->flags & EXEC_QUEUE_FLAG_KERNEL ||
> > > > -			(q->flags & EXEC_QUEUE_FLAG_VM && !exec_queue_killed(q)))) {
> > > > -		if (!xe_sched_invalidate_job(job, 2)) {
> > > > -			xe_sched_add_pending_job(sched, job);
> > > > -			xe_sched_submission_start(sched);
> > > > -			xe_gt_reset_async(q->gt);
> > > > -			goto out;
> > > > -		}
> > > > -	}
> > > > +	wedged = guc_submit_hint_wedged(exec_queue_to_guc(q));
> > > > -	/* Engine state now stable, disable scheduling if needed */
> > > > +	/* Engine state now stable, disable scheduling to check timestamp */
> > > >    	if (!wedged && exec_queue_registered(q)) {
> > > > -		struct xe_guc *guc = exec_queue_to_guc(q);
> > > >    		int ret;
> > > >    		if (exec_queue_reset(q))
> > > >    			err = -EIO;
> > > > -		set_exec_queue_banned(q);
> > > > +
> > > >    		if (!exec_queue_destroyed(q)) {
> > > > -			xe_exec_queue_get(q);
> > > > -			disable_scheduling_deregister(guc, q);
> > > > +			/*
> > > > +			 * Wait for any pending G2H to flush out before
> > > > +			 * modifying state
> > > > +			 */
> > > > +			ret = wait_event_timeout(guc->ct.wq,
> > > > +						 !exec_queue_pending_enable(q) ||
> > > > +						 guc_read_stopped(guc), HZ * 5);
> > > > +			if (!ret || guc_read_stopped(guc))
> > > > +				goto trigger_reset;
> > > > +
> > > > +			/*
> > > > +			 * Flag communicates to G2H handler that schedule
> > > > +			 * disable originated from a timeout check. The G2H then
> > > > +			 * avoid triggering cleanup or deregistering the exec
> > > > +			 * queue.
> > > > +			 */
> > > > +			set_exec_queue_check_timeout(q);
> > > > +			disable_scheduling(q, skip_timeout_check);
> > > >    		}
> > > >    		/*
> > > > @@ -1000,15 +1136,60 @@ guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
> > > >    					 !exec_queue_pending_disable(q) ||
> > > >    					 guc_read_stopped(guc), HZ * 5);
> > > >    		if (!ret || guc_read_stopped(guc)) {
> > > > -			drm_warn(&xe->drm, "Schedule disable failed to respond");
> > > > -			xe_sched_add_pending_job(sched, job);
> > > > -			xe_sched_submission_start(sched);
> > > > +trigger_reset:
> > > > +			xe_gt_warn(guc_to_gt(guc), "Schedule disable failed to respond");
> > > Not a problem introduced in this patch set so maybe not necessary to fix
> > > here either. But we have seen what look like false hits on this warning in
> > > some of the reset tests. The code gets here if the schedule disable
> > > genuinely times out which is what the warning is saying. But it also gets
> > > here if guc_read_stopped() is true and that happens if a reset occurs
> > > asynchronously to this timeout check. In that situation, there is no need to
> > > fire a warning - the abort is intentional and expected. It is also not
> > > necessary to queue up another reset just below. It seems like the warning
> > > and the reset should be inside a further 'if(!ret)' check.
> > > 
> > Agree. It should be:
> > 
> > if (!ret)
> > 	xe_gt_warn(guc_to_gt(guc), "Schedule disable failed to respond");
> > 
> > 
> > Will fix in next rev or before merging.
> What about the xe_gt_reset_async call? Should that be only in the case of
> genuine timeout or is there a reason to keep it in the case of an abort as
> well?
> 

In both cases it is fine. If guc_read_stopped() returns true it means a
GT reset has been queue'd. It is harmless to queue another one as we
only allow 1 in flight at a time (i.e. you can call xe_gt_reset_async as
many times as you want and it only results in 1 GT reset). Also the GT
reset is executed on same WQ as the TDR if a GT reset is queued, it
cannot complete while the TDR is executing.

Matt 

> > 
> > > > +			set_exec_queue_extra_ref(q);
> > > > +			xe_exec_queue_get(q);	/* GT reset owns this */
> > > > +			set_exec_queue_banned(q);
> > > >    			xe_gt_reset_async(q->gt);
> > > >    			xe_sched_tdr_queue_imm(sched);
> > > > -			goto out;
> > > > +			goto rearm;
> > > > +		}
> > > > +	}
> > > > +
> > > > +	/*
> > > > +	 * Check if job is actually timed out, if so restart job execution and TDR
> > > > +	 */
> > > > +	if (!wedged && !skip_timeout_check && !check_timeout(q, job) &&
> > > > +	    !exec_queue_reset(q) && exec_queue_registered(q)) {
> > > > +		clear_exec_queue_check_timeout(q);
> > > > +		goto sched_enable;
> > > > +	}
> > > > +
> > > > +	xe_gt_notice(guc_to_gt(guc), "Timedout job: seqno=%u, lrc_seqno=%u, guc_id=%d, flags=0x%lx",
> > > > +		     xe_sched_job_seqno(job), xe_sched_job_lrc_seqno(job),
> > > > +		     q->guc->id, q->flags);
> > > > +	xe_gt_WARN(q->gt, q->flags & EXEC_QUEUE_FLAG_KERNEL,
> > > > +		   "Kernel-submitted job timed out\n");
> > > > +	xe_gt_WARN(q->gt, q->flags & EXEC_QUEUE_FLAG_VM && !exec_queue_killed(q),
> > > > +		   "VM job timed out on non-killed execqueue\n");
> > > I still think it makes more sense to have these two warnings next to the
> > > comment that says why these are unexpected errors...
> > > 
> > > > +
> > > > +	trace_xe_sched_job_timedout(job);
> > > > +
> > > > +	if (!exec_queue_killed(q))
> > > > +		xe_devcoredump(job);
> > > > +
> > > > +	/*
> > > > +	 * Kernel jobs should never fail, nor should VM jobs if they do
> > > > +	 * somethings has gone wrong and the GT needs a reset
> > > > +	 */
> > > ... i.e. the warning about kernel jobs and VM jobs not failing should be
> > > here.
> > > 
> > Sure, can move these warn below this comment. Do you mind if I just fix
> > this at merge time?
> Sure.
> 
> John.
> 
> > 
> > Matt
> > 
> > > John.
> > > 
> > > > +	if (!wedged && (q->flags & EXEC_QUEUE_FLAG_KERNEL ||
> > > > +			(q->flags & EXEC_QUEUE_FLAG_VM && !exec_queue_killed(q)))) {
> > > > +		if (!xe_sched_invalidate_job(job, 2)) {
> > > > +			clear_exec_queue_check_timeout(q);
> > > > +			xe_gt_reset_async(q->gt);
> > > > +			goto rearm;
> > > >    		}
> > > >    	}
> > > > +	/* Finish cleaning up exec queue via deregister */
> > > > +	set_exec_queue_banned(q);
> > > > +	if (!wedged && exec_queue_registered(q) && !exec_queue_destroyed(q)) {
> > > > +		set_exec_queue_extra_ref(q);
> > > > +		xe_exec_queue_get(q);
> > > > +		__deregister_exec_queue(guc, q);
> > > > +	}
> > > > +
> > > >    	/* Stop fence signaling */
> > > >    	xe_hw_fence_irq_stop(q->fence_irq);
> > > > @@ -1030,7 +1211,19 @@ guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
> > > >    	/* Start fence signaling */
> > > >    	xe_hw_fence_irq_start(q->fence_irq);
> > > > -out:
> > > > +	return DRM_GPU_SCHED_STAT_NOMINAL;
> > > > +
> > > > +sched_enable:
> > > > +	enable_scheduling(q);
> > > > +rearm:
> > > > +	/*
> > > > +	 * XXX: Ideally want to adjust timeout based on current exection time
> > > > +	 * but there is not currently an easy way to do in DRM scheduler. With
> > > > +	 * some thought, do this in a follow up.
> > > > +	 */
> > > > +	xe_sched_add_pending_job(sched, job);
> > > > +	xe_sched_submission_start(sched);
> > > > +
> > > >    	return DRM_GPU_SCHED_STAT_NOMINAL;
> > > >    }
> > > > @@ -1133,7 +1326,6 @@ static void __guc_exec_queue_process_msg_suspend(struct xe_sched_msg *msg)
> > > >    			   guc_read_stopped(guc));
> > > >    		if (!guc_read_stopped(guc)) {
> > > > -			MAKE_SCHED_CONTEXT_ACTION(q, DISABLE);
> > > >    			s64 since_resume_ms =
> > > >    				ktime_ms_delta(ktime_get(),
> > > >    					       q->guc->resume_time);
> > > > @@ -1144,12 +1336,7 @@ static void __guc_exec_queue_process_msg_suspend(struct xe_sched_msg *msg)
> > > >    				msleep(wait_ms);
> > > >    			set_exec_queue_suspended(q);
> > > > -			clear_exec_queue_enabled(q);
> > > > -			set_exec_queue_pending_disable(q);
> > > > -			trace_xe_exec_queue_scheduling_disable(q);
> > > > -
> > > > -			xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
> > > > -				       G2H_LEN_DW_SCHED_CONTEXT_MODE_SET, 1);
> > > > +			disable_scheduling(q, false);
> > > >    		}
> > > >    	} else if (q->guc->suspend_pending) {
> > > >    		set_exec_queue_suspended(q);
> > > > @@ -1160,19 +1347,11 @@ static void __guc_exec_queue_process_msg_suspend(struct xe_sched_msg *msg)
> > > >    static void __guc_exec_queue_process_msg_resume(struct xe_sched_msg *msg)
> > > >    {
> > > >    	struct xe_exec_queue *q = msg->private_data;
> > > > -	struct xe_guc *guc = exec_queue_to_guc(q);
> > > >    	if (guc_exec_queue_allowed_to_change_state(q)) {
> > > > -		MAKE_SCHED_CONTEXT_ACTION(q, ENABLE);
> > > > -
> > > >    		q->guc->resume_time = RESUME_PENDING;
> > > >    		clear_exec_queue_suspended(q);
> > > > -		set_exec_queue_pending_enable(q);
> > > > -		set_exec_queue_enabled(q);
> > > > -		trace_xe_exec_queue_scheduling_enable(q);
> > > > -
> > > > -		xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
> > > > -			       G2H_LEN_DW_SCHED_CONTEXT_MODE_SET, 1);
> > > > +		enable_scheduling(q);
> > > >    	} else {
> > > >    		clear_exec_queue_suspended(q);
> > > >    	}
> > > > @@ -1434,8 +1613,7 @@ static void guc_exec_queue_stop(struct xe_guc *guc, struct xe_exec_queue *q)
> > > >    	/* Clean up lost G2H + reset engine state */
> > > >    	if (exec_queue_registered(q)) {
> > > > -		if ((exec_queue_banned(q) && exec_queue_destroyed(q)) ||
> > > > -		    xe_exec_queue_is_lr(q))
> > > > +		if (exec_queue_extra_ref(q) || xe_exec_queue_is_lr(q))
> > > >    			xe_exec_queue_put(q);
> > > >    		else if (exec_queue_destroyed(q))
> > > >    			__guc_exec_queue_fini(guc, q);
> > > > @@ -1612,6 +1790,8 @@ static void handle_sched_done(struct xe_guc *guc, struct xe_exec_queue *q,
> > > >    		smp_wmb();
> > > >    		wake_up_all(&guc->ct.wq);
> > > >    	} else {
> > > > +		bool check_timeout = exec_queue_check_timeout(q);
> > > > +
> > > >    		xe_gt_assert(guc_to_gt(guc), runnable_state == 0);
> > > >    		xe_gt_assert(guc_to_gt(guc), exec_queue_pending_disable(q));
> > > > @@ -1619,11 +1799,12 @@ static void handle_sched_done(struct xe_guc *guc, struct xe_exec_queue *q,
> > > >    		if (q->guc->suspend_pending) {
> > > >    			suspend_fence_signal(q);
> > > >    		} else {
> > > > -			if (exec_queue_banned(q)) {
> > > > +			if (exec_queue_banned(q) || check_timeout) {
> > > >    				smp_wmb();
> > > >    				wake_up_all(&guc->ct.wq);
> > > >    			}
> > > > -			deregister_exec_queue(guc, q);
> > > > +			if (!check_timeout)
> > > > +				deregister_exec_queue(guc, q);
> > > >    		}
> > > >    	}
> > > >    }
> > > > @@ -1664,7 +1845,7 @@ static void handle_deregister_done(struct xe_guc *guc, struct xe_exec_queue *q)
> > > >    	clear_exec_queue_registered(q);
> > > > -	if (exec_queue_banned(q) || xe_exec_queue_is_lr(q))
> > > > +	if (exec_queue_extra_ref(q) || xe_exec_queue_is_lr(q))
> > > >    		xe_exec_queue_put(q);
> > > >    	else
> > > >    		__guc_exec_queue_fini(guc, q);
> > > > @@ -1728,7 +1909,7 @@ int xe_guc_exec_queue_reset_handler(struct xe_guc *guc, u32 *msg, u32 len)
> > > >    	 * guc_exec_queue_timedout_job.
> > > >    	 */
> > > >    	set_exec_queue_reset(q);
> > > > -	if (!exec_queue_banned(q))
> > > > +	if (!exec_queue_banned(q) && !exec_queue_check_timeout(q))
> > > >    		xe_guc_exec_queue_trigger_cleanup(q);
> > > >    	return 0;
> > > > @@ -1758,7 +1939,7 @@ int xe_guc_exec_queue_memory_cat_error_handler(struct xe_guc *guc, u32 *msg,
> > > >    	/* Treat the same as engine reset */
> > > >    	set_exec_queue_reset(q);
> > > > -	if (!exec_queue_banned(q))
> > > > +	if (!exec_queue_banned(q) && !exec_queue_check_timeout(q))
> > > >    		xe_guc_exec_queue_trigger_cleanup(q);
> > > >    	return 0;
> 

Re: [PATCH v6 11/11] drm/xe: Sample ctx timestamp to determine if jobs have timed out

[Matt Roper]

On Tue, Jun 11, 2024 at 07:40:53AM -0700, Matthew Brost wrote:
> In GuC TDR sample ctx timestamp to determine if jobs have timed out. The
> scheduling enable needs to be toggled to properly sample the timestamp.
> If a job has not been running for longer than the timeout period,
> re-enable scheduling and restart the TDR.
> 
> v2:
>  - Use GT clock to msec helper (Umesh, off list)
>  - s/ctx_timestamp_job/ctx_job_timestamp
> v3:
>  - Fix state machine for TDR, mainly decouple sched disable and
>    deregister (testing)
>  - Rebase (CI)
> v4:
>  - Fix checkpatch && newline issue (CI)
>  - Do not deregister on wedged or unregistered (CI)
>  - Fix refcounting bugs (CI)
>  - Move devcoredump above VM / kernel job check (John H)
>  - Add comment for check_timeout state usage (John H)
>  - Assert pending disable not inflight when enabling scheduling (John H)
>  - Use enable_scheduling in other scheduling enable code (John H)
>  - Add comments on a few steps in TDR (John H)
>  - Add assert for timestamp overflow protection (John H)
> v6:
>  - Use mul_u64_u32_div (CI, checkpath)
>  - Change check time to dbg level (Paulo)
>  - Add immediate mode to sched disable (inspection)
>  - Use xe_gt_* messages (John H)
>  - Fix typo in comment (John H)
>  - Check timeout before clearing pending disable (Paulo)
> 
> Signed-off-by: Matthew Brost <matthew.brost@intel.com>
> Reviewed-by: Jonathan Cavitt <jonathan.cavitt@intel.com>
> ---
>  drivers/gpu/drm/xe/xe_guc_submit.c | 303 +++++++++++++++++++++++------
>  1 file changed, 242 insertions(+), 61 deletions(-)
> 
> diff --git a/drivers/gpu/drm/xe/xe_guc_submit.c b/drivers/gpu/drm/xe/xe_guc_submit.c
> index 671c72caf0ff..cddb391888b6 100644
> --- a/drivers/gpu/drm/xe/xe_guc_submit.c
> +++ b/drivers/gpu/drm/xe/xe_guc_submit.c
> @@ -10,6 +10,7 @@
>  #include <linux/circ_buf.h>
>  #include <linux/delay.h>
>  #include <linux/dma-fence-array.h>
> +#include <linux/math64.h>
>  
>  #include <drm/drm_managed.h>
>  
> @@ -23,6 +24,7 @@
>  #include "xe_force_wake.h"
>  #include "xe_gpu_scheduler.h"
>  #include "xe_gt.h"
> +#include "xe_gt_clock.h"
>  #include "xe_gt_printk.h"
>  #include "xe_guc.h"
>  #include "xe_guc_ct.h"
> @@ -62,6 +64,8 @@ exec_queue_to_guc(struct xe_exec_queue *q)
>  #define EXEC_QUEUE_STATE_KILLED			(1 << 7)
>  #define EXEC_QUEUE_STATE_WEDGED			(1 << 8)
>  #define EXEC_QUEUE_STATE_BANNED			(1 << 9)
> +#define EXEC_QUEUE_STATE_CHECK_TIMEOUT		(1 << 10)
> +#define EXEC_QUEUE_STATE_EXTRA_REF		(1 << 11)
>  
>  static bool exec_queue_registered(struct xe_exec_queue *q)
>  {
> @@ -188,6 +192,31 @@ static void set_exec_queue_wedged(struct xe_exec_queue *q)
>  	atomic_or(EXEC_QUEUE_STATE_WEDGED, &q->guc->state);
>  }
>  
> +static bool exec_queue_check_timeout(struct xe_exec_queue *q)
> +{
> +	return atomic_read(&q->guc->state) & EXEC_QUEUE_STATE_CHECK_TIMEOUT;
> +}
> +
> +static void set_exec_queue_check_timeout(struct xe_exec_queue *q)
> +{
> +	atomic_or(EXEC_QUEUE_STATE_CHECK_TIMEOUT, &q->guc->state);
> +}
> +
> +static void clear_exec_queue_check_timeout(struct xe_exec_queue *q)
> +{
> +	atomic_and(~EXEC_QUEUE_STATE_CHECK_TIMEOUT, &q->guc->state);
> +}
> +
> +static bool exec_queue_extra_ref(struct xe_exec_queue *q)
> +{
> +	return atomic_read(&q->guc->state) & EXEC_QUEUE_STATE_EXTRA_REF;
> +}
> +
> +static void set_exec_queue_extra_ref(struct xe_exec_queue *q)
> +{
> +	atomic_or(EXEC_QUEUE_STATE_EXTRA_REF, &q->guc->state);
> +}
> +
>  static bool exec_queue_killed_or_banned_or_wedged(struct xe_exec_queue *q)
>  {
>  	return (atomic_read(&q->guc->state) &
> @@ -920,6 +949,109 @@ static void xe_guc_exec_queue_lr_cleanup(struct work_struct *w)
>  	xe_sched_submission_start(sched);
>  }
>  
> +#define ADJUST_FIVE_PERCENT(__t)	mul_u64_u32_div((__t), 105, 100)
> +
> +static bool check_timeout(struct xe_exec_queue *q, struct xe_sched_job *job)
> +{
> +	struct xe_gt *gt = guc_to_gt(exec_queue_to_guc(q));
> +	u32 ctx_timestamp = xe_lrc_ctx_timestamp(q->lrc[0]);
> +	u32 ctx_job_timestamp = xe_lrc_ctx_job_timestamp(q->lrc[0]);
> +	u32 timeout_ms = q->sched_props.job_timeout_ms;
> +	u32 diff;
> +	u64 running_time_ms;
> +
> +	/*
> +	 * Counter wraps at ~223s at the usual 19.2MHz, be paranoid catch
> +	 * possible overflows with a high timeout.
> +	 */
> +	xe_gt_assert(gt, timeout_ms < 100 * MSEC_PER_SEC);
> +
> +	if (ctx_timestamp < ctx_job_timestamp)
> +		diff = ctx_timestamp + U32_MAX - ctx_job_timestamp;
> +	else
> +		diff = ctx_timestamp - ctx_job_timestamp;

Just noticed this while looking through the code...what is this if/else
supposed to do?  It looks like it's trying to detect when ctx_timestamp
has gone past U32_MAX and wrapped around while ctx_job_timestamp hasn't
yet.  But even if that's happened it doesn't seem like it's doing
anything meaningful either; I think the u32 subtraction works out the
same way regardless of whether or not there's a wraparound, and since
all the variables involved here are u32, adding U32_MAX is effectively
the same as just subtracting 1 from the final result, which doesn't seem
to actually do anything important for the rest of the logic in this
function?

It's also worth noting that starting with Xe2, CTX_TIMESTAMP is now a
64-bit register rather than 32-bits.  For the short timeouts we're
dealing with in this function is probably doesn't matter, but to prevent
future mistakes elsewhere in the driver we may want to think about
updating xe_lrc_ctx_timestamp() and such to return u64's and actually
fill both dwords when running on a platform that has the larger
timestamp.


Matt

> +
> +	/*
> +	 * Ensure timeout is within 5% to account for an GuC scheduling latency
> +	 */
> +	running_time_ms =
> +		ADJUST_FIVE_PERCENT(xe_gt_clock_interval_to_ms(gt, diff));
> +
> +	xe_gt_dbg(gt,
> +		  "Check job timeout: seqno=%u, lrc_seqno=%u, guc_id=%d, running_time_ms=%llu, timeout_ms=%u, diff=0x%08x",
> +		  xe_sched_job_seqno(job), xe_sched_job_lrc_seqno(job),
> +		  q->guc->id, running_time_ms, timeout_ms, diff);
> +
> +	return running_time_ms >= timeout_ms;
> +}
> +
> +static void enable_scheduling(struct xe_exec_queue *q)
> +{
> +	MAKE_SCHED_CONTEXT_ACTION(q, ENABLE);
> +	struct xe_guc *guc = exec_queue_to_guc(q);
> +	int ret;
> +
> +	xe_gt_assert(guc_to_gt(guc), !exec_queue_destroyed(q));
> +	xe_gt_assert(guc_to_gt(guc), exec_queue_registered(q));
> +	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_disable(q));
> +	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_enable(q));
> +
> +	set_exec_queue_pending_enable(q);
> +	set_exec_queue_enabled(q);
> +	trace_xe_exec_queue_scheduling_enable(q);
> +
> +	xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
> +		       G2H_LEN_DW_SCHED_CONTEXT_MODE_SET, 1);
> +
> +	ret = wait_event_timeout(guc->ct.wq,
> +				 !exec_queue_pending_enable(q) ||
> +				 guc_read_stopped(guc), HZ * 5);
> +	if (!ret || guc_read_stopped(guc)) {
> +		xe_gt_warn(guc_to_gt(guc), "Schedule enable failed to respond");
> +		set_exec_queue_banned(q);
> +		xe_gt_reset_async(q->gt);
> +		xe_sched_tdr_queue_imm(&q->guc->sched);
> +	}
> +}
> +
> +static void disable_scheduling(struct xe_exec_queue *q, bool immediate)
> +{
> +	MAKE_SCHED_CONTEXT_ACTION(q, DISABLE);
> +	struct xe_guc *guc = exec_queue_to_guc(q);
> +
> +	xe_gt_assert(guc_to_gt(guc), !exec_queue_destroyed(q));
> +	xe_gt_assert(guc_to_gt(guc), exec_queue_registered(q));
> +	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_disable(q));
> +
> +	if (immediate)
> +		set_min_preemption_timeout(guc, q);
> +	clear_exec_queue_enabled(q);
> +	set_exec_queue_pending_disable(q);
> +	trace_xe_exec_queue_scheduling_disable(q);
> +
> +	xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
> +		       G2H_LEN_DW_SCHED_CONTEXT_MODE_SET, 1);
> +}
> +
> +static void __deregister_exec_queue(struct xe_guc *guc, struct xe_exec_queue *q)
> +{
> +	u32 action[] = {
> +		XE_GUC_ACTION_DEREGISTER_CONTEXT,
> +		q->guc->id,
> +	};
> +
> +	xe_gt_assert(guc_to_gt(guc), !exec_queue_destroyed(q));
> +	xe_gt_assert(guc_to_gt(guc), exec_queue_registered(q));
> +	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_enable(q));
> +	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_disable(q));
> +
> +	set_exec_queue_destroyed(q);
> +	trace_xe_exec_queue_deregister(q);
> +
> +	xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
> +		       G2H_LEN_DW_DEREGISTER_CONTEXT, 1);
> +}
> +
>  static enum drm_gpu_sched_stat
>  guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
>  {
> @@ -927,10 +1059,10 @@ guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
>  	struct xe_sched_job *tmp_job;
>  	struct xe_exec_queue *q = job->q;
>  	struct xe_gpu_scheduler *sched = &q->guc->sched;
> -	struct xe_device *xe = guc_to_xe(exec_queue_to_guc(q));
> +	struct xe_guc *guc = exec_queue_to_guc(q);
>  	int err = -ETIME;
>  	int i = 0;
> -	bool wedged;
> +	bool wedged, skip_timeout_check;
>  
>  	/*
>  	 * TDR has fired before free job worker. Common if exec queue
> @@ -942,49 +1074,53 @@ guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
>  		return DRM_GPU_SCHED_STAT_NOMINAL;
>  	}
>  
> -	drm_notice(&xe->drm, "Timedout job: seqno=%u, lrc_seqno=%u, guc_id=%d, flags=0x%lx",
> -		   xe_sched_job_seqno(job), xe_sched_job_lrc_seqno(job),
> -		   q->guc->id, q->flags);
> -	xe_gt_WARN(q->gt, q->flags & EXEC_QUEUE_FLAG_KERNEL,
> -		   "Kernel-submitted job timed out\n");
> -	xe_gt_WARN(q->gt, q->flags & EXEC_QUEUE_FLAG_VM && !exec_queue_killed(q),
> -		   "VM job timed out on non-killed execqueue\n");
> -
> -	if (!exec_queue_killed(q))
> -		xe_devcoredump(job);
> -
> -	trace_xe_sched_job_timedout(job);
> -
> -	wedged = guc_submit_hint_wedged(exec_queue_to_guc(q));
> -
>  	/* Kill the run_job entry point */
>  	xe_sched_submission_stop(sched);
>  
> +	/* Must check all state after stopping scheduler */
> +	skip_timeout_check = exec_queue_reset(q) ||
> +		exec_queue_killed_or_banned_or_wedged(q) ||
> +		exec_queue_destroyed(q);
> +
> +	/* Job hasn't started, can't be timed out */
> +	if (!skip_timeout_check && !xe_sched_job_started(job))
> +		goto rearm;
> +
>  	/*
> -	 * Kernel jobs should never fail, nor should VM jobs if they do
> -	 * somethings has gone wrong and the GT needs a reset
> +	 * XXX: Sampling timeout doesn't work in wedged mode as we have to
> +	 * modify scheduling state to read timestamp. We could read the
> +	 * timestamp from a register to accumulate current running time but this
> +	 * doesn't work for SRIOV. For now assuming timeouts in wedged mode are
> +	 * genuine timeouts.
>  	 */
> -	if (!wedged && (q->flags & EXEC_QUEUE_FLAG_KERNEL ||
> -			(q->flags & EXEC_QUEUE_FLAG_VM && !exec_queue_killed(q)))) {
> -		if (!xe_sched_invalidate_job(job, 2)) {
> -			xe_sched_add_pending_job(sched, job);
> -			xe_sched_submission_start(sched);
> -			xe_gt_reset_async(q->gt);
> -			goto out;
> -		}
> -	}
> +	wedged = guc_submit_hint_wedged(exec_queue_to_guc(q));
>  
> -	/* Engine state now stable, disable scheduling if needed */
> +	/* Engine state now stable, disable scheduling to check timestamp */
>  	if (!wedged && exec_queue_registered(q)) {
> -		struct xe_guc *guc = exec_queue_to_guc(q);
>  		int ret;
>  
>  		if (exec_queue_reset(q))
>  			err = -EIO;
> -		set_exec_queue_banned(q);
> +
>  		if (!exec_queue_destroyed(q)) {
> -			xe_exec_queue_get(q);
> -			disable_scheduling_deregister(guc, q);
> +			/*
> +			 * Wait for any pending G2H to flush out before
> +			 * modifying state
> +			 */
> +			ret = wait_event_timeout(guc->ct.wq,
> +						 !exec_queue_pending_enable(q) ||
> +						 guc_read_stopped(guc), HZ * 5);
> +			if (!ret || guc_read_stopped(guc))
> +				goto trigger_reset;
> +
> +			/*
> +			 * Flag communicates to G2H handler that schedule
> +			 * disable originated from a timeout check. The G2H then
> +			 * avoid triggering cleanup or deregistering the exec
> +			 * queue.
> +			 */
> +			set_exec_queue_check_timeout(q);
> +			disable_scheduling(q, skip_timeout_check);
>  		}
>  
>  		/*
> @@ -1000,15 +1136,60 @@ guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
>  					 !exec_queue_pending_disable(q) ||
>  					 guc_read_stopped(guc), HZ * 5);
>  		if (!ret || guc_read_stopped(guc)) {
> -			drm_warn(&xe->drm, "Schedule disable failed to respond");
> -			xe_sched_add_pending_job(sched, job);
> -			xe_sched_submission_start(sched);
> +trigger_reset:
> +			xe_gt_warn(guc_to_gt(guc), "Schedule disable failed to respond");
> +			set_exec_queue_extra_ref(q);
> +			xe_exec_queue_get(q);	/* GT reset owns this */
> +			set_exec_queue_banned(q);
>  			xe_gt_reset_async(q->gt);
>  			xe_sched_tdr_queue_imm(sched);
> -			goto out;
> +			goto rearm;
> +		}
> +	}
> +
> +	/*
> +	 * Check if job is actually timed out, if so restart job execution and TDR
> +	 */
> +	if (!wedged && !skip_timeout_check && !check_timeout(q, job) &&
> +	    !exec_queue_reset(q) && exec_queue_registered(q)) {
> +		clear_exec_queue_check_timeout(q);
> +		goto sched_enable;
> +	}
> +
> +	xe_gt_notice(guc_to_gt(guc), "Timedout job: seqno=%u, lrc_seqno=%u, guc_id=%d, flags=0x%lx",
> +		     xe_sched_job_seqno(job), xe_sched_job_lrc_seqno(job),
> +		     q->guc->id, q->flags);
> +	xe_gt_WARN(q->gt, q->flags & EXEC_QUEUE_FLAG_KERNEL,
> +		   "Kernel-submitted job timed out\n");
> +	xe_gt_WARN(q->gt, q->flags & EXEC_QUEUE_FLAG_VM && !exec_queue_killed(q),
> +		   "VM job timed out on non-killed execqueue\n");
> +
> +	trace_xe_sched_job_timedout(job);
> +
> +	if (!exec_queue_killed(q))
> +		xe_devcoredump(job);
> +
> +	/*
> +	 * Kernel jobs should never fail, nor should VM jobs if they do
> +	 * somethings has gone wrong and the GT needs a reset
> +	 */
> +	if (!wedged && (q->flags & EXEC_QUEUE_FLAG_KERNEL ||
> +			(q->flags & EXEC_QUEUE_FLAG_VM && !exec_queue_killed(q)))) {
> +		if (!xe_sched_invalidate_job(job, 2)) {
> +			clear_exec_queue_check_timeout(q);
> +			xe_gt_reset_async(q->gt);
> +			goto rearm;
>  		}
>  	}
>  
> +	/* Finish cleaning up exec queue via deregister */
> +	set_exec_queue_banned(q);
> +	if (!wedged && exec_queue_registered(q) && !exec_queue_destroyed(q)) {
> +		set_exec_queue_extra_ref(q);
> +		xe_exec_queue_get(q);
> +		__deregister_exec_queue(guc, q);
> +	}
> +
>  	/* Stop fence signaling */
>  	xe_hw_fence_irq_stop(q->fence_irq);
>  
> @@ -1030,7 +1211,19 @@ guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
>  	/* Start fence signaling */
>  	xe_hw_fence_irq_start(q->fence_irq);
>  
> -out:
> +	return DRM_GPU_SCHED_STAT_NOMINAL;
> +
> +sched_enable:
> +	enable_scheduling(q);
> +rearm:
> +	/*
> +	 * XXX: Ideally want to adjust timeout based on current exection time
> +	 * but there is not currently an easy way to do in DRM scheduler. With
> +	 * some thought, do this in a follow up.
> +	 */
> +	xe_sched_add_pending_job(sched, job);
> +	xe_sched_submission_start(sched);
> +
>  	return DRM_GPU_SCHED_STAT_NOMINAL;
>  }
>  
> @@ -1133,7 +1326,6 @@ static void __guc_exec_queue_process_msg_suspend(struct xe_sched_msg *msg)
>  			   guc_read_stopped(guc));
>  
>  		if (!guc_read_stopped(guc)) {
> -			MAKE_SCHED_CONTEXT_ACTION(q, DISABLE);
>  			s64 since_resume_ms =
>  				ktime_ms_delta(ktime_get(),
>  					       q->guc->resume_time);
> @@ -1144,12 +1336,7 @@ static void __guc_exec_queue_process_msg_suspend(struct xe_sched_msg *msg)
>  				msleep(wait_ms);
>  
>  			set_exec_queue_suspended(q);
> -			clear_exec_queue_enabled(q);
> -			set_exec_queue_pending_disable(q);
> -			trace_xe_exec_queue_scheduling_disable(q);
> -
> -			xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
> -				       G2H_LEN_DW_SCHED_CONTEXT_MODE_SET, 1);
> +			disable_scheduling(q, false);
>  		}
>  	} else if (q->guc->suspend_pending) {
>  		set_exec_queue_suspended(q);
> @@ -1160,19 +1347,11 @@ static void __guc_exec_queue_process_msg_suspend(struct xe_sched_msg *msg)
>  static void __guc_exec_queue_process_msg_resume(struct xe_sched_msg *msg)
>  {
>  	struct xe_exec_queue *q = msg->private_data;
> -	struct xe_guc *guc = exec_queue_to_guc(q);
>  
>  	if (guc_exec_queue_allowed_to_change_state(q)) {
> -		MAKE_SCHED_CONTEXT_ACTION(q, ENABLE);
> -
>  		q->guc->resume_time = RESUME_PENDING;
>  		clear_exec_queue_suspended(q);
> -		set_exec_queue_pending_enable(q);
> -		set_exec_queue_enabled(q);
> -		trace_xe_exec_queue_scheduling_enable(q);
> -
> -		xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
> -			       G2H_LEN_DW_SCHED_CONTEXT_MODE_SET, 1);
> +		enable_scheduling(q);
>  	} else {
>  		clear_exec_queue_suspended(q);
>  	}
> @@ -1434,8 +1613,7 @@ static void guc_exec_queue_stop(struct xe_guc *guc, struct xe_exec_queue *q)
>  
>  	/* Clean up lost G2H + reset engine state */
>  	if (exec_queue_registered(q)) {
> -		if ((exec_queue_banned(q) && exec_queue_destroyed(q)) ||
> -		    xe_exec_queue_is_lr(q))
> +		if (exec_queue_extra_ref(q) || xe_exec_queue_is_lr(q))
>  			xe_exec_queue_put(q);
>  		else if (exec_queue_destroyed(q))
>  			__guc_exec_queue_fini(guc, q);
> @@ -1612,6 +1790,8 @@ static void handle_sched_done(struct xe_guc *guc, struct xe_exec_queue *q,
>  		smp_wmb();
>  		wake_up_all(&guc->ct.wq);
>  	} else {
> +		bool check_timeout = exec_queue_check_timeout(q);
> +
>  		xe_gt_assert(guc_to_gt(guc), runnable_state == 0);
>  		xe_gt_assert(guc_to_gt(guc), exec_queue_pending_disable(q));
>  
> @@ -1619,11 +1799,12 @@ static void handle_sched_done(struct xe_guc *guc, struct xe_exec_queue *q,
>  		if (q->guc->suspend_pending) {
>  			suspend_fence_signal(q);
>  		} else {
> -			if (exec_queue_banned(q)) {
> +			if (exec_queue_banned(q) || check_timeout) {
>  				smp_wmb();
>  				wake_up_all(&guc->ct.wq);
>  			}
> -			deregister_exec_queue(guc, q);
> +			if (!check_timeout)
> +				deregister_exec_queue(guc, q);
>  		}
>  	}
>  }
> @@ -1664,7 +1845,7 @@ static void handle_deregister_done(struct xe_guc *guc, struct xe_exec_queue *q)
>  
>  	clear_exec_queue_registered(q);
>  
> -	if (exec_queue_banned(q) || xe_exec_queue_is_lr(q))
> +	if (exec_queue_extra_ref(q) || xe_exec_queue_is_lr(q))
>  		xe_exec_queue_put(q);
>  	else
>  		__guc_exec_queue_fini(guc, q);
> @@ -1728,7 +1909,7 @@ int xe_guc_exec_queue_reset_handler(struct xe_guc *guc, u32 *msg, u32 len)
>  	 * guc_exec_queue_timedout_job.
>  	 */
>  	set_exec_queue_reset(q);
> -	if (!exec_queue_banned(q))
> +	if (!exec_queue_banned(q) && !exec_queue_check_timeout(q))
>  		xe_guc_exec_queue_trigger_cleanup(q);
>  
>  	return 0;
> @@ -1758,7 +1939,7 @@ int xe_guc_exec_queue_memory_cat_error_handler(struct xe_guc *guc, u32 *msg,
>  
>  	/* Treat the same as engine reset */
>  	set_exec_queue_reset(q);
> -	if (!exec_queue_banned(q))
> +	if (!exec_queue_banned(q) && !exec_queue_check_timeout(q))
>  		xe_guc_exec_queue_trigger_cleanup(q);
>  
>  	return 0;
> -- 
> 2.34.1
> 

-- 
Matt Roper
Graphics Software Engineer
Linux GPU Platform Enablement
Intel Corporation

Re: [PATCH v6 11/11] drm/xe: Sample ctx timestamp to determine if jobs have timed out

[Matt Roper]

On Wed, Aug 28, 2024 at 12:23:01PM -0700, Matt Roper wrote:
> On Tue, Jun 11, 2024 at 07:40:53AM -0700, Matthew Brost wrote:
> > In GuC TDR sample ctx timestamp to determine if jobs have timed out. The
> > scheduling enable needs to be toggled to properly sample the timestamp.
> > If a job has not been running for longer than the timeout period,
> > re-enable scheduling and restart the TDR.
> > 
> > v2:
> >  - Use GT clock to msec helper (Umesh, off list)
> >  - s/ctx_timestamp_job/ctx_job_timestamp
> > v3:
> >  - Fix state machine for TDR, mainly decouple sched disable and
> >    deregister (testing)
> >  - Rebase (CI)
> > v4:
> >  - Fix checkpatch && newline issue (CI)
> >  - Do not deregister on wedged or unregistered (CI)
> >  - Fix refcounting bugs (CI)
> >  - Move devcoredump above VM / kernel job check (John H)
> >  - Add comment for check_timeout state usage (John H)
> >  - Assert pending disable not inflight when enabling scheduling (John H)
> >  - Use enable_scheduling in other scheduling enable code (John H)
> >  - Add comments on a few steps in TDR (John H)
> >  - Add assert for timestamp overflow protection (John H)
> > v6:
> >  - Use mul_u64_u32_div (CI, checkpath)
> >  - Change check time to dbg level (Paulo)
> >  - Add immediate mode to sched disable (inspection)
> >  - Use xe_gt_* messages (John H)
> >  - Fix typo in comment (John H)
> >  - Check timeout before clearing pending disable (Paulo)
> > 
> > Signed-off-by: Matthew Brost <matthew.brost@intel.com>
> > Reviewed-by: Jonathan Cavitt <jonathan.cavitt@intel.com>
> > ---
> >  drivers/gpu/drm/xe/xe_guc_submit.c | 303 +++++++++++++++++++++++------
> >  1 file changed, 242 insertions(+), 61 deletions(-)
> > 
> > diff --git a/drivers/gpu/drm/xe/xe_guc_submit.c b/drivers/gpu/drm/xe/xe_guc_submit.c
> > index 671c72caf0ff..cddb391888b6 100644
> > --- a/drivers/gpu/drm/xe/xe_guc_submit.c
> > +++ b/drivers/gpu/drm/xe/xe_guc_submit.c
> > @@ -10,6 +10,7 @@
> >  #include <linux/circ_buf.h>
> >  #include <linux/delay.h>
> >  #include <linux/dma-fence-array.h>
> > +#include <linux/math64.h>
> >  
> >  #include <drm/drm_managed.h>
> >  
> > @@ -23,6 +24,7 @@
> >  #include "xe_force_wake.h"
> >  #include "xe_gpu_scheduler.h"
> >  #include "xe_gt.h"
> > +#include "xe_gt_clock.h"
> >  #include "xe_gt_printk.h"
> >  #include "xe_guc.h"
> >  #include "xe_guc_ct.h"
> > @@ -62,6 +64,8 @@ exec_queue_to_guc(struct xe_exec_queue *q)
> >  #define EXEC_QUEUE_STATE_KILLED			(1 << 7)
> >  #define EXEC_QUEUE_STATE_WEDGED			(1 << 8)
> >  #define EXEC_QUEUE_STATE_BANNED			(1 << 9)
> > +#define EXEC_QUEUE_STATE_CHECK_TIMEOUT		(1 << 10)
> > +#define EXEC_QUEUE_STATE_EXTRA_REF		(1 << 11)
> >  
> >  static bool exec_queue_registered(struct xe_exec_queue *q)
> >  {
> > @@ -188,6 +192,31 @@ static void set_exec_queue_wedged(struct xe_exec_queue *q)
> >  	atomic_or(EXEC_QUEUE_STATE_WEDGED, &q->guc->state);
> >  }
> >  
> > +static bool exec_queue_check_timeout(struct xe_exec_queue *q)
> > +{
> > +	return atomic_read(&q->guc->state) & EXEC_QUEUE_STATE_CHECK_TIMEOUT;
> > +}
> > +
> > +static void set_exec_queue_check_timeout(struct xe_exec_queue *q)
> > +{
> > +	atomic_or(EXEC_QUEUE_STATE_CHECK_TIMEOUT, &q->guc->state);
> > +}
> > +
> > +static void clear_exec_queue_check_timeout(struct xe_exec_queue *q)
> > +{
> > +	atomic_and(~EXEC_QUEUE_STATE_CHECK_TIMEOUT, &q->guc->state);
> > +}
> > +
> > +static bool exec_queue_extra_ref(struct xe_exec_queue *q)
> > +{
> > +	return atomic_read(&q->guc->state) & EXEC_QUEUE_STATE_EXTRA_REF;
> > +}
> > +
> > +static void set_exec_queue_extra_ref(struct xe_exec_queue *q)
> > +{
> > +	atomic_or(EXEC_QUEUE_STATE_EXTRA_REF, &q->guc->state);
> > +}
> > +
> >  static bool exec_queue_killed_or_banned_or_wedged(struct xe_exec_queue *q)
> >  {
> >  	return (atomic_read(&q->guc->state) &
> > @@ -920,6 +949,109 @@ static void xe_guc_exec_queue_lr_cleanup(struct work_struct *w)
> >  	xe_sched_submission_start(sched);
> >  }
> >  
> > +#define ADJUST_FIVE_PERCENT(__t)	mul_u64_u32_div((__t), 105, 100)
> > +
> > +static bool check_timeout(struct xe_exec_queue *q, struct xe_sched_job *job)
> > +{
> > +	struct xe_gt *gt = guc_to_gt(exec_queue_to_guc(q));
> > +	u32 ctx_timestamp = xe_lrc_ctx_timestamp(q->lrc[0]);
> > +	u32 ctx_job_timestamp = xe_lrc_ctx_job_timestamp(q->lrc[0]);
> > +	u32 timeout_ms = q->sched_props.job_timeout_ms;
> > +	u32 diff;
> > +	u64 running_time_ms;
> > +
> > +	/*
> > +	 * Counter wraps at ~223s at the usual 19.2MHz, be paranoid catch
> > +	 * possible overflows with a high timeout.
> > +	 */
> > +	xe_gt_assert(gt, timeout_ms < 100 * MSEC_PER_SEC);
> > +
> > +	if (ctx_timestamp < ctx_job_timestamp)
> > +		diff = ctx_timestamp + U32_MAX - ctx_job_timestamp;
> > +	else
> > +		diff = ctx_timestamp - ctx_job_timestamp;
> 
> Just noticed this while looking through the code...what is this if/else
> supposed to do?  It looks like it's trying to detect when ctx_timestamp
> has gone past U32_MAX and wrapped around while ctx_job_timestamp hasn't
> yet.  But even if that's happened it doesn't seem like it's doing
> anything meaningful either; I think the u32 subtraction works out the
> same way regardless of whether or not there's a wraparound, and since
> all the variables involved here are u32, adding U32_MAX is effectively
> the same as just subtracting 1 from the final result, which doesn't seem
> to actually do anything important for the rest of the logic in this
> function?
> 
> It's also worth noting that starting with Xe2, CTX_TIMESTAMP is now a
> 64-bit register rather than 32-bits.  For the short timeouts we're
> dealing with in this function is probably doesn't matter, but to prevent
> future mistakes elsewhere in the driver we may want to think about
> updating xe_lrc_ctx_timestamp() and such to return u64's and actually
> fill both dwords when running on a platform that has the larger
> timestamp.

Ping; going back through my emails and I don't think I saw a response
here.


Matt

> 
> 
> Matt
> 
> > +
> > +	/*
> > +	 * Ensure timeout is within 5% to account for an GuC scheduling latency
> > +	 */
> > +	running_time_ms =
> > +		ADJUST_FIVE_PERCENT(xe_gt_clock_interval_to_ms(gt, diff));
> > +
> > +	xe_gt_dbg(gt,
> > +		  "Check job timeout: seqno=%u, lrc_seqno=%u, guc_id=%d, running_time_ms=%llu, timeout_ms=%u, diff=0x%08x",
> > +		  xe_sched_job_seqno(job), xe_sched_job_lrc_seqno(job),
> > +		  q->guc->id, running_time_ms, timeout_ms, diff);
> > +
> > +	return running_time_ms >= timeout_ms;
> > +}
> > +
> > +static void enable_scheduling(struct xe_exec_queue *q)
> > +{
> > +	MAKE_SCHED_CONTEXT_ACTION(q, ENABLE);
> > +	struct xe_guc *guc = exec_queue_to_guc(q);
> > +	int ret;
> > +
> > +	xe_gt_assert(guc_to_gt(guc), !exec_queue_destroyed(q));
> > +	xe_gt_assert(guc_to_gt(guc), exec_queue_registered(q));
> > +	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_disable(q));
> > +	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_enable(q));
> > +
> > +	set_exec_queue_pending_enable(q);
> > +	set_exec_queue_enabled(q);
> > +	trace_xe_exec_queue_scheduling_enable(q);
> > +
> > +	xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
> > +		       G2H_LEN_DW_SCHED_CONTEXT_MODE_SET, 1);
> > +
> > +	ret = wait_event_timeout(guc->ct.wq,
> > +				 !exec_queue_pending_enable(q) ||
> > +				 guc_read_stopped(guc), HZ * 5);
> > +	if (!ret || guc_read_stopped(guc)) {
> > +		xe_gt_warn(guc_to_gt(guc), "Schedule enable failed to respond");
> > +		set_exec_queue_banned(q);
> > +		xe_gt_reset_async(q->gt);
> > +		xe_sched_tdr_queue_imm(&q->guc->sched);
> > +	}
> > +}
> > +
> > +static void disable_scheduling(struct xe_exec_queue *q, bool immediate)
> > +{
> > +	MAKE_SCHED_CONTEXT_ACTION(q, DISABLE);
> > +	struct xe_guc *guc = exec_queue_to_guc(q);
> > +
> > +	xe_gt_assert(guc_to_gt(guc), !exec_queue_destroyed(q));
> > +	xe_gt_assert(guc_to_gt(guc), exec_queue_registered(q));
> > +	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_disable(q));
> > +
> > +	if (immediate)
> > +		set_min_preemption_timeout(guc, q);
> > +	clear_exec_queue_enabled(q);
> > +	set_exec_queue_pending_disable(q);
> > +	trace_xe_exec_queue_scheduling_disable(q);
> > +
> > +	xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
> > +		       G2H_LEN_DW_SCHED_CONTEXT_MODE_SET, 1);
> > +}
> > +
> > +static void __deregister_exec_queue(struct xe_guc *guc, struct xe_exec_queue *q)
> > +{
> > +	u32 action[] = {
> > +		XE_GUC_ACTION_DEREGISTER_CONTEXT,
> > +		q->guc->id,
> > +	};
> > +
> > +	xe_gt_assert(guc_to_gt(guc), !exec_queue_destroyed(q));
> > +	xe_gt_assert(guc_to_gt(guc), exec_queue_registered(q));
> > +	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_enable(q));
> > +	xe_gt_assert(guc_to_gt(guc), !exec_queue_pending_disable(q));
> > +
> > +	set_exec_queue_destroyed(q);
> > +	trace_xe_exec_queue_deregister(q);
> > +
> > +	xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
> > +		       G2H_LEN_DW_DEREGISTER_CONTEXT, 1);
> > +}
> > +
> >  static enum drm_gpu_sched_stat
> >  guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
> >  {
> > @@ -927,10 +1059,10 @@ guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
> >  	struct xe_sched_job *tmp_job;
> >  	struct xe_exec_queue *q = job->q;
> >  	struct xe_gpu_scheduler *sched = &q->guc->sched;
> > -	struct xe_device *xe = guc_to_xe(exec_queue_to_guc(q));
> > +	struct xe_guc *guc = exec_queue_to_guc(q);
> >  	int err = -ETIME;
> >  	int i = 0;
> > -	bool wedged;
> > +	bool wedged, skip_timeout_check;
> >  
> >  	/*
> >  	 * TDR has fired before free job worker. Common if exec queue
> > @@ -942,49 +1074,53 @@ guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
> >  		return DRM_GPU_SCHED_STAT_NOMINAL;
> >  	}
> >  
> > -	drm_notice(&xe->drm, "Timedout job: seqno=%u, lrc_seqno=%u, guc_id=%d, flags=0x%lx",
> > -		   xe_sched_job_seqno(job), xe_sched_job_lrc_seqno(job),
> > -		   q->guc->id, q->flags);
> > -	xe_gt_WARN(q->gt, q->flags & EXEC_QUEUE_FLAG_KERNEL,
> > -		   "Kernel-submitted job timed out\n");
> > -	xe_gt_WARN(q->gt, q->flags & EXEC_QUEUE_FLAG_VM && !exec_queue_killed(q),
> > -		   "VM job timed out on non-killed execqueue\n");
> > -
> > -	if (!exec_queue_killed(q))
> > -		xe_devcoredump(job);
> > -
> > -	trace_xe_sched_job_timedout(job);
> > -
> > -	wedged = guc_submit_hint_wedged(exec_queue_to_guc(q));
> > -
> >  	/* Kill the run_job entry point */
> >  	xe_sched_submission_stop(sched);
> >  
> > +	/* Must check all state after stopping scheduler */
> > +	skip_timeout_check = exec_queue_reset(q) ||
> > +		exec_queue_killed_or_banned_or_wedged(q) ||
> > +		exec_queue_destroyed(q);
> > +
> > +	/* Job hasn't started, can't be timed out */
> > +	if (!skip_timeout_check && !xe_sched_job_started(job))
> > +		goto rearm;
> > +
> >  	/*
> > -	 * Kernel jobs should never fail, nor should VM jobs if they do
> > -	 * somethings has gone wrong and the GT needs a reset
> > +	 * XXX: Sampling timeout doesn't work in wedged mode as we have to
> > +	 * modify scheduling state to read timestamp. We could read the
> > +	 * timestamp from a register to accumulate current running time but this
> > +	 * doesn't work for SRIOV. For now assuming timeouts in wedged mode are
> > +	 * genuine timeouts.
> >  	 */
> > -	if (!wedged && (q->flags & EXEC_QUEUE_FLAG_KERNEL ||
> > -			(q->flags & EXEC_QUEUE_FLAG_VM && !exec_queue_killed(q)))) {
> > -		if (!xe_sched_invalidate_job(job, 2)) {
> > -			xe_sched_add_pending_job(sched, job);
> > -			xe_sched_submission_start(sched);
> > -			xe_gt_reset_async(q->gt);
> > -			goto out;
> > -		}
> > -	}
> > +	wedged = guc_submit_hint_wedged(exec_queue_to_guc(q));
> >  
> > -	/* Engine state now stable, disable scheduling if needed */
> > +	/* Engine state now stable, disable scheduling to check timestamp */
> >  	if (!wedged && exec_queue_registered(q)) {
> > -		struct xe_guc *guc = exec_queue_to_guc(q);
> >  		int ret;
> >  
> >  		if (exec_queue_reset(q))
> >  			err = -EIO;
> > -		set_exec_queue_banned(q);
> > +
> >  		if (!exec_queue_destroyed(q)) {
> > -			xe_exec_queue_get(q);
> > -			disable_scheduling_deregister(guc, q);
> > +			/*
> > +			 * Wait for any pending G2H to flush out before
> > +			 * modifying state
> > +			 */
> > +			ret = wait_event_timeout(guc->ct.wq,
> > +						 !exec_queue_pending_enable(q) ||
> > +						 guc_read_stopped(guc), HZ * 5);
> > +			if (!ret || guc_read_stopped(guc))
> > +				goto trigger_reset;
> > +
> > +			/*
> > +			 * Flag communicates to G2H handler that schedule
> > +			 * disable originated from a timeout check. The G2H then
> > +			 * avoid triggering cleanup or deregistering the exec
> > +			 * queue.
> > +			 */
> > +			set_exec_queue_check_timeout(q);
> > +			disable_scheduling(q, skip_timeout_check);
> >  		}
> >  
> >  		/*
> > @@ -1000,15 +1136,60 @@ guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
> >  					 !exec_queue_pending_disable(q) ||
> >  					 guc_read_stopped(guc), HZ * 5);
> >  		if (!ret || guc_read_stopped(guc)) {
> > -			drm_warn(&xe->drm, "Schedule disable failed to respond");
> > -			xe_sched_add_pending_job(sched, job);
> > -			xe_sched_submission_start(sched);
> > +trigger_reset:
> > +			xe_gt_warn(guc_to_gt(guc), "Schedule disable failed to respond");
> > +			set_exec_queue_extra_ref(q);
> > +			xe_exec_queue_get(q);	/* GT reset owns this */
> > +			set_exec_queue_banned(q);
> >  			xe_gt_reset_async(q->gt);
> >  			xe_sched_tdr_queue_imm(sched);
> > -			goto out;
> > +			goto rearm;
> > +		}
> > +	}
> > +
> > +	/*
> > +	 * Check if job is actually timed out, if so restart job execution and TDR
> > +	 */
> > +	if (!wedged && !skip_timeout_check && !check_timeout(q, job) &&
> > +	    !exec_queue_reset(q) && exec_queue_registered(q)) {
> > +		clear_exec_queue_check_timeout(q);
> > +		goto sched_enable;
> > +	}
> > +
> > +	xe_gt_notice(guc_to_gt(guc), "Timedout job: seqno=%u, lrc_seqno=%u, guc_id=%d, flags=0x%lx",
> > +		     xe_sched_job_seqno(job), xe_sched_job_lrc_seqno(job),
> > +		     q->guc->id, q->flags);
> > +	xe_gt_WARN(q->gt, q->flags & EXEC_QUEUE_FLAG_KERNEL,
> > +		   "Kernel-submitted job timed out\n");
> > +	xe_gt_WARN(q->gt, q->flags & EXEC_QUEUE_FLAG_VM && !exec_queue_killed(q),
> > +		   "VM job timed out on non-killed execqueue\n");
> > +
> > +	trace_xe_sched_job_timedout(job);
> > +
> > +	if (!exec_queue_killed(q))
> > +		xe_devcoredump(job);
> > +
> > +	/*
> > +	 * Kernel jobs should never fail, nor should VM jobs if they do
> > +	 * somethings has gone wrong and the GT needs a reset
> > +	 */
> > +	if (!wedged && (q->flags & EXEC_QUEUE_FLAG_KERNEL ||
> > +			(q->flags & EXEC_QUEUE_FLAG_VM && !exec_queue_killed(q)))) {
> > +		if (!xe_sched_invalidate_job(job, 2)) {
> > +			clear_exec_queue_check_timeout(q);
> > +			xe_gt_reset_async(q->gt);
> > +			goto rearm;
> >  		}
> >  	}
> >  
> > +	/* Finish cleaning up exec queue via deregister */
> > +	set_exec_queue_banned(q);
> > +	if (!wedged && exec_queue_registered(q) && !exec_queue_destroyed(q)) {
> > +		set_exec_queue_extra_ref(q);
> > +		xe_exec_queue_get(q);
> > +		__deregister_exec_queue(guc, q);
> > +	}
> > +
> >  	/* Stop fence signaling */
> >  	xe_hw_fence_irq_stop(q->fence_irq);
> >  
> > @@ -1030,7 +1211,19 @@ guc_exec_queue_timedout_job(struct drm_sched_job *drm_job)
> >  	/* Start fence signaling */
> >  	xe_hw_fence_irq_start(q->fence_irq);
> >  
> > -out:
> > +	return DRM_GPU_SCHED_STAT_NOMINAL;
> > +
> > +sched_enable:
> > +	enable_scheduling(q);
> > +rearm:
> > +	/*
> > +	 * XXX: Ideally want to adjust timeout based on current exection time
> > +	 * but there is not currently an easy way to do in DRM scheduler. With
> > +	 * some thought, do this in a follow up.
> > +	 */
> > +	xe_sched_add_pending_job(sched, job);
> > +	xe_sched_submission_start(sched);
> > +
> >  	return DRM_GPU_SCHED_STAT_NOMINAL;
> >  }
> >  
> > @@ -1133,7 +1326,6 @@ static void __guc_exec_queue_process_msg_suspend(struct xe_sched_msg *msg)
> >  			   guc_read_stopped(guc));
> >  
> >  		if (!guc_read_stopped(guc)) {
> > -			MAKE_SCHED_CONTEXT_ACTION(q, DISABLE);
> >  			s64 since_resume_ms =
> >  				ktime_ms_delta(ktime_get(),
> >  					       q->guc->resume_time);
> > @@ -1144,12 +1336,7 @@ static void __guc_exec_queue_process_msg_suspend(struct xe_sched_msg *msg)
> >  				msleep(wait_ms);
> >  
> >  			set_exec_queue_suspended(q);
> > -			clear_exec_queue_enabled(q);
> > -			set_exec_queue_pending_disable(q);
> > -			trace_xe_exec_queue_scheduling_disable(q);
> > -
> > -			xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
> > -				       G2H_LEN_DW_SCHED_CONTEXT_MODE_SET, 1);
> > +			disable_scheduling(q, false);
> >  		}
> >  	} else if (q->guc->suspend_pending) {
> >  		set_exec_queue_suspended(q);
> > @@ -1160,19 +1347,11 @@ static void __guc_exec_queue_process_msg_suspend(struct xe_sched_msg *msg)
> >  static void __guc_exec_queue_process_msg_resume(struct xe_sched_msg *msg)
> >  {
> >  	struct xe_exec_queue *q = msg->private_data;
> > -	struct xe_guc *guc = exec_queue_to_guc(q);
> >  
> >  	if (guc_exec_queue_allowed_to_change_state(q)) {
> > -		MAKE_SCHED_CONTEXT_ACTION(q, ENABLE);
> > -
> >  		q->guc->resume_time = RESUME_PENDING;
> >  		clear_exec_queue_suspended(q);
> > -		set_exec_queue_pending_enable(q);
> > -		set_exec_queue_enabled(q);
> > -		trace_xe_exec_queue_scheduling_enable(q);
> > -
> > -		xe_guc_ct_send(&guc->ct, action, ARRAY_SIZE(action),
> > -			       G2H_LEN_DW_SCHED_CONTEXT_MODE_SET, 1);
> > +		enable_scheduling(q);
> >  	} else {
> >  		clear_exec_queue_suspended(q);
> >  	}
> > @@ -1434,8 +1613,7 @@ static void guc_exec_queue_stop(struct xe_guc *guc, struct xe_exec_queue *q)
> >  
> >  	/* Clean up lost G2H + reset engine state */
> >  	if (exec_queue_registered(q)) {
> > -		if ((exec_queue_banned(q) && exec_queue_destroyed(q)) ||
> > -		    xe_exec_queue_is_lr(q))
> > +		if (exec_queue_extra_ref(q) || xe_exec_queue_is_lr(q))
> >  			xe_exec_queue_put(q);
> >  		else if (exec_queue_destroyed(q))
> >  			__guc_exec_queue_fini(guc, q);
> > @@ -1612,6 +1790,8 @@ static void handle_sched_done(struct xe_guc *guc, struct xe_exec_queue *q,
> >  		smp_wmb();
> >  		wake_up_all(&guc->ct.wq);
> >  	} else {
> > +		bool check_timeout = exec_queue_check_timeout(q);
> > +
> >  		xe_gt_assert(guc_to_gt(guc), runnable_state == 0);
> >  		xe_gt_assert(guc_to_gt(guc), exec_queue_pending_disable(q));
> >  
> > @@ -1619,11 +1799,12 @@ static void handle_sched_done(struct xe_guc *guc, struct xe_exec_queue *q,
> >  		if (q->guc->suspend_pending) {
> >  			suspend_fence_signal(q);
> >  		} else {
> > -			if (exec_queue_banned(q)) {
> > +			if (exec_queue_banned(q) || check_timeout) {
> >  				smp_wmb();
> >  				wake_up_all(&guc->ct.wq);
> >  			}
> > -			deregister_exec_queue(guc, q);
> > +			if (!check_timeout)
> > +				deregister_exec_queue(guc, q);
> >  		}
> >  	}
> >  }
> > @@ -1664,7 +1845,7 @@ static void handle_deregister_done(struct xe_guc *guc, struct xe_exec_queue *q)
> >  
> >  	clear_exec_queue_registered(q);
> >  
> > -	if (exec_queue_banned(q) || xe_exec_queue_is_lr(q))
> > +	if (exec_queue_extra_ref(q) || xe_exec_queue_is_lr(q))
> >  		xe_exec_queue_put(q);
> >  	else
> >  		__guc_exec_queue_fini(guc, q);
> > @@ -1728,7 +1909,7 @@ int xe_guc_exec_queue_reset_handler(struct xe_guc *guc, u32 *msg, u32 len)
> >  	 * guc_exec_queue_timedout_job.
> >  	 */
> >  	set_exec_queue_reset(q);
> > -	if (!exec_queue_banned(q))
> > +	if (!exec_queue_banned(q) && !exec_queue_check_timeout(q))
> >  		xe_guc_exec_queue_trigger_cleanup(q);
> >  
> >  	return 0;
> > @@ -1758,7 +1939,7 @@ int xe_guc_exec_queue_memory_cat_error_handler(struct xe_guc *guc, u32 *msg,
> >  
> >  	/* Treat the same as engine reset */
> >  	set_exec_queue_reset(q);
> > -	if (!exec_queue_banned(q))
> > +	if (!exec_queue_banned(q) && !exec_queue_check_timeout(q))
> >  		xe_guc_exec_queue_trigger_cleanup(q);
> >  
> >  	return 0;
> > -- 
> > 2.34.1
> > 
> 
> -- 
> Matt Roper
> Graphics Software Engineer
> Linux GPU Platform Enablement
> Intel Corporation

-- 
Matt Roper
Graphics Software Engineer
Linux GPU Platform Enablement
Intel Corporation

✓ CI.Patch_applied: success for Only timeout jobs if they run longer than timeout period

[Patchwork]

== Series Details ==

Series: Only timeout jobs if they run longer than timeout period
URL   : https://patchwork.freedesktop.org/series/134724/
State : success

== Summary ==

=== Applying kernel patches on branch 'drm-tip' with base: ===
Base commit: 950ce28fe0b3 drm-tip: 2024y-06m-11d-15h-22m-31s UTC integration manifest
=== git am output follows ===
Applying: drm/xe: Add LRC ctx timestamp support functions
Applying: drm/xe: Add MI_COPY_MEM_MEM GPU instruction definitions
Applying: drm/xe: Emit ctx timestamp copy in ring ops
Applying: drm/xe: Add ctx timestamp to LRC snapshot
Applying: drm/xe: Add xe_gt_clock_interval_to_ms helper
Applying: drm/xe: Improve unexpected state error messages
Applying: drm/xe: Assert runnable state in handle_sched_done
Applying: drm/xe: Add GuC state asserts to deregister_exec_queue
Applying: drm/xe: Add pending disable assert to handle_sched_done
Applying: drm/xe: Add killed, banned, or wedged as stick bit during GuC reset
Applying: drm/xe: Sample ctx timestamp to determine if jobs have timed out

✗ CI.checkpatch: warning for Only timeout jobs if they run longer than timeout period

[Patchwork]

== Series Details ==

Series: Only timeout jobs if they run longer than timeout period
URL   : https://patchwork.freedesktop.org/series/134724/
State : warning

== Summary ==

+ KERNEL=/kernel
+ git clone https://gitlab.freedesktop.org/drm/maintainer-tools mt
Cloning into 'mt'...
warning: redirecting to https://gitlab.freedesktop.org/drm/maintainer-tools.git/
+ git -C mt rev-list -n1 origin/master
51ce9f6cd981d42d7467409d7dbc559a450abc1e
+ cd /kernel
+ git config --global --add safe.directory /kernel
+ git log -n1
commit 6f782be9b30a16233e9424615c9cd197f2f31ade
Author: Matthew Brost <matthew.brost@intel.com>
Date:   Tue Jun 11 07:40:53 2024 -0700

    drm/xe: Sample ctx timestamp to determine if jobs have timed out
    
    In GuC TDR sample ctx timestamp to determine if jobs have timed out. The
    scheduling enable needs to be toggled to properly sample the timestamp.
    If a job has not been running for longer than the timeout period,
    re-enable scheduling and restart the TDR.
    
    v2:
     - Use GT clock to msec helper (Umesh, off list)
     - s/ctx_timestamp_job/ctx_job_timestamp
    v3:
     - Fix state machine for TDR, mainly decouple sched disable and
       deregister (testing)
     - Rebase (CI)
    v4:
     - Fix checkpatch && newline issue (CI)
     - Do not deregister on wedged or unregistered (CI)
     - Fix refcounting bugs (CI)
     - Move devcoredump above VM / kernel job check (John H)
     - Add comment for check_timeout state usage (John H)
     - Assert pending disable not inflight when enabling scheduling (John H)
     - Use enable_scheduling in other scheduling enable code (John H)
     - Add comments on a few steps in TDR (John H)
     - Add assert for timestamp overflow protection (John H)
    v6:
     - Use mul_u64_u32_div (CI, checkpath)
     - Change check time to dbg level (Paulo)
     - Add immediate mode to sched disable (inspection)
     - Use xe_gt_* messages (John H)
     - Fix typo in comment (John H)
     - Check timeout before clearing pending disable (Paulo)
    
    Signed-off-by: Matthew Brost <matthew.brost@intel.com>
    Reviewed-by: Jonathan Cavitt <jonathan.cavitt@intel.com>
+ /mt/dim checkpatch 950ce28fe0b31a24c5bddcc337aba9554a41cbb3 drm-intel
c1b0c2fc00ae drm/xe: Add LRC ctx timestamp support functions
ac6396d24f9b drm/xe: Add MI_COPY_MEM_MEM GPU instruction definitions
9a936b4770e7 drm/xe: Emit ctx timestamp copy in ring ops
1d2489ac72db drm/xe: Add ctx timestamp to LRC snapshot
bbadb45fbac3 drm/xe: Add xe_gt_clock_interval_to_ms helper
eaeda6e8ec2e drm/xe: Improve unexpected state error messages
d89857d4b955 drm/xe: Assert runnable state in handle_sched_done
a223c956174b drm/xe: Add GuC state asserts to deregister_exec_queue
6b7e6b1e228d drm/xe: Add pending disable assert to handle_sched_done
93749ae0414b drm/xe: Add killed, banned, or wedged as stick bit during GuC reset
6f782be9b30a drm/xe: Sample ctx timestamp to determine if jobs have timed out
-:105: CHECK:SPACING: No space is necessary after a cast
#105: FILE: drivers/gpu/drm/xe/xe_guc_submit.c:952:
+#define ADJUST_FIVE_PERCENT(__t)	mul_u64_u32_div((__t), 105, 100)

total: 0 errors, 0 warnings, 1 checks, 437 lines checked

✓ CI.KUnit: success for Only timeout jobs if they run longer than timeout period

[Patchwork]

== Series Details ==

Series: Only timeout jobs if they run longer than timeout period
URL   : https://patchwork.freedesktop.org/series/134724/
State : success

== Summary ==

+ trap cleanup EXIT
+ /kernel/tools/testing/kunit/kunit.py run --kunitconfig /kernel/drivers/gpu/drm/xe/.kunitconfig
[15:42:25] Configuring KUnit Kernel ...
Generating .config ...
Populating config with:
$ make ARCH=um O=.kunit olddefconfig
[15:42:31] Building KUnit Kernel ...
Populating config with:
$ make ARCH=um O=.kunit olddefconfig
Building with:
$ make ARCH=um O=.kunit --jobs=48
../lib/iomap.c:156:5: warning: no previous prototype for ‘ioread64_lo_hi’ [-Wmissing-prototypes]
  156 | u64 ioread64_lo_hi(const void __iomem *addr)
      |     ^~~~~~~~~~~~~~
../lib/iomap.c:163:5: warning: no previous prototype for ‘ioread64_hi_lo’ [-Wmissing-prototypes]
  163 | u64 ioread64_hi_lo(const void __iomem *addr)
      |     ^~~~~~~~~~~~~~
../lib/iomap.c:170:5: warning: no previous prototype for ‘ioread64be_lo_hi’ [-Wmissing-prototypes]
  170 | u64 ioread64be_lo_hi(const void __iomem *addr)
      |     ^~~~~~~~~~~~~~~~
../lib/iomap.c:178:5: warning: no previous prototype for ‘ioread64be_hi_lo’ [-Wmissing-prototypes]
  178 | u64 ioread64be_hi_lo(const void __iomem *addr)
      |     ^~~~~~~~~~~~~~~~
../lib/iomap.c:264:6: warning: no previous prototype for ‘iowrite64_lo_hi’ [-Wmissing-prototypes]
  264 | void iowrite64_lo_hi(u64 val, void __iomem *addr)
      |      ^~~~~~~~~~~~~~~
../lib/iomap.c:272:6: warning: no previous prototype for ‘iowrite64_hi_lo’ [-Wmissing-prototypes]
  272 | void iowrite64_hi_lo(u64 val, void __iomem *addr)
      |      ^~~~~~~~~~~~~~~
../lib/iomap.c:280:6: warning: no previous prototype for ‘iowrite64be_lo_hi’ [-Wmissing-prototypes]
  280 | void iowrite64be_lo_hi(u64 val, void __iomem *addr)
      |      ^~~~~~~~~~~~~~~~~
../lib/iomap.c:288:6: warning: no previous prototype for ‘iowrite64be_hi_lo’ [-Wmissing-prototypes]
  288 | void iowrite64be_hi_lo(u64 val, void __iomem *addr)
      |      ^~~~~~~~~~~~~~~~~

[15:42:56] Starting KUnit Kernel (1/1)...
[15:42:56] ============================================================
Running tests with:
$ .kunit/linux kunit.enable=1 mem=1G console=tty kunit_shutdown=halt
[15:42:57] =================== guc_dbm (7 subtests) ===================
[15:42:57] [PASSED] test_empty
[15:42:57] [PASSED] test_default
[15:42:57] ======================== test_size  ========================
[15:42:57] [PASSED] 4
[15:42:57] [PASSED] 8
[15:42:57] [PASSED] 32
[15:42:57] [PASSED] 256
[15:42:57] ==================== [PASSED] test_size ====================
[15:42:57] ======================= test_reuse  ========================
[15:42:57] [PASSED] 4
[15:42:57] [PASSED] 8
[15:42:57] [PASSED] 32
[15:42:57] [PASSED] 256
[15:42:57] =================== [PASSED] test_reuse ====================
[15:42:57] =================== test_range_overlap  ====================
[15:42:57] [PASSED] 4
[15:42:57] [PASSED] 8
[15:42:57] [PASSED] 32
[15:42:57] [PASSED] 256
[15:42:57] =============== [PASSED] test_range_overlap ================
[15:42:57] =================== test_range_compact  ====================
[15:42:57] [PASSED] 4
[15:42:57] [PASSED] 8
[15:42:57] [PASSED] 32
[15:42:57] [PASSED] 256
[15:42:57] =============== [PASSED] test_range_compact ================
[15:42:57] ==================== test_range_spare  =====================
[15:42:57] [PASSED] 4
[15:42:57] [PASSED] 8
[15:42:57] [PASSED] 32
[15:42:57] [PASSED] 256
[15:42:57] ================ [PASSED] test_range_spare =================
[15:42:57] ===================== [PASSED] guc_dbm =====================
[15:42:57] =================== guc_idm (6 subtests) ===================
[15:42:57] [PASSED] bad_init
[15:42:57] [PASSED] no_init
[15:42:57] [PASSED] init_fini
[15:42:57] [PASSED] check_used
[15:42:57] [PASSED] check_quota
[15:42:57] [PASSED] check_all
[15:42:57] ===================== [PASSED] guc_idm =====================
[15:42:57] ================== no_relay (3 subtests) ===================
[15:42:57] [PASSED] xe_drops_guc2pf_if_not_ready
[15:42:57] [PASSED] xe_drops_guc2vf_if_not_ready
[15:42:57] [PASSED] xe_rejects_send_if_not_ready
[15:42:57] ==================== [PASSED] no_relay =====================
[15:42:57] ================== pf_relay (14 subtests) ==================
[15:42:57] [PASSED] pf_rejects_guc2pf_too_short
[15:42:57] [PASSED] pf_rejects_guc2pf_too_long
[15:42:57] [PASSED] pf_rejects_guc2pf_no_payload
[15:42:57] [PASSED] pf_fails_no_payload
[15:42:57] [PASSED] pf_fails_bad_origin
[15:42:57] [PASSED] pf_fails_bad_type
[15:42:57] [PASSED] pf_txn_reports_error
[15:42:57] [PASSED] pf_txn_sends_pf2guc
[15:42:57] [PASSED] pf_sends_pf2guc
[15:42:57] [SKIPPED] pf_loopback_nop
[15:42:57] [SKIPPED] pf_loopback_echo
[15:42:57] [SKIPPED] pf_loopback_fail
[15:42:57] [SKIPPED] pf_loopback_busy
[15:42:57] [SKIPPED] pf_loopback_retry
[15:42:57] ==================== [PASSED] pf_relay =====================
[15:42:57] ================== vf_relay (3 subtests) ===================
[15:42:57] [PASSED] vf_rejects_guc2vf_too_short
[15:42:57] [PASSED] vf_rejects_guc2vf_too_long
[15:42:57] [PASSED] vf_rejects_guc2vf_no_payload
[15:42:57] ==================== [PASSED] vf_relay =====================
[15:42:57] ================= pf_service (11 subtests) =================
[15:42:57] [PASSED] pf_negotiate_any
[15:42:57] [PASSED] pf_negotiate_base_match
[15:42:57] [PASSED] pf_negotiate_base_newer
[15:42:57] [PASSED] pf_negotiate_base_next
[15:42:57] [SKIPPED] pf_negotiate_base_older
[15:42:57] [PASSED] pf_negotiate_base_prev
[15:42:57] [PASSED] pf_negotiate_latest_match
[15:42:57] [PASSED] pf_negotiate_latest_newer
[15:42:57] [PASSED] pf_negotiate_latest_next
[15:42:57] [SKIPPED] pf_negotiate_latest_older
[15:42:57] [SKIPPED] pf_negotiate_latest_prev
[15:42:57] =================== [PASSED] pf_service ====================
[15:42:57] ===================== lmtt (1 subtest) =====================
[15:42:57] ======================== test_ops  =========================
[15:42:57] [PASSED] 2-level
[15:42:57] [PASSED] multi-level
[15:42:57] ==================== [PASSED] test_ops =====================
[15:42:57] ====================== [PASSED] lmtt =======================
[15:42:57] ==================== xe_bo (2 subtests) ====================
[15:42:57] [SKIPPED] xe_ccs_migrate_kunit
[15:42:57] [SKIPPED] xe_bo_evict_kunit
[15:42:57] ===================== [SKIPPED] xe_bo ======================
[15:42:57] ================== xe_dma_buf (1 subtest) ==================
[15:42:57] [SKIPPED] xe_dma_buf_kunit
[15:42:57] =================== [SKIPPED] xe_dma_buf ===================
[15:42:57] ================== xe_migrate (1 subtest) ==================
[15:42:57] [SKIPPED] xe_migrate_sanity_kunit
[15:42:57] =================== [SKIPPED] xe_migrate ===================
[15:42:57] =================== xe_mocs (2 subtests) ===================
[15:42:57] [SKIPPED] xe_live_mocs_kernel_kunit
[15:42:57] [SKIPPED] xe_live_mocs_reset_kunit
[15:42:57] ==================== [SKIPPED] xe_mocs =====================
[15:42:57] ==================== args (11 subtests) ====================
[15:42:57] [PASSED] count_args_test
[15:42:57] [PASSED] call_args_example
[15:42:57] [PASSED] call_args_test
[15:42:57] [PASSED] drop_first_arg_example
[15:42:57] [PASSED] drop_first_arg_test
[15:42:57] [PASSED] first_arg_example
[15:42:57] [PASSED] first_arg_test
[15:42:57] [PASSED] last_arg_example
[15:42:57] [PASSED] last_arg_test
[15:42:57] [PASSED] pick_arg_example
[15:42:57] [PASSED] sep_comma_example
[15:42:57] ====================== [PASSED] args =======================
[15:42:57] =================== xe_pci (2 subtests) ====================
[15:42:57] [PASSED] xe_gmdid_graphics_ip
[15:42:57] [PASSED] xe_gmdid_media_ip
[15:42:57] ===================== [PASSED] xe_pci ======================
[15:42:57] ==================== xe_rtp (1 subtest) ====================
[15:42:57] ================== xe_rtp_process_tests  ===================
[15:42:57] [PASSED] coalesce-same-reg
[15:42:57] [PASSED] no-match-no-add
[15:42:57] [PASSED] no-match-no-add-multiple-rules
[15:42:57] [PASSED] two-regs-two-entries
[15:42:57] [PASSED] clr-one-set-other
[15:42:57] [PASSED] set-field
[15:42:57] [PASSED] conflict-duplicate
[15:42:57] [PASSED] conflict-not-disjoint
[15:42:57] [PASSED] conflict-reg-type
[15:42:57] ============== [PASSED] xe_rtp_process_tests ===============
stty: 'standard input': Inappropriate ioctl for device
[15:42:57] ===================== [PASSED] xe_rtp ======================
[15:42:57] ==================== xe_wa (1 subtest) =====================
[15:42:57] ======================== xe_wa_gt  =========================
[15:42:57] [PASSED] TIGERLAKE (B0)
[15:42:57] [PASSED] DG1 (A0)
[15:42:57] [PASSED] DG1 (B0)
[15:42:57] [PASSED] ALDERLAKE_S (A0)
[15:42:57] [PASSED] ALDERLAKE_S (B0)
[15:42:57] [PASSED] ALDERLAKE_S (C0)
[15:42:57] [PASSED] ALDERLAKE_S (D0)
[15:42:57] [PASSED] ALDERLAKE_P (A0)
[15:42:57] [PASSED] ALDERLAKE_P (B0)
[15:42:57] [PASSED] ALDERLAKE_P (C0)
[15:42:57] [PASSED] ALDERLAKE_S_RPLS (D0)
[15:42:57] [PASSED] ALDERLAKE_P_RPLU (E0)
[15:42:57] [PASSED] DG2_G10 (C0)
[15:42:57] [PASSED] DG2_G11 (B1)
[15:42:57] [PASSED] DG2_G12 (A1)
[15:42:57] [PASSED] METEORLAKE (g:A0, m:A0)
[15:42:57] [PASSED] METEORLAKE (g:A0, m:A0)
[15:42:57] [PASSED] METEORLAKE (g:A0, m:A0)
[15:42:57] [PASSED] LUNARLAKE (g:A0, m:A0)
[15:42:57] [PASSED] LUNARLAKE (g:B0, m:A0)
[15:42:57] ==================== [PASSED] xe_wa_gt =====================
[15:42:57] ====================== [PASSED] xe_wa ======================
[15:42:57] ============================================================
[15:42:57] Testing complete. Ran 109 tests: passed: 95, skipped: 14
[15:42:57] Elapsed time: 31.811s total, 5.800s configuring, 25.741s building, 0.224s running

+ /kernel/tools/testing/kunit/kunit.py run --kunitconfig /kernel/drivers/gpu/drm/tests/.kunitconfig
[15:42:57] Configuring KUnit Kernel ...
Regenerating .config ...
Populating config with:
$ make ARCH=um O=.kunit olddefconfig
[15:42:59] Building KUnit Kernel ...
Populating config with:
$ make ARCH=um O=.kunit olddefconfig
Building with:
$ make ARCH=um O=.kunit --jobs=48
../lib/iomap.c:156:5: warning: no previous prototype for ‘ioread64_lo_hi’ [-Wmissing-prototypes]
  156 | u64 ioread64_lo_hi(const void __iomem *addr)
      |     ^~~~~~~~~~~~~~
../lib/iomap.c:163:5: warning: no previous prototype for ‘ioread64_hi_lo’ [-Wmissing-prototypes]
  163 | u64 ioread64_hi_lo(const void __iomem *addr)
      |     ^~~~~~~~~~~~~~
../lib/iomap.c:170:5: warning: no previous prototype for ‘ioread64be_lo_hi’ [-Wmissing-prototypes]
  170 | u64 ioread64be_lo_hi(const void __iomem *addr)
      |     ^~~~~~~~~~~~~~~~
../lib/iomap.c:178:5: warning: no previous prototype for ‘ioread64be_hi_lo’ [-Wmissing-prototypes]
  178 | u64 ioread64be_hi_lo(const void __iomem *addr)
      |     ^~~~~~~~~~~~~~~~
../lib/iomap.c:264:6: warning: no previous prototype for ‘iowrite64_lo_hi’ [-Wmissing-prototypes]
  264 | void iowrite64_lo_hi(u64 val, void __iomem *addr)
      |      ^~~~~~~~~~~~~~~
../lib/iomap.c:272:6: warning: no previous prototype for ‘iowrite64_hi_lo’ [-Wmissing-prototypes]
  272 | void iowrite64_hi_lo(u64 val, void __iomem *addr)
      |      ^~~~~~~~~~~~~~~
../lib/iomap.c:280:6: warning: no previous prototype for ‘iowrite64be_lo_hi’ [-Wmissing-prototypes]
  280 | void iowrite64be_lo_hi(u64 val, void __iomem *addr)
      |      ^~~~~~~~~~~~~~~~~
../lib/iomap.c:288:6: warning: no previous prototype for ‘iowrite64be_hi_lo’ [-Wmissing-prototypes]
  288 | void iowrite64be_hi_lo(u64 val, void __iomem *addr)
      |      ^~~~~~~~~~~~~~~~~

[15:43:21] Starting KUnit Kernel (1/1)...
[15:43:21] ============================================================
Running tests with:
$ .kunit/linux kunit.enable=1 mem=1G console=tty kunit_shutdown=halt
[15:43:21] ============ drm_test_pick_cmdline (2 subtests) ============
[15:43:21] [PASSED] drm_test_pick_cmdline_res_1920_1080_60
[15:43:21] =============== drm_test_pick_cmdline_named  ===============
[15:43:21] [PASSED] NTSC
[15:43:21] [PASSED] NTSC-J
[15:43:21] [PASSED] PAL
[15:43:21] [PASSED] PAL-M
[15:43:21] =========== [PASSED] drm_test_pick_cmdline_named ===========
[15:43:21] ============== [PASSED] drm_test_pick_cmdline ==============
[15:43:21] ================== drm_buddy (7 subtests) ==================
[15:43:21] [PASSED] drm_test_buddy_alloc_limit
[15:43:21] [PASSED] drm_test_buddy_alloc_optimistic
[15:43:21] [PASSED] drm_test_buddy_alloc_pessimistic
[15:43:21] [PASSED] drm_test_buddy_alloc_pathological
[15:43:21] [PASSED] drm_test_buddy_alloc_contiguous
[15:43:21] [PASSED] drm_test_buddy_alloc_clear
[15:43:21] [PASSED] drm_test_buddy_alloc_range_bias
[15:43:21] ==================== [PASSED] drm_buddy ====================
[15:43:21] ============= drm_cmdline_parser (40 subtests) =============
[15:43:21] [PASSED] drm_test_cmdline_force_d_only
[15:43:21] [PASSED] drm_test_cmdline_force_D_only_dvi
[15:43:21] [PASSED] drm_test_cmdline_force_D_only_hdmi
[15:43:21] [PASSED] drm_test_cmdline_force_D_only_not_digital
[15:43:21] [PASSED] drm_test_cmdline_force_e_only
[15:43:21] [PASSED] drm_test_cmdline_res
[15:43:21] [PASSED] drm_test_cmdline_res_vesa
[15:43:21] [PASSED] drm_test_cmdline_res_vesa_rblank
[15:43:21] [PASSED] drm_test_cmdline_res_rblank
[15:43:21] [PASSED] drm_test_cmdline_res_bpp
[15:43:21] [PASSED] drm_test_cmdline_res_refresh
[15:43:21] [PASSED] drm_test_cmdline_res_bpp_refresh
[15:43:21] [PASSED] drm_test_cmdline_res_bpp_refresh_interlaced
[15:43:21] [PASSED] drm_test_cmdline_res_bpp_refresh_margins
[15:43:21] [PASSED] drm_test_cmdline_res_bpp_refresh_force_off
[15:43:21] [PASSED] drm_test_cmdline_res_bpp_refresh_force_on
[15:43:21] [PASSED] drm_test_cmdline_res_bpp_refresh_force_on_analog
[15:43:21] [PASSED] drm_test_cmdline_res_bpp_refresh_force_on_digital
[15:43:21] [PASSED] drm_test_cmdline_res_bpp_refresh_interlaced_margins_force_on
[15:43:21] [PASSED] drm_test_cmdline_res_margins_force_on
[15:43:21] [PASSED] drm_test_cmdline_res_vesa_margins
[15:43:21] [PASSED] drm_test_cmdline_name
[15:43:21] [PASSED] drm_test_cmdline_name_bpp
[15:43:21] [PASSED] drm_test_cmdline_name_option
[15:43:21] [PASSED] drm_test_cmdline_name_bpp_option
[15:43:21] [PASSED] drm_test_cmdline_rotate_0
[15:43:21] [PASSED] drm_test_cmdline_rotate_90
[15:43:21] [PASSED] drm_test_cmdline_rotate_180
[15:43:21] [PASSED] drm_test_cmdline_rotate_270
[15:43:21] [PASSED] drm_test_cmdline_hmirror
[15:43:21] [PASSED] drm_test_cmdline_vmirror
[15:43:21] [PASSED] drm_test_cmdline_margin_options
[15:43:21] [PASSED] drm_test_cmdline_multiple_options
[15:43:21] [PASSED] drm_test_cmdline_bpp_extra_and_option
[15:43:21] [PASSED] drm_test_cmdline_extra_and_option
[15:43:21] [PASSED] drm_test_cmdline_freestanding_options
[15:43:21] [PASSED] drm_test_cmdline_freestanding_force_e_and_options
[15:43:21] [PASSED] drm_test_cmdline_panel_orientation
[15:43:21] ================ drm_test_cmdline_invalid  =================
[15:43:21] [PASSED] margin_only
[15:43:21] [PASSED] interlace_only
[15:43:21] [PASSED] res_missing_x
[15:43:21] [PASSED] res_missing_y
[15:43:21] [PASSED] res_bad_y
[15:43:21] [PASSED] res_missing_y_bpp
[15:43:21] [PASSED] res_bad_bpp
[15:43:21] [PASSED] res_bad_refresh
[15:43:21] [PASSED] res_bpp_refresh_force_on_off
[15:43:21] [PASSED] res_invalid_mode
[15:43:21] [PASSED] res_bpp_wrong_place_mode
[15:43:21] [PASSED] name_bpp_refresh
[15:43:21] [PASSED] name_refresh
[15:43:21] [PASSED] name_refresh_wrong_mode
[15:43:21] [PASSED] name_refresh_invalid_mode
[15:43:21] [PASSED] rotate_multiple
[15:43:21] [PASSED] rotate_invalid_val
[15:43:21] [PASSED] rotate_truncated
[15:43:21] [PASSED] invalid_option
[15:43:21] [PASSED] invalid_tv_option
[15:43:21] [PASSED] truncated_tv_option
[15:43:21] ============ [PASSED] drm_test_cmdline_invalid =============
[15:43:21] =============== drm_test_cmdline_tv_options  ===============
[15:43:21] [PASSED] NTSC
[15:43:21] [PASSED] NTSC_443
[15:43:21] [PASSED] NTSC_J
[15:43:21] [PASSED] PAL
[15:43:21] [PASSED] PAL_M
[15:43:21] [PASSED] PAL_N
[15:43:21] [PASSED] SECAM
[15:43:21] =========== [PASSED] drm_test_cmdline_tv_options ===========
[15:43:21] =============== [PASSED] drm_cmdline_parser ================
[15:43:21] ========== drmm_connector_hdmi_init (19 subtests) ==========
[15:43:21] [PASSED] drm_test_connector_hdmi_init_valid
[15:43:21] [PASSED] drm_test_connector_hdmi_init_bpc_8
[15:43:21] [PASSED] drm_test_connector_hdmi_init_bpc_10
[15:43:21] [PASSED] drm_test_connector_hdmi_init_bpc_12
[15:43:21] [PASSED] drm_test_connector_hdmi_init_bpc_invalid
[15:43:21] [PASSED] drm_test_connector_hdmi_init_bpc_null
[15:43:21] [PASSED] drm_test_connector_hdmi_init_formats_empty
[15:43:21] [PASSED] drm_test_connector_hdmi_init_formats_no_rgb
[15:43:21] [PASSED] drm_test_connector_hdmi_init_null_ddc
[15:43:21] [PASSED] drm_test_connector_hdmi_init_null_product
[15:43:21] [PASSED] drm_test_connector_hdmi_init_null_vendor
[15:43:21] [PASSED] drm_test_connector_hdmi_init_product_length_exact
[15:43:21] [PASSED] drm_test_connector_hdmi_init_product_length_too_long
[15:43:21] [PASSED] drm_test_connector_hdmi_init_product_valid
[15:43:21] [PASSED] drm_test_connector_hdmi_init_vendor_length_exact
[15:43:21] [PASSED] drm_test_connector_hdmi_init_vendor_length_too_long
[15:43:21] [PASSED] drm_test_connector_hdmi_init_vendor_valid
[15:43:21] ========= drm_test_connector_hdmi_init_type_valid  =========
[15:43:21] [PASSED] HDMI-A
[15:43:21] [PASSED] HDMI-B
[15:43:21] ===== [PASSED] drm_test_connector_hdmi_init_type_valid =====
[15:43:21] ======== drm_test_connector_hdmi_init_type_invalid  ========
[15:43:21] [PASSED] Unknown
[15:43:21] [PASSED] VGA
[15:43:21] [PASSED] DVI-I
[15:43:21] [PASSED] DVI-D
[15:43:21] [PASSED] DVI-A
[15:43:21] [PASSED] Composite
[15:43:21] [PASSED] SVIDEO
[15:43:21] [PASSED] LVDS
[15:43:21] [PASSED] Component
[15:43:21] [PASSED] DIN
[15:43:21] [PASSED] DP
[15:43:21] [PASSED] TV
[15:43:21] [PASSED] eDP
[15:43:21] [PASSED] Virtual
[15:43:21] [PASSED] DSI
[15:43:21] [PASSED] DPI
[15:43:21] [PASSED] Writeback
[15:43:21] [PASSED] SPI
[15:43:21] [PASSED] USB
[15:43:21] ==== [PASSED] drm_test_connector_hdmi_init_type_invalid ====
[15:43:21] ============ [PASSED] drmm_connector_hdmi_init =============
[15:43:21] ============= drmm_connector_init (3 subtests) =============
[15:43:21] [PASSED] drm_test_drmm_connector_init
[15:43:21] [PASSED] drm_test_drmm_connector_init_null_ddc
[15:43:21] ========= drm_test_drmm_connector_init_type_valid  =========
[15:43:21] [PASSED] Unknown
[15:43:21] [PASSED] VGA
[15:43:21] [PASSED] DVI-I
[15:43:21] [PASSED] DVI-D
[15:43:21] [PASSED] DVI-A
[15:43:21] [PASSED] Composite
[15:43:21] [PASSED] SVIDEO
[15:43:21] [PASSED] LVDS
[15:43:21] [PASSED] Component
[15:43:21] [PASSED] DIN
[15:43:21] [PASSED] DP
[15:43:21] [PASSED] HDMI-A
[15:43:21] [PASSED] HDMI-B
[15:43:21] [PASSED] TV
[15:43:21] [PASSED] eDP
[15:43:21] [PASSED] Virtual
[15:43:21] [PASSED] DSI
[15:43:21] [PASSED] DPI
[15:43:21] [PASSED] Writeback
[15:43:21] [PASSED] SPI
[15:43:21] [PASSED] USB
[15:43:21] ===== [PASSED] drm_test_drmm_connector_init_type_valid =====
[15:43:21] =============== [PASSED] drmm_connector_init ===============
[15:43:21] = drm_connector_attach_broadcast_rgb_property (2 subtests) =
[15:43:21] [PASSED] drm_test_drm_connector_attach_broadcast_rgb_property
[15:43:21] [PASSED] drm_test_drm_connector_attach_broadcast_rgb_property_hdmi_connector
[15:43:21] === [PASSED] drm_connector_attach_broadcast_rgb_property ===
[15:43:21] ========== drm_get_tv_mode_from_name (2 subtests) ==========
[15:43:21] ========== drm_test_get_tv_mode_from_name_valid  ===========
[15:43:21] [PASSED] NTSC
[15:43:21] [PASSED] NTSC-443
[15:43:21] [PASSED] NTSC-J
[15:43:21] [PASSED] PAL
[15:43:21] [PASSED] PAL-M
[15:43:21] [PASSED] PAL-N
[15:43:21] [PASSED] SECAM
[15:43:21] ====== [PASSED] drm_test_get_tv_mode_from_name_valid =======
[15:43:21] [PASSED] drm_test_get_tv_mode_from_name_truncated
[15:43:21] ============ [PASSED] drm_get_tv_mode_from_name ============
[15:43:21] = drm_test_connector_hdmi_compute_mode_clock (12 subtests) =
[15:43:21] [PASSED] drm_test_drm_hdmi_compute_mode_clock_rgb
[15:43:21] [PASSED] drm_test_drm_hdmi_compute_mode_clock_rgb_10bpc
[15:43:21] [PASSED] drm_test_drm_hdmi_compute_mode_clock_rgb_10bpc_vic_1
[15:43:21] [PASSED] drm_test_drm_hdmi_compute_mode_clock_rgb_12bpc
[15:43:21] [PASSED] drm_test_drm_hdmi_compute_mode_clock_rgb_12bpc_vic_1
[15:43:21] [PASSED] drm_test_drm_hdmi_compute_mode_clock_rgb_double
[15:43:21] = drm_test_connector_hdmi_compute_mode_clock_yuv420_valid  =
[15:43:21] [PASSED] VIC 96
[15:43:21] [PASSED] VIC 97
[15:43:21] [PASSED] VIC 101
[15:43:21] [PASSED] VIC 102
[15:43:21] [PASSED] VIC 106
[15:43:21] [PASSED] VIC 107
[15:43:21] === [PASSED] drm_test_connector_hdmi_compute_mode_clock_yuv420_valid ===
[15:43:21] [PASSED] drm_test_connector_hdmi_compute_mode_clock_yuv420_10_bpc
[15:43:21] [PASSED] drm_test_connector_hdmi_compute_mode_clock_yuv420_12_bpc
[15:43:21] [PASSED] drm_test_connector_hdmi_compute_mode_clock_yuv422_8_bpc
[15:43:21] [PASSED] drm_test_connector_hdmi_compute_mode_clock_yuv422_10_bpc
[15:43:21] [PASSED] drm_test_connector_hdmi_compute_mode_clock_yuv422_12_bpc
[15:43:21] === [PASSED] drm_test_connector_hdmi_compute_mode_clock ====
[15:43:21] == drm_hdmi_connector_get_broadcast_rgb_name (2 subtests) ==
[15:43:21] === drm_test_drm_hdmi_connector_get_broadcast_rgb_name  ====
[15:43:21] [PASSED] Automatic
[15:43:21] [PASSED] Full
[15:43:21] [PASSED] Limited 16:235
[15:43:21] === [PASSED] drm_test_drm_hdmi_connector_get_broadcast_rgb_name ===
[15:43:21] [PASSED] drm_test_drm_hdmi_connector_get_broadcast_rgb_name_invalid
[15:43:21] ==== [PASSED] drm_hdmi_connector_get_broadcast_rgb_name ====
[15:43:21] == drm_hdmi_connector_get_output_format_name (2 subtests) ==
[15:43:21] === drm_test_drm_hdmi_connector_get_output_format_name  ====
[15:43:21] [PASSED] RGB
[15:43:21] [PASSED] YUV 4:2:0
[15:43:21] [PASSED] YUV 4:2:2
[15:43:21] [PASSED] YUV 4:4:4
[15:43:21] === [PASSED] drm_test_drm_hdmi_connector_get_output_format_name ===
[15:43:21] [PASSED] drm_test_drm_hdmi_connector_get_output_format_name_invalid
[15:43:21] ==== [PASSED] drm_hdmi_connector_get_output_format_name ====
[15:43:21] ============= drm_damage_helper (21 subtests) ==============
[15:43:21] [PASSED] drm_test_damage_iter_no_damage
[15:43:21] [PASSED] drm_test_damage_iter_no_damage_fractional_src
[15:43:21] [PASSED] drm_test_damage_iter_no_damage_src_moved
[15:43:21] [PASSED] drm_test_damage_iter_no_damage_fractional_src_moved
[15:43:21] [PASSED] drm_test_damage_iter_no_damage_not_visible
[15:43:21] [PASSED] drm_test_damage_iter_no_damage_no_crtc
[15:43:21] [PASSED] drm_test_damage_iter_no_damage_no_fb
[15:43:21] [PASSED] drm_test_damage_iter_simple_damage
[15:43:21] [PASSED] drm_test_damage_iter_single_damage
[15:43:21] [PASSED] drm_test_damage_iter_single_damage_intersect_src
[15:43:21] [PASSED] drm_test_damage_iter_single_damage_outside_src
[15:43:21] [PASSED] drm_test_damage_iter_single_damage_fractional_src
[15:43:21] [PASSED] drm_test_damage_iter_single_damage_intersect_fractional_src
[15:43:21] [PASSED] drm_test_damage_iter_single_damage_outside_fractional_src
[15:43:21] [PASSED] drm_test_damage_iter_single_damage_src_moved
[15:43:21] [PASSED] drm_test_damage_iter_single_damage_fractional_src_moved
[15:43:21] [PASSED] drm_test_damage_iter_damage
[15:43:21] [PASSED] drm_test_damage_iter_damage_one_intersect
[15:43:21] [PASSED] drm_test_damage_iter_damage_one_outside
[15:43:21] [PASSED] drm_test_damage_iter_damage_src_moved
[15:43:21] [PASSED] drm_test_damage_iter_damage_not_visible
[15:43:21] ================ [PASSED] drm_damage_helper ================
[15:43:21] ============== drm_dp_mst_helper (3 subtests) ==============
[15:43:21] ============== drm_test_dp_mst_calc_pbn_mode  ==============
[15:43:21] [PASSED] Clock 154000 BPP 30 DSC disabled
[15:43:21] [PASSED] Clock 234000 BPP 30 DSC disabled
[15:43:21] [PASSED] Clock 297000 BPP 24 DSC disabled
[15:43:21] [PASSED] Clock 332880 BPP 24 DSC enabled
[15:43:21] [PASSED] Clock 324540 BPP 24 DSC enabled
[15:43:21] ========== [PASSED] drm_test_dp_mst_calc_pbn_mode ==========
[15:43:21] ============== drm_test_dp_mst_calc_pbn_div  ===============
[15:43:21] [PASSED] Link rate 2000000 lane count 4
[15:43:21] [PASSED] Link rate 2000000 lane count 2
[15:43:21] [PASSED] Link rate 2000000 lane count 1
[15:43:21] [PASSED] Link rate 1350000 lane count 4
[15:43:21] [PASSED] Link rate 1350000 lane count 2
[15:43:21] [PASSED] Link rate 1350000 lane count 1
[15:43:21] [PASSED] Link rate 1000000 lane count 4
[15:43:21] [PASSED] Link rate 1000000 lane count 2
[15:43:21] [PASSED] Link rate 1000000 lane count 1
[15:43:21] [PASSED] Link rate 810000 lane count 4
[15:43:21] [PASSED] Link rate 810000 lane count 2
[15:43:21] [PASSED] Link rate 810000 lane count 1
[15:43:21] [PASSED] Link rate 540000 lane count 4
[15:43:21] [PASSED] Link rate 540000 lane count 2
[15:43:21] [PASSED] Link rate 540000 lane count 1
[15:43:21] [PASSED] Link rate 270000 lane count 4
[15:43:21] [PASSED] Link rate 270000 lane count 2
[15:43:21] [PASSED] Link rate 270000 lane count 1
[15:43:21] [PASSED] Link rate 162000 lane count 4
[15:43:21] [PASSED] Link rate 162000 lane count 2
[15:43:21] [PASSED] Link rate 162000 lane count 1
[15:43:21] ========== [PASSED] drm_test_dp_mst_calc_pbn_div ===========
[15:43:21] ========= drm_test_dp_mst_sideband_msg_req_decode  =========
[15:43:21] [PASSED] DP_ENUM_PATH_RESOURCES with port number
[15:43:21] [PASSED] DP_POWER_UP_PHY with port number
[15:43:21] [PASSED] DP_POWER_DOWN_PHY with port number
[15:43:21] [PASSED] DP_ALLOCATE_PAYLOAD with SDP stream sinks
[15:43:21] [PASSED] DP_ALLOCATE_PAYLOAD with port number
[15:43:21] [PASSED] DP_ALLOCATE_PAYLOAD with VCPI
[15:43:21] [PASSED] DP_ALLOCATE_PAYLOAD with PBN
[15:43:21] [PASSED] DP_QUERY_PAYLOAD with port number
[15:43:21] [PASSED] DP_QUERY_PAYLOAD with VCPI
[15:43:21] [PASSED] DP_REMOTE_DPCD_READ with port number
[15:43:21] [PASSED] DP_REMOTE_DPCD_READ with DPCD address
[15:43:21] [PASSED] DP_REMOTE_DPCD_READ with max number of bytes
[15:43:21] [PASSED] DP_REMOTE_DPCD_WRITE with port number
[15:43:21] [PASSED] DP_REMOTE_DPCD_WRITE with DPCD address
[15:43:21] [PASSED] DP_REMOTE_DPCD_WRITE with data array
[15:43:21] [PASSED] DP_REMOTE_I2C_READ with port number
[15:43:21] [PASSED] DP_REMOTE_I2C_READ with I2C device ID
[15:43:21] [PASSED] DP_REMOTE_I2C_READ with transactions array
[15:43:21] [PASSED] DP_REMOTE_I2C_WRITE with port number
[15:43:21] [PASSED] DP_REMOTE_I2C_WRITE with I2C device ID
[15:43:21] [PASSED] DP_REMOTE_I2C_WRITE with data array
[15:43:21] [PASSED] DP_QUERY_STREAM_ENC_STATUS with stream ID
[15:43:21] [PASSED] DP_QUERY_STREAM_ENC_STATUS with client ID
[15:43:21] [PASSED] DP_QUERY_STREAM_ENC_STATUS with stream event
[15:43:21] [PASSED] DP_QUERY_STREAM_ENC_STATUS with valid stream event
[15:43:21] [PASSED] DP_QUERY_STREAM_ENC_STATUS with stream behavior
[15:43:21] [PASSED] DP_QUERY_STREAM_ENC_STATUS with a valid stream behavior
[15:43:21] ===== [PASSED] drm_test_dp_mst_sideband_msg_req_decode =====
[15:43:21] ================ [PASSED] drm_dp_mst_helper ================
[15:43:21] ================== drm_exec (7 subtests) ===================
[15:43:21] [PASSED] sanitycheck
[15:43:21] [PASSED] test_lock
[15:43:21] [PASSED] test_lock_unlock
[15:43:21] [PASSED] test_duplicates
[15:43:21] [PASSED] test_prepare
[15:43:21] [PASSED] test_prepare_array
[15:43:21] [PASSED] test_multiple_loops
[15:43:21] ==================== [PASSED] drm_exec =====================
[15:43:21] =========== drm_format_helper_test (17 subtests) ===========
[15:43:21] ============== drm_test_fb_xrgb8888_to_gray8  ==============
[15:43:21] [PASSED] single_pixel_source_buffer
[15:43:21] [PASSED] single_pixel_clip_rectangle
[15:43:21] [PASSED] well_known_colors
[15:43:21] [PASSED] destination_pitch
[15:43:21] ========== [PASSED] drm_test_fb_xrgb8888_to_gray8 ==========
[15:43:21] ============= drm_test_fb_xrgb8888_to_rgb332  ==============
[15:43:21] [PASSED] single_pixel_source_buffer
[15:43:21] [PASSED] single_pixel_clip_rectangle
[15:43:21] [PASSED] well_known_colors
[15:43:21] [PASSED] destination_pitch
[15:43:21] ========= [PASSED] drm_test_fb_xrgb8888_to_rgb332 ==========
[15:43:21] ============= drm_test_fb_xrgb8888_to_rgb565  ==============
[15:43:21] [PASSED] single_pixel_source_buffer
[15:43:21] [PASSED] single_pixel_clip_rectangle
[15:43:21] [PASSED] well_known_colors
[15:43:21] [PASSED] destination_pitch
[15:43:21] ========= [PASSED] drm_test_fb_xrgb8888_to_rgb565 ==========
[15:43:21] ============ drm_test_fb_xrgb8888_to_xrgb1555  =============
[15:43:21] [PASSED] single_pixel_source_buffer
[15:43:21] [PASSED] single_pixel_clip_rectangle
[15:43:21] [PASSED] well_known_colors
[15:43:21] [PASSED] destination_pitch
[15:43:21] ======== [PASSED] drm_test_fb_xrgb8888_to_xrgb1555 =========
[15:43:21] ============ drm_test_fb_xrgb8888_to_argb1555  =============
[15:43:21] [PASSED] single_pixel_source_buffer
[15:43:21] [PASSED] single_pixel_clip_rectangle
[15:43:21] [PASSED] well_known_colors
[15:43:21] [PASSED] destination_pitch
[15:43:21] ======== [PASSED] drm_test_fb_xrgb8888_to_argb1555 =========
[15:43:21] ============ drm_test_fb_xrgb8888_to_rgba5551  =============
[15:43:21] [PASSED] single_pixel_source_buffer
[15:43:21] [PASSED] single_pixel_clip_rectangle
[15:43:21] [PASSED] well_known_colors
[15:43:21] [PASSED] destination_pitch
[15:43:21] ======== [PASSED] drm_test_fb_xrgb8888_to_rgba5551 =========
[15:43:21] ============= drm_test_fb_xrgb8888_to_rgb888  ==============
[15:43:21] [PASSED] single_pixel_source_buffer
[15:43:21] [PASSED] single_pixel_clip_rectangle
[15:43:21] [PASSED] well_known_colors
[15:43:21] [PASSED] destination_pitch
[15:43:21] ========= [PASSED] drm_test_fb_xrgb8888_to_rgb888 ==========
[15:43:21] ============ drm_test_fb_xrgb8888_to_argb8888  =============
[15:43:21] [PASSED] single_pixel_source_buffer
[15:43:21] [PASSED] single_pixel_clip_rectangle
[15:43:21] [PASSED] well_known_colors
[15:43:21] [PASSED] destination_pitch
[15:43:21] ======== [PASSED] drm_test_fb_xrgb8888_to_argb8888 =========
[15:43:21] =========== drm_test_fb_xrgb8888_to_xrgb2101010  ===========
[15:43:21] [PASSED] single_pixel_source_buffer
[15:43:21] [PASSED] single_pixel_clip_rectangle
[15:43:21] [PASSED] well_known_colors
[15:43:21] [PASSED] destination_pitch
[15:43:21] ======= [PASSED] drm_test_fb_xrgb8888_to_xrgb2101010 =======
[15:43:21] =========== drm_test_fb_xrgb8888_to_argb2101010  ===========
[15:43:21] [PASSED] single_pixel_source_buffer
[15:43:21] [PASSED] single_pixel_clip_rectangle
[15:43:21] [PASSED] well_known_colors
[15:43:21] [PASSED] destination_pitch
[15:43:21] ======= [PASSED] drm_test_fb_xrgb8888_to_argb2101010 =======
[15:43:21] ============== drm_test_fb_xrgb8888_to_mono  ===============
[15:43:21] [PASSED] single_pixel_source_buffer
[15:43:21] [PASSED] single_pixel_clip_rectangle
[15:43:21] [PASSED] well_known_colors
[15:43:21] [PASSED] destination_pitch
[15:43:21] ========== [PASSED] drm_test_fb_xrgb8888_to_mono ===========
[15:43:21] ==================== drm_test_fb_swab  =====================
[15:43:21] [PASSED] single_pixel_source_buffer
[15:43:21] [PASSED] single_pixel_clip_rectangle
[15:43:21] [PASSED] well_known_colors
[15:43:21] [PASSED] destination_pitch
[15:43:21] ================ [PASSED] drm_test_fb_swab =================
[15:43:21] ============ drm_test_fb_xrgb8888_to_xbgr8888  =============
[15:43:21] [PASSED] single_pixel_source_buffer
[15:43:21] [PASSED] single_pixel_clip_rectangle
[15:43:21] [PASSED] well_known_colors
[15:43:21] [PASSED] destination_pitch
[15:43:21] ======== [PASSED] drm_test_fb_xrgb8888_to_xbgr8888 =========
[15:43:21] ============ drm_test_fb_xrgb8888_to_abgr8888  =============
[15:43:21] [PASSED] single_pixel_source_buffer
[15:43:21] [PASSED] single_pixel_clip_rectangle
[15:43:21] [PASSED] well_known_colors
[15:43:21] [PASSED] destination_pitch
[15:43:21] ======== [PASSED] drm_test_fb_xrgb8888_to_abgr8888 =========
[15:43:21] ================= drm_test_fb_clip_offset  =================
[15:43:21] [PASSED] pass through
[15:43:21] [PASSED] horizontal offset
[15:43:21] [PASSED] vertical offset
[15:43:21] [PASSED] horizontal and vertical offset
[15:43:21] [PASSED] horizontal offset (custom pitch)
[15:43:21] [PASSED] vertical offset (custom pitch)
[15:43:21] [PASSED] horizontal and vertical offset (custom pitch)
[15:43:21] ============= [PASSED] drm_test_fb_clip_offset =============
[15:43:21] ============== drm_test_fb_build_fourcc_list  ==============
[15:43:21] [PASSED] no native formats
[15:43:21] [PASSED] XRGB8888 as native format
[15:43:21] [PASSED] remove duplicates
[15:43:21] [PASSED] convert alpha formats
[15:43:21] [PASSED] random formats
[15:43:21] ========== [PASSED] drm_test_fb_build_fourcc_list ==========
[15:43:21] =================== drm_test_fb_memcpy  ====================
[15:43:21] [PASSED] single_pixel_source_buffer: XR24 little-endian (0x34325258)
[15:43:21] [PASSED] single_pixel_source_buffer: XRA8 little-endian (0x38415258)
[15:43:21] [PASSED] single_pixel_source_buffer: YU24 little-endian (0x34325559)
[15:43:21] [PASSED] single_pixel_clip_rectangle: XB24 little-endian (0x34324258)
[15:43:21] [PASSED] single_pixel_clip_rectangle: XRA8 little-endian (0x38415258)
[15:43:21] [PASSED] single_pixel_clip_rectangle: YU24 little-endian (0x34325559)
[15:43:21] [PASSED] well_known_colors: XB24 little-endian (0x34324258)
[15:43:21] [PASSED] well_known_colors: XRA8 little-endian (0x38415258)
[15:43:21] [PASSED] well_known_colors: YU24 little-endian (0x34325559)
[15:43:21] [PASSED] destination_pitch: XB24 little-endian (0x34324258)
[15:43:21] [PASSED] destination_pitch: XRA8 little-endian (0x38415258)
[15:43:21] [PASSED] destination_pitch: YU24 little-endian (0x34325559)
[15:43:21] =============== [PASSED] drm_test_fb_memcpy ================
[15:43:21] ============= [PASSED] drm_format_helper_test ==============
[15:43:21] ================= drm_format (18 subtests) =================
[15:43:21] [PASSED] drm_test_format_block_width_invalid
[15:43:21] [PASSED] drm_test_format_block_width_one_plane
[15:43:21] [PASSED] drm_test_format_block_width_two_plane
[15:43:21] [PASSED] drm_test_format_block_width_three_plane
[15:43:21] [PASSED] drm_test_format_block_width_tiled
[15:43:21] [PASSED] drm_test_format_block_height_invalid
[15:43:21] [PASSED] drm_test_format_block_height_one_plane
[15:43:21] [PASSED] drm_test_format_block_height_two_plane
[15:43:21] [PASSED] drm_test_format_block_height_three_plane
[15:43:21] [PASSED] drm_test_format_block_height_tiled
[15:43:21] [PASSED] drm_test_format_min_pitch_invalid
[15:43:21] [PASSED] drm_test_format_min_pitch_one_plane_8bpp
[15:43:21] [PASSED] drm_test_format_min_pitch_one_plane_16bpp
[15:43:21] [PASSED] drm_test_format_min_pitch_one_plane_24bpp
[15:43:21] [PASSED] drm_test_format_min_pitch_one_plane_32bpp
[15:43:21] [PASSED] drm_test_format_min_pitch_two_plane
[15:43:21] [PASSED] drm_test_format_min_pitch_three_plane_8bpp
[15:43:21] [PASSED] drm_test_format_min_pitch_tiled
[15:43:21] =================== [PASSED] drm_format ====================
[15:43:21] =============== drm_framebuffer (1 subtest) ================
[15:43:21] =============== drm_test_framebuffer_create  ===============
[15:43:21] [PASSED] ABGR8888 normal sizes
[15:43:21] [PASSED] ABGR8888 max sizes
[15:43:21] [PASSED] ABGR8888 pitch greater than min required
[15:43:21] [PASSED] ABGR8888 pitch less than min required
[15:43:21] [PASSED] ABGR8888 Invalid width
[15:43:21] [PASSED] ABGR8888 Invalid buffer handle
[15:43:21] [PASSED] No pixel format
[15:43:21] [PASSED] ABGR8888 Width 0
[15:43:21] [PASSED] ABGR8888 Height 0
[15:43:21] [PASSED] ABGR8888 Out of bound height * pitch combination
[15:43:21] [PASSED] ABGR8888 Large buffer offset
[15:43:21] [PASSED] ABGR8888 Set DRM_MODE_FB_MODIFIERS without modifiers
[15:43:21] [PASSED] ABGR8888 Valid buffer modifier
[15:43:21] [PASSED] ABGR8888 Invalid buffer modifier(DRM_FORMAT_MOD_SAMSUNG_64_32_TILE)
[15:43:21] [PASSED] ABGR8888 Extra pitches without DRM_MODE_FB_MODIFIERS
[15:43:21] [PASSED] ABGR8888 Extra pitches with DRM_MODE_FB_MODIFIERS
[15:43:21] [PASSED] NV12 Normal sizes
[15:43:21] [PASSED] NV12 Max sizes
[15:43:21] [PASSED] NV12 Invalid pitch
[15:43:21] [PASSED] NV12 Invalid modifier/missing DRM_MODE_FB_MODIFIERS flag
[15:43:21] [PASSED] NV12 different  modifier per-plane
[15:43:21] [PASSED] NV12 with DRM_FORMAT_MOD_SAMSUNG_64_32_TILE
[15:43:21] [PASSED] NV12 Valid modifiers without DRM_MODE_FB_MODIFIERS
[15:43:21] [PASSED] NV12 Modifier for inexistent plane
[15:43:21] [PASSED] NV12 Handle for inexistent plane
[15:43:21] [PASSED] NV12 Handle for inexistent plane without DRM_MODE_FB_MODIFIERS
[15:43:21] [PASSED] YVU420 DRM_MODE_FB_MODIFIERS set without modifier
[15:43:21] [PASSED] YVU420 Normal sizes
[15:43:21] [PASSED] YVU420 Max sizes
[15:43:21] [PASSED] YVU420 Invalid pitch
[15:43:21] [PASSED] YVU420 Different pitches
[15:43:21] [PASSED] YVU420 Different buffer offsets/pitches
[15:43:21] [PASSED] YVU420 Modifier set just for plane 0, without DRM_MODE_FB_MODIFIERS
[15:43:21] [PASSED] YVU420 Modifier set just for planes 0, 1, without DRM_MODE_FB_MODIFIERS
[15:43:21] [PASSED] YVU420 Modifier set just for plane 0, 1, with DRM_MODE_FB_MODIFIERS
[15:43:21] [PASSED] YVU420 Valid modifier
[15:43:21] [PASSED] YVU420 Different modifiers per plane
[15:43:21] [PASSED] YVU420 Modifier for inexistent plane
[15:43:21] [PASSED] X0L2 Normal sizes
[15:43:21] [PASSED] X0L2 Max sizes
[15:43:21] [PASSED] X0L2 Invalid pitch
[15:43:21] [PASSED] X0L2 Pitch greater than minimum required
[15:43:21] [PASSED] X0L2 Handle for inexistent plane
[15:43:21] [PASSED] X0L2 Offset for inexistent plane, without DRM_MODE_FB_MODIFIERS set
[15:43:21] [PASSED] X0L2 Modifier without DRM_MODE_FB_MODIFIERS set
[15:43:21] [PASSED] X0L2 Valid modifier
[15:43:21] [PASSED] X0L2 Modifier for inexistent plane
[15:43:21] =========== [PASSED] drm_test_framebuffer_create ===========
[15:43:21] ================= [PASSED] drm_framebuffer =================
[15:43:21] ================ drm_gem_shmem (8 subtests) ================
[15:43:21] [PASSED] drm_gem_shmem_test_obj_create
[15:43:21] [PASSED] drm_gem_shmem_test_obj_create_private
[15:43:21] [PASSED] drm_gem_shmem_test_pin_pages
[15:43:21] [PASSED] drm_gem_shmem_test_vmap
[15:43:21] [PASSED] drm_gem_shmem_test_get_pages_sgt
[15:43:21] [PASSED] drm_gem_shmem_test_get_sg_table
[15:43:21] [PASSED] drm_gem_shmem_test_madvise
[15:43:21] [PASSED] drm_gem_shmem_test_purge
[15:43:21] ================== [PASSED] drm_gem_shmem ==================
[15:43:21] === drm_atomic_helper_connector_hdmi_check (22 subtests) ===
[15:43:21] [PASSED] drm_test_check_broadcast_rgb_auto_cea_mode
[15:43:21] [PASSED] drm_test_check_broadcast_rgb_auto_cea_mode_vic_1
[15:43:21] [PASSED] drm_test_check_broadcast_rgb_full_cea_mode
[15:43:21] [PASSED] drm_test_check_broadcast_rgb_full_cea_mode_vic_1
[15:43:21] [PASSED] drm_test_check_broadcast_rgb_limited_cea_mode
[15:43:21] [PASSED] drm_test_check_broadcast_rgb_limited_cea_mode_vic_1
[15:43:21] [PASSED] drm_test_check_broadcast_rgb_crtc_mode_changed
[15:43:21] [PASSED] drm_test_check_broadcast_rgb_crtc_mode_not_changed
[15:43:21] [PASSED] drm_test_check_hdmi_funcs_reject_rate
[15:43:21] [PASSED] drm_test_check_max_tmds_rate_bpc_fallback
[15:43:21] [PASSED] drm_test_check_max_tmds_rate_format_fallback
[15:43:21] [PASSED] drm_test_check_output_bpc_crtc_mode_changed
[15:43:21] [PASSED] drm_test_check_output_bpc_crtc_mode_not_changed
[15:43:21] [PASSED] drm_test_check_output_bpc_dvi
[15:43:21] [PASSED] drm_test_check_output_bpc_format_vic_1
[15:43:21] [PASSED] drm_test_check_output_bpc_format_display_8bpc_only
[15:43:21] [PASSED] drm_test_check_output_bpc_format_display_rgb_only
[15:43:21] [PASSED] drm_test_check_output_bpc_format_driver_8bpc_only
[15:43:21] [PASSED] drm_test_check_output_bpc_format_driver_rgb_only
[15:43:21] [PASSED] drm_test_check_tmds_char_rate_rgb_8bpc
[15:43:21] [PASSED] drm_test_check_tmds_char_rate_rgb_10bpc
[15:43:21] [PASSED] drm_test_check_tmds_char_rate_rgb_12bpc
[15:43:21] ===== [PASSED] drm_atomic_helper_connector_hdmi_check ======
[15:43:21] === drm_atomic_helper_connector_hdmi_reset (6 subtests) ====
[15:43:21] [PASSED] drm_test_check_broadcast_rgb_value
[15:43:21] [PASSED] drm_test_check_bpc_8_value
[15:43:21] [PASSED] drm_test_check_bpc_10_value
[15:43:21] [PASSED] drm_test_check_bpc_12_value
[15:43:21] [PASSED] drm_test_check_format_value
[15:43:21] [PASSED] drm_test_check_tmds_char_value
[15:43:21] ===== [PASSED] drm_atomic_helper_connector_hdmi_reset ======
[15:43:21] ================= drm_managed (2 subtests) =================
[15:43:21] [PASSED] drm_test_managed_release_action
[15:43:21] [PASSED] drm_test_managed_run_action
[15:43:21] =================== [PASSED] drm_managed ===================
[15:43:21] =================== drm_mm (6 subtests) ====================
[15:43:21] [PASSED] drm_test_mm_init
[15:43:21] [PASSED] drm_test_mm_debug
[15:43:21] [PASSED] drm_test_mm_align32
[15:43:21] [PASSED] drm_test_mm_align64
[15:43:21] [PASSED] drm_test_mm_lowest
[15:43:21] [PASSED] drm_test_mm_highest
[15:43:21] ===================== [PASSED] drm_mm ======================
[15:43:21] ============= drm_modes_analog_tv (4 subtests) =============
[15:43:21] [PASSED] drm_test_modes_analog_tv_ntsc_480i
[15:43:21] [PASSED] drm_test_modes_analog_tv_ntsc_480i_inlined
[15:43:21] [PASSED] drm_test_modes_analog_tv_pal_576i
[15:43:21] [PASSED] drm_test_modes_analog_tv_pal_576i_inlined
[15:43:21] =============== [PASSED] drm_modes_analog_tv ===============
[15:43:21] ============== drm_plane_helper (2 subtests) ===============
[15:43:21] =============== drm_test_check_plane_state  ================
[15:43:21] [PASSED] clipping_simple
[15:43:21] [PASSED] clipping_rotate_reflect
[15:43:21] [PASSED] positioning_simple
[15:43:21] [PASSED] upscaling
[15:43:21] [PASSED] downscaling
[15:43:21] [PASSED] rounding1
[15:43:21] [PASSED] rounding2
[15:43:21] [PASSED] rounding3
[15:43:21] [PASSED] rounding4
[15:43:21] =========== [PASSED] drm_test_check_plane_state ============
[15:43:21] =========== drm_test_check_invalid_plane_state  ============
[15:43:21] [PASSED] positioning_invalid
[15:43:21] [PASSED] upscaling_invalid
[15:43:21] [PASSED] downscaling_invalid
[15:43:21] ======= [PASSED] drm_test_check_invalid_plane_state ========
[15:43:21] ================ [PASSED] drm_plane_helper =================
stty: 'standard input': Inappropriate ioctl for device
[15:43:21] ====== drm_connector_helper_tv_get_modes (1 subtest) =======
[15:43:21] ====== drm_test_connector_helper_tv_get_modes_check  =======
[15:43:21] [PASSED] None
[15:43:21] [PASSED] PAL
[15:43:21] [PASSED] NTSC
[15:43:21] [PASSED] Both, NTSC Default
[15:43:21] [PASSED] Both, PAL Default
[15:43:21] [PASSED] Both, NTSC Default, with PAL on command-line
[15:43:21] [PASSED] Both, PAL Default, with NTSC on command-line
[15:43:21] == [PASSED] drm_test_connector_helper_tv_get_modes_check ===
[15:43:21] ======== [PASSED] drm_connector_helper_tv_get_modes ========
[15:43:21] ================== drm_rect (9 subtests) ===================
[15:43:21] [PASSED] drm_test_rect_clip_scaled_div_by_zero
[15:43:21] [PASSED] drm_test_rect_clip_scaled_not_clipped
[15:43:21] [PASSED] drm_test_rect_clip_scaled_clipped
[15:43:21] [PASSED] drm_test_rect_clip_scaled_signed_vs_unsigned
[15:43:21] ================= drm_test_rect_intersect  =================
[15:43:21] [PASSED] top-left x bottom-right: 2x2+1+1 x 2x2+0+0
[15:43:21] [PASSED] top-right x bottom-left: 2x2+0+0 x 2x2+1-1
[15:43:21] [PASSED] bottom-left x top-right: 2x2+1-1 x 2x2+0+0
[15:43:21] [PASSED] bottom-right x top-left: 2x2+0+0 x 2x2+1+1
[15:43:21] [PASSED] right x left: 2x1+0+0 x 3x1+1+0
[15:43:21] [PASSED] left x right: 3x1+1+0 x 2x1+0+0
[15:43:21] [PASSED] up x bottom: 1x2+0+0 x 1x3+0-1
[15:43:21] [PASSED] bottom x up: 1x3+0-1 x 1x2+0+0
[15:43:21] [PASSED] touching corner: 1x1+0+0 x 2x2+1+1
[15:43:21] [PASSED] touching side: 1x1+0+0 x 1x1+1+0
[15:43:21] [PASSED] equal rects: 2x2+0+0 x 2x2+0+0
[15:43:21] [PASSED] inside another: 2x2+0+0 x 1x1+1+1
[15:43:21] [PASSED] far away: 1x1+0+0 x 1x1+3+6
[15:43:21] [PASSED] points intersecting: 0x0+5+10 x 0x0+5+10
[15:43:21] [PASSED] points not intersecting: 0x0+0+0 x 0x0+5+10
[15:43:21] ============= [PASSED] drm_test_rect_intersect =============
[15:43:21] ================ drm_test_rect_calc_hscale  ================
[15:43:21] [PASSED] normal use
[15:43:21] [PASSED] out of max range
[15:43:21] [PASSED] out of min range
[15:43:21] [PASSED] zero dst
[15:43:21] [PASSED] negative src
[15:43:21] [PASSED] negative dst
[15:43:21] ============ [PASSED] drm_test_rect_calc_hscale ============
[15:43:21] ================ drm_test_rect_calc_vscale  ================
[15:43:21] [PASSED] normal use
[15:43:21] [PASSED] out of max range
[15:43:21] [PASSED] out of min range
[15:43:21] [PASSED] zero dst
[15:43:21] [PASSED] negative src
[15:43:21] [PASSED] negative dst
[15:43:21] ============ [PASSED] drm_test_rect_calc_vscale ============
[15:43:21] ================== drm_test_rect_rotate  ===================
[15:43:21] [PASSED] reflect-x
[15:43:21] [PASSED] reflect-y
[15:43:21] [PASSED] rotate-0
[15:43:21] [PASSED] rotate-90
[15:43:21] [PASSED] rotate-180
[15:43:21] [PASSED] rotate-270
[15:43:21] ============== [PASSED] drm_test_rect_rotate ===============
[15:43:21] ================ drm_test_rect_rotate_inv  =================
[15:43:21] [PASSED] reflect-x
[15:43:21] [PASSED] reflect-y
[15:43:21] [PASSED] rotate-0
[15:43:21] [PASSED] rotate-90
[15:43:21] [PASSED] rotate-180
[15:43:21] [PASSED] rotate-270
[15:43:21] ============ [PASSED] drm_test_rect_rotate_inv =============
[15:43:21] ==================== [PASSED] drm_rect =====================
[15:43:21] ============================================================
[15:43:21] Testing complete. Ran 511 tests: passed: 511
[15:43:21] Elapsed time: 24.327s total, 1.739s configuring, 22.365s building, 0.201s running

+ cleanup
++ stat -c %u:%g /kernel
+ chown -R 1003:1003 /kernel

✓ CI.Build: success for Only timeout jobs if they run longer than timeout period

[Patchwork]

== Series Details ==

Series: Only timeout jobs if they run longer than timeout period
URL   : https://patchwork.freedesktop.org/series/134724/
State : success

== Summary ==

lib/modules/6.10.0-rc3-xe/kernel/sound/core/seq/
lib/modules/6.10.0-rc3-xe/kernel/sound/core/seq/snd-seq.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/core/snd-seq-device.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/core/snd-hwdep.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/core/snd.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/core/snd-pcm.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/core/snd-compress.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/core/snd-timer.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/soundcore.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/intel/
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/intel/atom/
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/intel/atom/snd-soc-sst-atom-hifi2-platform.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/intel/atom/sst/
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/intel/atom/sst/snd-intel-sst-acpi.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/intel/atom/sst/snd-intel-sst-core.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/intel/common/
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/intel/common/snd-soc-acpi-intel-match.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/amd/
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/amd/snd-acp-config.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/sof/
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/sof/intel/
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/sof/intel/snd-sof-pci-intel-tgl.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/sof/intel/snd-sof-intel-hda-mlink.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/sof/intel/snd-sof-pci-intel-cnl.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/sof/intel/snd-sof-pci-intel-lnl.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/sof/intel/snd-sof-intel-hda-common.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/sof/intel/snd-sof-intel-hda-generic.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/sof/intel/snd-sof-intel-hda.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/sof/intel/snd-sof-pci-intel-mtl.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/sof/amd/
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/sof/amd/snd-sof-amd-renoir.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/sof/amd/snd-sof-amd-acp.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/sof/snd-sof-utils.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/sof/snd-sof-pci.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/sof/snd-sof.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/sof/snd-sof-probes.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/sof/xtensa/
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/sof/xtensa/snd-sof-xtensa-dsp.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/snd-soc-core.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/snd-soc-acpi.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/codecs/
lib/modules/6.10.0-rc3-xe/kernel/sound/soc/codecs/snd-soc-hdac-hda.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/hda/
lib/modules/6.10.0-rc3-xe/kernel/sound/hda/snd-intel-sdw-acpi.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/hda/ext/
lib/modules/6.10.0-rc3-xe/kernel/sound/hda/ext/snd-hda-ext-core.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/hda/snd-intel-dspcfg.ko
lib/modules/6.10.0-rc3-xe/kernel/sound/hda/snd-hda-core.ko
lib/modules/6.10.0-rc3-xe/kernel/arch/
lib/modules/6.10.0-rc3-xe/kernel/arch/x86/
lib/modules/6.10.0-rc3-xe/kernel/arch/x86/kernel/
lib/modules/6.10.0-rc3-xe/kernel/arch/x86/kernel/msr.ko
lib/modules/6.10.0-rc3-xe/kernel/arch/x86/kernel/cpuid.ko
lib/modules/6.10.0-rc3-xe/kernel/arch/x86/crypto/
lib/modules/6.10.0-rc3-xe/kernel/arch/x86/crypto/sha512-ssse3.ko
lib/modules/6.10.0-rc3-xe/kernel/arch/x86/crypto/crct10dif-pclmul.ko
lib/modules/6.10.0-rc3-xe/kernel/arch/x86/crypto/ghash-clmulni-intel.ko
lib/modules/6.10.0-rc3-xe/kernel/arch/x86/crypto/sha1-ssse3.ko
lib/modules/6.10.0-rc3-xe/kernel/arch/x86/crypto/crc32-pclmul.ko
lib/modules/6.10.0-rc3-xe/kernel/arch/x86/crypto/sha256-ssse3.ko
lib/modules/6.10.0-rc3-xe/kernel/arch/x86/crypto/aesni-intel.ko
lib/modules/6.10.0-rc3-xe/kernel/arch/x86/crypto/polyval-clmulni.ko
lib/modules/6.10.0-rc3-xe/kernel/arch/x86/events/
lib/modules/6.10.0-rc3-xe/kernel/arch/x86/events/intel/
lib/modules/6.10.0-rc3-xe/kernel/arch/x86/events/intel/intel-cstate.ko
lib/modules/6.10.0-rc3-xe/kernel/arch/x86/events/rapl.ko
lib/modules/6.10.0-rc3-xe/kernel/arch/x86/kvm/
lib/modules/6.10.0-rc3-xe/kernel/arch/x86/kvm/kvm.ko
lib/modules/6.10.0-rc3-xe/kernel/arch/x86/kvm/kvm-intel.ko
lib/modules/6.10.0-rc3-xe/kernel/crypto/
lib/modules/6.10.0-rc3-xe/kernel/crypto/crypto_simd.ko
lib/modules/6.10.0-rc3-xe/kernel/crypto/cmac.ko
lib/modules/6.10.0-rc3-xe/kernel/crypto/ccm.ko
lib/modules/6.10.0-rc3-xe/kernel/crypto/cryptd.ko
lib/modules/6.10.0-rc3-xe/kernel/crypto/polyval-generic.ko
lib/modules/6.10.0-rc3-xe/kernel/crypto/async_tx/
lib/modules/6.10.0-rc3-xe/kernel/crypto/async_tx/async_xor.ko
lib/modules/6.10.0-rc3-xe/kernel/crypto/async_tx/async_tx.ko
lib/modules/6.10.0-rc3-xe/kernel/crypto/async_tx/async_memcpy.ko
lib/modules/6.10.0-rc3-xe/kernel/crypto/async_tx/async_pq.ko
lib/modules/6.10.0-rc3-xe/kernel/crypto/async_tx/async_raid6_recov.ko
lib/modules/6.10.0-rc3-xe/build
lib/modules/6.10.0-rc3-xe/modules.alias.bin
lib/modules/6.10.0-rc3-xe/modules.builtin
lib/modules/6.10.0-rc3-xe/modules.softdep
lib/modules/6.10.0-rc3-xe/modules.alias
lib/modules/6.10.0-rc3-xe/modules.order
lib/modules/6.10.0-rc3-xe/modules.symbols
lib/modules/6.10.0-rc3-xe/modules.dep.bin
+ mv kernel-nodebug.tar.gz ..
+ cd ..
+ rm -rf archive
++ date +%s
^[[0Ksection_end:1718121571:package_x86_64_nodebug
^[[0K
+ echo -e '\e[0Ksection_end:1718121571:package_x86_64_nodebug\r\e[0K'
+ sync
+ cleanup
++ stat -c %u:%g /kernel
+ chown -R 1003:1003 /kernel

✗ CI.Hooks: failure for Only timeout jobs if they run longer than timeout period

[Patchwork]

== Series Details ==

Series: Only timeout jobs if they run longer than timeout period
URL   : https://patchwork.freedesktop.org/series/134724/
State : failure

== Summary ==

run-parts: executing /workspace/ci/hooks/00-showenv
+ export
+ grep -Ei '(^|\W)CI_'
declare -x CI_KERNEL_BUILD_DIR="/workspace/kernel/build64-default"
declare -x CI_KERNEL_SRC_DIR="/workspace/kernel"
declare -x CI_TOOLS_SRC_DIR="/workspace/ci"
declare -x CI_WORKSPACE_DIR="/workspace"
run-parts: executing /workspace/ci/hooks/10-build-W1
+ SRC_DIR=/workspace/kernel
+ RESTORE_DISPLAY_CONFIG=0
+ '[' -n /workspace/kernel/build64-default ']'
+ BUILD_DIR=/workspace/kernel/build64-default
+ cd /workspace/kernel
++ nproc
+ make -j48 O=/workspace/kernel/build64-default modules_prepare
make[1]: Entering directory '/workspace/kernel/build64-default'
  GEN     Makefile
  UPD     include/generated/compile.h
  UPD     include/config/kernel.release
  UPD     include/generated/utsrelease.h
mkdir -p /workspace/kernel/build64-default/tools/objtool && make O=/workspace/kernel/build64-default subdir=tools/objtool --no-print-directory -C objtool 
  HOSTCC  /workspace/kernel/build64-default/tools/objtool/fixdep.o
  CALL    ../scripts/checksyscalls.sh
  HOSTLD  /workspace/kernel/build64-default/tools/objtool/fixdep-in.o
  LINK    /workspace/kernel/build64-default/tools/objtool/fixdep
  INSTALL libsubcmd_headers
  CC      /workspace/kernel/build64-default/tools/objtool/libsubcmd/exec-cmd.o
  CC      /workspace/kernel/build64-default/tools/objtool/libsubcmd/help.o
  CC      /workspace/kernel/build64-default/tools/objtool/libsubcmd/pager.o
  CC      /workspace/kernel/build64-default/tools/objtool/libsubcmd/parse-options.o
  CC      /workspace/kernel/build64-default/tools/objtool/libsubcmd/run-command.o
  CC      /workspace/kernel/build64-default/tools/objtool/libsubcmd/sigchain.o
  CC      /workspace/kernel/build64-default/tools/objtool/libsubcmd/subcmd-config.o
  LD      /workspace/kernel/build64-default/tools/objtool/libsubcmd/libsubcmd-in.o
  AR      /workspace/kernel/build64-default/tools/objtool/libsubcmd/libsubcmd.a
  CC      /workspace/kernel/build64-default/tools/objtool/weak.o
  CC      /workspace/kernel/build64-default/tools/objtool/check.o
  CC      /workspace/kernel/build64-default/tools/objtool/special.o
  CC      /workspace/kernel/build64-default/tools/objtool/builtin-check.o
  CC      /workspace/kernel/build64-default/tools/objtool/elf.o
  CC      /workspace/kernel/build64-default/tools/objtool/objtool.o
  CC      /workspace/kernel/build64-default/tools/objtool/orc_gen.o
  CC      /workspace/kernel/build64-default/tools/objtool/orc_dump.o
  CC      /workspace/kernel/build64-default/tools/objtool/libctype.o
  CC      /workspace/kernel/build64-default/tools/objtool/libstring.o
  CC      /workspace/kernel/build64-default/tools/objtool/str_error_r.o
  CC      /workspace/kernel/build64-default/tools/objtool/librbtree.o
  CC      /workspace/kernel/build64-default/tools/objtool/arch/x86/special.o
  CC      /workspace/kernel/build64-default/tools/objtool/arch/x86/decode.o
  CC      /workspace/kernel/build64-default/tools/objtool/arch/x86/orc.o
  LD      /workspace/kernel/build64-default/tools/objtool/arch/x86/objtool-in.o
  LD      /workspace/kernel/build64-default/tools/objtool/objtool-in.o
  LINK    /workspace/kernel/build64-default/tools/objtool/objtool
make[1]: Leaving directory '/workspace/kernel/build64-default'
++ nproc
+ make -j48 O=/workspace/kernel/build64-default W=1 drivers/gpu/drm/xe
make[1]: Entering directory '/workspace/kernel/build64-default'
make[2]: Nothing to be done for 'drivers/gpu/drm/xe'.
make[1]: Leaving directory '/workspace/kernel/build64-default'
run-parts: executing /workspace/ci/hooks/11-build-32b
+++ realpath /workspace/ci/hooks/11-build-32b
++ dirname /workspace/ci/hooks/11-build-32b
+ THIS_SCRIPT_DIR=/workspace/ci/hooks
+ SRC_DIR=/workspace/kernel
+ TOOLS_SRC_DIR=/workspace/ci
+ '[' -n /workspace/kernel/build64-default ']'
+ BUILD_DIR=/workspace/kernel/build64-default
+ BUILD_DIR=/workspace/kernel/build64-default/build32
+ cd /workspace/kernel
+ mkdir -p /workspace/kernel/build64-default/build32
++ nproc
+ make -j48 ARCH=i386 O=/workspace/kernel/build64-default/build32 defconfig
make[1]: Entering directory '/workspace/kernel/build64-default/build32'
  GEN     Makefile
  HOSTCC  scripts/basic/fixdep
  HOSTCC  scripts/kconfig/conf.o
  HOSTCC  scripts/kconfig/confdata.o
  HOSTCC  scripts/kconfig/expr.o
  LEX     scripts/kconfig/lexer.lex.c
  YACC    scripts/kconfig/parser.tab.[ch]
  HOSTCC  scripts/kconfig/menu.o
  HOSTCC  scripts/kconfig/preprocess.o
  HOSTCC  scripts/kconfig/symbol.o
  HOSTCC  scripts/kconfig/util.o
  HOSTCC  scripts/kconfig/lexer.lex.o
  HOSTCC  scripts/kconfig/parser.tab.o
  HOSTLD  scripts/kconfig/conf
*** Default configuration is based on 'i386_defconfig'
#
# configuration written to .config
#
make[1]: Leaving directory '/workspace/kernel/build64-default/build32'
+ cd /workspace/kernel/build64-default/build32
+ /workspace/kernel/scripts/kconfig/merge_config.sh .config /workspace/ci/kernel/10-xe.fragment
Using .config as base
Merging /workspace/ci/kernel/10-xe.fragment
Value of CONFIG_DRM_XE is redefined by fragment /workspace/ci/kernel/10-xe.fragment:
Previous value: # CONFIG_DRM_XE is not set
New value: CONFIG_DRM_XE=m

Value of CONFIG_SND_DEBUG is redefined by fragment /workspace/ci/kernel/10-xe.fragment:
Previous value: # CONFIG_SND_DEBUG is not set
New value: CONFIG_SND_DEBUG=y

Value of CONFIG_SND_HDA_INTEL is redefined by fragment /workspace/ci/kernel/10-xe.fragment:
Previous value: CONFIG_SND_HDA_INTEL=y
New value: CONFIG_SND_HDA_INTEL=m

Value of CONFIG_SND_HDA_CODEC_HDMI is redefined by fragment /workspace/ci/kernel/10-xe.fragment:
Previous value: # CONFIG_SND_HDA_CODEC_HDMI is not set
New value: CONFIG_SND_HDA_CODEC_HDMI=m

  GEN     Makefile

WARNING: unmet direct dependencies detected for FB_IOMEM_HELPERS
  Depends on [n]: HAS_IOMEM [=y] && FB_CORE [=n]
  Selected by [m]:
  - DRM_XE_DISPLAY [=y] && HAS_IOMEM [=y] && DRM [=y] && DRM_XE [=m] && DRM_XE [=m]=m [=m]
#
# configuration written to .config
#
Value requested for CONFIG_HAVE_UID16 not in final .config
Requested value:  CONFIG_HAVE_UID16=y
Actual value:     

Value requested for CONFIG_UID16 not in final .config
Requested value:  CONFIG_UID16=y
Actual value:     

Value requested for CONFIG_X86_32 not in final .config
Requested value:  CONFIG_X86_32=y
Actual value:     

Value requested for CONFIG_OUTPUT_FORMAT not in final .config
Requested value:  CONFIG_OUTPUT_FORMAT="elf32-i386"
Actual value:     CONFIG_OUTPUT_FORMAT="elf64-x86-64"

Value requested for CONFIG_ARCH_MMAP_RND_BITS_MIN not in final .config
Requested value:  CONFIG_ARCH_MMAP_RND_BITS_MIN=8
Actual value:     CONFIG_ARCH_MMAP_RND_BITS_MIN=28

Value requested for CONFIG_ARCH_MMAP_RND_BITS_MAX not in final .config
Requested value:  CONFIG_ARCH_MMAP_RND_BITS_MAX=16
Actual value:     CONFIG_ARCH_MMAP_RND_BITS_MAX=32

Value requested for CONFIG_PGTABLE_LEVELS not in final .config
Requested value:  CONFIG_PGTABLE_LEVELS=2
Actual value:     CONFIG_PGTABLE_LEVELS=5

Value requested for CONFIG_X86_BIGSMP not in final .config
Requested value:  # CONFIG_X86_BIGSMP is not set
Actual value:     

Value requested for CONFIG_X86_INTEL_QUARK not in final .config
Requested value:  # CONFIG_X86_INTEL_QUARK is not set
Actual value:     

Value requested for CONFIG_X86_RDC321X not in final .config
Requested value:  # CONFIG_X86_RDC321X is not set
Actual value:     

Value requested for CONFIG_X86_32_NON_STANDARD not in final .config
Requested value:  # CONFIG_X86_32_NON_STANDARD is not set
Actual value:     

Value requested for CONFIG_X86_32_IRIS not in final .config
Requested value:  # CONFIG_X86_32_IRIS is not set
Actual value:     

Value requested for CONFIG_M486SX not in final .config
Requested value:  # CONFIG_M486SX is not set
Actual value:     

Value requested for CONFIG_M486 not in final .config
Requested value:  # CONFIG_M486 is not set
Actual value:     

Value requested for CONFIG_M586 not in final .config
Requested value:  # CONFIG_M586 is not set
Actual value:     

Value requested for CONFIG_M586TSC not in final .config
Requested value:  # CONFIG_M586TSC is not set
Actual value:     

Value requested for CONFIG_M586MMX not in final .config
Requested value:  # CONFIG_M586MMX is not set
Actual value:     

Value requested for CONFIG_M686 not in final .config
Requested value:  CONFIG_M686=y
Actual value:     

Value requested for CONFIG_MPENTIUMII not in final .config
Requested value:  # CONFIG_MPENTIUMII is not set
Actual value:     

Value requested for CONFIG_MPENTIUMIII not in final .config
Requested value:  # CONFIG_MPENTIUMIII is not set
Actual value:     

Value requested for CONFIG_MPENTIUMM not in final .config
Requested value:  # CONFIG_MPENTIUMM is not set
Actual value:     

Value requested for CONFIG_MPENTIUM4 not in final .config
Requested value:  # CONFIG_MPENTIUM4 is not set
Actual value:     

Value requested for CONFIG_MK6 not in final .config
Requested value:  # CONFIG_MK6 is not set
Actual value:     

Value requested for CONFIG_MK7 not in final .config
Requested value:  # CONFIG_MK7 is not set
Actual value:     

Value requested for CONFIG_MCRUSOE not in final .config
Requested value:  # CONFIG_MCRUSOE is not set
Actual value:     

Value requested for CONFIG_MEFFICEON not in final .config
Requested value:  # CONFIG_MEFFICEON is not set
Actual value:     

Value requested for CONFIG_MWINCHIPC6 not in final .config
Requested value:  # CONFIG_MWINCHIPC6 is not set
Actual value:     

Value requested for CONFIG_MWINCHIP3D not in final .config
Requested value:  # CONFIG_MWINCHIP3D is not set
Actual value:     

Value requested for CONFIG_MELAN not in final .config
Requested value:  # CONFIG_MELAN is not set
Actual value:     

Value requested for CONFIG_MGEODEGX1 not in final .config
Requested value:  # CONFIG_MGEODEGX1 is not set
Actual value:     

Value requested for CONFIG_MGEODE_LX not in final .config
Requested value:  # CONFIG_MGEODE_LX is not set
Actual value:     

Value requested for CONFIG_MCYRIXIII not in final .config
Requested value:  # CONFIG_MCYRIXIII is not set
Actual value:     

Value requested for CONFIG_MVIAC3_2 not in final .config
Requested value:  # CONFIG_MVIAC3_2 is not set
Actual value:     

Value requested for CONFIG_MVIAC7 not in final .config
Requested value:  # CONFIG_MVIAC7 is not set
Actual value:     

Value requested for CONFIG_X86_GENERIC not in final .config
Requested value:  # CONFIG_X86_GENERIC is not set
Actual value:     

Value requested for CONFIG_X86_INTERNODE_CACHE_SHIFT not in final .config
Requested value:  CONFIG_X86_INTERNODE_CACHE_SHIFT=5
Actual value:     CONFIG_X86_INTERNODE_CACHE_SHIFT=6

Value requested for CONFIG_X86_L1_CACHE_SHIFT not in final .config
Requested value:  CONFIG_X86_L1_CACHE_SHIFT=5
Actual value:     CONFIG_X86_L1_CACHE_SHIFT=6

Value requested for CONFIG_X86_USE_PPRO_CHECKSUM not in final .config
Requested value:  CONFIG_X86_USE_PPRO_CHECKSUM=y
Actual value:     

Value requested for CONFIG_X86_MINIMUM_CPU_FAMILY not in final .config
Requested value:  CONFIG_X86_MINIMUM_CPU_FAMILY=6
Actual value:     CONFIG_X86_MINIMUM_CPU_FAMILY=64

Value requested for CONFIG_CPU_SUP_TRANSMETA_32 not in final .config
Requested value:  CONFIG_CPU_SUP_TRANSMETA_32=y
Actual value:     

Value requested for CONFIG_CPU_SUP_VORTEX_32 not in final .config
Requested value:  CONFIG_CPU_SUP_VORTEX_32=y
Actual value:     

Value requested for CONFIG_HPET_TIMER not in final .config
Requested value:  # CONFIG_HPET_TIMER is not set
Actual value:     CONFIG_HPET_TIMER=y

Value requested for CONFIG_NR_CPUS_RANGE_END not in final .config
Requested value:  CONFIG_NR_CPUS_RANGE_END=8
Actual value:     CONFIG_NR_CPUS_RANGE_END=512

Value requested for CONFIG_NR_CPUS_DEFAULT not in final .config
Requested value:  CONFIG_NR_CPUS_DEFAULT=8
Actual value:     CONFIG_NR_CPUS_DEFAULT=64

Value requested for CONFIG_X86_ANCIENT_MCE not in final .config
Requested value:  # CONFIG_X86_ANCIENT_MCE is not set
Actual value:     

Value requested for CONFIG_X86_LEGACY_VM86 not in final .config
Requested value:  # CONFIG_X86_LEGACY_VM86 is not set
Actual value:     

Value requested for CONFIG_X86_ESPFIX32 not in final .config
Requested value:  CONFIG_X86_ESPFIX32=y
Actual value:     

Value requested for CONFIG_TOSHIBA not in final .config
Requested value:  # CONFIG_TOSHIBA is not set
Actual value:     

Value requested for CONFIG_X86_REBOOTFIXUPS not in final .config
Requested value:  # CONFIG_X86_REBOOTFIXUPS is not set
Actual value:     

Value requested for CONFIG_MICROCODE_INITRD32 not in final .config
Requested value:  CONFIG_MICROCODE_INITRD32=y
Actual value:     

Value requested for CONFIG_NOHIGHMEM not in final .config
Requested value:  # CONFIG_NOHIGHMEM is not set
Actual value:     

Value requested for CONFIG_HIGHMEM4G not in final .config
Requested value:  CONFIG_HIGHMEM4G=y
Actual value:     

Value requested for CONFIG_HIGHMEM64G not in final .config
Requested value:  # CONFIG_HIGHMEM64G is not set
Actual value:     

Value requested for CONFIG_PAGE_OFFSET not in final .config
Requested value:  CONFIG_PAGE_OFFSET=0xC0000000
Actual value:     

Value requested for CONFIG_HIGHMEM not in final .config
Requested value:  CONFIG_HIGHMEM=y
Actual value:     

Value requested for CONFIG_X86_PAE not in final .config
Requested value:  # CONFIG_X86_PAE is not set
Actual value:     

Value requested for CONFIG_ARCH_FLATMEM_ENABLE not in final .config
Requested value:  CONFIG_ARCH_FLATMEM_ENABLE=y
Actual value:     

Value requested for CONFIG_ARCH_SELECT_MEMORY_MODEL not in final .config
Requested value:  CONFIG_ARCH_SELECT_MEMORY_MODEL=y
Actual value:     

Value requested for CONFIG_ILLEGAL_POINTER_VALUE not in final .config
Requested value:  CONFIG_ILLEGAL_POINTER_VALUE=0
Actual value:     CONFIG_ILLEGAL_POINTER_VALUE=0xdead000000000000

Value requested for CONFIG_HIGHPTE not in final .config
Requested value:  # CONFIG_HIGHPTE is not set
Actual value:     

Value requested for CONFIG_COMPAT_VDSO not in final .config
Requested value:  # CONFIG_COMPAT_VDSO is not set
Actual value:     

Value requested for CONFIG_FUNCTION_PADDING_CFI not in final .config
Requested value:  CONFIG_FUNCTION_PADDING_CFI=0
Actual value:     CONFIG_FUNCTION_PADDING_CFI=11

Value requested for CONFIG_FUNCTION_PADDING_BYTES not in final .config
Requested value:  CONFIG_FUNCTION_PADDING_BYTES=4
Actual value:     CONFIG_FUNCTION_PADDING_BYTES=16

Value requested for CONFIG_APM not in final .config
Requested value:  # CONFIG_APM is not set
Actual value:     

Value requested for CONFIG_X86_POWERNOW_K6 not in final .config
Requested value:  # CONFIG_X86_POWERNOW_K6 is not set
Actual value:     

Value requested for CONFIG_X86_POWERNOW_K7 not in final .config
Requested value:  # CONFIG_X86_POWERNOW_K7 is not set
Actual value:     

Value requested for CONFIG_X86_GX_SUSPMOD not in final .config
Requested value:  # CONFIG_X86_GX_SUSPMOD is not set
Actual value:     

Value requested for CONFIG_X86_SPEEDSTEP_ICH not in final .config
Requested value:  # CONFIG_X86_SPEEDSTEP_ICH is not set
Actual value:     

Value requested for CONFIG_X86_SPEEDSTEP_SMI not in final .config
Requested value:  # CONFIG_X86_SPEEDSTEP_SMI is not set
Actual value:     

Value requested for CONFIG_X86_CPUFREQ_NFORCE2 not in final .config
Requested value:  # CONFIG_X86_CPUFREQ_NFORCE2 is not set
Actual value:     

Value requested for CONFIG_X86_LONGRUN not in final .config
Requested value:  # CONFIG_X86_LONGRUN is not set
Actual value:     

Value requested for CONFIG_X86_LONGHAUL not in final .config
Requested value:  # CONFIG_X86_LONGHAUL is not set
Actual value:     

Value requested for CONFIG_X86_E_POWERSAVER not in final .config
Requested value:  # CONFIG_X86_E_POWERSAVER is not set
Actual value:     

Value requested for CONFIG_PCI_GOBIOS not in final .config
Requested value:  # CONFIG_PCI_GOBIOS is not set
Actual value:     

Value requested for CONFIG_PCI_GOMMCONFIG not in final .config
Requested value:  # CONFIG_PCI_GOMMCONFIG is not set
Actual value:     

Value requested for CONFIG_PCI_GODIRECT not in final .config
Requested value:  # CONFIG_PCI_GODIRECT is not set
Actual value:     

Value requested for CONFIG_PCI_GOANY not in final .config
Requested value:  CONFIG_PCI_GOANY=y
Actual value:     

Value requested for CONFIG_PCI_BIOS not in final .config
Requested value:  CONFIG_PCI_BIOS=y
Actual value:     

Value requested for CONFIG_ISA not in final .config
Requested value:  # CONFIG_ISA is not set
Actual value:     

Value requested for CONFIG_SCx200 not in final .config
Requested value:  # CONFIG_SCx200 is not set
Actual value:     

Value requested for CONFIG_OLPC not in final .config
Requested value:  # CONFIG_OLPC is not set
Actual value:     

Value requested for CONFIG_ALIX not in final .config
Requested value:  # CONFIG_ALIX is not set
Actual value:     

Value requested for CONFIG_NET5501 not in final .config
Requested value:  # CONFIG_NET5501 is not set
Actual value:     

Value requested for CONFIG_GEOS not in final .config
Requested value:  # CONFIG_GEOS is not set
Actual value:     

Value requested for CONFIG_COMPAT_32 not in final .config
Requested value:  CONFIG_COMPAT_32=y
Actual value:     

Value requested for CONFIG_HAVE_ATOMIC_IOMAP not in final .config
Requested value:  CONFIG_HAVE_ATOMIC_IOMAP=y
Actual value:     

Value requested for CONFIG_ARCH_32BIT_OFF_T not in final .config
Requested value:  CONFIG_ARCH_32BIT_OFF_T=y
Actual value:     

Value requested for CONFIG_ARCH_WANT_IPC_PARSE_VERSION not in final .config
Requested value:  CONFIG_ARCH_WANT_IPC_PARSE_VERSION=y
Actual value:     

Value requested for CONFIG_MODULES_USE_ELF_REL not in final .config
Requested value:  CONFIG_MODULES_USE_ELF_REL=y
Actual value:     

Value requested for CONFIG_ARCH_MMAP_RND_BITS not in final .config
Requested value:  CONFIG_ARCH_MMAP_RND_BITS=8
Actual value:     CONFIG_ARCH_MMAP_RND_BITS=28

Value requested for CONFIG_CLONE_BACKWARDS not in final .config
Requested value:  CONFIG_CLONE_BACKWARDS=y
Actual value:     

Value requested for CONFIG_OLD_SIGSUSPEND3 not in final .config
Requested value:  CONFIG_OLD_SIGSUSPEND3=y
Actual value:     

Value requested for CONFIG_OLD_SIGACTION not in final .config
Requested value:  CONFIG_OLD_SIGACTION=y
Actual value:     

Value requested for CONFIG_ARCH_SPLIT_ARG64 not in final .config
Requested value:  CONFIG_ARCH_SPLIT_ARG64=y
Actual value:     

Value requested for CONFIG_FUNCTION_ALIGNMENT not in final .config
Requested value:  CONFIG_FUNCTION_ALIGNMENT=4
Actual value:     CONFIG_FUNCTION_ALIGNMENT=16

Value requested for CONFIG_SELECT_MEMORY_MODEL not in final .config
Requested value:  CONFIG_SELECT_MEMORY_MODEL=y
Actual value:     

Value requested for CONFIG_FLATMEM_MANUAL not in final .config
Requested value:  CONFIG_FLATMEM_MANUAL=y
Actual value:     

Value requested for CONFIG_SPARSEMEM_MANUAL not in final .config
Requested value:  # CONFIG_SPARSEMEM_MANUAL is not set
Actual value:     

Value requested for CONFIG_FLATMEM not in final .config
Requested value:  CONFIG_FLATMEM=y
Actual value:     

Value requested for CONFIG_SPARSEMEM_STATIC not in final .config
Requested value:  CONFIG_SPARSEMEM_STATIC=y
Actual value:     

Value requested for CONFIG_BOUNCE not in final .config
Requested value:  CONFIG_BOUNCE=y
Actual value:     

Value requested for CONFIG_KMAP_LOCAL not in final .config
Requested value:  CONFIG_KMAP_LOCAL=y
Actual value:     

Value requested for CONFIG_HOTPLUG_PCI_COMPAQ not in final .config
Requested value:  # CONFIG_HOTPLUG_PCI_COMPAQ is not set
Actual value:     

Value requested for CONFIG_HOTPLUG_PCI_IBM not in final .config
Requested value:  # CONFIG_HOTPLUG_PCI_IBM is not set
Actual value:     

Value requested for CONFIG_EFI_CAPSULE_QUIRK_QUARK_CSH not in final .config
Requested value:  CONFIG_EFI_CAPSULE_QUIRK_QUARK_CSH=y
Actual value:     

Value requested for CONFIG_PCH_PHUB not in final .config
Requested value:  # CONFIG_PCH_PHUB is not set
Actual value:     

Value requested for CONFIG_SCSI_NSP32 not in final .config
Requested value:  # CONFIG_SCSI_NSP32 is not set
Actual value:     

Value requested for CONFIG_PATA_CS5520 not in final .config
Requested value:  # CONFIG_PATA_CS5520 is not set
Actual value:     

Value requested for CONFIG_PATA_CS5530 not in final .config
Requested value:  # CONFIG_PATA_CS5530 is not set
Actual value:     

Value requested for CONFIG_PATA_CS5535 not in final .config
Requested value:  # CONFIG_PATA_CS5535 is not set
Actual value:     

Value requested for CONFIG_PATA_CS5536 not in final .config
Requested value:  # CONFIG_PATA_CS5536 is not set
Actual value:     

Value requested for CONFIG_PATA_SC1200 not in final .config
Requested value:  # CONFIG_PATA_SC1200 is not set
Actual value:     

Value requested for CONFIG_PCH_GBE not in final .config
Requested value:  # CONFIG_PCH_GBE is not set
Actual value:     

Value requested for CONFIG_INPUT_WISTRON_BTNS not in final .config
Requested value:  # CONFIG_INPUT_WISTRON_BTNS is not set
Actual value:     

Value requested for CONFIG_SERIAL_TIMBERDALE not in final .config
Requested value:  # CONFIG_SERIAL_TIMBERDALE is not set
Actual value:     

Value requested for CONFIG_SERIAL_PCH_UART not in final .config
Requested value:  # CONFIG_SERIAL_PCH_UART is not set
Actual value:     

Value requested for CONFIG_HW_RANDOM_GEODE not in final .config
Requested value:  CONFIG_HW_RANDOM_GEODE=y
Actual value:     

Value requested for CONFIG_SONYPI not in final .config
Requested value:  # CONFIG_SONYPI is not set
Actual value:     

Value requested for CONFIG_PC8736x_GPIO not in final .config
Requested value:  # CONFIG_PC8736x_GPIO is not set
Actual value:     

Value requested for CONFIG_NSC_GPIO not in final .config
Requested value:  # CONFIG_NSC_GPIO is not set
Actual value:     

Value requested for CONFIG_I2C_EG20T not in final .config
Requested value:  # CONFIG_I2C_EG20T is not set
Actual value:     

Value requested for CONFIG_SCx200_ACB not in final .config
Requested value:  # CONFIG_SCx200_ACB is not set
Actual value:     

Value requested for CONFIG_PTP_1588_CLOCK_PCH not in final .config
Requested value:  # CONFIG_PTP_1588_CLOCK_PCH is not set
Actual value:     

Value requested for CONFIG_SBC8360_WDT not in final .config
Requested value:  # CONFIG_SBC8360_WDT is not set
Actual value:     

Value requested for CONFIG_SBC7240_WDT not in final .config
Requested value:  # CONFIG_SBC7240_WDT is not set
Actual value:     

Value requested for CONFIG_MFD_CS5535 not in final .config
Requested value:  # CONFIG_MFD_CS5535 is not set
Actual value:     

Value requested for CONFIG_AGP_ALI not in final .config
Requested value:  # CONFIG_AGP_ALI is not set
Actual value:     

Value requested for CONFIG_AGP_ATI not in final .config
Requested value:  # CONFIG_AGP_ATI is not set
Actual value:     

Value requested for CONFIG_AGP_AMD not in final .config
Requested value:  # CONFIG_AGP_AMD is not set
Actual value:     

Value requested for CONFIG_AGP_NVIDIA not in final .config
Requested value:  # CONFIG_AGP_NVIDIA is not set
Actual value:     

Value requested for CONFIG_AGP_SWORKS not in final .config
Requested value:  # CONFIG_AGP_SWORKS is not set
Actual value:     

Value requested for CONFIG_AGP_EFFICEON not in final .config
Requested value:  # CONFIG_AGP_EFFICEON is not set
Actual value:     

Value requested for CONFIG_SND_PCM not in final .config
Requested value:  CONFIG_SND_PCM=y
Actual value:     CONFIG_SND_PCM=m

Value requested for CONFIG_SND_HWDEP not in final .config
Requested value:  CONFIG_SND_HWDEP=y
Actual value:     CONFIG_SND_HWDEP=m

Value requested for CONFIG_SND_DYNAMIC_MINORS not in final .config
Requested value:  # CONFIG_SND_DYNAMIC_MINORS is not set
Actual value:     CONFIG_SND_DYNAMIC_MINORS=y

Value requested for CONFIG_SND_CS5530 not in final .config
Requested value:  # CONFIG_SND_CS5530 is not set
Actual value:     

Value requested for CONFIG_SND_CS5535AUDIO not in final .config
Requested value:  # CONFIG_SND_CS5535AUDIO is not set
Actual value:     

Value requested for CONFIG_SND_SIS7019 not in final .config
Requested value:  # CONFIG_SND_SIS7019 is not set
Actual value:     

Value requested for CONFIG_SND_HDA not in final .config
Requested value:  CONFIG_SND_HDA=y
Actual value:     CONFIG_SND_HDA=m

Value requested for CONFIG_SND_HDA_CORE not in final .config
Requested value:  CONFIG_SND_HDA_CORE=y
Actual value:     CONFIG_SND_HDA_CORE=m

Value requested for CONFIG_SND_INTEL_DSP_CONFIG not in final .config
Requested value:  CONFIG_SND_INTEL_DSP_CONFIG=y
Actual value:     CONFIG_SND_INTEL_DSP_CONFIG=m

Value requested for CONFIG_SND_INTEL_SOUNDWIRE_ACPI not in final .config
Requested value:  CONFIG_SND_INTEL_SOUNDWIRE_ACPI=y
Actual value:     CONFIG_SND_INTEL_SOUNDWIRE_ACPI=m

Value requested for CONFIG_LEDS_OT200 not in final .config
Requested value:  # CONFIG_LEDS_OT200 is not set
Actual value:     

Value requested for CONFIG_PCH_DMA not in final .config
Requested value:  # CONFIG_PCH_DMA is not set
Actual value:     

Value requested for CONFIG_CLKSRC_I8253 not in final .config
Requested value:  CONFIG_CLKSRC_I8253=y
Actual value:     

Value requested for CONFIG_MAILBOX not in final .config
Requested value:  # CONFIG_MAILBOX is not set
Actual value:     CONFIG_MAILBOX=y

Value requested for CONFIG_CRYPTO_SERPENT_SSE2_586 not in final .config
Requested value:  # CONFIG_CRYPTO_SERPENT_SSE2_586 is not set
Actual value:     

Value requested for CONFIG_CRYPTO_TWOFISH_586 not in final .config
Requested value:  # CONFIG_CRYPTO_TWOFISH_586 is not set
Actual value:     

Value requested for CONFIG_CRYPTO_DEV_GEODE not in final .config
Requested value:  # CONFIG_CRYPTO_DEV_GEODE is not set
Actual value:     

Value requested for CONFIG_CRYPTO_DEV_HIFN_795X not in final .config
Requested value:  # CONFIG_CRYPTO_DEV_HIFN_795X is not set
Actual value:     

Value requested for CONFIG_CRYPTO_LIB_POLY1305_RSIZE not in final .config
Requested value:  CONFIG_CRYPTO_LIB_POLY1305_RSIZE=1
Actual value:     CONFIG_CRYPTO_LIB_POLY1305_RSIZE=11

Value requested for CONFIG_AUDIT_GENERIC not in final .config
Requested value:  CONFIG_AUDIT_GENERIC=y
Actual value:     

Value requested for CONFIG_GENERIC_VDSO_32 not in final .config
Requested value:  CONFIG_GENERIC_VDSO_32=y
Actual value:     

Value requested for CONFIG_DEBUG_KMAP_LOCAL not in final .config
Requested value:  # CONFIG_DEBUG_KMAP_LOCAL is not set
Actual value:     

Value requested for CONFIG_DEBUG_HIGHMEM not in final .config
Requested value:  # CONFIG_DEBUG_HIGHMEM is not set
Actual value:     

Value requested for CONFIG_HAVE_DEBUG_STACKOVERFLOW not in final .config
Requested value:  CONFIG_HAVE_DEBUG_STACKOVERFLOW=y
Actual value:     

Value requested for CONFIG_DEBUG_STACKOVERFLOW not in final .config
Requested value:  # CONFIG_DEBUG_STACKOVERFLOW is not set
Actual value:     

Value requested for CONFIG_HAVE_FUNCTION_GRAPH_TRACER not in final .config
Requested value:  CONFIG_HAVE_FUNCTION_GRAPH_TRACER=y
Actual value:     

Value requested for CONFIG_HAVE_FUNCTION_GRAPH_RETVAL not in final .config
Requested value:  CONFIG_HAVE_FUNCTION_GRAPH_RETVAL=y
Actual value:     

Value requested for CONFIG_DRM_KUNIT_TEST not in final .config
Requested value:  CONFIG_DRM_KUNIT_TEST=m
Actual value:     

Value requested for CONFIG_DRM_XE_WERROR not in final .config
Requested value:  CONFIG_DRM_XE_WERROR=y
Actual value:     

Value requested for CONFIG_DRM_XE_DEBUG not in final .config
Requested value:  CONFIG_DRM_XE_DEBUG=y
Actual value:     

Value requested for CONFIG_DRM_XE_DEBUG_MEM not in final .config
Requested value:  CONFIG_DRM_XE_DEBUG_MEM=y
Actual value:     

Value requested for CONFIG_DRM_XE_KUNIT_TEST not in final .config
Requested value:  CONFIG_DRM_XE_KUNIT_TEST=m
Actual value:     

++ nproc
+ make -j48 ARCH=i386 olddefconfig
  GEN     Makefile

WARNING: unmet direct dependencies detected for FB_IOMEM_HELPERS
  Depends on [n]: HAS_IOMEM [=y] && FB_CORE [=n]
  Selected by [m]:
  - DRM_XE_DISPLAY [=y] && HAS_IOMEM [=y] && DRM [=y] && DRM_XE [=m] && DRM_XE [=m]=m [=m]
#
# configuration written to .config
#
++ nproc
+ make -j48 ARCH=i386
  SYNC    include/config/auto.conf.cmd
  GEN     Makefile

WARNING: unmet direct dependencies detected for FB_IOMEM_HELPERS
  Depends on [n]: HAS_IOMEM [=y] && FB_CORE [=n]
  Selected by [m]:
  - DRM_XE_DISPLAY [=y] && HAS_IOMEM [=y] && DRM [=y] && DRM_XE [=m] && DRM_XE [=m]=m [=m]

WARNING: unmet direct dependencies detected for FB_IOMEM_HELPERS
  Depends on [n]: HAS_IOMEM [=y] && FB_CORE [=n]
  Selected by [m]:
  - DRM_XE_DISPLAY [=y] && HAS_IOMEM [=y] && DRM [=y] && DRM_XE [=m] && DRM_XE [=m]=m [=m]

WARNING: unmet direct dependencies detected for FB_IOMEM_HELPERS
  Depends on [n]: HAS_IOMEM [=y] && FB_CORE [=n]
  Selected by [m]:
  - DRM_XE_DISPLAY [=y] && HAS_IOMEM [=y] && DRM [=y] && DRM_XE [=m] && DRM_XE [=m]=m [=m]
  GEN     Makefile
  WRAP    arch/x86/include/generated/uapi/asm/bpf_perf_event.h
  WRAP    arch/x86/include/generated/uapi/asm/errno.h
  WRAP    arch/x86/include/generated/uapi/asm/fcntl.h
  UPD     include/generated/uapi/linux/version.h
  WRAP    arch/x86/include/generated/uapi/asm/ioctl.h
  WRAP    arch/x86/include/generated/uapi/asm/ioctls.h
  WRAP    arch/x86/include/generated/uapi/asm/ipcbuf.h
  WRAP    arch/x86/include/generated/uapi/asm/param.h
  WRAP    arch/x86/include/generated/uapi/asm/poll.h
  WRAP    arch/x86/include/generated/uapi/asm/resource.h
  WRAP    arch/x86/include/generated/uapi/asm/socket.h
  WRAP    arch/x86/include/generated/uapi/asm/termbits.h
  WRAP    arch/x86/include/generated/uapi/asm/sockios.h
  WRAP    arch/x86/include/generated/uapi/asm/termios.h
  WRAP    arch/x86/include/generated/uapi/asm/types.h
  SYSHDR  arch/x86/include/generated/uapi/asm/unistd_32.h
  SYSHDR  arch/x86/include/generated/uapi/asm/unistd_64.h
  SYSHDR  arch/x86/include/generated/uapi/asm/unistd_x32.h
  SYSTBL  arch/x86/include/generated/asm/syscalls_32.h
  HOSTCC  arch/x86/tools/relocs_32.o
  HOSTCC  arch/x86/tools/relocs_64.o
  HOSTCC  arch/x86/tools/relocs_common.o
  UPD     include/generated/compile.h
  WRAP    arch/x86/include/generated/asm/early_ioremap.h
  WRAP    arch/x86/include/generated/asm/mcs_spinlock.h
  WRAP    arch/x86/include/generated/asm/irq_regs.h
  WRAP    arch/x86/include/generated/asm/local64.h
  WRAP    arch/x86/include/generated/asm/kmap_size.h
  WRAP    arch/x86/include/generated/asm/mmiowb.h
  WRAP    arch/x86/include/generated/asm/module.lds.h
  WRAP    arch/x86/include/generated/asm/rwonce.h
  WRAP    arch/x86/include/generated/asm/unaligned.h
  HOSTCC  scripts/kallsyms
  HOSTCC  scripts/sorttable
  HOSTCC  scripts/asn1_compiler
  HOSTCC  scripts/selinux/mdp/mdp
  HOSTCC  scripts/selinux/genheaders/genheaders
  HOSTLD  arch/x86/tools/relocs
  UPD     include/config/kernel.release
  UPD     include/generated/utsrelease.h
  CC      scripts/mod/empty.o
  HOSTCC  scripts/mod/mk_elfconfig
  CC      scripts/mod/devicetable-offsets.s
  UPD     scripts/mod/devicetable-offsets.h
  MKELF   scripts/mod/elfconfig.h
  HOSTCC  scripts/mod/modpost.o
  HOSTCC  scripts/mod/file2alias.o
  HOSTCC  scripts/mod/sumversion.o
  HOSTCC  scripts/mod/symsearch.o
  HOSTLD  scripts/mod/modpost
  CC      kernel/bounds.s
  CHKSHA1 /workspace/kernel/include/linux/atomic/atomic-arch-fallback.h
  CHKSHA1 /workspace/kernel/include/linux/atomic/atomic-instrumented.h
  CHKSHA1 /workspace/kernel/include/linux/atomic/atomic-long.h
  UPD     include/generated/timeconst.h
  UPD     include/generated/bounds.h
  CC      arch/x86/kernel/asm-offsets.s
  UPD     include/generated/asm-offsets.h
  CALL    /workspace/kernel/scripts/checksyscalls.sh
  LDS     scripts/module.lds
  CC      ipc/util.o
  CC      ipc/msgutil.o
  CC      init/main.o
  CC      ipc/msg.o
  CC      ipc/sem.o
  CC      ipc/shm.o
  HOSTCC  usr/gen_init_cpio
  CC      certs/system_keyring.o
  CC      init/do_mounts.o
  CC      ipc/syscall.o
  CC      init/do_mounts_initrd.o
  CC      block/bdev.o
  CC      ipc/ipc_sysctl.o
  UPD     init/utsversion-tmp.h
  CC      block/fops.o
  CC      init/initramfs.o
  AS      arch/x86/lib/atomic64_cx8_32.o
  CC      mm/filemap.o
  CC      io_uring/io_uring.o
  CC      ipc/mqueue.o
  CC      arch/x86/power/cpu.o
  AR      arch/x86/net/built-in.a
  CC      arch/x86/video/video-common.o
  CC      block/partitions/core.o
  CC      arch/x86/pci/i386.o
  CC      arch/x86/realmode/init.o
  AR      virt/lib/built-in.a
  GEN     security/selinux/flask.h security/selinux/av_permissions.h
  CC      ipc/namespace.o
  CC      net/ethernet/eth.o
  AR      arch/x86/crypto/built-in.a
  AR      drivers/cache/built-in.a
  CC      lib/math/div64.o
  CC      security/keys/gc.o
  CC      arch/x86/mm/pat/set_memory.o
  CC      lib/math/gcd.o
  CC      security/integrity/iint.o
  AR      arch/x86/platform/atom/built-in.a
  CC      security/selinux/avc.o
  AR      net/802/built-in.a
  CC      net/core/sock.o
  AR      arch/x86/virt/svm/built-in.a
  AR      sound/i2c/other/built-in.a
  AR      virt/built-in.a
  CC      arch/x86/events/amd/core.o
  CC      sound/core/seq/seq.o
  AR      sound/drivers/opl3/built-in.a
  CC      fs/notify/dnotify/dnotify.o
  AR      sound/i2c/built-in.a
  CC      arch/x86/kernel/fpu/init.o
  AR      arch/x86/virt/vmx/built-in.a
  CC      fs/nfs_common/nfsacl.o
  CC      sound/core/seq/seq_lock.o
  AR      drivers/irqchip/built-in.a
  AS      arch/x86/lib/checksum_32.o
  AR      arch/x86/virt/built-in.a
  AR      arch/x86/platform/ce4100/built-in.a
  CC      sound/core/seq/seq_clientmgr.o
  AR      sound/drivers/opl4/built-in.a
  CC      arch/x86/entry/vdso/vma.o
  HOSTCC  certs/extract-cert
  CC      arch/x86/platform/efi/memmap.o
  AR      drivers/bus/mhi/built-in.a
  AR      sound/isa/ad1816a/built-in.a
  CC      kernel/sched/core.o
  CC      arch/x86/lib/cmdline.o
  AR      sound/drivers/mpu401/built-in.a
  AR      drivers/bus/built-in.a
  AS      arch/x86/lib/cmpxchg8b_emu.o
  AR      sound/isa/ad1848/built-in.a
  AR      sound/drivers/vx/built-in.a
  AR      drivers/pwm/built-in.a
  CC      crypto/asymmetric_keys/asymmetric_type.o
  AR      sound/isa/cs423x/built-in.a
  AR      sound/drivers/pcsp/built-in.a
  CC      crypto/api.o
  AR      sound/drivers/built-in.a
  AR      sound/isa/es1688/built-in.a
  CC      drivers/pci/msi/pcidev_msi.o
  AR      sound/isa/galaxy/built-in.a
  CC      lib/math/lcm.o
  AR      sound/isa/gus/built-in.a
  CC      crypto/cipher.o
  AR      sound/isa/msnd/built-in.a
  CC      lib/math/int_log.o
  CC      arch/x86/lib/cpu.o
  AR      sound/isa/opti9xx/built-in.a
  AR      sound/isa/sb/built-in.a
  AR      sound/isa/wavefront/built-in.a
  AR      sound/isa/wss/built-in.a
  AR      sound/isa/built-in.a
  CC      lib/math/int_pow.o
  GEN     usr/initramfs_data.cpio
  COPY    usr/initramfs_inc_data
  CC      drivers/pci/pcie/portdrv.o
  AS      usr/initramfs_data.o
  CC      drivers/pci/pcie/rcec.o
  AR      usr/built-in.a
  CC      lib/math/int_sqrt.o
  CERT    certs/x509_certificate_list
  CERT    certs/signing_key.x509
  AS      certs/system_certificates.o
  CC      drivers/pci/pcie/aspm.o
  CC      arch/x86/kernel/fpu/bugs.o
  AR      certs/built-in.a
  CC      arch/x86/mm/init.o
  CC      net/sched/sch_generic.o
  CC      lib/math/reciprocal_div.o
  CC      arch/x86/kernel/fpu/core.o
  CC      arch/x86/mm/init_32.o
  CC      fs/notify/inotify/inotify_fsnotify.o
  AS      arch/x86/realmode/rm/header.o
  AR      arch/x86/video/built-in.a
  CC      fs/notify/inotify/inotify_user.o
  CC      lib/math/rational.o
  CC      arch/x86/lib/delay.o
  AS      arch/x86/realmode/rm/trampoline_32.o
  CC      net/core/request_sock.o
  CC      security/integrity/integrity_audit.o
  CC      fs/nfs_common/grace.o
  CC      crypto/asymmetric_keys/restrict.o
  AS      arch/x86/realmode/rm/stack.o
  CC      arch/x86/pci/init.o
  AS      arch/x86/realmode/rm/reboot.o
  CC      sound/core/sound.o
  CC      drivers/pci/msi/api.o
  AS      arch/x86/realmode/rm/wakeup_asm.o
  CC      arch/x86/kernel/cpu/mce/core.o
  CC      arch/x86/realmode/rm/wakemain.o
  AR      fs/notify/dnotify/built-in.a
  CC      arch/x86/pci/pcbios.o
  AR      sound/pci/ac97/built-in.a
  CC      security/keys/key.o
  CC      arch/x86/kernel/acpi/boot.o
  CC      arch/x86/entry/vdso/extable.o
  CC      arch/x86/power/hibernate_32.o
  CC      arch/x86/platform/efi/quirks.o
  AR      sound/pci/ali5451/built-in.a
  AR      sound/pci/asihpi/built-in.a
  CC      arch/x86/realmode/rm/video-mode.o
  AR      sound/pci/au88x0/built-in.a
  AR      sound/pci/aw2/built-in.a
  AR      sound/pci/ctxfi/built-in.a
  CC      block/partitions/msdos.o
  AR      sound/pci/ca0106/built-in.a
  AS      arch/x86/lib/getuser.o
  CC      arch/x86/kernel/cpu/mtrr/mtrr.o
  AR      sound/pci/cs46xx/built-in.a
  AR      sound/pci/cs5535audio/built-in.a
  GEN     arch/x86/lib/inat-tables.c
  AS      arch/x86/realmode/rm/copy.o
  AR      sound/pci/lola/built-in.a
  AR      lib/math/built-in.a
  AS      arch/x86/realmode/rm/bioscall.o
  CC      arch/x86/kernel/acpi/sleep.o
  AR      sound/pci/lx6464es/built-in.a
  CC      arch/x86/realmode/rm/regs.o
  CC      lib/crypto/mpi/generic_mpih-lshift.o
  CC      arch/x86/events/intel/core.o
  AR      sound/pci/echoaudio/built-in.a
  CC      arch/x86/lib/insn-eval.o
  CC      lib/crypto/mpi/generic_mpih-mul1.o
  AR      sound/pci/emu10k1/built-in.a
  CC      lib/crypto/mpi/generic_mpih-mul2.o
  AR      arch/x86/platform/geode/built-in.a
  AR      sound/pci/hda/built-in.a
  CC      arch/x86/realmode/rm/video-vga.o
  CC      block/bio.o
  CC [M]  sound/pci/hda/hda_bind.o
  AR      sound/pci/ice1712/built-in.a
  CC      block/elevator.o
  CC      arch/x86/events/amd/lbr.o
  CC      net/core/skbuff.o
  CC      crypto/asymmetric_keys/signature.o
  CC      arch/x86/mm/pat/memtype.o
  CC      arch/x86/realmode/rm/video-vesa.o
  CC      block/blk-core.o
  CC      init/calibrate.o
  CC      mm/mempool.o
  CC      arch/x86/realmode/rm/video-bios.o
  CC      sound/core/seq/seq_memory.o
  CC      security/keys/keyring.o
  AR      net/ethernet/built-in.a
  CC      drivers/pci/pcie/pme.o
  CC      crypto/asymmetric_keys/public_key.o
  CC      sound/core/init.o
  AR      security/integrity/built-in.a
  PASYMS  arch/x86/realmode/rm/pasyms.h
  LDS     arch/x86/realmode/rm/realmode.lds
  AR      fs/nfs_common/built-in.a
  CC      arch/x86/mm/fault.o
  AR      sound/pci/korg1212/built-in.a
  CC      drivers/pci/msi/msi.o
  LD      arch/x86/realmode/rm/realmode.elf
  CC      arch/x86/pci/mmconfig_32.o
  CC      drivers/pci/msi/irqdomain.o
  CC      mm/oom_kill.o
  RELOCS  arch/x86/realmode/rm/realmode.relocs
  OBJCOPY arch/x86/realmode/rm/realmode.bin
  ASN.1   crypto/asymmetric_keys/x509.asn1.[ch]
  CC      arch/x86/mm/ioremap.o
  AS      arch/x86/realmode/rmpiggy.o
  AS      arch/x86/power/hibernate_asm_32.o
  AR      sound/pci/mixart/built-in.a
  CC      arch/x86/pci/direct.o
  CC      init/init_task.o
  AR      arch/x86/realmode/built-in.a
  CC      arch/x86/power/hibernate.o
  CC      security/commoncap.o
  CC      ipc/mq_sysctl.o
  CC      crypto/compress.o
  AR      fs/notify/inotify/built-in.a
  CC      lib/zlib_inflate/inffast.o
  LDS     arch/x86/entry/vdso/vdso32/vdso32.lds
  CC      security/selinux/hooks.o
  AR      fs/notify/fanotify/built-in.a
  AS      arch/x86/entry/vdso/vdso32/note.o
  CC      fs/notify/fsnotify.o
  CC      security/selinux/selinuxfs.o
  AS      arch/x86/entry/vdso/vdso32/system_call.o
  CC      lib/crypto/mpi/generic_mpih-mul3.o
  CC      lib/crypto/mpi/generic_mpih-rshift.o
  CC      crypto/algapi.o
  CC      block/blk-sysfs.o
  AS      arch/x86/entry/vdso/vdso32/sigreturn.o
  CC      arch/x86/kernel/cpu/mtrr/if.o
  CC      arch/x86/platform/efi/efi.o
  CC      arch/x86/entry/vdso/vdso32/vclock_gettime.o
  CC      arch/x86/kernel/fpu/regset.o
  CC      lib/zlib_inflate/inflate.o
  CC      block/partitions/efi.o
  CC      security/keys/keyctl.o
  CC [M]  sound/pci/hda/hda_codec.o
  CC      arch/x86/lib/insn.o
  AR      ipc/built-in.a
  CC      arch/x86/lib/kaslr.o
  CC      arch/x86/events/amd/ibs.o
  AS      arch/x86/kernel/acpi/wakeup_32.o
  ASN.1   crypto/asymmetric_keys/x509_akid.asn1.[ch]
  CC      lib/crypto/mpi/generic_mpih-sub1.o
  CC      crypto/asymmetric_keys/x509_loader.o
  CC      arch/x86/kernel/acpi/cstate.o
  CC      arch/x86/mm/pat/memtype_interval.o
  CC      arch/x86/events/intel/bts.o
  CC      sound/core/seq/seq_queue.o
  AR      drivers/pci/pcie/built-in.a
  CC      drivers/pci/hotplug/pci_hotplug_core.o
  CC      arch/x86/kernel/cpu/microcode/core.o
  AR      arch/x86/power/built-in.a
  CC      arch/x86/pci/mmconfig-shared.o
  CC      kernel/locking/mutex.o
  CC      arch/x86/lib/memcpy_32.o
  CC      kernel/locking/semaphore.o
  CC      kernel/locking/rwsem.o
  CC      crypto/asymmetric_keys/x509_public_key.o
  CC      kernel/power/qos.o
  CC      kernel/locking/percpu-rwsem.o
  CC      init/version.o
  CC      arch/x86/pci/fixup.o
  AS      arch/x86/lib/memmove_32.o
  CC      mm/fadvise.o
  CC      arch/x86/lib/misc.o
  CC      arch/x86/kernel/cpu/mtrr/generic.o
  CC      kernel/locking/spinlock.o
  CC      arch/x86/lib/pc-conf-reg.o
  AR      drivers/pci/msi/built-in.a
  CC      lib/crypto/mpi/generic_mpih-add1.o
  CC      arch/x86/entry/vdso/vdso32/vgetcpu.o
  CC      lib/zlib_inflate/infutil.o
  AR      init/built-in.a
  CC      arch/x86/kernel/cpu/mce/severity.o
  CC      fs/notify/notification.o
  CC      fs/notify/group.o
  HOSTCC  arch/x86/entry/vdso/vdso2c
  CC      security/selinux/netlink.o
  AS      arch/x86/lib/putuser.o
  AS      arch/x86/lib/retpoline.o
  CC      arch/x86/kernel/fpu/signal.o
  CC      net/sched/sch_mq.o
  CC      arch/x86/lib/string_32.o
  CC      lib/crypto/memneq.o
  AR      arch/x86/kernel/acpi/built-in.a
  CC      lib/crypto/utils.o
  CC      arch/x86/events/intel/ds.o
  CC      arch/x86/lib/strstr_32.o
  CC      drivers/video/console/dummycon.o
  CC      arch/x86/events/intel/knc.o
  CC      arch/x86/platform/efi/efi_32.o
  CC      arch/x86/lib/usercopy.o
  AS      arch/x86/platform/efi/efi_stub_32.o
  CC      lib/zlib_inflate/inftrees.o
  CC      arch/x86/lib/usercopy_32.o
  AR      arch/x86/mm/pat/built-in.a
  CC      arch/x86/mm/extable.o
  ASN.1   crypto/asymmetric_keys/pkcs7.asn1.[ch]
  CC      crypto/asymmetric_keys/pkcs7_trust.o
  AR      block/partitions/built-in.a
  CC      drivers/video/console/vgacon.o
  CC      arch/x86/kernel/fpu/xstate.o
  AR      drivers/idle/built-in.a
  CC      sound/core/memory.o
  CC      arch/x86/entry/vdso/vdso32-setup.o
  CC      sound/core/seq/seq_fifo.o
  CC      arch/x86/kernel/cpu/microcode/intel.o
  CC      lib/zlib_inflate/inflate_syms.o
  CC      arch/x86/kernel/cpu/microcode/amd.o
  CC      security/selinux/nlmsgtab.o
  CC      security/keys/permission.o
  CC      drivers/pci/hotplug/acpi_pcihp.o
  CC      lib/crypto/mpi/ec.o
  CC      security/keys/process_keys.o
  CC      lib/crypto/chacha.o
  CC      security/keys/request_key.o
  CC      net/core/datagram.o
  CC      arch/x86/lib/msr-smp.o
  CC      arch/x86/events/intel/lbr.o
  CC      drivers/video/backlight/backlight.o
  CC      kernel/locking/osq_lock.o
  CC      mm/maccess.o
  CC      kernel/locking/qspinlock.o
  CC      arch/x86/events/amd/uncore.o
  CC      net/core/stream.o
  CC      mm/page-writeback.o
  CC      sound/core/control.o
  CC      arch/x86/pci/acpi.o
  CC      crypto/asymmetric_keys/pkcs7_verify.o
  CC      fs/notify/mark.o
  VDSO    arch/x86/entry/vdso/vdso32.so.dbg
  OBJCOPY arch/x86/entry/vdso/vdso32.so
  VDSO2C  arch/x86/entry/vdso/vdso-image-32.c
  CC      arch/x86/entry/vdso/vdso-image-32.o
  AR      lib/zlib_inflate/built-in.a
  CC      block/blk-flush.o
  CC      security/keys/request_key_auth.o
  CC      arch/x86/mm/mmap.o
  CC      arch/x86/kernel/cpu/mce/genpool.o
  CC      arch/x86/kernel/cpu/mtrr/cleanup.o
  CC      lib/zlib_deflate/deflate.o
  CC      lib/zlib_deflate/deftree.o
  CC      arch/x86/lib/cache-smp.o
  CC      lib/zlib_deflate/deflate_syms.o
  CC      kernel/power/main.o
  CC      kernel/sched/fair.o
  CC      arch/x86/platform/efi/runtime-map.o
  AR      arch/x86/entry/vsyscall/built-in.a
  CC      sound/core/misc.o
  CC      arch/x86/lib/msr.o
  AR      arch/x86/entry/vdso/built-in.a
  CC      arch/x86/mm/pgtable.o
  AS      arch/x86/entry/entry.o
  CC      sound/core/seq/seq_prioq.o
  AS      arch/x86/entry/entry_32.o
  CC      kernel/locking/rtmutex_api.o
  CC      arch/x86/entry/syscall_32.o
  CC      arch/x86/mm/physaddr.o
  CC      crypto/asymmetric_keys/x509.asn1.o
  CC      net/sched/sch_frag.o
  CC      crypto/asymmetric_keys/x509_akid.asn1.o
  CC      arch/x86/kernel/apic/apic.o
  CC      net/sched/sch_api.o
  CC      arch/x86/kernel/kprobes/core.o
  AR      drivers/pci/hotplug/built-in.a
  CC      crypto/asymmetric_keys/x509_cert_parser.o
  CC      arch/x86/kernel/kprobes/opt.o
  AR      arch/x86/kernel/cpu/microcode/built-in.a
  AR      drivers/pci/controller/dwc/built-in.a
  CC      kernel/sched/build_policy.o
  AR      drivers/pci/controller/mobiveil/built-in.a
  AR      drivers/pci/controller/built-in.a
  AR      drivers/pci/switch/built-in.a
  CC      arch/x86/kernel/apic/apic_common.o
  CC      drivers/pci/access.o
  CC      net/sched/sch_blackhole.o
  CC      io_uring/opdef.o
  CC      mm/folio-compat.o
  AR      drivers/video/console/built-in.a
  CC      mm/readahead.o
  CC      crypto/scatterwalk.o
  CC [M]  sound/pci/hda/hda_jack.o
  AR      drivers/video/backlight/built-in.a
  CC      arch/x86/pci/legacy.o
  AR      drivers/video/fbdev/core/built-in.a
  AR      drivers/video/fbdev/omap/built-in.a
  CC      kernel/printk/printk.o
  CC      arch/x86/kernel/cpu/mce/intel.o
  CC      arch/x86/kernel/cpu/mce/amd.o
  AR      drivers/video/fbdev/omap2/omapfb/dss/built-in.a
  CC      arch/x86/kernel/cpu/mce/threshold.o
  AR      drivers/video/fbdev/omap2/omapfb/displays/built-in.a
  AR      drivers/video/fbdev/omap2/omapfb/built-in.a
  CC      lib/crypto/mpi/mpicoder.o
  AR      drivers/video/fbdev/omap2/built-in.a
  AR      arch/x86/kernel/fpu/built-in.a
  CC [M]  sound/pci/hda/hda_auto_parser.o
  AR      drivers/video/fbdev/built-in.a
  CC      security/keys/user_defined.o
  CC      arch/x86/kernel/cpu/mtrr/amd.o
  CC      drivers/video/aperture.o
  CC      fs/notify/fdinfo.o
  CC      crypto/proc.o
  AR      lib/zlib_deflate/built-in.a
  CC      block/blk-settings.o
  CC      sound/core/seq/seq_timer.o
  CC      drivers/video/cmdline.o
  CC      arch/x86/mm/tlb.o
  AR      arch/x86/events/amd/built-in.a
  CC      arch/x86/mm/cpu_entry_area.o
  CC [M]  sound/pci/hda/hda_sysfs.o
  AR      arch/x86/platform/efi/built-in.a
  LDS     arch/x86/kernel/vmlinux.lds
  AS      arch/x86/kernel/head_32.o
  CC      crypto/asymmetric_keys/pkcs7.asn1.o
  AR      arch/x86/platform/iris/built-in.a
  CC      arch/x86/platform/intel/iosf_mbi.o
  AR      arch/x86/platform/intel-mid/built-in.a
  CC      crypto/asymmetric_keys/pkcs7_parser.o
  CC      lib/crypto/mpi/mpi-add.o
  AR      drivers/char/ipmi/built-in.a
  CC      arch/x86/kernel/apic/apic_noop.o
  AR      arch/x86/platform/intel-quark/built-in.a
  CC      io_uring/kbuf.o
  CC      arch/x86/events/intel/p4.o
  AS      arch/x86/lib/msr-reg.o
  CC      arch/x86/lib/msr-reg-export.o
  CC      kernel/power/console.o
  CC      kernel/locking/qrwlock.o
  CC      crypto/aead.o
  CC      sound/core/device.o
  CC      arch/x86/pci/irq.o
  CC      drivers/pnp/core.o
  CC      drivers/pnp/card.o
  AS      arch/x86/lib/hweight.o
  CC      drivers/pnp/pnpacpi/core.o
  CC      drivers/acpi/acpica/dsargs.o
  CC      arch/x86/kernel/cpu/mtrr/cyrix.o
  CC      arch/x86/lib/iomem.o
  CC      security/keys/proc.o
  CC      drivers/pci/bus.o
  AR      arch/x86/kernel/kprobes/built-in.a
  CC      security/keys/sysctl.o
  AR      drivers/acpi/pmic/built-in.a
  CC      drivers/pci/probe.o
  CC      arch/x86/kernel/head32.o
  CC      arch/x86/kernel/ebda.o
  AR      fs/notify/built-in.a
  CC      fs/iomap/trace.o
  CC      arch/x86/mm/maccess.o
  AR      crypto/asymmetric_keys/built-in.a
  CC      arch/x86/entry/common.o
  CC      drivers/acpi/acpica/dscontrol.o
  CC      arch/x86/events/intel/p6.o
  CC      kernel/irq/irqdesc.o
  CC      kernel/power/process.o
  CC      kernel/printk/conopt.o
  CC      drivers/video/nomodeset.o
  CC      sound/core/seq/seq_system.o
  CC      net/sched/cls_api.o
  CC      fs/iomap/iter.o
  CC      lib/crypto/mpi/mpi-bit.o
  AR      kernel/locking/built-in.a
  CC      drivers/acpi/acpica/dsdebug.o
  CC      drivers/video/hdmi.o
  CC      arch/x86/mm/pgprot.o
  CC      mm/swap.o
  CC      arch/x86/lib/atomic64_32.o
  CC      sound/core/info.o
  CC      arch/x86/kernel/cpu/mtrr/centaur.o
  AR      arch/x86/platform/intel/built-in.a
  CC [M]  sound/pci/hda/hda_controller.o
  CC      arch/x86/lib/inat.o
  CC      fs/quota/dquot.o
  AR      arch/x86/platform/olpc/built-in.a
  AR      arch/x86/platform/scx200/built-in.a
  CC      block/blk-ioc.o
  AR      arch/x86/platform/ts5500/built-in.a
  CC      fs/iomap/buffered-io.o
  CC      drivers/pnp/pnpacpi/rsparser.o
  AR      arch/x86/platform/uv/built-in.a
  AR      arch/x86/platform/built-in.a
  CC      arch/x86/mm/pgtable_32.o
  CC      net/core/scm.o
  CC      block/blk-map.o
  CC      sound/core/seq/seq_ports.o
  CC      security/selinux/netif.o
  CC      drivers/acpi/acpica/dsfield.o
  CC      io_uring/rsrc.o
  CC      arch/x86/mm/iomap_32.o
  AR      arch/x86/lib/built-in.a
  CC      mm/truncate.o
  AR      arch/x86/lib/lib.a
  CC      arch/x86/mm/hugetlbpage.o
  CC      drivers/acpi/dptf/int340x_thermal.o
  CC      drivers/acpi/x86/apple.o
  CC      security/keys/keyctl_pkey.o
  CC      io_uring/notif.o
  CC      net/netlink/af_netlink.o
  CC      net/netlink/genetlink.o
  AR      net/bpf/built-in.a
  CC      crypto/geniv.o
  CC      net/sched/act_api.o
  CC      crypto/lskcipher.o
  CC      sound/core/seq/seq_info.o
  CC      arch/x86/kernel/apic/ipi.o
  CC      kernel/printk/printk_safe.o
  AR      arch/x86/kernel/cpu/mce/built-in.a
  CC      arch/x86/kernel/apic/vector.o
  CC      crypto/skcipher.o
  CC      kernel/irq/handle.o
  CC      arch/x86/kernel/cpu/mtrr/legacy.o
  CC      arch/x86/events/intel/pt.o
  CC      lib/crypto/mpi/mpi-cmp.o
  CC      arch/x86/pci/common.o
  CC      crypto/seqiv.o
  AS      arch/x86/entry/thunk.o
  CC      drivers/acpi/acpica/dsinit.o
  CC      drivers/acpi/x86/cmos_rtc.o
  CC      drivers/acpi/x86/lpss.o
  AR      arch/x86/entry/built-in.a
  AR      drivers/acpi/dptf/built-in.a
  CC      fs/proc/task_mmu.o
  CC      kernel/rcu/update.o
  AR      drivers/video/built-in.a
  CC      fs/proc/inode.o
  CC      lib/crypto/aes.o
  CC      arch/x86/mm/dump_pagetables.o
  CC      kernel/rcu/sync.o
  CC      sound/core/isadma.o
  AR      arch/x86/kernel/cpu/mtrr/built-in.a
  CC      arch/x86/kernel/cpu/cacheinfo.o
  AR      security/keys/built-in.a
  CC      kernel/rcu/srcutree.o
  CC      arch/x86/mm/highmem_32.o
  CC      kernel/power/suspend.o
  CC      net/core/gen_stats.o
  CC      kernel/power/hibernate.o
  CC      sound/core/seq/seq_dummy.o
  CC      lib/crypto/arc4.o
  CC      kernel/printk/nbcon.o
  CC      block/blk-merge.o
  AR      drivers/pnp/pnpacpi/built-in.a
  CC      drivers/pnp/driver.o
  CC      drivers/acpi/acpica/dsmethod.o
  CC      kernel/rcu/tree.o
  CC      kernel/rcu/rcu_segcblist.o
  CC      kernel/irq/manage.o
  CC      lib/crypto/mpi/mpi-sub-ui.o
  CC      crypto/echainiv.o
  CC      drivers/pci/host-bridge.o
  CC      arch/x86/kernel/platform-quirks.o
  CC      arch/x86/pci/early.o
  CC      lib/lzo/lzo1x_compress.o
  CC      crypto/ahash.o
  CC      fs/kernfs/mount.o
  CC      security/selinux/netnode.o
  CC      fs/kernfs/inode.o
  CC      lib/lzo/lzo1x_decompress_safe.o
  CC      mm/vmscan.o
  CC      sound/core/vmaster.o
  CC      fs/kernfs/dir.o
  CC      block/blk-timeout.o
  CC      drivers/acpi/x86/s2idle.o
  CC [M]  sound/pci/hda/hda_proc.o
  CC      kernel/printk/printk_ringbuffer.o
  CC      drivers/acpi/x86/utils.o
  CC      lib/crypto/gf128mul.o
  CC      drivers/acpi/acpica/dsmthdat.o
  CC      lib/crypto/blake2s.o
  CC      io_uring/tctx.o
  AR      arch/x86/mm/built-in.a
  AR      sound/core/seq/built-in.a
  CC      sound/core/ctljack.o
  CC      fs/sysfs/file.o
  CC      drivers/pnp/resource.o
  CC      arch/x86/pci/bus_numa.o
  CC      sound/core/jack.o
  CC      arch/x86/pci/amd_bus.o
  CC      lib/crypto/mpi/mpi-div.o
  CC      arch/x86/events/intel/uncore.o
  CC      lib/crypto/mpi/mpi-inv.o
  CC      drivers/pci/remove.o
  AR      lib/lzo/built-in.a
  CC      fs/devpts/inode.o
  CC      fs/netfs/buffered_read.o
  AR      kernel/livepatch/built-in.a
  CC      kernel/dma/mapping.o
  CC      drivers/acpi/acpica/dsobject.o
  CC      lib/lz4/lz4_decompress.o
  CC      net/netlink/policy.o
  CC      lib/zstd/zstd_decompress_module.o
  CC      net/core/gen_estimator.o
  CC      fs/quota/quota_v2.o
  CC      fs/quota/quota_tree.o
  CC      sound/core/timer.o
  CC      kernel/printk/sysctl.o
  CC      arch/x86/kernel/apic/init.o
  CC      drivers/acpi/x86/blacklist.o
  CC      fs/iomap/direct-io.o
  CC      fs/kernfs/file.o
  CC      kernel/dma/direct.o
  CC      io_uring/filetable.o
  CC      lib/crypto/blake2s-generic.o
  CC      arch/x86/kernel/cpu/scattered.o
  CC      fs/netfs/buffered_write.o
  CC      lib/crypto/sha1.o
  CC      mm/shrinker.o
  AR      kernel/printk/built-in.a
  CC      kernel/entry/common.o
  CC      fs/proc/root.o
  CC      crypto/shash.o
  CC      security/lsm_syscalls.o
  CC      kernel/power/snapshot.o
  CC      kernel/entry/syscall_user_dispatch.o
  CC      lib/zstd/decompress/huf_decompress.o
  CC      fs/sysfs/dir.o
  CC      drivers/acpi/acpica/dsopcode.o
  AR      arch/x86/pci/built-in.a
  CC      net/sched/sch_fifo.o
  CC      fs/netfs/direct_read.o
  CC      lib/crypto/mpi/mpi-mod.o
  CC      kernel/power/swap.o
  CC      kernel/irq/spurious.o
  CC      security/selinux/netport.o
  CC      drivers/pci/pci.o
  CC      arch/x86/kernel/apic/hw_nmi.o
  CC      kernel/power/user.o
  CC [M]  sound/pci/hda/hda_hwdep.o
  CC      arch/x86/kernel/cpu/topology_common.o
  CC      arch/x86/kernel/process_32.o
  AR      drivers/acpi/x86/built-in.a
  AR      fs/devpts/built-in.a
  CC      net/core/net_namespace.o
  CC      lib/zstd/decompress/zstd_ddict.o
  CC      lib/crypto/mpi/mpi-mul.o
  CC      arch/x86/kernel/cpu/topology_ext.o
  CC      security/selinux/status.o
  CC      kernel/sched/build_utility.o
  CC      fs/kernfs/symlink.o
  CC      fs/quota/quota.o
  CC      block/blk-lib.o
  CC      drivers/pnp/manager.o
  CC      fs/quota/kqid.o
  CC      drivers/acpi/acpica/dspkginit.o
  AR      net/netlink/built-in.a
  CC      fs/quota/netlink.o
  CC      drivers/acpi/acpica/dsutils.o
  CC      fs/sysfs/symlink.o
  CC      fs/sysfs/mount.o
  CC      drivers/acpi/tables.o
  CC      drivers/acpi/osi.o
  CC      kernel/dma/ops_helpers.o
  CC      security/selinux/ss/ebitmap.o
  CC      kernel/irq/resend.o
  CC      sound/core/hrtimer.o
  CC      io_uring/rw.o
  CC      arch/x86/kernel/cpu/topology_amd.o
  CC      sound/core/seq_device.o
  CC      lib/crypto/mpi/mpih-cmp.o
  CC      lib/crypto/mpi/mpih-div.o
  CC      fs/proc/base.o
  CC      fs/proc/generic.o
  AR      lib/lz4/built-in.a
  CC      lib/xz/xz_dec_syms.o
  CC      arch/x86/kernel/apic/io_apic.o
  CC      fs/iomap/fiemap.o
  CC      fs/iomap/seek.o
  CC      crypto/akcipher.o
  CC [M]  sound/pci/hda/patch_hdmi.o
  CC      fs/iomap/swapfile.o
  CC      arch/x86/kernel/apic/msi.o
  CC      fs/proc/array.o
  CC      mm/shmem.o
  CC      net/ethtool/ioctl.o
  CC      drivers/pnp/support.o
  CC      drivers/acpi/acpica/dswexec.o
  AR      kernel/entry/built-in.a
  CC      arch/x86/events/intel/uncore_nhmex.o
  CC      arch/x86/events/intel/uncore_snb.o
  CC      fs/netfs/direct_write.o
  AR      fs/kernfs/built-in.a
  CC      drivers/acpi/acpica/dswload.o
  CC      net/netfilter/core.o
  CC      net/sched/cls_cgroup.o
  CC      kernel/irq/chip.o
  CC      net/netfilter/nf_log.o
  CC      block/blk-mq.o
  CC      lib/xz/xz_dec_stream.o
  CC      net/netfilter/nf_queue.o
  CC      arch/x86/kernel/cpu/common.o
  CC      drivers/acpi/acpica/dswload2.o
  CC      mm/util.o
  CC      arch/x86/kernel/signal.o
  CC      kernel/dma/dummy.o
  CC      kernel/power/poweroff.o
  CC [M]  sound/core/hwdep.o
  CC      arch/x86/events/intel/uncore_snbep.o
  CC      fs/netfs/io.o
  CC      fs/sysfs/group.o
  CC      lib/zstd/decompress/zstd_decompress.o
  CC      fs/netfs/iterator.o
  CC      block/blk-mq-tag.o
  CC      drivers/pnp/interface.o
  AR      fs/quota/built-in.a
  CC      drivers/acpi/acpica/dswscope.o
  CC      drivers/acpi/osl.o
  CC      fs/ext4/balloc.o
  CC      drivers/acpi/utils.o
  CC      lib/crypto/mpi/mpih-mul.o
  CC      drivers/acpi/reboot.o
  CC      fs/ext4/bitmap.o
  CC      crypto/sig.o
  CC      fs/proc/fd.o
  AR      kernel/power/built-in.a
  CC      net/core/secure_seq.o
  AR      fs/iomap/built-in.a
  CC      kernel/module/main.o
  CC      arch/x86/kernel/apic/probe_32.o
  CC      kernel/module/strict_rwx.o
  CC      lib/xz/xz_dec_lzma2.o
  CC      lib/crypto/mpi/mpi-pow.o
  CC      security/selinux/ss/hashtab.o
  CC      kernel/dma/remap.o
  CC      net/ipv4/netfilter/nf_defrag_ipv4.o
  CC      drivers/acpi/acpica/dswstate.o
  CC      fs/netfs/locking.o
  CC [M]  sound/core/pcm.o
  CC      fs/proc/proc_tty.o
  AR      fs/sysfs/built-in.a
  CC      fs/jbd2/transaction.o
  CC      kernel/irq/dummychip.o
  CC      drivers/pnp/quirks.o
  CC      fs/ramfs/inode.o
  CC      drivers/pnp/system.o
  CC      io_uring/net.o
  CC      fs/hugetlbfs/inode.o
  CC      net/sched/ematch.o
  CC      lib/zstd/decompress/zstd_decompress_block.o
  CC      arch/x86/events/intel/uncore_discovery.o
  CC [M]  sound/pci/hda/hda_eld.o
  CC      fs/netfs/main.o
  CC      drivers/acpi/nvs.o
  CC      security/selinux/ss/symtab.o
  CC      kernel/module/kmod.o
  CC      net/netfilter/nf_sockopt.o
  CC      drivers/acpi/acpica/evevent.o
  CC      fs/ext4/block_validity.o
  CC      fs/ext4/dir.o
  CC      security/selinux/ss/sidtab.o
  CC      crypto/kpp.o
  CC      lib/xz/xz_dec_bcj.o
  CC      arch/x86/events/intel/cstate.o
  CC      lib/crypto/mpi/mpiutil.o
  CC      fs/jbd2/commit.o
  ASN.1   crypto/rsapubkey.asn1.[ch]
  CC      fs/netfs/misc.o
  ASN.1   crypto/rsaprivkey.asn1.[ch]
  AR      arch/x86/kernel/apic/built-in.a
  AR      kernel/dma/built-in.a
  CC      fs/proc/cmdline.o
  CC      crypto/rsa.o
  CC      arch/x86/kernel/signal_32.o
  CC      drivers/acpi/acpica/evgpe.o
  CC      kernel/time/time.o
  CC      net/netfilter/utils.o
  CC      kernel/irq/devres.o
  AR      kernel/rcu/built-in.a
  CC      kernel/time/timer.o
  CC      security/selinux/ss/avtab.o
  CC      fs/ramfs/file-mmu.o
  CC      arch/x86/kernel/cpu/rdrand.o
  CC      fs/fat/cache.o
  CC      drivers/pci/pci-driver.o
  CC      fs/proc/consoles.o
  CC      fs/fat/dir.o
  CC      arch/x86/kernel/cpu/match.o
  CC      net/core/flow_dissector.o
  AR      drivers/pnp/built-in.a
  AR      lib/xz/built-in.a
  CC      fs/fat/fatent.o
  CC      lib/dim/dim.o
  CC      fs/proc/cpuinfo.o
  CC      drivers/acpi/wakeup.o
  CC      lib/dim/net_dim.o
  CC      drivers/acpi/acpica/evgpeblk.o
  CC      fs/jbd2/recovery.o
  CC      net/ipv4/netfilter/nf_reject_ipv4.o
  CC [M]  sound/core/pcm_native.o
  CC      kernel/irq/autoprobe.o
  CC      fs/ext4/ext4_jbd2.o
  CC [M]  sound/pci/hda/hda_intel.o
  CC      lib/zstd/zstd_common_module.o
  AR      lib/crypto/mpi/built-in.a
  CC      lib/crypto/sha256.o
  CC      mm/mmzone.o
  CC      lib/fonts/fonts.o
  CC      arch/x86/kernel/traps.o
  CC      arch/x86/kernel/cpu/bugs.o
  AR      net/sched/built-in.a
  CC      crypto/rsa_helper.o
  CC      arch/x86/kernel/cpu/aperfmperf.o
  CC      net/netfilter/nfnetlink.o
  CC      fs/ext4/extents.o
  CC      lib/zstd/common/debug.o
  CC      arch/x86/kernel/idt.o
  CC      fs/proc/devices.o
  AR      fs/ramfs/built-in.a
  CC      net/ethtool/common.o
  CC      arch/x86/kernel/irq.o
  CC      lib/fonts/font_8x16.o
  CC      crypto/rsa-pkcs1pad.o
  CC      lib/dim/rdma_dim.o
  CC      fs/proc/interrupts.o
  AR      fs/hugetlbfs/built-in.a
  AR      arch/x86/events/intel/built-in.a
  CC      arch/x86/kernel/cpu/cpuid-deps.o
  CC      drivers/acpi/acpica/evgpeinit.o
  CC      kernel/time/hrtimer.o
  CC      arch/x86/events/zhaoxin/core.o
  CC      fs/isofs/namei.o
  CC      fs/proc/loadavg.o
  CC      arch/x86/kernel/cpu/umwait.o
  CC      fs/fat/file.o
  CC      kernel/irq/irqdomain.o
  CC      kernel/time/timekeeping.o
  CC      drivers/pci/search.o
  CC      security/selinux/ss/policydb.o
  CC      kernel/module/tree_lookup.o
  AR      lib/fonts/built-in.a
  CC [M]  sound/core/pcm_lib.o
  CC      net/ipv4/netfilter/ip_tables.o
  CC      mm/vmstat.o
  AR      lib/dim/built-in.a
  CC      fs/isofs/inode.o
  CC      fs/nfs/client.o
  CC      fs/jbd2/checkpoint.o
  CC      fs/exportfs/expfs.o
  CC      fs/nfs/dir.o
  AR      lib/crypto/built-in.a
  CC      fs/nfs/file.o
  CC      fs/jbd2/revoke.o
  CC      drivers/acpi/acpica/evgpeutil.o
  AR      kernel/sched/built-in.a
  CC      io_uring/poll.o
  CC      security/selinux/ss/services.o
  CC      fs/netfs/objects.o
  CC      fs/proc/meminfo.o
  CC      net/netfilter/nfnetlink_log.o
  CC      drivers/acpi/acpica/evglock.o
  CC      io_uring/uring_cmd.o
  CC      fs/jbd2/journal.o
  CC      fs/lockd/clntlock.o
  CC      fs/proc/stat.o
  CC      fs/lockd/clntproc.o
  CC      arch/x86/kernel/irq_32.o
  CC      fs/fat/inode.o
  CC      crypto/acompress.o
  CC      lib/argv_split.o
  CC      lib/zstd/common/entropy_common.o
  CC      net/netfilter/nf_conntrack_core.o
  CC      fs/lockd/clntxdr.o
  CC      kernel/module/kallsyms.o
  CC      drivers/pci/rom.o
  AR      arch/x86/events/zhaoxin/built-in.a
  CC      net/ethtool/netlink.o
  CC      arch/x86/events/core.o
  CC      drivers/acpi/acpica/evhandler.o
  CC      lib/zstd/common/error_private.o
  CC      net/netfilter/nf_conntrack_standalone.o
  CC      lib/zstd/common/fse_decompress.o
  CC      fs/fat/misc.o
  AR      fs/exportfs/built-in.a
  CC      security/selinux/ss/conditional.o
  CC      block/blk-stat.o
  CC      arch/x86/kernel/dumpstack_32.o
  CC      fs/lockd/host.o
  CC      fs/isofs/dir.o
  LD [M]  sound/pci/hda/snd-hda-codec.o
  LD [M]  sound/pci/hda/snd-hda-codec-hdmi.o
  CC      kernel/irq/proc.o
  LD [M]  sound/pci/hda/snd-hda-intel.o
  CC      fs/netfs/write_collect.o
  AR      sound/pci/nm256/built-in.a
  AR      sound/pci/oxygen/built-in.a
  CC      kernel/irq/migration.o
  CC      fs/proc/uptime.o
  AR      sound/pci/pcxhr/built-in.a
  AR      sound/pci/riptide/built-in.a
  AR      sound/pci/rme9652/built-in.a
  AR      sound/pci/trident/built-in.a
  CC      drivers/acpi/acpica/evmisc.o
  CC      fs/nfs/getroot.o
  MKCAP   arch/x86/kernel/cpu/capflags.c
  AR      sound/pci/ymfpci/built-in.a
  AR      sound/pci/vx222/built-in.a
  CC      arch/x86/kernel/time.o
  AR      sound/pci/built-in.a
  CC      arch/x86/kernel/ioport.o
  CC      net/core/sysctl_net_core.o
  AR      sound/ppc/built-in.a
  AR      sound/arm/built-in.a
  AR      sound/sh/built-in.a
  CC      drivers/pci/setup-res.o
  CC      fs/netfs/write_issue.o
  AR      sound/synth/emux/built-in.a
  AR      sound/synth/built-in.a
  CC      kernel/time/ntp.o
  CC      kernel/time/clocksource.o
  CC      lib/zstd/common/zstd_common.o
  CC      crypto/scompress.o
  CC      fs/lockd/svc.o
  CC      kernel/time/jiffies.o
  CC      kernel/module/procfs.o
  AR      lib/zstd/built-in.a
  CC      lib/bug.o
  CC      mm/backing-dev.o
  CC      kernel/time/timer_list.o
  CC      mm/mm_init.o
  CC      drivers/acpi/acpica/evregion.o
  CC      net/ipv4/netfilter/iptable_filter.o
  CC      arch/x86/kernel/dumpstack.o
  CC      net/ipv4/netfilter/iptable_mangle.o
  CC      fs/proc/util.o
  CC      fs/proc/version.o
  CC      arch/x86/kernel/nmi.o
  CC      fs/lockd/svclock.o
  CC      kernel/time/timeconv.o
  CC      fs/isofs/util.o
  CC      kernel/irq/cpuhotplug.o
  CC      block/blk-mq-sysfs.o
  CC      mm/percpu.o
  CC      fs/isofs/rock.o
  CC      fs/isofs/export.o
  AR      sound/usb/misc/built-in.a
  CC [M]  sound/core/pcm_misc.o
  AR      sound/usb/usx2y/built-in.a
  CC [M]  sound/core/pcm_memory.o
  CC      fs/fat/nfs.o
  AR      sound/usb/caiaq/built-in.a
  CC      net/ethtool/bitset.o
  CC      net/netfilter/nf_conntrack_expect.o
  AR      sound/usb/6fire/built-in.a
  CC      io_uring/openclose.o
  AR      sound/usb/hiface/built-in.a
  AR      sound/usb/bcd2000/built-in.a
  AR      sound/usb/built-in.a
  CC [M]  sound/core/memalloc.o
  CC      drivers/acpi/acpica/evrgnini.o
  CC      kernel/module/sysfs.o
  CC      kernel/time/timecounter.o
  CC      mm/slab_common.o
  CC      drivers/pci/irq.o
  CC      fs/proc/softirqs.o
  CC      lib/buildid.o
  CC [M]  sound/core/pcm_timer.o
  CC      kernel/time/alarmtimer.o
  CC      lib/clz_tab.o
  CC      kernel/time/posix-timers.o
  CC      drivers/acpi/acpica/evsci.o
  CC      fs/isofs/joliet.o
  CC      drivers/acpi/acpica/evxface.o
  CC      arch/x86/kernel/ldt.o
  CC      net/ipv4/netfilter/ipt_REJECT.o
  CC      crypto/algboss.o
  CC [M]  net/ipv4/netfilter/iptable_nat.o
  CC      security/selinux/ss/mls.o
  CC      drivers/acpi/sleep.o
  CC      drivers/acpi/acpica/evxfevnt.o
  CC      kernel/irq/pm.o
  CC      arch/x86/events/probe.o
  CC      fs/lockd/svcshare.o
  CC      kernel/time/posix-cpu-timers.o
  CC      net/core/dev.o
  CC      block/blk-mq-cpumap.o
  AR      fs/netfs/built-in.a
  CC      kernel/time/posix-clock.o
  CC      fs/fat/namei_vfat.o
  CC      kernel/time/itimer.o
  CC      block/blk-mq-sched.o
  CC      security/selinux/ss/context.o
  CC      arch/x86/kernel/cpu/powerflags.o
  CC      arch/x86/kernel/cpu/topology.o
  CC      fs/proc/namespaces.o
  CC      fs/nls/nls_base.o
  CC      fs/proc/self.o
  CC      net/netfilter/nf_conntrack_helper.o
  CC      drivers/acpi/acpica/evxfgpe.o
  CC      security/selinux/netlabel.o
  CC      drivers/pci/vpd.o
  CC      net/core/dev_addr_lists.o
  CC      arch/x86/events/utils.o
  AR      kernel/module/built-in.a
  CC      drivers/pci/setup-bus.o
  CC      lib/cmdline.o
  CC      net/ipv4/route.o
  CC      lib/cpumask.o
  CC      mm/compaction.o
  CC      kernel/futex/core.o
  CC      mm/show_mem.o
  CC      kernel/futex/syscalls.o
  CC      fs/isofs/compress.o
  CC      io_uring/sqpoll.o
  CC      net/ipv4/inetpeer.o
  LD [M]  sound/core/snd-hwdep.o
  AR      fs/jbd2/built-in.a
  LD [M]  sound/core/snd-pcm.o
  CC      mm/shmem_quota.o
  AR      sound/core/built-in.a
  AR      sound/firewire/built-in.a
  AR      sound/sparc/built-in.a
  AR      sound/spi/built-in.a
  CC      mm/interval_tree.o
  AR      sound/parisc/built-in.a
  AR      sound/pcmcia/vx/built-in.a
  AR      sound/pcmcia/pdaudiocf/built-in.a
  AR      sound/pcmcia/built-in.a
  AR      sound/mips/built-in.a
  AR      sound/soc/built-in.a
  AR      sound/atmel/built-in.a
  CC      fs/nls/nls_cp437.o
  AR      sound/hda/built-in.a
  CC      net/ethtool/strset.o
  CC [M]  sound/hda/hda_bus_type.o
  CC      drivers/acpi/acpica/evxfregn.o
  CC [M]  sound/hda/hdac_bus.o
  CC      kernel/irq/msi.o
  CC [M]  sound/hda/hdac_device.o
  AR      fs/unicode/built-in.a
  CC      crypto/testmgr.o
  CC      fs/nfs/inode.o
  CC      kernel/futex/pi.o
  CC      fs/autofs/init.o
  CC      kernel/futex/requeue.o
  CC      fs/9p/vfs_super.o
  CC      kernel/futex/waitwake.o
  AR      fs/hostfs/built-in.a
  CC      fs/nfs/super.o
  CC      lib/ctype.o
  CC      fs/proc/thread_self.o
  CC      lib/dec_and_lock.o
  AR      net/ipv4/netfilter/built-in.a
  CC      fs/9p/vfs_inode.o
  CC      fs/debugfs/inode.o
  CC      fs/nls/nls_ascii.o
  CC      fs/lockd/svcproc.o
  CC      arch/x86/events/rapl.o
  CC      net/ipv4/protocol.o
  CC      net/ipv4/ip_input.o
  CC      drivers/acpi/acpica/exconcat.o
  CC      net/netfilter/nf_conntrack_proto.o
  CC      fs/autofs/inode.o
  CC      net/netfilter/nf_conntrack_proto_generic.o
  CC      lib/decompress.o
  CC      kernel/time/clockevents.o
  CC      arch/x86/events/msr.o
  CC      arch/x86/kernel/cpu/proc.o
  CC      fs/fat/namei_msdos.o
  CC      block/ioctl.o
  CC      lib/decompress_bunzip2.o
  CC      arch/x86/kernel/cpu/feat_ctl.o
  CC      security/min_addr.o
  AR      fs/isofs/built-in.a
  CC      fs/tracefs/inode.o
  CC      fs/lockd/svcsubs.o
  CC      crypto/cmac.o
  CC [M]  fs/efivarfs/inode.o
  CC [M]  fs/efivarfs/file.o
  CC      fs/nls/nls_iso8859-1.o
  CC      arch/x86/kernel/setup.o
  CC      fs/ext4/extents_status.o
  CC      arch/x86/kernel/x86_init.o
  CC      arch/x86/kernel/i8259.o
  CC      fs/proc/proc_sysctl.o
  CC      fs/proc/proc_net.o
  CC      arch/x86/kernel/cpu/intel.o
  CC      drivers/acpi/acpica/exconfig.o
  AR      security/selinux/built-in.a
  CC      net/netfilter/nf_conntrack_proto_tcp.o
  CC      net/netfilter/nf_conntrack_proto_udp.o
  AR      drivers/amba/built-in.a
  CC      net/ethtool/linkinfo.o
  AR      drivers/clk/actions/built-in.a
  AR      drivers/clk/analogbits/built-in.a
  AR      drivers/clk/bcm/built-in.a
  CC      net/ethtool/linkmodes.o
  AR      drivers/clk/imgtec/built-in.a
  AR      drivers/clk/imx/built-in.a
  AR      kernel/futex/built-in.a
  CC      fs/debugfs/file.o
  AR      drivers/clk/ingenic/built-in.a
  AR      drivers/clk/mediatek/built-in.a
  AR      drivers/clk/microchip/built-in.a
  CC [M]  sound/hda/hdac_sysfs.o
  AR      drivers/clk/mstar/built-in.a
  AR      drivers/clk/mvebu/built-in.a
  CC      arch/x86/kernel/irqinit.o
  AR      drivers/clk/ralink/built-in.a
  CC      drivers/pci/vc.o
  AR      drivers/clk/renesas/built-in.a
  AR      drivers/clk/socfpga/built-in.a
  CC [M]  sound/hda/hdac_regmap.o
  CC      fs/nls/nls_utf8.o
  AR      drivers/clk/sophgo/built-in.a
  AR      drivers/clk/sprd/built-in.a
  CC      kernel/time/tick-common.o
  AR      drivers/clk/starfive/built-in.a
  CC      kernel/irq/affinity.o
  CC      crypto/hmac.o
  AR      drivers/clk/sunxi-ng/built-in.a
  AR      drivers/clk/ti/built-in.a
  CC      net/ethtool/rss.o
  CC      fs/autofs/root.o
  CC      security/security.o
  CC      lib/decompress_inflate.o
  CC      drivers/pci/mmap.o
  CC      drivers/acpi/acpica/exconvrt.o
  CC      net/ipv4/ip_fragment.o
  CC      net/netfilter/nf_conntrack_proto_icmp.o
  AR      drivers/clk/versatile/built-in.a
  CC [M]  fs/efivarfs/super.o
  AR      drivers/clk/xilinx/built-in.a
  CC [M]  fs/efivarfs/vars.o
  CC      io_uring/xattr.o
  AR      arch/x86/events/built-in.a
  AR      drivers/clk/built-in.a
  AR      fs/fat/built-in.a
  CC      fs/9p/vfs_inode_dotl.o
  CC      drivers/acpi/acpica/excreate.o
  CC      fs/9p/vfs_addr.o
  CC      fs/lockd/mon.o
  CC      drivers/acpi/device_sysfs.o
  CC      kernel/irq/matrix.o
  AR      fs/nls/built-in.a
  CC      drivers/acpi/device_pm.o
  CC      net/core/dst.o
  CC      fs/tracefs/event_inode.o
  CC      block/genhd.o
  CC      fs/lockd/trace.o
  AR      sound/x86/built-in.a
  CC      fs/ext4/file.o
  CC      fs/ext4/fsmap.o
  CC      fs/proc/kcore.o
  CC      drivers/acpi/acpica/exdebug.o
  CC      drivers/acpi/acpica/exdump.o
  CC      lib/decompress_unlz4.o
  CC      fs/9p/vfs_file.o
  CC      lib/decompress_unlzma.o
  AR      sound/xen/built-in.a
  CC      kernel/time/tick-broadcast.o
  CC      security/lsm_audit.o
  CC      net/ethtool/linkstate.o
  CC      crypto/crypto_null.o
  CC      arch/x86/kernel/jump_label.o
  CC      crypto/md5.o
  CC [M]  sound/hda/hdac_controller.o
  CC      arch/x86/kernel/irq_work.o
  CC      drivers/pci/devres.o
  CC      drivers/acpi/acpica/exfield.o
  CC      arch/x86/kernel/cpu/intel_pconfig.o
  AR      fs/debugfs/built-in.a
  CC      arch/x86/kernel/cpu/tsx.o
  CC      arch/x86/kernel/cpu/intel_epb.o
  CC      fs/nfs/io.o
  CC      fs/nfs/direct.o
  CC [M]  sound/hda/hdac_stream.o
  CC      fs/proc/vmcore.o
  CC      fs/autofs/symlink.o
  CC      drivers/acpi/proc.o
  CC      fs/open.o
  LD [M]  fs/efivarfs/efivarfs.o
  CC      crypto/sha256_generic.o
  CC      security/device_cgroup.o
  CC      arch/x86/kernel/cpu/amd.o
  CC      fs/proc/kmsg.o
  CC      fs/9p/vfs_dir.o
  CC      fs/proc/page.o
  CC      io_uring/nop.o
  CC      io_uring/fs.o
  CC      drivers/acpi/acpica/exfldio.o
  CC      kernel/cgroup/cgroup.o
  CC      kernel/trace/trace_clock.o
  CC      kernel/trace/ring_buffer.o
  AR      fs/tracefs/built-in.a
  CC      fs/9p/vfs_dentry.o
  CC      net/netfilter/nf_conntrack_extend.o
  CC      kernel/time/tick-broadcast-hrtimer.o
  CC      kernel/time/tick-oneshot.o
  CC      kernel/time/tick-sched.o
  CC      block/ioprio.o
  CC      fs/ext4/fsync.o
  CC      net/ipv4/ip_forward.o
  CC      lib/decompress_unlzo.o
  CC      net/ipv4/ip_options.o
  CC      mm/list_lru.o
  CC      arch/x86/kernel/cpu/hygon.o
  CC      drivers/acpi/bus.o
  CC      block/badblocks.o
  CC      drivers/pci/proc.o
  AR      kernel/irq/built-in.a
  CC      fs/lockd/xdr.o
  CC      kernel/cgroup/rstat.o
  CC      kernel/bpf/core.o
  CC      net/core/netevent.o
  CC      block/blk-rq-qos.o
  CC      block/disk-events.o
  CC      fs/autofs/waitq.o
  CC      kernel/trace/trace.o
  CC      net/ethtool/debug.o
  CC      drivers/acpi/acpica/exmisc.o
  CC      crypto/sha512_generic.o
  CC      fs/autofs/expire.o
  CC      fs/ext4/hash.o
  CC      block/blk-ia-ranges.o
  CC      arch/x86/kernel/probe_roms.o
  CC      fs/autofs/dev-ioctl.o
  CC      block/early-lookup.o
  CC      fs/9p/v9fs.o
  CC      fs/nfs/pagelist.o
  CC [M]  sound/hda/array.o
  CC      fs/9p/fid.o
  CC      drivers/dma/dw/core.o
  CC [M]  sound/hda/hdmi_chmap.o
  CC      drivers/dma/hsu/hsu.o
  CC      lib/decompress_unxz.o
  AR      fs/proc/built-in.a
  CC      drivers/pci/pci-sysfs.o
  AR      drivers/dma/idxd/built-in.a
  CC      fs/9p/xattr.o
  CC      io_uring/splice.o
  AR      drivers/dma/mediatek/built-in.a
  AR      sound/virtio/built-in.a
  CC      drivers/acpi/acpica/exmutex.o
  CC      drivers/acpi/acpica/exnames.o
  CC      mm/workingset.o
  CC      drivers/acpi/acpica/exoparg1.o
  CC      io_uring/sync.o
  CC      drivers/pci/slot.o
  CC      net/core/neighbour.o
  CC      drivers/dma/dw/dw.o
  CC      net/netfilter/nf_conntrack_acct.o
  CC      mm/debug.o
  CC      kernel/time/timer_migration.o
  CC      lib/decompress_unzstd.o
  CC      sound/sound_core.o
  CC      kernel/time/vsyscall.o
  CC      kernel/time/timekeeping_debug.o
  CC      drivers/dma/dw/idma32.o
  CC      lib/dump_stack.o
  CC [M]  sound/hda/trace.o
  CC      drivers/pci/pci-acpi.o
  CC      crypto/sha3_generic.o
  AR      drivers/dma/qcom/built-in.a
  CC      drivers/acpi/acpica/exoparg2.o
  CC      fs/read_write.o
  CC      block/bounce.o
  AR      drivers/dma/ti/built-in.a
  AR      drivers/soc/apple/built-in.a
  CC      net/ethtool/wol.o
  AR      drivers/dma/xilinx/built-in.a
  AR      drivers/soc/aspeed/built-in.a
  AR      drivers/soc/bcm/built-in.a
  CC      fs/ext4/ialloc.o
  CC      fs/ext4/indirect.o
  AR      fs/autofs/built-in.a
  AR      drivers/soc/fsl/built-in.a
  AR      security/built-in.a
  CC      drivers/virtio/virtio.o
  CC      drivers/virtio/virtio_ring.o
  AR      drivers/soc/fujitsu/built-in.a
  CC      drivers/virtio/virtio_anchor.o
  CC      drivers/tty/vt/vt_ioctl.o
  CC      arch/x86/kernel/cpu/centaur.o
  AR      drivers/soc/hisilicon/built-in.a
  CC      fs/file_table.o
  CC      net/ethtool/features.o
  CC      arch/x86/kernel/sys_ia32.o
  AR      drivers/soc/imx/built-in.a
  CC      net/ipv4/ip_output.o
  CC      fs/lockd/clnt4xdr.o
  AR      drivers/soc/ixp4xx/built-in.a
  AR      drivers/soc/loongson/built-in.a
  AR      drivers/soc/mediatek/built-in.a
  AR      drivers/soc/microchip/built-in.a
  AR      drivers/dma/hsu/built-in.a
  CC      drivers/virtio/virtio_pci_modern_dev.o
  AR      drivers/soc/nuvoton/built-in.a
  AR      drivers/soc/pxa/built-in.a
  AR      fs/9p/built-in.a
  CC      fs/super.o
  AR      drivers/soc/amlogic/built-in.a
  AR      drivers/soc/qcom/built-in.a
  CC      net/ethtool/privflags.o
  AR      drivers/soc/renesas/built-in.a
  CC      drivers/tty/vt/vc_screen.o
  AR      drivers/soc/rockchip/built-in.a
  CC      kernel/time/namespace.o
  AR      drivers/soc/sunxi/built-in.a
  AR      drivers/soc/ti/built-in.a
  AR      drivers/soc/xilinx/built-in.a
  CC      lib/earlycpio.o
  AR      drivers/soc/built-in.a
  CC      drivers/virtio/virtio_pci_legacy_dev.o
  CC      drivers/tty/hvc/hvc_console.o
  CC      drivers/acpi/acpica/exoparg3.o
  CC      kernel/cgroup/namespace.o
  CC      kernel/cgroup/cgroup-v1.o
  CC      fs/nfs/read.o
  CC      drivers/acpi/acpica/exoparg6.o
  CC      crypto/ecb.o
  CC      io_uring/msg_ring.o
  CC      lib/extable.o
  CC      arch/x86/kernel/cpu/transmeta.o
  CC      drivers/acpi/acpica/exprep.o
  AR      drivers/tty/ipwireless/built-in.a
  CC      drivers/pci/iomap.o
  CC      block/bsg.o
  CC      drivers/tty/serial/8250/8250_core.o
  CC      drivers/acpi/glue.o
  CC      drivers/dma/dw/acpi.o
  CC      mm/gup.o
  CC      drivers/pci/quirks.o
  CC      drivers/virtio/virtio_pci_modern.o
  CC      fs/char_dev.o
  CC      fs/ext4/inline.o
  CC      net/netfilter/nf_conntrack_seqadj.o
  CC      drivers/dma/dmaengine.o
  CC [M]  sound/hda/hdac_component.o
  CC      drivers/acpi/acpica/exregion.o
  CC      drivers/tty/serial/serial_core.o
  CC      lib/flex_proportions.o
  CC      drivers/acpi/scan.o
  CC      crypto/cbc.o
  CC      drivers/acpi/mipi-disco-img.o
  CC      drivers/acpi/resource.o
  CC      drivers/virtio/virtio_pci_common.o
  CC      drivers/acpi/acpi_processor.o
  CC      drivers/virtio/virtio_pci_legacy.o
  CC      drivers/acpi/acpica/exresnte.o
  CC      lib/idr.o
  CC      arch/x86/kernel/cpu/zhaoxin.o
  CC      drivers/tty/serial/8250/8250_pnp.o
  CC      drivers/tty/vt/selection.o
  CC      net/xfrm/xfrm_policy.o
  CC      net/ethtool/rings.o
  CC      fs/lockd/xdr4.o
  CC      block/blk-cgroup.o
  AR      drivers/tty/hvc/built-in.a
  AR      drivers/dma/dw/built-in.a
  CC      drivers/pci/pci-label.o
  CC      kernel/trace/trace_output.o
  CC      drivers/pci/vgaarb.o
  CC      drivers/tty/vt/keyboard.o
  CC      kernel/cgroup/freezer.o
  CC      arch/x86/kernel/cpu/vortex.o
  CC      crypto/ctr.o
  AR      kernel/time/built-in.a
  CC      arch/x86/kernel/cpu/perfctr-watchdog.o
  CC      io_uring/advise.o
  CC      drivers/acpi/acpica/exresolv.o
  CC      kernel/events/core.o
  CC      io_uring/epoll.o
  CC      io_uring/statx.o
  CC      kernel/cgroup/legacy_freezer.o
  AR      kernel/bpf/built-in.a
  CC [M]  sound/hda/hdac_i915.o
  CC      crypto/gcm.o
  CC      kernel/trace/trace_seq.o
  CC      lib/irq_regs.o
  CC      crypto/ccm.o
  CC      block/blk-ioprio.o
  CC      net/xfrm/xfrm_state.o
  CC      drivers/acpi/acpica/exresop.o
  CC      crypto/aes_generic.o
  CC      block/blk-iolatency.o
  CC      block/blk-iocost.o
  CC      drivers/tty/serial/8250/8250_port.o
  CC      net/core/rtnetlink.o
  CC      lib/is_single_threaded.o
  CC      drivers/tty/tty_io.o
  CC      drivers/virtio/virtio_pci_admin_legacy_io.o
  CC      net/xfrm/xfrm_hash.o
  CC      drivers/dma/virt-dma.o
  CC      drivers/acpi/acpica/exserial.o
  CC      io_uring/timeout.o
  CC      fs/ext4/inode.o
  CC      drivers/dma/acpi-dma.o
  CC      arch/x86/kernel/cpu/vmware.o
  CC      net/netfilter/nf_conntrack_proto_icmpv6.o
  CC      net/ipv4/ip_sockglue.o
  CC      fs/stat.o
  CC      arch/x86/kernel/ksysfs.o
  CC      lib/klist.o
  CC      net/ethtool/channels.o
  CC      kernel/cgroup/pids.o
  CC [M]  sound/hda/intel-dsp-config.o
  CC      fs/ext4/ioctl.o
  CC      io_uring/fdinfo.o
  CC      drivers/acpi/acpica/exstore.o
  CC      arch/x86/kernel/cpu/hypervisor.o
  CC      fs/exec.o
  CC      net/ipv4/inet_hashtables.o
  CC      net/core/utils.o
  CC      drivers/tty/serial/8250/8250_dma.o
  CC      lib/kobject.o
  CC      fs/lockd/svc4proc.o
  CC      mm/mmap_lock.o
  CC      drivers/acpi/processor_core.o
  CC      mm/highmem.o
  CC      crypto/crc32c_generic.o
  CC      net/xfrm/xfrm_input.o
  CC      net/core/link_watch.o
  CC      drivers/acpi/acpica/exstoren.o
  CC      fs/lockd/procfs.o
  CC      fs/nfs/symlink.o
  CC      drivers/virtio/virtio_input.o
  CC      kernel/trace/trace_stat.o
  CC      drivers/virtio/virtio_dma_buf.o
  CC      fs/nfs/unlink.o
  CC      crypto/authenc.o
  CC      arch/x86/kernel/cpu/mshyperv.o
  CC [M]  sound/hda/intel-nhlt.o
  CC      drivers/acpi/processor_pdc.o
  CC      drivers/tty/serial/8250/8250_dwlib.o
  CC      drivers/tty/vt/vt.o
  AR      drivers/pci/built-in.a
  CC      net/ethtool/coalesce.o
  CC      kernel/fork.o
  AR      drivers/dma/built-in.a
  CC      lib/kobject_uevent.o
  CC      net/core/filter.o
  CC      net/core/sock_diag.o
  CC      drivers/acpi/acpica/exstorob.o
  CC      kernel/cgroup/rdma.o
  CC      arch/x86/kernel/bootflag.o
  CC      lib/logic_pio.o
  CC      arch/x86/kernel/e820.o
  CC      drivers/acpi/acpica/exsystem.o
  CC      arch/x86/kernel/pci-dma.o
  CC      block/mq-deadline.o
  COPY    drivers/tty/vt/defkeymap.c
  CC      lib/maple_tree.o
  CC      block/kyber-iosched.o
  CC      net/ethtool/pause.o
  CC      crypto/authencesn.o
  CC [M]  sound/hda/intel-sdw-acpi.o
  CC      io_uring/cancel.o
  CC      drivers/tty/serial/serial_base_bus.o
  CC      fs/pipe.o
  CC      drivers/acpi/acpica/extrace.o
  AR      drivers/virtio/built-in.a
  CC      fs/namei.o
  CC      drivers/char/hw_random/core.o
  CC      kernel/trace/trace_printk.o
  CC      drivers/char/hw_random/intel-rng.o
  CC      mm/memory.o
  CC      drivers/tty/serial/8250/8250_pcilib.o
  CC      net/netfilter/nf_conntrack_netlink.o
  CC      drivers/char/agp/backend.o
  CC      drivers/char/mem.o
  CC      fs/fcntl.o
  CC      arch/x86/kernel/cpu/debugfs.o
  AR      fs/lockd/built-in.a
  CC      net/core/dev_ioctl.o
  CC      kernel/exec_domain.o
  CC      net/ethtool/eee.o
  CC      fs/ioctl.o
  CC      kernel/cgroup/cpuset.o
  CC      fs/nfs/write.o
  CC      block/blk-mq-pci.o
  CC      drivers/acpi/acpica/exutils.o
  LD [M]  sound/hda/snd-hda-core.o
  LD [M]  sound/hda/snd-intel-dspcfg.o
  LD [M]  sound/hda/snd-intel-sdw-acpi.o
  CC      sound/last.o
  CC      arch/x86/kernel/quirks.o
  CC      net/core/tso.o
  CC      lib/memcat_p.o
  CC      net/ipv4/inet_timewait_sock.o
  CC      drivers/char/hw_random/amd-rng.o
  CC      net/xfrm/xfrm_output.o
  CC      kernel/panic.o
  CC      drivers/tty/vt/consolemap.o
  CC      drivers/tty/serial/8250/8250_early.o
  CC      arch/x86/kernel/cpu/capflags.o
  CC      drivers/acpi/acpica/hwacpi.o
  AR      arch/x86/kernel/cpu/built-in.a
  HOSTCC  drivers/tty/vt/conmakehash
  CC      kernel/trace/pid_list.o
  CC      drivers/char/agp/generic.o
  CC      drivers/char/agp/isoch.o
  CC      net/ipv4/inet_connection_sock.o
  CC      arch/x86/kernel/kdebugfs.o
  CC      net/ipv4/tcp.o
  CC      crypto/lzo.o
  CC      io_uring/waitid.o
  AR      sound/built-in.a
  CC      net/ipv4/tcp_input.o
  CC      fs/nfs/namespace.o
  CC      drivers/char/agp/amd64-agp.o
  CC      kernel/trace/trace_sched_switch.o
  CC      crypto/lzo-rle.o
  CC      fs/nfs/mount_clnt.o
  CC      fs/readdir.o
  CC      drivers/acpi/acpica/hwesleep.o
  CC      net/ipv4/tcp_output.o
  CC      block/blk-mq-virtio.o
  CC      drivers/tty/vt/defkeymap.o
  CC      drivers/char/random.o
  CONMK   drivers/tty/vt/consolemap_deftbl.c
  CC      fs/select.o
  CC      drivers/acpi/acpica/hwgpe.o
  CC      fs/dcache.o
  CC      net/ethtool/tsinfo.o
  CC      arch/x86/kernel/alternative.o
  CC      arch/x86/kernel/i8253.o
  CC      drivers/char/hw_random/geode-rng.o
  CC      drivers/tty/vt/consolemap_deftbl.o
  CC      drivers/char/misc.o
  CC      drivers/char/virtio_console.o
  CC      drivers/tty/serial/8250/8250_exar.o
  CC      drivers/tty/serial/serial_ctrl.o
  CC      io_uring/register.o
  CC      crypto/rng.o
  CC      drivers/acpi/acpica/hwregs.o
  CC      net/core/sock_reuseport.o
  CC      fs/nfs/nfstrace.o
  CC      net/ethtool/cabletest.o
  CC      drivers/char/agp/intel-agp.o
  CC      net/ipv4/tcp_timer.o
  CC      drivers/acpi/ec.o
  CC      drivers/acpi/acpica/hwsleep.o
  AR      drivers/tty/vt/built-in.a
  AR      drivers/iommu/amd/built-in.a
  AR      drivers/gpu/host1x/built-in.a
  AR      drivers/iommu/intel/built-in.a
  CC      drivers/connector/cn_queue.o
  AR      drivers/iommu/arm/arm-smmu/built-in.a
  AR      drivers/iommu/arm/arm-smmu-v3/built-in.a
  CC      drivers/connector/connector.o
  AR      drivers/iommu/arm/built-in.a
  CC      drivers/base/power/sysfs.o
  AR      drivers/iommu/iommufd/built-in.a
  CC      block/blk-mq-debugfs.o
  CC      drivers/iommu/iommu.o
  CC      drivers/base/firmware_loader/builtin/main.o
  CC      drivers/base/firmware_loader/main.o
  CC      drivers/base/regmap/regmap.o
  CC      drivers/char/hw_random/via-rng.o
  AR      drivers/gpu/drm/tests/built-in.a
  CC      crypto/drbg.o
  CC      kernel/cpu.o
  AR      drivers/gpu/drm/arm/built-in.a
  CC      drivers/gpu/drm/display/drm_display_helper_mod.o
  CC      drivers/gpu/drm/display/drm_dp_dual_mode_helper.o
  CC      drivers/acpi/acpica/hwvalid.o
  CC      crypto/jitterentropy.o
  CC      net/ipv4/tcp_ipv4.o
  CC      drivers/gpu/drm/display/drm_dp_helper.o
  CC      net/xfrm/xfrm_sysctl.o
  CC      drivers/base/regmap/regcache.o
  CC      drivers/tty/serial/8250/8250_lpss.o
  AR      drivers/base/firmware_loader/builtin/built-in.a
  CC      arch/x86/kernel/hw_breakpoint.o
  CC      lib/nmi_backtrace.o
  CC      net/netfilter/nf_conntrack_ftp.o
  CC      kernel/trace/trace_nop.o
  CC      drivers/char/agp/intel-gtt.o
  AR      drivers/char/hw_random/built-in.a
  CC      drivers/iommu/iommu-traces.o
  CC      kernel/trace/blktrace.o
  CC      net/xfrm/xfrm_replay.o
  CC      drivers/base/power/generic_ops.o
  CC      drivers/gpu/drm/display/drm_dp_mst_topology.o
  CC      kernel/cgroup/misc.o
  CC      drivers/acpi/acpica/hwxface.o
  CC      arch/x86/kernel/tsc.o
  CC      net/ethtool/tunnels.o
  CC      net/ethtool/fec.o
  CC      drivers/base/regmap/regcache-rbtree.o
  CC      fs/inode.o
  CC      net/core/fib_notifier.o
  CC      lib/objpool.o
  CC      block/blk-pm.o
  CC      drivers/connector/cn_proc.o
  CC      net/core/xdp.o
  CC      drivers/acpi/acpica/hwxfsleep.o
  CC      net/ipv4/tcp_minisocks.o
  CC      drivers/base/power/common.o
  CC      drivers/acpi/acpica/hwpci.o
  CC      crypto/jitterentropy-kcapi.o
  AR      drivers/base/firmware_loader/built-in.a
  CC      drivers/tty/serial/8250/8250_mid.o
  CC      drivers/acpi/acpica/nsaccess.o
  AR      drivers/base/test/built-in.a
  CC      drivers/tty/serial/8250/8250_pci.o
  CC      net/core/flow_offload.o
  CC      kernel/cgroup/debug.o
  CC      drivers/tty/serial/8250/8250_pericom.o
  CC      io_uring/truncate.o
  CC      drivers/gpu/drm/ttm/ttm_tt.o
  CC      io_uring/memmap.o
  CC      drivers/gpu/drm/ttm/ttm_bo.o
  CC      io_uring/io-wq.o
  CC      fs/ext4/mballoc.o
  CC      drivers/acpi/dock.o
  CC      arch/x86/kernel/tsc_msr.o
  CC      kernel/events/ring_buffer.o
  CC      lib/plist.o
  CC      mm/mincore.o
  CC      arch/x86/kernel/io_delay.o
  CC      drivers/acpi/acpica/nsalloc.o
  AR      drivers/char/agp/built-in.a
  CC      drivers/iommu/iommu-sysfs.o
  CC      drivers/char/hpet.o
  CC      crypto/ghash-generic.o
  CC      drivers/base/power/qos.o
  CC      drivers/base/regmap/regcache-flat.o
  CC      drivers/iommu/dma-iommu.o
  CC      block/holder.o
  CC      drivers/gpu/drm/i915/i915_config.o
  CC      drivers/gpu/drm/i915/i915_driver.o
  CC      arch/x86/kernel/rtc.o
  CC      net/netfilter/nf_conntrack_irc.o
  AR      drivers/gpu/drm/renesas/rcar-du/built-in.a
  CC      net/netfilter/nf_conntrack_sip.o
  AR      drivers/gpu/drm/renesas/rz-du/built-in.a
  CC      net/xfrm/xfrm_device.o
  CC      net/netfilter/nf_nat_core.o
  AR      drivers/gpu/drm/renesas/built-in.a
  CC      net/core/gro.o
  CC      drivers/gpu/drm/i915/i915_drm_client.o
  CC      kernel/events/callchain.o
  CC      kernel/exit.o
  CC      net/ethtool/eeprom.o
  AR      kernel/cgroup/built-in.a
  CC      arch/x86/kernel/resource.o
  CC      drivers/acpi/acpica/nsarguments.o
  CC      drivers/acpi/pci_root.o
  CC      net/xfrm/xfrm_algo.o
  CC      crypto/hash_info.o
  CC      lib/radix-tree.o
  CC      crypto/rsapubkey.asn1.o
  AR      drivers/connector/built-in.a
  CC      mm/mlock.o
  CC      drivers/acpi/acpica/nsconvert.o
  CC      mm/mmap.o
  CC      drivers/gpu/drm/i915/i915_getparam.o
  CC      crypto/rsaprivkey.asn1.o
  AR      crypto/built-in.a
  CC      drivers/char/nvram.o
  CC      net/core/netdev-genl.o
  CC      drivers/block/loop.o
  CC      net/ethtool/stats.o
  CC      drivers/block/virtio_blk.o
  CC      drivers/gpu/drm/ttm/ttm_bo_util.o
  CC      kernel/trace/trace_events.o
  CC      net/core/netdev-genl-gen.o
  CC      drivers/tty/n_tty.o
  CC      net/unix/af_unix.o
  AR      drivers/tty/serial/8250/built-in.a
  CC      drivers/tty/serial/serial_port.o
  CC      net/unix/garbage.o
  AR      block/built-in.a
  AS      arch/x86/kernel/irqflags.o
  CC      arch/x86/kernel/static_call.o
  CC      net/ipv6/af_inet6.o
  CC      net/ipv6/netfilter/ip6_tables.o
  CC      net/ipv6/anycast.o
  CC      net/packet/af_packet.o
  AR      net/dsa/built-in.a
  CC      drivers/acpi/acpica/nsdump.o
  CC      net/ipv6/netfilter/ip6table_filter.o
  CC      arch/x86/kernel/process.o
  CC      drivers/base/regmap/regcache-maple.o
  CC      kernel/events/hw_breakpoint.o
  CC      drivers/tty/serial/earlycon.o
  CC      io_uring/futex.o
  CC      drivers/base/power/runtime.o
  CC      net/xfrm/xfrm_user.o
  CC      arch/x86/kernel/ptrace.o
  CC      drivers/acpi/acpica/nseval.o
  CC      drivers/acpi/pci_link.o
  AR      drivers/char/built-in.a
  CC      kernel/events/uprobes.o
  CC      net/ethtool/phc_vclocks.o
  CC      kernel/softirq.o
  CC      lib/ratelimit.o
  CC      net/core/gso.o
  CC      drivers/gpu/drm/i915/i915_ioctl.o
  CC      drivers/gpu/drm/display/drm_dsc_helper.o
  CC      drivers/gpu/drm/ttm/ttm_bo_vm.o
  CC      drivers/base/regmap/regmap-debugfs.o
  CC      arch/x86/kernel/tls.o
  CC      drivers/iommu/iova.o
  AR      drivers/misc/eeprom/built-in.a
  AR      drivers/misc/cb710/built-in.a
  AR      drivers/misc/ti-st/built-in.a
  CC      lib/rbtree.o
  CC      net/ipv6/netfilter/ip6table_mangle.o
  AR      drivers/misc/lis3lv02d/built-in.a
  AR      drivers/misc/cardreader/built-in.a
  AR      drivers/misc/built-in.a
  AR      drivers/mfd/built-in.a
  AR      drivers/nfc/built-in.a
  AR      drivers/dax/hmem/built-in.a
  CC      drivers/acpi/acpica/nsinit.o
  CC      net/ipv4/tcp_cong.o
  AR      drivers/dax/built-in.a
  CC      net/ipv6/ip6_output.o
  CC      drivers/gpu/drm/display/drm_hdcp_helper.o
  CC      net/ipv6/ip6_input.o
  CC      net/ipv4/tcp_metrics.o
  CC      drivers/gpu/drm/display/drm_hdmi_helper.o
  CC      drivers/dma-buf/dma-buf.o
  CC      mm/mmu_gather.o
  AR      drivers/tty/serial/built-in.a
  CC      net/netfilter/nf_nat_proto.o
  CC      drivers/tty/tty_ioctl.o
  CC      net/ipv4/tcp_fastopen.o
  CC      net/ipv4/tcp_rate.o
  CC      lib/seq_buf.o
  CC      drivers/tty/tty_ldisc.o
  CC      net/ipv6/addrconf.o
  CC      fs/attr.o
  CC      net/netfilter/nf_nat_helper.o
  CC      io_uring/napi.o
  AR      drivers/block/built-in.a
  CC      drivers/acpi/acpica/nsload.o
  CC      fs/bad_inode.o
  CC      drivers/tty/tty_buffer.o
  AR      drivers/cxl/core/built-in.a
  AR      drivers/cxl/built-in.a
  CC      drivers/acpi/pci_irq.o
  CC      kernel/resource.o
  CC      drivers/base/power/wakeirq.o
  AR      drivers/base/regmap/built-in.a
  CC      drivers/acpi/acpica/nsnames.o
  CC      drivers/gpu/drm/ttm/ttm_module.o
  CC      drivers/acpi/acpica/nsobject.o
  CC      drivers/acpi/acpica/nsparse.o
  CC      fs/nfs/export.o
  CC      net/ethtool/mm.o
  CC      drivers/dma-buf/dma-fence.o
  CC      arch/x86/kernel/step.o
  CC      drivers/gpu/drm/display/drm_scdc_helper.o
  AR      drivers/iommu/built-in.a
  CC      net/ethtool/module.o
  CC      drivers/acpi/acpi_apd.o
  CC      drivers/gpu/drm/i915/i915_irq.o
  CC      drivers/acpi/acpi_platform.o
  CC      net/core/net-sysfs.o
  CC      net/core/hotdata.o
  CC      net/ipv6/netfilter/nf_defrag_ipv6_hooks.o
  CC      drivers/dma-buf/dma-fence-array.o
  CC      lib/siphash.o
  CC      fs/nfs/sysfs.o
  CC      arch/x86/kernel/i8237.o
  CC      drivers/base/power/main.o
  CC      drivers/dma-buf/dma-fence-chain.o
  CC      drivers/dma-buf/dma-fence-unwrap.o
  CC      drivers/acpi/acpica/nspredef.o
  CC      drivers/acpi/acpi_pnp.o
  AR      drivers/gpu/drm/omapdrm/built-in.a
  CC      fs/nfs/fs_context.o
  CC      drivers/gpu/drm/ttm/ttm_execbuf_util.o
  CC      mm/mprotect.o
  CC      fs/ext4/migrate.o
  CC      kernel/trace/trace_export.o
  CC      arch/x86/kernel/stacktrace.o
  CC      kernel/trace/trace_event_perf.o
  CC      kernel/trace/trace_events_filter.o
  AR      kernel/events/built-in.a
  CC      drivers/acpi/power.o
  CC      net/sunrpc/auth_gss/auth_gss.o
  CC      drivers/tty/tty_port.o
  AR      net/wireless/tests/built-in.a
  AR      net/mac80211/tests/built-in.a
  CC      net/wireless/core.o
  CC      net/wireless/sysfs.o
  CC      net/mac80211/main.o
  CC      net/sunrpc/clnt.o
  CC      net/unix/sysctl_net_unix.o
  CC      drivers/acpi/acpica/nsprepkg.o
  CC      net/sunrpc/auth_gss/gss_generic_token.o
  CC      drivers/macintosh/mac_hid.o
  CC      lib/string.o
  CC      drivers/gpu/drm/i915/i915_mitigations.o
  AR      drivers/gpu/drm/display/built-in.a
  AR      drivers/scsi/pcmcia/built-in.a
  CC      drivers/scsi/scsi.o
  CC      lib/timerqueue.o
  CC      net/netlabel/netlabel_user.o
  CC      drivers/gpu/drm/i915/i915_module.o
  CC      net/netlabel/netlabel_kapi.o
  CC      drivers/acpi/event.o
  CC      net/ipv4/tcp_recovery.o
  CC      drivers/gpu/drm/ttm/ttm_range_manager.o
  CC      drivers/dma-buf/dma-resv.o
  CC      fs/file.o
  CC      net/ethtool/pse-pd.o
  CC      net/ipv6/addrlabel.o
  CC      lib/vsprintf.o
  CC      net/netlabel/netlabel_domainhash.o
  CC      net/netfilter/nf_nat_masquerade.o
  CC      net/netlabel/netlabel_addrlist.o
  CC      drivers/gpu/drm/ttm/ttm_resource.o
  CC      arch/x86/kernel/reboot.o
  CC      drivers/dma-buf/sync_file.o
  AR      io_uring/built-in.a
  CC      net/wireless/radiotap.o
  CC      drivers/acpi/acpica/nsrepair.o
  CC      fs/filesystems.o
  AR      net/xfrm/built-in.a
  CC      net/rfkill/core.o
  CC      net/rfkill/input.o
  AR      drivers/macintosh/built-in.a
  CC      drivers/acpi/evged.o
  CC      drivers/acpi/sysfs.o
  CC      net/wireless/util.o
  CC      net/ipv6/netfilter/nf_conntrack_reasm.o
  CC      drivers/tty/tty_mutex.o
  CC      fs/ext4/mmp.o
  AR      net/packet/built-in.a
  CC      kernel/trace/trace_events_trigger.o
  CC      mm/mremap.o
  CC      kernel/trace/trace_eprobe.o
  CC      lib/win_minmax.o
  AR      net/unix/built-in.a
  CC      lib/xarray.o
  CC      net/9p/mod.o
  CC      drivers/acpi/acpica/nsrepair2.o
  CC      net/9p/client.o
  CC      arch/x86/kernel/msr.o
  CC      mm/msync.o
  CC      net/9p/error.o
  CC      net/netlabel/netlabel_mgmt.o
  AR      drivers/dma-buf/built-in.a
  CC      fs/nfs/nfsroot.o
  CC      kernel/trace/trace_kprobe.o
  CC      drivers/tty/tty_ldsem.o
  CC      net/core/net-procfs.o
  CC      net/ipv6/netfilter/nf_reject_ipv6.o
  CC      mm/page_vma_mapped.o
  CC      lib/lockref.o
  CC      drivers/base/power/wakeup.o
  CC      kernel/trace/error_report-traces.o
  CC      kernel/trace/power-traces.o
  CC      drivers/gpu/drm/i915/i915_params.o
  CC      drivers/gpu/drm/ttm/ttm_pool.o
  CC      net/ethtool/plca.o
  CC      net/ipv6/netfilter/ip6t_ipv6header.o
  CC      drivers/acpi/acpica/nssearch.o
  AR      drivers/nvme/common/built-in.a
  CC      drivers/ata/libata-core.o
  AR      drivers/nvme/host/built-in.a
  CC      net/ipv4/tcp_ulp.o
  AR      drivers/nvme/target/built-in.a
  AR      drivers/nvme/built-in.a
  CC      drivers/net/phy/mdio-boardinfo.o
  CC      drivers/ata/libata-scsi.o
  AR      drivers/net/phy/qcom/built-in.a
  CC      drivers/scsi/hosts.o
  CC      drivers/net/phy/stubs.o
  CC      net/netlabel/netlabel_unlabeled.o
  CC      drivers/acpi/acpica/nsutils.o
  AR      drivers/net/pse-pd/built-in.a
  CC      drivers/acpi/acpica/nswalk.o
  CC      lib/bcd.o
  CC      drivers/firewire/init_ohci1394_dma.o
  AR      net/rfkill/built-in.a
  CC      drivers/ata/libata-eh.o
  CC      net/netlabel/netlabel_cipso_v4.o
  CC      drivers/acpi/acpica/nsxfeval.o
  CC      fs/ext4/move_extent.o
  CC      net/netfilter/nf_nat_ftp.o
  CC      fs/namespace.o
  CC      drivers/acpi/acpica/nsxfname.o
  CC      drivers/acpi/property.o
  CC      arch/x86/kernel/cpuid.o
  CC      drivers/tty/tty_baudrate.o
  CC      drivers/acpi/debugfs.o
  CC      drivers/base/power/wakeup_stats.o
  CC      drivers/acpi/acpi_lpat.o
  CC      kernel/trace/rpm-traces.o
  CC      mm/pagewalk.o
  CC      mm/pgtable-generic.o
  CC      kernel/trace/trace_dynevent.o
  CC      drivers/tty/tty_jobctrl.o
  CC      net/netlabel/netlabel_calipso.o
  CC      net/sunrpc/auth_gss/gss_mech_switch.o
  CC      net/wireless/reg.o
  CC      drivers/tty/n_null.o
  CC      fs/nfs/sysctl.o
  AR      drivers/firewire/built-in.a
  CC      drivers/gpu/drm/ttm/ttm_device.o
  CC      drivers/gpu/drm/ttm/ttm_sys_manager.o
  CC      drivers/acpi/acpica/nsxfobj.o
  CC      drivers/gpu/drm/i915/i915_pci.o
  CC      drivers/scsi/scsi_ioctl.o
  CC      drivers/net/phy/mdio_devres.o
  AR      net/ethtool/built-in.a
  CC      net/core/netpoll.o
  CC      drivers/base/power/trace.o
  CC      net/ipv4/tcp_offload.o
  CC      arch/x86/kernel/early-quirks.o
  CC      net/ipv4/tcp_plb.o
  CC      net/ipv4/datagram.o
  CC      drivers/acpi/acpi_pcc.o
  CC      drivers/gpu/drm/i915/i915_scatterlist.o
  CC      drivers/cdrom/cdrom.o
  CC      drivers/gpu/drm/i915/i915_suspend.o
  CC      drivers/gpu/drm/i915/i915_switcheroo.o
  CC      net/ipv6/netfilter/ip6t_REJECT.o
  CC      drivers/acpi/acpica/psargs.o
  CC      net/ipv6/route.o
  CC      fs/ext4/namei.o
  CC      fs/ext4/page-io.o
  CC      lib/sort.o
  CC      drivers/scsi/scsicam.o
  CC      net/9p/protocol.o
  CC      drivers/acpi/ac.o
  CC      lib/parser.o
  CC      net/netfilter/nf_nat_irc.o
  CC      fs/ext4/readpage.o
  CC      net/sunrpc/xprt.o
  CC      drivers/gpu/drm/i915/i915_sysfs.o
  CC      mm/rmap.o
  CC      drivers/tty/pty.o
  CC      kernel/trace/trace_probe.o
  CC      net/ipv6/ip6_fib.o
  CC      lib/debug_locks.o
  CC      kernel/trace/trace_uprobe.o
  CC      drivers/gpu/drm/ttm/ttm_agp_backend.o
  CC      kernel/trace/rethook.o
  CC      net/ipv4/raw.o
  CC      net/mac80211/status.o
  CC      drivers/acpi/button.o
  AR      drivers/base/power/built-in.a
  CC      drivers/net/phy/phy.o
  CC      drivers/base/component.o
  CC      drivers/tty/tty_audit.o
  CC      drivers/acpi/acpica/psloop.o
  CC      lib/random32.o
  CC      fs/nfs/nfs3super.o
  AR      net/netlabel/built-in.a
  CC      drivers/scsi/scsi_error.o
  CC      fs/ext4/resize.o
  CC      net/wireless/scan.o
  CC      net/dns_resolver/dns_key.o
  CC      drivers/scsi/scsi_lib.o
  CC      arch/x86/kernel/smp.o
  CC      net/dns_resolver/dns_query.o
  CC      net/netfilter/nf_nat_sip.o
  CC      drivers/scsi/constants.o
  CC      lib/bust_spinlocks.o
  CC      net/9p/trans_common.o
  CC      drivers/ata/libata-transport.o
  CC      drivers/acpi/acpica/psobject.o
  CC      net/sunrpc/auth_gss/svcauth_gss.o
  CC      drivers/base/core.o
  CC      drivers/tty/sysrq.o
  AR      drivers/gpu/drm/ttm/built-in.a
  CC      drivers/ata/libata-trace.o
  AR      drivers/gpu/drm/tilcdc/built-in.a
  CC      mm/vmalloc.o
  CC      arch/x86/kernel/smpboot.o
  CC      drivers/base/bus.o
  CC      fs/ext4/super.o
  CC      drivers/gpu/drm/virtio/virtgpu_drv.o
  CC      drivers/gpu/drm/virtio/virtgpu_kms.o
  CC      drivers/gpu/drm/i915/i915_utils.o
  CC      drivers/acpi/fan_core.o
  CC      drivers/acpi/fan_attr.o
  CC      drivers/gpu/drm/virtio/virtgpu_gem.o
  AR      net/ipv6/netfilter/built-in.a
  CC      drivers/gpu/drm/i915/intel_clock_gating.o
  AR      drivers/gpu/drm/imx/built-in.a
  CC      arch/x86/kernel/tsc_sync.o
  CC      net/sunrpc/socklib.o
  CC      drivers/acpi/acpi_video.o
  CC      net/core/fib_rules.o
  AR      net/dns_resolver/built-in.a
  CC      net/handshake/alert.o
  CC      drivers/acpi/acpica/psopcode.o
  CC      lib/kasprintf.o
  CC      net/9p/trans_fd.o
  CC      net/handshake/genl.o
  CC      fs/nfs/nfs3client.o
  AR      drivers/cdrom/built-in.a
  CC      fs/seq_file.o
  CC      drivers/scsi/scsi_lib_dma.o
  CC      drivers/acpi/video_detect.o
  CC      drivers/base/dd.o
  CC      net/netfilter/x_tables.o
  CC      drivers/gpu/drm/virtio/virtgpu_vram.o
  CC      drivers/scsi/scsi_scan.o
  CC      drivers/acpi/acpica/psopinfo.o
  AR      drivers/auxdisplay/built-in.a
  CC      lib/bitmap.o
  CC      drivers/acpi/acpica/psparse.o
  CC      drivers/gpu/drm/virtio/virtgpu_display.o
  AR      drivers/gpu/drm/i2c/built-in.a
  GEN     drivers/scsi/scsi_devinfo_tbl.c
  CC      net/9p/trans_virtio.o
  AR      drivers/gpu/drm/panel/built-in.a
  CC      drivers/net/phy/phy-c45.o
  CC      drivers/ata/libata-sata.o
  CC      drivers/ata/libata-sff.o
  AR      drivers/gpu/drm/bridge/analogix/built-in.a
  AR      drivers/gpu/drm/bridge/cadence/built-in.a
  CC      drivers/gpu/drm/virtio/virtgpu_vq.o
  CC      net/ipv4/udp.o
  AR      drivers/gpu/drm/bridge/imx/built-in.a
  AR      drivers/gpu/drm/bridge/synopsys/built-in.a
  AR      drivers/tty/built-in.a
  AR      drivers/gpu/drm/bridge/built-in.a
  CC      drivers/gpu/drm/virtio/virtgpu_fence.o
  CC      fs/nfs/nfs3proc.o
  CC      net/core/net-traces.o
  AR      drivers/gpu/drm/hisilicon/built-in.a
  CC      net/netfilter/xt_tcpudp.o
  CC      drivers/scsi/scsi_devinfo.o
  CC      fs/xattr.o
  AR      kernel/trace/built-in.a
  CC      kernel/sysctl.o
  CC      arch/x86/kernel/setup_percpu.o
  CC      fs/nfs/nfs3xdr.o
  CC      drivers/acpi/acpica/psscope.o
  CC      drivers/gpu/drm/i915/intel_device_info.o
  CC      drivers/acpi/processor_driver.o
  CC      net/devres.o
  CC      net/handshake/netlink.o
  CC      arch/x86/kernel/mpparse.o
  CC      lib/scatterlist.o
  CC      fs/libfs.o
  CC      drivers/acpi/processor_thermal.o
  CC      fs/nfs/nfs3acl.o
  CC      drivers/acpi/acpica/pstree.o
  CC      mm/process_vm_access.o
  CC      fs/fs-writeback.o
  CC      fs/ext4/symlink.o
  CC      drivers/gpu/drm/virtio/virtgpu_object.o
  CC      drivers/scsi/scsi_sysctl.o
  CC      fs/nfs/nfs4proc.o
  CC      fs/nfs/nfs4xdr.o
  AR      drivers/gpu/drm/mxsfb/built-in.a
  CC      net/handshake/request.o
  CC      drivers/gpu/drm/i915/intel_memory_region.o
  CC      drivers/gpu/drm/i915/intel_pcode.o
  CC      net/core/selftests.o
  CC      net/netfilter/xt_CONNSECMARK.o
  CC      drivers/acpi/processor_idle.o
  CC      drivers/scsi/scsi_proc.o
  CC      drivers/scsi/scsi_debugfs.o
  CC      drivers/acpi/acpica/psutils.o
  CC      net/sunrpc/auth_gss/gss_rpc_upcall.o
  CC      drivers/scsi/scsi_trace.o
  CC      net/ipv6/ipv6_sockglue.o
  CC      net/handshake/tlshd.o
  AR      drivers/gpu/drm/tiny/built-in.a
  CC      drivers/net/phy/phy-core.o
  AR      drivers/gpu/drm/xlnx/built-in.a
  AR      net/9p/built-in.a
  CC      drivers/net/phy/phy_device.o
  AR      drivers/gpu/drm/gud/built-in.a
  AR      drivers/gpu/drm/solomon/built-in.a
  CC      drivers/acpi/processor_throttling.o
  CC      drivers/acpi/processor_perflib.o
  CC      drivers/net/mdio/acpi_mdio.o
  AR      drivers/net/pcs/built-in.a
  CC      net/ipv4/udplite.o
  CC      net/mac80211/driver-ops.o
  CC      arch/x86/kernel/trace_clock.o
  CC      net/socket.o
  AR      drivers/net/ethernet/3com/built-in.a
  CC      net/sysctl_net.o
  CC      drivers/net/ethernet/8390/ne2k-pci.o
  CC      fs/nfs/nfs4state.o
  CC      drivers/acpi/acpica/pswalk.o
  CC      net/wireless/nl80211.o
  CC      drivers/gpu/drm/virtio/virtgpu_debugfs.o
  CC      net/netfilter/xt_NFLOG.o
  CC      drivers/base/syscore.o
  AR      drivers/net/ethernet/adaptec/built-in.a
  CC      drivers/base/driver.o
  CC      lib/list_sort.o
  CC      drivers/gpu/drm/virtio/virtgpu_plane.o
  CC      net/ipv4/udp_offload.o
  CC      arch/x86/kernel/trace.o
  CC      lib/uuid.o
  CC      net/netfilter/xt_SECMARK.o
  CC      lib/iov_iter.o
  CC      net/ipv4/arp.o
  CC      drivers/acpi/acpica/psxface.o
  CC      fs/nfs/nfs4renewd.o
  CC      kernel/capability.o
  CC      fs/ext4/sysfs.o
  CC      drivers/acpi/container.o
  CC      drivers/gpu/drm/i915/intel_region_ttm.o
  CC [M]  drivers/gpu/drm/scheduler/sched_main.o
  CC      mm/page_alloc.o
  CC      drivers/gpu/drm/i915/intel_runtime_pm.o
  CC      drivers/ata/libata-pmp.o
  CC      drivers/net/mdio/fwnode_mdio.o
  CC      drivers/scsi/scsi_logging.o
  CC [M]  drivers/gpu/drm/xe/xe_bb.o
  CC      drivers/scsi/scsi_pm.o
  CC      fs/pnode.o
  CC      drivers/net/phy/linkmode.o
  CC      arch/x86/kernel/rethook.o
  CC      fs/ext4/xattr.o
  CC      net/sunrpc/auth_gss/gss_rpc_xdr.o
  CC      drivers/acpi/acpica/rsaddr.o
  CC      drivers/acpi/acpica/rscalc.o
  CC      net/handshake/trace.o
  CC      drivers/gpu/drm/drm_aperture.o
  AR      drivers/net/wireless/admtek/built-in.a
  AR      drivers/net/usb/built-in.a
  AR      drivers/net/wireless/ath/built-in.a
  CC      net/sunrpc/auth_gss/trace.o
  AR      drivers/net/wireless/atmel/built-in.a
  AR      drivers/net/wireless/broadcom/built-in.a
  AR      drivers/net/wireless/intel/built-in.a
  CC      drivers/acpi/acpica/rscreate.o
  AR      drivers/net/wireless/intersil/built-in.a
  CC      drivers/gpu/drm/i915/intel_sbi.o
  AR      drivers/net/wireless/marvell/built-in.a
  CC      drivers/gpu/drm/virtio/virtgpu_ioctl.o
  AR      drivers/net/wireless/mediatek/built-in.a
  AR      drivers/net/wireless/microchip/built-in.a
  CC      drivers/net/phy/mdio_bus.o
  AR      drivers/net/wireless/purelifi/built-in.a
  CC      drivers/net/ethernet/8390/8390.o
  AR      drivers/net/wireless/quantenna/built-in.a
  AR      drivers/net/wireless/ralink/built-in.a
  AR      drivers/net/wireless/realtek/built-in.a
  AR      drivers/net/wireless/rsi/built-in.a
  CC      net/ipv4/icmp.o
  AR      drivers/net/wireless/silabs/built-in.a
  CC      drivers/base/class.o
  AR      drivers/net/wireless/st/built-in.a
  CC      net/ipv4/devinet.o
  CC      net/netfilter/xt_TCPMSS.o
  AR      drivers/net/wireless/ti/built-in.a
  AR      drivers/net/wireless/zydas/built-in.a
  AR      drivers/net/wireless/virtual/built-in.a
  AR      drivers/net/wireless/built-in.a
  CC      drivers/acpi/acpica/rsdumpinfo.o
  CC      kernel/ptrace.o
  CC      net/wireless/mlme.o
  CC      drivers/gpu/drm/i915/intel_step.o
  CC      drivers/acpi/thermal_lib.o
  CC      fs/nfs/nfs4super.o
  CC [M]  drivers/gpu/drm/xe/xe_bo.o
  CC      arch/x86/kernel/vmcore_info_32.o
  CC      net/core/ptp_classifier.o
  CC      arch/x86/kernel/machine_kexec_32.o
  CC      drivers/gpu/drm/i915/intel_uncore.o
  CC      fs/ext4/xattr_hurd.o
  CC      fs/nfs/nfs4file.o
  CC      net/sunrpc/xprtsock.o
  AR      drivers/net/mdio/built-in.a
  CC      drivers/scsi/scsi_bsg.o
  CC      drivers/acpi/acpica/rsinfo.o
  CC      drivers/base/platform.o
  CC      drivers/base/cpu.o
  CC      kernel/user.o
  AS      arch/x86/kernel/relocate_kernel_32.o
  CC      arch/x86/kernel/crash_dump_32.o
  CC      net/ipv6/ndisc.o
  CC      drivers/ata/libata-acpi.o
  CC      drivers/net/phy/mdio_device.o
  CC      lib/clz_ctz.o
  CC      net/core/netprio_cgroup.o
  CC      drivers/gpu/drm/i915/intel_wakeref.o
  CC      drivers/acpi/acpica/rsio.o
  CC [M]  drivers/gpu/drm/scheduler/sched_fence.o
  CC [M]  drivers/gpu/drm/scheduler/sched_entity.o
  CC      drivers/gpu/drm/virtio/virtgpu_prime.o
  CC      drivers/acpi/acpica/rsirq.o
  CC      drivers/acpi/acpica/rslist.o
  CC [M]  drivers/gpu/drm/xe/xe_bo_evict.o
  CC      drivers/acpi/acpica/rsmemory.o
  CC      kernel/signal.o
  AR      drivers/net/ethernet/8390/built-in.a
  CC      net/ipv4/af_inet.o
  AR      drivers/net/ethernet/agere/built-in.a
  AR      drivers/net/ethernet/alacritech/built-in.a
  CC      arch/x86/kernel/crash.o
  CC      fs/splice.o
  AR      drivers/net/ethernet/alteon/built-in.a
  AR      drivers/net/ethernet/amazon/built-in.a
  AR      drivers/net/ethernet/amd/built-in.a
  CC      lib/bsearch.o
  AR      drivers/net/ethernet/aquantia/built-in.a
  AR      drivers/net/ethernet/arc/built-in.a
  AR      drivers/net/ethernet/asix/built-in.a
  CC      net/mac80211/sta_info.o
  CC [M]  drivers/gpu/drm/xe/xe_debugfs.o
  AR      drivers/net/ethernet/atheros/built-in.a
  AR      drivers/gpu/vga/built-in.a
  CC      drivers/scsi/scsi_common.o
  AR      drivers/net/ethernet/cadence/built-in.a
  CC [M]  drivers/gpu/drm/xe/xe_devcoredump.o
  CC      drivers/base/firmware.o
  CC [M]  drivers/gpu/drm/xe/xe_device.o
  CC      drivers/net/ethernet/broadcom/bnx2.o
  CC [M]  drivers/gpu/drm/xe/xe_device_sysfs.o
  AR      net/handshake/built-in.a
  CC      drivers/net/phy/swphy.o
  CC      drivers/net/phy/fixed_phy.o
  CC      drivers/acpi/acpica/rsmisc.o
  AR      drivers/net/ethernet/brocade/built-in.a
  CC      drivers/net/mii.o
  CC      drivers/net/ethernet/broadcom/tg3.o
  CC      kernel/sys.o
  CC      drivers/net/loopback.o
  CC      drivers/net/netconsole.o
  CC      net/netfilter/xt_conntrack.o
  CC      net/core/netclassid_cgroup.o
  CC      drivers/gpu/drm/i915/vlv_sideband.o
  CC      net/core/dst_cache.o
  CC      drivers/gpu/drm/i915/vlv_suspend.o
  LD [M]  drivers/gpu/drm/scheduler/gpu-sched.o
  CC      drivers/base/init.o
  CC      drivers/gpu/drm/virtio/virtgpu_trace_points.o
  CC      mm/init-mm.o
  CC      drivers/scsi/scsi_transport_spi.o
  CC      drivers/base/map.o
  CC [M]  drivers/gpu/drm/xe/xe_dma_buf.o
  CC      drivers/gpu/drm/i915/soc/intel_dram.o
  CC      drivers/ata/libata-pata-timings.o
  CC      drivers/net/phy/realtek.o
  CC      lib/find_bit.o
  CC      drivers/ata/ahci.o
  CC      drivers/base/devres.o
  CC      drivers/acpi/acpica/rsserial.o
  CC      arch/x86/kernel/module.o
  CC      net/ipv4/igmp.o
  CC [M]  drivers/gpu/drm/xe/xe_drm_client.o
  CC      net/mac80211/wep.o
  CC      net/sunrpc/auth_gss/gss_krb5_mech.o
  CC      lib/llist.o
  CC      fs/ext4/xattr_trusted.o
  CC [M]  drivers/gpu/drm/xe/xe_exec.o
  CC      net/core/gro_cells.o
  CC      net/netfilter/xt_policy.o
  CC      drivers/acpi/acpica/rsutils.o
  AR      drivers/net/ethernet/cavium/common/built-in.a
  CC      lib/lwq.o
  CC      net/netfilter/xt_state.o
  AR      drivers/net/ethernet/cavium/thunder/built-in.a
  CC      drivers/base/attribute_container.o
  AR      drivers/net/ethernet/cavium/liquidio/built-in.a
  AR      drivers/net/ethernet/cavium/octeon/built-in.a
  AR      drivers/net/ethernet/cavium/built-in.a
  CC      fs/sync.o
  CC      arch/x86/kernel/doublefault_32.o
  CC [M]  drivers/gpu/drm/xe/xe_execlist.o
  CC      net/sunrpc/sched.o
  CC      net/sunrpc/auth.o
  CC      drivers/gpu/drm/drm_atomic.o
  CC      drivers/gpu/drm/virtio/virtgpu_submit.o
  CC      kernel/umh.o
  CC      lib/memweight.o
  CC      fs/ext4/xattr_user.o
  CC      drivers/base/transport_class.o
  CC      mm/memblock.o
  CC      net/sunrpc/auth_null.o
  CC      lib/kfifo.o
  CC      net/sunrpc/auth_tls.o
  CC      fs/utimes.o
  CC [M]  drivers/gpu/drm/xe/xe_exec_queue.o
  CC      net/wireless/ibss.o
  CC      drivers/acpi/acpica/rsxface.o
  CC      drivers/ata/libahci.o
  CC      arch/x86/kernel/early_printk.o
  CC      fs/nfs/delegation.o
  CC      net/ipv6/udp.o
  CC      fs/d_path.o
  CC      drivers/gpu/drm/drm_atomic_uapi.o
  CC      drivers/gpu/drm/i915/soc/intel_gmch.o
  CC      fs/ext4/fast_commit.o
  CC      net/sunrpc/auth_gss/gss_krb5_seal.o
  CC      drivers/ata/ata_piix.o
  CC      drivers/base/topology.o
  AR      drivers/net/phy/built-in.a
  CC      drivers/acpi/acpica/tbdata.o
  CC      drivers/ata/pata_amd.o
  CC      net/sunrpc/auth_unix.o
  CC      net/ipv4/fib_frontend.o
  CC      net/ipv6/udplite.o
  CC      mm/slub.o
  CC      drivers/base/container.o
  CC      net/wireless/sme.o
  CC      drivers/scsi/virtio_scsi.o
  CC      net/core/failover.o
  CC      fs/stack.o
  CC      arch/x86/kernel/hpet.o
  CC      drivers/scsi/sd.o
  AR      drivers/gpu/drm/virtio/built-in.a
  CC      mm/madvise.o
  CC [M]  net/netfilter/nf_log_syslog.o
  CC [M]  drivers/gpu/drm/xe/xe_force_wake.o
  CC      arch/x86/kernel/amd_nb.o
  CC [M]  drivers/gpu/drm/xe/xe_ggtt.o
  CC      fs/ext4/orphan.o
  CC      kernel/workqueue.o
  CC      net/wireless/chan.o
  CC      net/ipv6/raw.o
  CC      lib/percpu-refcount.o
  CC      drivers/acpi/acpica/tbfadt.o
  CC      drivers/base/property.o
  CC      net/sunrpc/svc.o
  CC      drivers/net/virtio_net.o
  CC      drivers/net/net_failover.o
  CC      net/sunrpc/auth_gss/gss_krb5_unseal.o
  CC      drivers/gpu/drm/i915/soc/intel_pch.o
  CC      drivers/gpu/drm/drm_auth.o
  CC [M]  drivers/gpu/drm/xe/xe_gpu_scheduler.o
  CC [M]  net/netfilter/xt_mark.o
  CC      net/ipv4/fib_semantics.o
  CC      net/sunrpc/svcsock.o
  CC      drivers/acpi/acpica/tbfind.o
  CC      drivers/ata/pata_oldpiix.o
  CC      net/wireless/ethtool.o
  HOSTCC  drivers/gpu/drm/xe/xe_gen_wa_oob
  CC      lib/rhashtable.o
  CC      drivers/base/cacheinfo.o
  CC      lib/base64.o
  CC      drivers/base/swnode.o
  CC      lib/once.o
  AR      net/core/built-in.a
  CC      net/ipv6/icmp.o
  CC      drivers/gpu/drm/drm_blend.o
  CC      arch/x86/kernel/kvm.o
  CC      drivers/gpu/drm/i915/i915_memcpy.o
  CC      drivers/base/auxiliary.o
  CC [M]  drivers/gpu/drm/xe/xe_gsc_proxy.o
  CC      drivers/base/devtmpfs.o
  CC      drivers/scsi/sr.o
  CC      drivers/acpi/acpica/tbinstal.o
  CC      net/sunrpc/auth_gss/gss_krb5_wrap.o
  CC      drivers/scsi/sr_ioctl.o
  CC      net/sunrpc/svcauth.o
  CC      arch/x86/kernel/kvmclock.o
  CC      fs/ext4/acl.o
  CC      drivers/gpu/drm/drm_bridge.o
  CC      fs/nfs/nfs4idmap.o
  CC [M]  net/netfilter/xt_nat.o
  CC      drivers/acpi/acpica/tbprint.o
  CC      drivers/base/module.o
  CC      mm/page_io.o
  CC      drivers/base/devcoredump.o
  CC      drivers/acpi/acpica/tbutils.o
  CC      drivers/base/platform-msi.o
  CC      drivers/gpu/drm/i915/i915_mm.o
  CC      drivers/ata/pata_sch.o
  CC      net/sunrpc/svcauth_unix.o
  CC      fs/ext4/xattr_security.o
  CC      mm/swap_state.o
  CC      drivers/scsi/sr_vendor.o
  AR      drivers/net/ethernet/chelsio/built-in.a
  CC      net/sunrpc/addr.o
  CC      drivers/base/physical_location.o
  CC [M]  drivers/gpu/drm/xe/xe_gsc_submit.o
  CC      drivers/acpi/acpica/tbxface.o
  CC      net/sunrpc/auth_gss/gss_krb5_crypto.o
  CC      drivers/base/trace.o
  CC      lib/refcount.o
  CC      fs/nfs/callback.o
  CC      drivers/acpi/acpica/tbxfload.o
  CC      drivers/acpi/acpica/tbxfroot.o
  CC      net/ipv4/fib_trie.o
  CC      fs/nfs/callback_xdr.o
  CC      mm/swapfile.o
  CC      net/sunrpc/rpcb_clnt.o
  CC      drivers/scsi/sg.o
  CC      net/mac80211/aead_api.o
  CC      drivers/scsi/scsi_sysfs.o
  CC      net/mac80211/wpa.o
  CC      lib/rcuref.o
  CC      fs/fs_struct.o
  AR      drivers/net/ethernet/cisco/built-in.a
  CC [M]  drivers/gpu/drm/xe/xe_gt.o
  CC      net/ipv6/mcast.o
  CC      mm/swap_slots.o
  CC      net/ipv6/reassembly.o
  CC      arch/x86/kernel/paravirt.o
  CC      drivers/acpi/acpica/utaddress.o
  CC      drivers/acpi/acpica/utalloc.o
  CC      net/ipv4/fib_notifier.o
  CC      net/ipv4/inet_fragment.o
  CC      lib/usercopy.o
  CC      fs/statfs.o
  AR      fs/ext4/built-in.a
  CC      drivers/ata/pata_mpiix.o
  CC      drivers/ata/ata_generic.o
  CC      mm/dmapool.o
  CC      lib/errseq.o
  CC      fs/fs_pin.o
  CC      drivers/gpu/drm/i915/i915_sw_fence.o
  CC [M]  net/netfilter/xt_LOG.o
  CC      drivers/pcmcia/cs.o
  AR      drivers/base/built-in.a
  CC      drivers/usb/common/common.o
  CC      drivers/input/serio/serio.o
  CC      drivers/usb/common/debug.o
  CC      lib/bucket_locks.o
  CC      drivers/acpi/acpica/utascii.o
  CC      drivers/usb/core/usb.o
  AR      drivers/usb/phy/built-in.a
  CC      drivers/input/serio/i8042.o
  CC      drivers/input/serio/serport.o
  CC      drivers/usb/core/hub.o
  CC      drivers/input/keyboard/atkbd.o
  CC      drivers/acpi/acpica/utbuffer.o
  CC      net/ipv4/ping.o
  CC      net/sunrpc/auth_gss/gss_krb5_keys.o
  CC      arch/x86/kernel/pvclock.o
  CC      fs/nfs/callback_proc.o
  CC      net/sunrpc/timer.o
  CC      lib/generic-radix-tree.o
  CC      drivers/acpi/acpica/utcksum.o
  CC      drivers/gpu/drm/i915/i915_sw_fence_work.o
  CC      fs/nfs/nfs4namespace.o
  CC      arch/x86/kernel/pcspeaker.o
  CC      drivers/rtc/lib.o
  CC      mm/hugetlb.o
  CC      kernel/pid.o
  CC      kernel/task_work.o
  CC [M]  drivers/gpu/drm/xe/xe_gt_ccs_mode.o
  CC      kernel/extable.o
  CC      drivers/i2c/algos/i2c-algo-bit.o
  CC      net/sunrpc/xdr.o
  CC      drivers/i2c/busses/i2c-i801.o
  AR      drivers/ata/built-in.a
  CC      drivers/i2c/i2c-boardinfo.o
  AR      drivers/i2c/muxes/built-in.a
  AR      drivers/i3c/built-in.a
  CC      drivers/i2c/i2c-core-base.o
  CC      drivers/i2c/i2c-core-smbus.o
  AR      drivers/usb/common/built-in.a
  CC      drivers/input/mouse/psmouse-base.o
  CC [M]  net/netfilter/xt_MASQUERADE.o
  CC      drivers/gpu/drm/i915/i915_syncmap.o
  AR      drivers/media/i2c/built-in.a
  AR      drivers/media/tuners/built-in.a
  AR      drivers/media/rc/keymaps/built-in.a
  AR      drivers/media/rc/built-in.a
  CC      drivers/pcmcia/socket_sysfs.o
  CC      drivers/input/serio/libps2.o
  CC      drivers/acpi/acpica/utcopy.o
  AR      drivers/media/common/b2c2/built-in.a
  AR      drivers/media/common/saa7146/built-in.a
  AR      drivers/media/common/siano/built-in.a
  CC      lib/bitmap-str.o
  CC      drivers/usb/mon/mon_main.o
  AR      drivers/media/common/v4l2-tpg/built-in.a
  AR      drivers/media/common/videobuf2/built-in.a
  CC      drivers/usb/mon/mon_stat.o
  AR      drivers/media/common/built-in.a
  CC      net/mac80211/scan.o
  CC      arch/x86/kernel/check.o
  CC      drivers/usb/host/pci-quirks.o
  AR      drivers/media/platform/allegro-dvt/built-in.a
  AR      drivers/media/platform/amlogic/meson-ge2d/built-in.a
  CC      net/ipv6/tcp_ipv6.o
  AR      drivers/scsi/built-in.a
  AR      drivers/media/platform/amlogic/built-in.a
  AR      drivers/media/platform/amphion/built-in.a
  AR      drivers/media/pci/ttpci/built-in.a
  AR      drivers/pps/clients/built-in.a
  AR      drivers/media/pci/b2c2/built-in.a
  AR      drivers/media/platform/aspeed/built-in.a
  AR      drivers/pps/generators/built-in.a
  AR      drivers/media/pci/pluto2/built-in.a
  CC      drivers/pps/pps.o
  AR      drivers/media/platform/atmel/built-in.a
  AR      drivers/media/pci/dm1105/built-in.a
  AR      drivers/media/platform/cadence/built-in.a
  AR      drivers/media/platform/broadcom/built-in.a
  CC      drivers/usb/core/hcd.o
  AR      drivers/media/pci/pt1/built-in.a
  AR      drivers/media/pci/pt3/built-in.a
  AR      drivers/media/platform/chips-media/coda/built-in.a
  AR      drivers/media/pci/mantis/built-in.a
  AR      drivers/media/platform/chips-media/wave5/built-in.a
  AR      drivers/media/platform/chips-media/built-in.a
  AR      drivers/media/pci/ngene/built-in.a
  AR      drivers/input/keyboard/built-in.a
  CC      drivers/pps/kapi.o
  AR      drivers/media/pci/ddbridge/built-in.a
  AR      drivers/media/platform/intel/built-in.a
  CC      drivers/acpi/acpica/utexcep.o
  AR      net/sunrpc/auth_gss/built-in.a
  AR      drivers/media/pci/saa7146/built-in.a
  CC      drivers/rtc/class.o
  AR      drivers/media/platform/marvell/built-in.a
  CC      drivers/gpu/drm/drm_cache.o
  AR      drivers/media/pci/smipcie/built-in.a
  AR      drivers/media/pci/netup_unidvb/built-in.a
  AR      drivers/media/platform/mediatek/jpeg/built-in.a
  CC      drivers/gpu/drm/i915/i915_user_extensions.o
  CC      drivers/acpi/thermal.o
  AR      drivers/media/pci/intel/ipu3/built-in.a
  AR      drivers/media/platform/mediatek/mdp/built-in.a
  AR      drivers/media/pci/intel/ivsc/built-in.a
  AR      drivers/media/pci/intel/built-in.a
  AR      drivers/media/platform/mediatek/vcodec/common/built-in.a
  AR      drivers/media/pci/built-in.a
  CC      net/ipv4/ip_tunnel_core.o
  AR      drivers/media/platform/mediatek/vcodec/encoder/built-in.a
  AR      drivers/media/platform/microchip/built-in.a
  AR      drivers/media/platform/mediatek/vcodec/decoder/built-in.a
  CC      kernel/params.o
  AR      drivers/media/platform/mediatek/vcodec/built-in.a
  AR      drivers/media/platform/nuvoton/built-in.a
  CC      kernel/kthread.o
  CC      net/ipv4/gre_offload.o
  CC      drivers/gpu/drm/i915/i915_debugfs.o
  AR      drivers/media/platform/mediatek/vpu/built-in.a
  AR      drivers/media/platform/mediatek/mdp3/built-in.a
  AR      drivers/media/platform/mediatek/built-in.a
  CC [M]  net/netfilter/xt_addrtype.o
  CC [M]  drivers/gpu/drm/xe/xe_gt_clock.o
  AR      drivers/media/platform/nvidia/tegra-vde/built-in.a
  AR      drivers/media/platform/nvidia/built-in.a
  AR      drivers/media/usb/b2c2/built-in.a
  AR      drivers/media/usb/dvb-usb/built-in.a
  AR      drivers/media/platform/nxp/dw100/built-in.a
  CC [M]  drivers/gpu/drm/xe/xe_gt_debugfs.o
  AR      drivers/media/usb/dvb-usb-v2/built-in.a
  AR      drivers/media/platform/nxp/imx-jpeg/built-in.a
  CC [M]  drivers/gpu/drm/xe/xe_gt_freq.o
  AR      drivers/media/usb/s2255/built-in.a
  CC [M]  drivers/gpu/drm/xe/xe_gt_idle.o
  AR      drivers/media/platform/nxp/imx8-isi/built-in.a
  AR      drivers/media/usb/siano/built-in.a
  AR      drivers/media/platform/nxp/built-in.a
  CC      drivers/pcmcia/cardbus.o
  AR      drivers/media/usb/ttusb-budget/built-in.a
  CC      arch/x86/kernel/uprobes.o
  CC      drivers/usb/mon/mon_text.o
  AR      drivers/i2c/algos/built-in.a
  AR      drivers/media/usb/ttusb-dec/built-in.a
  AR      drivers/media/platform/qcom/camss/built-in.a
  AR      drivers/media/platform/qcom/venus/built-in.a
  CC      lib/string_helpers.o
  CC      lib/hexdump.o
  AR      drivers/media/usb/built-in.a
  CC      drivers/i2c/i2c-core-acpi.o
  AR      drivers/media/platform/qcom/built-in.a
  AR      drivers/input/serio/built-in.a
  CC      drivers/acpi/acpica/utdebug.o
  CC      drivers/acpi/acpica/utdecode.o
  CC      net/ipv4/metrics.o
  AR      drivers/media/platform/renesas/rcar-vin/built-in.a
  AR      drivers/media/platform/renesas/rzg2l-cru/built-in.a
  CC      drivers/input/mouse/synaptics.o
  AR      drivers/media/platform/renesas/vsp1/built-in.a
  AR      drivers/media/platform/renesas/built-in.a
  AR      drivers/input/joystick/built-in.a
  CC      net/ipv6/ping.o
  AR      drivers/media/platform/rockchip/rga/built-in.a
  CC      drivers/gpu/drm/i915/i915_debugfs_params.o
  AR      drivers/media/platform/rockchip/rkisp1/built-in.a
  CC      drivers/pps/sysfs.o
  AR      drivers/media/platform/rockchip/built-in.a
  AR      drivers/media/platform/samsung/exynos-gsc/built-in.a
  CC      drivers/acpi/nhlt.o
  CC      drivers/acpi/acpi_memhotplug.o
  AR      drivers/media/platform/samsung/exynos4-is/built-in.a
  CC      drivers/acpi/ioapic.o
  AR      drivers/media/platform/samsung/s3c-camif/built-in.a
  CC      lib/kstrtox.o
  CC [M]  drivers/gpu/drm/xe/xe_gt_mcr.o
  AR      drivers/media/platform/samsung/s5p-g2d/built-in.a
  AR      drivers/media/platform/samsung/s5p-jpeg/built-in.a
  CC      drivers/rtc/interface.o
  AR      drivers/media/platform/samsung/s5p-mfc/built-in.a
  AR      drivers/media/platform/samsung/built-in.a
  CC [M]  drivers/gpu/drm/xe/xe_gt_pagefault.o
  CC      mm/mmu_notifier.o
  AR      drivers/media/platform/st/sti/bdisp/built-in.a
  CC      drivers/usb/host/ehci-hcd.o
  AR      drivers/media/platform/st/sti/c8sectpfe/built-in.a
  CC      fs/nfs/nfs4getroot.o
  AR      drivers/media/platform/st/sti/delta/built-in.a
  AR      drivers/media/platform/st/sti/hva/built-in.a
  AR      drivers/i2c/busses/built-in.a
  CC      kernel/sys_ni.o
  AR      drivers/media/platform/st/stm32/built-in.a
  CC      kernel/nsproxy.o
  CC      kernel/notifier.o
  AR      drivers/media/platform/st/built-in.a
  CC      drivers/acpi/acpica/utdelete.o
  AR      drivers/media/platform/sunxi/sun4i-csi/built-in.a
  CC      drivers/i2c/i2c-smbus.o
  AR      drivers/media/platform/sunxi/sun6i-csi/built-in.a
  AR      drivers/media/platform/sunxi/sun6i-mipi-csi2/built-in.a
  AR      drivers/media/platform/sunxi/sun8i-a83t-mipi-csi2/built-in.a
  AR      drivers/media/platform/sunxi/sun8i-di/built-in.a
  AR      drivers/pps/built-in.a
  AR      drivers/media/platform/sunxi/sun8i-rotate/built-in.a
  AR      drivers/media/platform/sunxi/built-in.a
  CC      drivers/acpi/acpica/uterror.o
  AR      drivers/media/platform/verisilicon/built-in.a
  AR      drivers/media/platform/ti/am437x/built-in.a
  AR      drivers/media/platform/via/built-in.a
  CC      drivers/pcmcia/ds.o
  CC      drivers/acpi/acpica/uteval.o
  CC      drivers/usb/mon/mon_bin.o
  AR      drivers/media/platform/ti/cal/built-in.a
  AR      drivers/media/platform/ti/vpe/built-in.a
  CC      drivers/ptp/ptp_clock.o
  CC      net/ipv6/exthdrs.o
  AR      drivers/media/platform/ti/davinci/built-in.a
  CC      drivers/power/supply/power_supply_core.o
  CC      net/sunrpc/sunrpc_syms.o
  CC      net/sunrpc/cache.o
  AR      drivers/media/platform/ti/j721e-csi2rx/built-in.a
  CC      kernel/ksysfs.o
  AR      drivers/media/platform/ti/omap/built-in.a
  CC      drivers/usb/host/ehci-pci.o
  AR      drivers/media/platform/ti/omap3isp/built-in.a
  CC      drivers/ptp/ptp_chardev.o
  AR      drivers/media/platform/ti/built-in.a
  CC      fs/nsfs.o
  CC      arch/x86/kernel/perf_regs.o
  AR      drivers/media/platform/xilinx/built-in.a
  AR      drivers/media/platform/built-in.a
  CC      lib/iomap.o
  CC      drivers/acpi/battery.o
  AR      drivers/media/mmc/siano/built-in.a
  AR      drivers/media/firewire/built-in.a
  AR      drivers/media/mmc/built-in.a
  CC      drivers/acpi/bgrt.o
  AR      drivers/media/spi/built-in.a
  CC      fs/nfs/nfs4client.o
  AR      drivers/media/test-drivers/built-in.a
  CC      drivers/ptp/ptp_sysfs.o
  AR      drivers/media/built-in.a
  CC      drivers/power/supply/power_supply_sysfs.o
  CC      drivers/rtc/nvmem.o
  CC      net/wireless/mesh.o
  CC      drivers/usb/host/ohci-hcd.o
  CC      net/ipv4/netlink.o
  CC      drivers/acpi/acpica/utglobal.o
  CC      arch/x86/kernel/tracepoint.o
  CC      arch/x86/kernel/itmt.o
  AR      net/netfilter/built-in.a
  CC      drivers/gpu/drm/drm_client.o
  CC      fs/nfs/nfs4session.o
  CC      drivers/usb/core/urb.o
  CC      drivers/power/supply/power_supply_leds.o
  CC      drivers/power/supply/power_supply_hwmon.o
  CC      drivers/gpu/drm/i915/i915_pmu.o
  CC      drivers/gpu/drm/i915/gt/gen2_engine_cs.o
  CC      net/ipv6/datagram.o
  AR      drivers/i2c/built-in.a
  CC      arch/x86/kernel/umip.o
  CC      kernel/cred.o
  CC      drivers/input/mouse/focaltech.o
  CC      drivers/input/mouse/alps.o
  CC      net/ipv6/ip6_flowlabel.o
  CC      drivers/acpi/acpica/uthex.o
  CC      drivers/rtc/dev.o
  CC      drivers/hwmon/hwmon.o
  CC      drivers/usb/host/ohci-pci.o
  CC      net/ipv6/inet6_connection_sock.o
  CC      fs/nfs/dns_resolve.o
  AR      drivers/thermal/broadcom/built-in.a
  CC      drivers/rtc/proc.o
  CC      drivers/usb/host/uhci-hcd.o
  AR      drivers/watchdog/built-in.a
  AR      drivers/thermal/samsung/built-in.a
  CC      drivers/rtc/sysfs.o
  CC      drivers/thermal/intel/intel_tcc.o
  AR      drivers/thermal/st/built-in.a
  CC      net/sunrpc/rpc_pipe.o
  CC      lib/iomap_copy.o
  CC      drivers/input/mouse/byd.o
  CC      drivers/thermal/intel/therm_throt.o
  AR      drivers/usb/mon/built-in.a
  CC      drivers/ptp/ptp_vclock.o
  CC      drivers/pcmcia/pcmcia_resource.o
  CC      drivers/ptp/ptp_kvm_x86.o
  CC      drivers/pcmcia/cistpl.o
  AR      drivers/power/supply/built-in.a
  CC      drivers/usb/core/message.o
  AR      drivers/power/built-in.a
  CC      drivers/pcmcia/pcmcia_cis.o
  CC [M]  drivers/gpu/drm/xe/xe_gt_sysfs.o
  CC      drivers/input/mouse/logips2pp.o
  CC      lib/devres.o
  CC      mm/migrate.o
  CC      kernel/reboot.o
  CC      drivers/acpi/acpica/utids.o
  CC      drivers/acpi/spcr.o
  CC      drivers/usb/class/usblp.o
  CC      drivers/input/mouse/lifebook.o
  CC      kernel/async.o
  CC      drivers/usb/core/driver.o
  AR      drivers/usb/misc/built-in.a
  CC      drivers/usb/storage/scsiglue.o
  CC      net/ipv4/nexthop.o
  CC      drivers/usb/core/config.o
  CC      drivers/usb/storage/protocol.o
  CC      arch/x86/kernel/unwind_frame.o
  CC      drivers/ptp/ptp_kvm_common.o
  CC      net/sunrpc/sysfs.o
  CC      net/sunrpc/svc_xprt.o
  CC      drivers/rtc/rtc-mc146818-lib.o
  CC      drivers/acpi/acpica/utinit.o
  CC      drivers/usb/host/xhci.o
  CC      drivers/acpi/acpica/utlock.o
  CC      lib/check_signature.o
  CC      drivers/usb/host/xhci-mem.o
  CC      drivers/usb/early/ehci-dbgp.o
  CC      drivers/usb/storage/transport.o
  CC      net/mac80211/offchannel.o
  CC      drivers/usb/storage/usb.o
  CC      net/mac80211/ht.o
  CC      lib/interval_tree.o
  AR      drivers/net/ethernet/broadcom/built-in.a
  CC      fs/nfs/nfs4trace.o
  AR      drivers/net/ethernet/cortina/built-in.a
  CC      fs/nfs/nfs4sysctl.o
  CC [M]  drivers/gpu/drm/xe/xe_gt_throttle.o
  AR      drivers/net/ethernet/dec/tulip/built-in.a
  AR      drivers/net/ethernet/dec/built-in.a
  CC      drivers/usb/storage/initializers.o
  AR      drivers/net/ethernet/dlink/built-in.a
  AR      drivers/net/ethernet/emulex/built-in.a
  AR      drivers/net/ethernet/engleder/built-in.a
  AR      drivers/net/ethernet/ezchip/built-in.a
  CC      drivers/gpu/drm/i915/gt/gen6_engine_cs.o
  CC      drivers/input/mouse/trackpoint.o
  CC      drivers/gpu/drm/drm_client_modeset.o
  AR      drivers/net/ethernet/fujitsu/built-in.a
  AR      drivers/hwmon/built-in.a
  CC      drivers/acpi/acpica/utmath.o
  CC      drivers/input/mouse/cypress_ps2.o
  AR      drivers/net/ethernet/fungible/built-in.a
  CC      drivers/input/mouse/psmouse-smbus.o
  AR      drivers/net/ethernet/google/built-in.a
  CC      net/ipv4/udp_tunnel_stub.o
  AR      drivers/net/ethernet/huawei/built-in.a
  CC      lib/assoc_array.o
  CC      drivers/pcmcia/rsrc_mgr.o
  CC      drivers/net/ethernet/intel/e1000/e1000_main.o
  CC [M]  drivers/thermal/intel/x86_pkg_temp_thermal.o
  CC      drivers/net/ethernet/intel/e1000/e1000_hw.o
  CC      drivers/pcmcia/rsrc_nonstatic.o
  CC      net/ipv6/udp_offload.o
  CC      kernel/range.o
  AR      arch/x86/kernel/built-in.a
  AR      arch/x86/built-in.a
  AR      drivers/ptp/built-in.a
  CC      drivers/rtc/rtc-cmos.o
  CC      net/ipv6/seg6.o
  AR      drivers/usb/class/built-in.a
  CC      net/ipv4/ip_tunnel.o
  CC      drivers/acpi/acpica/utmisc.o
  CC      drivers/gpu/drm/drm_color_mgmt.o
  CC      kernel/smpboot.o
  CC      drivers/usb/host/xhci-ext-caps.o
  CC      kernel/ucount.o
  CC      drivers/gpu/drm/drm_connector.o
  CC      drivers/pcmcia/yenta_socket.o
  CC      drivers/net/ethernet/intel/e1000/e1000_ethtool.o
  CC      kernel/regset.o
  CC      drivers/net/ethernet/intel/e1000/e1000_param.o
  AR      drivers/net/ethernet/i825xx/built-in.a
  CC      lib/bitrev.o
  CC      drivers/usb/core/file.o
  CC      drivers/net/ethernet/intel/e100.o
  CC      drivers/net/ethernet/intel/e1000e/82571.o
  CC [M]  drivers/gpu/drm/xe/xe_gt_tlb_invalidation.o
  AR      drivers/usb/early/built-in.a
  CC      drivers/usb/core/buffer.o
  CC      drivers/usb/storage/sierra_ms.o
  CC      drivers/acpi/acpica/utmutex.o
  CC      drivers/usb/storage/option_ms.o
  AR      drivers/thermal/intel/built-in.a
  CC      mm/page_counter.o
  CC      mm/hugetlb_cgroup.o
  AR      drivers/net/ethernet/microsoft/built-in.a
  CC      drivers/gpu/drm/i915/gt/gen6_ppgtt.o
  CC      net/ipv4/sysctl_net_ipv4.o
  AR      drivers/thermal/qcom/built-in.a
  AR      drivers/thermal/tegra/built-in.a
  CC      drivers/md/md.o
  AR      drivers/input/mouse/built-in.a
  AR      drivers/thermal/mediatek/built-in.a
  CC      drivers/cpufreq/cpufreq.o
  CC      drivers/thermal/thermal_core.o
  AR      drivers/input/tablet/built-in.a
  CC      drivers/usb/storage/usual-tables.o
  CC      drivers/cpufreq/freq_table.o
  AR      drivers/input/touchscreen/built-in.a
  CC      drivers/gpu/drm/drm_crtc.o
  AR      drivers/input/misc/built-in.a
  CC      drivers/md/md-bitmap.o
  CC      drivers/input/input.o
  CC      lib/crc-ccitt.o
  CC      kernel/ksyms_common.o
  AR      drivers/net/ethernet/litex/built-in.a
  CC      drivers/usb/host/xhci-ring.o
  CC      drivers/usb/host/xhci-hub.o
  AR      drivers/net/ethernet/marvell/octeon_ep/built-in.a
  CC      lib/crc16.o
  AR      drivers/net/ethernet/marvell/octeon_ep_vf/built-in.a
  AR      drivers/net/ethernet/mellanox/built-in.a
  HOSTCC  lib/gen_crc32table
  AR      drivers/net/ethernet/marvell/octeontx2/built-in.a
  AR      drivers/net/ethernet/micrel/built-in.a
  AR      drivers/net/ethernet/marvell/prestera/built-in.a
  CC      drivers/usb/host/xhci-dbg.o
  CC      drivers/net/ethernet/marvell/sky2.o
  CC      drivers/acpi/acpica/utnonansi.o
  CC      drivers/usb/core/sysfs.o
  CC      drivers/md/md-autodetect.o
  CC      drivers/net/ethernet/intel/e1000e/ich8lan.o
  CC      drivers/input/input-compat.o
  AR      drivers/rtc/built-in.a
  CC      drivers/cpuidle/governors/menu.o
  CC [M]  drivers/gpu/drm/xe/xe_gt_topology.o
  CC      drivers/cpuidle/cpuidle.o
  AR      drivers/mmc/built-in.a
  CC      net/ipv6/fib6_notifier.o
  CC      drivers/net/ethernet/intel/e1000e/80003es2lan.o
  CC      drivers/cpuidle/driver.o
  CC      drivers/cpuidle/governors/haltpoll.o
  CC      net/ipv6/rpl.o
  CC      net/ipv6/ioam6.o
  CC      lib/xxhash.o
  AR      drivers/usb/storage/built-in.a
  CC      drivers/acpi/acpica/utobject.o
  CC      net/sunrpc/xprtmultipath.o
  CC      kernel/groups.o
  CC      drivers/gpu/drm/drm_displayid.o
  CC      drivers/cpuidle/governor.o
  CC      mm/early_ioremap.o
  CC      drivers/usb/core/endpoint.o
  AR      drivers/pcmcia/built-in.a
  CC      net/wireless/ap.o
  AR      drivers/ufs/built-in.a
  CC      drivers/usb/core/devio.o
  CC      drivers/usb/host/xhci-trace.o
  CC      drivers/cpuidle/sysfs.o
  CC      mm/secretmem.o
  CC      lib/genalloc.o
  CC      net/wireless/trace.o
  CC      drivers/thermal/thermal_sysfs.o
  CC      drivers/acpi/acpica/utosi.o
  CC      drivers/cpufreq/cpufreq_performance.o
  CC      drivers/thermal/thermal_trip.o
  CC      lib/percpu_counter.o
  CC      drivers/gpu/drm/i915/gt/gen7_renderclear.o
  GEN     xe_wa_oob.c xe_wa_oob.h
  CC      fs/fs_types.o
  CC [M]  drivers/gpu/drm/xe/xe_guc_ct.o
  AR      drivers/leds/trigger/built-in.a
  CC      fs/fs_context.o
  AR      drivers/leds/blink/built-in.a
  CC      net/mac80211/agg-tx.o
  CC      drivers/cpuidle/poll_state.o
  AR      drivers/leds/simple/built-in.a
  CC [M]  drivers/gpu/drm/xe/xe_guc_db_mgr.o
  CC      drivers/leds/led-core.o
  CC      net/ipv4/proc.o
  CC      net/ipv4/fib_rules.o
  CC      net/mac80211/agg-rx.o
  CC      net/ipv6/sysctl_net_ipv6.o
  CC      fs/fs_parser.o
  CC      drivers/input/input-mt.o
  CC      drivers/acpi/acpica/utownerid.o
  CC      net/ipv4/ipmr.o
  CC      drivers/cpufreq/cpufreq_userspace.o
  CC      drivers/usb/core/notify.o
  CC      net/ipv4/ipmr_base.o
  CC      drivers/usb/core/generic.o
  AR      drivers/cpuidle/governors/built-in.a
  CC      net/ipv6/xfrm6_policy.o
  CC      drivers/cpuidle/cpuidle-haltpoll.o
  CC      drivers/cpufreq/cpufreq_ondemand.o
  CC      kernel/kcmp.o
  CC      fs/fsopen.o
  CC [M]  drivers/gpu/drm/xe/xe_guc_debugfs.o
  CC      drivers/leds/led-class.o
  CC      drivers/md/dm.o
  CC      net/mac80211/vht.o
  CC      drivers/thermal/thermal_helpers.o
  CC      lib/audit.o
  CC      lib/syscall.o
  CC      drivers/cpufreq/cpufreq_governor.o
  CC      drivers/net/ethernet/intel/e1000e/mac.o
  CC      mm/hmm.o
  CC      net/sunrpc/stats.o
  CC      drivers/thermal/thermal_hwmon.o
  CC      drivers/usb/host/xhci-debugfs.o
  CC      drivers/acpi/acpica/utpredef.o
  AR      drivers/net/ethernet/microchip/built-in.a
  AR      drivers/net/ethernet/mscc/built-in.a
  AR      drivers/net/ethernet/myricom/built-in.a
  CC      net/mac80211/he.o
  AR      drivers/net/ethernet/natsemi/built-in.a
  AR      drivers/net/ethernet/neterion/built-in.a
  CC      net/sunrpc/sysctl.o
  AR      drivers/cpuidle/built-in.a
  AR      drivers/firmware/arm_ffa/built-in.a
  AR      drivers/firmware/arm_scmi/built-in.a
  AR      drivers/firmware/broadcom/built-in.a
  AR      drivers/firmware/cirrus/built-in.a
  AR      drivers/firmware/meson/built-in.a
  CC [M]  drivers/gpu/drm/xe/xe_guc_hwconfig.o
  CC      drivers/usb/core/quirks.o
  AR      drivers/net/ethernet/intel/e1000/built-in.a
  AR      drivers/firmware/microchip/built-in.a
  CC      net/mac80211/s1g.o
  CC      drivers/firmware/efi/efi-bgrt.o
  AR      drivers/firmware/imx/built-in.a
  CC      drivers/input/input-poller.o
  CC      drivers/leds/led-triggers.o
  CC      drivers/input/ff-core.o
  CC      drivers/gpu/drm/i915/gt/gen8_engine_cs.o
  AR      drivers/crypto/stm32/built-in.a
  AR      drivers/crypto/xilinx/built-in.a
  CC      drivers/thermal/gov_step_wise.o
  CC      drivers/firmware/efi/libstub/efi-stub-helper.o
  CC      drivers/thermal/gov_user_space.o
  AR      drivers/crypto/hisilicon/built-in.a
  CC      drivers/acpi/acpica/utresdecode.o
  AR      fs/nfs/built-in.a
  AR      drivers/crypto/intel/keembay/built-in.a
  CC      drivers/clocksource/acpi_pm.o
  AR      drivers/crypto/intel/ixp4xx/built-in.a
  CC      drivers/input/touchscreen.o
  CC      lib/errname.o
  AR      drivers/crypto/starfive/built-in.a
  AR      drivers/crypto/intel/built-in.a
  CC      drivers/input/ff-memless.o
  AR      drivers/crypto/built-in.a
  CC      drivers/input/sparse-keymap.o
  CC      drivers/input/vivaldi-fmap.o
  CC      drivers/usb/host/xhci-pci.o
  CC      kernel/freezer.o
  CC      drivers/clocksource/i8253.o
  CC      lib/nlattr.o
  CC      fs/init.o
  CC      kernel/profile.o
  CC      drivers/cpufreq/cpufreq_governor_attr_set.o
  CC      drivers/acpi/acpica/utresrc.o
  CC      mm/memfd.o
  CC      drivers/firmware/efi/efi.o
  CC      net/ipv6/xfrm6_state.o
  CC      drivers/firmware/efi/vars.o
  CC      drivers/net/ethernet/intel/e1000e/manage.o
  CC      drivers/input/input-leds.o
  CC      drivers/cpufreq/acpi-cpufreq.o
  CC      drivers/input/evdev.o
  AR      drivers/thermal/built-in.a
  CC      net/ipv6/xfrm6_input.o
  CC      drivers/hid/usbhid/hid-core.o
  AR      drivers/platform/x86/amd/built-in.a
  CC      drivers/hid/hid-core.o
  CC      net/mac80211/ibss.o
  CC      net/mac80211/iface.o
  AR      drivers/platform/x86/intel/built-in.a
  CC      drivers/platform/x86/wmi.o
  CC      drivers/platform/x86/wmi-bmof.o
  CC      drivers/md/dm-table.o
  CC      drivers/usb/core/devices.o
  CC      drivers/platform/x86/eeepc-laptop.o
  CC      drivers/hid/usbhid/hiddev.o
  CC      drivers/hid/hid-input.o
  AR      drivers/leds/built-in.a
  CC      drivers/mailbox/mailbox.o
  AR      drivers/clocksource/built-in.a
  CC [M]  drivers/gpu/drm/xe/xe_guc_id_mgr.o
  AR      drivers/perf/built-in.a
  CC      drivers/gpu/drm/i915/gt/gen8_ppgtt.o
  CC      drivers/mailbox/pcc.o
  CC      drivers/acpi/acpica/utstate.o
  CC [M]  drivers/gpu/drm/xe/xe_guc_klv_helpers.o
  AR      drivers/net/ethernet/marvell/built-in.a
  CC      drivers/cpufreq/amd-pstate.o
  CC      drivers/firmware/efi/libstub/gop.o
  CC      drivers/net/ethernet/intel/e1000e/nvm.o
  AR      drivers/net/ethernet/netronome/built-in.a
  CC      drivers/net/ethernet/intel/e1000e/phy.o
  CC      drivers/hid/usbhid/hid-pidff.o
  CC      drivers/gpu/drm/i915/gt/intel_breadcrumbs.o
  CC      net/ipv6/xfrm6_output.o
  CC      fs/kernel_read_file.o
  CC      kernel/stacktrace.o
  CC      kernel/dma.o
  CC      drivers/firmware/efi/reboot.o
  CC      drivers/acpi/acpica/utstring.o
  CC      drivers/platform/x86/p2sb.o
  CC [M]  drivers/gpu/drm/xe/xe_guc_log.o
  CC      lib/cpu_rmap.o
  CC      lib/dynamic_queue_limits.o
  CC      net/ipv4/syncookies.o
  AR      drivers/hwtracing/intel_th/built-in.a
  CC      drivers/cpufreq/amd-pstate-trace.o
  CC      mm/ptdump.o
  CC      net/ipv6/xfrm6_protocol.o
  AR      drivers/mailbox/built-in.a
  CC      drivers/md/dm-target.o
  CC      drivers/usb/core/phy.o
  CC      drivers/gpu/drm/i915/gt/intel_context.o
  AR      drivers/input/built-in.a
  CC      net/ipv6/netfilter.o
  CC      drivers/md/dm-linear.o
  CC      net/wireless/ocb.o
  CC      drivers/cpufreq/intel_pstate.o
  CC      drivers/acpi/acpica/utstrsuppt.o
  CC      drivers/usb/core/port.o
  CC      mm/execmem.o
  CC      drivers/firmware/efi/libstub/secureboot.o
  CC      net/ipv4/tunnel4.o
  CC      drivers/firmware/efi/memattr.o
  CC      net/ipv4/ipconfig.o
  AR      drivers/usb/host/built-in.a
  CC      kernel/smp.o
  CC      kernel/uid16.o
  CC      kernel/kallsyms.o
  CC      fs/mnt_idmapping.o
  CC      net/ipv4/netfilter.o
  CC      net/mac80211/link.o
  CC      net/mac80211/rate.o
  CC      drivers/usb/core/hcd-pci.o
  AR      drivers/platform/x86/built-in.a
  AR      drivers/firmware/psci/built-in.a
  AR      drivers/platform/surface/built-in.a
  CC      net/mac80211/michael.o
  AR      drivers/platform/built-in.a
  AR      drivers/firmware/qcom/built-in.a
  CC      net/ipv6/proc.o
  AR      net/sunrpc/built-in.a
  AR      drivers/android/built-in.a
  CC      net/ipv6/syncookies.o
  AR      drivers/nvmem/layouts/built-in.a
  CC      drivers/nvmem/core.o
  CC      net/ipv6/calipso.o
  CC [M]  drivers/gpu/drm/xe/xe_guc_pc.o
  CC      drivers/acpi/acpica/utstrtoul64.o
  AR      drivers/hid/usbhid/built-in.a
  CC      drivers/hid/hid-quirks.o
  CC      lib/glob.o
  CC      kernel/acct.o
  CC      drivers/net/ethernet/intel/e1000e/param.o
  CC      drivers/net/ethernet/intel/e1000e/ethtool.o
  AR      mm/built-in.a
  CC      net/mac80211/tkip.o
  CC      net/mac80211/aes_cmac.o
  CC      drivers/hid/hid-debug.o
  CC      net/ipv4/tcp_cubic.o
  CC      drivers/hid/hidraw.o
  CC      net/ipv6/ah6.o
  CC      fs/remap_range.o
  CC      net/ipv6/esp6.o
  CC      drivers/firmware/efi/libstub/tpm.o
  CC      net/ipv6/sit.o
  CC      drivers/acpi/acpica/utxface.o
  CC      drivers/net/ethernet/intel/e1000e/netdev.o
  CC      drivers/usb/core/usb-acpi.o
  CC [M]  drivers/gpu/drm/xe/xe_guc_submit.o
  CC      lib/strncpy_from_user.o
  CC      drivers/gpu/drm/i915/gt/intel_context_sseu.o
  CC      drivers/net/ethernet/intel/e1000e/ptp.o
  CC      net/ipv6/addrconf_core.o
  CC      kernel/vmcore_info.o
  CC      drivers/firmware/efi/tpm.o
  CC      fs/pidfs.o
  AR      drivers/net/ethernet/ni/built-in.a
  CC      drivers/net/ethernet/nvidia/forcedeth.o
  CC      fs/buffer.o
  CC      drivers/acpi/acpica/utxfinit.o
  CC      net/mac80211/aes_gmac.o
  CC      net/mac80211/fils_aead.o
  CC      drivers/firmware/efi/libstub/file.o
  CC      net/wireless/pmsr.o
  CC      net/ipv4/tcp_sigpool.o
  CC      drivers/hid/hid-generic.o
  CC      drivers/gpu/drm/i915/gt/intel_engine_cs.o
  CC      drivers/firmware/efi/memmap.o
  CC      lib/strnlen_user.o
  CC [M]  drivers/gpu/drm/xe/xe_heci_gsc.o
  CC      net/mac80211/cfg.o
  AR      drivers/nvmem/built-in.a
  CC      fs/mpage.o
  CC      drivers/gpu/drm/i915/gt/intel_engine_heartbeat.o
  CC      drivers/md/dm-stripe.o
  AR      drivers/usb/core/built-in.a
  AR      drivers/usb/built-in.a
  CC      drivers/md/dm-ioctl.o
  CC      drivers/acpi/acpica/utxferror.o
  CC      net/ipv6/exthdrs_core.o
  CC      net/mac80211/ethtool.o
  CC      lib/net_utils.o
  CC      net/ipv6/ip6_checksum.o
  CC      kernel/elfcorehdr.o
  CC [M]  drivers/gpu/drm/xe/xe_hw_engine.o
  CC      drivers/firmware/efi/capsule.o
  GEN     net/wireless/shipped-certs.c
  CC      drivers/firmware/efi/esrt.o
  CC      drivers/gpu/drm/i915/gt/intel_engine_pm.o
  CC      net/mac80211/rx.o
  CC [M]  drivers/gpu/drm/xe/xe_hw_engine_class_sysfs.o
  AR      drivers/cpufreq/built-in.a
  CC      fs/proc_namespace.o
  CC      fs/direct-io.o
  CC      fs/eventpoll.o
  CC      drivers/firmware/efi/libstub/mem.o
  CC      drivers/acpi/acpica/utxfmutex.o
  AR      drivers/net/ethernet/oki-semi/built-in.a
  CC      drivers/gpu/drm/drm_drv.o
  CC      drivers/gpu/drm/i915/gt/intel_engine_user.o
  CC      drivers/hid/hid-a4tech.o
  CC      net/ipv6/ip6_icmp.o
  CC      drivers/hid/hid-apple.o
  CC      drivers/gpu/drm/i915/gt/intel_execlists_submission.o
  CC      net/ipv4/cipso_ipv4.o
  CC      net/ipv4/xfrm4_policy.o
  CC      net/mac80211/spectmgmt.o
  CC      fs/anon_inodes.o
  CC      net/mac80211/tx.o
  CC      kernel/crash_reserve.o
  CC      lib/sg_pool.o
  AR      drivers/acpi/acpica/built-in.a
  AR      drivers/acpi/built-in.a
  CC      net/ipv6/output_core.o
  CC      drivers/md/dm-io.o
  CC      net/ipv6/protocol.o
  CC      drivers/md/dm-kcopyd.o
  CC      fs/signalfd.o
  CC      drivers/hid/hid-belkin.o
  CC      drivers/gpu/drm/drm_dumb_buffers.o
  CC      drivers/hid/hid-cherry.o
  AR      drivers/firmware/smccc/built-in.a
  CC      lib/stackdepot.o
  AR      drivers/firmware/tegra/built-in.a
  CC      net/ipv6/ip6_offload.o
  CC      drivers/md/dm-sysfs.o
  CC      drivers/firmware/efi/libstub/random.o
  CC [M]  drivers/gpu/drm/xe/xe_hw_fence.o
  CC      net/ipv4/xfrm4_state.o
  CC      net/mac80211/key.o
  CC      drivers/gpu/drm/i915/gt/intel_ggtt.o
  CC      fs/timerfd.o
  CC      drivers/md/dm-stats.o
  AR      drivers/firmware/xilinx/built-in.a
  CC      drivers/hid/hid-chicony.o
  CC      drivers/hid/hid-cypress.o
  CC      fs/eventfd.o
  CC      net/ipv4/xfrm4_input.o
  CC [M]  drivers/gpu/drm/xe/xe_huc.o
  CC      drivers/hid/hid-ezkey.o
  CC      drivers/firmware/efi/libstub/randomalloc.o
  CC      drivers/firmware/dmi_scan.o
  CC      kernel/kexec_core.o
  CC      drivers/gpu/drm/drm_edid.o
  CC      drivers/hid/hid-gyration.o
  CC      net/mac80211/util.o
  CC      drivers/firmware/efi/runtime-wrappers.o
  CC      fs/aio.o
  CC      lib/asn1_decoder.o
  CC      drivers/firmware/efi/capsule-loader.o
  CC      drivers/gpu/drm/i915/gt/intel_ggtt_fencing.o
  CC      fs/locks.o
  CC      drivers/firmware/efi/libstub/pci.o
  CC      drivers/hid/hid-ite.o
  CC      drivers/firmware/efi/libstub/skip_spaces.o
  GEN     lib/oid_registry_data.c
  CC      drivers/firmware/efi/libstub/lib-cmdline.o
  CC      lib/ucs2_string.o
  CC      drivers/gpu/drm/i915/gt/intel_gt.o
  CC      drivers/gpu/drm/i915/gt/intel_gt_buffer_pool.o
  CC      lib/sbitmap.o
  CC      net/ipv6/tcpv6_offload.o
  CC      drivers/firmware/efi/libstub/lib-ctype.o
  CC      drivers/firmware/efi/libstub/alignedmem.o
  CC      drivers/md/dm-rq.o
  CC      kernel/crash_core.o
  CC      drivers/firmware/dmi-id.o
  CC      drivers/firmware/efi/libstub/relocate.o
  CC      drivers/gpu/drm/i915/gt/intel_gt_ccs_mode.o
  CC      drivers/firmware/efi/libstub/printk.o
  CC      net/ipv6/exthdrs_offload.o
  CC      drivers/firmware/efi/libstub/vsprintf.o
  CC      drivers/firmware/efi/earlycon.o
  CC      net/ipv6/inet6_hashtables.o
  CC      net/ipv6/mcast_snoop.o
  CC      net/ipv4/xfrm4_output.o
  CC      drivers/gpu/drm/i915/gt/intel_gt_clock_utils.o
  CC      drivers/hid/hid-kensington.o
  CC      lib/group_cpus.o
  CC      net/wireless/shipped-certs.o
  CC [M]  drivers/gpu/drm/xe/xe_huc_debugfs.o
  CC      net/ipv4/xfrm4_protocol.o
  CC      drivers/firmware/efi/libstub/x86-stub.o
  AR      drivers/net/ethernet/packetengines/built-in.a
  STUBCPY drivers/firmware/efi/libstub/efi-stub-helper.stub.o
  STUBCPY drivers/firmware/efi/libstub/file.stub.o
  CC      drivers/firmware/memmap.o
  STUBCPY drivers/firmware/efi/libstub/gop.stub.o
  CC      lib/fw_table.o
  AR      drivers/net/ethernet/nvidia/built-in.a
  STUBCPY drivers/firmware/efi/libstub/lib-cmdline.stub.o
  STUBCPY drivers/firmware/efi/libstub/lib-ctype.stub.o
  AR      drivers/net/ethernet/qlogic/built-in.a
  AR      lib/lib.a
  STUBCPY drivers/firmware/efi/libstub/mem.stub.o
  CC      drivers/hid/hid-lg.o
  GEN     lib/crc32table.h
  CC      kernel/kexec.o
  STUBCPY drivers/firmware/efi/libstub/random.stub.o
  CC      lib/oid_registry.o
  CC      drivers/gpu/drm/drm_eld.o
  CC      fs/binfmt_misc.o
  AR      drivers/net/ethernet/qualcomm/emac/built-in.a
  AR      drivers/net/ethernet/qualcomm/built-in.a
  CC [M]  drivers/gpu/drm/xe/xe_irq.o
  CC      fs/binfmt_script.o
  CC      drivers/gpu/drm/drm_encoder.o
  CC      fs/binfmt_elf.o
  CC      net/mac80211/parse.o
  STUBCPY drivers/firmware/efi/libstub/randomalloc.stub.o
  STUBCPY drivers/firmware/efi/libstub/secureboot.stub.o
  STUBCPY drivers/firmware/efi/libstub/skip_spaces.stub.o
  STUBCPY drivers/firmware/efi/libstub/tpm.stub.o
  STUBCPY drivers/firmware/efi/libstub/vsprintf.stub.o
  CC      drivers/hid/hid-lgff.o
  CC      lib/crc32.o
  CC      kernel/utsname.o
  CC      drivers/gpu/drm/i915/gt/intel_gt_debugfs.o
  CC      kernel/pid_namespace.o
  CC      kernel/stop_machine.o
  STUBCPY drivers/firmware/efi/libstub/alignedmem.stub.o
  STUBCPY drivers/firmware/efi/libstub/pci.stub.o
  STUBCPY drivers/firmware/efi/libstub/printk.stub.o
  CC      kernel/audit.o
  STUBCPY drivers/firmware/efi/libstub/relocate.stub.o
  CC [M]  drivers/gpu/drm/xe/xe_lrc.o
  CC      drivers/md/dm-io-rewind.o
  CC      drivers/gpu/drm/i915/gt/intel_gt_engines_debugfs.o
  AR      drivers/firmware/efi/built-in.a
  CC      drivers/gpu/drm/drm_file.o
  CC      drivers/gpu/drm/drm_fourcc.o
  CC      net/mac80211/wme.o
  CC      fs/mbcache.o
  CC      drivers/net/ethernet/realtek/8139too.o
  CC      fs/posix_acl.o
  CC      drivers/net/ethernet/realtek/r8169_main.o
  CC [M]  drivers/gpu/drm/xe/xe_migrate.o
  CC      net/mac80211/chan.o
  AR      drivers/net/ethernet/intel/e1000e/built-in.a
  AR      drivers/net/ethernet/intel/built-in.a
  CC [M]  drivers/gpu/drm/xe/xe_mmio.o
  CC      drivers/md/dm-builtin.o
  CC      drivers/net/ethernet/realtek/r8169_firmware.o
  CC      drivers/md/dm-raid1.o
  CC      kernel/auditfilter.o
  CC      drivers/gpu/drm/i915/gt/intel_gt_irq.o
  CC      drivers/gpu/drm/i915/gt/intel_gt_mcr.o
  CC      drivers/gpu/drm/drm_framebuffer.o
  AR      lib/built-in.a
  STUBCPY drivers/firmware/efi/libstub/x86-stub.stub.o
  CC      drivers/gpu/drm/drm_gem.o
  AR      drivers/firmware/efi/libstub/lib.a
  CC      drivers/gpu/drm/i915/gt/intel_gt_pm.o
  CC      drivers/md/dm-log.o
  AR      drivers/firmware/built-in.a
  CC      drivers/gpu/drm/drm_ioctl.o
  CC      drivers/md/dm-region-hash.o
  AR      drivers/net/ethernet/renesas/built-in.a
  CC      fs/coredump.o
  CC      drivers/gpu/drm/i915/gt/intel_gt_pm_debugfs.o
  AR      drivers/net/ethernet/rdc/built-in.a
  CC      drivers/gpu/drm/i915/gt/intel_gt_pm_irq.o
  CC      drivers/net/ethernet/realtek/r8169_phy_config.o
  CC      net/mac80211/trace.o
  AR      net/ipv4/built-in.a
  CC      net/mac80211/mlme.o
  CC [M]  drivers/gpu/drm/xe/xe_mocs.o
  CC      drivers/hid/hid-lg4ff.o
  CC      net/mac80211/tdls.o
  CC      kernel/auditsc.o
  CC      net/mac80211/ocb.o
  AR      net/ipv6/built-in.a
  AR      drivers/net/ethernet/rocker/built-in.a
  CC      fs/drop_caches.o
  AR      drivers/net/ethernet/samsung/built-in.a
  CC      kernel/audit_watch.o
  AR      drivers/net/ethernet/seeq/built-in.a
  CC      fs/sysctls.o
  CC      drivers/gpu/drm/i915/gt/intel_gt_requests.o
  CC      drivers/gpu/drm/i915/gt/intel_gt_sysfs.o
  CC      fs/fhandle.o
  CC      drivers/md/dm-zero.o
  CC      drivers/gpu/drm/drm_lease.o
  CC      drivers/gpu/drm/drm_managed.o
  CC      kernel/audit_fsnotify.o
  CC [M]  drivers/gpu/drm/xe/xe_module.o
  CC      net/mac80211/airtime.o
  CC      net/mac80211/eht.o
  CC      net/mac80211/led.o
  CC      net/mac80211/pm.o
  CC      net/mac80211/rc80211_minstrel_ht.o
  CC      net/mac80211/wbrf.o
  CC      drivers/gpu/drm/drm_mm.o
  CC      drivers/hid/hid-lg-g15.o
  CC      drivers/gpu/drm/drm_mode_config.o
  CC      drivers/gpu/drm/i915/gt/intel_gt_sysfs_pm.o
  CC [M]  drivers/gpu/drm/xe/xe_pat.o
  CC      drivers/gpu/drm/i915/gt/intel_gtt.o
  CC      drivers/gpu/drm/drm_mode_object.o
  CC      drivers/gpu/drm/drm_modes.o
  CC      drivers/gpu/drm/i915/gt/intel_llc.o
  AR      drivers/net/ethernet/silan/built-in.a
  AR      drivers/net/ethernet/sis/built-in.a
  AR      drivers/net/ethernet/sfc/built-in.a
  CC      kernel/audit_tree.o
  AR      drivers/net/ethernet/smsc/built-in.a
  CC      kernel/kprobes.o
  CC      drivers/gpu/drm/i915/gt/intel_lrc.o
  CC      drivers/gpu/drm/drm_modeset_lock.o
  AR      drivers/md/built-in.a
  CC      drivers/gpu/drm/i915/gt/intel_migrate.o
  CC      drivers/gpu/drm/i915/gt/intel_mocs.o
  CC      kernel/seccomp.o
  CC      drivers/gpu/drm/i915/gt/intel_ppgtt.o
  CC      kernel/relay.o
  CC      drivers/hid/hid-microsoft.o
  CC      kernel/utsname_sysctl.o
  CC      drivers/gpu/drm/i915/gt/intel_rc6.o
  CC      drivers/gpu/drm/i915/gt/intel_region_lmem.o
  CC      drivers/gpu/drm/i915/gt/intel_renderstate.o
  CC      kernel/delayacct.o
  CC      drivers/gpu/drm/drm_plane.o
  CC      drivers/gpu/drm/i915/gt/intel_reset.o
  CC      kernel/taskstats.o
  CC      drivers/hid/hid-monterey.o
  CC [M]  drivers/gpu/drm/xe/xe_pci.o
  AR      fs/built-in.a
  CC [M]  drivers/gpu/drm/xe/xe_pcode.o
  CC [M]  drivers/gpu/drm/xe/xe_pm.o
  CC [M]  drivers/gpu/drm/xe/xe_preempt_fence.o
  CC      drivers/gpu/drm/drm_prime.o
  CC [M]  drivers/gpu/drm/xe/xe_pt.o
  CC      drivers/hid/hid-ntrig.o
  CC      drivers/gpu/drm/drm_print.o
  CC      drivers/gpu/drm/i915/gt/intel_ring.o
  CC [M]  drivers/gpu/drm/xe/xe_pt_walk.o
  CC      drivers/hid/hid-pl.o
  AR      drivers/net/ethernet/socionext/built-in.a
  AR      drivers/net/ethernet/stmicro/built-in.a
  AR      drivers/net/ethernet/sun/built-in.a
  AR      drivers/net/ethernet/tehuti/built-in.a
  AR      drivers/net/ethernet/ti/built-in.a
  AR      drivers/net/ethernet/vertexcom/built-in.a
  AR      drivers/net/ethernet/via/built-in.a
  CC      drivers/gpu/drm/i915/gt/intel_ring_submission.o
  AR      drivers/net/ethernet/wangxun/built-in.a
  CC      drivers/gpu/drm/i915/gt/intel_rps.o
  AR      drivers/net/ethernet/wiznet/built-in.a
  CC      drivers/gpu/drm/i915/gt/intel_sa_media.o
  CC      drivers/gpu/drm/i915/gt/intel_sseu.o
  CC      drivers/hid/hid-petalynx.o
  CC      kernel/tsacct.o
  CC [M]  drivers/gpu/drm/xe/xe_query.o
  CC      drivers/gpu/drm/i915/gt/intel_sseu_debugfs.o
  CC      drivers/gpu/drm/i915/gt/intel_timeline.o
  CC      kernel/tracepoint.o
  CC      drivers/hid/hid-redragon.o
  CC      drivers/gpu/drm/drm_property.o
  AR      net/wireless/built-in.a
  CC      drivers/gpu/drm/i915/gt/intel_tlb.o
  CC [M]  drivers/gpu/drm/xe/xe_range_fence.o
  AR      drivers/net/ethernet/realtek/built-in.a
  AR      drivers/net/ethernet/xilinx/built-in.a
  CC      drivers/gpu/drm/i915/gt/intel_wopcm.o
  AR      drivers/net/ethernet/xircom/built-in.a
  AR      drivers/net/ethernet/synopsys/built-in.a
  CC [M]  drivers/gpu/drm/xe/xe_reg_sr.o
  CC      drivers/gpu/drm/i915/gt/intel_workarounds.o
  AR      drivers/net/ethernet/pensando/built-in.a
  AR      drivers/net/ethernet/built-in.a
  CC      kernel/irq_work.o
  CC      drivers/gpu/drm/drm_syncobj.o
  CC      drivers/gpu/drm/drm_sysfs.o
  CC      drivers/gpu/drm/drm_trace_points.o
  CC [M]  drivers/gpu/drm/xe/xe_reg_whitelist.o
  CC      kernel/static_call.o
  CC [M]  drivers/gpu/drm/xe/xe_rtp.o
  CC [M]  drivers/gpu/drm/xe/xe_ring_ops.o
  CC      drivers/gpu/drm/i915/gt/shmem_utils.o
  CC [M]  drivers/gpu/drm/xe/xe_sa.o
  CC      drivers/hid/hid-samsung.o
  CC      kernel/padata.o
  CC      kernel/jump_label.o
  CC      drivers/gpu/drm/i915/gt/sysfs_engines.o
  CC      drivers/hid/hid-sony.o
  AR      drivers/net/built-in.a
  CC      drivers/gpu/drm/i915/gt/intel_ggtt_gmch.o
  CC      drivers/gpu/drm/i915/gt/gen6_renderstate.o
  CC      drivers/gpu/drm/i915/gt/gen7_renderstate.o
  CC      kernel/context_tracking.o
  CC      drivers/gpu/drm/drm_vblank.o
  CC [M]  drivers/gpu/drm/xe/xe_sched_job.o
  CC      kernel/iomem.o
  CC      drivers/hid/hid-sunplus.o
  CC      drivers/hid/hid-topseed.o
  CC [M]  drivers/gpu/drm/xe/xe_step.o
  CC [M]  drivers/gpu/drm/xe/xe_sync.o
  CC      kernel/rseq.o
  CC      drivers/gpu/drm/i915/gt/gen8_renderstate.o
  CC      drivers/gpu/drm/i915/gt/gen9_renderstate.o
  CC      drivers/gpu/drm/i915/gem/i915_gem_busy.o
  CC      drivers/gpu/drm/i915/gem/i915_gem_clflush.o
  CC      drivers/gpu/drm/i915/gem/i915_gem_context.o
  CC      drivers/gpu/drm/i915/gem/i915_gem_create.o
  CC [M]  drivers/gpu/drm/xe/xe_tile.o
  CC [M]  drivers/gpu/drm/xe/xe_tile_sysfs.o
  CC      drivers/gpu/drm/drm_vblank_work.o
  CC      drivers/gpu/drm/drm_vma_manager.o
  CC [M]  drivers/gpu/drm/xe/xe_trace.o
  CC [M]  drivers/gpu/drm/xe/xe_ttm_sys_mgr.o
  CC      drivers/gpu/drm/i915/gem/i915_gem_dmabuf.o
  CC [M]  drivers/gpu/drm/xe/xe_ttm_stolen_mgr.o
  CC      drivers/gpu/drm/i915/gem/i915_gem_domain.o
  CC      drivers/gpu/drm/i915/gem/i915_gem_execbuffer.o
  CC      drivers/gpu/drm/i915/gem/i915_gem_internal.o
  CC      drivers/gpu/drm/i915/gem/i915_gem_lmem.o
  CC      drivers/gpu/drm/i915/gem/i915_gem_mman.o
  CC [M]  drivers/gpu/drm/xe/xe_ttm_vram_mgr.o
  CC      drivers/gpu/drm/i915/gem/i915_gem_object.o
  CC      drivers/gpu/drm/i915/gem/i915_gem_pages.o
  CC      drivers/gpu/drm/drm_writeback.o
  CC [M]  drivers/gpu/drm/xe/xe_tuning.o
  CC      drivers/gpu/drm/drm_panel.o
  CC      drivers/gpu/drm/drm_pci.o
  CC      drivers/gpu/drm/i915/gem/i915_gem_phys.o
  CC      drivers/gpu/drm/i915/gem/i915_gem_pm.o
  CC [M]  drivers/gpu/drm/xe/xe_uc.o
  CC [M]  drivers/gpu/drm/xe/xe_uc_debugfs.o
  CC      drivers/gpu/drm/i915/gem/i915_gem_region.o
  CC [M]  drivers/gpu/drm/xe/xe_uc_fw.o
  CC      drivers/gpu/drm/drm_debugfs.o
  CC      drivers/gpu/drm/i915/gem/i915_gem_shmem.o
  CC      drivers/gpu/drm/i915/gem/i915_gem_shrinker.o
  CC [M]  drivers/gpu/drm/xe/xe_vm.o
  CC [M]  drivers/gpu/drm/xe/xe_vram.o
  CC      drivers/gpu/drm/i915/gem/i915_gem_stolen.o
  CC      drivers/gpu/drm/i915/gem/i915_gem_throttle.o
  AR      drivers/hid/built-in.a
  CC      drivers/gpu/drm/i915/gem/i915_gem_tiling.o
  CC [M]  drivers/gpu/drm/xe/xe_vram_freq.o
  AR      kernel/built-in.a
  CC      drivers/gpu/drm/drm_debugfs_crc.o
  CC      drivers/gpu/drm/drm_panel_orientation_quirks.o
  CC [M]  drivers/gpu/drm/xe/xe_wait_user_fence.o
  CC      drivers/gpu/drm/i915/gem/i915_gem_ttm.o
  CC [M]  drivers/gpu/drm/xe/xe_wa.o
  CC      drivers/gpu/drm/i915/gem/i915_gem_ttm_move.o
  CC      drivers/gpu/drm/drm_buddy.o
  CC [M]  drivers/gpu/drm/xe/xe_wopcm.o
  CC [M]  drivers/gpu/drm/xe/xe_hmm.o
  CC      drivers/gpu/drm/i915/gem/i915_gem_ttm_pm.o
  CC [M]  drivers/gpu/drm/xe/xe_hwmon.o
  CC [M]  drivers/gpu/drm/xe/xe_gt_sriov_vf.o
  CC      drivers/gpu/drm/drm_gem_shmem_helper.o
  CC      drivers/gpu/drm/i915/gem/i915_gem_userptr.o
  CC      drivers/gpu/drm/i915/gem/i915_gem_wait.o
  CC [M]  drivers/gpu/drm/xe/xe_gt_sriov_vf_debugfs.o
  CC      drivers/gpu/drm/i915/gem/i915_gemfs.o
  CC [M]  drivers/gpu/drm/xe/xe_guc_relay.o
  CC [M]  drivers/gpu/drm/xe/xe_memirq.o
  CC      drivers/gpu/drm/i915/i915_active.o
  CC [M]  drivers/gpu/drm/xe/xe_sriov.o
  CC      drivers/gpu/drm/i915/i915_cmd_parser.o
  CC      drivers/gpu/drm/i915/i915_deps.o
  CC [M]  drivers/gpu/drm/xe/display/ext/i915_irq.o
  CC      drivers/gpu/drm/i915/i915_gem.o
  CC      drivers/gpu/drm/i915/i915_gem_evict.o
  CC      drivers/gpu/drm/i915/i915_gem_gtt.o
  CC [M]  drivers/gpu/drm/xe/display/ext/i915_utils.o
  CC      drivers/gpu/drm/drm_atomic_helper.o
  CC      drivers/gpu/drm/drm_atomic_state_helper.o
  CC      drivers/gpu/drm/drm_bridge_connector.o
  CC [M]  drivers/gpu/drm/xe/display/intel_fb_bo.o
  CC      drivers/gpu/drm/i915/i915_gem_ww.o
  CC      drivers/gpu/drm/drm_crtc_helper.o
  CC [M]  drivers/gpu/drm/xe/display/intel_fbdev_fb.o
  CC [M]  drivers/gpu/drm/xe/display/xe_display.o
  CC      drivers/gpu/drm/i915/i915_query.o
  CC [M]  drivers/gpu/drm/xe/display/xe_display_misc.o
  CC [M]  drivers/gpu/drm/xe/display/xe_display_rps.o
  CC      drivers/gpu/drm/i915/i915_request.o
  CC [M]  drivers/gpu/drm/xe/display/xe_dsb_buffer.o
  CC      drivers/gpu/drm/i915/i915_scheduler.o
  CC [M]  drivers/gpu/drm/xe/display/xe_fb_pin.o
  CC      drivers/gpu/drm/i915/i915_trace_points.o
  CC [M]  drivers/gpu/drm/xe/display/xe_hdcp_gsc.o
  CC      drivers/gpu/drm/drm_damage_helper.o
  CC      drivers/gpu/drm/i915/i915_ttm_buddy_manager.o
  CC      drivers/gpu/drm/i915/i915_vma.o
  CC      drivers/gpu/drm/i915/i915_vma_resource.o
  CC [M]  drivers/gpu/drm/xe/display/xe_plane_initial.o
  CC      drivers/gpu/drm/i915/gt/uc/intel_gsc_fw.o
  CC      drivers/gpu/drm/i915/gt/uc/intel_gsc_proxy.o
  CC      drivers/gpu/drm/i915/gt/uc/intel_gsc_uc.o
  CC [M]  drivers/gpu/drm/xe/display/xe_tdf.o
  CC      drivers/gpu/drm/drm_encoder_slave.o
  CC [M]  drivers/gpu/drm/xe/i915-soc/intel_dram.o
  CC      drivers/gpu/drm/i915/gt/uc/intel_gsc_uc_debugfs.o
  CC      drivers/gpu/drm/drm_flip_work.o
  CC      drivers/gpu/drm/i915/gt/uc/intel_gsc_uc_heci_cmd_submit.o
  CC [M]  drivers/gpu/drm/xe/i915-soc/intel_pch.o
  CC      drivers/gpu/drm/drm_format_helper.o
  CC      drivers/gpu/drm/i915/gt/uc/intel_guc.o
  CC      drivers/gpu/drm/drm_gem_atomic_helper.o
  CC      drivers/gpu/drm/i915/gt/uc/intel_guc_ads.o
  CC [M]  drivers/gpu/drm/xe/i915-display/icl_dsi.o
  CC      drivers/gpu/drm/i915/gt/uc/intel_guc_capture.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_alpm.o
  CC      drivers/gpu/drm/drm_gem_framebuffer_helper.o
  CC      drivers/gpu/drm/i915/gt/uc/intel_guc_ct.o
  CC      drivers/gpu/drm/drm_kms_helper_common.o
  CC      drivers/gpu/drm/i915/gt/uc/intel_guc_debugfs.o
  CC      drivers/gpu/drm/i915/gt/uc/intel_guc_fw.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_atomic.o
  CC      drivers/gpu/drm/drm_modeset_helper.o
  CC      drivers/gpu/drm/i915/gt/uc/intel_guc_hwconfig.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_atomic_plane.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_audio.o
  CC      drivers/gpu/drm/drm_plane_helper.o
  CC      drivers/gpu/drm/i915/gt/uc/intel_guc_log.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_backlight.o
  CC      drivers/gpu/drm/drm_probe_helper.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_bios.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_bw.o
  CC      drivers/gpu/drm/i915/gt/uc/intel_guc_log_debugfs.o
  CC      drivers/gpu/drm/drm_rect.o
  CC      drivers/gpu/drm/i915/gt/uc/intel_guc_rc.o
  CC      drivers/gpu/drm/i915/gt/uc/intel_guc_slpc.o
  CC      drivers/gpu/drm/drm_self_refresh_helper.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_cdclk.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_color.o
  CC      drivers/gpu/drm/drm_simple_kms_helper.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_combo_phy.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_connector.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_crtc.o
  CC      drivers/gpu/drm/i915/gt/uc/intel_guc_submission.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_crtc_state_dump.o
  CC      drivers/gpu/drm/i915/gt/uc/intel_huc.o
  CC      drivers/gpu/drm/i915/gt/uc/intel_huc_debugfs.o
  CC      drivers/gpu/drm/i915/gt/uc/intel_huc_fw.o
  CC      drivers/gpu/drm/bridge/panel.o
  CC      drivers/gpu/drm/drm_mipi_dsi.o
  CC      drivers/gpu/drm/i915/gt/uc/intel_uc.o
  CC      drivers/gpu/drm/i915/gt/uc/intel_uc_debugfs.o
  CC      drivers/gpu/drm/i915/gt/uc/intel_uc_fw.o
  CC [M]  drivers/gpu/drm/drm_exec.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_cursor.o
  CC [M]  drivers/gpu/drm/drm_gpuvm.o
  CC      drivers/gpu/drm/i915/gt/intel_gsc.o
  CC [M]  drivers/gpu/drm/drm_suballoc.o
  CC      drivers/gpu/drm/i915/i915_hwmon.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_cx0_phy.o
  CC [M]  drivers/gpu/drm/drm_gem_ttm_helper.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_ddi.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_ddi_buf_trans.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_display.o
  CC      drivers/gpu/drm/i915/display/hsw_ips.o
  CC      drivers/gpu/drm/i915/display/i9xx_plane.o
  CC      drivers/gpu/drm/i915/display/i9xx_wm.o
  CC      drivers/gpu/drm/i915/display/intel_alpm.o
  CC      drivers/gpu/drm/i915/display/intel_atomic.o
  CC      drivers/gpu/drm/i915/display/intel_atomic_plane.o
  CC      drivers/gpu/drm/i915/display/intel_audio.o
  CC      drivers/gpu/drm/i915/display/intel_bios.o
  CC      drivers/gpu/drm/i915/display/intel_bw.o
  CC      drivers/gpu/drm/i915/display/intel_cdclk.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_display_device.o
  CC      drivers/gpu/drm/i915/display/intel_color.o
  CC      drivers/gpu/drm/i915/display/intel_combo_phy.o
  CC      drivers/gpu/drm/i915/display/intel_connector.o
  CC      drivers/gpu/drm/i915/display/intel_crtc.o
  CC      drivers/gpu/drm/i915/display/intel_crtc_state_dump.o
  CC      drivers/gpu/drm/i915/display/intel_cursor.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_display_driver.o
  CC      drivers/gpu/drm/i915/display/intel_display.o
  LD [M]  drivers/gpu/drm/drm_suballoc_helper.o
  CC      drivers/gpu/drm/i915/display/intel_display_driver.o
  CC      drivers/gpu/drm/i915/display/intel_display_irq.o
  CC      drivers/gpu/drm/i915/display/intel_display_params.o
  CC      drivers/gpu/drm/i915/display/intel_display_power.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_display_irq.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_display_params.o
  LD [M]  drivers/gpu/drm/drm_ttm_helper.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_display_power.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_display_power_map.o
  CC      drivers/gpu/drm/i915/display/intel_display_power_map.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_display_power_well.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_display_trace.o
  CC      drivers/gpu/drm/i915/display/intel_display_power_well.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_display_wa.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_dkl_phy.o
  CC      drivers/gpu/drm/i915/display/intel_display_reset.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_dmc.o
  CC      drivers/gpu/drm/i915/display/intel_display_rps.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_dp.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_dp_aux.o
  CC      drivers/gpu/drm/i915/display/intel_display_wa.o
  AR      net/mac80211/built-in.a
  AR      net/built-in.a
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_dp_aux_backlight.o
  CC      drivers/gpu/drm/i915/display/intel_dmc.o
  CC      drivers/gpu/drm/i915/display/intel_dmc_wl.o
  CC      drivers/gpu/drm/i915/display/intel_dpio_phy.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_dp_hdcp.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_dp_link_training.o
  CC      drivers/gpu/drm/i915/display/intel_dpll.o
  CC      drivers/gpu/drm/i915/display/intel_dpll_mgr.o
  CC      drivers/gpu/drm/i915/display/intel_dpt.o
  CC      drivers/gpu/drm/i915/display/intel_dpt_common.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_dp_mst.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_dpll.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_dpll_mgr.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_dpt_common.o
  CC      drivers/gpu/drm/i915/display/intel_drrs.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_drrs.o
  CC      drivers/gpu/drm/i915/display/intel_dsb.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_dsb.o
  CC      drivers/gpu/drm/i915/display/intel_dsb_buffer.o
  CC      drivers/gpu/drm/i915/display/intel_fb.o
  CC      drivers/gpu/drm/i915/display/intel_fb_bo.o
  CC      drivers/gpu/drm/i915/display/intel_fb_pin.o
  CC      drivers/gpu/drm/i915/display/intel_fbc.o
  CC      drivers/gpu/drm/i915/display/intel_fdi.o
  CC      drivers/gpu/drm/i915/display/intel_fifo_underrun.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_dsi.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_dsi_dcs_backlight.o
  CC      drivers/gpu/drm/i915/display/intel_frontbuffer.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_dsi_vbt.o
  CC      drivers/gpu/drm/i915/display/intel_global_state.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_fb.o
  CC      drivers/gpu/drm/i915/display/intel_hdcp.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_fbc.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_fdi.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_fifo_underrun.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_frontbuffer.o
  CC      drivers/gpu/drm/i915/display/intel_hdcp_gsc.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_global_state.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_gmbus.o
  CC      drivers/gpu/drm/i915/display/intel_hdcp_gsc_message.o
  CC      drivers/gpu/drm/i915/display/intel_hotplug.o
  CC      drivers/gpu/drm/i915/display/intel_hotplug_irq.o
  CC      drivers/gpu/drm/i915/display/intel_hti.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_hdcp.o
  CC      drivers/gpu/drm/i915/display/intel_link_bw.o
  CC      drivers/gpu/drm/i915/display/intel_load_detect.o
  CC      drivers/gpu/drm/i915/display/intel_lpe_audio.o
  CC      drivers/gpu/drm/i915/display/intel_modeset_lock.o
  CC      drivers/gpu/drm/i915/display/intel_modeset_setup.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_hdcp_gsc_message.o
  CC      drivers/gpu/drm/i915/display/intel_modeset_verify.o
  CC      drivers/gpu/drm/i915/display/intel_overlay.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_hdmi.o
  CC      drivers/gpu/drm/i915/display/intel_pch_display.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_hotplug.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_hotplug_irq.o
  CC      drivers/gpu/drm/i915/display/intel_pch_refclk.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_hti.o
  CC      drivers/gpu/drm/i915/display/intel_plane_initial.o
  CC      drivers/gpu/drm/i915/display/intel_pmdemand.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_link_bw.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_lspcon.o
  CC      drivers/gpu/drm/i915/display/intel_psr.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_modeset_lock.o
  CC      drivers/gpu/drm/i915/display/intel_quirks.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_modeset_setup.o
  CC      drivers/gpu/drm/i915/display/intel_sprite.o
  CC      drivers/gpu/drm/i915/display/intel_sprite_uapi.o
  CC      drivers/gpu/drm/i915/display/intel_tc.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_modeset_verify.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_panel.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_pmdemand.o
  CC      drivers/gpu/drm/i915/display/intel_vblank.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_pps.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_psr.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_qp_tables.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_quirks.o
  CC      drivers/gpu/drm/i915/display/intel_vga.o
  CC      drivers/gpu/drm/i915/display/intel_wm.o
  CC      drivers/gpu/drm/i915/display/skl_scaler.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_snps_phy.o
  CC      drivers/gpu/drm/i915/display/skl_universal_plane.o
  CC      drivers/gpu/drm/i915/display/skl_watermark.o
  CC      drivers/gpu/drm/i915/display/intel_acpi.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_tc.o
  CC      drivers/gpu/drm/i915/display/intel_opregion.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_vblank.o
  CC      drivers/gpu/drm/i915/display/intel_display_debugfs.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_vdsc.o
  CC      drivers/gpu/drm/i915/display/intel_display_debugfs_params.o
  CC      drivers/gpu/drm/i915/display/intel_pipe_crc.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_vga.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_vrr.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_dmc_wl.o
  CC      drivers/gpu/drm/i915/display/dvo_ch7017.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_wm.o
  CC      drivers/gpu/drm/i915/display/dvo_ch7xxx.o
  CC      drivers/gpu/drm/i915/display/dvo_ivch.o
  CC [M]  drivers/gpu/drm/xe/i915-display/skl_scaler.o
  CC [M]  drivers/gpu/drm/xe/i915-display/skl_universal_plane.o
  CC [M]  drivers/gpu/drm/xe/i915-display/skl_watermark.o
  CC      drivers/gpu/drm/i915/display/dvo_ns2501.o
  CC      drivers/gpu/drm/i915/display/dvo_sil164.o
  CC      drivers/gpu/drm/i915/display/dvo_tfp410.o
  CC      drivers/gpu/drm/i915/display/g4x_dp.o
  CC      drivers/gpu/drm/i915/display/g4x_hdmi.o
  CC      drivers/gpu/drm/i915/display/icl_dsi.o
  CC      drivers/gpu/drm/i915/display/intel_backlight.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_acpi.o
  CC      drivers/gpu/drm/i915/display/intel_crt.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_opregion.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_display_debugfs.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_display_debugfs_params.o
  CC [M]  drivers/gpu/drm/xe/i915-display/intel_pipe_crc.o
  CC [M]  drivers/gpu/drm/xe/xe_gsc.o
  CC [M]  drivers/gpu/drm/xe/xe_guc.o
  CC      drivers/gpu/drm/i915/display/intel_cx0_phy.o
  CC      drivers/gpu/drm/i915/display/intel_ddi.o
  CC [M]  drivers/gpu/drm/xe/xe_guc_ads.o
  CC      drivers/gpu/drm/i915/display/intel_ddi_buf_trans.o
  CC      drivers/gpu/drm/i915/display/intel_display_device.o
  CC      drivers/gpu/drm/i915/display/intel_display_trace.o
  CC      drivers/gpu/drm/i915/display/intel_dkl_phy.o
  CC      drivers/gpu/drm/i915/display/intel_dp.o
  CC      drivers/gpu/drm/i915/display/intel_dp_aux.o
  CC      drivers/gpu/drm/i915/display/intel_dp_aux_backlight.o
  CC      drivers/gpu/drm/i915/display/intel_dp_hdcp.o
  CC      drivers/gpu/drm/i915/display/intel_dp_link_training.o
  CC      drivers/gpu/drm/i915/display/intel_dp_mst.o
  CC      drivers/gpu/drm/i915/display/intel_dsi.o
  CC      drivers/gpu/drm/i915/display/intel_dsi_dcs_backlight.o
  CC      drivers/gpu/drm/i915/display/intel_dsi_vbt.o
  CC      drivers/gpu/drm/i915/display/intel_dvo.o
  CC      drivers/gpu/drm/i915/display/intel_gmbus.o
  CC      drivers/gpu/drm/i915/display/intel_hdmi.o
  CC      drivers/gpu/drm/i915/display/intel_lspcon.o
  CC      drivers/gpu/drm/i915/display/intel_lvds.o
  CC      drivers/gpu/drm/i915/display/intel_panel.o
  CC      drivers/gpu/drm/i915/display/intel_pps.o
  CC      drivers/gpu/drm/i915/display/intel_qp_tables.o
  CC      drivers/gpu/drm/i915/display/intel_sdvo.o
  CC      drivers/gpu/drm/i915/display/intel_snps_phy.o
  CC      drivers/gpu/drm/i915/display/intel_tv.o
  CC      drivers/gpu/drm/i915/display/intel_vdsc.o
  CC      drivers/gpu/drm/i915/display/intel_vrr.o
  CC      drivers/gpu/drm/i915/display/vlv_dsi.o
  CC      drivers/gpu/drm/i915/display/vlv_dsi_pll.o
  CC      drivers/gpu/drm/i915/i915_perf.o
  CC      drivers/gpu/drm/i915/pxp/intel_pxp.o
  CC      drivers/gpu/drm/i915/pxp/intel_pxp_huc.o
  CC      drivers/gpu/drm/i915/pxp/intel_pxp_tee.o
  CC      drivers/gpu/drm/i915/i915_gpu_error.o
  CC      drivers/gpu/drm/i915/i915_vgpu.o
  LD [M]  drivers/gpu/drm/xe/xe.o
  AR      drivers/gpu/drm/i915/built-in.a
  AR      drivers/gpu/drm/built-in.a
  AR      drivers/gpu/built-in.a
  AR      drivers/built-in.a
  AR      built-in.a
  AR      vmlinux.a
  LD      vmlinux.o
  OBJCOPY modules.builtin.modinfo
  GEN     modules.builtin
  MODPOST Module.symvers
ERROR: modpost: "__udivdi3" [drivers/gpu/drm/xe/xe.ko] undefined!
make[2]: *** [/workspace/kernel/scripts/Makefile.modpost:145: Module.symvers] Error 1
make[1]: *** [/workspace/kernel/Makefile:1886: modpost] Error 2
make: *** [/workspace/kernel/Makefile:240: __sub-make] Error 2
run-parts: /workspace/ci/hooks/11-build-32b exited with return code 2

✓ CI.checksparse: success for Only timeout jobs if they run longer than timeout period

[Patchwork]

== Series Details ==

Series: Only timeout jobs if they run longer than timeout period
URL   : https://patchwork.freedesktop.org/series/134724/
State : success

== Summary ==

+ trap cleanup EXIT
+ KERNEL=/kernel
+ MT=/root/linux/maintainer-tools
+ git clone https://gitlab.freedesktop.org/drm/maintainer-tools /root/linux/maintainer-tools
Cloning into '/root/linux/maintainer-tools'...
warning: redirecting to https://gitlab.freedesktop.org/drm/maintainer-tools.git/
+ make -C /root/linux/maintainer-tools
make: Entering directory '/root/linux/maintainer-tools'
cc -O2 -g -Wextra -o remap-log remap-log.c
make: Leaving directory '/root/linux/maintainer-tools'
+ cd /kernel
+ git config --global --add safe.directory /kernel
+ /root/linux/maintainer-tools/dim sparse --fast 950ce28fe0b31a24c5bddcc337aba9554a41cbb3
Sparse version: 0.6.1 (Ubuntu: 0.6.1-2build1)
Fast mode used, each commit won't be checked separately.
Okay!

+ cleanup
++ stat -c %u:%g /kernel
+ chown -R 1003:1003 /kernel

✓ CI.BAT: success for Only timeout jobs if they run longer than timeout period

[Patchwork]

[-- Attachment #1: Type: text/plain, Size: 1767 bytes --]

== Series Details ==

Series: Only timeout jobs if they run longer than timeout period
URL   : https://patchwork.freedesktop.org/series/134724/
State : success

== Summary ==

CI Bug Log - changes from xe-1443-46852067df1514110bfc9c514d2610447376f1b7_BAT -> xe-pw-134724v1_BAT
====================================================

Summary
-------

  **SUCCESS**

  No regressions found.

  

Participating hosts (3 -> 3)
------------------------------

  No changes in participating hosts

Known issues
------------

  Here are the changes found in xe-pw-134724v1_BAT that come from known issues:

### IGT changes ###

#### Possible fixes ####

  * igt@core_hotunplug@unbind-rebind:
    - {bat-lnl-1}:        [DMESG-WARN][1] ([Intel XE#2016]) -> [PASS][2] +1 other test pass
   [1]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/bat-lnl-1/igt@core_hotunplug@unbind-rebind.html
   [2]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/bat-lnl-1/igt@core_hotunplug@unbind-rebind.html

  
  {name}: This element is suppressed. This means it is ignored when computing
          the status of the difference (SUCCESS, WARNING, or FAILURE).

  [Intel XE#1069]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1069
  [Intel XE#1330]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1330
  [Intel XE#2016]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/2016


Build changes
-------------

  * Linux: xe-1443-46852067df1514110bfc9c514d2610447376f1b7 -> xe-pw-134724v1

  IGT_7881: 7881
  xe-1443-46852067df1514110bfc9c514d2610447376f1b7: 46852067df1514110bfc9c514d2610447376f1b7
  xe-pw-134724v1: 134724v1

== Logs ==

For more details see: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/index.html

[-- Attachment #2: Type: text/html, Size: 2190 bytes --]

✓ CI.FULL: success for Only timeout jobs if they run longer than timeout period

[Patchwork]

[-- Attachment #1: Type: text/plain, Size: 49525 bytes --]

== Series Details ==

Series: Only timeout jobs if they run longer than timeout period
URL   : https://patchwork.freedesktop.org/series/134724/
State : success

== Summary ==

CI Bug Log - changes from xe-1443-46852067df1514110bfc9c514d2610447376f1b7_full -> xe-pw-134724v1_full
====================================================

Summary
-------

  **SUCCESS**

  No regressions found.

  

Participating hosts (3 -> 3)
------------------------------

  No changes in participating hosts

Possible new issues
-------------------

  Here are the unknown changes that may have been introduced in xe-pw-134724v1_full:

### IGT changes ###

#### Suppressed ####

  The following results come from untrusted machines, tests, or statuses.
  They do not affect the overall result.

  * igt@kms_rotation_crc@primary-4-tiled-reflect-x-0:
    - {shard-lnl}:        NOTRUN -> [INCOMPLETE][1]
   [1]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-lnl-2/igt@kms_rotation_crc@primary-4-tiled-reflect-x-0.html

  * igt@xe_evict@evict-mixed-threads-large-multi-vm:
    - {shard-lnl}:        [SKIP][2] ([Intel XE#688]) -> [INCOMPLETE][3]
   [2]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-lnl-6/igt@xe_evict@evict-mixed-threads-large-multi-vm.html
   [3]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-lnl-3/igt@xe_evict@evict-mixed-threads-large-multi-vm.html

  * igt@xe_exec_fault_mode@many-userptr-invalidate-race:
    - {shard-lnl}:        [PASS][4] -> [ABORT][5]
   [4]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-lnl-4/igt@xe_exec_fault_mode@many-userptr-invalidate-race.html
   [5]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-lnl-5/igt@xe_exec_fault_mode@many-userptr-invalidate-race.html

  
New tests
---------

  New tests have been introduced between xe-1443-46852067df1514110bfc9c514d2610447376f1b7_full and xe-pw-134724v1_full:

### New IGT tests (1) ###

  * igt@kms_async_flips:
    - Statuses :
    - Exec time: [None] s

  

Known issues
------------

  Here are the changes found in xe-pw-134724v1_full that come from known issues:

### IGT changes ###

#### Issues hit ####

  * igt@kms_big_fb@linear-64bpp-rotate-270:
    - shard-adlp:         NOTRUN -> [SKIP][6] ([Intel XE#1201] / [Intel XE#316]) +2 other tests skip
   [6]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-4/igt@kms_big_fb@linear-64bpp-rotate-270.html

  * igt@kms_big_fb@linear-8bpp-rotate-270:
    - shard-dg2-set2:     NOTRUN -> [SKIP][7] ([Intel XE#1201] / [Intel XE#316])
   [7]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-435/igt@kms_big_fb@linear-8bpp-rotate-270.html

  * igt@kms_big_fb@x-tiled-max-hw-stride-64bpp-rotate-0-hflip-async-flip:
    - shard-adlp:         NOTRUN -> [FAIL][8] ([Intel XE#1231]) +1 other test fail
   [8]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-4/igt@kms_big_fb@x-tiled-max-hw-stride-64bpp-rotate-0-hflip-async-flip.html

  * igt@kms_big_fb@y-tiled-8bpp-rotate-0:
    - shard-adlp:         NOTRUN -> [FAIL][9] ([Intel XE#1874]) +10 other tests fail
   [9]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-1/igt@kms_big_fb@y-tiled-8bpp-rotate-0.html

  * igt@kms_big_fb@y-tiled-addfb:
    - shard-dg2-set2:     NOTRUN -> [SKIP][10] ([Intel XE#1201] / [Intel XE#619])
   [10]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-435/igt@kms_big_fb@y-tiled-addfb.html

  * igt@kms_big_fb@yf-tiled-32bpp-rotate-180:
    - shard-dg2-set2:     NOTRUN -> [SKIP][11] ([Intel XE#1124] / [Intel XE#1201])
   [11]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-435/igt@kms_big_fb@yf-tiled-32bpp-rotate-180.html

  * igt@kms_big_fb@yf-tiled-8bpp-rotate-90:
    - shard-adlp:         NOTRUN -> [SKIP][12] ([Intel XE#1124] / [Intel XE#1201]) +18 other tests skip
   [12]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-8/igt@kms_big_fb@yf-tiled-8bpp-rotate-90.html

  * igt@kms_big_fb@yf-tiled-addfb:
    - shard-adlp:         NOTRUN -> [SKIP][13] ([Intel XE#1201] / [Intel XE#619])
   [13]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-6/igt@kms_big_fb@yf-tiled-addfb.html

  * igt@kms_big_fb@yf-tiled-addfb-size-overflow:
    - shard-adlp:         NOTRUN -> [SKIP][14] ([Intel XE#1201] / [Intel XE#610])
   [14]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-1/igt@kms_big_fb@yf-tiled-addfb-size-overflow.html

  * igt@kms_bw@linear-tiling-1-displays-2160x1440p:
    - shard-adlp:         NOTRUN -> [SKIP][15] ([Intel XE#1201] / [Intel XE#367]) +1 other test skip
   [15]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-9/igt@kms_bw@linear-tiling-1-displays-2160x1440p.html
    - shard-dg2-set2:     NOTRUN -> [SKIP][16] ([Intel XE#1201] / [Intel XE#367])
   [16]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-435/igt@kms_bw@linear-tiling-1-displays-2160x1440p.html

  * igt@kms_ccs@bad-aux-stride-4-tiled-mtl-mc-ccs@pipe-d-hdmi-a-1:
    - shard-adlp:         NOTRUN -> [SKIP][17] ([Intel XE#1201] / [Intel XE#455] / [Intel XE#787]) +41 other tests skip
   [17]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-6/igt@kms_ccs@bad-aux-stride-4-tiled-mtl-mc-ccs@pipe-d-hdmi-a-1.html

  * igt@kms_ccs@bad-pixel-format-4-tiled-dg2-rc-ccs-cc@pipe-a-hdmi-a-1:
    - shard-adlp:         NOTRUN -> [SKIP][18] ([Intel XE#1201] / [Intel XE#787]) +62 other tests skip
   [18]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-1/igt@kms_ccs@bad-pixel-format-4-tiled-dg2-rc-ccs-cc@pipe-a-hdmi-a-1.html

  * igt@kms_ccs@crc-primary-basic-4-tiled-mtl-rc-ccs:
    - shard-dg2-set2:     NOTRUN -> [SKIP][19] ([Intel XE#1201] / [Intel XE#455] / [Intel XE#787]) +5 other tests skip
   [19]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-435/igt@kms_ccs@crc-primary-basic-4-tiled-mtl-rc-ccs.html

  * igt@kms_ccs@crc-primary-basic-4-tiled-mtl-rc-ccs@pipe-b-hdmi-a-6:
    - shard-dg2-set2:     NOTRUN -> [SKIP][20] ([Intel XE#1201] / [Intel XE#787]) +20 other tests skip
   [20]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-435/igt@kms_ccs@crc-primary-basic-4-tiled-mtl-rc-ccs@pipe-b-hdmi-a-6.html

  * igt@kms_ccs@crc-primary-rotation-180-4-tiled-xe2-ccs:
    - shard-adlp:         NOTRUN -> [SKIP][21] ([Intel XE#1201] / [Intel XE#1252]) +2 other tests skip
   [21]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-9/igt@kms_ccs@crc-primary-rotation-180-4-tiled-xe2-ccs.html

  * igt@kms_cdclk@plane-scaling:
    - shard-adlp:         NOTRUN -> [SKIP][22] ([Intel XE#1152] / [Intel XE#1201] / [Intel XE#455])
   [22]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-8/igt@kms_cdclk@plane-scaling.html

  * igt@kms_cdclk@plane-scaling@pipe-b-hdmi-a-1:
    - shard-adlp:         NOTRUN -> [SKIP][23] ([Intel XE#1152] / [Intel XE#1201]) +2 other tests skip
   [23]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-8/igt@kms_cdclk@plane-scaling@pipe-b-hdmi-a-1.html

  * igt@kms_chamelium_color@gamma:
    - shard-adlp:         NOTRUN -> [SKIP][24] ([Intel XE#1201] / [Intel XE#306]) +1 other test skip
   [24]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-1/igt@kms_chamelium_color@gamma.html

  * igt@kms_chamelium_edid@dp-edid-resolution-list:
    - shard-adlp:         NOTRUN -> [SKIP][25] ([Intel XE#1201] / [Intel XE#373]) +12 other tests skip
   [25]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-6/igt@kms_chamelium_edid@dp-edid-resolution-list.html

  * igt@kms_chamelium_hpd@dp-hpd-storm-disable:
    - shard-dg2-set2:     NOTRUN -> [SKIP][26] ([Intel XE#1201] / [Intel XE#373])
   [26]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-435/igt@kms_chamelium_hpd@dp-hpd-storm-disable.html

  * igt@kms_content_protection@dp-mst-type-1:
    - shard-adlp:         NOTRUN -> [SKIP][27] ([Intel XE#1201] / [Intel XE#307])
   [27]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-9/igt@kms_content_protection@dp-mst-type-1.html

  * igt@kms_cursor_crc@cursor-onscreen-512x512:
    - shard-adlp:         NOTRUN -> [SKIP][28] ([Intel XE#1201] / [Intel XE#308]) +3 other tests skip
   [28]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-8/igt@kms_cursor_crc@cursor-onscreen-512x512.html

  * igt@kms_cursor_crc@cursor-rapid-movement-256x256@pipe-d-hdmi-a-6:
    - shard-dg2-set2:     [PASS][29] -> [DMESG-WARN][30] ([Intel XE#1214] / [Intel XE#282]) +6 other tests dmesg-warn
   [29]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-dg2-463/igt@kms_cursor_crc@cursor-rapid-movement-256x256@pipe-d-hdmi-a-6.html
   [30]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-466/igt@kms_cursor_crc@cursor-rapid-movement-256x256@pipe-d-hdmi-a-6.html

  * igt@kms_cursor_crc@cursor-suspend@pipe-a-hdmi-a-1:
    - shard-adlp:         NOTRUN -> [DMESG-FAIL][31] ([Intel XE#1608]) +2 other tests dmesg-fail
   [31]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-9/igt@kms_cursor_crc@cursor-suspend@pipe-a-hdmi-a-1.html

  * igt@kms_cursor_legacy@flip-vs-cursor-varying-size:
    - shard-dg2-set2:     NOTRUN -> [DMESG-WARN][32] ([Intel XE#1214] / [Intel XE#282])
   [32]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-435/igt@kms_cursor_legacy@flip-vs-cursor-varying-size.html

  * igt@kms_cursor_legacy@short-busy-flip-before-cursor-atomic-transitions:
    - shard-dg2-set2:     NOTRUN -> [SKIP][33] ([Intel XE#1201] / [Intel XE#323])
   [33]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-435/igt@kms_cursor_legacy@short-busy-flip-before-cursor-atomic-transitions.html
    - shard-adlp:         NOTRUN -> [SKIP][34] ([Intel XE#1201] / [Intel XE#323])
   [34]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-9/igt@kms_cursor_legacy@short-busy-flip-before-cursor-atomic-transitions.html

  * igt@kms_cursor_legacy@torture-bo:
    - shard-dg2-set2:     [PASS][35] -> [DMESG-WARN][36] ([Intel XE#1214] / [Intel XE#282] / [Intel XE#877])
   [35]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-dg2-466/igt@kms_cursor_legacy@torture-bo.html
   [36]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-435/igt@kms_cursor_legacy@torture-bo.html

  * igt@kms_cursor_legacy@torture-bo@pipe-a:
    - shard-dg2-set2:     [PASS][37] -> [DMESG-WARN][38] ([Intel XE#1214] / [Intel XE#877])
   [37]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-dg2-466/igt@kms_cursor_legacy@torture-bo@pipe-a.html
   [38]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-435/igt@kms_cursor_legacy@torture-bo@pipe-a.html

  * igt@kms_fbcon_fbt@psr:
    - shard-adlp:         NOTRUN -> [SKIP][39] ([Intel XE#1201] / [Intel XE#776]) +1 other test skip
   [39]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-1/igt@kms_fbcon_fbt@psr.html

  * igt@kms_feature_discovery@display-4x:
    - shard-adlp:         NOTRUN -> [SKIP][40] ([Intel XE#1138] / [Intel XE#1201])
   [40]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-1/igt@kms_feature_discovery@display-4x.html

  * igt@kms_flip@2x-flip-vs-wf_vblank-interruptible:
    - shard-adlp:         NOTRUN -> [SKIP][41] ([Intel XE#1201] / [Intel XE#310]) +5 other tests skip
   [41]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-1/igt@kms_flip@2x-flip-vs-wf_vblank-interruptible.html

  * igt@kms_flip@wf_vblank-ts-check-interruptible:
    - shard-dg2-set2:     [PASS][42] -> [INCOMPLETE][43] ([Intel XE#1195] / [Intel XE#2049])
   [42]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-dg2-464/igt@kms_flip@wf_vblank-ts-check-interruptible.html
   [43]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-463/igt@kms_flip@wf_vblank-ts-check-interruptible.html

  * igt@kms_flip@wf_vblank-ts-check-interruptible@c-hdmi-a6:
    - shard-dg2-set2:     [PASS][44] -> [INCOMPLETE][45] ([Intel XE#1195]) +1 other test incomplete
   [44]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-dg2-464/igt@kms_flip@wf_vblank-ts-check-interruptible@c-hdmi-a6.html
   [45]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-463/igt@kms_flip@wf_vblank-ts-check-interruptible@c-hdmi-a6.html

  * igt@kms_flip_scaled_crc@flip-32bpp-4tile-to-64bpp-4tile-downscaling@pipe-a-valid-mode:
    - shard-adlp:         NOTRUN -> [SKIP][46] ([Intel XE#1201] / [Intel XE#455]) +30 other tests skip
   [46]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-8/igt@kms_flip_scaled_crc@flip-32bpp-4tile-to-64bpp-4tile-downscaling@pipe-a-valid-mode.html

  * igt@kms_flip_scaled_crc@flip-64bpp-ytile-to-32bpp-ytilegen12rcccs-upscaling:
    - shard-dg2-set2:     NOTRUN -> [SKIP][47] ([Intel XE#1201] / [Intel XE#455]) +4 other tests skip
   [47]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-435/igt@kms_flip_scaled_crc@flip-64bpp-ytile-to-32bpp-ytilegen12rcccs-upscaling.html

  * igt@kms_flip_tiling@flip-change-tiling@pipe-c-hdmi-a-1-y-to-x:
    - shard-adlp:         [PASS][48] -> [FAIL][49] ([Intel XE#1874]) +1 other test fail
   [48]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-adlp-4/igt@kms_flip_tiling@flip-change-tiling@pipe-c-hdmi-a-1-y-to-x.html
   [49]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-6/igt@kms_flip_tiling@flip-change-tiling@pipe-c-hdmi-a-1-y-to-x.html

  * igt@kms_frontbuffer_tracking@fbc-1p-offscren-pri-shrfb-draw-mmap-wc:
    - shard-adlp:         NOTRUN -> [FAIL][50] ([Intel XE#1861]) +1 other test fail
   [50]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-6/igt@kms_frontbuffer_tracking@fbc-1p-offscren-pri-shrfb-draw-mmap-wc.html

  * igt@kms_frontbuffer_tracking@fbcdrrs-1p-primscrn-cur-indfb-draw-mmap-wc:
    - shard-adlp:         NOTRUN -> [SKIP][51] ([Intel XE#1201] / [Intel XE#651]) +19 other tests skip
   [51]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-9/igt@kms_frontbuffer_tracking@fbcdrrs-1p-primscrn-cur-indfb-draw-mmap-wc.html

  * igt@kms_frontbuffer_tracking@fbcdrrs-2p-scndscrn-pri-indfb-draw-mmap-wc:
    - shard-dg2-set2:     NOTRUN -> [SKIP][52] ([Intel XE#1201] / [Intel XE#651]) +1 other test skip
   [52]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-435/igt@kms_frontbuffer_tracking@fbcdrrs-2p-scndscrn-pri-indfb-draw-mmap-wc.html

  * igt@kms_frontbuffer_tracking@fbcpsr-2p-scndscrn-spr-indfb-onoff:
    - shard-dg2-set2:     NOTRUN -> [SKIP][53] ([Intel XE#1201] / [Intel XE#653]) +4 other tests skip
   [53]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-435/igt@kms_frontbuffer_tracking@fbcpsr-2p-scndscrn-spr-indfb-onoff.html

  * igt@kms_frontbuffer_tracking@fbcpsr-tiling-4:
    - shard-adlp:         NOTRUN -> [SKIP][54] ([Intel XE#1151] / [Intel XE#1201]) +1 other test skip
   [54]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-6/igt@kms_frontbuffer_tracking@fbcpsr-tiling-4.html

  * igt@kms_frontbuffer_tracking@psr-1p-primscrn-indfb-pgflip-blt:
    - shard-adlp:         NOTRUN -> [SKIP][55] ([Intel XE#1201] / [Intel XE#653]) +20 other tests skip
   [55]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-9/igt@kms_frontbuffer_tracking@psr-1p-primscrn-indfb-pgflip-blt.html

  * igt@kms_frontbuffer_tracking@psr-2p-scndscrn-cur-indfb-draw-render:
    - shard-adlp:         NOTRUN -> [SKIP][56] ([Intel XE#1201] / [Intel XE#656]) +57 other tests skip
   [56]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-8/igt@kms_frontbuffer_tracking@psr-2p-scndscrn-cur-indfb-draw-render.html

  * igt@kms_getfb@getfb-reject-ccs:
    - shard-adlp:         NOTRUN -> [SKIP][57] ([Intel XE#1201] / [Intel XE#1341])
   [57]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-4/igt@kms_getfb@getfb-reject-ccs.html

  * igt@kms_hdr@static-toggle-suspend@pipe-a-hdmi-a-6:
    - shard-dg2-set2:     NOTRUN -> [FAIL][58] ([Intel XE#616])
   [58]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-466/igt@kms_hdr@static-toggle-suspend@pipe-a-hdmi-a-6.html

  * igt@kms_pipe_crc_basic@suspend-read-crc@pipe-d-hdmi-a-6:
    - shard-dg2-set2:     [PASS][59] -> [DMESG-WARN][60] ([Intel XE#1214])
   [59]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-dg2-466/igt@kms_pipe_crc_basic@suspend-read-crc@pipe-d-hdmi-a-6.html
   [60]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-434/igt@kms_pipe_crc_basic@suspend-read-crc@pipe-d-hdmi-a-6.html

  * igt@kms_plane@pixel-format:
    - shard-adlp:         NOTRUN -> [INCOMPLETE][61] ([Intel XE#1035] / [Intel XE#1195])
   [61]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-6/igt@kms_plane@pixel-format.html

  * igt@kms_plane@plane-panning-bottom-right-suspend:
    - shard-adlp:         NOTRUN -> [DMESG-FAIL][62] ([Intel XE#1608] / [Intel XE#2034]) +2 other tests dmesg-fail
   [62]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-1/igt@kms_plane@plane-panning-bottom-right-suspend.html

  * igt@kms_plane@plane-panning-bottom-right-suspend@pipe-b:
    - shard-adlp:         NOTRUN -> [FAIL][63] ([Intel XE#2028]) +1 other test fail
   [63]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-1/igt@kms_plane@plane-panning-bottom-right-suspend@pipe-b.html

  * igt@kms_plane_scaling@2x-scaler-multi-pipe:
    - shard-adlp:         NOTRUN -> [SKIP][64] ([Intel XE#1201] / [Intel XE#309]) +7 other tests skip
   [64]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-9/igt@kms_plane_scaling@2x-scaler-multi-pipe.html

  * igt@kms_plane_scaling@intel-max-src-size@pipe-a-dp-4:
    - shard-dg2-set2:     NOTRUN -> [FAIL][65] ([Intel XE#361]) +2 other tests fail
   [65]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-435/igt@kms_plane_scaling@intel-max-src-size@pipe-a-dp-4.html

  * igt@kms_plane_scaling@intel-max-src-size@pipe-a-hdmi-a-1:
    - shard-adlp:         NOTRUN -> [FAIL][66] ([Intel XE#361]) +1 other test fail
   [66]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-9/igt@kms_plane_scaling@intel-max-src-size@pipe-a-hdmi-a-1.html

  * igt@kms_plane_scaling@plane-downscale-factor-0-25-with-modifiers@pipe-b-hdmi-a-1:
    - shard-adlp:         NOTRUN -> [SKIP][67] ([Intel XE#1201] / [Intel XE#498]) +2 other tests skip
   [67]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-9/igt@kms_plane_scaling@plane-downscale-factor-0-25-with-modifiers@pipe-b-hdmi-a-1.html

  * igt@kms_plane_scaling@plane-downscale-factor-0-25-with-modifiers@pipe-d-hdmi-a-1:
    - shard-adlp:         NOTRUN -> [SKIP][68] ([Intel XE#1201] / [Intel XE#455] / [Intel XE#498]) +1 other test skip
   [68]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-9/igt@kms_plane_scaling@plane-downscale-factor-0-25-with-modifiers@pipe-d-hdmi-a-1.html

  * igt@kms_pm_backlight@bad-brightness:
    - shard-adlp:         NOTRUN -> [SKIP][69] ([Intel XE#1201] / [Intel XE#870])
   [69]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-8/igt@kms_pm_backlight@bad-brightness.html

  * igt@kms_pm_dc@deep-pkgc:
    - shard-adlp:         NOTRUN -> [SKIP][70] ([Intel XE#1201] / [Intel XE#2007])
   [70]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-8/igt@kms_pm_dc@deep-pkgc.html

  * igt@kms_pm_rpm@dpms-mode-unset-non-lpsp:
    - shard-adlp:         NOTRUN -> [SKIP][71] ([Intel XE#1201] / [Intel XE#836])
   [71]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-6/igt@kms_pm_rpm@dpms-mode-unset-non-lpsp.html

  * igt@kms_pm_rpm@i2c:
    - shard-adlp:         NOTRUN -> [SKIP][72] ([Intel XE#1201] / [Intel XE#1211]) +4 other tests skip
   [72]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-8/igt@kms_pm_rpm@i2c.html

  * igt@kms_psr2_sf@overlay-plane-move-continuous-sf:
    - shard-adlp:         NOTRUN -> [SKIP][73] ([Intel XE#1201]) +5 other tests skip
   [73]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-8/igt@kms_psr2_sf@overlay-plane-move-continuous-sf.html

  * igt@kms_psr2_su@page_flip-xrgb8888:
    - shard-adlp:         NOTRUN -> [SKIP][74] ([Intel XE#1122] / [Intel XE#1201]) +1 other test skip
   [74]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-9/igt@kms_psr2_su@page_flip-xrgb8888.html

  * igt@kms_psr@fbc-psr-cursor-plane-move:
    - shard-dg2-set2:     NOTRUN -> [SKIP][75] ([Intel XE#1201] / [Intel XE#929]) +1 other test skip
   [75]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-435/igt@kms_psr@fbc-psr-cursor-plane-move.html

  * igt@kms_psr@fbc-psr-suspend:
    - shard-adlp:         NOTRUN -> [SKIP][76] ([Intel XE#1201] / [Intel XE#929]) +19 other tests skip
   [76]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-1/igt@kms_psr@fbc-psr-suspend.html

  * igt@kms_rotation_crc@primary-rotation-90:
    - shard-adlp:         NOTRUN -> [SKIP][77] ([Intel XE#1201] / [Intel XE#327])
   [77]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-1/igt@kms_rotation_crc@primary-rotation-90.html

  * igt@kms_rotation_crc@primary-yf-tiled-reflect-x-0:
    - shard-adlp:         NOTRUN -> [SKIP][78] ([Intel XE#1127] / [Intel XE#1201]) +1 other test skip
   [78]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-1/igt@kms_rotation_crc@primary-yf-tiled-reflect-x-0.html

  * igt@kms_sysfs_edid_timing:
    - shard-adlp:         NOTRUN -> [FAIL][79] ([Intel XE#1174])
   [79]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-1/igt@kms_sysfs_edid_timing.html

  * igt@kms_tiled_display@basic-test-pattern:
    - shard-adlp:         NOTRUN -> [SKIP][80] ([Intel XE#1201] / [Intel XE#362])
   [80]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-9/igt@kms_tiled_display@basic-test-pattern.html

  * igt@kms_universal_plane@cursor-fb-leak:
    - shard-adlp:         [PASS][81] -> [FAIL][82] ([Intel XE#771] / [Intel XE#899])
   [81]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-adlp-1/igt@kms_universal_plane@cursor-fb-leak.html
   [82]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-8/igt@kms_universal_plane@cursor-fb-leak.html
    - shard-dg2-set2:     [PASS][83] -> [FAIL][84] ([Intel XE#771] / [Intel XE#899])
   [83]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-dg2-466/igt@kms_universal_plane@cursor-fb-leak.html
   [84]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-433/igt@kms_universal_plane@cursor-fb-leak.html

  * igt@kms_universal_plane@cursor-fb-leak@pipe-b-dp-4:
    - shard-dg2-set2:     [PASS][85] -> [FAIL][86] ([Intel XE#899])
   [85]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-dg2-466/igt@kms_universal_plane@cursor-fb-leak@pipe-b-dp-4.html
   [86]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-433/igt@kms_universal_plane@cursor-fb-leak@pipe-b-dp-4.html

  * igt@kms_universal_plane@cursor-fb-leak@pipe-b-hdmi-a-1:
    - shard-adlp:         [PASS][87] -> [FAIL][88] ([Intel XE#899])
   [87]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-adlp-1/igt@kms_universal_plane@cursor-fb-leak@pipe-b-hdmi-a-1.html
   [88]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-8/igt@kms_universal_plane@cursor-fb-leak@pipe-b-hdmi-a-1.html

  * igt@kms_writeback@writeback-check-output-xrgb2101010:
    - shard-adlp:         NOTRUN -> [SKIP][89] ([Intel XE#1201] / [Intel XE#756])
   [89]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-4/igt@kms_writeback@writeback-check-output-xrgb2101010.html

  * igt@sriov_basic@bind-unbind-vf:
    - shard-adlp:         NOTRUN -> [SKIP][90] ([Intel XE#1201] / [Intel XE#1932])
   [90]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-8/igt@sriov_basic@bind-unbind-vf.html

  * igt@xe_ccs@block-copy-compressed-inc-dimension:
    - shard-adlp:         NOTRUN -> [SKIP][91] ([Intel XE#1201] / [Intel XE#455] / [Intel XE#488]) +3 other tests skip
   [91]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-8/igt@xe_ccs@block-copy-compressed-inc-dimension.html

  * igt@xe_compute@ccs-mode-basic:
    - shard-adlp:         NOTRUN -> [SKIP][92] ([Intel XE#1201] / [Intel XE#1447])
   [92]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-4/igt@xe_compute@ccs-mode-basic.html

  * igt@xe_copy_basic@mem-set-linear-0xfd:
    - shard-dg2-set2:     NOTRUN -> [SKIP][93] ([Intel XE#1126] / [Intel XE#1201])
   [93]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-435/igt@xe_copy_basic@mem-set-linear-0xfd.html
    - shard-adlp:         NOTRUN -> [SKIP][94] ([Intel XE#1126] / [Intel XE#1201])
   [94]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-9/igt@xe_copy_basic@mem-set-linear-0xfd.html

  * igt@xe_evict@evict-mixed-many-threads-small:
    - shard-adlp:         NOTRUN -> [SKIP][95] ([Intel XE#1201] / [Intel XE#261]) +8 other tests skip
   [95]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-4/igt@xe_evict@evict-mixed-many-threads-small.html

  * igt@xe_evict@evict-small-external-cm:
    - shard-adlp:         NOTRUN -> [SKIP][96] ([Intel XE#1201] / [Intel XE#261] / [Intel XE#688]) +1 other test skip
   [96]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-8/igt@xe_evict@evict-small-external-cm.html

  * igt@xe_evict@evict-threads-large:
    - shard-dg2-set2:     [PASS][97] -> [TIMEOUT][98] ([Intel XE#1473] / [Intel XE#392]) +2 other tests timeout
   [97]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-dg2-433/igt@xe_evict@evict-threads-large.html
   [98]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-463/igt@xe_evict@evict-threads-large.html

  * igt@xe_exec_basic@multigpu-no-exec-null:
    - shard-adlp:         NOTRUN -> [SKIP][99] ([Intel XE#1201] / [Intel XE#1392]) +8 other tests skip
   [99]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-1/igt@xe_exec_basic@multigpu-no-exec-null.html

  * igt@xe_exec_fault_mode@once-bindexecqueue-userptr-invalidate-race-prefetch:
    - shard-adlp:         NOTRUN -> [SKIP][100] ([Intel XE#1201] / [Intel XE#288]) +39 other tests skip
   [100]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-4/igt@xe_exec_fault_mode@once-bindexecqueue-userptr-invalidate-race-prefetch.html

  * igt@xe_exec_fault_mode@once-userptr-invalidate-race-prefetch:
    - shard-dg2-set2:     NOTRUN -> [SKIP][101] ([Intel XE#1201] / [Intel XE#288]) +2 other tests skip
   [101]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-435/igt@xe_exec_fault_mode@once-userptr-invalidate-race-prefetch.html

  * igt@xe_exec_threads@threads-cm-shared-vm-userptr-invalidate:
    - shard-dg2-set2:     [PASS][102] -> [INCOMPLETE][103] ([Intel XE#1169] / [Intel XE#1195] / [Intel XE#1356])
   [102]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-dg2-466/igt@xe_exec_threads@threads-cm-shared-vm-userptr-invalidate.html
   [103]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-435/igt@xe_exec_threads@threads-cm-shared-vm-userptr-invalidate.html

  * igt@xe_gt_freq@freq_suspend:
    - shard-adlp:         NOTRUN -> [DMESG-FAIL][104] ([Intel XE#1608] / [Intel XE#1782] / [Intel XE#2034])
   [104]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-9/igt@xe_gt_freq@freq_suspend.html

  * igt@xe_pat@pat-index-xe2:
    - shard-adlp:         NOTRUN -> [SKIP][105] ([Intel XE#1201] / [Intel XE#977])
   [105]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-8/igt@xe_pat@pat-index-xe2.html

  * igt@xe_pat@pat-index-xelpg:
    - shard-adlp:         NOTRUN -> [SKIP][106] ([Intel XE#1201] / [Intel XE#979])
   [106]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-9/igt@xe_pat@pat-index-xelpg.html

  * igt@xe_pm@d3cold-basic:
    - shard-adlp:         NOTRUN -> [SKIP][107] ([Intel XE#1201] / [Intel XE#366])
   [107]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-1/igt@xe_pm@d3cold-basic.html

  * igt@xe_pm@s3-d3hot-basic-exec:
    - shard-adlp:         NOTRUN -> [FAIL][108] ([Intel XE#1924]) +2 other tests fail
   [108]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-9/igt@xe_pm@s3-d3hot-basic-exec.html

  * igt@xe_pm@s4-exec-after:
    - shard-adlp:         [PASS][109] -> [ABORT][110] ([Intel XE#1358])
   [109]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-adlp-4/igt@xe_pm@s4-exec-after.html
   [110]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-9/igt@xe_pm@s4-exec-after.html

  * igt@xe_query@multigpu-query-invalid-uc-fw-version-mbz:
    - shard-adlp:         NOTRUN -> [SKIP][111] ([Intel XE#1201] / [Intel XE#944]) +3 other tests skip
   [111]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-9/igt@xe_query@multigpu-query-invalid-uc-fw-version-mbz.html

  
#### Possible fixes ####

  * igt@kms_async_flips@async-flip-with-page-flip-events@pipe-d-hdmi-a-1-y:
    - shard-adlp:         [DMESG-WARN][112] ([Intel XE#1033] / [Intel XE#1214]) -> [PASS][113]
   [112]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-adlp-8/igt@kms_async_flips@async-flip-with-page-flip-events@pipe-d-hdmi-a-1-y.html
   [113]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-9/igt@kms_async_flips@async-flip-with-page-flip-events@pipe-d-hdmi-a-1-y.html

  * igt@kms_cursor_legacy@2x-long-flip-vs-cursor-legacy:
    - shard-dg2-set2:     [DMESG-WARN][114] ([Intel XE#1214] / [Intel XE#282]) -> [PASS][115] +8 other tests pass
   [114]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-dg2-463/igt@kms_cursor_legacy@2x-long-flip-vs-cursor-legacy.html
   [115]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-464/igt@kms_cursor_legacy@2x-long-flip-vs-cursor-legacy.html

  * igt@kms_cursor_legacy@flip-vs-cursor-atomic:
    - {shard-lnl}:        [FAIL][116] -> [PASS][117]
   [116]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-lnl-3/igt@kms_cursor_legacy@flip-vs-cursor-atomic.html
   [117]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-lnl-5/igt@kms_cursor_legacy@flip-vs-cursor-atomic.html

  * igt@kms_flip_tiling@flip-change-tiling@pipe-b-hdmi-a-1-y-to-x:
    - shard-adlp:         [FAIL][118] ([Intel XE#1874]) -> [PASS][119] +2 other tests pass
   [118]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-adlp-4/igt@kms_flip_tiling@flip-change-tiling@pipe-b-hdmi-a-1-y-to-x.html
   [119]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-6/igt@kms_flip_tiling@flip-change-tiling@pipe-b-hdmi-a-1-y-to-x.html

  * igt@kms_universal_plane@cursor-fb-leak@pipe-c-edp-1:
    - {shard-lnl}:        [FAIL][120] ([Intel XE#899]) -> [PASS][121] +1 other test pass
   [120]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-lnl-5/igt@kms_universal_plane@cursor-fb-leak@pipe-c-edp-1.html
   [121]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-lnl-3/igt@kms_universal_plane@cursor-fb-leak@pipe-c-edp-1.html

  * igt@xe_evict@evict-beng-large-multi-vm-cm:
    - shard-dg2-set2:     [FAIL][122] ([Intel XE#1600]) -> [PASS][123] +1 other test pass
   [122]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-dg2-466/igt@xe_evict@evict-beng-large-multi-vm-cm.html
   [123]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-433/igt@xe_evict@evict-beng-large-multi-vm-cm.html

  * igt@xe_evict@evict-beng-threads-large:
    - shard-dg2-set2:     [INCOMPLETE][124] ([Intel XE#1195] / [Intel XE#1473]) -> [PASS][125]
   [124]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-dg2-463/igt@xe_evict@evict-beng-threads-large.html
   [125]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-434/igt@xe_evict@evict-beng-threads-large.html

  * igt@xe_evict_ccs@evict-overcommit-simple:
    - shard-dg2-set2:     [INCOMPLETE][126] ([Intel XE#1195]) -> [PASS][127]
   [126]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-dg2-434/igt@xe_evict_ccs@evict-overcommit-simple.html
   [127]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-435/igt@xe_evict_ccs@evict-overcommit-simple.html

  * igt@xe_gt_freq@freq_fixed_idle:
    - {shard-lnl}:        [FAIL][128] ([Intel XE#1414]) -> [PASS][129]
   [128]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-lnl-1/igt@xe_gt_freq@freq_fixed_idle.html
   [129]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-lnl-8/igt@xe_gt_freq@freq_fixed_idle.html

  * igt@xe_intel_bb@blit-simple:
    - {shard-lnl}:        [INCOMPLETE][130] ([Intel XE#1330] / [Intel XE#1622]) -> [PASS][131]
   [130]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-lnl-3/igt@xe_intel_bb@blit-simple.html
   [131]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-lnl-7/igt@xe_intel_bb@blit-simple.html

  * igt@xe_intel_bb@offset-control:
    - shard-dg2-set2:     [DMESG-WARN][132] ([Intel XE#1214]) -> [PASS][133]
   [132]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-dg2-434/igt@xe_intel_bb@offset-control.html
   [133]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-435/igt@xe_intel_bb@offset-control.html

  * igt@xe_module_load@reload:
    - {shard-lnl}:        [DMESG-WARN][134] ([Intel XE#2016]) -> [PASS][135] +9 other tests pass
   [134]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-lnl-8/igt@xe_module_load@reload.html
   [135]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-lnl-4/igt@xe_module_load@reload.html

  * igt@xe_pm@s4-basic:
    - shard-adlp:         [ABORT][136] ([Intel XE#1358]) -> [PASS][137]
   [136]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-adlp-9/igt@xe_pm@s4-basic.html
   [137]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-1/igt@xe_pm@s4-basic.html

  * igt@xe_pm@s4-vm-bind-unbind-all:
    - shard-adlp:         [DMESG-WARN][138] ([Intel XE#1214]) -> [PASS][139] +1 other test pass
   [138]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-adlp-6/igt@xe_pm@s4-vm-bind-unbind-all.html
   [139]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-6/igt@xe_pm@s4-vm-bind-unbind-all.html

  * igt@xe_pm@s4-vm-bind-userptr:
    - shard-adlp:         [ABORT][140] ([Intel XE#1794]) -> [PASS][141]
   [140]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-adlp-9/igt@xe_pm@s4-vm-bind-userptr.html
   [141]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-4/igt@xe_pm@s4-vm-bind-userptr.html

  
#### Warnings ####

  * igt@kms_big_fb@y-tiled-max-hw-stride-64bpp-rotate-0-async-flip:
    - shard-adlp:         [FAIL][142] ([Intel XE#1231]) -> [DMESG-FAIL][143] ([Intel XE#324])
   [142]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-adlp-8/igt@kms_big_fb@y-tiled-max-hw-stride-64bpp-rotate-0-async-flip.html
   [143]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-1/igt@kms_big_fb@y-tiled-max-hw-stride-64bpp-rotate-0-async-flip.html

  * igt@kms_flip@2x-flip-vs-dpms-off-vs-modeset:
    - shard-adlp:         [ABORT][144] -> [SKIP][145] ([Intel XE#1201] / [Intel XE#310])
   [144]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-adlp-8/igt@kms_flip@2x-flip-vs-dpms-off-vs-modeset.html
   [145]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-9/igt@kms_flip@2x-flip-vs-dpms-off-vs-modeset.html

  * igt@kms_flip@flip-vs-suspend@b-hdmi-a1:
    - shard-adlp:         [DMESG-FAIL][146] ([Intel XE#1191]) -> [DMESG-FAIL][147] ([Intel XE#1608]) +1 other test dmesg-fail
   [146]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-adlp-4/igt@kms_flip@flip-vs-suspend@b-hdmi-a1.html
   [147]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-6/igt@kms_flip@flip-vs-suspend@b-hdmi-a1.html

  * igt@kms_pipe_crc_basic@suspend-read-crc:
    - shard-adlp:         [DMESG-FAIL][148] ([Intel XE#1608]) -> [DMESG-FAIL][149] ([Intel XE#1191] / [Intel XE#1608])
   [148]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-adlp-2/igt@kms_pipe_crc_basic@suspend-read-crc.html
   [149]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-4/igt@kms_pipe_crc_basic@suspend-read-crc.html

  * igt@kms_pipe_crc_basic@suspend-read-crc@pipe-c-hdmi-a-1:
    - shard-adlp:         [DMESG-FAIL][150] ([Intel XE#1608]) -> [DMESG-FAIL][151] ([Intel XE#1191])
   [150]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-adlp-2/igt@kms_pipe_crc_basic@suspend-read-crc@pipe-c-hdmi-a-1.html
   [151]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-4/igt@kms_pipe_crc_basic@suspend-read-crc@pipe-c-hdmi-a-1.html

  * igt@kms_tiled_display@basic-test-pattern:
    - shard-dg2-set2:     [SKIP][152] ([Intel XE#1201] / [Intel XE#362]) -> [FAIL][153] ([Intel XE#1729])
   [152]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-dg2-463/igt@kms_tiled_display@basic-test-pattern.html
   [153]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-466/igt@kms_tiled_display@basic-test-pattern.html

  * igt@kms_tiled_display@basic-test-pattern-with-chamelium:
    - shard-dg2-set2:     [SKIP][154] ([Intel XE#1201] / [Intel XE#1500]) -> [SKIP][155] ([Intel XE#1201] / [Intel XE#362])
   [154]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-dg2-433/igt@kms_tiled_display@basic-test-pattern-with-chamelium.html
   [155]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-463/igt@kms_tiled_display@basic-test-pattern-with-chamelium.html

  * igt@xe_evict@evict-beng-cm-threads-large:
    - shard-dg2-set2:     [INCOMPLETE][156] ([Intel XE#1195] / [Intel XE#1473] / [Intel XE#392]) -> [TIMEOUT][157] ([Intel XE#1473] / [Intel XE#392])
   [156]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-dg2-434/igt@xe_evict@evict-beng-cm-threads-large.html
   [157]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-dg2-435/igt@xe_evict@evict-beng-cm-threads-large.html

  * igt@xe_exec_reset@gt-reset-stress:
    - shard-adlp:         [DMESG-WARN][158] ([Intel XE#1214] / [Intel XE#1638] / [Intel XE#2056]) -> [DMESG-WARN][159] ([Intel XE#1214] / [Intel XE#1638])
   [158]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-adlp-8/igt@xe_exec_reset@gt-reset-stress.html
   [159]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-9/igt@xe_exec_reset@gt-reset-stress.html

  * igt@xe_pm@s2idle-basic:
    - shard-adlp:         [INCOMPLETE][160] ([Intel XE#1195] / [Intel XE#1358]) -> [DMESG-FAIL][161] ([Intel XE#1608] / [Intel XE#2034])
   [160]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-adlp-1/igt@xe_pm@s2idle-basic.html
   [161]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-8/igt@xe_pm@s2idle-basic.html

  * igt@xe_pm@s3-basic-exec:
    - shard-adlp:         [INCOMPLETE][162] ([Intel XE#1195] / [Intel XE#1358]) -> [DMESG-FAIL][163] ([Intel XE#1608]) +1 other test dmesg-fail
   [162]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-adlp-1/igt@xe_pm@s3-basic-exec.html
   [163]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-8/igt@xe_pm@s3-basic-exec.html

  * igt@xe_pm@s3-vm-bind-userptr:
    - shard-adlp:         [INCOMPLETE][164] ([Intel XE#1195]) -> [DMESG-FAIL][165] ([Intel XE#1608])
   [164]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-adlp-9/igt@xe_pm@s3-vm-bind-userptr.html
   [165]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-9/igt@xe_pm@s3-vm-bind-userptr.html

  * igt@xe_pm@s4-d3hot-basic-exec:
    - shard-adlp:         [ABORT][166] ([Intel XE#1358]) -> [DMESG-WARN][167] ([Intel XE#1214])
   [166]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-1443-46852067df1514110bfc9c514d2610447376f1b7/shard-adlp-9/igt@xe_pm@s4-d3hot-basic-exec.html
   [167]: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/shard-adlp-6/igt@xe_pm@s4-d3hot-basic-exec.html

  
  {name}: This element is suppressed. This means it is ignored when computing
          the status of the difference (SUCCESS, WARNING, or FAILURE).

  [Intel XE#1033]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1033
  [Intel XE#1035]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1035
  [Intel XE#1122]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1122
  [Intel XE#1124]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1124
  [Intel XE#1126]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1126
  [Intel XE#1127]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1127
  [Intel XE#1138]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1138
  [Intel XE#1151]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1151
  [Intel XE#1152]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1152
  [Intel XE#1169]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1169
  [Intel XE#1174]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1174
  [Intel XE#1191]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1191
  [Intel XE#1195]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1195
  [Intel XE#1201]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1201
  [Intel XE#1211]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1211
  [Intel XE#1214]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1214
  [Intel XE#1231]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1231
  [Intel XE#1252]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1252
  [Intel XE#1330]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1330
  [Intel XE#1341]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1341
  [Intel XE#1356]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1356
  [Intel XE#1358]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1358
  [Intel XE#1392]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1392
  [Intel XE#1406]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1406
  [Intel XE#1414]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1414
  [Intel XE#1421]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1421
  [Intel XE#1424]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1424
  [Intel XE#1437]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1437
  [Intel XE#1446]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1446
  [Intel XE#1447]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1447
  [Intel XE#1473]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1473
  [Intel XE#1500]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1500
  [Intel XE#1600]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1600
  [Intel XE#1608]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1608
  [Intel XE#1622]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1622
  [Intel XE#1638]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1638
  [Intel XE#1659]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1659
  [Intel XE#1729]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1729
  [Intel XE#1782]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1782
  [Intel XE#1794]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1794
  [Intel XE#1861]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1861
  [Intel XE#1874]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1874
  [Intel XE#1924]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1924
  [Intel XE#1932]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1932
  [Intel XE#1960]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/1960
  [Intel XE#2007]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/2007
  [Intel XE#2016]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/2016
  [Intel XE#2028]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/2028
  [Intel XE#2034]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/2034
  [Intel XE#2049]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/2049
  [Intel XE#2056]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/2056
  [Intel XE#2078]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/2078
  [Intel XE#261]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/261
  [Intel XE#282]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/282
  [Intel XE#288]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/288
  [Intel XE#305]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/305
  [Intel XE#306]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/306
  [Intel XE#307]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/307
  [Intel XE#308]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/308
  [Intel XE#309]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/309
  [Intel XE#310]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/310
  [Intel XE#316]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/316
  [Intel XE#323]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/323
  [Intel XE#324]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/324
  [Intel XE#327]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/327
  [Intel XE#361]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/361
  [Intel XE#362]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/362
  [Intel XE#366]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/366
  [Intel XE#367]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/367
  [Intel XE#373]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/373
  [Intel XE#392]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/392
  [Intel XE#455]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/455
  [Intel XE#488]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/488
  [Intel XE#498]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/498
  [Intel XE#584]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/584
  [Intel XE#610]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/610
  [Intel XE#616]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/616
  [Intel XE#619]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/619
  [Intel XE#651]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/651
  [Intel XE#653]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/653
  [Intel XE#656]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/656
  [Intel XE#688]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/688
  [Intel XE#756]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/756
  [Intel XE#771]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/771
  [Intel XE#776]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/776
  [Intel XE#787]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/787
  [Intel XE#836]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/836
  [Intel XE#870]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/870
  [Intel XE#877]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/877
  [Intel XE#899]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/899
  [Intel XE#929]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/929
  [Intel XE#944]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/944
  [Intel XE#977]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/977
  [Intel XE#979]: https://gitlab.freedesktop.org/drm/xe/kernel/issues/979


Build changes
-------------

  * Linux: xe-1443-46852067df1514110bfc9c514d2610447376f1b7 -> xe-pw-134724v1

  IGT_7881: 7881
  xe-1443-46852067df1514110bfc9c514d2610447376f1b7: 46852067df1514110bfc9c514d2610447376f1b7
  xe-pw-134724v1: 134724v1

== Logs ==

For more details see: https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-134724v1/index.html

[-- Attachment #2: Type: text/html, Size: 62453 bytes --]