Comments on fails:

• igt@xe_evict@evict-beng-mixed-threads-small:

  • shard-dg2-set2: PASS -> DMESG-WARN

within `xe_guc_sched_done_handler()` -> `handle_sched_done()` -> `deregister_exec_queue()`, the assert got triggered:

xe_gt_assert(guc_to_gt(guc), exec_queue_destroyed(q));

This means we have bugs in our queue life cycle. We assumed there was already a call to `set_exec_queue_destroyed()` before the `deregister_exec_queue()`, but that was not the case here.

Someone working on submission should take a look, but  - this is not related to the series under test, nor with SRIOV.

• igt@xe_exec_sip@invalidinstr-walker-enabled:

  • shard-lnl: PASS -> FAIL +1 other test fail

The jobs executed during the test were unable to finish in 5 seconds, so caused engine reset. This is how this test normally works - in the "PASS" example it does the same thing.

However, for some reason, in the new run IGT considered the execution too long and failed the case.

This looks to me like a race, with both KMD and IGT having roughly the same timeout set. If KMD takes longer in a specific run, the comparison on IGT side - and therefore the test - will fail.

Looks like a test issue to me. The test author should take a look. Regardless, this has nothing to do with the series under test, nor with SRIOV.

• igt@xe_pm_residency@gt-c6-freeze:

  • shard-lnl: PASS -> INCOMPLETE +2 other tests incomplete

The machine did not returned after RC6. It's very hard to tell anything more. Very likely a hardware issue, but who knows.

One is certain, this has nothing to do with the series under test, nor with SRIOV.

-Tomasz

Patch Details

Series:	drm/xe/vf: Post-migration recovery worker basis (rev4)
URL:	https://patchwork.freedesktop.org/series/138935/
State:	failure
Details:	https://intel-gfx-ci.01.org/tree/intel-xe/xe-pw-138935v4/index.html

CI Bug Log - changes from xe-2019-d6a4624817a46144a4dbc125c9371439edc82295_full -> xe-pw-138935v4_full

Summary

FAILURE

Serious unknown changes coming with xe-pw-138935v4_full absolutely need to be
verified manually.

If you think the reported changes have nothing to do with the changes
introduced in xe-pw-138935v4_full, please notify your bug team (I915-ci-infra@lists.freedesktop.org) to allow them
to document this new failure mode, which will reduce false positives in CI.

Participating hosts (4 -> 4)

No changes in participating hosts

Possible new issues

Here are the unknown changes that may have been introduced in xe-pw-138935v4_full:

IGT changes

Possible regressions

• igt@xe_evict@evict-beng-mixed-threads-small:

  • shard-dg2-set2: PASS -> DMESG-WARN

• igt@xe_exec_sip@invalidinstr-walker-enabled:

  • shard-lnl: PASS -> FAIL +1 other test fail

• igt@xe_pm_residency@gt-c6-freeze:

  • shard-lnl: PASS -> INCOMPLETE +2 other tests incomplete

Suppressed

The following results come from untrusted machines, tests, or statuses.
They do not affect the overall result.

• igt@kms_plane_scaling@planes-downscale-factor-0-5-upscale-factor-0-25@pipe-c:
  • {shard-bmg}: PASS -> INCOMPLETE

Known issues

Here are the changes found in xe-pw-138935v4_full that come from known issues:

IGT changes

Issues hit

• igt@kms_async_flips@alternate-sync-async-flip@pipe-c-hdmi-a-1:

  • shard-adlp: PASS -> DMESG-WARN (Intel XE#324) +1 other test dmesg-warn

• igt@kms_atomic_transition@modeset-transition-nonblocking@1x-outputs:

  • shard-lnl: PASS -> FAIL (Intel XE#1701) +1 other test fail

• igt@kms_atomic_transition@plane-all-modeset-transition-fencing-internal-panels:

  • shard-lnl: PASS -> FAIL (Intel XE#1426) +1 other test fail

• igt@kms_big_fb@4-tiled-64bpp-rotate-0:

  • shard-lnl: PASS -> FAIL (Intel XE#1659)

• igt@kms_big_fb@4-tiled-64bpp-rotate-180:

  • shard-adlp: NOTRUN -> SKIP (Intel XE#1124) +3 other tests skip

• igt@kms_big_fb@4-tiled-8bpp-rotate-270:

  • shard-lnl: NOTRUN -> SKIP (Intel XE#1407) +1 other test skip

• igt@kms_big_fb@linear-64bpp-rotate-0:

  • shard-dg2-set2: PASS -> DMESG-WARN (Intel XE#877)

• igt@kms_big_fb@y-tiled-max-hw-stride-64bpp-rotate-180-hflip:

  • shard-lnl: NOTRUN -> SKIP (Intel XE#1124) +3 other tests skip

• igt@kms_bw@connected-linear-tiling-1-displays-3840x2160p:

  • shard-adlp: NOTRUN -> SKIP (Intel XE#367)
  • shard-dg2-set2: NOTRUN -> SKIP (Intel XE#367)

• igt@kms_ccs@crc-sprite-planes-basic-y-tiled-gen12-mc-ccs:

  • shard-adlp: NOTRUN -> SKIP (Intel XE#455 / Intel XE#787) +1 other test skip

• igt@kms_ccs@crc-sprite-planes-basic-y-tiled-gen12-mc-ccs@pipe-c-hdmi-a-1:

  • shard-adlp: NOTRUN -> SKIP (Intel XE#787) +2 other tests skip

• igt@kms_ccs@crc-sprite-planes-basic-y-tiled-gen12-rc-ccs:

  • shard-lnl: NOTRUN -> SKIP (Intel XE#2887) +2 other tests skip

• igt@kms_ccs@random-ccs-data-4-tiled-dg2-rc-ccs:

  • shard-dg2-set2: PASS -> INCOMPLETE (Intel XE#1195) +1 other test incomplete

• igt@kms_chamelium_hpd@dp-hpd-storm-disable:

  • shard-adlp: NOTRUN -> SKIP (Intel XE#373) +1 other test skip
  • shard-dg2-set2: NOTRUN -> SKIP (Intel XE#373)

• igt@kms_chamelium_hpd@vga-hpd-for-each-pipe:

  • shard-lnl: NOTRUN -> SKIP (Intel XE#373) +3 other tests skip

• igt@kms_cursor_crc@cursor-sliding-max-size:

  • shard-lnl: NOTRUN -> SKIP (Intel XE#1424) +2 other tests skip

• igt@kms_cursor_legacy@2x-nonblocking-modeset-vs-cursor-atomic:

  • shard-adlp: NOTRUN -> SKIP (Intel XE#309)

• igt@kms_cursor_legacy@flip-vs-cursor-atomic-transitions-varying-size:

  • shard-lnl: PASS -> FAIL (Intel XE#1475)

• igt@kms_flip@2x-flip-vs-dpms-off-vs-modeset:

  • shard-lnl: NOTRUN -> SKIP (Intel XE#1421)

• igt@kms_flip@blocking-wf_vblank@a-edp1:

  • shard-lnl: NOTRUN -> FAIL (Intel XE#886) +1 other test fail

• igt@kms_flip@flip-vs-blocking-wf-vblank@a-edp1:

  • shard-lnl: PASS -> FAIL (Intel XE#886) +3 other tests fail

• igt@kms_flip@flip-vs-expired-vblank-interruptible@b-hdmi-a6:

  • shard-dg2-set2: PASS -> FAIL (Intel XE#301) +3 other tests fail

• igt@kms_flip_scaled_crc@flip-32bpp-ytile-to-32bpp-ytileccs-upscaling@pipe-a-valid-mode:

  • shard-dg2-set2: NOTRUN -> SKIP (Intel XE#455) +1 other test skip

• igt@kms_flip_scaled_crc@flip-64bpp-yftile-to-32bpp-yftile-downscaling:

  • shard-lnl: NOTRUN -> SKIP (Intel XE#1401 / Intel XE#1745)

• igt@kms_flip_scaled_crc@flip-64bpp-yftile-to-32bpp-yftile-downscaling@pipe-a-default-mode:

  • shard-lnl: NOTRUN -> SKIP (Intel XE#1401)

• igt@kms_force_connector_basic@prune-stale-modes:

  • shard-lnl: NOTRUN -> SKIP (Intel XE#352)

• igt@kms_frontbuffer_tracking@fbc-2p-scndscrn-indfb-pgflip-blt:

  • shard-lnl: NOTRUN -> SKIP (Intel XE#656) +6 other tests skip

• igt@kms_frontbuffer_tracking@fbc-2p-scndscrn-spr-indfb-onoff:

  • shard-adlp: NOTRUN -> SKIP (Intel XE#656) +4 other tests skip

• igt@kms_frontbuffer_tracking@fbc-suspend:

  • shard-lnl: PASS -> INCOMPLETE (Intel XE#2050)

• igt@kms_frontbuffer_tracking@fbcdrrs-1p-primscrn-indfb-pgflip-blt:

  • shard-lnl: NOTRUN -> SKIP (Intel XE#651) +3 other tests skip

• igt@kms_frontbuffer_tracking@fbcdrrs-1p-primscrn-spr-indfb-draw-blt:

  • shard-adlp: NOTRUN -> SKIP (Intel XE#651) +2 other tests skip

• igt@kms_frontbuffer_tracking@fbcdrrs-2p-scndscrn-spr-indfb-onoff:

  • shard-dg2-set2: NOTRUN -> SKIP (Intel XE#651) +1 other test skip

• igt@kms_frontbuffer_tracking@fbcpsr-1p-primscrn-cur-indfb-draw-mmap-wc:

  • shard-adlp: NOTRUN -> SKIP (Intel XE#653) +1 other test skip

• igt@kms_frontbuffer_tracking@fbcpsr-2p-rte:

  • shard-dg2-set2: NOTRUN -> SKIP (Intel XE#653) +1 other test skip

• igt@kms_hdr@static-swap:

  • shard-adlp: NOTRUN -> SKIP (Intel XE#455) +4 other tests skip

• igt@kms_joiner@basic-force-ultra-joiner:

  • shard-lnl: NOTRUN -> SKIP (Intel XE#2934)

• igt@kms_joiner@invalid-modeset-force-ultra-joiner:

  • shard-adlp: NOTRUN -> SKIP (Intel XE#2332)

• igt@kms_plane@plane-position-covered@pipe-b-plane-3:

  • shard-lnl: PASS -> DMESG-WARN (Intel XE#324)

• igt@kms_plane@plane-position-hole@pipe-a-plane-3:

  • shard-lnl: PASS -> DMESG-FAIL (Intel XE#324) +2 other tests dmesg-fail

• igt@kms_plane_scaling@planes-unity-scaling-downscale-factor-0-25@pipe-a:

  • shard-lnl: NOTRUN -> SKIP (Intel XE#2763) +11 other tests skip

• igt@kms_pm_dc@dc6-dpms:

  • shard-lnl: PASS -> FAIL (Intel XE#1430)

• igt@kms_pm_rpm@dpms-non-lpsp:

  • shard-adlp: NOTRUN -> SKIP (Intel XE#836)

• igt@kms_pm_rpm@universal-planes-dpms:

  • shard-lnl: PASS -> INCOMPLETE (Intel XE#1620 / Intel XE#2864)

• igt@kms_pm_rpm@universal-planes-dpms@plane-77:

  • shard-lnl: PASS -> DMESG-FAIL (Intel XE#1620)

• igt@kms_psr2_sf@psr2-cursor-plane-move-continuous-exceed-fully-sf:

  • shard-adlp: NOTRUN -> SKIP (Intel XE#1489)

• igt@kms_psr@fbc-psr2-no-drrs:

  • shard-dg2-set2: NOTRUN -> SKIP (Intel XE#2850 / Intel XE#929)
  • shard-adlp: NOTRUN -> SKIP (Intel XE#2850 / Intel XE#929)

• igt@kms_psr@pr-no-drrs:

  • shard-lnl: NOTRUN -> SKIP (Intel XE#1406)

• igt@kms_rotation_crc@primary-yf-tiled-reflect-x-180:

  • shard-lnl: NOTRUN -> SKIP (Intel XE#1127)

• igt@kms_rotation_crc@sprite-rotation-180:

  • shard-lnl: PASS -> DMESG-WARN (Intel XE#2055)

• igt@kms_vrr@flip-suspend@pipe-a-edp-1:

  • shard-lnl: PASS -> FAIL (Intel XE#2443) +1 other test fail

• igt@xe_ccs@block-multicopy-inplace:

  • shard-adlp: NOTRUN -> SKIP (Intel XE#455 / Intel XE#488)

• igt@xe_eudebug@vma-ufence:

  • shard-lnl: NOTRUN -> SKIP (Intel XE#2905) +1 other test skip

• igt@xe_evict@evict-beng-small:

  • shard-lnl: NOTRUN -> SKIP (Intel XE#688)

• igt@xe_evict@evict-small-cm:

  • shard-adlp: NOTRUN -> SKIP (Intel XE#261 / Intel XE#688)

• igt@xe_exec_basic@multigpu-no-exec-bindexecqueue-rebind:

  • shard-adlp: NOTRUN -> SKIP (Intel XE#1392)

• igt@xe_exec_basic@multigpu-no-exec-bindexecqueue-userptr-invalidate:

  • shard-lnl: NOTRUN -> SKIP (Intel XE#1392)

• igt@xe_exec_fault_mode@many-execqueues-rebind:

  • shard-adlp: NOTRUN -> SKIP (Intel XE#288) +2 other tests skip

• igt@xe_exec_reset@cm-cat-error:

  • shard-adlp: NOTRUN -> DMESG-FAIL (Intel XE#1962)

• igt@xe_live_ktest@xe_bo@xe_bo_evict_kunit:

  • shard-adlp: NOTRUN -> SKIP (Intel XE#2229) +1 other test skip

• igt@xe_pat@pat-index-xelpg:

  • shard-lnl: NOTRUN -> SKIP (Intel XE#979)

• igt@xe_pm@d3hot-basic:

  • shard-lnl: PASS -> DMESG-WARN (Intel XE#1620)

• igt@xe_pm@s4-basic:

  • shard-adlp: NOTRUN -> ABORT (Intel XE#1358 / Intel XE#1607)

• igt@xe_query@multigpu-query-cs-cycles:

  • shard-lnl: NOTRUN -> SKIP (Intel XE#944) +1 other test skip

• igt@xe_wedged@basic-wedged:

  • shard-adlp: NOTRUN -> DMESG-WARN (Intel XE#2919)

Possible fixes

• igt@kms_async_flips@alternate-sync-async-flip@pipe-d-hdmi-a-1:

  • shard-adlp: DMESG-WARN (Intel XE#324) -> PASS

• igt@kms_big_fb@4-tiled-max-hw-stride-64bpp-rotate-0:

  • shard-lnl: FAIL (Intel XE#1659) -> PASS

• igt@kms_cursor_crc@cursor-rapid-movement-256x256:

  • shard-adlp: DMESG-WARN -> PASS

• igt@kms_cursor_edge_walk@128x128-right-edge:

  • shard-lnl: FAIL -> PASS +2 other tests pass

• igt@kms_cursor_legacy@cursorb-vs-flipa-atomic-transitions-varying-size:

  • {shard-bmg}: DMESG-WARN (Intel XE#2791 / Intel XE#877) -> PASS

• igt@kms_cursor_legacy@flip-vs-cursor-varying-size:

  • shard-lnl: FAIL (Intel XE#1475) -> PASS

• igt@kms_fbcon_fbt@fbc-suspend:

  • shard-lnl: FAIL (Intel XE#2958) -> PASS

• igt@kms_fbcon_fbt@psr-suspend:

  • shard-lnl: INCOMPLETE -> PASS +1 other test pass

• igt@kms_flip@2x-flip-vs-expired-vblank-interruptible@ac-dp2-hdmi-a3:

  • {shard-bmg}: FAIL (Intel XE#301) -> PASS

• igt@kms_flip@2x-flip-vs-expired-vblank-interruptible@ac-hdmi-a6-dp4:

  • shard-dg2-set2: FAIL -> PASS

• igt@kms_flip@flip-vs-expired-vblank-interruptible@b-dp4:

  • shard-dg2-set2: FAIL (Intel XE#301) -> PASS +4 other tests pass

• igt@kms_flip@flip-vs-expired-vblank-interruptible@c-dp2:

  • {shard-bmg}: FAIL -> PASS

• igt@kms_flip@plain-flip-fb-recreate-interruptible@a-edp1:

  • shard-lnl: FAIL (Intel XE#886) -> PASS +7 other tests pass

• igt@kms_flip@single-buffer-flip-vs-dpms-off-vs-modeset-interruptible:

  • shard-lnl: FAIL (Intel XE#2957) -> PASS

• igt@kms_plane@plane-position-covered@pipe-a-plane-1:

  • shard-lnl: DMESG-FAIL (Intel XE#324) -> PASS +2 other tests pass

• igt@kms_plane@plane-position-hole-dpms@pipe-b-plane-3:

  • shard-lnl: DMESG-WARN (Intel XE#324) -> PASS +6 other tests pass

• igt@kms_pm_rpm@legacy-planes-dpms:

  • shard-lnl: INCOMPLETE (Intel XE#1620 / Intel XE#2864) -> PASS

• igt@kms_pm_rpm@legacy-planes-dpms@plane-41:

  • shard-lnl: DMESG-FAIL (Intel XE#1620) -> PASS +1 other test pass

• igt@kms_universal_plane@cursor-fb-leak@pipe-a-edp-1:

  • shard-lnl: FAIL (Intel XE#899) -> PASS +1 other test pass

• igt@xe_ccs@suspend-resume@xmajor-compressed-compfmt0-system-system:

  • shard-lnl: INCOMPLETE (Intel XE#2760) -> PASS +1 other test pass

• igt@xe_create@create-contexts:

  • shard-lnl: DMESG-WARN -> PASS

• igt@xe_evict@evict-mixed-threads-large:

  • shard-dg2-set2: FAIL (Intel XE#1000) -> PASS

• igt@xe_exec_balancer@no-exec-parallel-rebind:

  • shard-adlp: DMESG-WARN (Intel XE#1033 / Intel XE#1727) -> PASS

• igt@xe_exec_compute_mode@once-userptr-invalidate:

  • shard-lnl: FAIL (Intel XE#2754) -> PASS +2 other tests pass

• igt@xe_pm_residency@toggle-gt-c6:

  • shard-lnl: FAIL (Intel XE#958) -> PASS

• igt@xe_vm@large-misaligned-binds-2147483648:

  • shard-adlp: TIMEOUT -> PASS +2 other tests pass

Warnings

• igt@kms_big_fb@x-tiled-max-hw-stride-64bpp-rotate-0-hflip-async-flip:

  • shard-adlp: DMESG-FAIL (Intel XE#324) -> FAIL (Intel XE#1231)

• igt@kms_big_fb@y-tiled-max-hw-stride-64bpp-rotate-0-hflip-async-flip:

  • shard-adlp: FAIL (Intel XE#1231) -> DMESG-WARN (Intel XE#324)

• igt@kms_big_fb@y-tiled-max-hw-stride-64bpp-rotate-180-async-flip:

  • shard-adlp: TIMEOUT (Intel XE#402) -> FAIL (Intel XE#1231)

• igt@xe_exec_basic@multigpu-many-execqueues-many-vm-userptr-invalidate-race:

  • shard-adlp: TIMEOUT -> SKIP (Intel XE#1392)

• igt@xe_live_ktest@xe_bo@xe_bo_shrink_kunit:

  • shard-dg2-set2: INCOMPLETE (Intel XE#1195) -> TIMEOUT (Intel XE#2961) +1 other test timeout

{name}: This element is suppressed. This means it is ignored when computing
the status of the difference (SUCCESS, WARNING, or FAILURE).

Build changes

• Linux: xe-2019-d6a4624817a46144a4dbc125c9371439edc82295 -> xe-pw-138935v4

IGT_8054: 3f627b7fd48c6ab324ceaa80dd8cf0131292bf63 @ https://gitlab.freedesktop.org/drm/igt-gpu-tools.git
xe-2019-d6a4624817a46144a4dbc125c9371439edc82295: d6a4624817a46144a4dbc125c9371439edc82295
xe-pw-138935v4: 138935v4