From: Matthew Brost <matthew.brost@intel.com>
To: intel-xe@lists.freedesktop.org
Subject: [PATCH 00/28] VF migration redesign
Date: Tue, 16 Sep 2025 20:45:47 -0700 [thread overview]
Message-ID: <20250917034615.3977603-1-matthew.brost@intel.com> (raw)
Rather than modifying buffers in place using GGTT addresses during VF
migration, this approach relies on the submission backend's stop/start
mechanism to issue fixups. The patch titled "Document GuC Submission
Backend" provides a detailed explanation of the design.
Testing was performed using an out-of-tree PF/VFIO driver with manual
triggering of VF migration while IGT test cases are running.
IGT test cases:
- A new series [1] that exercises active contexts and job resubmission.
- xe_exec_threads basic sections, which test context registration loss,
schedule enable loss, and job resubmission.
- xe_exec_threads balancer sections, which follow the same flows as the
basic sections but include a work queue (GGTT address shift).
- xe_exec_threads compute mode user pointer invalidation sections, which
exercise the same flow as the basic sections, plus replaying
suspend/resume flows.
All code paths in "Replay GuC submission state on pause/unpause" that
replay state have been manually verified via debug messages "Add debug
prints for GuC replaying state during VF recovery".
Matt
[1] https://patchwork.freedesktop.org/series/154616/
Matthew Brost (27):
Revert "drm/xe/vf: Rebase exec queue parallel commands during
migration recovery"
Revert "drm/xe/vf: Post migration, repopulate ring area for pending
request"
Revert "drm/xe/vf: Fixup CTB send buffer messages after migration"
drm/xe: Save off position in ring in which a job was programmed
drm/xe/guc: Track pending-enable source in submission state
drm/xe: Track LR jobs in DRM scheduler pending list
drm/xe: Don't change LRC ring head on job resubmission
drm/xe/guc: Document GuC submission backend
drm/xe/vf: Add xe_gt_sriov_vf_recovery_inprogress helper
drm/xe/vf: Make VF recovery run on per-GT worker
drm/xe/vf: Abort H2G sends during VF post-migration recovery
drm/xe/vf: Remove memory allocations from VF post migration recovery
drm/xe/vf: Close multi-GT GGTT shift race
drm/xe/vf: Teardown VF post migration worker on driver unload
drm/xe/vf: Don't allow GT reset to be queued during VF post migration
recovery
drm/xe/vf: Wakeup in GuC backend on VF post migration recovery
drm/xe/vf: Extra debug on GGTT shift
drm/xe/vf: Use GUC_HXG_TYPE_EVENT for GuC context register
drm/xe/vf: Stop and flush CTs in VF post migration recovery
drm/xe/vf: Reset TLB invalidations during VF post migration recovery
drm/xe/vf: Kickstart after resfix in VF post migration recovery
drm/xe/vf: Start CTs before resfix VF post migration recovery
drm/xe/vf: Abort VF post migration recovery on failure
drm/xe/vf: Replay GuC submission state on pause / unpause
drm/xe: Move queue init before LRC creation
drm/xe/vf: Add debug prints for GuC replaying state during VF recovery
drm/xe/vf: Workaround for race condition in GuC firmware during VF
pause
Tomasz Lis (1):
drm/xe/vf: Lock querying GGTT config during driver init
Documentation/gpu/xe/index.rst | 1 +
drivers/gpu/drm/xe/abi/guc_actions_abi.h | 8 -
drivers/gpu/drm/xe/xe_exec.c | 12 +-
drivers/gpu/drm/xe/xe_exec_queue.c | 81 +-
drivers/gpu/drm/xe/xe_exec_queue.h | 5 +-
drivers/gpu/drm/xe/xe_execlist.c | 2 +-
drivers/gpu/drm/xe/xe_gpu_scheduler.c | 14 +
drivers/gpu/drm/xe/xe_gpu_scheduler.h | 2 +
drivers/gpu/drm/xe/xe_gt.c | 9 -
drivers/gpu/drm/xe/xe_gt_sriov_vf.c | 362 +++++++--
drivers/gpu/drm/xe/xe_gt_sriov_vf.h | 8 +-
drivers/gpu/drm/xe/xe_gt_sriov_vf_types.h | 31 +-
drivers/gpu/drm/xe/xe_guc.c | 2 +-
drivers/gpu/drm/xe/xe_guc_ct.c | 282 ++-----
drivers/gpu/drm/xe/xe_guc_ct.h | 4 +-
drivers/gpu/drm/xe/xe_guc_exec_queue_types.h | 15 +
drivers/gpu/drm/xe/xe_guc_submit.c | 790 +++++++++++++++----
drivers/gpu/drm/xe/xe_guc_submit.h | 7 +-
drivers/gpu/drm/xe/xe_lrc.h | 10 +
drivers/gpu/drm/xe/xe_map.h | 18 -
drivers/gpu/drm/xe/xe_memirq.c | 48 +-
drivers/gpu/drm/xe/xe_memirq.h | 3 +
drivers/gpu/drm/xe/xe_ring_ops.c | 23 +-
drivers/gpu/drm/xe/xe_sched_job_types.h | 9 +
drivers/gpu/drm/xe/xe_sriov.c | 8 +-
drivers/gpu/drm/xe/xe_sriov_vf.c | 243 +-----
drivers/gpu/drm/xe/xe_sriov_vf.h | 3 +-
drivers/gpu/drm/xe/xe_sriov_vf_types.h | 4 -
drivers/gpu/drm/xe/xe_tile_sriov_vf.c | 6 +-
drivers/gpu/drm/xe/xe_tile_sriov_vf.h | 1 -
30 files changed, 1232 insertions(+), 779 deletions(-)
--
2.34.1
next reply other threads:[~2025-09-17 3:46 UTC|newest]
Thread overview: 33+ messages / expand[flat|nested] mbox.gz Atom feed top
2025-09-17 3:45 Matthew Brost [this message]
2025-09-17 3:45 ` [PATCH 01/28] drm/xe/vf: Lock querying GGTT config during driver init Matthew Brost
2025-09-17 3:45 ` [PATCH 02/28] Revert "drm/xe/vf: Rebase exec queue parallel commands during migration recovery" Matthew Brost
2025-09-17 3:45 ` [PATCH 03/28] Revert "drm/xe/vf: Post migration, repopulate ring area for pending request" Matthew Brost
2025-09-17 3:45 ` [PATCH 04/28] Revert "drm/xe/vf: Fixup CTB send buffer messages after migration" Matthew Brost
2025-09-17 3:45 ` [PATCH 05/28] drm/xe: Save off position in ring in which a job was programmed Matthew Brost
2025-09-17 3:45 ` [PATCH 06/28] drm/xe/guc: Track pending-enable source in submission state Matthew Brost
2025-09-17 3:45 ` [PATCH 07/28] drm/xe: Track LR jobs in DRM scheduler pending list Matthew Brost
2025-09-17 3:45 ` [PATCH 08/28] drm/xe: Don't change LRC ring head on job resubmission Matthew Brost
2025-09-17 3:45 ` [PATCH 09/28] drm/xe/guc: Document GuC submission backend Matthew Brost
2025-09-17 3:45 ` [PATCH 10/28] drm/xe/vf: Add xe_gt_sriov_vf_recovery_inprogress helper Matthew Brost
2025-09-17 3:45 ` [PATCH 11/28] drm/xe/vf: Make VF recovery run on per-GT worker Matthew Brost
2025-09-17 3:45 ` [PATCH 12/28] drm/xe/vf: Abort H2G sends during VF post-migration recovery Matthew Brost
2025-09-17 3:46 ` [PATCH 13/28] drm/xe/vf: Remove memory allocations from VF post migration recovery Matthew Brost
2025-09-17 3:46 ` [PATCH 14/28] drm/xe/vf: Close multi-GT GGTT shift race Matthew Brost
2025-09-17 3:46 ` [PATCH 15/28] drm/xe/vf: Teardown VF post migration worker on driver unload Matthew Brost
2025-09-17 3:46 ` [PATCH 16/28] drm/xe/vf: Don't allow GT reset to be queued during VF post migration recovery Matthew Brost
2025-09-17 3:46 ` [PATCH 17/28] drm/xe/vf: Wakeup in GuC backend on " Matthew Brost
2025-09-17 3:46 ` [PATCH 18/28] drm/xe/vf: Extra debug on GGTT shift Matthew Brost
2025-09-17 3:46 ` [PATCH 19/28] drm/xe/vf: Use GUC_HXG_TYPE_EVENT for GuC context register Matthew Brost
2025-09-17 3:46 ` [PATCH 20/28] drm/xe/vf: Stop and flush CTs in VF post migration recovery Matthew Brost
2025-09-17 3:46 ` [PATCH 21/28] drm/xe/vf: Reset TLB invalidations during " Matthew Brost
2025-09-17 3:46 ` [PATCH 22/28] drm/xe/vf: Kickstart after resfix in " Matthew Brost
2025-09-17 3:46 ` [PATCH 23/28] drm/xe/vf: Start CTs before resfix " Matthew Brost
2025-09-17 3:46 ` [PATCH 24/28] drm/xe/vf: Abort VF post migration recovery on failure Matthew Brost
2025-09-17 3:46 ` [PATCH 25/28] drm/xe/vf: Replay GuC submission state on pause / unpause Matthew Brost
2025-09-17 3:46 ` [PATCH 26/28] drm/xe: Move queue init before LRC creation Matthew Brost
2025-09-17 3:46 ` [PATCH 27/28] drm/xe/vf: Add debug prints for GuC replaying state during VF recovery Matthew Brost
2025-09-17 3:46 ` [PATCH 28/28] drm/xe/vf: Workaround for race condition in GuC firmware during VF pause Matthew Brost
2025-09-17 3:55 ` ✗ CI.checkpatch: warning for VF migration redesign Patchwork
2025-09-17 3:56 ` ✓ CI.KUnit: success " Patchwork
2025-09-17 4:39 ` ✗ Xe.CI.BAT: failure " Patchwork
2025-09-17 6:38 ` ✗ Xe.CI.Full: " Patchwork
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20250917034615.3977603-1-matthew.brost@intel.com \
--to=matthew.brost@intel.com \
--cc=intel-xe@lists.freedesktop.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox