From: Matthew Brost <matthew.brost@intel.com>
To: <sashiko-reviews@lists.linux.dev>
Cc: <intel-xe@lists.freedesktop.org>
Subject: Re: [PATCH v5 22/25] drm/xe: Add ULLS migration job support to GuC submission
Date: Thu, 3 Sep 2026 21:17:42 -0700 [thread overview]
Message-ID: <appGZjA7NTSPRnNT@gsse-cloud1.jf.intel.com> (raw)
In-Reply-To: <20260904024935.1A7D71F000E9@smtp.kernel.org>
On Fri, Sep 04, 2026 at 02:49:34AM +0000, sashiko-bot@kernel.org wrote:
> Thank you for your contribution! Sashiko AI review found 1 potential issue(s) to consider:
> - [High] Missing MMIO readback to flush the posted write to RING_TAIL before signaling the ULLS semaphore in memory.
> --
>
> commit 454390e5dedb020c4422d2a8b279ed19fa3eb789
> Author: Matthew Brost <matthew.brost@intel.com>
>
> drm/xe: Add ULLS migration job support to GuC submission
>
> This commit adds ULLS migration job support to the GuC submission backend.
> It updates the migration queue max jobs, directly sets the hardware engine
> tail via a MMIO write for ULLS jobs, and sets the ULLS semaphore for the
> current job releasing the last job.
>
> Link: https://patch.msgid.link/20260228013501.106680-24-matthew.brost@intel.com
>
> > diff --git a/drivers/gpu/drm/xe/xe_guc_submit.c b/drivers/gpu/drm/xe/xe_guc_submit.c
> > index dcb4b8a4f3b78..1578d80b01b82 100644
> > --- a/drivers/gpu/drm/xe/xe_guc_submit.c
> > +++ b/drivers/gpu/drm/xe/xe_guc_submit.c
> > @@ -1207,6 +1207,11 @@ static void submit_exec_queue(struct xe_exec_queue *q, struct xe_sched_job *job)
> > if (exec_queue_suspended(q))
> > return;
> >
> > + if (job->is_ulls && !job->is_ulls_first) {
> > + xe_hw_engine_write_ring_tail(q->hwe, lrc->ring.tail);
> > + xe_lrc_set_ulls_semaphore(lrc, xe_sched_job_lrc_seqno(job));
>
> [Severity: High]
> Does this sequence miss an MMIO readback to flush the posted write?
>
> A posted MMIO write is issued to the hardware engine's RING_TAIL via
> xe_hw_engine_write_ring_tail(), and is immediately followed by a memory write
> to signal the semaphore in xe_lrc_set_ulls_semaphore(). There is no
> intermediate MMIO readback to flush the posted write.
>
> If the CS wakes up from the semaphore wait before the MMIO RING_TAIL write
> arrives, it can observe HEAD == TAIL, assume the ring is empty, and go idle.
> The context is then switched out. When the delayed MMIO write eventually
> arrives, it hits an idle engine (or worse, a different context), failing to
> execute the submitted ULLS job and hanging the migration queue.
>
> Because xe_migrate_ulls_exit would then hang indefinitely waiting for the
> unexecuted job's fence, and the migration queue handles GPU page faults and
> SVM prefetches, this can hang workloads utilizing SVM.
>
> Does this violate PCIe ordering requirements for flushing posted writes before
> dependent memory writes?
>
Maybe. Again [1], it's something to keep an eye on, but I've never seen a
failure on BMG, and I've run `xe_exec_system_allocator` thousands of
times on this code over the past year.
I'd like to avoid adding a read unless we start seeing failures, as it
adds latency that we're trying very hard to avoid in this series.
If this does turn out to be an issue, we'll most likely move to a pure
memory-based model for ULLS with a single ring tail update. I have a
prototype of this, but it is significantly more invasive to the ring
operations and submission code than the changes in this series.
Matt
[1] https://patchwork.freedesktop.org/patch/750801/?series=149888&rev=6#comment_1383766
> > + }
> > +
> > if (!exec_queue_enabled(q)) {
> > action[len++] = XE_GUC_ACTION_SCHED_CONTEXT_MODE_SET;
> > action[len++] = q->guc->id;
>
> --
> Sashiko AI review · https://sashiko.dev/#/patchset/20260904022207.3490018-1-matthew.brost@intel.com?part=22
next prev parent reply other threads:[~2026-09-04 4:17 UTC|newest]
Thread overview: 41+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-09-04 2:21 [PATCH v5 00/25] CPU binds and ULLS on migration queue Matthew Brost
2026-09-04 2:21 ` [PATCH v5 01/25] drm/xe: Drop struct xe_migrate_pt_update argument from populate/clear vfuns Matthew Brost
2026-09-04 2:21 ` [PATCH v5 02/25] drm/xe: Add xe_migrate_update_pgtables_cpu_execute helper Matthew Brost
2026-09-04 2:37 ` sashiko-bot
2026-09-04 2:21 ` [PATCH v5 03/25] drm/xe: Decouple exec queue idle check from LRC Matthew Brost
2026-09-04 2:21 ` [PATCH v5 04/25] drm/xe: Add job count to GuC exec queue snapshot Matthew Brost
2026-09-04 2:21 ` [PATCH v5 05/25] drm/xe: Update xe_bo_put_deferred arguments to include writeback flag Matthew Brost
2026-09-04 2:44 ` sashiko-bot
2026-09-04 2:21 ` [PATCH v5 06/25] drm/xe: Add XE_BO_FLAG_PUT_VM_ASYNC Matthew Brost
2026-09-04 2:21 ` [PATCH v5 07/25] drm/xe: Update scheduler job layer to support PT jobs Matthew Brost
2026-09-04 2:21 ` [PATCH v5 08/25] drm/xe: Add helpers to access PT ops Matthew Brost
2026-09-04 2:21 ` [PATCH v5 09/25] drm/xe: Add struct xe_pt_job_ops Matthew Brost
2026-09-04 2:48 ` sashiko-bot
2026-09-04 2:21 ` [PATCH v5 10/25] drm/xe: Update GuC submission backend to run PT jobs Matthew Brost
2026-09-04 2:46 ` sashiko-bot
2026-09-04 2:21 ` [PATCH v5 11/25] drm/xe: Store level in struct xe_vm_pgtable_update Matthew Brost
2026-09-04 2:21 ` [PATCH v5 12/25] drm/xe: Don't use migrate exec queue for page fault binds Matthew Brost
2026-09-04 2:21 ` [PATCH v5 13/25] drm/xe: Enable CPU binds for jobs Matthew Brost
2026-09-04 2:51 ` sashiko-bot
2026-09-04 2:21 ` [PATCH v5 14/25] drm/xe: Remove unused arguments from xe_migrate_pt_update_ops Matthew Brost
2026-09-04 2:21 ` [PATCH v5 15/25] drm/xe: Make bind queues operate cross-tile Matthew Brost
2026-09-04 2:21 ` [PATCH v5 16/25] drm/xe: Add CPU bind layer Matthew Brost
2026-09-04 2:21 ` [PATCH v5 17/25] drm/xe: Add device flag to enable PT mirroring across tiles Matthew Brost
2026-09-04 2:43 ` sashiko-bot
2026-09-04 4:10 ` Matthew Brost
2026-09-04 2:22 ` [PATCH v5 18/25] drm/xe: Add xe_hw_engine_write_ring_tail Matthew Brost
2026-09-04 2:22 ` [PATCH v5 19/25] drm/xe: Add ULLS support to LRC Matthew Brost
2026-09-04 2:22 ` [PATCH v5 20/25] drm/xe: Add ULLS migration job support to migration layer Matthew Brost
2026-09-04 2:44 ` sashiko-bot
2026-09-04 4:11 ` Matthew Brost
2026-09-04 2:22 ` [PATCH v5 21/25] drm/xe: Add ULLS migration job support to ring ops Matthew Brost
2026-09-04 2:22 ` [PATCH v5 22/25] drm/xe: Add ULLS migration job support to GuC submission Matthew Brost
2026-09-04 2:49 ` sashiko-bot
2026-09-04 4:17 ` Matthew Brost [this message]
2026-09-04 2:22 ` [PATCH v5 23/25] drm/xe: Enter ULLS for migration jobs upon page fault or SVM prefetch Matthew Brost
2026-09-04 2:22 ` [PATCH v5 24/25] drm/xe: Add modparam to enable / disable ULLS on migrate queue Matthew Brost
2026-09-04 2:22 ` [PATCH v5 25/25] drm/xe: Document ULLS for migration jobs Matthew Brost
2026-09-04 2:29 ` ✗ CI.checkpatch: warning for CPU binds and ULLS on migration queue (rev7) Patchwork
2026-09-04 2:31 ` ✓ CI.KUnit: success " Patchwork
2026-09-04 3:08 ` ✓ Xe.CI.BAT: " Patchwork
2026-09-04 15:21 ` ✗ Xe.CI.FULL: failure " Patchwork
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=appGZjA7NTSPRnNT@gsse-cloud1.jf.intel.com \
--to=matthew.brost@intel.com \
--cc=intel-xe@lists.freedesktop.org \
--cc=sashiko-reviews@lists.linux.dev \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox