dri-devel Archive on lore.kernel.org
 help / color / mirror / Atom feed
From: "Yadav, Arvind" <arvind.yadav@intel.com>
To: Rodrigo Vivi <rodrigo.vivi@intel.com>
Cc: <intel-xe@lists.freedesktop.org>,
	<dri-devel@lists.freedesktop.org>, <matthew.brost@intel.com>,
	<himal.prasad.ghimiray@intel.com>,
	<thomas.hellstrom@linux.intel.com>
Subject: Re: [PATCH 03/13] drm/xe: Drop queued page faults when device I/O is blocked
Date: Wed, 2 Sep 2026 10:19:22 +0530	[thread overview]
Message-ID: <ec7667c6-edc8-497c-97f5-872ba5d63bc3@intel.com> (raw)
In-Reply-To: <apXnb3_WmpYhPeUo@intel.com>


On 01-09-2026 02:13, Rodrigo Vivi wrote:
> On Thu, Aug 27, 2026 at 03:47:51PM +0530, Arvind Yadav wrote:
>> Page-fault work may still be queued when PCI error recovery starts or
>> the device becomes permanently wedged. Servicing these faults can migrate
>> memory or update page tables after device I/O has been blocked.
>>
>> Check the device state before and after fault servicing to cover a reset
>> racing with the worker. Drop the active fault and its chained faults
>> without sending a hardware response, and invalidate the cached fault
>> state.
>>
>> Cc: Matthew Brost <matthew.brost@intel.com>
>> Cc: Thomas Hellström <thomas.hellstrom@linux.intel.com>
>> Cc: Himal Prasad Ghimiray <himal.prasad.ghimiray@intel.com>
>> Cc: Rodrigo Vivi <rodrigo.vivi@intel.com>
>> Assisted-by: Claude:claude-opus-4-8
>> Signed-off-by: Arvind Yadav <arvind.yadav@intel.com>
>> ---
>>   drivers/gpu/drm/xe/xe_pagefault.c | 40 +++++++++++++++++++++++++++++++
>>   1 file changed, 40 insertions(+)
>>
>> diff --git a/drivers/gpu/drm/xe/xe_pagefault.c b/drivers/gpu/drm/xe/xe_pagefault.c
>> index 2e415995f067..f486165f2323 100644
>> --- a/drivers/gpu/drm/xe/xe_pagefault.c
>> +++ b/drivers/gpu/drm/xe/xe_pagefault.c
>> @@ -592,6 +592,38 @@ static void xe_pagefault_save_to_vm(struct xe_device *xe, struct xe_pagefault *p
>>   	xe_vm_put(vm);
>>   }
>>   
>> +static bool
>> +xe_pagefault_drop_if_blocked(struct xe_pagefault_queue *pf_queue,
>> +			     struct xe_pagefault_work *pf_work,
>> +			     struct xe_pagefault *pf,
>> +			     u64 *cache_start)
>> +{
>> +	struct xe_pagefault *next;
>> +
>> +	if (!xe_device_io_blocked(pf_work->xe))
>> +		return false;
>> +
>> +	/*
>> +	 * cache_start is private to this worker invocation. pf_work->cache is
>> +	 * shared with fault producers and must be invalidated under the queue
>> +	 * lock.
>> +	 */
>> +	xe_pagefault_cache_start_invalidate(*cache_start);
>> +
>> +	guard(spinlock_irq)(&pf_queue->lock);
>> +
>> +	xe_pagefault_cache_invalidate(pf_queue, pf_work);
>> +
>> +	while (pf) {
>> +		next = pf->consumer.next;
>> +		pf->consumer.next = NULL;
>> +		pf->consumer.alloc_state = XE_PAGEFAULT_ALLOC_STATE_FREE;
>> +		pf = next;
> is there some helper we could re-use? I know we cannot use the pop directly,
> because it would deadlock, but perhaps we can unify some code here...


Noted,

>
>> +	}
>> +
>> +	return true;
>> +}
>> +
>>   static void xe_pagefault_queue_work(struct work_struct *w)
>>   {
>>   	struct xe_pagefault_work *pf_work =
>> @@ -615,6 +647,10 @@ static void xe_pagefault_queue_work(struct work_struct *w)
>>   		int err = 0;
>>   		bool invalidated = false;
>>   
>> +		if (xe_pagefault_drop_if_blocked(pf_queue, pf_work, pf,
>> +						 &cache_start))
>> +			continue;
> do we really need to loop inside the loop or only check and let this main loop goes?


Yes, The inner walk is needed. Chained faults have already been removed 
from the queue and linked through consumer.next. The outer pop loop will 
not see them.

>
>> +
>>   		/* Last fault same address, ack immediately */
>>   		if (xe_pagefault_match(pf, cache_start, cache_end, cache_asid)) {
>>   			xe_gt_stats_incr(gt, XE_GT_STATS_ID_LAST_PAGEFAULT_COUNT, 1);
>> @@ -623,6 +659,10 @@ static void xe_pagefault_queue_work(struct work_struct *w)
>>   
>>   		err = xe_pagefault_service(pf);
>>   
>> +		if (xe_pagefault_drop_if_blocked(pf_queue, pf_work, pf,
>> +						 &cache_start))
> do we really need to check after?


Yes. The device can enter reset or become wedged while 
xe_pagefault_service() is running. The first check alone does not cover 
that race.

>
>> +			continue;
>> +
>>   		if (err) {
> now this err far from where it is collected is pretty bad...


Agreed. i will keeps err next to its use.

Thanks,
Arvind

>
>>   			if (!(pf->consumer.access_type & XE_PAGEFAULT_ACCESS_PREFETCH)) {
>>   				xe_pagefault_save_to_vm(gt_to_xe(gt), pf);
>> -- 
>> 2.43.0
>>

  reply	other threads:[~2026-09-02  4:49 UTC|newest]

Thread overview: 41+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-08-27 10:17 [PATCH 00/13] drm/xe: Isolate wedged devices from hardware access Arvind Yadav
2026-08-27 10:17 ` [PATCH 01/13] drm/xe/irq: Always free requested IRQs on uninstall Arvind Yadav
2026-08-27 10:39   ` Ghimiray, Himal Prasad
2026-08-31 20:30     ` Rodrigo Vivi
2026-09-01  9:32       ` Yadav, Arvind
2026-08-27 10:17 ` [PATCH 02/13] drm/xe: Separate AER reset state from device wedging Arvind Yadav
2026-08-27 10:36   ` sashiko-bot
2026-08-27 21:55   ` Andi Shyti
2026-08-28  3:32     ` Yadav, Arvind
2026-08-28 11:36   ` [PATCH 2/13] " Raag Jadav
2026-08-27 10:17 ` [PATCH 03/13] drm/xe: Drop queued page faults when device I/O is blocked Arvind Yadav
2026-08-31 20:43   ` Rodrigo Vivi
2026-09-02  4:49     ` Yadav, Arvind [this message]
2026-09-02  5:30       ` Matthew Brost
2026-09-02  5:33         ` Matthew Brost
2026-08-27 10:17 ` [PATCH 04/13] drm/xe: Stop VM work " Arvind Yadav
2026-08-31 20:55   ` Rodrigo Vivi
2026-09-01  9:11     ` Yadav, Arvind
2026-09-02  5:40       ` Matthew Brost
2026-08-27 10:17 ` [PATCH 05/13] drm/xe: Send wedged notification from a worker Arvind Yadav
2026-08-27 22:12   ` Andi Shyti
2026-08-28  3:39     ` Yadav, Arvind
2026-08-27 10:17 ` [PATCH 06/13] drm/xe: Reuse one dummy page per BO after wedge Arvind Yadav
2026-08-27 10:30   ` sashiko-bot
2026-08-27 10:17 ` [PATCH 07/13] drm/xe: Invalidate existing VRAM mappings on wedge Arvind Yadav
2026-08-27 10:17 ` [PATCH 08/13] drm/xe/irq: Serialize IRQ suspend and resume Arvind Yadav
2026-08-31 21:06   ` Rodrigo Vivi
2026-09-01  9:07     ` Yadav, Arvind
2026-08-27 10:17 ` [PATCH 09/13] drm/xe: Isolate a wedged device before notifying userspace Arvind Yadav
2026-08-27 10:35   ` sashiko-bot
2026-08-27 10:17 ` [PATCH 10/13] drm/xe/ttm: Reject VRAM allocations on wedged devices Arvind Yadav
2026-08-31 21:03   ` Rodrigo Vivi
2026-09-01  8:19     ` Yadav, Arvind
2026-08-27 10:17 ` [PATCH 11/13] drm/xe/guc: Skip timeout recovery on a wedged device Arvind Yadav
2026-08-31 21:01   ` Rodrigo Vivi
2026-08-27 10:18 ` [PATCH 12/13] drm/xe: Skip PM notifier preparation for wedged devices Arvind Yadav
2026-08-31 21:00   ` Rodrigo Vivi
2026-09-01  7:03     ` Yadav, Arvind
2026-09-02 19:21       ` Rodrigo Vivi
2026-08-27 10:18 ` [PATCH 13/13] drm/xe: Block BO VM access when device I/O is unavailable Arvind Yadav
2026-08-27 10:30   ` sashiko-bot

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=ec7667c6-edc8-497c-97f5-872ba5d63bc3@intel.com \
    --to=arvind.yadav@intel.com \
    --cc=dri-devel@lists.freedesktop.org \
    --cc=himal.prasad.ghimiray@intel.com \
    --cc=intel-xe@lists.freedesktop.org \
    --cc=matthew.brost@intel.com \
    --cc=rodrigo.vivi@intel.com \
    --cc=thomas.hellstrom@linux.intel.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox