From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-3.5 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE, SPF_PASS,URIBL_BLOCKED autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 809B4C433DB for ; Wed, 3 Feb 2021 12:24:53 +0000 (UTC) Received: from gabe.freedesktop.org (gabe.freedesktop.org [131.252.210.177]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 0643664F95 for ; Wed, 3 Feb 2021 12:24:52 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 0643664F95 Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=ffwll.ch Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=amd-gfx-bounces@lists.freedesktop.org Received: from gabe.freedesktop.org (localhost [127.0.0.1]) by gabe.freedesktop.org (Postfix) with ESMTP id 29E1B6EA8D; Wed, 3 Feb 2021 12:24:48 +0000 (UTC) Received: from mail-wm1-x329.google.com (mail-wm1-x329.google.com [IPv6:2a00:1450:4864:20::329]) by gabe.freedesktop.org (Postfix) with ESMTPS id 16ADD6EA68 for ; Wed, 3 Feb 2021 12:24:46 +0000 (UTC) Received: by mail-wm1-x329.google.com with SMTP id 190so5314990wmz.0 for ; Wed, 03 Feb 2021 04:24:46 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ffwll.ch; s=google; h=date:from:to:cc:subject:message-id:mail-followup-to:references :mime-version:content-disposition:content-transfer-encoding :in-reply-to; bh=m/NA4XNIrCQYNebCKt931IdDV/rzSFumSCUH9F33px4=; b=ZRA0TVyu4fRxmUS1RmK6WHKfbnpAv8v9d+qtiFMBD2IMSSfd8urMqqHC95oam0EQlS YxqzZFFmMHv0SPV1aHNYeH4b8OqGEH2/o0HSixyFNS/mtm5SitgA1QMRAXq1lH3Z3M7i r/xCYBSLA8EQ8csv35OC5wluVAbmODcTD17G4= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id :mail-followup-to:references:mime-version:content-disposition :content-transfer-encoding:in-reply-to; bh=m/NA4XNIrCQYNebCKt931IdDV/rzSFumSCUH9F33px4=; b=mplvYPHlnvjM+3MmHJ5SXkuQC5eR0sH1u+RvGnPN8fMhZiYhuyBksO3TeehRBIDzsD dcJMd/zKL5ic31pFi33YJVKvuCWoivcZFCdhz+n29gfqNI1NqbC/nlpg4DvnKHsP2pFw UDOU0BSKOKVFRakWs2TG+MryTqij1wTKJwmsAoSUXMIs39tspSCGxdwZnEwSRANq1li+ 7gmJxhYZvygONNn2cY0NnBO4uaun6o0Wg/KRURH+agRS48rLeCjf7DNoBLI/kvzUEIJj uex19YOq9shIi+4D0S2wX3cSSspk00Kdwmkcr43WKbcw/GQxmwkxeA/N0Sle3nhRG3MZ ToHQ== X-Gm-Message-State: AOAM531+gnIh2B4cROERPQzJlc5hNcalQRo+FWYXMCJhKNxorP28ynFt WZQyKIiP38fKul067So5cAy1mQ== X-Google-Smtp-Source: ABdhPJyVy0zQu6h3nSD6wAbF9bgQ1VdIhgwWSIQlKTCZZyiOuBEn8EE8tvHk8fS3yPow6235vprjjA== X-Received: by 2002:a05:600c:4148:: with SMTP id h8mr2576404wmm.137.1612355084657; Wed, 03 Feb 2021 04:24:44 -0800 (PST) Received: from phenom.ffwll.local ([2a02:168:57f4:0:efd0:b9e5:5ae6:c2fa]) by smtp.gmail.com with ESMTPSA id e16sm3547170wrp.24.2021.02.03.04.24.43 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 03 Feb 2021 04:24:43 -0800 (PST) Date: Wed, 3 Feb 2021 13:24:42 +0100 From: Daniel Vetter To: christian.koenig@amd.com Subject: Re: [amdgpu] deadlock Message-ID: Mail-Followup-To: christian.koenig@amd.com, Daniel Gomez , Alex Deucher , dri-devel , amd-gfx list , Linux Kernel Mailing List References: <58e41b62-b8e0-b036-c87d-a84d53f5a26e@amd.com> <538682ee-3e12-a345-2205-2c0f16b496ff@gmail.com> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <538682ee-3e12-a345-2205-2c0f16b496ff@gmail.com> X-Operating-System: Linux phenom 5.7.0-1-amd64 X-BeenThere: amd-gfx@lists.freedesktop.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion list for AMD gfx List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Linux Kernel Mailing List , amd-gfx list , dri-devel , Daniel Vetter , Alex Deucher , Daniel Gomez Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Errors-To: amd-gfx-bounces@lists.freedesktop.org Sender: "amd-gfx" T24gV2VkLCBGZWIgMDMsIDIwMjEgYXQgMDE6MjE6MjBQTSArMDEwMCwgQ2hyaXN0aWFuIEvDtm5p ZyB3cm90ZToKPiBBbSAwMy4wMi4yMSB1bSAxMjo0NSBzY2hyaWViIERhbmllbCBHb21lejoKPiA+ IE9uIFdlZCwgMyBGZWIgMjAyMSBhdCAxMDo0NywgRGFuaWVsIEdvbWV6IDxkYW5pZWxAcXRlYy5j b20+IHdyb3RlOgo+ID4gPiBPbiBXZWQsIDMgRmViIDIwMjEgYXQgMTA6MTcsIERhbmllbCBWZXR0 ZXIgPGRhbmllbEBmZndsbC5jaD4gd3JvdGU6Cj4gPiA+ID4gT24gV2VkLCBGZWIgMywgMjAyMSBh dCA5OjUxIEFNIENocmlzdGlhbiBLw7ZuaWcgPGNocmlzdGlhbi5rb2VuaWdAYW1kLmNvbT4gd3Jv dGU6Cj4gPiA+ID4gPiBBbSAwMy4wMi4yMSB1bSAwOTo0OCBzY2hyaWViIERhbmllbCBWZXR0ZXI6 Cj4gPiA+ID4gPiA+IE9uIFdlZCwgRmViIDMsIDIwMjEgYXQgOTozNiBBTSBDaHJpc3RpYW4gS8O2 bmlnIDxjaHJpc3RpYW4ua29lbmlnQGFtZC5jb20+IHdyb3RlOgo+ID4gPiA+ID4gPiA+IEhpIERh bmllbCwKPiA+ID4gPiA+ID4gPiAKPiA+ID4gPiA+ID4gPiB0aGlzIGlzIG5vdCBhIGRlYWRsb2Nr LCBidXQgcmF0aGVyIGEgaGFyZHdhcmUgbG9ja3VwLgo+ID4gPiA+ID4gPiBBcmUgeW91IHN1cmU/ IEltZSBnZXR0aW5nIHN0dWNrIGluIGRtYV9mZW5jZV93YWl0IGhhcyBnZW5lcmFsbHkgZ29vZAo+ ID4gPiA+ID4gPiBjaGFuY2Ugb2YgYmVpbmcgYSBkbWFfZmVuY2UgZGVhZGxvY2suIEdQVSBoYW5n IHNob3VsZCBuZXZlciByZXN1bHQgaW4KPiA+ID4gPiA+ID4gYSBmb3JldmVyIHN0dWNrIGRtYV9m ZW5jZS4KPiA+ID4gPiA+IFllcywgSSdtIHByZXR0eSBzdXJlLiBPdGhlcndpc2UgdGhlIGhhcmR3 YXJlIGNsb2NrcyB3b3VsZG4ndCBnbyB1cCBsaWtlCj4gPiA+ID4gPiB0aGlzLgo+ID4gPiA+IE1h eWJlIGNsYXJpZnlpbmcsIGNvdWxkIGJlIGJvdGguIFREUiBzaG91bGQgbm90aWNlIGFuZCBnZXQg dXMgb3V0IG9mCj4gPiA+ID4gdGhpcywgYnV0IGlmIHRoZXJlJ3MgYSBkbWFfZmVuY2UgZGVhZGxv Y2sgYW5kIHdlIGNhbid0IHJlLWVtaXQgb3IKPiA+ID4gPiBmb3JjZSBjb21wbGV0ZSB0aGUgcGVu ZGluZyB0aGluZ3MsIHRoZW4gd2UncmUgc3R1Y2sgZm9yIGdvb2QuCj4gPiA+ID4gLURhbmllbAo+ ID4gPiA+IAo+ID4gPiA+ID4gUXVlc3Rpb24gaXMgcmF0aGVyIHdoeSB3ZSBlbmQgdXAgaW4gdGhl IHVzZXJwdHIgaGFuZGxpbmcgZm9yIEdGWD8gT3VyCj4gPiA+ID4gPiBST0NtIE9wZW5DTCBzdGFj ayBzaG91bGRuJ3QgdXNlIHRoaXMuCj4gPiA+ID4gPiAKPiA+ID4gPiA+ID4gRGFuaWVsLCBjYW4g eW91IHBscyByZS1oYW5nIHlvdXIgbWFjaGluZSBhbmQgdGhlbiBkdW1wIGJhY2t0cmFjZXMgb2YK PiA+ID4gPiA+ID4gYWxsIHRhc2tzIGludG8gZG1lc2cgd2l0aCBzeXNycS10LCBhbmQgdGhlbiBh dHRhY2ggdGhhdD8gV2l0aG91dCBhbGwKPiA+ID4gPiA+ID4gdGhlIGJhY2t0cmFjZXMgaXQncyB0 cmlja3kgdG8gY29uc3RydWN0IHRoZSBmdWxsIGRlcGVuZGVuY3kgY2hhaW4gb2YKPiA+ID4gPiA+ ID4gd2hhdCdzIGdvaW5nIG9uLiBBbHNvIGlzIHRoaXMgcGxhaW4gLXJjNiwgbm90IHNvbWUgbW9y ZSBwYXRjaGVzIG9uCj4gPiA+ID4gPiA+IHRvcD8KPiA+ID4gPiA+IFllYWgsIHRoYXQncyBzdGls bCBhIGdvb2QgaWRlYSB0byBoYXZlLgo+ID4gPiBIZXJlIHRoZSBmdWxsIGJhY2t0cmFjZSBkbWVz ZyBsb2dzIGFmdGVyIHRoZSBoYW5nOgo+ID4gPiBodHRwczovL3Bhc3RlYmluLmNvbS9yYXcva3pp dm0yTDMKPiA+ID4gCj4gPiA+IFRoaXMgaXMgYW5vdGhlciBkbWVzZyBsb2cgd2l0aCB0aGUgYmFj a3RyYWNlcyBhZnRlciBTSUdLSUxMIHRoZSBtYXRyaXggcHJvY2VzczoKPiA+ID4gKEkgZGlkbid0 IGhhdmUgdGhlIHN5c3JxIGVuYWJsZSBhdCB0aGUgdGltZSk6Cj4gPiA+IGh0dHBzOi8vcGFzdGVi aW4uY29tL3Jhdy9wUkJ3R2NqMQo+ID4gSSd2ZSBub3cgcmVtb3ZlZCBhbGwgb3VyIHY0bDIgcGF0 Y2hlcyBhbmQgZGlkIHRoZSBzYW1lIHRlc3Qgd2l0aCB0aGUgJ3BsYWluJwo+ID4gbWFpbmxpbmUg dmVyc2lvbiAoLXJjNikuCj4gPiAKPiA+IFJlZmVyZW5jZTogM2FhZjBhMjdmZmMyOWIxOWE2MjMx NGVkZDY4NGI5YmM2MzQ2ZjlhOAo+ID4gCj4gPiBTYW1lIGVycm9yLCBzYW1lIGJlaGF2aW91ci4g RnVsbCBkbWVzZyBsb2cgYXR0YWNoZWQ6Cj4gPiBodHRwczovL3Bhc3RlYmluLmNvbS9yYXcvS2dh RWY3WTEKPiA+IE5vdGU6Cj4gPiAgICBkbWVzZyB3aXRoIHN5c3JxLXQgYmVmb3JlIHJ1bm5pbmcg dGhlIHRlc3Qgc3RhcnRzIGluIFsgIDEyMi4wMTY1MDJdCj4gPiBzeXNycTogU2hvdyBTdGF0ZQo+ ID4gICAgZG1lc2cgd2l0aCBzeXNycS10IGFmdGVyIHRoZSB0ZXN0IHN0YXJ0cyBpbjogWyAgNDk1 LjU4NzY3MV0gc3lzcnE6IFNob3cgU3RhdGUKPiAKPiBUaGVyZSBpcyBub3RoaW5nIGFtZGdwdSBy ZWxhdGVkIGluIHRoZXJlIGV4Y2VwdCBmb3Igd2FpdGluZyBmb3IgdGhlCj4gaGFyZHdhcmUuCgpZ ZWFoLCBidXQgdGhlcmUncyBhbHNvIG5vIG90aGVyIGRyaXZlciB0aGF0IGNvdWxkIGNhdXNlIGEg c3R1Y2sgZG1hX2ZlbmNlLApzbyB3aHkgaXMgcmVzZXQgbm90IGNsZWFuaW5nIHVwIHRoZSBtZXNz IGhlcmU/IElycmVzcGVjdGl2ZSBvZiB3aHkgdGhlIGdwdQppcyBzdHVjaywgdGhlIGtlcm5lbCBz aG91bGQgYXQgbGVhc3QgY29tcGxldGUgYWxsIHRoZSBkbWFfZmVuY2VzIGV2ZW4gaWYKdGhlIGdw dSBmb3Igc29tZSByZWFzb24gaXMgdGVybWluYWxseSBpbGwgLi4uCi1EYW5pZWwKCj4gVGhpcyBp cyBhIHByZXR0eSBzdGFuZGFyZCBoYXJkd2FyZSBsb2NrdXAsIGJ1dCBJJ20gc3RpbGwgd2FpdGlu ZyBmb3IgYW4KPiBleHBsYW5hdGlvbiB3aHkgd2UgZW5kIHVwIGluIHRoaXMgY2FsbCBwYXRoIGlu IHRoZSBmaXJzdCBwbGFjZS4KPiAKPiBDaHJpc3RpYW4uCj4gCj4gPiAKPiA+IAo+ID4gPiA+ID4g Q2hyaXN0aWFuLgo+ID4gPiA+ID4gCj4gPiA+ID4gPiA+IC1EYW5pZWwKPiA+ID4gPiA+ID4gCj4g PiA+ID4gPiA+ID4gV2hpY2ggT3BlbkNsIHN0YWNrIGFyZSB5b3UgdXNpbmc/Cj4gPiA+ID4gPiA+ ID4gCj4gPiA+ID4gPiA+ID4gUmVnYXJkcywKPiA+ID4gPiA+ID4gPiBDaHJpc3RpYW4uCj4gPiA+ ID4gPiA+ID4gCj4gPiA+ID4gPiA+ID4gQW0gMDMuMDIuMjEgdW0gMDk6MzMgc2NocmllYiBEYW5p ZWwgR29tZXo6Cj4gPiA+ID4gPiA+ID4gPiBIaSBhbGwsCj4gPiA+ID4gPiA+ID4gPiAKPiA+ID4g PiA+ID4gPiA+IEkgaGF2ZSBhIGRlYWRsb2NrIHdpdGggdGhlIGFtZGdwdSBtYWlubGluZSBkcml2 ZXIgd2hlbiBydW5uaW5nIGluIHBhcmFsbGVsIHR3bwo+ID4gPiA+ID4gPiA+ID4gT3BlbkNMIGFw cGxpY2F0aW9ucy4gU28gZmFyLCB3ZSd2ZSBiZWVuIGFibGUgdG8gcmVwbGljYXRlIGl0IGVhc2ls eSBieSBleGVjdXRpbmcKPiA+ID4gPiA+ID4gPiA+IGNsaW5mbyBhbmQgTWF0cml4TXVsdGlwbGlj YXRpb24gKGZyb20gQU1EIG9wZW5jbC1zYW1wbGVzKS4gSXQncyBxdWl0ZSBvbGQgdGhlCj4gPiA+ ID4gPiA+ID4gPiBvcGVuY2wtc2FtcGxlcyBzbywgaWYgeW91IGhhdmUgYW55IG90aGVyIHN1Z2dl c3Rpb24gZm9yIHRlc3RpbmcgSSdkIGJlIHZlcnkKPiA+ID4gPiA+ID4gPiA+IGhhcHB5IHRvIHRl c3QgaXQgYXMgd2VsbC4KPiA+ID4gPiA+ID4gPiA+IAo+ID4gPiA+ID4gPiA+ID4gSG93IHRvIHJl cGxpY2F0ZSB0aGUgaXNzdWU6Cj4gPiA+ID4gPiA+ID4gPiAKPiA+ID4gPiA+ID4gPiA+ICMgd2hp bGUgdHJ1ZTsgZG8gL3Vzci9iaW4vTWF0cml4TXVsdGlwbGljYXRpb24gLS1kZXZpY2UgZ3B1IFwK PiA+ID4gPiA+ID4gPiA+ICAgICAgICAtLWRldmljZUlkIDAgLXggMTAwMCAteSAxMDAwIC16IDEw MDAgLXEgLXQgLWkgNTA7IGRvbmUKPiA+ID4gPiA+ID4gPiA+ICMgd2hpbGUgdHJ1ZTsgZG8gY2xp bmZvOyBkb25lCj4gPiA+ID4gPiA+ID4gPiAKPiA+ID4gPiA+ID4gPiA+IE91dHB1dDoKPiA+ID4g PiA+ID4gPiA+IAo+ID4gPiA+ID4gPiA+ID4gQWZ0ZXIgYSBtaW51dGUgb3IgbGVzcyAoc29tZXRp bWVzIGNvdWxkIGJlIG1vcmUpIEkgY2FuIHNlZSB0aGF0Cj4gPiA+ID4gPiA+ID4gPiBNYXRyaXhN dWx0aXBsaWNhdGlvbiBhbmQgY2xpbmZvIGhhbmcuIEluIGFkZGl0aW9uLCB3aXRoIHJhZGVvbnRv cCB5b3UgY2FuIHNlZQo+ID4gPiA+ID4gPiA+ID4gaG93IHRoZSBHcmFwaGljcyBwaXBlIGdvZXMg ZnJvbSB+NTAlIHRvIDEwMCUuIEFsc28gdGhlIHNoYWRlciBjbG9ja3MKPiA+ID4gPiA+ID4gPiA+ IGdvZXMgdXAgZnJvbSB+MzUlIHRvIH45NiUuCj4gPiA+ID4gPiA+ID4gPiAKPiA+ID4gPiA+ID4g PiA+IGNsaW5mbyBrZWVwcyBwcmludGluZzoKPiA+ID4gPiA+ID4gPiA+IGlvY3RsKDcsIERSTV9J T0NUTF9TWU5DT0JKX1dBSVQsIDB4N2ZmZTQ2ZTVmOTUwKSA9IC0xIEVUSU1FIChUaW1lciBleHBp cmVkKQo+ID4gPiA+ID4gPiA+ID4gCj4gPiA+ID4gPiA+ID4gPiBBbmQgTWF0cml4TXVsdGlwbGlj YXRpb24gcHJpbnRzIHRoZSBmb2xsb3dpbmcgKHN0cmFjZSkgaWYgeW91IHRyeSB0bwo+ID4gPiA+ ID4gPiA+ID4ga2lsbCB0aGUgcHJvY2VzczoKPiA+ID4gPiA+ID4gPiA+IAo+ID4gPiA+ID4gPiA+ ID4gc2NoZWRfeWllbGQoKSAgICAgICAgICAgICAgICAgICAgICAgICAgID0gMAo+ID4gPiA+ID4g PiA+ID4gZnV0ZXgoMHg1NTdlOTQ1MzQzYjgsIEZVVEVYX1dBSVRfQklUU0VUX1BSSVZBVEV8RlVU RVhfQ0xPQ0tfUkVBTFRJTUUsIDAsCj4gPiA+ID4gPiA+ID4gPiBOVUxMLCBGVVRFWF9CSVRTRVRf TUFUQ0hfQU5Zc3RyYWNlOiBQcm9jZXNzIDY1MSBkZXRhY2hlZAo+ID4gPiA+ID4gPiA+ID4gICAg IDxkZXRhY2hlZCAuLi4+Cj4gPiA+ID4gPiA+ID4gPiAKPiA+ID4gPiA+ID4gPiA+IEFmdGVyIHRo aXMsIHRoZSBncHUgaXMgbm90IGZ1bmN0aW9uYWwgYXQgYWxsIGFuZCB5b3UnZCBuZWVkIGEgcG93 ZXIgY3ljbGUgcmVzZXQKPiA+ID4gPiA+ID4gPiA+IHRvIHJlc3RvcmUgdGhlIHN5c3RlbS4KPiA+ ID4gPiA+ID4gPiA+IAo+ID4gPiA+ID4gPiA+ID4gSGFyZHdhcmUgaW5mbzoKPiA+ID4gPiA+ID4g PiA+IENQVTogQU1EIFJ5emVuIEVtYmVkZGVkIFYxNjA1QiB3aXRoIFJhZGVvbiBWZWdhIEdmeCAo OCkgQCAyLjAwMEdIego+ID4gPiA+ID4gPiA+ID4gR1BVOiBBTUQgQVRJIFJhZGVvbiBWZWdhIFNl cmllcyAvIFJhZGVvbiBWZWdhIE1vYmlsZSBTZXJpZXMKPiA+ID4gPiA+ID4gPiA+IAo+ID4gPiA+ ID4gPiA+ID4gMDM6MDAuMCBWR0EgY29tcGF0aWJsZSBjb250cm9sbGVyOiBBZHZhbmNlZCBNaWNy byBEZXZpY2VzLCBJbmMuCj4gPiA+ID4gPiA+ID4gPiBbQU1EL0FUSV0gUmF2ZW4gUmlkZ2UgW1Jh ZGVvbiBWZWdhIFNlcmllcyAvIFJhZGVvbiBWZWdhIE1vYmlsZSBTZXJpZXNdCj4gPiA+ID4gPiA+ ID4gPiAocmV2IDgzKQo+ID4gPiA+ID4gPiA+ID4gICAgICAgIERldmljZU5hbWU6IEJyb2FkY29t IDU3NjIKPiA+ID4gPiA+ID4gPiA+ICAgICAgICBTdWJzeXN0ZW06IEFkdmFuY2VkIE1pY3JvIERl dmljZXMsIEluYy4gW0FNRC9BVEldIFJhdmVuIFJpZGdlCj4gPiA+ID4gPiA+ID4gPiBbUmFkZW9u IFZlZ2EgU2VyaWVzIC8gUmFkZW9uIFZlZ2EgTW9iaWxlIFNlcmllc10KPiA+ID4gPiA+ID4gPiA+ ICAgICAgICBLZXJuZWwgZHJpdmVyIGluIHVzZTogYW1kZ3B1Cj4gPiA+ID4gPiA+ID4gPiAgICAg ICAgS2VybmVsIG1vZHVsZXM6IGFtZGdwdQo+ID4gPiA+ID4gPiA+ID4gCj4gPiA+ID4gPiA+ID4g PiBMaW51eCBrZXJuZWwgaW5mbzoKPiA+ID4gPiA+ID4gPiA+IAo+ID4gPiA+ID4gPiA+ID4gcm9v dEBxdDUyMjI6fiMgdW5hbWUgLWEKPiA+ID4gPiA+ID4gPiA+IExpbnV4IHF0NTIyMiA1LjExLjAt cmM2LXF0ZWMtc3RhbmRhcmQgIzIgU01QIFR1ZSBGZWIgMiAwOTo0MTo0NiBVVEMKPiA+ID4gPiA+ ID4gPiA+IDIwMjEgeDg2XzY0IHg4Nl82NCB4ODZfNjQgR05VL0xpbnV4Cj4gPiA+ID4gPiA+ID4g PiAKPiA+ID4gPiA+ID4gPiA+IEJ5IGVuYWJsaW5nIHRoZSBrZXJuZWwgbG9ja3Mgc3RhdHMgSSBj b3VsZCBzZWUgdGhlIE1hdHJpeE11bHRpcGxpY2F0aW9uIGlzCj4gPiA+ID4gPiA+ID4gPiBoYW5n ZWQgaW4gdGhlIGFtZGdwdV9tbl9pbnZhbGlkYXRlX2dmeCBmdW5jdGlvbjoKPiA+ID4gPiA+ID4g PiA+IAo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4LjM1OTIwMl0gMSBsb2NrIGhlbGQgYnkgTWF0cml4 TXVsdGlwbGljLzY1MzoKPiA+ID4gPiA+ID4gPiA+IFsgIDczOC4zNTkyMDZdICAjMDogZmZmZjg4 ODEwZTM2NGZlMAo+ID4gPiA+ID4gPiA+ID4gKCZhZGV2LT5ub3RpZmllcl9sb2NrKXsrLisufS17 MzozfSwgYXQ6Cj4gPiA+ID4gPiA+ID4gPiBhbWRncHVfbW5faW52YWxpZGF0ZV9nZngrMHgzNC8w eGEwIFthbWRncHVdCj4gPiA+ID4gPiA+ID4gPiAKPiA+ID4gPiA+ID4gPiA+IEkgY2FuIHNlZSBp biB0aGUgdGhlIGFtZGdwdV9tbl9pbnZhbGlkYXRlX2dmeCBmdW5jdGlvbjogdGhlCj4gPiA+ID4g PiA+ID4gPiBkbWFfcmVzdl93YWl0X3RpbWVvdXRfcmN1IHVzZXMgd2FpdF9hbGwgKGZlbmNlcykg YW5kIE1BWF9TQ0hFRFVMRV9USU1FT1VUIHNvLCBJCj4gPiA+ID4gPiA+ID4gPiBndWVzcyB0aGUg Y29kZSBnZXRzIHN0dWNrIHRoZXJlIHdhaXRpbmcgZm9yZXZlci4gQWNjb3JkaW5nIHRvIHRoZQo+ ID4gPiA+ID4gPiA+ID4gZG9jdW1lbnRhdGlvbjogIldoZW4gc29tZWJvZHkgdHJpZXMgdG8gaW52 YWxpZGF0ZSB0aGUgcGFnZSB0YWJsZXMgd2UgYmxvY2sgdGhlCj4gPiA+ID4gPiA+ID4gPiB1cGRh dGUgdW50aWwgYWxsIG9wZXJhdGlvbnMgb24gdGhlIHBhZ2VzIGluIHF1ZXN0aW9uIGFyZSBjb21w bGV0ZWQsIHRoZW4gdGhvc2UKPiA+ID4gPiA+ID4gPiA+IHBhZ2VzIGFyZSBtYXJrZWQgIGFzIGFj Y2Vzc2VkIGFuZCBhbHNvIGRpcnR5IGlmIGl0IHdhc27igJl0IGEgcmVhZCBvbmx5IGFjY2Vzcy4i Cj4gPiA+ID4gPiA+ID4gPiBMb29rcyBsaWtlIHRoZSBmZW5jZXMgYXJlIGRlYWRsb2NrZWQgYW5k IHRoZXJlZm9yZSwgaXQgbmV2ZXIgcmV0dXJucy4gQ291bGQgaXQKPiA+ID4gPiA+ID4gPiA+IGJl IHBvc3NpYmxlPyBhbnkgaGludCB0byB3aGVyZSBjYW4gSSBsb29rIHRvIGZpeCB0aGlzPwo+ID4g PiA+ID4gPiA+ID4gCj4gPiA+ID4gPiA+ID4gPiBUaGFuayB5b3UgIGluIGFkdmFuY2UuCj4gPiA+ ID4gPiA+ID4gPiAKPiA+ID4gPiA+ID4gPiA+IEhlcmUgdGhlIGZ1bGwgZG1lc2cgb3V0cHV0Ogo+ ID4gPiA+ID4gPiA+ID4gCj4gPiA+ID4gPiA+ID4gPiBbICA3MzguMzM3NzI2XSBJTkZPOiB0YXNr IE1hdHJpeE11bHRpcGxpYzo2NTMgYmxvY2tlZCBmb3IgbW9yZSB0aGFuIDEyMiBzZWNvbmRzLgo+ ID4gPiA+ID4gPiA+ID4gWyAgNzM4LjM0NDkzN10gICAgICAgTm90IHRhaW50ZWQgNS4xMS4wLXJj Ni1xdGVjLXN0YW5kYXJkICMyCj4gPiA+ID4gPiA+ID4gPiBbICA3MzguMzUwMzg0XSAiZWNobyAw ID4gL3Byb2Mvc3lzL2tlcm5lbC9odW5nX3Rhc2tfdGltZW91dF9zZWNzIgo+ID4gPiA+ID4gPiA+ ID4gZGlzYWJsZXMgdGhpcyBtZXNzYWdlLgo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4LjM1ODI0MF0g dGFzazpNYXRyaXhNdWx0aXBsaWMgc3RhdGU6RCBzdGFjazogICAgMCBwaWQ6ICA2NTMKPiA+ID4g PiA+ID4gPiA+IHBwaWQ6ICAgICAxIGZsYWdzOjB4MDAwMDQwMDAKPiA+ID4gPiA+ID4gPiA+IFsg IDczOC4zNTgyNTRdIENhbGwgVHJhY2U6Cj4gPiA+ID4gPiA+ID4gPiBbICA3MzguMzU4MjYxXSAg PyBkbWFfZmVuY2VfZGVmYXVsdF93YWl0KzB4MWViLzB4MjMwCj4gPiA+ID4gPiA+ID4gPiBbICA3 MzguMzU4Mjc2XSAgX19zY2hlZHVsZSsweDM3MC8weDk2MAo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4 LjM1ODI5MV0gID8gZG1hX2ZlbmNlX2RlZmF1bHRfd2FpdCsweDExNy8weDIzMAo+ID4gPiA+ID4g PiA+ID4gWyAgNzM4LjM1ODI5N10gID8gZG1hX2ZlbmNlX2RlZmF1bHRfd2FpdCsweDFlYi8weDIz MAo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4LjM1ODMwNV0gIHNjaGVkdWxlKzB4NTEvMHhjMAo+ID4g PiA+ID4gPiA+ID4gWyAgNzM4LjM1ODMxMl0gIHNjaGVkdWxlX3RpbWVvdXQrMHgyNzUvMHgzODAK PiA+ID4gPiA+ID4gPiA+IFsgIDczOC4zNTgzMjRdICA/IGRtYV9mZW5jZV9kZWZhdWx0X3dhaXQr MHgxZWIvMHgyMzAKPiA+ID4gPiA+ID4gPiA+IFsgIDczOC4zNTgzMzJdICA/IG1hcmtfaGVsZF9s b2NrcysweDRmLzB4NzAKPiA+ID4gPiA+ID4gPiA+IFsgIDczOC4zNTgzNDFdICA/IGRtYV9mZW5j ZV9kZWZhdWx0X3dhaXQrMHgxMTcvMHgyMzAKPiA+ID4gPiA+ID4gPiA+IFsgIDczOC4zNTgzNDdd ICA/IGxvY2tkZXBfaGFyZGlycXNfb25fcHJlcGFyZSsweGQ0LzB4MTgwCj4gPiA+ID4gPiA+ID4g PiBbICA3MzguMzU4MzUzXSAgPyBfcmF3X3NwaW5fdW5sb2NrX2lycXJlc3RvcmUrMHgzOS8weDQw Cj4gPiA+ID4gPiA+ID4gPiBbICA3MzguMzU4MzYyXSAgPyBkbWFfZmVuY2VfZGVmYXVsdF93YWl0 KzB4MTE3LzB4MjMwCj4gPiA+ID4gPiA+ID4gPiBbICA3MzguMzU4MzcwXSAgPyBkbWFfZmVuY2Vf ZGVmYXVsdF93YWl0KzB4MWViLzB4MjMwCj4gPiA+ID4gPiA+ID4gPiBbICA3MzguMzU4Mzc1XSAg ZG1hX2ZlbmNlX2RlZmF1bHRfd2FpdCsweDIxNC8weDIzMAo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4 LjM1ODM4NF0gID8gZG1hX2ZlbmNlX3JlbGVhc2UrMHgxYTAvMHgxYTAKPiA+ID4gPiA+ID4gPiA+ IFsgIDczOC4zNTgzOTZdICBkbWFfZmVuY2Vfd2FpdF90aW1lb3V0KzB4MTA1LzB4MjAwCj4gPiA+ ID4gPiA+ID4gPiBbICA3MzguMzU4NDA1XSAgZG1hX3Jlc3Zfd2FpdF90aW1lb3V0X3JjdSsweDFh YS8weDVlMAo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4LjM1ODQyMV0gIGFtZGdwdV9tbl9pbnZhbGlk YXRlX2dmeCsweDU1LzB4YTAgW2FtZGdwdV0KPiA+ID4gPiA+ID4gPiA+IFsgIDczOC4zNTg2ODhd ICBfX21tdV9ub3RpZmllcl9yZWxlYXNlKzB4MWJiLzB4MjEwCj4gPiA+ID4gPiA+ID4gPiBbICA3 MzguMzU4NzEwXSAgZXhpdF9tbWFwKzB4MmYvMHgxZTAKPiA+ID4gPiA+ID4gPiA+IFsgIDczOC4z NTg3MjNdICA/IGZpbmRfaGVsZF9sb2NrKzB4MzQvMHhhMAo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4 LjM1ODc0Nl0gIG1tcHV0KzB4MzkvMHhlMAo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4LjM1ODc1Nl0g IGRvX2V4aXQrMHg1YzMvMHhjMDAKPiA+ID4gPiA+ID4gPiA+IFsgIDczOC4zNTg3NjNdICA/IGZp bmRfaGVsZF9sb2NrKzB4MzQvMHhhMAo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4LjM1ODc4MF0gIGRv X2dyb3VwX2V4aXQrMHg0Ny8weGIwCj4gPiA+ID4gPiA+ID4gPiBbICA3MzguMzU4NzkxXSAgZ2V0 X3NpZ25hbCsweDE1Yi8weGM1MAo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4LjM1ODgwN10gIGFyY2hf ZG9fc2lnbmFsX29yX3Jlc3RhcnQrMHhhZi8weDcxMAo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4LjM1 ODgxNl0gID8gbG9ja2RlcF9oYXJkaXJxc19vbl9wcmVwYXJlKzB4ZDQvMHgxODAKPiA+ID4gPiA+ ID4gPiA+IFsgIDczOC4zNTg4MjJdICA/IF9yYXdfc3Bpbl91bmxvY2tfaXJxcmVzdG9yZSsweDM5 LzB4NDAKPiA+ID4gPiA+ID4gPiA+IFsgIDczOC4zNTg4MzFdICA/IGt0aW1lX2dldF9tb25vX2Zh c3RfbnMrMHg1MC8weGEwCj4gPiA+ID4gPiA+ID4gPiBbICA3MzguMzU4ODQ0XSAgPyBhbWRncHVf ZHJtX2lvY3RsKzB4NmIvMHg4MCBbYW1kZ3B1XQo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4LjM1OTA0 NF0gIGV4aXRfdG9fdXNlcl9tb2RlX3ByZXBhcmUrMHhmMi8weDFiMAo+ID4gPiA+ID4gPiA+ID4g WyAgNzM4LjM1OTA1NF0gIHN5c2NhbGxfZXhpdF90b191c2VyX21vZGUrMHgxOS8weDYwCj4gPiA+ ID4gPiA+ID4gPiBbICA3MzguMzU5MDYyXSAgZW50cnlfU1lTQ0FMTF82NF9hZnRlcl9od2ZyYW1l KzB4NDQvMHhhOQo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4LjM1OTA2OV0gUklQOiAwMDMzOjB4N2Y2 Yjg5YTUxODg3Cj4gPiA+ID4gPiA+ID4gPiBbICA3MzguMzU5MDc2XSBSU1A6IDAwMmI6MDAwMDdm NmI4MmI1NGIxOCBFRkxBR1M6IDAwMDAwMjQ2IE9SSUdfUkFYOgo+ID4gPiA+ID4gPiA+ID4gMDAw MDAwMDAwMDAwMDAxMAo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4LjM1OTA4Nl0gUkFYOiBmZmZmZmZm ZmZmZmZmZTAwIFJCWDogMDAwMDdmNmI4MmI1NGI1MCBSQ1g6IDAwMDA3ZjZiODlhNTE4ODcKPiA+ ID4gPiA+ID4gPiA+IFsgIDczOC4zNTkwOTFdIFJEWDogMDAwMDdmNmI4MmI1NGI1MCBSU0k6IDAw MDAwMDAwYzAyMDY0YzMgUkRJOiAwMDAwMDAwMDAwMDAwMDA3Cj4gPiA+ID4gPiA+ID4gPiBbICA3 MzguMzU5MDk2XSBSQlA6IDAwMDAwMDAwYzAyMDY0YzMgUjA4OiAwMDAwMDAwMDAwMDAwMDAzIFIw OTogMDAwMDdmNmI4MmI1NGJiYwo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4LjM1OTEwMV0gUjEwOiAw MDAwMDAwMDAwMDAwMDAxIFIxMTogMDAwMDAwMDAwMDAwMDI0NiBSMTI6IDAwMDAwMDAxNjVhMGJj MDAKPiA+ID4gPiA+ID4gPiA+IFsgIDczOC4zNTkxMDZdIFIxMzogMDAwMDAwMDAwMDAwMDAwNyBS MTQ6IDAwMDAwMDAwMDAwMDAwMDEgUjE1OiAwMDAwMDAwMDAwMDAwMDAwCj4gPiA+ID4gPiA+ID4g PiBbICA3MzguMzU5MTI5XQo+ID4gPiA+ID4gPiA+ID4gICAgICAgICAgICAgICAgICAgU2hvd2lu ZyBhbGwgbG9ja3MgaGVsZCBpbiB0aGUgc3lzdGVtOgo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4LjM1 OTE0MV0gMSBsb2NrIGhlbGQgYnkga2h1bmd0YXNrZC81NDoKPiA+ID4gPiA+ID4gPiA+IFsgIDcz OC4zNTkxNDhdICAjMDogZmZmZmZmZmY4MjlmNjg0MCAocmN1X3JlYWRfbG9jayl7Li4uLn0tezE6 Mn0sIGF0Ogo+ID4gPiA+ID4gPiA+ID4gZGVidWdfc2hvd19hbGxfbG9ja3MrMHgxNS8weDE4Mwo+ ID4gPiA+ID4gPiA+ID4gWyAgNzM4LjM1OTE4N10gMSBsb2NrIGhlbGQgYnkgc3lzdGVtZC1qb3Vy bmFsLzE3NDoKPiA+ID4gPiA+ID4gPiA+IFsgIDczOC4zNTkyMDJdIDEgbG9jayBoZWxkIGJ5IE1h dHJpeE11bHRpcGxpYy82NTM6Cj4gPiA+ID4gPiA+ID4gPiBbICA3MzguMzU5MjA2XSAgIzA6IGZm ZmY4ODgxMGUzNjRmZTAKPiA+ID4gPiA+ID4gPiA+ICgmYWRldi0+bm90aWZpZXJfbG9jayl7Ky4r Ln0tezM6M30sIGF0Ogo+ID4gPiA+ID4gPiA+ID4gYW1kZ3B1X21uX2ludmFsaWRhdGVfZ2Z4KzB4 MzQvMHhhMCBbYW1kZ3B1XQo+ID4gPiA+ID4gPiA+ID4gCj4gPiA+ID4gPiA+ID4gPiBEYW5pZWwK PiA+ID4gPiA+ID4gPiBfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fXwo+ID4gPiA+ID4gPiA+IGRyaS1kZXZlbCBtYWlsaW5nIGxpc3QKPiA+ID4gPiA+ID4gPiBk cmktZGV2ZWxAbGlzdHMuZnJlZWRlc2t0b3Aub3JnCj4gPiA+ID4gPiA+ID4gaHR0cHM6Ly9uYW0x MS5zYWZlbGlua3MucHJvdGVjdGlvbi5vdXRsb29rLmNvbS8/dXJsPWh0dHBzJTNBJTJGJTJGbGlz dHMuZnJlZWRlc2t0b3Aub3JnJTJGbWFpbG1hbiUyRmxpc3RpbmZvJTJGZHJpLWRldmVsJmFtcDtk YXRhPTA0JTdDMDElN0NjaHJpc3RpYW4ua29lbmlnJTQwYW1kLmNvbSU3QzgxMjAzZTViYWM1ODQx YjhlNWExMDhkOGM4MjA4N2E5JTdDM2RkODk2MWZlNDg4NGU2MDhlMTFhODJkOTk0ZTE4M2QlN0Mw JTdDMCU3QzYzNzQ3OTM4OTMzOTI5NTYyMiU3Q1Vua25vd24lN0NUV0ZwYkdac2IzZDhleUpXSWpv aU1DNHdMakF3TURBaUxDSlFJam9pVjJsdU16SWlMQ0pCVGlJNklrMWhhV3dpTENKWFZDSTZNbjAl M0QlN0MxMDAwJmFtcDtzZGF0YT1SRFN4RDZPcUQ4SGFPQTJWbk5mYkp3TG5LemhDTGdPcjVTVkxq TEY5MWJBJTNEJmFtcDtyZXNlcnZlZD0wCj4gPiA+ID4gPiA+IAo+ID4gPiA+IAo+ID4gPiA+IC0t Cj4gPiA+ID4gRGFuaWVsIFZldHRlcgo+ID4gPiA+IFNvZnR3YXJlIEVuZ2luZWVyLCBJbnRlbCBD b3Jwb3JhdGlvbgo+ID4gPiA+IGh0dHA6Ly9ibG9nLmZmd2xsLmNoCj4gPiBfX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwo+ID4gYW1kLWdmeCBtYWlsaW5nIGxp c3QKPiA+IGFtZC1nZnhAbGlzdHMuZnJlZWRlc2t0b3Aub3JnCj4gPiBodHRwczovL2xpc3RzLmZy ZWVkZXNrdG9wLm9yZy9tYWlsbWFuL2xpc3RpbmZvL2FtZC1nZngKPiAKCi0tIApEYW5pZWwgVmV0 dGVyClNvZnR3YXJlIEVuZ2luZWVyLCBJbnRlbCBDb3Jwb3JhdGlvbgpodHRwOi8vYmxvZy5mZnds bC5jaApfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwphbWQt Z2Z4IG1haWxpbmcgbGlzdAphbWQtZ2Z4QGxpc3RzLmZyZWVkZXNrdG9wLm9yZwpodHRwczovL2xp c3RzLmZyZWVkZXNrdG9wLm9yZy9tYWlsbWFuL2xpc3RpbmZvL2FtZC1nZngK From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-3.5 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE, SPF_PASS,URIBL_BLOCKED autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 1888DC433E0 for ; Wed, 3 Feb 2021 12:24:49 +0000 (UTC) Received: from gabe.freedesktop.org (gabe.freedesktop.org [131.252.210.177]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 4D18D64F95 for ; Wed, 3 Feb 2021 12:24:48 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 4D18D64F95 Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=ffwll.ch Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=dri-devel-bounces@lists.freedesktop.org Received: from gabe.freedesktop.org (localhost [127.0.0.1]) by gabe.freedesktop.org (Postfix) with ESMTP id 2B1FC6EA68; Wed, 3 Feb 2021 12:24:47 +0000 (UTC) Received: from mail-wm1-x32d.google.com (mail-wm1-x32d.google.com [IPv6:2a00:1450:4864:20::32d]) by gabe.freedesktop.org (Postfix) with ESMTPS id 245C36EA8D for ; Wed, 3 Feb 2021 12:24:46 +0000 (UTC) Received: by mail-wm1-x32d.google.com with SMTP id l12so4236710wmq.2 for ; Wed, 03 Feb 2021 04:24:46 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ffwll.ch; s=google; h=date:from:to:cc:subject:message-id:mail-followup-to:references :mime-version:content-disposition:content-transfer-encoding :in-reply-to; bh=m/NA4XNIrCQYNebCKt931IdDV/rzSFumSCUH9F33px4=; b=ZRA0TVyu4fRxmUS1RmK6WHKfbnpAv8v9d+qtiFMBD2IMSSfd8urMqqHC95oam0EQlS YxqzZFFmMHv0SPV1aHNYeH4b8OqGEH2/o0HSixyFNS/mtm5SitgA1QMRAXq1lH3Z3M7i r/xCYBSLA8EQ8csv35OC5wluVAbmODcTD17G4= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id :mail-followup-to:references:mime-version:content-disposition :content-transfer-encoding:in-reply-to; bh=m/NA4XNIrCQYNebCKt931IdDV/rzSFumSCUH9F33px4=; b=a0Tfs9nh+MOQbo8xAyPBAMBX6yOjQnZJ/QgsgnUNYNDTX8HItT8DiNleZqDgnFbXg6 nUcqSn3mMf5gRvqSx62EvO/bTsf2x0OHt5/mcq0EGHDki0PMBXldV3hiDzcNMLUOVRZb +hF+AEKKVlFc/RAEPpqh9+/cnII9ZIeuCqtUyMiojqLoi9L3gXkTJHyqYwcFavbwQnvU w9+tIJyEFZdwA8pFD/wTtVI5ttr5g3bQHX+ALHus8jAc8114nPnX2IFHEzolN7uE6+eo hQi6yoYFpUwh7uyaxBAf+k9RrnSZZOfZKXc0qhtoq1wUl5AW7Uis5FLEEVb8x6MWmW01 Kuew== X-Gm-Message-State: AOAM5323ZBBV+TUfHjCaH+Sn/c+Au9gmaGYXjUTFYPBxG65B/vN9+ZgU SIDmo7gyOL/t+GIaxveIBM5/yA== X-Google-Smtp-Source: ABdhPJyVy0zQu6h3nSD6wAbF9bgQ1VdIhgwWSIQlKTCZZyiOuBEn8EE8tvHk8fS3yPow6235vprjjA== X-Received: by 2002:a05:600c:4148:: with SMTP id h8mr2576404wmm.137.1612355084657; Wed, 03 Feb 2021 04:24:44 -0800 (PST) Received: from phenom.ffwll.local ([2a02:168:57f4:0:efd0:b9e5:5ae6:c2fa]) by smtp.gmail.com with ESMTPSA id e16sm3547170wrp.24.2021.02.03.04.24.43 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 03 Feb 2021 04:24:43 -0800 (PST) Date: Wed, 3 Feb 2021 13:24:42 +0100 From: Daniel Vetter To: christian.koenig@amd.com Subject: Re: [amdgpu] deadlock Message-ID: Mail-Followup-To: christian.koenig@amd.com, Daniel Gomez , Alex Deucher , dri-devel , amd-gfx list , Linux Kernel Mailing List References: <58e41b62-b8e0-b036-c87d-a84d53f5a26e@amd.com> <538682ee-3e12-a345-2205-2c0f16b496ff@gmail.com> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <538682ee-3e12-a345-2205-2c0f16b496ff@gmail.com> X-Operating-System: Linux phenom 5.7.0-1-amd64 X-BeenThere: dri-devel@lists.freedesktop.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Direct Rendering Infrastructure - Development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Linux Kernel Mailing List , amd-gfx list , dri-devel , Alex Deucher , Daniel Gomez Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Errors-To: dri-devel-bounces@lists.freedesktop.org Sender: "dri-devel" T24gV2VkLCBGZWIgMDMsIDIwMjEgYXQgMDE6MjE6MjBQTSArMDEwMCwgQ2hyaXN0aWFuIEvDtm5p ZyB3cm90ZToKPiBBbSAwMy4wMi4yMSB1bSAxMjo0NSBzY2hyaWViIERhbmllbCBHb21lejoKPiA+ IE9uIFdlZCwgMyBGZWIgMjAyMSBhdCAxMDo0NywgRGFuaWVsIEdvbWV6IDxkYW5pZWxAcXRlYy5j b20+IHdyb3RlOgo+ID4gPiBPbiBXZWQsIDMgRmViIDIwMjEgYXQgMTA6MTcsIERhbmllbCBWZXR0 ZXIgPGRhbmllbEBmZndsbC5jaD4gd3JvdGU6Cj4gPiA+ID4gT24gV2VkLCBGZWIgMywgMjAyMSBh dCA5OjUxIEFNIENocmlzdGlhbiBLw7ZuaWcgPGNocmlzdGlhbi5rb2VuaWdAYW1kLmNvbT4gd3Jv dGU6Cj4gPiA+ID4gPiBBbSAwMy4wMi4yMSB1bSAwOTo0OCBzY2hyaWViIERhbmllbCBWZXR0ZXI6 Cj4gPiA+ID4gPiA+IE9uIFdlZCwgRmViIDMsIDIwMjEgYXQgOTozNiBBTSBDaHJpc3RpYW4gS8O2 bmlnIDxjaHJpc3RpYW4ua29lbmlnQGFtZC5jb20+IHdyb3RlOgo+ID4gPiA+ID4gPiA+IEhpIERh bmllbCwKPiA+ID4gPiA+ID4gPiAKPiA+ID4gPiA+ID4gPiB0aGlzIGlzIG5vdCBhIGRlYWRsb2Nr LCBidXQgcmF0aGVyIGEgaGFyZHdhcmUgbG9ja3VwLgo+ID4gPiA+ID4gPiBBcmUgeW91IHN1cmU/ IEltZSBnZXR0aW5nIHN0dWNrIGluIGRtYV9mZW5jZV93YWl0IGhhcyBnZW5lcmFsbHkgZ29vZAo+ ID4gPiA+ID4gPiBjaGFuY2Ugb2YgYmVpbmcgYSBkbWFfZmVuY2UgZGVhZGxvY2suIEdQVSBoYW5n IHNob3VsZCBuZXZlciByZXN1bHQgaW4KPiA+ID4gPiA+ID4gYSBmb3JldmVyIHN0dWNrIGRtYV9m ZW5jZS4KPiA+ID4gPiA+IFllcywgSSdtIHByZXR0eSBzdXJlLiBPdGhlcndpc2UgdGhlIGhhcmR3 YXJlIGNsb2NrcyB3b3VsZG4ndCBnbyB1cCBsaWtlCj4gPiA+ID4gPiB0aGlzLgo+ID4gPiA+IE1h eWJlIGNsYXJpZnlpbmcsIGNvdWxkIGJlIGJvdGguIFREUiBzaG91bGQgbm90aWNlIGFuZCBnZXQg dXMgb3V0IG9mCj4gPiA+ID4gdGhpcywgYnV0IGlmIHRoZXJlJ3MgYSBkbWFfZmVuY2UgZGVhZGxv Y2sgYW5kIHdlIGNhbid0IHJlLWVtaXQgb3IKPiA+ID4gPiBmb3JjZSBjb21wbGV0ZSB0aGUgcGVu ZGluZyB0aGluZ3MsIHRoZW4gd2UncmUgc3R1Y2sgZm9yIGdvb2QuCj4gPiA+ID4gLURhbmllbAo+ ID4gPiA+IAo+ID4gPiA+ID4gUXVlc3Rpb24gaXMgcmF0aGVyIHdoeSB3ZSBlbmQgdXAgaW4gdGhl IHVzZXJwdHIgaGFuZGxpbmcgZm9yIEdGWD8gT3VyCj4gPiA+ID4gPiBST0NtIE9wZW5DTCBzdGFj ayBzaG91bGRuJ3QgdXNlIHRoaXMuCj4gPiA+ID4gPiAKPiA+ID4gPiA+ID4gRGFuaWVsLCBjYW4g eW91IHBscyByZS1oYW5nIHlvdXIgbWFjaGluZSBhbmQgdGhlbiBkdW1wIGJhY2t0cmFjZXMgb2YK PiA+ID4gPiA+ID4gYWxsIHRhc2tzIGludG8gZG1lc2cgd2l0aCBzeXNycS10LCBhbmQgdGhlbiBh dHRhY2ggdGhhdD8gV2l0aG91dCBhbGwKPiA+ID4gPiA+ID4gdGhlIGJhY2t0cmFjZXMgaXQncyB0 cmlja3kgdG8gY29uc3RydWN0IHRoZSBmdWxsIGRlcGVuZGVuY3kgY2hhaW4gb2YKPiA+ID4gPiA+ ID4gd2hhdCdzIGdvaW5nIG9uLiBBbHNvIGlzIHRoaXMgcGxhaW4gLXJjNiwgbm90IHNvbWUgbW9y ZSBwYXRjaGVzIG9uCj4gPiA+ID4gPiA+IHRvcD8KPiA+ID4gPiA+IFllYWgsIHRoYXQncyBzdGls bCBhIGdvb2QgaWRlYSB0byBoYXZlLgo+ID4gPiBIZXJlIHRoZSBmdWxsIGJhY2t0cmFjZSBkbWVz ZyBsb2dzIGFmdGVyIHRoZSBoYW5nOgo+ID4gPiBodHRwczovL3Bhc3RlYmluLmNvbS9yYXcva3pp dm0yTDMKPiA+ID4gCj4gPiA+IFRoaXMgaXMgYW5vdGhlciBkbWVzZyBsb2cgd2l0aCB0aGUgYmFj a3RyYWNlcyBhZnRlciBTSUdLSUxMIHRoZSBtYXRyaXggcHJvY2VzczoKPiA+ID4gKEkgZGlkbid0 IGhhdmUgdGhlIHN5c3JxIGVuYWJsZSBhdCB0aGUgdGltZSk6Cj4gPiA+IGh0dHBzOi8vcGFzdGVi aW4uY29tL3Jhdy9wUkJ3R2NqMQo+ID4gSSd2ZSBub3cgcmVtb3ZlZCBhbGwgb3VyIHY0bDIgcGF0 Y2hlcyBhbmQgZGlkIHRoZSBzYW1lIHRlc3Qgd2l0aCB0aGUgJ3BsYWluJwo+ID4gbWFpbmxpbmUg dmVyc2lvbiAoLXJjNikuCj4gPiAKPiA+IFJlZmVyZW5jZTogM2FhZjBhMjdmZmMyOWIxOWE2MjMx NGVkZDY4NGI5YmM2MzQ2ZjlhOAo+ID4gCj4gPiBTYW1lIGVycm9yLCBzYW1lIGJlaGF2aW91ci4g RnVsbCBkbWVzZyBsb2cgYXR0YWNoZWQ6Cj4gPiBodHRwczovL3Bhc3RlYmluLmNvbS9yYXcvS2dh RWY3WTEKPiA+IE5vdGU6Cj4gPiAgICBkbWVzZyB3aXRoIHN5c3JxLXQgYmVmb3JlIHJ1bm5pbmcg dGhlIHRlc3Qgc3RhcnRzIGluIFsgIDEyMi4wMTY1MDJdCj4gPiBzeXNycTogU2hvdyBTdGF0ZQo+ ID4gICAgZG1lc2cgd2l0aCBzeXNycS10IGFmdGVyIHRoZSB0ZXN0IHN0YXJ0cyBpbjogWyAgNDk1 LjU4NzY3MV0gc3lzcnE6IFNob3cgU3RhdGUKPiAKPiBUaGVyZSBpcyBub3RoaW5nIGFtZGdwdSBy ZWxhdGVkIGluIHRoZXJlIGV4Y2VwdCBmb3Igd2FpdGluZyBmb3IgdGhlCj4gaGFyZHdhcmUuCgpZ ZWFoLCBidXQgdGhlcmUncyBhbHNvIG5vIG90aGVyIGRyaXZlciB0aGF0IGNvdWxkIGNhdXNlIGEg c3R1Y2sgZG1hX2ZlbmNlLApzbyB3aHkgaXMgcmVzZXQgbm90IGNsZWFuaW5nIHVwIHRoZSBtZXNz IGhlcmU/IElycmVzcGVjdGl2ZSBvZiB3aHkgdGhlIGdwdQppcyBzdHVjaywgdGhlIGtlcm5lbCBz aG91bGQgYXQgbGVhc3QgY29tcGxldGUgYWxsIHRoZSBkbWFfZmVuY2VzIGV2ZW4gaWYKdGhlIGdw dSBmb3Igc29tZSByZWFzb24gaXMgdGVybWluYWxseSBpbGwgLi4uCi1EYW5pZWwKCj4gVGhpcyBp cyBhIHByZXR0eSBzdGFuZGFyZCBoYXJkd2FyZSBsb2NrdXAsIGJ1dCBJJ20gc3RpbGwgd2FpdGlu ZyBmb3IgYW4KPiBleHBsYW5hdGlvbiB3aHkgd2UgZW5kIHVwIGluIHRoaXMgY2FsbCBwYXRoIGlu IHRoZSBmaXJzdCBwbGFjZS4KPiAKPiBDaHJpc3RpYW4uCj4gCj4gPiAKPiA+IAo+ID4gPiA+ID4g Q2hyaXN0aWFuLgo+ID4gPiA+ID4gCj4gPiA+ID4gPiA+IC1EYW5pZWwKPiA+ID4gPiA+ID4gCj4g PiA+ID4gPiA+ID4gV2hpY2ggT3BlbkNsIHN0YWNrIGFyZSB5b3UgdXNpbmc/Cj4gPiA+ID4gPiA+ ID4gCj4gPiA+ID4gPiA+ID4gUmVnYXJkcywKPiA+ID4gPiA+ID4gPiBDaHJpc3RpYW4uCj4gPiA+ ID4gPiA+ID4gCj4gPiA+ID4gPiA+ID4gQW0gMDMuMDIuMjEgdW0gMDk6MzMgc2NocmllYiBEYW5p ZWwgR29tZXo6Cj4gPiA+ID4gPiA+ID4gPiBIaSBhbGwsCj4gPiA+ID4gPiA+ID4gPiAKPiA+ID4g PiA+ID4gPiA+IEkgaGF2ZSBhIGRlYWRsb2NrIHdpdGggdGhlIGFtZGdwdSBtYWlubGluZSBkcml2 ZXIgd2hlbiBydW5uaW5nIGluIHBhcmFsbGVsIHR3bwo+ID4gPiA+ID4gPiA+ID4gT3BlbkNMIGFw cGxpY2F0aW9ucy4gU28gZmFyLCB3ZSd2ZSBiZWVuIGFibGUgdG8gcmVwbGljYXRlIGl0IGVhc2ls eSBieSBleGVjdXRpbmcKPiA+ID4gPiA+ID4gPiA+IGNsaW5mbyBhbmQgTWF0cml4TXVsdGlwbGlj YXRpb24gKGZyb20gQU1EIG9wZW5jbC1zYW1wbGVzKS4gSXQncyBxdWl0ZSBvbGQgdGhlCj4gPiA+ ID4gPiA+ID4gPiBvcGVuY2wtc2FtcGxlcyBzbywgaWYgeW91IGhhdmUgYW55IG90aGVyIHN1Z2dl c3Rpb24gZm9yIHRlc3RpbmcgSSdkIGJlIHZlcnkKPiA+ID4gPiA+ID4gPiA+IGhhcHB5IHRvIHRl c3QgaXQgYXMgd2VsbC4KPiA+ID4gPiA+ID4gPiA+IAo+ID4gPiA+ID4gPiA+ID4gSG93IHRvIHJl cGxpY2F0ZSB0aGUgaXNzdWU6Cj4gPiA+ID4gPiA+ID4gPiAKPiA+ID4gPiA+ID4gPiA+ICMgd2hp bGUgdHJ1ZTsgZG8gL3Vzci9iaW4vTWF0cml4TXVsdGlwbGljYXRpb24gLS1kZXZpY2UgZ3B1IFwK PiA+ID4gPiA+ID4gPiA+ICAgICAgICAtLWRldmljZUlkIDAgLXggMTAwMCAteSAxMDAwIC16IDEw MDAgLXEgLXQgLWkgNTA7IGRvbmUKPiA+ID4gPiA+ID4gPiA+ICMgd2hpbGUgdHJ1ZTsgZG8gY2xp bmZvOyBkb25lCj4gPiA+ID4gPiA+ID4gPiAKPiA+ID4gPiA+ID4gPiA+IE91dHB1dDoKPiA+ID4g PiA+ID4gPiA+IAo+ID4gPiA+ID4gPiA+ID4gQWZ0ZXIgYSBtaW51dGUgb3IgbGVzcyAoc29tZXRp bWVzIGNvdWxkIGJlIG1vcmUpIEkgY2FuIHNlZSB0aGF0Cj4gPiA+ID4gPiA+ID4gPiBNYXRyaXhN dWx0aXBsaWNhdGlvbiBhbmQgY2xpbmZvIGhhbmcuIEluIGFkZGl0aW9uLCB3aXRoIHJhZGVvbnRv cCB5b3UgY2FuIHNlZQo+ID4gPiA+ID4gPiA+ID4gaG93IHRoZSBHcmFwaGljcyBwaXBlIGdvZXMg ZnJvbSB+NTAlIHRvIDEwMCUuIEFsc28gdGhlIHNoYWRlciBjbG9ja3MKPiA+ID4gPiA+ID4gPiA+ IGdvZXMgdXAgZnJvbSB+MzUlIHRvIH45NiUuCj4gPiA+ID4gPiA+ID4gPiAKPiA+ID4gPiA+ID4g PiA+IGNsaW5mbyBrZWVwcyBwcmludGluZzoKPiA+ID4gPiA+ID4gPiA+IGlvY3RsKDcsIERSTV9J T0NUTF9TWU5DT0JKX1dBSVQsIDB4N2ZmZTQ2ZTVmOTUwKSA9IC0xIEVUSU1FIChUaW1lciBleHBp cmVkKQo+ID4gPiA+ID4gPiA+ID4gCj4gPiA+ID4gPiA+ID4gPiBBbmQgTWF0cml4TXVsdGlwbGlj YXRpb24gcHJpbnRzIHRoZSBmb2xsb3dpbmcgKHN0cmFjZSkgaWYgeW91IHRyeSB0bwo+ID4gPiA+ ID4gPiA+ID4ga2lsbCB0aGUgcHJvY2VzczoKPiA+ID4gPiA+ID4gPiA+IAo+ID4gPiA+ID4gPiA+ ID4gc2NoZWRfeWllbGQoKSAgICAgICAgICAgICAgICAgICAgICAgICAgID0gMAo+ID4gPiA+ID4g PiA+ID4gZnV0ZXgoMHg1NTdlOTQ1MzQzYjgsIEZVVEVYX1dBSVRfQklUU0VUX1BSSVZBVEV8RlVU RVhfQ0xPQ0tfUkVBTFRJTUUsIDAsCj4gPiA+ID4gPiA+ID4gPiBOVUxMLCBGVVRFWF9CSVRTRVRf TUFUQ0hfQU5Zc3RyYWNlOiBQcm9jZXNzIDY1MSBkZXRhY2hlZAo+ID4gPiA+ID4gPiA+ID4gICAg IDxkZXRhY2hlZCAuLi4+Cj4gPiA+ID4gPiA+ID4gPiAKPiA+ID4gPiA+ID4gPiA+IEFmdGVyIHRo aXMsIHRoZSBncHUgaXMgbm90IGZ1bmN0aW9uYWwgYXQgYWxsIGFuZCB5b3UnZCBuZWVkIGEgcG93 ZXIgY3ljbGUgcmVzZXQKPiA+ID4gPiA+ID4gPiA+IHRvIHJlc3RvcmUgdGhlIHN5c3RlbS4KPiA+ ID4gPiA+ID4gPiA+IAo+ID4gPiA+ID4gPiA+ID4gSGFyZHdhcmUgaW5mbzoKPiA+ID4gPiA+ID4g PiA+IENQVTogQU1EIFJ5emVuIEVtYmVkZGVkIFYxNjA1QiB3aXRoIFJhZGVvbiBWZWdhIEdmeCAo OCkgQCAyLjAwMEdIego+ID4gPiA+ID4gPiA+ID4gR1BVOiBBTUQgQVRJIFJhZGVvbiBWZWdhIFNl cmllcyAvIFJhZGVvbiBWZWdhIE1vYmlsZSBTZXJpZXMKPiA+ID4gPiA+ID4gPiA+IAo+ID4gPiA+ ID4gPiA+ID4gMDM6MDAuMCBWR0EgY29tcGF0aWJsZSBjb250cm9sbGVyOiBBZHZhbmNlZCBNaWNy byBEZXZpY2VzLCBJbmMuCj4gPiA+ID4gPiA+ID4gPiBbQU1EL0FUSV0gUmF2ZW4gUmlkZ2UgW1Jh ZGVvbiBWZWdhIFNlcmllcyAvIFJhZGVvbiBWZWdhIE1vYmlsZSBTZXJpZXNdCj4gPiA+ID4gPiA+ ID4gPiAocmV2IDgzKQo+ID4gPiA+ID4gPiA+ID4gICAgICAgIERldmljZU5hbWU6IEJyb2FkY29t IDU3NjIKPiA+ID4gPiA+ID4gPiA+ICAgICAgICBTdWJzeXN0ZW06IEFkdmFuY2VkIE1pY3JvIERl dmljZXMsIEluYy4gW0FNRC9BVEldIFJhdmVuIFJpZGdlCj4gPiA+ID4gPiA+ID4gPiBbUmFkZW9u IFZlZ2EgU2VyaWVzIC8gUmFkZW9uIFZlZ2EgTW9iaWxlIFNlcmllc10KPiA+ID4gPiA+ID4gPiA+ ICAgICAgICBLZXJuZWwgZHJpdmVyIGluIHVzZTogYW1kZ3B1Cj4gPiA+ID4gPiA+ID4gPiAgICAg ICAgS2VybmVsIG1vZHVsZXM6IGFtZGdwdQo+ID4gPiA+ID4gPiA+ID4gCj4gPiA+ID4gPiA+ID4g PiBMaW51eCBrZXJuZWwgaW5mbzoKPiA+ID4gPiA+ID4gPiA+IAo+ID4gPiA+ID4gPiA+ID4gcm9v dEBxdDUyMjI6fiMgdW5hbWUgLWEKPiA+ID4gPiA+ID4gPiA+IExpbnV4IHF0NTIyMiA1LjExLjAt cmM2LXF0ZWMtc3RhbmRhcmQgIzIgU01QIFR1ZSBGZWIgMiAwOTo0MTo0NiBVVEMKPiA+ID4gPiA+ ID4gPiA+IDIwMjEgeDg2XzY0IHg4Nl82NCB4ODZfNjQgR05VL0xpbnV4Cj4gPiA+ID4gPiA+ID4g PiAKPiA+ID4gPiA+ID4gPiA+IEJ5IGVuYWJsaW5nIHRoZSBrZXJuZWwgbG9ja3Mgc3RhdHMgSSBj b3VsZCBzZWUgdGhlIE1hdHJpeE11bHRpcGxpY2F0aW9uIGlzCj4gPiA+ID4gPiA+ID4gPiBoYW5n ZWQgaW4gdGhlIGFtZGdwdV9tbl9pbnZhbGlkYXRlX2dmeCBmdW5jdGlvbjoKPiA+ID4gPiA+ID4g PiA+IAo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4LjM1OTIwMl0gMSBsb2NrIGhlbGQgYnkgTWF0cml4 TXVsdGlwbGljLzY1MzoKPiA+ID4gPiA+ID4gPiA+IFsgIDczOC4zNTkyMDZdICAjMDogZmZmZjg4 ODEwZTM2NGZlMAo+ID4gPiA+ID4gPiA+ID4gKCZhZGV2LT5ub3RpZmllcl9sb2NrKXsrLisufS17 MzozfSwgYXQ6Cj4gPiA+ID4gPiA+ID4gPiBhbWRncHVfbW5faW52YWxpZGF0ZV9nZngrMHgzNC8w eGEwIFthbWRncHVdCj4gPiA+ID4gPiA+ID4gPiAKPiA+ID4gPiA+ID4gPiA+IEkgY2FuIHNlZSBp biB0aGUgdGhlIGFtZGdwdV9tbl9pbnZhbGlkYXRlX2dmeCBmdW5jdGlvbjogdGhlCj4gPiA+ID4g PiA+ID4gPiBkbWFfcmVzdl93YWl0X3RpbWVvdXRfcmN1IHVzZXMgd2FpdF9hbGwgKGZlbmNlcykg YW5kIE1BWF9TQ0hFRFVMRV9USU1FT1VUIHNvLCBJCj4gPiA+ID4gPiA+ID4gPiBndWVzcyB0aGUg Y29kZSBnZXRzIHN0dWNrIHRoZXJlIHdhaXRpbmcgZm9yZXZlci4gQWNjb3JkaW5nIHRvIHRoZQo+ ID4gPiA+ID4gPiA+ID4gZG9jdW1lbnRhdGlvbjogIldoZW4gc29tZWJvZHkgdHJpZXMgdG8gaW52 YWxpZGF0ZSB0aGUgcGFnZSB0YWJsZXMgd2UgYmxvY2sgdGhlCj4gPiA+ID4gPiA+ID4gPiB1cGRh dGUgdW50aWwgYWxsIG9wZXJhdGlvbnMgb24gdGhlIHBhZ2VzIGluIHF1ZXN0aW9uIGFyZSBjb21w bGV0ZWQsIHRoZW4gdGhvc2UKPiA+ID4gPiA+ID4gPiA+IHBhZ2VzIGFyZSBtYXJrZWQgIGFzIGFj Y2Vzc2VkIGFuZCBhbHNvIGRpcnR5IGlmIGl0IHdhc27igJl0IGEgcmVhZCBvbmx5IGFjY2Vzcy4i Cj4gPiA+ID4gPiA+ID4gPiBMb29rcyBsaWtlIHRoZSBmZW5jZXMgYXJlIGRlYWRsb2NrZWQgYW5k IHRoZXJlZm9yZSwgaXQgbmV2ZXIgcmV0dXJucy4gQ291bGQgaXQKPiA+ID4gPiA+ID4gPiA+IGJl IHBvc3NpYmxlPyBhbnkgaGludCB0byB3aGVyZSBjYW4gSSBsb29rIHRvIGZpeCB0aGlzPwo+ID4g PiA+ID4gPiA+ID4gCj4gPiA+ID4gPiA+ID4gPiBUaGFuayB5b3UgIGluIGFkdmFuY2UuCj4gPiA+ ID4gPiA+ID4gPiAKPiA+ID4gPiA+ID4gPiA+IEhlcmUgdGhlIGZ1bGwgZG1lc2cgb3V0cHV0Ogo+ ID4gPiA+ID4gPiA+ID4gCj4gPiA+ID4gPiA+ID4gPiBbICA3MzguMzM3NzI2XSBJTkZPOiB0YXNr IE1hdHJpeE11bHRpcGxpYzo2NTMgYmxvY2tlZCBmb3IgbW9yZSB0aGFuIDEyMiBzZWNvbmRzLgo+ ID4gPiA+ID4gPiA+ID4gWyAgNzM4LjM0NDkzN10gICAgICAgTm90IHRhaW50ZWQgNS4xMS4wLXJj Ni1xdGVjLXN0YW5kYXJkICMyCj4gPiA+ID4gPiA+ID4gPiBbICA3MzguMzUwMzg0XSAiZWNobyAw ID4gL3Byb2Mvc3lzL2tlcm5lbC9odW5nX3Rhc2tfdGltZW91dF9zZWNzIgo+ID4gPiA+ID4gPiA+ ID4gZGlzYWJsZXMgdGhpcyBtZXNzYWdlLgo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4LjM1ODI0MF0g dGFzazpNYXRyaXhNdWx0aXBsaWMgc3RhdGU6RCBzdGFjazogICAgMCBwaWQ6ICA2NTMKPiA+ID4g PiA+ID4gPiA+IHBwaWQ6ICAgICAxIGZsYWdzOjB4MDAwMDQwMDAKPiA+ID4gPiA+ID4gPiA+IFsg IDczOC4zNTgyNTRdIENhbGwgVHJhY2U6Cj4gPiA+ID4gPiA+ID4gPiBbICA3MzguMzU4MjYxXSAg PyBkbWFfZmVuY2VfZGVmYXVsdF93YWl0KzB4MWViLzB4MjMwCj4gPiA+ID4gPiA+ID4gPiBbICA3 MzguMzU4Mjc2XSAgX19zY2hlZHVsZSsweDM3MC8weDk2MAo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4 LjM1ODI5MV0gID8gZG1hX2ZlbmNlX2RlZmF1bHRfd2FpdCsweDExNy8weDIzMAo+ID4gPiA+ID4g PiA+ID4gWyAgNzM4LjM1ODI5N10gID8gZG1hX2ZlbmNlX2RlZmF1bHRfd2FpdCsweDFlYi8weDIz MAo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4LjM1ODMwNV0gIHNjaGVkdWxlKzB4NTEvMHhjMAo+ID4g PiA+ID4gPiA+ID4gWyAgNzM4LjM1ODMxMl0gIHNjaGVkdWxlX3RpbWVvdXQrMHgyNzUvMHgzODAK PiA+ID4gPiA+ID4gPiA+IFsgIDczOC4zNTgzMjRdICA/IGRtYV9mZW5jZV9kZWZhdWx0X3dhaXQr MHgxZWIvMHgyMzAKPiA+ID4gPiA+ID4gPiA+IFsgIDczOC4zNTgzMzJdICA/IG1hcmtfaGVsZF9s b2NrcysweDRmLzB4NzAKPiA+ID4gPiA+ID4gPiA+IFsgIDczOC4zNTgzNDFdICA/IGRtYV9mZW5j ZV9kZWZhdWx0X3dhaXQrMHgxMTcvMHgyMzAKPiA+ID4gPiA+ID4gPiA+IFsgIDczOC4zNTgzNDdd ICA/IGxvY2tkZXBfaGFyZGlycXNfb25fcHJlcGFyZSsweGQ0LzB4MTgwCj4gPiA+ID4gPiA+ID4g PiBbICA3MzguMzU4MzUzXSAgPyBfcmF3X3NwaW5fdW5sb2NrX2lycXJlc3RvcmUrMHgzOS8weDQw Cj4gPiA+ID4gPiA+ID4gPiBbICA3MzguMzU4MzYyXSAgPyBkbWFfZmVuY2VfZGVmYXVsdF93YWl0 KzB4MTE3LzB4MjMwCj4gPiA+ID4gPiA+ID4gPiBbICA3MzguMzU4MzcwXSAgPyBkbWFfZmVuY2Vf ZGVmYXVsdF93YWl0KzB4MWViLzB4MjMwCj4gPiA+ID4gPiA+ID4gPiBbICA3MzguMzU4Mzc1XSAg ZG1hX2ZlbmNlX2RlZmF1bHRfd2FpdCsweDIxNC8weDIzMAo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4 LjM1ODM4NF0gID8gZG1hX2ZlbmNlX3JlbGVhc2UrMHgxYTAvMHgxYTAKPiA+ID4gPiA+ID4gPiA+ IFsgIDczOC4zNTgzOTZdICBkbWFfZmVuY2Vfd2FpdF90aW1lb3V0KzB4MTA1LzB4MjAwCj4gPiA+ ID4gPiA+ID4gPiBbICA3MzguMzU4NDA1XSAgZG1hX3Jlc3Zfd2FpdF90aW1lb3V0X3JjdSsweDFh YS8weDVlMAo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4LjM1ODQyMV0gIGFtZGdwdV9tbl9pbnZhbGlk YXRlX2dmeCsweDU1LzB4YTAgW2FtZGdwdV0KPiA+ID4gPiA+ID4gPiA+IFsgIDczOC4zNTg2ODhd ICBfX21tdV9ub3RpZmllcl9yZWxlYXNlKzB4MWJiLzB4MjEwCj4gPiA+ID4gPiA+ID4gPiBbICA3 MzguMzU4NzEwXSAgZXhpdF9tbWFwKzB4MmYvMHgxZTAKPiA+ID4gPiA+ID4gPiA+IFsgIDczOC4z NTg3MjNdICA/IGZpbmRfaGVsZF9sb2NrKzB4MzQvMHhhMAo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4 LjM1ODc0Nl0gIG1tcHV0KzB4MzkvMHhlMAo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4LjM1ODc1Nl0g IGRvX2V4aXQrMHg1YzMvMHhjMDAKPiA+ID4gPiA+ID4gPiA+IFsgIDczOC4zNTg3NjNdICA/IGZp bmRfaGVsZF9sb2NrKzB4MzQvMHhhMAo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4LjM1ODc4MF0gIGRv X2dyb3VwX2V4aXQrMHg0Ny8weGIwCj4gPiA+ID4gPiA+ID4gPiBbICA3MzguMzU4NzkxXSAgZ2V0 X3NpZ25hbCsweDE1Yi8weGM1MAo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4LjM1ODgwN10gIGFyY2hf ZG9fc2lnbmFsX29yX3Jlc3RhcnQrMHhhZi8weDcxMAo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4LjM1 ODgxNl0gID8gbG9ja2RlcF9oYXJkaXJxc19vbl9wcmVwYXJlKzB4ZDQvMHgxODAKPiA+ID4gPiA+ ID4gPiA+IFsgIDczOC4zNTg4MjJdICA/IF9yYXdfc3Bpbl91bmxvY2tfaXJxcmVzdG9yZSsweDM5 LzB4NDAKPiA+ID4gPiA+ID4gPiA+IFsgIDczOC4zNTg4MzFdICA/IGt0aW1lX2dldF9tb25vX2Zh c3RfbnMrMHg1MC8weGEwCj4gPiA+ID4gPiA+ID4gPiBbICA3MzguMzU4ODQ0XSAgPyBhbWRncHVf ZHJtX2lvY3RsKzB4NmIvMHg4MCBbYW1kZ3B1XQo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4LjM1OTA0 NF0gIGV4aXRfdG9fdXNlcl9tb2RlX3ByZXBhcmUrMHhmMi8weDFiMAo+ID4gPiA+ID4gPiA+ID4g WyAgNzM4LjM1OTA1NF0gIHN5c2NhbGxfZXhpdF90b191c2VyX21vZGUrMHgxOS8weDYwCj4gPiA+ ID4gPiA+ID4gPiBbICA3MzguMzU5MDYyXSAgZW50cnlfU1lTQ0FMTF82NF9hZnRlcl9od2ZyYW1l KzB4NDQvMHhhOQo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4LjM1OTA2OV0gUklQOiAwMDMzOjB4N2Y2 Yjg5YTUxODg3Cj4gPiA+ID4gPiA+ID4gPiBbICA3MzguMzU5MDc2XSBSU1A6IDAwMmI6MDAwMDdm NmI4MmI1NGIxOCBFRkxBR1M6IDAwMDAwMjQ2IE9SSUdfUkFYOgo+ID4gPiA+ID4gPiA+ID4gMDAw MDAwMDAwMDAwMDAxMAo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4LjM1OTA4Nl0gUkFYOiBmZmZmZmZm ZmZmZmZmZTAwIFJCWDogMDAwMDdmNmI4MmI1NGI1MCBSQ1g6IDAwMDA3ZjZiODlhNTE4ODcKPiA+ ID4gPiA+ID4gPiA+IFsgIDczOC4zNTkwOTFdIFJEWDogMDAwMDdmNmI4MmI1NGI1MCBSU0k6IDAw MDAwMDAwYzAyMDY0YzMgUkRJOiAwMDAwMDAwMDAwMDAwMDA3Cj4gPiA+ID4gPiA+ID4gPiBbICA3 MzguMzU5MDk2XSBSQlA6IDAwMDAwMDAwYzAyMDY0YzMgUjA4OiAwMDAwMDAwMDAwMDAwMDAzIFIw OTogMDAwMDdmNmI4MmI1NGJiYwo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4LjM1OTEwMV0gUjEwOiAw MDAwMDAwMDAwMDAwMDAxIFIxMTogMDAwMDAwMDAwMDAwMDI0NiBSMTI6IDAwMDAwMDAxNjVhMGJj MDAKPiA+ID4gPiA+ID4gPiA+IFsgIDczOC4zNTkxMDZdIFIxMzogMDAwMDAwMDAwMDAwMDAwNyBS MTQ6IDAwMDAwMDAwMDAwMDAwMDEgUjE1OiAwMDAwMDAwMDAwMDAwMDAwCj4gPiA+ID4gPiA+ID4g PiBbICA3MzguMzU5MTI5XQo+ID4gPiA+ID4gPiA+ID4gICAgICAgICAgICAgICAgICAgU2hvd2lu ZyBhbGwgbG9ja3MgaGVsZCBpbiB0aGUgc3lzdGVtOgo+ID4gPiA+ID4gPiA+ID4gWyAgNzM4LjM1 OTE0MV0gMSBsb2NrIGhlbGQgYnkga2h1bmd0YXNrZC81NDoKPiA+ID4gPiA+ID4gPiA+IFsgIDcz OC4zNTkxNDhdICAjMDogZmZmZmZmZmY4MjlmNjg0MCAocmN1X3JlYWRfbG9jayl7Li4uLn0tezE6 Mn0sIGF0Ogo+ID4gPiA+ID4gPiA+ID4gZGVidWdfc2hvd19hbGxfbG9ja3MrMHgxNS8weDE4Mwo+ ID4gPiA+ID4gPiA+ID4gWyAgNzM4LjM1OTE4N10gMSBsb2NrIGhlbGQgYnkgc3lzdGVtZC1qb3Vy bmFsLzE3NDoKPiA+ID4gPiA+ID4gPiA+IFsgIDczOC4zNTkyMDJdIDEgbG9jayBoZWxkIGJ5IE1h dHJpeE11bHRpcGxpYy82NTM6Cj4gPiA+ID4gPiA+ID4gPiBbICA3MzguMzU5MjA2XSAgIzA6IGZm ZmY4ODgxMGUzNjRmZTAKPiA+ID4gPiA+ID4gPiA+ICgmYWRldi0+bm90aWZpZXJfbG9jayl7Ky4r Ln0tezM6M30sIGF0Ogo+ID4gPiA+ID4gPiA+ID4gYW1kZ3B1X21uX2ludmFsaWRhdGVfZ2Z4KzB4 MzQvMHhhMCBbYW1kZ3B1XQo+ID4gPiA+ID4gPiA+ID4gCj4gPiA+ID4gPiA+ID4gPiBEYW5pZWwK PiA+ID4gPiA+ID4gPiBfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fXwo+ID4gPiA+ID4gPiA+IGRyaS1kZXZlbCBtYWlsaW5nIGxpc3QKPiA+ID4gPiA+ID4gPiBk cmktZGV2ZWxAbGlzdHMuZnJlZWRlc2t0b3Aub3JnCj4gPiA+ID4gPiA+ID4gaHR0cHM6Ly9uYW0x MS5zYWZlbGlua3MucHJvdGVjdGlvbi5vdXRsb29rLmNvbS8/dXJsPWh0dHBzJTNBJTJGJTJGbGlz dHMuZnJlZWRlc2t0b3Aub3JnJTJGbWFpbG1hbiUyRmxpc3RpbmZvJTJGZHJpLWRldmVsJmFtcDtk YXRhPTA0JTdDMDElN0NjaHJpc3RpYW4ua29lbmlnJTQwYW1kLmNvbSU3QzgxMjAzZTViYWM1ODQx YjhlNWExMDhkOGM4MjA4N2E5JTdDM2RkODk2MWZlNDg4NGU2MDhlMTFhODJkOTk0ZTE4M2QlN0Mw JTdDMCU3QzYzNzQ3OTM4OTMzOTI5NTYyMiU3Q1Vua25vd24lN0NUV0ZwYkdac2IzZDhleUpXSWpv aU1DNHdMakF3TURBaUxDSlFJam9pVjJsdU16SWlMQ0pCVGlJNklrMWhhV3dpTENKWFZDSTZNbjAl M0QlN0MxMDAwJmFtcDtzZGF0YT1SRFN4RDZPcUQ4SGFPQTJWbk5mYkp3TG5LemhDTGdPcjVTVkxq TEY5MWJBJTNEJmFtcDtyZXNlcnZlZD0wCj4gPiA+ID4gPiA+IAo+ID4gPiA+IAo+ID4gPiA+IC0t Cj4gPiA+ID4gRGFuaWVsIFZldHRlcgo+ID4gPiA+IFNvZnR3YXJlIEVuZ2luZWVyLCBJbnRlbCBD b3Jwb3JhdGlvbgo+ID4gPiA+IGh0dHA6Ly9ibG9nLmZmd2xsLmNoCj4gPiBfX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwo+ID4gYW1kLWdmeCBtYWlsaW5nIGxp c3QKPiA+IGFtZC1nZnhAbGlzdHMuZnJlZWRlc2t0b3Aub3JnCj4gPiBodHRwczovL2xpc3RzLmZy ZWVkZXNrdG9wLm9yZy9tYWlsbWFuL2xpc3RpbmZvL2FtZC1nZngKPiAKCi0tIApEYW5pZWwgVmV0 dGVyClNvZnR3YXJlIEVuZ2luZWVyLCBJbnRlbCBDb3Jwb3JhdGlvbgpodHRwOi8vYmxvZy5mZnds bC5jaApfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwpkcmkt ZGV2ZWwgbWFpbGluZyBsaXN0CmRyaS1kZXZlbEBsaXN0cy5mcmVlZGVza3RvcC5vcmcKaHR0cHM6 Ly9saXN0cy5mcmVlZGVza3RvcC5vcmcvbWFpbG1hbi9saXN0aW5mby9kcmktZGV2ZWwK From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-5.8 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI, SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 644B9C433E6 for ; Wed, 3 Feb 2021 12:25:29 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 1D21664F96 for ; Wed, 3 Feb 2021 12:25:29 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S234488AbhBCMZ2 (ORCPT ); Wed, 3 Feb 2021 07:25:28 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:56572 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S232525AbhBCMZ0 (ORCPT ); Wed, 3 Feb 2021 07:25:26 -0500 Received: from mail-wm1-x334.google.com (mail-wm1-x334.google.com [IPv6:2a00:1450:4864:20::334]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 0DD3BC061573 for ; Wed, 3 Feb 2021 04:24:46 -0800 (PST) Received: by mail-wm1-x334.google.com with SMTP id j11so4485805wmi.3 for ; Wed, 03 Feb 2021 04:24:45 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ffwll.ch; s=google; h=date:from:to:cc:subject:message-id:mail-followup-to:references :mime-version:content-disposition:content-transfer-encoding :in-reply-to; bh=m/NA4XNIrCQYNebCKt931IdDV/rzSFumSCUH9F33px4=; b=ZRA0TVyu4fRxmUS1RmK6WHKfbnpAv8v9d+qtiFMBD2IMSSfd8urMqqHC95oam0EQlS YxqzZFFmMHv0SPV1aHNYeH4b8OqGEH2/o0HSixyFNS/mtm5SitgA1QMRAXq1lH3Z3M7i r/xCYBSLA8EQ8csv35OC5wluVAbmODcTD17G4= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id :mail-followup-to:references:mime-version:content-disposition :content-transfer-encoding:in-reply-to; bh=m/NA4XNIrCQYNebCKt931IdDV/rzSFumSCUH9F33px4=; b=M0iCmfiN2wQV3mdwVt1VoZ6rzRurO0gCHikIh8ixIu/WtvfgOHOZ9l8uN3kNtIWC4T SXef0hYJO9YCD/h7KSUWKb7YWoszVcZqUWYNLY0z+n6+s8HHws5rfRVjimGbs9/mE3fY NxjdCu7hhDQ6H++7w49RffHp44ln4Jc6Lmvq1VrxHMelWRM9KRg02YEcL++Ayirfaww0 0u3lSiCy3IKi80mSr58NNc+qDVAIxecinombndYjY9PAzeZP+HfTmldS/YeDXE+O01k/ t2uVL5N2E0KLHh892MbmLr4o3zIsUZmPLuY+1bqkoLxbeGB9l25vZpg8cbs3GIfcUQiM tcfw== X-Gm-Message-State: AOAM532ifL6E2GTTM8XDrY9EZCIGKeP3cDWTclAcS2P6InKV/LUa5NTk B67V9ofBI8vE9sg8oXfvxJUapA== X-Google-Smtp-Source: ABdhPJyVy0zQu6h3nSD6wAbF9bgQ1VdIhgwWSIQlKTCZZyiOuBEn8EE8tvHk8fS3yPow6235vprjjA== X-Received: by 2002:a05:600c:4148:: with SMTP id h8mr2576404wmm.137.1612355084657; Wed, 03 Feb 2021 04:24:44 -0800 (PST) Received: from phenom.ffwll.local ([2a02:168:57f4:0:efd0:b9e5:5ae6:c2fa]) by smtp.gmail.com with ESMTPSA id e16sm3547170wrp.24.2021.02.03.04.24.43 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 03 Feb 2021 04:24:43 -0800 (PST) Date: Wed, 3 Feb 2021 13:24:42 +0100 From: Daniel Vetter To: christian.koenig@amd.com Cc: Daniel Gomez , Daniel Vetter , Alex Deucher , dri-devel , amd-gfx list , Linux Kernel Mailing List Subject: Re: [amdgpu] deadlock Message-ID: Mail-Followup-To: christian.koenig@amd.com, Daniel Gomez , Alex Deucher , dri-devel , amd-gfx list , Linux Kernel Mailing List References: <58e41b62-b8e0-b036-c87d-a84d53f5a26e@amd.com> <538682ee-3e12-a345-2205-2c0f16b496ff@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <538682ee-3e12-a345-2205-2c0f16b496ff@gmail.com> X-Operating-System: Linux phenom 5.7.0-1-amd64 Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Wed, Feb 03, 2021 at 01:21:20PM +0100, Christian König wrote: > Am 03.02.21 um 12:45 schrieb Daniel Gomez: > > On Wed, 3 Feb 2021 at 10:47, Daniel Gomez wrote: > > > On Wed, 3 Feb 2021 at 10:17, Daniel Vetter wrote: > > > > On Wed, Feb 3, 2021 at 9:51 AM Christian König wrote: > > > > > Am 03.02.21 um 09:48 schrieb Daniel Vetter: > > > > > > On Wed, Feb 3, 2021 at 9:36 AM Christian König wrote: > > > > > > > Hi Daniel, > > > > > > > > > > > > > > this is not a deadlock, but rather a hardware lockup. > > > > > > Are you sure? Ime getting stuck in dma_fence_wait has generally good > > > > > > chance of being a dma_fence deadlock. GPU hang should never result in > > > > > > a forever stuck dma_fence. > > > > > Yes, I'm pretty sure. Otherwise the hardware clocks wouldn't go up like > > > > > this. > > > > Maybe clarifying, could be both. TDR should notice and get us out of > > > > this, but if there's a dma_fence deadlock and we can't re-emit or > > > > force complete the pending things, then we're stuck for good. > > > > -Daniel > > > > > > > > > Question is rather why we end up in the userptr handling for GFX? Our > > > > > ROCm OpenCL stack shouldn't use this. > > > > > > > > > > > Daniel, can you pls re-hang your machine and then dump backtraces of > > > > > > all tasks into dmesg with sysrq-t, and then attach that? Without all > > > > > > the backtraces it's tricky to construct the full dependency chain of > > > > > > what's going on. Also is this plain -rc6, not some more patches on > > > > > > top? > > > > > Yeah, that's still a good idea to have. > > > Here the full backtrace dmesg logs after the hang: > > > https://pastebin.com/raw/kzivm2L3 > > > > > > This is another dmesg log with the backtraces after SIGKILL the matrix process: > > > (I didn't have the sysrq enable at the time): > > > https://pastebin.com/raw/pRBwGcj1 > > I've now removed all our v4l2 patches and did the same test with the 'plain' > > mainline version (-rc6). > > > > Reference: 3aaf0a27ffc29b19a62314edd684b9bc6346f9a8 > > > > Same error, same behaviour. Full dmesg log attached: > > https://pastebin.com/raw/KgaEf7Y1 > > Note: > > dmesg with sysrq-t before running the test starts in [ 122.016502] > > sysrq: Show State > > dmesg with sysrq-t after the test starts in: [ 495.587671] sysrq: Show State > > There is nothing amdgpu related in there except for waiting for the > hardware. Yeah, but there's also no other driver that could cause a stuck dma_fence, so why is reset not cleaning up the mess here? Irrespective of why the gpu is stuck, the kernel should at least complete all the dma_fences even if the gpu for some reason is terminally ill ... -Daniel > This is a pretty standard hardware lockup, but I'm still waiting for an > explanation why we end up in this call path in the first place. > > Christian. > > > > > > > > > > Christian. > > > > > > > > > > > -Daniel > > > > > > > > > > > > > Which OpenCl stack are you using? > > > > > > > > > > > > > > Regards, > > > > > > > Christian. > > > > > > > > > > > > > > Am 03.02.21 um 09:33 schrieb Daniel Gomez: > > > > > > > > Hi all, > > > > > > > > > > > > > > > > I have a deadlock with the amdgpu mainline driver when running in parallel two > > > > > > > > OpenCL applications. So far, we've been able to replicate it easily by executing > > > > > > > > clinfo and MatrixMultiplication (from AMD opencl-samples). It's quite old the > > > > > > > > opencl-samples so, if you have any other suggestion for testing I'd be very > > > > > > > > happy to test it as well. > > > > > > > > > > > > > > > > How to replicate the issue: > > > > > > > > > > > > > > > > # while true; do /usr/bin/MatrixMultiplication --device gpu \ > > > > > > > > --deviceId 0 -x 1000 -y 1000 -z 1000 -q -t -i 50; done > > > > > > > > # while true; do clinfo; done > > > > > > > > > > > > > > > > Output: > > > > > > > > > > > > > > > > After a minute or less (sometimes could be more) I can see that > > > > > > > > MatrixMultiplication and clinfo hang. In addition, with radeontop you can see > > > > > > > > how the Graphics pipe goes from ~50% to 100%. Also the shader clocks > > > > > > > > goes up from ~35% to ~96%. > > > > > > > > > > > > > > > > clinfo keeps printing: > > > > > > > > ioctl(7, DRM_IOCTL_SYNCOBJ_WAIT, 0x7ffe46e5f950) = -1 ETIME (Timer expired) > > > > > > > > > > > > > > > > And MatrixMultiplication prints the following (strace) if you try to > > > > > > > > kill the process: > > > > > > > > > > > > > > > > sched_yield() = 0 > > > > > > > > futex(0x557e945343b8, FUTEX_WAIT_BITSET_PRIVATE|FUTEX_CLOCK_REALTIME, 0, > > > > > > > > NULL, FUTEX_BITSET_MATCH_ANYstrace: Process 651 detached > > > > > > > > > > > > > > > > > > > > > > > > After this, the gpu is not functional at all and you'd need a power cycle reset > > > > > > > > to restore the system. > > > > > > > > > > > > > > > > Hardware info: > > > > > > > > CPU: AMD Ryzen Embedded V1605B with Radeon Vega Gfx (8) @ 2.000GHz > > > > > > > > GPU: AMD ATI Radeon Vega Series / Radeon Vega Mobile Series > > > > > > > > > > > > > > > > 03:00.0 VGA compatible controller: Advanced Micro Devices, Inc. > > > > > > > > [AMD/ATI] Raven Ridge [Radeon Vega Series / Radeon Vega Mobile Series] > > > > > > > > (rev 83) > > > > > > > > DeviceName: Broadcom 5762 > > > > > > > > Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Raven Ridge > > > > > > > > [Radeon Vega Series / Radeon Vega Mobile Series] > > > > > > > > Kernel driver in use: amdgpu > > > > > > > > Kernel modules: amdgpu > > > > > > > > > > > > > > > > Linux kernel info: > > > > > > > > > > > > > > > > root@qt5222:~# uname -a > > > > > > > > Linux qt5222 5.11.0-rc6-qtec-standard #2 SMP Tue Feb 2 09:41:46 UTC > > > > > > > > 2021 x86_64 x86_64 x86_64 GNU/Linux > > > > > > > > > > > > > > > > By enabling the kernel locks stats I could see the MatrixMultiplication is > > > > > > > > hanged in the amdgpu_mn_invalidate_gfx function: > > > > > > > > > > > > > > > > [ 738.359202] 1 lock held by MatrixMultiplic/653: > > > > > > > > [ 738.359206] #0: ffff88810e364fe0 > > > > > > > > (&adev->notifier_lock){+.+.}-{3:3}, at: > > > > > > > > amdgpu_mn_invalidate_gfx+0x34/0xa0 [amdgpu] > > > > > > > > > > > > > > > > I can see in the the amdgpu_mn_invalidate_gfx function: the > > > > > > > > dma_resv_wait_timeout_rcu uses wait_all (fences) and MAX_SCHEDULE_TIMEOUT so, I > > > > > > > > guess the code gets stuck there waiting forever. According to the > > > > > > > > documentation: "When somebody tries to invalidate the page tables we block the > > > > > > > > update until all operations on the pages in question are completed, then those > > > > > > > > pages are marked as accessed and also dirty if it wasn’t a read only access." > > > > > > > > Looks like the fences are deadlocked and therefore, it never returns. Could it > > > > > > > > be possible? any hint to where can I look to fix this? > > > > > > > > > > > > > > > > Thank you in advance. > > > > > > > > > > > > > > > > Here the full dmesg output: > > > > > > > > > > > > > > > > [ 738.337726] INFO: task MatrixMultiplic:653 blocked for more than 122 seconds. > > > > > > > > [ 738.344937] Not tainted 5.11.0-rc6-qtec-standard #2 > > > > > > > > [ 738.350384] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" > > > > > > > > disables this message. > > > > > > > > [ 738.358240] task:MatrixMultiplic state:D stack: 0 pid: 653 > > > > > > > > ppid: 1 flags:0x00004000 > > > > > > > > [ 738.358254] Call Trace: > > > > > > > > [ 738.358261] ? dma_fence_default_wait+0x1eb/0x230 > > > > > > > > [ 738.358276] __schedule+0x370/0x960 > > > > > > > > [ 738.358291] ? dma_fence_default_wait+0x117/0x230 > > > > > > > > [ 738.358297] ? dma_fence_default_wait+0x1eb/0x230 > > > > > > > > [ 738.358305] schedule+0x51/0xc0 > > > > > > > > [ 738.358312] schedule_timeout+0x275/0x380 > > > > > > > > [ 738.358324] ? dma_fence_default_wait+0x1eb/0x230 > > > > > > > > [ 738.358332] ? mark_held_locks+0x4f/0x70 > > > > > > > > [ 738.358341] ? dma_fence_default_wait+0x117/0x230 > > > > > > > > [ 738.358347] ? lockdep_hardirqs_on_prepare+0xd4/0x180 > > > > > > > > [ 738.358353] ? _raw_spin_unlock_irqrestore+0x39/0x40 > > > > > > > > [ 738.358362] ? dma_fence_default_wait+0x117/0x230 > > > > > > > > [ 738.358370] ? dma_fence_default_wait+0x1eb/0x230 > > > > > > > > [ 738.358375] dma_fence_default_wait+0x214/0x230 > > > > > > > > [ 738.358384] ? dma_fence_release+0x1a0/0x1a0 > > > > > > > > [ 738.358396] dma_fence_wait_timeout+0x105/0x200 > > > > > > > > [ 738.358405] dma_resv_wait_timeout_rcu+0x1aa/0x5e0 > > > > > > > > [ 738.358421] amdgpu_mn_invalidate_gfx+0x55/0xa0 [amdgpu] > > > > > > > > [ 738.358688] __mmu_notifier_release+0x1bb/0x210 > > > > > > > > [ 738.358710] exit_mmap+0x2f/0x1e0 > > > > > > > > [ 738.358723] ? find_held_lock+0x34/0xa0 > > > > > > > > [ 738.358746] mmput+0x39/0xe0 > > > > > > > > [ 738.358756] do_exit+0x5c3/0xc00 > > > > > > > > [ 738.358763] ? find_held_lock+0x34/0xa0 > > > > > > > > [ 738.358780] do_group_exit+0x47/0xb0 > > > > > > > > [ 738.358791] get_signal+0x15b/0xc50 > > > > > > > > [ 738.358807] arch_do_signal_or_restart+0xaf/0x710 > > > > > > > > [ 738.358816] ? lockdep_hardirqs_on_prepare+0xd4/0x180 > > > > > > > > [ 738.358822] ? _raw_spin_unlock_irqrestore+0x39/0x40 > > > > > > > > [ 738.358831] ? ktime_get_mono_fast_ns+0x50/0xa0 > > > > > > > > [ 738.358844] ? amdgpu_drm_ioctl+0x6b/0x80 [amdgpu] > > > > > > > > [ 738.359044] exit_to_user_mode_prepare+0xf2/0x1b0 > > > > > > > > [ 738.359054] syscall_exit_to_user_mode+0x19/0x60 > > > > > > > > [ 738.359062] entry_SYSCALL_64_after_hwframe+0x44/0xa9 > > > > > > > > [ 738.359069] RIP: 0033:0x7f6b89a51887 > > > > > > > > [ 738.359076] RSP: 002b:00007f6b82b54b18 EFLAGS: 00000246 ORIG_RAX: > > > > > > > > 0000000000000010 > > > > > > > > [ 738.359086] RAX: fffffffffffffe00 RBX: 00007f6b82b54b50 RCX: 00007f6b89a51887 > > > > > > > > [ 738.359091] RDX: 00007f6b82b54b50 RSI: 00000000c02064c3 RDI: 0000000000000007 > > > > > > > > [ 738.359096] RBP: 00000000c02064c3 R08: 0000000000000003 R09: 00007f6b82b54bbc > > > > > > > > [ 738.359101] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000165a0bc00 > > > > > > > > [ 738.359106] R13: 0000000000000007 R14: 0000000000000001 R15: 0000000000000000 > > > > > > > > [ 738.359129] > > > > > > > > Showing all locks held in the system: > > > > > > > > [ 738.359141] 1 lock held by khungtaskd/54: > > > > > > > > [ 738.359148] #0: ffffffff829f6840 (rcu_read_lock){....}-{1:2}, at: > > > > > > > > debug_show_all_locks+0x15/0x183 > > > > > > > > [ 738.359187] 1 lock held by systemd-journal/174: > > > > > > > > [ 738.359202] 1 lock held by MatrixMultiplic/653: > > > > > > > > [ 738.359206] #0: ffff88810e364fe0 > > > > > > > > (&adev->notifier_lock){+.+.}-{3:3}, at: > > > > > > > > amdgpu_mn_invalidate_gfx+0x34/0xa0 [amdgpu] > > > > > > > > > > > > > > > > Daniel > > > > > > > _______________________________________________ > > > > > > > dri-devel mailing list > > > > > > > dri-devel@lists.freedesktop.org > > > > > > > https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.freedesktop.org%2Fmailman%2Flistinfo%2Fdri-devel&data=04%7C01%7Cchristian.koenig%40amd.com%7C81203e5bac5841b8e5a108d8c82087a9%7C3dd8961fe4884e608e11a82d994e183d%7C0%7C0%7C637479389339295622%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=RDSxD6OqD8HaOA2VnNfbJwLnKzhCLgOr5SVLjLF91bA%3D&reserved=0 > > > > > > > > > > > > > > -- > > > > Daniel Vetter > > > > Software Engineer, Intel Corporation > > > > http://blog.ffwll.ch > > _______________________________________________ > > amd-gfx mailing list > > amd-gfx@lists.freedesktop.org > > https://lists.freedesktop.org/mailman/listinfo/amd-gfx > -- Daniel Vetter Software Engineer, Intel Corporation http://blog.ffwll.ch