From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.2 required=3.0 tests=BAYES_00,DKIM_ADSP_CUSTOM_MED, DKIM_INVALID,DKIM_SIGNED,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,NICE_REPLY_A,SPF_HELO_NONE, SPF_PASS,URIBL_BLOCKED,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 90A76C433E0 for ; Wed, 3 Feb 2021 12:21:30 +0000 (UTC) Received: from gabe.freedesktop.org (gabe.freedesktop.org [131.252.210.177]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 244B064F96 for ; Wed, 3 Feb 2021 12:21:30 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 244B064F96 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=gmail.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=amd-gfx-bounces@lists.freedesktop.org Received: from gabe.freedesktop.org (localhost [127.0.0.1]) by gabe.freedesktop.org (Postfix) with ESMTP id 8D0456EA92; Wed, 3 Feb 2021 12:21:25 +0000 (UTC) Received: from mail-ed1-x535.google.com (mail-ed1-x535.google.com [IPv6:2a00:1450:4864:20::535]) by gabe.freedesktop.org (Postfix) with ESMTPS id 0D81B6EA8D; Wed, 3 Feb 2021 12:21:24 +0000 (UTC) Received: by mail-ed1-x535.google.com with SMTP id q2so11851422edi.4; Wed, 03 Feb 2021 04:21:23 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=reply-to:subject:to:cc:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-transfer-encoding:content-language; bh=bLF32KqYMp2Ag9MhzCy/CMzv0E6X87uMKhtUHj70LAE=; b=fXrZYMRoW24U8f0iJ5ejvqmSVq+CbSu6fwlCfOUAJfbz1btQ/fkgafj4Itw/J5SiYj K0Bk5c+WZOJDuHs/kkT1XVzcZEuUT0unUnjtEkPspkDLNyhSJMMmHkJfMj7nlUauzZ2x HhsE6IjyLPphw8fJ9Ykbt8e5qLQIEh0OzVztWsP8tkygMRLvwH3FD1womBHK97gqQXov cjmOgUKNkt6wsvR0+EmjiOPXiLC33Vx+upYeEofIIZc/ksGW0t3yj3LOiMHUtsj1mOZ/ 59H+TSkMBBkqQWubGYGZkV2YoAZ3q6Yr3f46eKUGWRRGbJBUgXcqup8dq516UhtRQB8M MCrA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:reply-to:subject:to:cc:references:from :message-id:date:user-agent:mime-version:in-reply-to :content-transfer-encoding:content-language; bh=bLF32KqYMp2Ag9MhzCy/CMzv0E6X87uMKhtUHj70LAE=; b=HS+DCZmObjrFNpIA7J2ZCgCewTNgmmigMZaJ3fNj+riQB8SjFBFSVkCERal7yovRgz mi8BQ8Kdhur6cvlGzMg1wMLOetpgELM6ZSgcgoJN42xpjFahhasOkgFZLdpFZEn9OffY OiN5BC7ensFOXGarcm+hW3i6sbf1feI7Sr1oi9F5pL0V0YO7Ag4E2jauV3tIMUfxLbvI 8Q5sZNJsxucS7ULMkbIm73PT04hhdiFzYbQmBWzx6KAaQ7+cyaQGaqlmJ8j354+j1ZXI cljvdQketl0TICneSxPW13zuJh0sjDDDokDHoClPcyuEtaudr/gEY3nL/XwM2MOjsFab tv/Q== X-Gm-Message-State: AOAM532QD+lJQvT/7MElJlHwcZOLH0bhOjvvl8zmCEcQWScYE4+L6Lou qrG5iC5IPJ8RAzUdF3uPpGY= X-Google-Smtp-Source: ABdhPJxBdLLD9NGdRzHVxag7BKf2yQFcixrwyfP7WT8VO2NoggPW8S6nyp5uD1yoY6pS3P2BmJmtXA== X-Received: by 2002:aa7:c682:: with SMTP id n2mr2685871edq.27.1612354882579; Wed, 03 Feb 2021 04:21:22 -0800 (PST) Received: from ?IPv6:2a02:908:1252:fb60:be8a:bd56:1f94:86e7? ([2a02:908:1252:fb60:be8a:bd56:1f94:86e7]) by smtp.gmail.com with ESMTPSA id u23sm782393edt.87.2021.02.03.04.21.21 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 03 Feb 2021 04:21:21 -0800 (PST) Subject: Re: [amdgpu] deadlock To: Daniel Gomez , Daniel Vetter References: <58e41b62-b8e0-b036-c87d-a84d53f5a26e@amd.com> From: =?UTF-8?Q?Christian_K=c3=b6nig?= Message-ID: <538682ee-3e12-a345-2205-2c0f16b496ff@gmail.com> Date: Wed, 3 Feb 2021 13:21:20 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.10.0 MIME-Version: 1.0 In-Reply-To: Content-Language: en-US X-BeenThere: amd-gfx@lists.freedesktop.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion list for AMD gfx List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: christian.koenig@amd.com Cc: Alex Deucher , amd-gfx list , =?UTF-8?Q?Christian_K=c3=b6nig?= , dri-devel , Linux Kernel Mailing List Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8"; Format="flowed" Errors-To: amd-gfx-bounces@lists.freedesktop.org Sender: "amd-gfx" QW0gMDMuMDIuMjEgdW0gMTI6NDUgc2NocmllYiBEYW5pZWwgR29tZXo6Cj4gT24gV2VkLCAzIEZl YiAyMDIxIGF0IDEwOjQ3LCBEYW5pZWwgR29tZXogPGRhbmllbEBxdGVjLmNvbT4gd3JvdGU6Cj4+ IE9uIFdlZCwgMyBGZWIgMjAyMSBhdCAxMDoxNywgRGFuaWVsIFZldHRlciA8ZGFuaWVsQGZmd2xs LmNoPiB3cm90ZToKPj4+IE9uIFdlZCwgRmViIDMsIDIwMjEgYXQgOTo1MSBBTSBDaHJpc3RpYW4g S8O2bmlnIDxjaHJpc3RpYW4ua29lbmlnQGFtZC5jb20+IHdyb3RlOgo+Pj4+IEFtIDAzLjAyLjIx IHVtIDA5OjQ4IHNjaHJpZWIgRGFuaWVsIFZldHRlcjoKPj4+Pj4gT24gV2VkLCBGZWIgMywgMjAy MSBhdCA5OjM2IEFNIENocmlzdGlhbiBLw7ZuaWcgPGNocmlzdGlhbi5rb2VuaWdAYW1kLmNvbT4g d3JvdGU6Cj4+Pj4+PiBIaSBEYW5pZWwsCj4+Pj4+Pgo+Pj4+Pj4gdGhpcyBpcyBub3QgYSBkZWFk bG9jaywgYnV0IHJhdGhlciBhIGhhcmR3YXJlIGxvY2t1cC4KPj4+Pj4gQXJlIHlvdSBzdXJlPyBJ bWUgZ2V0dGluZyBzdHVjayBpbiBkbWFfZmVuY2Vfd2FpdCBoYXMgZ2VuZXJhbGx5IGdvb2QKPj4+ Pj4gY2hhbmNlIG9mIGJlaW5nIGEgZG1hX2ZlbmNlIGRlYWRsb2NrLiBHUFUgaGFuZyBzaG91bGQg bmV2ZXIgcmVzdWx0IGluCj4+Pj4+IGEgZm9yZXZlciBzdHVjayBkbWFfZmVuY2UuCj4+Pj4gWWVz LCBJJ20gcHJldHR5IHN1cmUuIE90aGVyd2lzZSB0aGUgaGFyZHdhcmUgY2xvY2tzIHdvdWxkbid0 IGdvIHVwIGxpa2UKPj4+PiB0aGlzLgo+Pj4gTWF5YmUgY2xhcmlmeWluZywgY291bGQgYmUgYm90 aC4gVERSIHNob3VsZCBub3RpY2UgYW5kIGdldCB1cyBvdXQgb2YKPj4+IHRoaXMsIGJ1dCBpZiB0 aGVyZSdzIGEgZG1hX2ZlbmNlIGRlYWRsb2NrIGFuZCB3ZSBjYW4ndCByZS1lbWl0IG9yCj4+PiBm b3JjZSBjb21wbGV0ZSB0aGUgcGVuZGluZyB0aGluZ3MsIHRoZW4gd2UncmUgc3R1Y2sgZm9yIGdv b2QuCj4+PiAtRGFuaWVsCj4+Pgo+Pj4+IFF1ZXN0aW9uIGlzIHJhdGhlciB3aHkgd2UgZW5kIHVw IGluIHRoZSB1c2VycHRyIGhhbmRsaW5nIGZvciBHRlg/IE91cgo+Pj4+IFJPQ20gT3BlbkNMIHN0 YWNrIHNob3VsZG4ndCB1c2UgdGhpcy4KPj4+Pgo+Pj4+PiBEYW5pZWwsIGNhbiB5b3UgcGxzIHJl LWhhbmcgeW91ciBtYWNoaW5lIGFuZCB0aGVuIGR1bXAgYmFja3RyYWNlcyBvZgo+Pj4+PiBhbGwg dGFza3MgaW50byBkbWVzZyB3aXRoIHN5c3JxLXQsIGFuZCB0aGVuIGF0dGFjaCB0aGF0PyBXaXRo b3V0IGFsbAo+Pj4+PiB0aGUgYmFja3RyYWNlcyBpdCdzIHRyaWNreSB0byBjb25zdHJ1Y3QgdGhl IGZ1bGwgZGVwZW5kZW5jeSBjaGFpbiBvZgo+Pj4+PiB3aGF0J3MgZ29pbmcgb24uIEFsc28gaXMg dGhpcyBwbGFpbiAtcmM2LCBub3Qgc29tZSBtb3JlIHBhdGNoZXMgb24KPj4+Pj4gdG9wPwo+Pj4+ IFllYWgsIHRoYXQncyBzdGlsbCBhIGdvb2QgaWRlYSB0byBoYXZlLgo+PiBIZXJlIHRoZSBmdWxs IGJhY2t0cmFjZSBkbWVzZyBsb2dzIGFmdGVyIHRoZSBoYW5nOgo+PiBodHRwczovL3Bhc3RlYmlu LmNvbS9yYXcva3ppdm0yTDMKPj4KPj4gVGhpcyBpcyBhbm90aGVyIGRtZXNnIGxvZyB3aXRoIHRo ZSBiYWNrdHJhY2VzIGFmdGVyIFNJR0tJTEwgdGhlIG1hdHJpeCBwcm9jZXNzOgo+PiAoSSBkaWRu J3QgaGF2ZSB0aGUgc3lzcnEgZW5hYmxlIGF0IHRoZSB0aW1lKToKPj4gaHR0cHM6Ly9wYXN0ZWJp bi5jb20vcmF3L3BSQndHY2oxCj4gSSd2ZSBub3cgcmVtb3ZlZCBhbGwgb3VyIHY0bDIgcGF0Y2hl cyBhbmQgZGlkIHRoZSBzYW1lIHRlc3Qgd2l0aCB0aGUgJ3BsYWluJwo+IG1haW5saW5lIHZlcnNp b24gKC1yYzYpLgo+Cj4gUmVmZXJlbmNlOiAzYWFmMGEyN2ZmYzI5YjE5YTYyMzE0ZWRkNjg0Yjli YzYzNDZmOWE4Cj4KPiBTYW1lIGVycm9yLCBzYW1lIGJlaGF2aW91ci4gRnVsbCBkbWVzZyBsb2cg YXR0YWNoZWQ6Cj4gaHR0cHM6Ly9wYXN0ZWJpbi5jb20vcmF3L0tnYUVmN1kxCj4gTm90ZToKPiAg ICBkbWVzZyB3aXRoIHN5c3JxLXQgYmVmb3JlIHJ1bm5pbmcgdGhlIHRlc3Qgc3RhcnRzIGluIFsg IDEyMi4wMTY1MDJdCj4gc3lzcnE6IFNob3cgU3RhdGUKPiAgICBkbWVzZyB3aXRoIHN5c3JxLXQg YWZ0ZXIgdGhlIHRlc3Qgc3RhcnRzIGluOiBbICA0OTUuNTg3NjcxXSBzeXNycTogU2hvdyBTdGF0 ZQoKVGhlcmUgaXMgbm90aGluZyBhbWRncHUgcmVsYXRlZCBpbiB0aGVyZSBleGNlcHQgZm9yIHdh aXRpbmcgZm9yIHRoZSAKaGFyZHdhcmUuCgpUaGlzIGlzIGEgcHJldHR5IHN0YW5kYXJkIGhhcmR3 YXJlIGxvY2t1cCwgYnV0IEknbSBzdGlsbCB3YWl0aW5nIGZvciBhbiAKZXhwbGFuYXRpb24gd2h5 IHdlIGVuZCB1cCBpbiB0aGlzIGNhbGwgcGF0aCBpbiB0aGUgZmlyc3QgcGxhY2UuCgpDaHJpc3Rp YW4uCgo+Cj4KPj4+PiBDaHJpc3RpYW4uCj4+Pj4KPj4+Pj4gLURhbmllbAo+Pj4+Pgo+Pj4+Pj4g V2hpY2ggT3BlbkNsIHN0YWNrIGFyZSB5b3UgdXNpbmc/Cj4+Pj4+Pgo+Pj4+Pj4gUmVnYXJkcywK Pj4+Pj4+IENocmlzdGlhbi4KPj4+Pj4+Cj4+Pj4+PiBBbSAwMy4wMi4yMSB1bSAwOTozMyBzY2hy aWViIERhbmllbCBHb21lejoKPj4+Pj4+PiBIaSBhbGwsCj4+Pj4+Pj4KPj4+Pj4+PiBJIGhhdmUg YSBkZWFkbG9jayB3aXRoIHRoZSBhbWRncHUgbWFpbmxpbmUgZHJpdmVyIHdoZW4gcnVubmluZyBp biBwYXJhbGxlbCB0d28KPj4+Pj4+PiBPcGVuQ0wgYXBwbGljYXRpb25zLiBTbyBmYXIsIHdlJ3Zl IGJlZW4gYWJsZSB0byByZXBsaWNhdGUgaXQgZWFzaWx5IGJ5IGV4ZWN1dGluZwo+Pj4+Pj4+IGNs aW5mbyBhbmQgTWF0cml4TXVsdGlwbGljYXRpb24gKGZyb20gQU1EIG9wZW5jbC1zYW1wbGVzKS4g SXQncyBxdWl0ZSBvbGQgdGhlCj4+Pj4+Pj4gb3BlbmNsLXNhbXBsZXMgc28sIGlmIHlvdSBoYXZl IGFueSBvdGhlciBzdWdnZXN0aW9uIGZvciB0ZXN0aW5nIEknZCBiZSB2ZXJ5Cj4+Pj4+Pj4gaGFw cHkgdG8gdGVzdCBpdCBhcyB3ZWxsLgo+Pj4+Pj4+Cj4+Pj4+Pj4gSG93IHRvIHJlcGxpY2F0ZSB0 aGUgaXNzdWU6Cj4+Pj4+Pj4KPj4+Pj4+PiAjIHdoaWxlIHRydWU7IGRvIC91c3IvYmluL01hdHJp eE11bHRpcGxpY2F0aW9uIC0tZGV2aWNlIGdwdSBcCj4+Pj4+Pj4gICAgICAgIC0tZGV2aWNlSWQg MCAteCAxMDAwIC15IDEwMDAgLXogMTAwMCAtcSAtdCAtaSA1MDsgZG9uZQo+Pj4+Pj4+ICMgd2hp bGUgdHJ1ZTsgZG8gY2xpbmZvOyBkb25lCj4+Pj4+Pj4KPj4+Pj4+PiBPdXRwdXQ6Cj4+Pj4+Pj4K Pj4+Pj4+PiBBZnRlciBhIG1pbnV0ZSBvciBsZXNzIChzb21ldGltZXMgY291bGQgYmUgbW9yZSkg SSBjYW4gc2VlIHRoYXQKPj4+Pj4+PiBNYXRyaXhNdWx0aXBsaWNhdGlvbiBhbmQgY2xpbmZvIGhh bmcuIEluIGFkZGl0aW9uLCB3aXRoIHJhZGVvbnRvcCB5b3UgY2FuIHNlZQo+Pj4+Pj4+IGhvdyB0 aGUgR3JhcGhpY3MgcGlwZSBnb2VzIGZyb20gfjUwJSB0byAxMDAlLiBBbHNvIHRoZSBzaGFkZXIg Y2xvY2tzCj4+Pj4+Pj4gZ29lcyB1cCBmcm9tIH4zNSUgdG8gfjk2JS4KPj4+Pj4+Pgo+Pj4+Pj4+ IGNsaW5mbyBrZWVwcyBwcmludGluZzoKPj4+Pj4+PiBpb2N0bCg3LCBEUk1fSU9DVExfU1lOQ09C Sl9XQUlULCAweDdmZmU0NmU1Zjk1MCkgPSAtMSBFVElNRSAoVGltZXIgZXhwaXJlZCkKPj4+Pj4+ Pgo+Pj4+Pj4+IEFuZCBNYXRyaXhNdWx0aXBsaWNhdGlvbiBwcmludHMgdGhlIGZvbGxvd2luZyAo c3RyYWNlKSBpZiB5b3UgdHJ5IHRvCj4+Pj4+Pj4ga2lsbCB0aGUgcHJvY2VzczoKPj4+Pj4+Pgo+ Pj4+Pj4+IHNjaGVkX3lpZWxkKCkgICAgICAgICAgICAgICAgICAgICAgICAgICA9IDAKPj4+Pj4+ PiBmdXRleCgweDU1N2U5NDUzNDNiOCwgRlVURVhfV0FJVF9CSVRTRVRfUFJJVkFURXxGVVRFWF9D TE9DS19SRUFMVElNRSwgMCwKPj4+Pj4+PiBOVUxMLCBGVVRFWF9CSVRTRVRfTUFUQ0hfQU5Zc3Ry YWNlOiBQcm9jZXNzIDY1MSBkZXRhY2hlZAo+Pj4+Pj4+ICAgICA8ZGV0YWNoZWQgLi4uPgo+Pj4+ Pj4+Cj4+Pj4+Pj4gQWZ0ZXIgdGhpcywgdGhlIGdwdSBpcyBub3QgZnVuY3Rpb25hbCBhdCBhbGwg YW5kIHlvdSdkIG5lZWQgYSBwb3dlciBjeWNsZSByZXNldAo+Pj4+Pj4+IHRvIHJlc3RvcmUgdGhl IHN5c3RlbS4KPj4+Pj4+Pgo+Pj4+Pj4+IEhhcmR3YXJlIGluZm86Cj4+Pj4+Pj4gQ1BVOiBBTUQg Unl6ZW4gRW1iZWRkZWQgVjE2MDVCIHdpdGggUmFkZW9uIFZlZ2EgR2Z4ICg4KSBAIDIuMDAwR0h6 Cj4+Pj4+Pj4gR1BVOiBBTUQgQVRJIFJhZGVvbiBWZWdhIFNlcmllcyAvIFJhZGVvbiBWZWdhIE1v YmlsZSBTZXJpZXMKPj4+Pj4+Pgo+Pj4+Pj4+IDAzOjAwLjAgVkdBIGNvbXBhdGlibGUgY29udHJv bGxlcjogQWR2YW5jZWQgTWljcm8gRGV2aWNlcywgSW5jLgo+Pj4+Pj4+IFtBTUQvQVRJXSBSYXZl biBSaWRnZSBbUmFkZW9uIFZlZ2EgU2VyaWVzIC8gUmFkZW9uIFZlZ2EgTW9iaWxlIFNlcmllc10K Pj4+Pj4+PiAocmV2IDgzKQo+Pj4+Pj4+ICAgICAgICBEZXZpY2VOYW1lOiBCcm9hZGNvbSA1NzYy Cj4+Pj4+Pj4gICAgICAgIFN1YnN5c3RlbTogQWR2YW5jZWQgTWljcm8gRGV2aWNlcywgSW5jLiBb QU1EL0FUSV0gUmF2ZW4gUmlkZ2UKPj4+Pj4+PiBbUmFkZW9uIFZlZ2EgU2VyaWVzIC8gUmFkZW9u IFZlZ2EgTW9iaWxlIFNlcmllc10KPj4+Pj4+PiAgICAgICAgS2VybmVsIGRyaXZlciBpbiB1c2U6 IGFtZGdwdQo+Pj4+Pj4+ICAgICAgICBLZXJuZWwgbW9kdWxlczogYW1kZ3B1Cj4+Pj4+Pj4KPj4+ Pj4+PiBMaW51eCBrZXJuZWwgaW5mbzoKPj4+Pj4+Pgo+Pj4+Pj4+IHJvb3RAcXQ1MjIyOn4jIHVu YW1lIC1hCj4+Pj4+Pj4gTGludXggcXQ1MjIyIDUuMTEuMC1yYzYtcXRlYy1zdGFuZGFyZCAjMiBT TVAgVHVlIEZlYiAyIDA5OjQxOjQ2IFVUQwo+Pj4+Pj4+IDIwMjEgeDg2XzY0IHg4Nl82NCB4ODZf NjQgR05VL0xpbnV4Cj4+Pj4+Pj4KPj4+Pj4+PiBCeSBlbmFibGluZyB0aGUga2VybmVsIGxvY2tz IHN0YXRzIEkgY291bGQgc2VlIHRoZSBNYXRyaXhNdWx0aXBsaWNhdGlvbiBpcwo+Pj4+Pj4+IGhh bmdlZCBpbiB0aGUgYW1kZ3B1X21uX2ludmFsaWRhdGVfZ2Z4IGZ1bmN0aW9uOgo+Pj4+Pj4+Cj4+ Pj4+Pj4gWyAgNzM4LjM1OTIwMl0gMSBsb2NrIGhlbGQgYnkgTWF0cml4TXVsdGlwbGljLzY1MzoK Pj4+Pj4+PiBbICA3MzguMzU5MjA2XSAgIzA6IGZmZmY4ODgxMGUzNjRmZTAKPj4+Pj4+PiAoJmFk ZXYtPm5vdGlmaWVyX2xvY2speysuKy59LXszOjN9LCBhdDoKPj4+Pj4+PiBhbWRncHVfbW5faW52 YWxpZGF0ZV9nZngrMHgzNC8weGEwIFthbWRncHVdCj4+Pj4+Pj4KPj4+Pj4+PiBJIGNhbiBzZWUg aW4gdGhlIHRoZSBhbWRncHVfbW5faW52YWxpZGF0ZV9nZnggZnVuY3Rpb246IHRoZQo+Pj4+Pj4+ IGRtYV9yZXN2X3dhaXRfdGltZW91dF9yY3UgdXNlcyB3YWl0X2FsbCAoZmVuY2VzKSBhbmQgTUFY X1NDSEVEVUxFX1RJTUVPVVQgc28sIEkKPj4+Pj4+PiBndWVzcyB0aGUgY29kZSBnZXRzIHN0dWNr IHRoZXJlIHdhaXRpbmcgZm9yZXZlci4gQWNjb3JkaW5nIHRvIHRoZQo+Pj4+Pj4+IGRvY3VtZW50 YXRpb246ICJXaGVuIHNvbWVib2R5IHRyaWVzIHRvIGludmFsaWRhdGUgdGhlIHBhZ2UgdGFibGVz IHdlIGJsb2NrIHRoZQo+Pj4+Pj4+IHVwZGF0ZSB1bnRpbCBhbGwgb3BlcmF0aW9ucyBvbiB0aGUg cGFnZXMgaW4gcXVlc3Rpb24gYXJlIGNvbXBsZXRlZCwgdGhlbiB0aG9zZQo+Pj4+Pj4+IHBhZ2Vz IGFyZSBtYXJrZWQgIGFzIGFjY2Vzc2VkIGFuZCBhbHNvIGRpcnR5IGlmIGl0IHdhc27igJl0IGEg cmVhZCBvbmx5IGFjY2Vzcy4iCj4+Pj4+Pj4gTG9va3MgbGlrZSB0aGUgZmVuY2VzIGFyZSBkZWFk bG9ja2VkIGFuZCB0aGVyZWZvcmUsIGl0IG5ldmVyIHJldHVybnMuIENvdWxkIGl0Cj4+Pj4+Pj4g YmUgcG9zc2libGU/IGFueSBoaW50IHRvIHdoZXJlIGNhbiBJIGxvb2sgdG8gZml4IHRoaXM/Cj4+ Pj4+Pj4KPj4+Pj4+PiBUaGFuayB5b3UgIGluIGFkdmFuY2UuCj4+Pj4+Pj4KPj4+Pj4+PiBIZXJl IHRoZSBmdWxsIGRtZXNnIG91dHB1dDoKPj4+Pj4+Pgo+Pj4+Pj4+IFsgIDczOC4zMzc3MjZdIElO Rk86IHRhc2sgTWF0cml4TXVsdGlwbGljOjY1MyBibG9ja2VkIGZvciBtb3JlIHRoYW4gMTIyIHNl Y29uZHMuCj4+Pj4+Pj4gWyAgNzM4LjM0NDkzN10gICAgICAgTm90IHRhaW50ZWQgNS4xMS4wLXJj Ni1xdGVjLXN0YW5kYXJkICMyCj4+Pj4+Pj4gWyAgNzM4LjM1MDM4NF0gImVjaG8gMCA+IC9wcm9j L3N5cy9rZXJuZWwvaHVuZ190YXNrX3RpbWVvdXRfc2VjcyIKPj4+Pj4+PiBkaXNhYmxlcyB0aGlz IG1lc3NhZ2UuCj4+Pj4+Pj4gWyAgNzM4LjM1ODI0MF0gdGFzazpNYXRyaXhNdWx0aXBsaWMgc3Rh dGU6RCBzdGFjazogICAgMCBwaWQ6ICA2NTMKPj4+Pj4+PiBwcGlkOiAgICAgMSBmbGFnczoweDAw MDA0MDAwCj4+Pj4+Pj4gWyAgNzM4LjM1ODI1NF0gQ2FsbCBUcmFjZToKPj4+Pj4+PiBbICA3Mzgu MzU4MjYxXSAgPyBkbWFfZmVuY2VfZGVmYXVsdF93YWl0KzB4MWViLzB4MjMwCj4+Pj4+Pj4gWyAg NzM4LjM1ODI3Nl0gIF9fc2NoZWR1bGUrMHgzNzAvMHg5NjAKPj4+Pj4+PiBbICA3MzguMzU4Mjkx XSAgPyBkbWFfZmVuY2VfZGVmYXVsdF93YWl0KzB4MTE3LzB4MjMwCj4+Pj4+Pj4gWyAgNzM4LjM1 ODI5N10gID8gZG1hX2ZlbmNlX2RlZmF1bHRfd2FpdCsweDFlYi8weDIzMAo+Pj4+Pj4+IFsgIDcz OC4zNTgzMDVdICBzY2hlZHVsZSsweDUxLzB4YzAKPj4+Pj4+PiBbICA3MzguMzU4MzEyXSAgc2No ZWR1bGVfdGltZW91dCsweDI3NS8weDM4MAo+Pj4+Pj4+IFsgIDczOC4zNTgzMjRdICA/IGRtYV9m ZW5jZV9kZWZhdWx0X3dhaXQrMHgxZWIvMHgyMzAKPj4+Pj4+PiBbICA3MzguMzU4MzMyXSAgPyBt YXJrX2hlbGRfbG9ja3MrMHg0Zi8weDcwCj4+Pj4+Pj4gWyAgNzM4LjM1ODM0MV0gID8gZG1hX2Zl bmNlX2RlZmF1bHRfd2FpdCsweDExNy8weDIzMAo+Pj4+Pj4+IFsgIDczOC4zNTgzNDddICA/IGxv Y2tkZXBfaGFyZGlycXNfb25fcHJlcGFyZSsweGQ0LzB4MTgwCj4+Pj4+Pj4gWyAgNzM4LjM1ODM1 M10gID8gX3Jhd19zcGluX3VubG9ja19pcnFyZXN0b3JlKzB4MzkvMHg0MAo+Pj4+Pj4+IFsgIDcz OC4zNTgzNjJdICA/IGRtYV9mZW5jZV9kZWZhdWx0X3dhaXQrMHgxMTcvMHgyMzAKPj4+Pj4+PiBb ICA3MzguMzU4MzcwXSAgPyBkbWFfZmVuY2VfZGVmYXVsdF93YWl0KzB4MWViLzB4MjMwCj4+Pj4+ Pj4gWyAgNzM4LjM1ODM3NV0gIGRtYV9mZW5jZV9kZWZhdWx0X3dhaXQrMHgyMTQvMHgyMzAKPj4+ Pj4+PiBbICA3MzguMzU4Mzg0XSAgPyBkbWFfZmVuY2VfcmVsZWFzZSsweDFhMC8weDFhMAo+Pj4+ Pj4+IFsgIDczOC4zNTgzOTZdICBkbWFfZmVuY2Vfd2FpdF90aW1lb3V0KzB4MTA1LzB4MjAwCj4+ Pj4+Pj4gWyAgNzM4LjM1ODQwNV0gIGRtYV9yZXN2X3dhaXRfdGltZW91dF9yY3UrMHgxYWEvMHg1 ZTAKPj4+Pj4+PiBbICA3MzguMzU4NDIxXSAgYW1kZ3B1X21uX2ludmFsaWRhdGVfZ2Z4KzB4NTUv MHhhMCBbYW1kZ3B1XQo+Pj4+Pj4+IFsgIDczOC4zNTg2ODhdICBfX21tdV9ub3RpZmllcl9yZWxl YXNlKzB4MWJiLzB4MjEwCj4+Pj4+Pj4gWyAgNzM4LjM1ODcxMF0gIGV4aXRfbW1hcCsweDJmLzB4 MWUwCj4+Pj4+Pj4gWyAgNzM4LjM1ODcyM10gID8gZmluZF9oZWxkX2xvY2srMHgzNC8weGEwCj4+ Pj4+Pj4gWyAgNzM4LjM1ODc0Nl0gIG1tcHV0KzB4MzkvMHhlMAo+Pj4+Pj4+IFsgIDczOC4zNTg3 NTZdICBkb19leGl0KzB4NWMzLzB4YzAwCj4+Pj4+Pj4gWyAgNzM4LjM1ODc2M10gID8gZmluZF9o ZWxkX2xvY2srMHgzNC8weGEwCj4+Pj4+Pj4gWyAgNzM4LjM1ODc4MF0gIGRvX2dyb3VwX2V4aXQr MHg0Ny8weGIwCj4+Pj4+Pj4gWyAgNzM4LjM1ODc5MV0gIGdldF9zaWduYWwrMHgxNWIvMHhjNTAK Pj4+Pj4+PiBbICA3MzguMzU4ODA3XSAgYXJjaF9kb19zaWduYWxfb3JfcmVzdGFydCsweGFmLzB4 NzEwCj4+Pj4+Pj4gWyAgNzM4LjM1ODgxNl0gID8gbG9ja2RlcF9oYXJkaXJxc19vbl9wcmVwYXJl KzB4ZDQvMHgxODAKPj4+Pj4+PiBbICA3MzguMzU4ODIyXSAgPyBfcmF3X3NwaW5fdW5sb2NrX2ly cXJlc3RvcmUrMHgzOS8weDQwCj4+Pj4+Pj4gWyAgNzM4LjM1ODgzMV0gID8ga3RpbWVfZ2V0X21v bm9fZmFzdF9ucysweDUwLzB4YTAKPj4+Pj4+PiBbICA3MzguMzU4ODQ0XSAgPyBhbWRncHVfZHJt X2lvY3RsKzB4NmIvMHg4MCBbYW1kZ3B1XQo+Pj4+Pj4+IFsgIDczOC4zNTkwNDRdICBleGl0X3Rv X3VzZXJfbW9kZV9wcmVwYXJlKzB4ZjIvMHgxYjAKPj4+Pj4+PiBbICA3MzguMzU5MDU0XSAgc3lz Y2FsbF9leGl0X3RvX3VzZXJfbW9kZSsweDE5LzB4NjAKPj4+Pj4+PiBbICA3MzguMzU5MDYyXSAg ZW50cnlfU1lTQ0FMTF82NF9hZnRlcl9od2ZyYW1lKzB4NDQvMHhhOQo+Pj4+Pj4+IFsgIDczOC4z NTkwNjldIFJJUDogMDAzMzoweDdmNmI4OWE1MTg4Nwo+Pj4+Pj4+IFsgIDczOC4zNTkwNzZdIFJT UDogMDAyYjowMDAwN2Y2YjgyYjU0YjE4IEVGTEFHUzogMDAwMDAyNDYgT1JJR19SQVg6Cj4+Pj4+ Pj4gMDAwMDAwMDAwMDAwMDAxMAo+Pj4+Pj4+IFsgIDczOC4zNTkwODZdIFJBWDogZmZmZmZmZmZm ZmZmZmUwMCBSQlg6IDAwMDA3ZjZiODJiNTRiNTAgUkNYOiAwMDAwN2Y2Yjg5YTUxODg3Cj4+Pj4+ Pj4gWyAgNzM4LjM1OTA5MV0gUkRYOiAwMDAwN2Y2YjgyYjU0YjUwIFJTSTogMDAwMDAwMDBjMDIw NjRjMyBSREk6IDAwMDAwMDAwMDAwMDAwMDcKPj4+Pj4+PiBbICA3MzguMzU5MDk2XSBSQlA6IDAw MDAwMDAwYzAyMDY0YzMgUjA4OiAwMDAwMDAwMDAwMDAwMDAzIFIwOTogMDAwMDdmNmI4MmI1NGJi Ywo+Pj4+Pj4+IFsgIDczOC4zNTkxMDFdIFIxMDogMDAwMDAwMDAwMDAwMDAwMSBSMTE6IDAwMDAw MDAwMDAwMDAyNDYgUjEyOiAwMDAwMDAwMTY1YTBiYzAwCj4+Pj4+Pj4gWyAgNzM4LjM1OTEwNl0g UjEzOiAwMDAwMDAwMDAwMDAwMDA3IFIxNDogMDAwMDAwMDAwMDAwMDAwMSBSMTU6IDAwMDAwMDAw MDAwMDAwMDAKPj4+Pj4+PiBbICA3MzguMzU5MTI5XQo+Pj4+Pj4+ICAgICAgICAgICAgICAgICAg IFNob3dpbmcgYWxsIGxvY2tzIGhlbGQgaW4gdGhlIHN5c3RlbToKPj4+Pj4+PiBbICA3MzguMzU5 MTQxXSAxIGxvY2sgaGVsZCBieSBraHVuZ3Rhc2tkLzU0Ogo+Pj4+Pj4+IFsgIDczOC4zNTkxNDhd ICAjMDogZmZmZmZmZmY4MjlmNjg0MCAocmN1X3JlYWRfbG9jayl7Li4uLn0tezE6Mn0sIGF0Ogo+ Pj4+Pj4+IGRlYnVnX3Nob3dfYWxsX2xvY2tzKzB4MTUvMHgxODMKPj4+Pj4+PiBbICA3MzguMzU5 MTg3XSAxIGxvY2sgaGVsZCBieSBzeXN0ZW1kLWpvdXJuYWwvMTc0Ogo+Pj4+Pj4+IFsgIDczOC4z NTkyMDJdIDEgbG9jayBoZWxkIGJ5IE1hdHJpeE11bHRpcGxpYy82NTM6Cj4+Pj4+Pj4gWyAgNzM4 LjM1OTIwNl0gICMwOiBmZmZmODg4MTBlMzY0ZmUwCj4+Pj4+Pj4gKCZhZGV2LT5ub3RpZmllcl9s b2NrKXsrLisufS17MzozfSwgYXQ6Cj4+Pj4+Pj4gYW1kZ3B1X21uX2ludmFsaWRhdGVfZ2Z4KzB4 MzQvMHhhMCBbYW1kZ3B1XQo+Pj4+Pj4+Cj4+Pj4+Pj4gRGFuaWVsCj4+Pj4+PiBfX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwo+Pj4+Pj4gZHJpLWRldmVsIG1h aWxpbmcgbGlzdAo+Pj4+Pj4gZHJpLWRldmVsQGxpc3RzLmZyZWVkZXNrdG9wLm9yZwo+Pj4+Pj4g aHR0cHM6Ly9uYW0xMS5zYWZlbGlua3MucHJvdGVjdGlvbi5vdXRsb29rLmNvbS8/dXJsPWh0dHBz JTNBJTJGJTJGbGlzdHMuZnJlZWRlc2t0b3Aub3JnJTJGbWFpbG1hbiUyRmxpc3RpbmZvJTJGZHJp LWRldmVsJmFtcDtkYXRhPTA0JTdDMDElN0NjaHJpc3RpYW4ua29lbmlnJTQwYW1kLmNvbSU3Qzgx MjAzZTViYWM1ODQxYjhlNWExMDhkOGM4MjA4N2E5JTdDM2RkODk2MWZlNDg4NGU2MDhlMTFhODJk OTk0ZTE4M2QlN0MwJTdDMCU3QzYzNzQ3OTM4OTMzOTI5NTYyMiU3Q1Vua25vd24lN0NUV0ZwYkda c2IzZDhleUpXSWpvaU1DNHdMakF3TURBaUxDSlFJam9pVjJsdU16SWlMQ0pCVGlJNklrMWhhV3dp TENKWFZDSTZNbjAlM0QlN0MxMDAwJmFtcDtzZGF0YT1SRFN4RDZPcUQ4SGFPQTJWbk5mYkp3TG5L emhDTGdPcjVTVkxqTEY5MWJBJTNEJmFtcDtyZXNlcnZlZD0wCj4+Pj4+Cj4+Pgo+Pj4gLS0KPj4+ IERhbmllbCBWZXR0ZXIKPj4+IFNvZnR3YXJlIEVuZ2luZWVyLCBJbnRlbCBDb3Jwb3JhdGlvbgo+ Pj4gaHR0cDovL2Jsb2cuZmZ3bGwuY2gKPiBfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fXwo+IGFtZC1nZnggbWFpbGluZyBsaXN0Cj4gYW1kLWdmeEBsaXN0cy5m cmVlZGVza3RvcC5vcmcKPiBodHRwczovL2xpc3RzLmZyZWVkZXNrdG9wLm9yZy9tYWlsbWFuL2xp c3RpbmZvL2FtZC1nZngKCl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fCmFtZC1nZnggbWFpbGluZyBsaXN0CmFtZC1nZnhAbGlzdHMuZnJlZWRlc2t0b3Aub3Jn Cmh0dHBzOi8vbGlzdHMuZnJlZWRlc2t0b3Aub3JnL21haWxtYW4vbGlzdGluZm8vYW1kLWdmeAo= From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.2 required=3.0 tests=BAYES_00,DKIM_ADSP_CUSTOM_MED, DKIM_INVALID,DKIM_SIGNED,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,NICE_REPLY_A,SPF_HELO_NONE, SPF_PASS,URIBL_BLOCKED,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id D63DEC433DB for ; Wed, 3 Feb 2021 12:21:26 +0000 (UTC) Received: from gabe.freedesktop.org (gabe.freedesktop.org [131.252.210.177]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 4A7C164F74 for ; Wed, 3 Feb 2021 12:21:26 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 4A7C164F74 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=gmail.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=dri-devel-bounces@lists.freedesktop.org Received: from gabe.freedesktop.org (localhost [127.0.0.1]) by gabe.freedesktop.org (Postfix) with ESMTP id 5F7516EA91; Wed, 3 Feb 2021 12:21:25 +0000 (UTC) Received: from mail-ed1-x535.google.com (mail-ed1-x535.google.com [IPv6:2a00:1450:4864:20::535]) by gabe.freedesktop.org (Postfix) with ESMTPS id 0D81B6EA8D; Wed, 3 Feb 2021 12:21:24 +0000 (UTC) Received: by mail-ed1-x535.google.com with SMTP id q2so11851422edi.4; Wed, 03 Feb 2021 04:21:23 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=reply-to:subject:to:cc:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-transfer-encoding:content-language; bh=bLF32KqYMp2Ag9MhzCy/CMzv0E6X87uMKhtUHj70LAE=; b=fXrZYMRoW24U8f0iJ5ejvqmSVq+CbSu6fwlCfOUAJfbz1btQ/fkgafj4Itw/J5SiYj K0Bk5c+WZOJDuHs/kkT1XVzcZEuUT0unUnjtEkPspkDLNyhSJMMmHkJfMj7nlUauzZ2x HhsE6IjyLPphw8fJ9Ykbt8e5qLQIEh0OzVztWsP8tkygMRLvwH3FD1womBHK97gqQXov cjmOgUKNkt6wsvR0+EmjiOPXiLC33Vx+upYeEofIIZc/ksGW0t3yj3LOiMHUtsj1mOZ/ 59H+TSkMBBkqQWubGYGZkV2YoAZ3q6Yr3f46eKUGWRRGbJBUgXcqup8dq516UhtRQB8M MCrA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:reply-to:subject:to:cc:references:from :message-id:date:user-agent:mime-version:in-reply-to :content-transfer-encoding:content-language; bh=bLF32KqYMp2Ag9MhzCy/CMzv0E6X87uMKhtUHj70LAE=; b=HS+DCZmObjrFNpIA7J2ZCgCewTNgmmigMZaJ3fNj+riQB8SjFBFSVkCERal7yovRgz mi8BQ8Kdhur6cvlGzMg1wMLOetpgELM6ZSgcgoJN42xpjFahhasOkgFZLdpFZEn9OffY OiN5BC7ensFOXGarcm+hW3i6sbf1feI7Sr1oi9F5pL0V0YO7Ag4E2jauV3tIMUfxLbvI 8Q5sZNJsxucS7ULMkbIm73PT04hhdiFzYbQmBWzx6KAaQ7+cyaQGaqlmJ8j354+j1ZXI cljvdQketl0TICneSxPW13zuJh0sjDDDokDHoClPcyuEtaudr/gEY3nL/XwM2MOjsFab tv/Q== X-Gm-Message-State: AOAM532QD+lJQvT/7MElJlHwcZOLH0bhOjvvl8zmCEcQWScYE4+L6Lou qrG5iC5IPJ8RAzUdF3uPpGY= X-Google-Smtp-Source: ABdhPJxBdLLD9NGdRzHVxag7BKf2yQFcixrwyfP7WT8VO2NoggPW8S6nyp5uD1yoY6pS3P2BmJmtXA== X-Received: by 2002:aa7:c682:: with SMTP id n2mr2685871edq.27.1612354882579; Wed, 03 Feb 2021 04:21:22 -0800 (PST) Received: from ?IPv6:2a02:908:1252:fb60:be8a:bd56:1f94:86e7? ([2a02:908:1252:fb60:be8a:bd56:1f94:86e7]) by smtp.gmail.com with ESMTPSA id u23sm782393edt.87.2021.02.03.04.21.21 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 03 Feb 2021 04:21:21 -0800 (PST) Subject: Re: [amdgpu] deadlock To: Daniel Gomez , Daniel Vetter References: <58e41b62-b8e0-b036-c87d-a84d53f5a26e@amd.com> From: =?UTF-8?Q?Christian_K=c3=b6nig?= Message-ID: <538682ee-3e12-a345-2205-2c0f16b496ff@gmail.com> Date: Wed, 3 Feb 2021 13:21:20 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.10.0 MIME-Version: 1.0 In-Reply-To: Content-Language: en-US X-BeenThere: dri-devel@lists.freedesktop.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Direct Rendering Infrastructure - Development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: christian.koenig@amd.com Cc: Alex Deucher , amd-gfx list , =?UTF-8?Q?Christian_K=c3=b6nig?= , dri-devel , Linux Kernel Mailing List Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8"; Format="flowed" Errors-To: dri-devel-bounces@lists.freedesktop.org Sender: "dri-devel" QW0gMDMuMDIuMjEgdW0gMTI6NDUgc2NocmllYiBEYW5pZWwgR29tZXo6Cj4gT24gV2VkLCAzIEZl YiAyMDIxIGF0IDEwOjQ3LCBEYW5pZWwgR29tZXogPGRhbmllbEBxdGVjLmNvbT4gd3JvdGU6Cj4+ IE9uIFdlZCwgMyBGZWIgMjAyMSBhdCAxMDoxNywgRGFuaWVsIFZldHRlciA8ZGFuaWVsQGZmd2xs LmNoPiB3cm90ZToKPj4+IE9uIFdlZCwgRmViIDMsIDIwMjEgYXQgOTo1MSBBTSBDaHJpc3RpYW4g S8O2bmlnIDxjaHJpc3RpYW4ua29lbmlnQGFtZC5jb20+IHdyb3RlOgo+Pj4+IEFtIDAzLjAyLjIx IHVtIDA5OjQ4IHNjaHJpZWIgRGFuaWVsIFZldHRlcjoKPj4+Pj4gT24gV2VkLCBGZWIgMywgMjAy MSBhdCA5OjM2IEFNIENocmlzdGlhbiBLw7ZuaWcgPGNocmlzdGlhbi5rb2VuaWdAYW1kLmNvbT4g d3JvdGU6Cj4+Pj4+PiBIaSBEYW5pZWwsCj4+Pj4+Pgo+Pj4+Pj4gdGhpcyBpcyBub3QgYSBkZWFk bG9jaywgYnV0IHJhdGhlciBhIGhhcmR3YXJlIGxvY2t1cC4KPj4+Pj4gQXJlIHlvdSBzdXJlPyBJ bWUgZ2V0dGluZyBzdHVjayBpbiBkbWFfZmVuY2Vfd2FpdCBoYXMgZ2VuZXJhbGx5IGdvb2QKPj4+ Pj4gY2hhbmNlIG9mIGJlaW5nIGEgZG1hX2ZlbmNlIGRlYWRsb2NrLiBHUFUgaGFuZyBzaG91bGQg bmV2ZXIgcmVzdWx0IGluCj4+Pj4+IGEgZm9yZXZlciBzdHVjayBkbWFfZmVuY2UuCj4+Pj4gWWVz LCBJJ20gcHJldHR5IHN1cmUuIE90aGVyd2lzZSB0aGUgaGFyZHdhcmUgY2xvY2tzIHdvdWxkbid0 IGdvIHVwIGxpa2UKPj4+PiB0aGlzLgo+Pj4gTWF5YmUgY2xhcmlmeWluZywgY291bGQgYmUgYm90 aC4gVERSIHNob3VsZCBub3RpY2UgYW5kIGdldCB1cyBvdXQgb2YKPj4+IHRoaXMsIGJ1dCBpZiB0 aGVyZSdzIGEgZG1hX2ZlbmNlIGRlYWRsb2NrIGFuZCB3ZSBjYW4ndCByZS1lbWl0IG9yCj4+PiBm b3JjZSBjb21wbGV0ZSB0aGUgcGVuZGluZyB0aGluZ3MsIHRoZW4gd2UncmUgc3R1Y2sgZm9yIGdv b2QuCj4+PiAtRGFuaWVsCj4+Pgo+Pj4+IFF1ZXN0aW9uIGlzIHJhdGhlciB3aHkgd2UgZW5kIHVw IGluIHRoZSB1c2VycHRyIGhhbmRsaW5nIGZvciBHRlg/IE91cgo+Pj4+IFJPQ20gT3BlbkNMIHN0 YWNrIHNob3VsZG4ndCB1c2UgdGhpcy4KPj4+Pgo+Pj4+PiBEYW5pZWwsIGNhbiB5b3UgcGxzIHJl LWhhbmcgeW91ciBtYWNoaW5lIGFuZCB0aGVuIGR1bXAgYmFja3RyYWNlcyBvZgo+Pj4+PiBhbGwg dGFza3MgaW50byBkbWVzZyB3aXRoIHN5c3JxLXQsIGFuZCB0aGVuIGF0dGFjaCB0aGF0PyBXaXRo b3V0IGFsbAo+Pj4+PiB0aGUgYmFja3RyYWNlcyBpdCdzIHRyaWNreSB0byBjb25zdHJ1Y3QgdGhl IGZ1bGwgZGVwZW5kZW5jeSBjaGFpbiBvZgo+Pj4+PiB3aGF0J3MgZ29pbmcgb24uIEFsc28gaXMg dGhpcyBwbGFpbiAtcmM2LCBub3Qgc29tZSBtb3JlIHBhdGNoZXMgb24KPj4+Pj4gdG9wPwo+Pj4+ IFllYWgsIHRoYXQncyBzdGlsbCBhIGdvb2QgaWRlYSB0byBoYXZlLgo+PiBIZXJlIHRoZSBmdWxs IGJhY2t0cmFjZSBkbWVzZyBsb2dzIGFmdGVyIHRoZSBoYW5nOgo+PiBodHRwczovL3Bhc3RlYmlu LmNvbS9yYXcva3ppdm0yTDMKPj4KPj4gVGhpcyBpcyBhbm90aGVyIGRtZXNnIGxvZyB3aXRoIHRo ZSBiYWNrdHJhY2VzIGFmdGVyIFNJR0tJTEwgdGhlIG1hdHJpeCBwcm9jZXNzOgo+PiAoSSBkaWRu J3QgaGF2ZSB0aGUgc3lzcnEgZW5hYmxlIGF0IHRoZSB0aW1lKToKPj4gaHR0cHM6Ly9wYXN0ZWJp bi5jb20vcmF3L3BSQndHY2oxCj4gSSd2ZSBub3cgcmVtb3ZlZCBhbGwgb3VyIHY0bDIgcGF0Y2hl cyBhbmQgZGlkIHRoZSBzYW1lIHRlc3Qgd2l0aCB0aGUgJ3BsYWluJwo+IG1haW5saW5lIHZlcnNp b24gKC1yYzYpLgo+Cj4gUmVmZXJlbmNlOiAzYWFmMGEyN2ZmYzI5YjE5YTYyMzE0ZWRkNjg0Yjli YzYzNDZmOWE4Cj4KPiBTYW1lIGVycm9yLCBzYW1lIGJlaGF2aW91ci4gRnVsbCBkbWVzZyBsb2cg YXR0YWNoZWQ6Cj4gaHR0cHM6Ly9wYXN0ZWJpbi5jb20vcmF3L0tnYUVmN1kxCj4gTm90ZToKPiAg ICBkbWVzZyB3aXRoIHN5c3JxLXQgYmVmb3JlIHJ1bm5pbmcgdGhlIHRlc3Qgc3RhcnRzIGluIFsg IDEyMi4wMTY1MDJdCj4gc3lzcnE6IFNob3cgU3RhdGUKPiAgICBkbWVzZyB3aXRoIHN5c3JxLXQg YWZ0ZXIgdGhlIHRlc3Qgc3RhcnRzIGluOiBbICA0OTUuNTg3NjcxXSBzeXNycTogU2hvdyBTdGF0 ZQoKVGhlcmUgaXMgbm90aGluZyBhbWRncHUgcmVsYXRlZCBpbiB0aGVyZSBleGNlcHQgZm9yIHdh aXRpbmcgZm9yIHRoZSAKaGFyZHdhcmUuCgpUaGlzIGlzIGEgcHJldHR5IHN0YW5kYXJkIGhhcmR3 YXJlIGxvY2t1cCwgYnV0IEknbSBzdGlsbCB3YWl0aW5nIGZvciBhbiAKZXhwbGFuYXRpb24gd2h5 IHdlIGVuZCB1cCBpbiB0aGlzIGNhbGwgcGF0aCBpbiB0aGUgZmlyc3QgcGxhY2UuCgpDaHJpc3Rp YW4uCgo+Cj4KPj4+PiBDaHJpc3RpYW4uCj4+Pj4KPj4+Pj4gLURhbmllbAo+Pj4+Pgo+Pj4+Pj4g V2hpY2ggT3BlbkNsIHN0YWNrIGFyZSB5b3UgdXNpbmc/Cj4+Pj4+Pgo+Pj4+Pj4gUmVnYXJkcywK Pj4+Pj4+IENocmlzdGlhbi4KPj4+Pj4+Cj4+Pj4+PiBBbSAwMy4wMi4yMSB1bSAwOTozMyBzY2hy aWViIERhbmllbCBHb21lejoKPj4+Pj4+PiBIaSBhbGwsCj4+Pj4+Pj4KPj4+Pj4+PiBJIGhhdmUg YSBkZWFkbG9jayB3aXRoIHRoZSBhbWRncHUgbWFpbmxpbmUgZHJpdmVyIHdoZW4gcnVubmluZyBp biBwYXJhbGxlbCB0d28KPj4+Pj4+PiBPcGVuQ0wgYXBwbGljYXRpb25zLiBTbyBmYXIsIHdlJ3Zl IGJlZW4gYWJsZSB0byByZXBsaWNhdGUgaXQgZWFzaWx5IGJ5IGV4ZWN1dGluZwo+Pj4+Pj4+IGNs aW5mbyBhbmQgTWF0cml4TXVsdGlwbGljYXRpb24gKGZyb20gQU1EIG9wZW5jbC1zYW1wbGVzKS4g SXQncyBxdWl0ZSBvbGQgdGhlCj4+Pj4+Pj4gb3BlbmNsLXNhbXBsZXMgc28sIGlmIHlvdSBoYXZl IGFueSBvdGhlciBzdWdnZXN0aW9uIGZvciB0ZXN0aW5nIEknZCBiZSB2ZXJ5Cj4+Pj4+Pj4gaGFw cHkgdG8gdGVzdCBpdCBhcyB3ZWxsLgo+Pj4+Pj4+Cj4+Pj4+Pj4gSG93IHRvIHJlcGxpY2F0ZSB0 aGUgaXNzdWU6Cj4+Pj4+Pj4KPj4+Pj4+PiAjIHdoaWxlIHRydWU7IGRvIC91c3IvYmluL01hdHJp eE11bHRpcGxpY2F0aW9uIC0tZGV2aWNlIGdwdSBcCj4+Pj4+Pj4gICAgICAgIC0tZGV2aWNlSWQg MCAteCAxMDAwIC15IDEwMDAgLXogMTAwMCAtcSAtdCAtaSA1MDsgZG9uZQo+Pj4+Pj4+ICMgd2hp bGUgdHJ1ZTsgZG8gY2xpbmZvOyBkb25lCj4+Pj4+Pj4KPj4+Pj4+PiBPdXRwdXQ6Cj4+Pj4+Pj4K Pj4+Pj4+PiBBZnRlciBhIG1pbnV0ZSBvciBsZXNzIChzb21ldGltZXMgY291bGQgYmUgbW9yZSkg SSBjYW4gc2VlIHRoYXQKPj4+Pj4+PiBNYXRyaXhNdWx0aXBsaWNhdGlvbiBhbmQgY2xpbmZvIGhh bmcuIEluIGFkZGl0aW9uLCB3aXRoIHJhZGVvbnRvcCB5b3UgY2FuIHNlZQo+Pj4+Pj4+IGhvdyB0 aGUgR3JhcGhpY3MgcGlwZSBnb2VzIGZyb20gfjUwJSB0byAxMDAlLiBBbHNvIHRoZSBzaGFkZXIg Y2xvY2tzCj4+Pj4+Pj4gZ29lcyB1cCBmcm9tIH4zNSUgdG8gfjk2JS4KPj4+Pj4+Pgo+Pj4+Pj4+ IGNsaW5mbyBrZWVwcyBwcmludGluZzoKPj4+Pj4+PiBpb2N0bCg3LCBEUk1fSU9DVExfU1lOQ09C Sl9XQUlULCAweDdmZmU0NmU1Zjk1MCkgPSAtMSBFVElNRSAoVGltZXIgZXhwaXJlZCkKPj4+Pj4+ Pgo+Pj4+Pj4+IEFuZCBNYXRyaXhNdWx0aXBsaWNhdGlvbiBwcmludHMgdGhlIGZvbGxvd2luZyAo c3RyYWNlKSBpZiB5b3UgdHJ5IHRvCj4+Pj4+Pj4ga2lsbCB0aGUgcHJvY2VzczoKPj4+Pj4+Pgo+ Pj4+Pj4+IHNjaGVkX3lpZWxkKCkgICAgICAgICAgICAgICAgICAgICAgICAgICA9IDAKPj4+Pj4+ PiBmdXRleCgweDU1N2U5NDUzNDNiOCwgRlVURVhfV0FJVF9CSVRTRVRfUFJJVkFURXxGVVRFWF9D TE9DS19SRUFMVElNRSwgMCwKPj4+Pj4+PiBOVUxMLCBGVVRFWF9CSVRTRVRfTUFUQ0hfQU5Zc3Ry YWNlOiBQcm9jZXNzIDY1MSBkZXRhY2hlZAo+Pj4+Pj4+ICAgICA8ZGV0YWNoZWQgLi4uPgo+Pj4+ Pj4+Cj4+Pj4+Pj4gQWZ0ZXIgdGhpcywgdGhlIGdwdSBpcyBub3QgZnVuY3Rpb25hbCBhdCBhbGwg YW5kIHlvdSdkIG5lZWQgYSBwb3dlciBjeWNsZSByZXNldAo+Pj4+Pj4+IHRvIHJlc3RvcmUgdGhl IHN5c3RlbS4KPj4+Pj4+Pgo+Pj4+Pj4+IEhhcmR3YXJlIGluZm86Cj4+Pj4+Pj4gQ1BVOiBBTUQg Unl6ZW4gRW1iZWRkZWQgVjE2MDVCIHdpdGggUmFkZW9uIFZlZ2EgR2Z4ICg4KSBAIDIuMDAwR0h6 Cj4+Pj4+Pj4gR1BVOiBBTUQgQVRJIFJhZGVvbiBWZWdhIFNlcmllcyAvIFJhZGVvbiBWZWdhIE1v YmlsZSBTZXJpZXMKPj4+Pj4+Pgo+Pj4+Pj4+IDAzOjAwLjAgVkdBIGNvbXBhdGlibGUgY29udHJv bGxlcjogQWR2YW5jZWQgTWljcm8gRGV2aWNlcywgSW5jLgo+Pj4+Pj4+IFtBTUQvQVRJXSBSYXZl biBSaWRnZSBbUmFkZW9uIFZlZ2EgU2VyaWVzIC8gUmFkZW9uIFZlZ2EgTW9iaWxlIFNlcmllc10K Pj4+Pj4+PiAocmV2IDgzKQo+Pj4+Pj4+ICAgICAgICBEZXZpY2VOYW1lOiBCcm9hZGNvbSA1NzYy Cj4+Pj4+Pj4gICAgICAgIFN1YnN5c3RlbTogQWR2YW5jZWQgTWljcm8gRGV2aWNlcywgSW5jLiBb QU1EL0FUSV0gUmF2ZW4gUmlkZ2UKPj4+Pj4+PiBbUmFkZW9uIFZlZ2EgU2VyaWVzIC8gUmFkZW9u IFZlZ2EgTW9iaWxlIFNlcmllc10KPj4+Pj4+PiAgICAgICAgS2VybmVsIGRyaXZlciBpbiB1c2U6 IGFtZGdwdQo+Pj4+Pj4+ICAgICAgICBLZXJuZWwgbW9kdWxlczogYW1kZ3B1Cj4+Pj4+Pj4KPj4+ Pj4+PiBMaW51eCBrZXJuZWwgaW5mbzoKPj4+Pj4+Pgo+Pj4+Pj4+IHJvb3RAcXQ1MjIyOn4jIHVu YW1lIC1hCj4+Pj4+Pj4gTGludXggcXQ1MjIyIDUuMTEuMC1yYzYtcXRlYy1zdGFuZGFyZCAjMiBT TVAgVHVlIEZlYiAyIDA5OjQxOjQ2IFVUQwo+Pj4+Pj4+IDIwMjEgeDg2XzY0IHg4Nl82NCB4ODZf NjQgR05VL0xpbnV4Cj4+Pj4+Pj4KPj4+Pj4+PiBCeSBlbmFibGluZyB0aGUga2VybmVsIGxvY2tz IHN0YXRzIEkgY291bGQgc2VlIHRoZSBNYXRyaXhNdWx0aXBsaWNhdGlvbiBpcwo+Pj4+Pj4+IGhh bmdlZCBpbiB0aGUgYW1kZ3B1X21uX2ludmFsaWRhdGVfZ2Z4IGZ1bmN0aW9uOgo+Pj4+Pj4+Cj4+ Pj4+Pj4gWyAgNzM4LjM1OTIwMl0gMSBsb2NrIGhlbGQgYnkgTWF0cml4TXVsdGlwbGljLzY1MzoK Pj4+Pj4+PiBbICA3MzguMzU5MjA2XSAgIzA6IGZmZmY4ODgxMGUzNjRmZTAKPj4+Pj4+PiAoJmFk ZXYtPm5vdGlmaWVyX2xvY2speysuKy59LXszOjN9LCBhdDoKPj4+Pj4+PiBhbWRncHVfbW5faW52 YWxpZGF0ZV9nZngrMHgzNC8weGEwIFthbWRncHVdCj4+Pj4+Pj4KPj4+Pj4+PiBJIGNhbiBzZWUg aW4gdGhlIHRoZSBhbWRncHVfbW5faW52YWxpZGF0ZV9nZnggZnVuY3Rpb246IHRoZQo+Pj4+Pj4+ IGRtYV9yZXN2X3dhaXRfdGltZW91dF9yY3UgdXNlcyB3YWl0X2FsbCAoZmVuY2VzKSBhbmQgTUFY X1NDSEVEVUxFX1RJTUVPVVQgc28sIEkKPj4+Pj4+PiBndWVzcyB0aGUgY29kZSBnZXRzIHN0dWNr IHRoZXJlIHdhaXRpbmcgZm9yZXZlci4gQWNjb3JkaW5nIHRvIHRoZQo+Pj4+Pj4+IGRvY3VtZW50 YXRpb246ICJXaGVuIHNvbWVib2R5IHRyaWVzIHRvIGludmFsaWRhdGUgdGhlIHBhZ2UgdGFibGVz IHdlIGJsb2NrIHRoZQo+Pj4+Pj4+IHVwZGF0ZSB1bnRpbCBhbGwgb3BlcmF0aW9ucyBvbiB0aGUg cGFnZXMgaW4gcXVlc3Rpb24gYXJlIGNvbXBsZXRlZCwgdGhlbiB0aG9zZQo+Pj4+Pj4+IHBhZ2Vz IGFyZSBtYXJrZWQgIGFzIGFjY2Vzc2VkIGFuZCBhbHNvIGRpcnR5IGlmIGl0IHdhc27igJl0IGEg cmVhZCBvbmx5IGFjY2Vzcy4iCj4+Pj4+Pj4gTG9va3MgbGlrZSB0aGUgZmVuY2VzIGFyZSBkZWFk bG9ja2VkIGFuZCB0aGVyZWZvcmUsIGl0IG5ldmVyIHJldHVybnMuIENvdWxkIGl0Cj4+Pj4+Pj4g YmUgcG9zc2libGU/IGFueSBoaW50IHRvIHdoZXJlIGNhbiBJIGxvb2sgdG8gZml4IHRoaXM/Cj4+ Pj4+Pj4KPj4+Pj4+PiBUaGFuayB5b3UgIGluIGFkdmFuY2UuCj4+Pj4+Pj4KPj4+Pj4+PiBIZXJl IHRoZSBmdWxsIGRtZXNnIG91dHB1dDoKPj4+Pj4+Pgo+Pj4+Pj4+IFsgIDczOC4zMzc3MjZdIElO Rk86IHRhc2sgTWF0cml4TXVsdGlwbGljOjY1MyBibG9ja2VkIGZvciBtb3JlIHRoYW4gMTIyIHNl Y29uZHMuCj4+Pj4+Pj4gWyAgNzM4LjM0NDkzN10gICAgICAgTm90IHRhaW50ZWQgNS4xMS4wLXJj Ni1xdGVjLXN0YW5kYXJkICMyCj4+Pj4+Pj4gWyAgNzM4LjM1MDM4NF0gImVjaG8gMCA+IC9wcm9j L3N5cy9rZXJuZWwvaHVuZ190YXNrX3RpbWVvdXRfc2VjcyIKPj4+Pj4+PiBkaXNhYmxlcyB0aGlz IG1lc3NhZ2UuCj4+Pj4+Pj4gWyAgNzM4LjM1ODI0MF0gdGFzazpNYXRyaXhNdWx0aXBsaWMgc3Rh dGU6RCBzdGFjazogICAgMCBwaWQ6ICA2NTMKPj4+Pj4+PiBwcGlkOiAgICAgMSBmbGFnczoweDAw MDA0MDAwCj4+Pj4+Pj4gWyAgNzM4LjM1ODI1NF0gQ2FsbCBUcmFjZToKPj4+Pj4+PiBbICA3Mzgu MzU4MjYxXSAgPyBkbWFfZmVuY2VfZGVmYXVsdF93YWl0KzB4MWViLzB4MjMwCj4+Pj4+Pj4gWyAg NzM4LjM1ODI3Nl0gIF9fc2NoZWR1bGUrMHgzNzAvMHg5NjAKPj4+Pj4+PiBbICA3MzguMzU4Mjkx XSAgPyBkbWFfZmVuY2VfZGVmYXVsdF93YWl0KzB4MTE3LzB4MjMwCj4+Pj4+Pj4gWyAgNzM4LjM1 ODI5N10gID8gZG1hX2ZlbmNlX2RlZmF1bHRfd2FpdCsweDFlYi8weDIzMAo+Pj4+Pj4+IFsgIDcz OC4zNTgzMDVdICBzY2hlZHVsZSsweDUxLzB4YzAKPj4+Pj4+PiBbICA3MzguMzU4MzEyXSAgc2No ZWR1bGVfdGltZW91dCsweDI3NS8weDM4MAo+Pj4+Pj4+IFsgIDczOC4zNTgzMjRdICA/IGRtYV9m ZW5jZV9kZWZhdWx0X3dhaXQrMHgxZWIvMHgyMzAKPj4+Pj4+PiBbICA3MzguMzU4MzMyXSAgPyBt YXJrX2hlbGRfbG9ja3MrMHg0Zi8weDcwCj4+Pj4+Pj4gWyAgNzM4LjM1ODM0MV0gID8gZG1hX2Zl bmNlX2RlZmF1bHRfd2FpdCsweDExNy8weDIzMAo+Pj4+Pj4+IFsgIDczOC4zNTgzNDddICA/IGxv Y2tkZXBfaGFyZGlycXNfb25fcHJlcGFyZSsweGQ0LzB4MTgwCj4+Pj4+Pj4gWyAgNzM4LjM1ODM1 M10gID8gX3Jhd19zcGluX3VubG9ja19pcnFyZXN0b3JlKzB4MzkvMHg0MAo+Pj4+Pj4+IFsgIDcz OC4zNTgzNjJdICA/IGRtYV9mZW5jZV9kZWZhdWx0X3dhaXQrMHgxMTcvMHgyMzAKPj4+Pj4+PiBb ICA3MzguMzU4MzcwXSAgPyBkbWFfZmVuY2VfZGVmYXVsdF93YWl0KzB4MWViLzB4MjMwCj4+Pj4+ Pj4gWyAgNzM4LjM1ODM3NV0gIGRtYV9mZW5jZV9kZWZhdWx0X3dhaXQrMHgyMTQvMHgyMzAKPj4+ Pj4+PiBbICA3MzguMzU4Mzg0XSAgPyBkbWFfZmVuY2VfcmVsZWFzZSsweDFhMC8weDFhMAo+Pj4+ Pj4+IFsgIDczOC4zNTgzOTZdICBkbWFfZmVuY2Vfd2FpdF90aW1lb3V0KzB4MTA1LzB4MjAwCj4+ Pj4+Pj4gWyAgNzM4LjM1ODQwNV0gIGRtYV9yZXN2X3dhaXRfdGltZW91dF9yY3UrMHgxYWEvMHg1 ZTAKPj4+Pj4+PiBbICA3MzguMzU4NDIxXSAgYW1kZ3B1X21uX2ludmFsaWRhdGVfZ2Z4KzB4NTUv MHhhMCBbYW1kZ3B1XQo+Pj4+Pj4+IFsgIDczOC4zNTg2ODhdICBfX21tdV9ub3RpZmllcl9yZWxl YXNlKzB4MWJiLzB4MjEwCj4+Pj4+Pj4gWyAgNzM4LjM1ODcxMF0gIGV4aXRfbW1hcCsweDJmLzB4 MWUwCj4+Pj4+Pj4gWyAgNzM4LjM1ODcyM10gID8gZmluZF9oZWxkX2xvY2srMHgzNC8weGEwCj4+ Pj4+Pj4gWyAgNzM4LjM1ODc0Nl0gIG1tcHV0KzB4MzkvMHhlMAo+Pj4+Pj4+IFsgIDczOC4zNTg3 NTZdICBkb19leGl0KzB4NWMzLzB4YzAwCj4+Pj4+Pj4gWyAgNzM4LjM1ODc2M10gID8gZmluZF9o ZWxkX2xvY2srMHgzNC8weGEwCj4+Pj4+Pj4gWyAgNzM4LjM1ODc4MF0gIGRvX2dyb3VwX2V4aXQr MHg0Ny8weGIwCj4+Pj4+Pj4gWyAgNzM4LjM1ODc5MV0gIGdldF9zaWduYWwrMHgxNWIvMHhjNTAK Pj4+Pj4+PiBbICA3MzguMzU4ODA3XSAgYXJjaF9kb19zaWduYWxfb3JfcmVzdGFydCsweGFmLzB4 NzEwCj4+Pj4+Pj4gWyAgNzM4LjM1ODgxNl0gID8gbG9ja2RlcF9oYXJkaXJxc19vbl9wcmVwYXJl KzB4ZDQvMHgxODAKPj4+Pj4+PiBbICA3MzguMzU4ODIyXSAgPyBfcmF3X3NwaW5fdW5sb2NrX2ly cXJlc3RvcmUrMHgzOS8weDQwCj4+Pj4+Pj4gWyAgNzM4LjM1ODgzMV0gID8ga3RpbWVfZ2V0X21v bm9fZmFzdF9ucysweDUwLzB4YTAKPj4+Pj4+PiBbICA3MzguMzU4ODQ0XSAgPyBhbWRncHVfZHJt X2lvY3RsKzB4NmIvMHg4MCBbYW1kZ3B1XQo+Pj4+Pj4+IFsgIDczOC4zNTkwNDRdICBleGl0X3Rv X3VzZXJfbW9kZV9wcmVwYXJlKzB4ZjIvMHgxYjAKPj4+Pj4+PiBbICA3MzguMzU5MDU0XSAgc3lz Y2FsbF9leGl0X3RvX3VzZXJfbW9kZSsweDE5LzB4NjAKPj4+Pj4+PiBbICA3MzguMzU5MDYyXSAg ZW50cnlfU1lTQ0FMTF82NF9hZnRlcl9od2ZyYW1lKzB4NDQvMHhhOQo+Pj4+Pj4+IFsgIDczOC4z NTkwNjldIFJJUDogMDAzMzoweDdmNmI4OWE1MTg4Nwo+Pj4+Pj4+IFsgIDczOC4zNTkwNzZdIFJT UDogMDAyYjowMDAwN2Y2YjgyYjU0YjE4IEVGTEFHUzogMDAwMDAyNDYgT1JJR19SQVg6Cj4+Pj4+ Pj4gMDAwMDAwMDAwMDAwMDAxMAo+Pj4+Pj4+IFsgIDczOC4zNTkwODZdIFJBWDogZmZmZmZmZmZm ZmZmZmUwMCBSQlg6IDAwMDA3ZjZiODJiNTRiNTAgUkNYOiAwMDAwN2Y2Yjg5YTUxODg3Cj4+Pj4+ Pj4gWyAgNzM4LjM1OTA5MV0gUkRYOiAwMDAwN2Y2YjgyYjU0YjUwIFJTSTogMDAwMDAwMDBjMDIw NjRjMyBSREk6IDAwMDAwMDAwMDAwMDAwMDcKPj4+Pj4+PiBbICA3MzguMzU5MDk2XSBSQlA6IDAw MDAwMDAwYzAyMDY0YzMgUjA4OiAwMDAwMDAwMDAwMDAwMDAzIFIwOTogMDAwMDdmNmI4MmI1NGJi Ywo+Pj4+Pj4+IFsgIDczOC4zNTkxMDFdIFIxMDogMDAwMDAwMDAwMDAwMDAwMSBSMTE6IDAwMDAw MDAwMDAwMDAyNDYgUjEyOiAwMDAwMDAwMTY1YTBiYzAwCj4+Pj4+Pj4gWyAgNzM4LjM1OTEwNl0g UjEzOiAwMDAwMDAwMDAwMDAwMDA3IFIxNDogMDAwMDAwMDAwMDAwMDAwMSBSMTU6IDAwMDAwMDAw MDAwMDAwMDAKPj4+Pj4+PiBbICA3MzguMzU5MTI5XQo+Pj4+Pj4+ICAgICAgICAgICAgICAgICAg IFNob3dpbmcgYWxsIGxvY2tzIGhlbGQgaW4gdGhlIHN5c3RlbToKPj4+Pj4+PiBbICA3MzguMzU5 MTQxXSAxIGxvY2sgaGVsZCBieSBraHVuZ3Rhc2tkLzU0Ogo+Pj4+Pj4+IFsgIDczOC4zNTkxNDhd ICAjMDogZmZmZmZmZmY4MjlmNjg0MCAocmN1X3JlYWRfbG9jayl7Li4uLn0tezE6Mn0sIGF0Ogo+ Pj4+Pj4+IGRlYnVnX3Nob3dfYWxsX2xvY2tzKzB4MTUvMHgxODMKPj4+Pj4+PiBbICA3MzguMzU5 MTg3XSAxIGxvY2sgaGVsZCBieSBzeXN0ZW1kLWpvdXJuYWwvMTc0Ogo+Pj4+Pj4+IFsgIDczOC4z NTkyMDJdIDEgbG9jayBoZWxkIGJ5IE1hdHJpeE11bHRpcGxpYy82NTM6Cj4+Pj4+Pj4gWyAgNzM4 LjM1OTIwNl0gICMwOiBmZmZmODg4MTBlMzY0ZmUwCj4+Pj4+Pj4gKCZhZGV2LT5ub3RpZmllcl9s b2NrKXsrLisufS17MzozfSwgYXQ6Cj4+Pj4+Pj4gYW1kZ3B1X21uX2ludmFsaWRhdGVfZ2Z4KzB4 MzQvMHhhMCBbYW1kZ3B1XQo+Pj4+Pj4+Cj4+Pj4+Pj4gRGFuaWVsCj4+Pj4+PiBfX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwo+Pj4+Pj4gZHJpLWRldmVsIG1h aWxpbmcgbGlzdAo+Pj4+Pj4gZHJpLWRldmVsQGxpc3RzLmZyZWVkZXNrdG9wLm9yZwo+Pj4+Pj4g aHR0cHM6Ly9uYW0xMS5zYWZlbGlua3MucHJvdGVjdGlvbi5vdXRsb29rLmNvbS8/dXJsPWh0dHBz JTNBJTJGJTJGbGlzdHMuZnJlZWRlc2t0b3Aub3JnJTJGbWFpbG1hbiUyRmxpc3RpbmZvJTJGZHJp LWRldmVsJmFtcDtkYXRhPTA0JTdDMDElN0NjaHJpc3RpYW4ua29lbmlnJTQwYW1kLmNvbSU3Qzgx MjAzZTViYWM1ODQxYjhlNWExMDhkOGM4MjA4N2E5JTdDM2RkODk2MWZlNDg4NGU2MDhlMTFhODJk OTk0ZTE4M2QlN0MwJTdDMCU3QzYzNzQ3OTM4OTMzOTI5NTYyMiU3Q1Vua25vd24lN0NUV0ZwYkda c2IzZDhleUpXSWpvaU1DNHdMakF3TURBaUxDSlFJam9pVjJsdU16SWlMQ0pCVGlJNklrMWhhV3dp TENKWFZDSTZNbjAlM0QlN0MxMDAwJmFtcDtzZGF0YT1SRFN4RDZPcUQ4SGFPQTJWbk5mYkp3TG5L emhDTGdPcjVTVkxqTEY5MWJBJTNEJmFtcDtyZXNlcnZlZD0wCj4+Pj4+Cj4+Pgo+Pj4gLS0KPj4+ IERhbmllbCBWZXR0ZXIKPj4+IFNvZnR3YXJlIEVuZ2luZWVyLCBJbnRlbCBDb3Jwb3JhdGlvbgo+ Pj4gaHR0cDovL2Jsb2cuZmZ3bGwuY2gKPiBfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fXwo+IGFtZC1nZnggbWFpbGluZyBsaXN0Cj4gYW1kLWdmeEBsaXN0cy5m cmVlZGVza3RvcC5vcmcKPiBodHRwczovL2xpc3RzLmZyZWVkZXNrdG9wLm9yZy9tYWlsbWFuL2xp c3RpbmZvL2FtZC1nZngKCl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fCmRyaS1kZXZlbCBtYWlsaW5nIGxpc3QKZHJpLWRldmVsQGxpc3RzLmZyZWVkZXNrdG9w Lm9yZwpodHRwczovL2xpc3RzLmZyZWVkZXNrdG9wLm9yZy9tYWlsbWFuL2xpc3RpbmZvL2RyaS1k ZXZlbAo= From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-4.4 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,NICE_REPLY_A,SPF_HELO_NONE, SPF_PASS,URIBL_BLOCKED,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 7F83AC433DB for ; Wed, 3 Feb 2021 12:22:24 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 1C75364F74 for ; Wed, 3 Feb 2021 12:22:24 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S234478AbhBCMWH (ORCPT ); Wed, 3 Feb 2021 07:22:07 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:55856 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S234131AbhBCMWE (ORCPT ); Wed, 3 Feb 2021 07:22:04 -0500 Received: from mail-ed1-x52c.google.com (mail-ed1-x52c.google.com [IPv6:2a00:1450:4864:20::52c]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 40AF7C061573 for ; Wed, 3 Feb 2021 04:21:24 -0800 (PST) Received: by mail-ed1-x52c.google.com with SMTP id z22so26560532edb.9 for ; Wed, 03 Feb 2021 04:21:24 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=reply-to:subject:to:cc:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-transfer-encoding:content-language; bh=bLF32KqYMp2Ag9MhzCy/CMzv0E6X87uMKhtUHj70LAE=; b=fXrZYMRoW24U8f0iJ5ejvqmSVq+CbSu6fwlCfOUAJfbz1btQ/fkgafj4Itw/J5SiYj K0Bk5c+WZOJDuHs/kkT1XVzcZEuUT0unUnjtEkPspkDLNyhSJMMmHkJfMj7nlUauzZ2x HhsE6IjyLPphw8fJ9Ykbt8e5qLQIEh0OzVztWsP8tkygMRLvwH3FD1womBHK97gqQXov cjmOgUKNkt6wsvR0+EmjiOPXiLC33Vx+upYeEofIIZc/ksGW0t3yj3LOiMHUtsj1mOZ/ 59H+TSkMBBkqQWubGYGZkV2YoAZ3q6Yr3f46eKUGWRRGbJBUgXcqup8dq516UhtRQB8M MCrA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:reply-to:subject:to:cc:references:from :message-id:date:user-agent:mime-version:in-reply-to :content-transfer-encoding:content-language; bh=bLF32KqYMp2Ag9MhzCy/CMzv0E6X87uMKhtUHj70LAE=; b=OeHK/qsHQ5qssWwvaL+g9fpVVnslM5kRV8lyfRfiisciX33gA7OkiCsLppFk+LWbP8 43EgIsRQkJKDO8vg/TfVn6tbohPeDRfd/bFp/V8DnJEnUgmp8NZO2JPb4RK77tLrAHN8 NNhBcT8u+LqjcWFNy6SC0lUgYPg6WVoSr3cXD0IsNSvj+BCWt0BYSU66v/H1lVbAKDB1 KO2QIOwBU58vNsWuq/BQMMsJSJcc18UBQDn18dCDjki6HLWgCBDhWdf0jHU9v0pb+C35 uFy1P7NCovLJzbCLtUMmKdRNUoMRs2OQrElDZhN0kCCBTIi0clYPnSPzlB9O96FwGv2Q z2pA== X-Gm-Message-State: AOAM531dw78LTciyZTd4yR6qMucp0oMAg6ocN8ZQ5RBPcoNy0S9xeoEC ycdjANu8QSBmp2i5du3jI3mQVNcThcg= X-Google-Smtp-Source: ABdhPJxBdLLD9NGdRzHVxag7BKf2yQFcixrwyfP7WT8VO2NoggPW8S6nyp5uD1yoY6pS3P2BmJmtXA== X-Received: by 2002:aa7:c682:: with SMTP id n2mr2685871edq.27.1612354882579; Wed, 03 Feb 2021 04:21:22 -0800 (PST) Received: from ?IPv6:2a02:908:1252:fb60:be8a:bd56:1f94:86e7? ([2a02:908:1252:fb60:be8a:bd56:1f94:86e7]) by smtp.gmail.com with ESMTPSA id u23sm782393edt.87.2021.02.03.04.21.21 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 03 Feb 2021 04:21:21 -0800 (PST) Reply-To: christian.koenig@amd.com Subject: Re: [amdgpu] deadlock To: Daniel Gomez , Daniel Vetter Cc: Alex Deucher , dri-devel , =?UTF-8?Q?Christian_K=c3=b6nig?= , amd-gfx list , Linux Kernel Mailing List References: <58e41b62-b8e0-b036-c87d-a84d53f5a26e@amd.com> From: =?UTF-8?Q?Christian_K=c3=b6nig?= Message-ID: <538682ee-3e12-a345-2205-2c0f16b496ff@gmail.com> Date: Wed, 3 Feb 2021 13:21:20 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.10.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Am 03.02.21 um 12:45 schrieb Daniel Gomez: > On Wed, 3 Feb 2021 at 10:47, Daniel Gomez wrote: >> On Wed, 3 Feb 2021 at 10:17, Daniel Vetter wrote: >>> On Wed, Feb 3, 2021 at 9:51 AM Christian König wrote: >>>> Am 03.02.21 um 09:48 schrieb Daniel Vetter: >>>>> On Wed, Feb 3, 2021 at 9:36 AM Christian König wrote: >>>>>> Hi Daniel, >>>>>> >>>>>> this is not a deadlock, but rather a hardware lockup. >>>>> Are you sure? Ime getting stuck in dma_fence_wait has generally good >>>>> chance of being a dma_fence deadlock. GPU hang should never result in >>>>> a forever stuck dma_fence. >>>> Yes, I'm pretty sure. Otherwise the hardware clocks wouldn't go up like >>>> this. >>> Maybe clarifying, could be both. TDR should notice and get us out of >>> this, but if there's a dma_fence deadlock and we can't re-emit or >>> force complete the pending things, then we're stuck for good. >>> -Daniel >>> >>>> Question is rather why we end up in the userptr handling for GFX? Our >>>> ROCm OpenCL stack shouldn't use this. >>>> >>>>> Daniel, can you pls re-hang your machine and then dump backtraces of >>>>> all tasks into dmesg with sysrq-t, and then attach that? Without all >>>>> the backtraces it's tricky to construct the full dependency chain of >>>>> what's going on. Also is this plain -rc6, not some more patches on >>>>> top? >>>> Yeah, that's still a good idea to have. >> Here the full backtrace dmesg logs after the hang: >> https://pastebin.com/raw/kzivm2L3 >> >> This is another dmesg log with the backtraces after SIGKILL the matrix process: >> (I didn't have the sysrq enable at the time): >> https://pastebin.com/raw/pRBwGcj1 > I've now removed all our v4l2 patches and did the same test with the 'plain' > mainline version (-rc6). > > Reference: 3aaf0a27ffc29b19a62314edd684b9bc6346f9a8 > > Same error, same behaviour. Full dmesg log attached: > https://pastebin.com/raw/KgaEf7Y1 > Note: > dmesg with sysrq-t before running the test starts in [ 122.016502] > sysrq: Show State > dmesg with sysrq-t after the test starts in: [ 495.587671] sysrq: Show State There is nothing amdgpu related in there except for waiting for the hardware. This is a pretty standard hardware lockup, but I'm still waiting for an explanation why we end up in this call path in the first place. Christian. > > >>>> Christian. >>>> >>>>> -Daniel >>>>> >>>>>> Which OpenCl stack are you using? >>>>>> >>>>>> Regards, >>>>>> Christian. >>>>>> >>>>>> Am 03.02.21 um 09:33 schrieb Daniel Gomez: >>>>>>> Hi all, >>>>>>> >>>>>>> I have a deadlock with the amdgpu mainline driver when running in parallel two >>>>>>> OpenCL applications. So far, we've been able to replicate it easily by executing >>>>>>> clinfo and MatrixMultiplication (from AMD opencl-samples). It's quite old the >>>>>>> opencl-samples so, if you have any other suggestion for testing I'd be very >>>>>>> happy to test it as well. >>>>>>> >>>>>>> How to replicate the issue: >>>>>>> >>>>>>> # while true; do /usr/bin/MatrixMultiplication --device gpu \ >>>>>>> --deviceId 0 -x 1000 -y 1000 -z 1000 -q -t -i 50; done >>>>>>> # while true; do clinfo; done >>>>>>> >>>>>>> Output: >>>>>>> >>>>>>> After a minute or less (sometimes could be more) I can see that >>>>>>> MatrixMultiplication and clinfo hang. In addition, with radeontop you can see >>>>>>> how the Graphics pipe goes from ~50% to 100%. Also the shader clocks >>>>>>> goes up from ~35% to ~96%. >>>>>>> >>>>>>> clinfo keeps printing: >>>>>>> ioctl(7, DRM_IOCTL_SYNCOBJ_WAIT, 0x7ffe46e5f950) = -1 ETIME (Timer expired) >>>>>>> >>>>>>> And MatrixMultiplication prints the following (strace) if you try to >>>>>>> kill the process: >>>>>>> >>>>>>> sched_yield() = 0 >>>>>>> futex(0x557e945343b8, FUTEX_WAIT_BITSET_PRIVATE|FUTEX_CLOCK_REALTIME, 0, >>>>>>> NULL, FUTEX_BITSET_MATCH_ANYstrace: Process 651 detached >>>>>>> >>>>>>> >>>>>>> After this, the gpu is not functional at all and you'd need a power cycle reset >>>>>>> to restore the system. >>>>>>> >>>>>>> Hardware info: >>>>>>> CPU: AMD Ryzen Embedded V1605B with Radeon Vega Gfx (8) @ 2.000GHz >>>>>>> GPU: AMD ATI Radeon Vega Series / Radeon Vega Mobile Series >>>>>>> >>>>>>> 03:00.0 VGA compatible controller: Advanced Micro Devices, Inc. >>>>>>> [AMD/ATI] Raven Ridge [Radeon Vega Series / Radeon Vega Mobile Series] >>>>>>> (rev 83) >>>>>>> DeviceName: Broadcom 5762 >>>>>>> Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Raven Ridge >>>>>>> [Radeon Vega Series / Radeon Vega Mobile Series] >>>>>>> Kernel driver in use: amdgpu >>>>>>> Kernel modules: amdgpu >>>>>>> >>>>>>> Linux kernel info: >>>>>>> >>>>>>> root@qt5222:~# uname -a >>>>>>> Linux qt5222 5.11.0-rc6-qtec-standard #2 SMP Tue Feb 2 09:41:46 UTC >>>>>>> 2021 x86_64 x86_64 x86_64 GNU/Linux >>>>>>> >>>>>>> By enabling the kernel locks stats I could see the MatrixMultiplication is >>>>>>> hanged in the amdgpu_mn_invalidate_gfx function: >>>>>>> >>>>>>> [ 738.359202] 1 lock held by MatrixMultiplic/653: >>>>>>> [ 738.359206] #0: ffff88810e364fe0 >>>>>>> (&adev->notifier_lock){+.+.}-{3:3}, at: >>>>>>> amdgpu_mn_invalidate_gfx+0x34/0xa0 [amdgpu] >>>>>>> >>>>>>> I can see in the the amdgpu_mn_invalidate_gfx function: the >>>>>>> dma_resv_wait_timeout_rcu uses wait_all (fences) and MAX_SCHEDULE_TIMEOUT so, I >>>>>>> guess the code gets stuck there waiting forever. According to the >>>>>>> documentation: "When somebody tries to invalidate the page tables we block the >>>>>>> update until all operations on the pages in question are completed, then those >>>>>>> pages are marked as accessed and also dirty if it wasn’t a read only access." >>>>>>> Looks like the fences are deadlocked and therefore, it never returns. Could it >>>>>>> be possible? any hint to where can I look to fix this? >>>>>>> >>>>>>> Thank you in advance. >>>>>>> >>>>>>> Here the full dmesg output: >>>>>>> >>>>>>> [ 738.337726] INFO: task MatrixMultiplic:653 blocked for more than 122 seconds. >>>>>>> [ 738.344937] Not tainted 5.11.0-rc6-qtec-standard #2 >>>>>>> [ 738.350384] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" >>>>>>> disables this message. >>>>>>> [ 738.358240] task:MatrixMultiplic state:D stack: 0 pid: 653 >>>>>>> ppid: 1 flags:0x00004000 >>>>>>> [ 738.358254] Call Trace: >>>>>>> [ 738.358261] ? dma_fence_default_wait+0x1eb/0x230 >>>>>>> [ 738.358276] __schedule+0x370/0x960 >>>>>>> [ 738.358291] ? dma_fence_default_wait+0x117/0x230 >>>>>>> [ 738.358297] ? dma_fence_default_wait+0x1eb/0x230 >>>>>>> [ 738.358305] schedule+0x51/0xc0 >>>>>>> [ 738.358312] schedule_timeout+0x275/0x380 >>>>>>> [ 738.358324] ? dma_fence_default_wait+0x1eb/0x230 >>>>>>> [ 738.358332] ? mark_held_locks+0x4f/0x70 >>>>>>> [ 738.358341] ? dma_fence_default_wait+0x117/0x230 >>>>>>> [ 738.358347] ? lockdep_hardirqs_on_prepare+0xd4/0x180 >>>>>>> [ 738.358353] ? _raw_spin_unlock_irqrestore+0x39/0x40 >>>>>>> [ 738.358362] ? dma_fence_default_wait+0x117/0x230 >>>>>>> [ 738.358370] ? dma_fence_default_wait+0x1eb/0x230 >>>>>>> [ 738.358375] dma_fence_default_wait+0x214/0x230 >>>>>>> [ 738.358384] ? dma_fence_release+0x1a0/0x1a0 >>>>>>> [ 738.358396] dma_fence_wait_timeout+0x105/0x200 >>>>>>> [ 738.358405] dma_resv_wait_timeout_rcu+0x1aa/0x5e0 >>>>>>> [ 738.358421] amdgpu_mn_invalidate_gfx+0x55/0xa0 [amdgpu] >>>>>>> [ 738.358688] __mmu_notifier_release+0x1bb/0x210 >>>>>>> [ 738.358710] exit_mmap+0x2f/0x1e0 >>>>>>> [ 738.358723] ? find_held_lock+0x34/0xa0 >>>>>>> [ 738.358746] mmput+0x39/0xe0 >>>>>>> [ 738.358756] do_exit+0x5c3/0xc00 >>>>>>> [ 738.358763] ? find_held_lock+0x34/0xa0 >>>>>>> [ 738.358780] do_group_exit+0x47/0xb0 >>>>>>> [ 738.358791] get_signal+0x15b/0xc50 >>>>>>> [ 738.358807] arch_do_signal_or_restart+0xaf/0x710 >>>>>>> [ 738.358816] ? lockdep_hardirqs_on_prepare+0xd4/0x180 >>>>>>> [ 738.358822] ? _raw_spin_unlock_irqrestore+0x39/0x40 >>>>>>> [ 738.358831] ? ktime_get_mono_fast_ns+0x50/0xa0 >>>>>>> [ 738.358844] ? amdgpu_drm_ioctl+0x6b/0x80 [amdgpu] >>>>>>> [ 738.359044] exit_to_user_mode_prepare+0xf2/0x1b0 >>>>>>> [ 738.359054] syscall_exit_to_user_mode+0x19/0x60 >>>>>>> [ 738.359062] entry_SYSCALL_64_after_hwframe+0x44/0xa9 >>>>>>> [ 738.359069] RIP: 0033:0x7f6b89a51887 >>>>>>> [ 738.359076] RSP: 002b:00007f6b82b54b18 EFLAGS: 00000246 ORIG_RAX: >>>>>>> 0000000000000010 >>>>>>> [ 738.359086] RAX: fffffffffffffe00 RBX: 00007f6b82b54b50 RCX: 00007f6b89a51887 >>>>>>> [ 738.359091] RDX: 00007f6b82b54b50 RSI: 00000000c02064c3 RDI: 0000000000000007 >>>>>>> [ 738.359096] RBP: 00000000c02064c3 R08: 0000000000000003 R09: 00007f6b82b54bbc >>>>>>> [ 738.359101] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000165a0bc00 >>>>>>> [ 738.359106] R13: 0000000000000007 R14: 0000000000000001 R15: 0000000000000000 >>>>>>> [ 738.359129] >>>>>>> Showing all locks held in the system: >>>>>>> [ 738.359141] 1 lock held by khungtaskd/54: >>>>>>> [ 738.359148] #0: ffffffff829f6840 (rcu_read_lock){....}-{1:2}, at: >>>>>>> debug_show_all_locks+0x15/0x183 >>>>>>> [ 738.359187] 1 lock held by systemd-journal/174: >>>>>>> [ 738.359202] 1 lock held by MatrixMultiplic/653: >>>>>>> [ 738.359206] #0: ffff88810e364fe0 >>>>>>> (&adev->notifier_lock){+.+.}-{3:3}, at: >>>>>>> amdgpu_mn_invalidate_gfx+0x34/0xa0 [amdgpu] >>>>>>> >>>>>>> Daniel >>>>>> _______________________________________________ >>>>>> dri-devel mailing list >>>>>> dri-devel@lists.freedesktop.org >>>>>> https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.freedesktop.org%2Fmailman%2Flistinfo%2Fdri-devel&data=04%7C01%7Cchristian.koenig%40amd.com%7C81203e5bac5841b8e5a108d8c82087a9%7C3dd8961fe4884e608e11a82d994e183d%7C0%7C0%7C637479389339295622%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=RDSxD6OqD8HaOA2VnNfbJwLnKzhCLgOr5SVLjLF91bA%3D&reserved=0 >>>>> >>> >>> -- >>> Daniel Vetter >>> Software Engineer, Intel Corporation >>> http://blog.ffwll.ch > _______________________________________________ > amd-gfx mailing list > amd-gfx@lists.freedesktop.org > https://lists.freedesktop.org/mailman/listinfo/amd-gfx