From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from shelob.surriel.com (shelob.surriel.com [96.67.55.147]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id F2916C021B8 for ; Tue, 4 Mar 2025 21:01:47 +0000 (UTC) Received: from localhost ([::1] helo=shelob.surriel.com) by shelob.surriel.com with esmtp (Exim 4.97.1) (envelope-from ) id 1tpZOb-000000004i3-1u6q; Tue, 04 Mar 2025 16:01:45 -0500 Received: from dfw.source.kernel.org ([139.178.84.217]) by shelob.surriel.com with esmtps (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.97.1) (envelope-from ) id 1tpZOa-000000004gf-2TVX for kernelnewbies@kernelnewbies.org; Tue, 04 Mar 2025 16:01:44 -0500 Received: from smtp.kernel.org (transwarp.subspace.kernel.org [100.75.92.58]) by dfw.source.kernel.org (Postfix) with ESMTP id 45E245C61FA; Tue, 4 Mar 2025 20:59:07 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id A3C0EC4CEE5; Tue, 4 Mar 2025 21:01:23 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1741122083; bh=wuSZUsJUBvvoVVqs5pexnapAelVoxNHgNy106DGrgsc=; h=Date:From:To:Cc:Subject:In-Reply-To:From; b=WaKZp4plvRf+flSK8OMx76i9ew3l3hxm7OcNuKEQKPgKzV6AMK0G09KFUQBqvyneA cGYUMqkEO/tq2le0YNkFl1sAjc4UynkxUB82rY0ONgFkg6gcB5Qy36sqPDnqWRP0wR tLSIWBHHzqCC2a+sNGSiDQ3pv0oGoCv8nBHuokOb4VjKTxeq6Vbh5xCuTEgMRStfg8 ERtbU4SW8SIbgLWsu/WpgYQHYvx7sh0h+7xBUsyVKvH/AFQFTgOTwsHzVIzHmBvXPe qv/MhA0Wor99mduAYOxFNZsjvzuxr1EBLIvKy/7mMma2AULWWZzXrEhCnRGo+DQW+u 0xVHwBlo4MjIQ== Date: Tue, 4 Mar 2025 15:01:22 -0600 From: Bjorn Helgaas To: Naveen Kumar P Subject: Re: PCI: hotplug_event: PCIe PLDA Device BAR Reset Message-ID: <20250304210122.GA257363@bhelgaas> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: Cc: linux-pci@vger.kernel.org, linux-acpi@vger.kernel.org, linux-kernel@vger.kernel.org, kernelnewbies X-BeenThere: kernelnewbies@kernelnewbies.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: Learn about the Linux kernel List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Errors-To: kernelnewbies-bounces@kernelnewbies.org T24gVHVlLCBNYXIgMDQsIDIwMjUgYXQgMTA6MTk6MDdQTSArMDUzMCwgTmF2ZWVuIEt1bWFyIFAg d3JvdGU6Cj4gT24gVHVlLCBNYXIgNCwgMjAyNSBhdCAxOjM14oCvUE0gTmF2ZWVuIEt1bWFyIFAK PiA8bmF2ZWVua3VtYXIucGFybmFAZ21haWwuY29tPiB3cm90ZToKPiAuLi4KCj4gRm9yIHRoaXMg dGVzdCBydW4sIEkgcmVtb3ZlZCBhbGwgdGhyZWUgcGFyYW1ldGVycyAocGNpZV9hc3BtPW9mZiwK PiBwY2k9bm9tc2ksIGFuZCBwY2llX3BvcnRzPW9uKSBhbmQgYm9vdGVkIHdpdGggdGhlIGZvbGxv d2luZyBrZXJuZWwKPiBjb21tYW5kIGxpbmUgYXJndW1lbnRzOgo+IAo+IGNhdCAvcHJvYy9jbWRs aW5lCj4gQk9PVF9JTUFHRT0vdm1saW51ei02LjEzLjArIHJvb3Q9L2Rldi9tYXBwZXIvdmcwMC1y b290dm9sIHJvIHF1aWV0Cj4gImR5bmRiZz1maWxlIGRyaXZlcnMvcGNpLyogK3A7IGZpbGUgZHJp dmVycy9hY3BpL2J1cy5jICtwOyBmaWxlCj4gZHJpdmVycy9hY3BpL29zbC5jICtwIgo+IAo+IFRo aXMgdGltZSwgdGhlIGlzc3VlIG9jY3VycmVkIGVhcmxpZXIsIGF0IDIyOTk4IHNlY29uZHMuIEJl bG93IGlzIHRoZQo+IHJlbGV2YW50IGRtZXNnIGxvZyBkdXJpbmcgdGhlIEFDUElfTk9USUZZX0JV U19DSEVDSyBldmVudC4gVGhlCj4gY29tcGxldGUgbG9nIGlzIGF0dGFjaGVkIChkbWVzZ19tYXJj aDR0aF9sb2cudHh0KS4KPiAKPiBbMjI5OTguNTM2NzA1XSBBQ1BJOiBcX1NCXy5QQ0kwLlJQMDE6 IEFDUEk6IEFDUElfTk9USUZZX0JVU19DSEVDSyBldmVudAo+IFsyMjk5OC41MzY3NTNdIEFDUEk6 IFxfU0JfLlBDSTAuUlAwMTogQUNQSTogT1NMOiBTY2hlZHVsaW5nIGhvdHBsdWcKPiBldmVudCAw IGZvciBkZWZlcnJlZCBoYW5kbGluZwo+IFsyMjk5OC41MzY5MzRdIEFDUEk6IFxfU0JfLlBDSTAu UlAwMTogYWNwaXBocF9nbHVlOiBCcmlkZ2UgYWNxdWlyZWQgaW4KPiBob3RwbHVnX2V2ZW50KCkK PiBbMjI5OTguNTM2OTcyXSBBQ1BJOiBcX1NCXy5QQ0kwLlJQMDE6IGFjcGlwaHBfZ2x1ZTogQnVz IGNoZWNrIGluIGhvdHBsdWdfZXZlbnQoKQo+IFsyMjk5OC41MzcwMDJdIEFDUEk6IFxfU0JfLlBD STAuUlAwMTogYWNwaXBocF9nbHVlOiBDaGVja2luZyBicmlkZ2UgaW4KPiBob3RwbHVnX2V2ZW50 KCkKPiBbMjI5OTguNTM3MDI0XSBQQ0kgUkVBRDogcmVzPTAsIGJ1cz0wMSBkZXY9MDAgZnVuYz0w IHBvcz0weDAwIGxlbj00Cj4gZGF0YT0weDU1NTUxNTU2Cj4gWzIyOTk4LjUzNzA2Nl0gUENJIFJF QUQ6IHJlcz0wLCBidXM9MDEgZGV2PTAwIGZ1bmM9MCBwb3M9MHgwMCBsZW49NAo+IGRhdGE9MHg1 NTU1MTU1NgoKRmluZSBhZ2Fpbi4KCj4gWzIyOTk4LjUzNzA5NF0gQUNQSTogXF9TQl8uUENJMC5S UDAxOiBhY3BpcGhwX2dsdWU6IEVuYWJsaW5nIHNsb3QgaW4KPiBhY3BpcGhwX2NoZWNrX2JyaWRn ZSgpCj4gWzIyOTk4LjUzNzE1NV0gQUNQSTogRGV2aWNlIFtQWFNYXSBzdGF0dXMgWzAwMDAwMDBm XQo+IFsyMjk5OC41MzcyMDZdIEFDUEk6IERldmljZSBbRDAxNV0gc3RhdHVzIFswMDAwMDAwZl0K PiBbMjI5OTguNTM3Mjc2XSBBQ1BJOiBcX1NCXy5QQ0kwLlJQMDE6IGFjcGlwaHBfZ2x1ZTogUmVs ZWFzaW5nIGJyaWRnZQo+IGluIGhvdHBsdWdfZXZlbnQoKQo+IAo+IHN1ZG8gbHNwY2kgLXh4eCAt cyAwMTowMC4wIHwgZ3JlcCAxMDoKPiAxMDogMDAgMDAgMDAgMDAgMDAgMDAgMDAgMDAgMDAgMDAg MDAgMDAgMDAgMDAgMDAgMDAKCk9idmlvdXNseSBhIHByb2JsZW0uICBDYW4geW91IHN0YXJ0IGlu Y2x1ZGluZyB0aGUgd2hvbGUKImxzcGNpIC14IC1zIDAxOjAwLjAiIG91dHB1dD8gIE9idmlvdXNs eSB0aGUgVmVuZG9yIElEIHJlYWRzIGFib3ZlCndvcmtlZCBmaW5lLiAgSSAqYXNzdW1lKiBpdCdz IHN0aWxsIGZpbmUgaGVyZSwgYW5kIG9ubHkgdGhlIEJBUnMgYXJlCnplcm9lZCBvdXQ/CgpJIGFz c3VtZSB5b3Ugc2F3IG5vIG5ldyBkbWVzZyBsb2dzIGFib3V0IGNvbmZpZyBhY2Nlc3NlcyB0byB0 aGUgZGV2aWNlCmJlZm9yZSB0aGUgbHNwY2kuICBJZiB5b3UgaW5zdHJ1bWVudGVkIHRoZSB1c2Vy IGNvbmZpZyBhY2Nlc3NvcnMKKHBjaV91c2VyX3JlYWRfY29uZmlnXyooKSwgYWxzbyBpbiBhY2Nl c3MuYyksIHlvdSBzaG91bGQgc2VlIHRob3NlCmFjY2Vzc2VzLgoKWW91IGNvdWxkIHNwcmlua2xl IHNvbWUgY2FsbHMgdG8gZWFybHlfZHVtcF9wY2lfZGV2aWNlKCkgdGhyb3VnaCB0aGUKYWNwaXBo cCBwYXRoLiAgVHVybiBvZmYgdGhlIGtlcm5lbCBjb25maWcgYWNjZXNzIHRyYWNpbmcgd2hlbiB5 b3UgZG8KdGhpcyBzbyBpdCBkb2Vzbid0IGNsdXR0ZXIgdGhpbmdzIHVwLgoKV2hhdCBpcyB0aGlz IGRldmljZT8gIElzIGl0IGEgc2hpcHBpbmcgcHJvZHVjdD8gIERvIHlvdSBoYXZlIGdvb2QKY29u ZmlkZW5jZSB0aGF0IHRoZSBoYXJkd2FyZSBpcyB3b3JraW5nIGNvcnJlY3RseT8gIEkgZ3Vlc3Mg eW91IHNhaWQKaXQgd29ya3MgY29ycmVjdGx5IG9uIGEgZGlmZmVyZW50IG1hY2hpbmUgd2l0aCBh biBvbGRlciBrZXJuZWwuICBJCndvdWxkIHN3YXAgdGhlIGNhcmRzIGJldHdlZW4gbWFjaGluZXMg aW4gY2FzZSBvbmUgY2FyZCBpcyBicm9rZW4uCgpZb3UgY291bGQgdHJ5IGJpc2VjdGluZyBiZXR3 ZWVuIHRoZSB3b3JraW5nIGtlcm5lbCBhbmQgdGhlIGJyb2tlbiBvbmUuCkl0J3Mga2luZCBvZiBw YWluZnVsIHNpbmNlIGl0IHRha2VzIHNvIGxvbmcgdG8gcmVwcm9kdWNlIHRoZSBwcm9ibGVtLgoK Qmpvcm4KCl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fCktl cm5lbG5ld2JpZXMgbWFpbGluZyBsaXN0Cktlcm5lbG5ld2JpZXNAa2VybmVsbmV3Ymllcy5vcmcK aHR0cHM6Ly9saXN0cy5rZXJuZWxuZXdiaWVzLm9yZy9tYWlsbWFuL2xpc3RpbmZvL2tlcm5lbG5l d2JpZXMK From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 62DFE13B58B; Tue, 4 Mar 2025 21:01:23 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1741122084; cv=none; b=r9UA1mQKrVvKwYvo6MZOL4LgvXJqImOUJICLrOKPxX6DJTpPsnryVUiqCdPXV8FkENRePDkJGx94fBZqCrqV31jdYyWF2mn4OgQ98NOmas38N88RcO632Nk9w1B1jMrtC5OTcv+HncRG0ScwBpZfFlyWONMVUpPJAN74QxrHN+M= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1741122084; c=relaxed/simple; bh=wuSZUsJUBvvoVVqs5pexnapAelVoxNHgNy106DGrgsc=; h=Date:From:To:Cc:Subject:Message-ID:MIME-Version:Content-Type: Content-Disposition:In-Reply-To; b=nIE3cqDz26fmnc7fd6s+rJ4goR6f/mqTkDYV8cXb6LjsLcdtePBrdFR/70LoSDF8IAs0M1GcDVMNN4w/2y37kXFTMNtPiPSSa7awNygwAay9lWV2X3KYEO5UdR8ZLS1jp/NgGC47hpeas0JcvznwRH1cjD5go8Ya/KiFhtNgY0Q= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=WaKZp4pl; arc=none smtp.client-ip=10.30.226.201 Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="WaKZp4pl" Received: by smtp.kernel.org (Postfix) with ESMTPSA id A3C0EC4CEE5; Tue, 4 Mar 2025 21:01:23 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1741122083; bh=wuSZUsJUBvvoVVqs5pexnapAelVoxNHgNy106DGrgsc=; h=Date:From:To:Cc:Subject:In-Reply-To:From; b=WaKZp4plvRf+flSK8OMx76i9ew3l3hxm7OcNuKEQKPgKzV6AMK0G09KFUQBqvyneA cGYUMqkEO/tq2le0YNkFl1sAjc4UynkxUB82rY0ONgFkg6gcB5Qy36sqPDnqWRP0wR tLSIWBHHzqCC2a+sNGSiDQ3pv0oGoCv8nBHuokOb4VjKTxeq6Vbh5xCuTEgMRStfg8 ERtbU4SW8SIbgLWsu/WpgYQHYvx7sh0h+7xBUsyVKvH/AFQFTgOTwsHzVIzHmBvXPe qv/MhA0Wor99mduAYOxFNZsjvzuxr1EBLIvKy/7mMma2AULWWZzXrEhCnRGo+DQW+u 0xVHwBlo4MjIQ== Date: Tue, 4 Mar 2025 15:01:22 -0600 From: Bjorn Helgaas To: Naveen Kumar P Cc: linux-pci@vger.kernel.org, linux-kernel@vger.kernel.org, kernelnewbies , linux-acpi@vger.kernel.org Subject: Re: PCI: hotplug_event: PCIe PLDA Device BAR Reset Message-ID: <20250304210122.GA257363@bhelgaas> Precedence: bulk X-Mailing-List: linux-acpi@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: On Tue, Mar 04, 2025 at 10:19:07PM +0530, Naveen Kumar P wrote: > On Tue, Mar 4, 2025 at 1:35 PM Naveen Kumar P > wrote: > ... > For this test run, I removed all three parameters (pcie_aspm=off, > pci=nomsi, and pcie_ports=on) and booted with the following kernel > command line arguments: > > cat /proc/cmdline > BOOT_IMAGE=/vmlinuz-6.13.0+ root=/dev/mapper/vg00-rootvol ro quiet > "dyndbg=file drivers/pci/* +p; file drivers/acpi/bus.c +p; file > drivers/acpi/osl.c +p" > > This time, the issue occurred earlier, at 22998 seconds. Below is the > relevant dmesg log during the ACPI_NOTIFY_BUS_CHECK event. The > complete log is attached (dmesg_march4th_log.txt). > > [22998.536705] ACPI: \_SB_.PCI0.RP01: ACPI: ACPI_NOTIFY_BUS_CHECK event > [22998.536753] ACPI: \_SB_.PCI0.RP01: ACPI: OSL: Scheduling hotplug > event 0 for deferred handling > [22998.536934] ACPI: \_SB_.PCI0.RP01: acpiphp_glue: Bridge acquired in > hotplug_event() > [22998.536972] ACPI: \_SB_.PCI0.RP01: acpiphp_glue: Bus check in hotplug_event() > [22998.537002] ACPI: \_SB_.PCI0.RP01: acpiphp_glue: Checking bridge in > hotplug_event() > [22998.537024] PCI READ: res=0, bus=01 dev=00 func=0 pos=0x00 len=4 > data=0x55551556 > [22998.537066] PCI READ: res=0, bus=01 dev=00 func=0 pos=0x00 len=4 > data=0x55551556 Fine again. > [22998.537094] ACPI: \_SB_.PCI0.RP01: acpiphp_glue: Enabling slot in > acpiphp_check_bridge() > [22998.537155] ACPI: Device [PXSX] status [0000000f] > [22998.537206] ACPI: Device [D015] status [0000000f] > [22998.537276] ACPI: \_SB_.PCI0.RP01: acpiphp_glue: Releasing bridge > in hotplug_event() > > sudo lspci -xxx -s 01:00.0 | grep 10: > 10: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 Obviously a problem. Can you start including the whole "lspci -x -s 01:00.0" output? Obviously the Vendor ID reads above worked fine. I *assume* it's still fine here, and only the BARs are zeroed out? I assume you saw no new dmesg logs about config accesses to the device before the lspci. If you instrumented the user config accessors (pci_user_read_config_*(), also in access.c), you should see those accesses. You could sprinkle some calls to early_dump_pci_device() through the acpiphp path. Turn off the kernel config access tracing when you do this so it doesn't clutter things up. What is this device? Is it a shipping product? Do you have good confidence that the hardware is working correctly? I guess you said it works correctly on a different machine with an older kernel. I would swap the cards between machines in case one card is broken. You could try bisecting between the working kernel and the broken one. It's kind of painful since it takes so long to reproduce the problem. Bjorn