From: Priyank Rathod <rathodpriyank@google.com>
To: Bjorn Helgaas <bhelgaas@google.com>,
Jonathan Corbet <corbet@lwn.net>,
Shuah Khan <skhan@linuxfoundation.org>,
Randy Dunlap <rdunlap@infradead.org>,
Kees Cook <kees@kernel.org>,
"Gustavo A. R. Silva" <gustavoars@kernel.org>
Cc: "Ilpo Järvinen" <ilpo.jarvinen@linux.intel.com>,
linux-pci@vger.kernel.org, linux-kernel@vger.kernel.org,
"Priyank Rathod" <rathodpriyank@google.com>,
sashiko-bot@kernel.org, linux-doc@vger.kernel.org,
linux-kselftest@vger.kernel.org, linux-hardening@vger.kernel.org
Subject: [PATCH v2 1/3] PCI: Add pcie_get_link_endpoints() helper
Date: Fri, 04 Sep 2026 02:48:28 +0000 [thread overview]
Message-ID: <20260904-pcie-link-endpoints-v2-1-16fcb301a3e4@google.com> (raw)
In-Reply-To: <20260904-pcie-link-endpoints-v2-0-16fcb301a3e4@google.com>
In PCIe topologies, physical links are point-to-point connections
between an Upstream Component (Downstream Port, such as a Root Port
or Switch Downstream Port) and a Downstream Component (Upstream Port,
such as an Endpoint or Switch Upstream Port), per PCIe Base Specification
Revision 7.0 / 6.0 sec 1.3.1.
Drivers across drivers/pci/ (such as Lane Margining at Receiver and AER
recovery) coordinate operations across both ends of a PCIe link:
- Lane Margining at Receiver (LMR): requires resolving both link
endpoints to establish hierarchical locking and runtime PM pinning.
- AER/DPC Recovery: identifies the parent bridge to coordinate link
resets and recovery sequences.
Introduce pcie_get_link_endpoints() and pcie_put_link_endpoints() in the
PCI core to provide a standardized, symmetric, and race-safe helper:
- Validates output pointer arguments and initializes them to NULL.
- Resolves Physical Functions for VFs via pci_physfn().
- For Endpoints: resolves parent Downstream Port via
pci_upstream_bridge().
- Resolves base Function 0 symmetrically on the link subordinate bus
for both non-ARI multi-function devices and ARI (Alternative
Routing-ID Interpretation) devices where all functions (0..255)
belong to the same logical device.
- Safely inspects subordinate bus and bus device lists under
down_read(&pci_bus_sem), verifying bridge ownership
(child->self == pdev) to eliminate ABA pointer identity and UAF
races with concurrent hot-remove.
- Symmetrically acquires references via pci_dev_get() on both resolved
endpoints on success, or returns -ENODEV if either end is unresolved.
Callers release acquired references using pcie_put_link_endpoints().
Reported-by: sashiko-bot@kernel.org
Closes: https://lore.kernel.org/linux-pci/20260831214631.7CD5E1F000E9@smtp.kernel.org/
Signed-off-by: Priyank Rathod <rathodpriyank@google.com>
---
drivers/pci/pci.c | 152 ++++++++++++++++++++++++++++++++++++++++++++++++++++
include/linux/pci.h | 5 ++
2 files changed, 157 insertions(+)
diff --git a/drivers/pci/pci.c b/drivers/pci/pci.c
index b2879a6be5f8..d1e3d6e3f5b1 100644
--- a/drivers/pci/pci.c
+++ b/drivers/pci/pci.c
@@ -4654,6 +4654,158 @@ int pcie_retrain_link(struct pci_dev *pdev, bool use_lt)
return rc;
}
+/*
+ * pcie_get_subordinate_bus_locked() - Safely obtain active subordinate bus.
+ * Validates that a child bus matching bridge @pdev is actively linked in
+ * pdev->bus->children under pci_bus_sem. Verifies bridge ownership
+ * (child->self == pdev) to prevent Use-After-Free or ABA pointer identity
+ * races during concurrent hot-remove (pci_remove_bus / pci_remove_bus_device).
+ */
+static struct pci_bus *pcie_get_subordinate_bus_locked(struct pci_dev *pdev)
+{
+ struct pci_bus *child;
+
+ lockdep_assert_held_read(&pci_bus_sem);
+
+ if (!pdev->subordinate)
+ return NULL;
+
+ list_for_each_entry(child, &pdev->bus->children, node) {
+ if (child->self == pdev)
+ return child;
+ }
+
+ return NULL;
+}
+
+/*
+ * pcie_find_link_upstream_func0() - Find the base Function 0 device on a link.
+ * Handles ARI (Alternative Routing-ID Interpretation) and multi-function
+ * topologies uniformly and symmetrically.
+ */
+static struct pci_dev *pcie_find_link_upstream_func0(struct pci_bus *bus,
+ struct pci_dev *hint)
+{
+ struct pci_dev *child;
+
+ if (!bus)
+ return NULL;
+
+ if (pci_ari_enabled(bus)) {
+ /*
+ * In ARI, all functions (0..255) on the bus belong to the same
+ * logical device. Base Function 0 is strictly devfn == 0.
+ */
+ list_for_each_entry(child, &bus->devices, bus_list) {
+ if (child->devfn == 0)
+ return pci_dev_get(child);
+ }
+ } else if (hint) {
+ /* Non-ARI: find Function 0 in the same device slot */
+ if (PCI_FUNC(hint->devfn) == 0)
+ return pci_dev_get(hint);
+
+ list_for_each_entry(child, &bus->devices, bus_list) {
+ if (PCI_SLOT(child->devfn) == PCI_SLOT(hint->devfn) &&
+ PCI_FUNC(child->devfn) == 0)
+ return pci_dev_get(child);
+ }
+ } else {
+ /* Non-ARI from Downstream Port: prefer devfn 0, then any Func 0 */
+ list_for_each_entry(child, &bus->devices, bus_list) {
+ if (child->devfn == 0)
+ return pci_dev_get(child);
+ }
+ list_for_each_entry(child, &bus->devices, bus_list) {
+ if (PCI_FUNC(child->devfn) == 0)
+ return pci_dev_get(child);
+ }
+ }
+
+ /* Fall back to hint or first device on subordinate bus */
+ if (hint)
+ return pci_dev_get(hint);
+
+ child = list_first_entry_or_null(&bus->devices, struct pci_dev, bus_list);
+ return pci_dev_get(child);
+}
+
+/**
+ * pcie_get_link_endpoints - Identify Upstream and Downstream ends of a PCIe link
+ * @pdev: Any PCIe device on the link (Downstream Port or Endpoint)
+ * @downstream_port: Output pointer to Downstream Port (Upstream Component)
+ * @upstream_port: Output pointer to Upstream Port (Downstream Component)
+ *
+ * Identifies both ends of a point-to-point PCIe link. Acquires a reference
+ * (pci_dev_get()) on both discovered endpoints on success. Callers must release
+ * acquired references with pcie_put_link_endpoints() or pci_dev_put().
+ *
+ * Return: 0 on success, -EINVAL if @pdev is NULL or not PCIe, or -ENODEV if
+ * either end of the link cannot be resolved.
+ */
+int pcie_get_link_endpoints(struct pci_dev *pdev,
+ struct pci_dev **downstream_port,
+ struct pci_dev **upstream_port)
+{
+ struct pci_dev *down = NULL, *up = NULL;
+
+ if (!downstream_port || !upstream_port)
+ return -EINVAL;
+
+ *downstream_port = NULL;
+ *upstream_port = NULL;
+
+ if (!pdev || !pci_is_pcie(pdev))
+ return -EINVAL;
+
+ pdev = pci_physfn(pdev);
+ if (!pdev->bus)
+ return -ENODEV;
+
+ if (pcie_downstream_port(pdev)) {
+ struct pci_bus *subordinate;
+
+ down_read(&pci_bus_sem);
+ subordinate = pcie_get_subordinate_bus_locked(pdev);
+ if (subordinate)
+ up = pcie_find_link_upstream_func0(subordinate, NULL);
+ up_read(&pci_bus_sem);
+ down = pci_dev_get(pdev);
+ } else {
+ down = pci_dev_get(pci_upstream_bridge(pdev));
+ down_read(&pci_bus_sem);
+ up = pcie_find_link_upstream_func0(pdev->bus, pdev);
+ up_read(&pci_bus_sem);
+ if (!up)
+ up = pci_dev_get(pdev);
+ }
+
+ if (!down || !up || !pci_is_pcie(down) || !pci_is_pcie(up)) {
+ pci_dev_put(down);
+ pci_dev_put(up);
+ return -ENODEV;
+ }
+
+ *downstream_port = down;
+ *upstream_port = up;
+
+ return 0;
+}
+EXPORT_SYMBOL_GPL(pcie_get_link_endpoints);
+
+/**
+ * pcie_put_link_endpoints - Release references acquired by pcie_get_link_endpoints
+ * @downstream_port: Downstream Port pointer
+ * @upstream_port: Upstream Port pointer
+ */
+void pcie_put_link_endpoints(struct pci_dev *downstream_port,
+ struct pci_dev *upstream_port)
+{
+ pci_dev_put(upstream_port);
+ pci_dev_put(downstream_port);
+}
+EXPORT_SYMBOL_GPL(pcie_put_link_endpoints);
+
/**
* pcie_wait_for_link_delay - Wait until link is active or inactive
* @pdev: Bridge device
diff --git a/include/linux/pci.h b/include/linux/pci.h
index d31a8d107b1e..671d8db5898e 100644
--- a/include/linux/pci.h
+++ b/include/linux/pci.h
@@ -1272,6 +1272,11 @@ struct resource *pci_find_parent_resource(const struct pci_dev *dev,
u8 pci_swizzle_interrupt_pin(const struct pci_dev *dev, u8 pin);
int pci_get_interrupt_pin(struct pci_dev *dev, struct pci_dev **bridge);
u8 pci_common_swizzle(struct pci_dev *dev, u8 *pinp);
+int pcie_get_link_endpoints(struct pci_dev *pdev,
+ struct pci_dev **downstream_port,
+ struct pci_dev **upstream_port);
+void pcie_put_link_endpoints(struct pci_dev *downstream_port,
+ struct pci_dev *upstream_port);
struct pci_dev *pci_dev_get(struct pci_dev *dev);
void pci_dev_put(struct pci_dev *dev);
DEFINE_FREE(pci_dev_put, struct pci_dev *, if (_T) pci_dev_put(_T))
--
2.55.0.1003.g10538fe699-goog
next prev parent reply other threads:[~2026-09-04 2:48 UTC|newest]
Thread overview: 4+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-09-04 2:48 [PATCH v2 0/3] PCI/pcie: Add PCIe Lane Margining at Receiver (LMR) support Priyank Rathod
2026-09-04 2:48 ` Priyank Rathod [this message]
2026-09-04 2:48 ` [PATCH v2 2/3] PCI/ASPM: Add pci_aspm_inhibit() helper for temporary link state suppression Priyank Rathod
2026-09-04 2:48 ` [PATCH v2 3/3] PCI/pcie: Add PCIe Lane Margining at Receiver (LMR) support Priyank Rathod
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20260904-pcie-link-endpoints-v2-1-16fcb301a3e4@google.com \
--to=rathodpriyank@google.com \
--cc=bhelgaas@google.com \
--cc=corbet@lwn.net \
--cc=gustavoars@kernel.org \
--cc=ilpo.jarvinen@linux.intel.com \
--cc=kees@kernel.org \
--cc=linux-doc@vger.kernel.org \
--cc=linux-hardening@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-kselftest@vger.kernel.org \
--cc=linux-pci@vger.kernel.org \
--cc=rdunlap@infradead.org \
--cc=sashiko-bot@kernel.org \
--cc=skhan@linuxfoundation.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox