From: Christian Bruel <christian.bruel@foss.st.com>
To: Bjorn Helgaas <helgaas@kernel.org>
Cc: "Lorenzo Pieralisi" <lpieralisi@kernel.org>,
"Krzysztof Wilczyński" <kwilczynski@kernel.org>,
"Manivannan Sadhasivam" <mani@kernel.org>,
"Rob Herring" <robh@kernel.org>,
"Bjorn Helgaas" <bhelgaas@google.com>,
"Maxime Coquelin" <mcoquelin.stm32@gmail.com>,
"Alexandre Torgue" <alexandre.torgue@foss.st.com>,
linux-pci@vger.kernel.org,
linux-stm32@st-md-mailman.stormreply.com,
linux-arm-kernel@lists.infradead.org,
linux-kernel@vger.kernel.org
Subject: Re: [PATCH] PCI: stm32: Fix LTSSM EP race with start link.
Date: Tue, 18 Nov 2025 19:34:01 +0100 [thread overview]
Message-ID: <67dbd8f6-2efe-4a73-a611-9081f364d2d4@foss.st.com> (raw)
In-Reply-To: <20251117200020.GA2518034@bhelgaas>
On 11/17/25 21:00, Bjorn Helgaas wrote:
> On Mon, Nov 17, 2025 at 01:04:47PM +0100, Christian Bruel wrote:
>> On 11/14/25 19:59, Bjorn Helgaas wrote:
>>> On Fri, Nov 14, 2025 at 08:45:52AM +0100, Christian Bruel wrote:
>>>> If the host has deasserted PERST# and started link training before the link
>>>> is started on EP side, enabling LTSSM before the endpoint registers are
>>>> initialized in the perst_irq handler results in probing incorrect values.
>>>>
>>>> Thus, wait for the PERST# level-triggered interrupt to start link training
>>>> at the end of initialization and cleanup the stm32_pcie_[start stop]_link
>>>> functions.
>>>
>>> I've seen this kind of thing in other drivers, and I wondered whether
>>> it was safe because the host asserts and deasserts PERST#
>>> asynchronously, independent of anything the endpoint is doing.
>>>
>>> I assume it's possible that the host deasserts PERST# before this
>>> driver has the stm32_pcie_ep_perst_irq_thread() thread set up. If
>>> that happens and the driver doesn't see the PERST# interrupt, does
>>> everything still work correctly?
>>
>> yes it does. the PERST# interrupt is level-triggered and, if already
>> de-asserted, fires only when enabled (it is NOAUTOEN) with start_link.
>>
>> At that point, the host can enumerate by performing a manual rescan or
>> rebind the PCIe driver, restarting the entire probe sequence.
>>
>> Tested the pcie_epf_test driver with various power-up sequences: full
>> power-up the host or device first, and stop or standby PM suspend/resume.
>
> Help me think through this. I guess the interesting case is when the
> host boots first and enumerates devices before the stm32 endpoint is
> ready, right?
>
> I suppose the endpoint LTSSM is initially disabled, so the link is
> down, and the host enumeration didn't find anything?
yes. When the device is not started (start_link) dw_pcie_wait_for_link()
fails and pci_host_probe() only register the root port:
/*
* Note: Skip the link up delay only when a Link Up IRQ is present.
* If there is no Link Up IRQ, we should not bypass the delay
* because that would require users to manually rescan for devices.
*/
if (!pp->use_linkup_irq)
/* Ignore errors, the link may come up later */
dw_pcie_wait_for_link(pci);
ret = pci_host_probe(bridge);
>
> Where does the link come up? I see the pci_epc_start_store() that
> eventually leads to stm32_pcie_start_link(), which enables perst_irq.
The link appears when explicitly requested by writing '1' into the bound
endpoint device driver sysfs 'start' once the device is configured.
see https://www.kernel.org/doc/html/latest/PCI/endpoint/pci-test-howto.html
But how pci_epc_start_store() is iterated from the configfs_write_iter()
mechanism is beyond my knowledge...
> Since you requested perst_irq with IRQF_TRIGGER_HIGH, and PERST# is
> deasserted, does that trigger stm32_pcie_ep_perst_irq_thread() and
> call stm32_pcie_perst_deassert() to enable the LTSSM?
perst_gpio is active low. So requesting the perst_irq with
IRQF_TRIGGER_HIGH triggers when deasserted.
This parts is quite confusing (for me) because gpiod_get_value()
correctly returns 0 when the gpio is de-asserted, when the irq API does
not know about active low so we must use TRIGGER_HIGH
>
> When the link comes up, if the Downstream Port supports hotplug and
> pciehp is enabled, it might notice the link-up event and treat this as
> a hot-add?
yes, I just tried with a host pc with hot-plug enabled. lspci found the
stm32 EP, as you anticipated
>
> Otherwise the user would have to manually rescan to notice the
> endpoint?
indeed, this is how I proceed when the host does not support hot-plug,
thank you,
Christian
>
>>>> Signed-off-by: Christian Bruel <christian.bruel@foss.st.com>
>>>> ---
>>>> drivers/pci/controller/dwc/pcie-stm32-ep.c | 38 ++++++------------------------
>>>> 1 file changed, 7 insertions(+), 31 deletions(-)
>>>>
>>>> diff --git a/drivers/pci/controller/dwc/pcie-stm32-ep.c b/drivers/pci/controller/dwc/pcie-stm32-ep.c
>>>> index 3400c7cd2d88a279c49ef36a99fc7537c381c384..d0654bb43759bb8d0f0d7badbf7bdae839241fcf 100644
>>>> --- a/drivers/pci/controller/dwc/pcie-stm32-ep.c
>>>> +++ b/drivers/pci/controller/dwc/pcie-stm32-ep.c
>>>> @@ -37,36 +37,9 @@ static void stm32_pcie_ep_init(struct dw_pcie_ep *ep)
>>>> dw_pcie_ep_reset_bar(pci, bar);
>>>> }
>>>> -static int stm32_pcie_enable_link(struct dw_pcie *pci)
>>>> -{
>>>> - struct stm32_pcie *stm32_pcie = to_stm32_pcie(pci);
>>>> -
>>>> - regmap_update_bits(stm32_pcie->regmap, SYSCFG_PCIECR,
>>>> - STM32MP25_PCIECR_LTSSM_EN,
>>>> - STM32MP25_PCIECR_LTSSM_EN);
>>>> -
>>>> - return dw_pcie_wait_for_link(pci);
>>>> -}
>>>> -
>>>> -static void stm32_pcie_disable_link(struct dw_pcie *pci)
>>>> -{
>>>> - struct stm32_pcie *stm32_pcie = to_stm32_pcie(pci);
>>>> -
>>>> - regmap_update_bits(stm32_pcie->regmap, SYSCFG_PCIECR, STM32MP25_PCIECR_LTSSM_EN, 0);
>>>> -}
>>>> -
>>>> static int stm32_pcie_start_link(struct dw_pcie *pci)
>>>> {
>>>> struct stm32_pcie *stm32_pcie = to_stm32_pcie(pci);
>>>> - int ret;
>>>> -
>>>> - dev_dbg(pci->dev, "Enable link\n");
>>>> -
>>>> - ret = stm32_pcie_enable_link(pci);
>>>> - if (ret) {
>>>> - dev_err(pci->dev, "PCIe cannot establish link: %d\n", ret);
>>>> - return ret;
>>>> - }
>>>> enable_irq(stm32_pcie->perst_irq);
>>>> @@ -77,11 +50,7 @@ static void stm32_pcie_stop_link(struct dw_pcie *pci)
>>>> {
>>>> struct stm32_pcie *stm32_pcie = to_stm32_pcie(pci);
>>>> - dev_dbg(pci->dev, "Disable link\n");
>>>> -
>>>> disable_irq(stm32_pcie->perst_irq);
>>>> -
>>>> - stm32_pcie_disable_link(pci);
>>>> }
>>>> static int stm32_pcie_raise_irq(struct dw_pcie_ep *ep, u8 func_no,
>>>> @@ -152,6 +121,8 @@ static void stm32_pcie_perst_assert(struct dw_pcie *pci)
>>>> dev_dbg(dev, "PERST asserted by host\n");
>>>> + regmap_update_bits(stm32_pcie->regmap, SYSCFG_PCIECR, STM32MP25_PCIECR_LTSSM_EN, 0);
>>>> +
>>>> pci_epc_deinit_notify(ep->epc);
>>>> stm32_pcie_disable_resources(stm32_pcie);
>>>> @@ -192,6 +163,11 @@ static void stm32_pcie_perst_deassert(struct dw_pcie *pci)
>>>> pci_epc_init_notify(ep->epc);
>>>> + /* Enable link training */
>>>> + regmap_update_bits(stm32_pcie->regmap, SYSCFG_PCIECR,
>>>> + STM32MP25_PCIECR_LTSSM_EN,
>>>> + STM32MP25_PCIECR_LTSSM_EN);
>>>> +
>>>> return;
>>>> err_disable_resources:
>>>>
>>>> ---
>>>> base-commit: 31115ecec74fe5c679a149d7037009f26b3aa8a9
>>>> change-id: 20251113-perst_ep-0b57b9679cf9
>>>>
>>>> Best regards,
>>>> --
>>>> Christian Bruel <christian.bruel@foss.st.com>
>>>>
>>
next prev parent reply other threads:[~2025-11-18 18:34 UTC|newest]
Thread overview: 9+ messages / expand[flat|nested] mbox.gz Atom feed top
2025-11-14 7:45 [PATCH] PCI: stm32: Fix LTSSM EP race with start link Christian Bruel
2025-11-14 18:59 ` Bjorn Helgaas
2025-11-17 12:04 ` Christian Bruel
2025-11-17 20:00 ` Bjorn Helgaas
2025-11-18 18:34 ` Christian Bruel [this message]
2025-11-18 21:28 ` Bjorn Helgaas
2025-11-19 15:13 ` Christian Bruel
2025-11-19 15:47 ` Manivannan Sadhasivam
2025-11-17 15:10 ` Manivannan Sadhasivam
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=67dbd8f6-2efe-4a73-a611-9081f364d2d4@foss.st.com \
--to=christian.bruel@foss.st.com \
--cc=alexandre.torgue@foss.st.com \
--cc=bhelgaas@google.com \
--cc=helgaas@kernel.org \
--cc=kwilczynski@kernel.org \
--cc=linux-arm-kernel@lists.infradead.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-pci@vger.kernel.org \
--cc=linux-stm32@st-md-mailman.stormreply.com \
--cc=lpieralisi@kernel.org \
--cc=mani@kernel.org \
--cc=mcoquelin.stm32@gmail.com \
--cc=robh@kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).