From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id 03257C76196 for ; Thu, 6 Apr 2023 03:50:43 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S234886AbjDFDul (ORCPT ); Wed, 5 Apr 2023 23:50:41 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:53936 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S234703AbjDFDuf (ORCPT ); Wed, 5 Apr 2023 23:50:35 -0400 Received: from mail-pj1-x102e.google.com (mail-pj1-x102e.google.com [IPv6:2607:f8b0:4864:20::102e]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 9175259E3 for ; Wed, 5 Apr 2023 20:50:32 -0700 (PDT) Received: by mail-pj1-x102e.google.com with SMTP id j13so36116281pjd.1 for ; Wed, 05 Apr 2023 20:50:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20210112; t=1680753032; h=in-reply-to:content-transfer-encoding:content-disposition :mime-version:references:message-id:subject:cc:to:from:date:from:to :cc:subject:date:message-id:reply-to; bh=6DFgxHVSoi7qhEpk5u+BdsarAdP4qAWg3XCiTncAEZ8=; b=P2gR2qVRdK7Ckxs6pVpTZbDbdDHtA/td2Fwn67o7qF1KaamtjwPe+pFeFgGI4xfL1x LMBRX64kKMNSVX48fVqhkkDQSkjv2zvQXa6zmIc2CIMt+JUzws+w/NOUwNmWcEw7XY6t uiX6VPmuHTwl7QOGQZKCmmPbS4oxjY7x9uktKGg7GmSAaaZ8PG2uIt7TwqXt7WdAd9Yq Oj8VB0P4MqCbLiZA2s/FrB9ywQUq4FrYUqsW91uI6AZXAiRehv+6Ln5E0Hl1eXwKUwrL 0z7I011Aw0HNBemvxn3IcSuKmNjHUNO4hfM5EiC112Ukru05dxUF6z/GZbmsXjzNg1YT JSFg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; t=1680753032; h=in-reply-to:content-transfer-encoding:content-disposition :mime-version:references:message-id:subject:cc:to:from:date :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=6DFgxHVSoi7qhEpk5u+BdsarAdP4qAWg3XCiTncAEZ8=; b=ftWdWr9tgRupEzPhj2BiAUdM/VpGezEturoJXwiJ5/fAbu11Tbz47IAEQf530+CGk4 5Ejm7Ri36vcVmmJfbfSb2JudawpNQY0tYrp2szZEcJXmXKFT6B9+DYLsBDoNknEzXpQS vuJL4p39GXA3EshUCPVotIBtizQ8E2hliKCMtNlxmDmUPeaXp8W5rdbl4T82Hu3Y/NB+ HoYl6j8TzdZPsY/N3AfROXh1moTO/DPU2xlnfE7kG75lsOheasRlSbf+PJBaJH+o3xWf uSvdowWhgQt77hMjF3J6shRyxTlZMmpZjkSHBKDMNRqCIySm3v0RUjw4QffkxAf6CT/Z Zjvw== X-Gm-Message-State: AAQBX9e1KLfWWyeQs6LXHjaQy6ItH2dsHkQFG9On7NfWwgmF3hpmYsQu yADcpS91wQzrcscEI3lUrMuyLA== X-Google-Smtp-Source: AKy350YfFfed8valzu4kVHfFuJe0ofxdRZFg4bBa9riHFH1xCIb/InFmM+bkl6j7Y73AIi6QZzDoHw== X-Received: by 2002:a17:902:d510:b0:1a1:b8ff:5552 with SMTP id b16-20020a170902d51000b001a1b8ff5552mr11075791plg.6.1680753031634; Wed, 05 Apr 2023 20:50:31 -0700 (PDT) Received: from google.com (41.183.143.34.bc.googleusercontent.com. [34.143.183.41]) by smtp.gmail.com with ESMTPSA id d22-20020a170902b71600b0019cb6222698sm265444pls.266.2023.04.05.20.50.28 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 05 Apr 2023 20:50:31 -0700 (PDT) Date: Thu, 6 Apr 2023 09:20:21 +0530 From: Ajay Agarwal To: William McVicker Cc: Bjorn Helgaas , Lorenzo Pieralisi , Sajid Dalvi , Han Jingoo , Bjorn Helgaas , Gustavo Pimentel , Krzysztof =?utf-8?Q?Wilczy=C5=84ski?= , Rob Herring , kernel-team@android.com, linux-pci@vger.kernel.org, linux-kernel@vger.kernel.org, Krzysztof Kozlowski Subject: Re: [PATCH v2] PCI: dwc: Wait for link up only if link is started Message-ID: References: <20230405182753.GA3626483@bhelgaas> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Wed, Apr 05, 2023 at 12:23:47PM -0700, William McVicker wrote: > On 04/05/2023, William McVicker wrote: > > On 04/05/2023, Bjorn Helgaas wrote: > > > On Wed, Apr 05, 2023 at 03:24:36PM +0200, Lorenzo Pieralisi wrote: > > > > On Thu, Mar 16, 2023 at 06:05:02PM -0500, Sajid Dalvi wrote: > > > > > On Tue, Feb 28, 2023 at 10:36 PM Sajid Dalvi wrote: > > > > > > > > > > > > Thanks for your review Jingoo. > > > > > > Sajid > > > > > > > > > > > > On Tue, Feb 28, 2023 at 4:04 PM Han Jingoo wrote: > > > > > > > > > > > > > > On Mon, Feb 27, 2023, Sajid Dalvi wrote: > > > > > > > > > > > > > > > > In dw_pcie_host_init() regardless of whether the link has been started > > > > > > > > or not, the code waits for the link to come up. Even in cases where > > > > > > > > start_link() is not defined the code ends up spinning in a loop for 1 > > > > > > > > second. Since in some systems dw_pcie_host_init() gets called during > > > > > > > > probe, this one second loop for each pcie interface instance ends up > > > > > > > > extending the boot time. > > > > > > > > > > > > > > > > Call trace when start_link() is not defined: > > > > > > > > dw_pcie_wait_for_link << spins in a loop for 1 second > > > > > > > > dw_pcie_host_init > > > > > > > > > > > > > > > > Signed-off-by: Sajid Dalvi > > > > > > > > > > > > > > (CC'ed Krzysztof Kozlowski) > > > > > > > > > > > > > > Acked-by: Jingoo Han > > > > > > > > > > > > > > It looks good to me. I also checked the previous thread. > > > > > > > I agree with Krzysztof's opinion that we should include > > > > > > > only hardware-related features into DT. > > > > > > > Thank you. > > > > > > > > > > > > > > Best regards, > > > > > > > Jingoo Han > > > > > > > > > > > > > > > --- > > > > > > > > drivers/pci/controller/dwc/pcie-designware-host.c | 6 +++--- > > > > > > > > 1 file changed, 3 insertions(+), 3 deletions(-) > > > > > > > > > > > > > > > > diff --git a/drivers/pci/controller/dwc/pcie-designware-host.c b/drivers/pci/controller/dwc/pcie-designware-host.c > > > > > > > > index 9952057c8819..9709f69f173e 100644 > > > > > > > > --- a/drivers/pci/controller/dwc/pcie-designware-host.c > > > > > > > > +++ b/drivers/pci/controller/dwc/pcie-designware-host.c > > > > > > > > @@ -489,10 +489,10 @@ int dw_pcie_host_init(struct dw_pcie_rp *pp) > > > > > > > > ret = dw_pcie_start_link(pci); > > > > > > > > if (ret) > > > > > > > > goto err_remove_edma; > > > > > > > > - } > > > > > > > > > > > > > > > > - /* Ignore errors, the link may come up later */ > > > > > > > > - dw_pcie_wait_for_link(pci); > > > > > > > > + /* Ignore errors, the link may come up later */ > > > > > > > > + dw_pcie_wait_for_link(pci); > > > > > > > > + } > > > > > > > > > > > > > > > > bridge->sysdata = pp; > > > > > > > > > > > > > > > > -- > > > > > > > > 2.39.2.722.g9855ee24e9-goog > > > > > > > > > > > > > > > > > > @bhelgaas Can this be picked up in your tree: > > > > > https://git.kernel.org/pub/scm/linux/kernel/git/helgaas/pci.git/ > > > > > > > > This patch seems fine to me. The question I have though is why the > > > > *current* code is written the way it is. Perhaps it is just the way > > > > it is, I wonder whether this change can trigger a regression though. > > > > > > The new code will look basically like this: > > > > > > if (!dw_pcie_link_up(pci)) { > > > dw_pcie_start_link(pci); > > > dw_pcie_wait_for_link(pci); > > > } > > > > > > If the link is already up by the time we get here, this change means > > > we won't get this message emitted by dw_pcie_wait_for_link(): > > > > > > dev_info(pci->dev, "PCIe Gen.%u x%u link up\n", ...) > > > > > > I don't know how important that is, but I bet somebody cares about it. > > > > > > From the commit log, I expected the patch to do something based on > > > whether ->start_link() was defined, but there really isn't a direct > > > connection, so maybe the log could be refined. > > > > > > Bjorn > > > > > > -- > > > To unsubscribe from this group and stop receiving emails from it, send an email to kernel-team+unsubscribe@android.com. > > > > > > > After taking a deeper dive into this patch, I found that [1] changes the > > original intent which was to skip the call to dw_pcie_wait_for_link() > > when pci->ops->start_link is NULL. I talked to Sajid offline and he > > agreed we should put back the start_link NULL check. The updated patch > > should look like this: > > > > if (!dw_pcie_link_up(pci) && pci->ops && pci->ops->start_link) { > > ret = dw_pcie_start_link(pci); > > if (ret) > > goto err_free_msi; > > dw_pcie_wait_for_link(pci); > > } > > > > > > ...which will ensure that we don't call dw_pcie_wait_for_link() when > > pci->ops->start_link is NULL. > > > > With regards to the log, I think there are 2 ways to solve this: > > > > 1) We could also call dw_pcie_wait_for_link() in a new else if > > dw_pcie_link_up() returns 1. > > 2) We could add this to the top of dw_pcie_wait_for_link() and leave the > > code as is: > > > > if (!pci->ops || !pci->ops->start_link) > > return 0; > > > > I kind of like (2) since that solves both Sajid's original issue and > > will keep the original log. > > > > [1] https://lore.kernel.org/all/20220624143428.8334-14-Sergey.Semin@baikalelectronics.ru/ > > > > Regards, > > Will > > Below is what I'm thinking will do the job. I verified on a Pixel 6 > (which doesn't have start_link() defined) that we don't have the 1 > second wait from dw_pcie_wait_for_link() during probe. > > diff --git a/drivers/pci/controller/dwc/pcie-designware.c b/drivers/pci/controller/dwc/pcie-designware.c > index 8e33e6e59e68..1bf04324ad2d 100644 > --- a/drivers/pci/controller/dwc/pcie-designware.c > +++ b/drivers/pci/controller/dwc/pcie-designware.c > @@ -648,13 +648,16 @@ int dw_pcie_wait_for_link(struct dw_pcie *pci) > { > u32 offset, val; > int retries; > + int link_up = dw_pcie_link_up(pci); > > - /* Check if the link is up or not */ > - for (retries = 0; retries < LINK_WAIT_MAX_RETRIES; retries++) { > - if (dw_pcie_link_up(pci)) > - break; > + if (!link_up && !(pci->ops && pci->ops->start_link)) > + return 0; There is a problem with this approach. A platform driver could enable link training internally, i.e., it does not have the start_link() pointer defined. Then it could call `dw_pcie_wait_for_link` to wait for the link to come up. (See pcie-intel-gw.c for an example of such a platform). Your logic will end up regressing this driver by exiting early. > > + /* Check if the link is up or not */ > + for (retries = 0; !link_up && retries < LINK_WAIT_MAX_RETRIES; retries++) { > usleep_range(LINK_WAIT_USLEEP_MIN, LINK_WAIT_USLEEP_MAX); > + > + link_up = dw_pcie_link_up(pci); > } > > if (retries >= LINK_WAIT_MAX_RETRIES) { > The problem of the log is still not solved for a platform which could have the link up by default, i.e., it does not need to explicitly enable link training.