From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 91EFDC433F5 for ; Mon, 21 Mar 2022 22:34:10 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender: Content-Transfer-Encoding:Content-Type:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:In-Reply-To:MIME-Version:References: Message-ID:Subject:Cc:To:From:Date:Reply-To:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: List-Owner; bh=Y2Mv0Y4LrQqZ0e+ju8BQ+N8RxJ4qGSsa47gMG0UlJus=; b=bRjSQmW0vveijY /wMC3/Hplhk5u7Wz5qUN30/9mlXJ3QG+rE9Os75c2dBNAZGSd7ZwXRhIqCMynvrqbGYF8jXq19FbR UI1JRcARbLTXhr4P9PUGgAaQKRwArzmoq+52OSUO6LKt5xt1TQigtnMXuMZV0IJmSUqKiwDJkeXqR UDr+VwpfAYDZyyNkuigHjYuBQoTIT+x2i7rj3IXqGmbr7G61yYRG+EsqgWcwAwbkYw+sRsbr0fN/k eH8vvg1cy7IotVvY/YJZLKTesr9upyQ3CfRxCD9e2jfgOdXCcUSaaDU2qfpV7pdsUhvdkWrx55MUx +FNRWnqyVb96XVd/0IBg==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.94.2 #2 (Red Hat Linux)) id 1nWQa8-009Fof-Og; Mon, 21 Mar 2022 22:32:56 +0000 Received: from smtp-relay-internal-0.canonical.com ([185.125.188.122]) by bombadil.infradead.org with esmtps (Exim 4.94.2 #2 (Red Hat Linux)) id 1nWQa5-009Fno-1Z for linux-arm-kernel@lists.infradead.org; Mon, 21 Mar 2022 22:32:55 +0000 Received: from mail-io1-f70.google.com (mail-io1-f70.google.com [209.85.166.70]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by smtp-relay-internal-0.canonical.com (Postfix) with ESMTPS id 1EF893F1B6 for ; Mon, 21 Mar 2022 22:32:45 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=canonical.com; s=20210705; t=1647901965; bh=XDxK5C2+TSZ+aKZ0Wy4YRhUpCIrlRUVGIVSk2+SABTU=; h=Date:From:To:Cc:Subject:Message-ID:References:MIME-Version: Content-Type:In-Reply-To; b=tqIgojDWSHJyPdZcyqFpL6o7ZVnZAmuDGRyK9juvO1iBokpBxtaeo4HpmAUj+S/Q6 JHodkUAHBUxfvJ+Uopa70FxlpAMbPNC9VvbI1Ef63Dh7TNY34kBKHCt3iXArIBlRyf XG8MxI9bLmlN7dWkm481SoG0CKw54lCQ+QL9AppckOkEIIKpckEVV2uWpU9G5cGWr8 +w57c+e4jyPMiJ1Ex3ra7e3bxZAqfVOVsLZ/AxslvWGmrvEHBQfx7v8BNoaQ+f2/R2 JYW7VTlO+x9H31t9J5KYXSJp6sTvquLnyzqDxlc39wlkt1gmjzv+e4SXYy27n2NLkw om9AH1zRK7k0w== Received: by mail-io1-f70.google.com with SMTP id k10-20020a5d91ca000000b006414a00b160so11313244ior.18 for ; Mon, 21 Mar 2022 15:32:45 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=XDxK5C2+TSZ+aKZ0Wy4YRhUpCIrlRUVGIVSk2+SABTU=; b=dfjapII0bIwqFrXfgvbKhMuEq22zRrw6OkURd77nFrnLR1oihyqn/r0uqTMK5nK4wM 70pGpsuBx0NS9B1dxhu4UkpsugWN8caiDkNldln75Ppq6K0eD65ZE5S/5dR8IpgIeltP wu7UB+r2eiQIatJyebzxJD/Xh03pb/f+rRuI7PPoLV0GfspWclzbF7G4ogEWfQAexsw7 nAtm7P490shq+dUFubRLudn+U14U86u9pccn7d4Mq2/vk4XivHQRdGjp4Lty55wwzp8M Rm8i41b3HcarPGBe4zcQHp1wz8TbylwhuhdZYnnXpZxY51hWFIhIwzLovAVjAAOsfBdd VdUQ== X-Gm-Message-State: AOAM531XOwjPrpjJYlh0j7OT+EKyy4Em++dAcZLGpCEQMjKaakYr1O7l Ove/zraeNwTJkCzwEOeKe/+7eN6iqBSsQAU9IMoPOVbqKrBoEWg0rFI1Tl+pL4Ikf5wNUZkkUMO lVY+3wynKM9KjcBSS+QqI1jL3rO3YlC6ewW9QWms0bKOgcqycS4b3 X-Received: by 2002:a05:6e02:5b1:b0:2c6:218d:fb38 with SMTP id k17-20020a056e0205b100b002c6218dfb38mr10945927ils.266.1647901963708; Mon, 21 Mar 2022 15:32:43 -0700 (PDT) X-Google-Smtp-Source: ABdhPJwAFr4gjq1K+/JSkE+Bmnd8mMisGuPUNiCR0CRuDg5LKHtX6MOLU2pb1SX/F9E9Vlp34LLMoQ== X-Received: by 2002:a05:6e02:5b1:b0:2c6:218d:fb38 with SMTP id k17-20020a056e0205b100b002c6218dfb38mr10945920ils.266.1647901963429; Mon, 21 Mar 2022 15:32:43 -0700 (PDT) Received: from xps13.dannf (c-73-14-97-161.hsd1.co.comcast.net. [73.14.97.161]) by smtp.gmail.com with ESMTPSA id s10-20020a6b740a000000b006413d13477dsm9219017iog.33.2022.03.21.15.32.42 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 21 Mar 2022 15:32:42 -0700 (PDT) Date: Mon, 21 Mar 2022 16:32:40 -0600 From: dann frazier To: Rob Herring Cc: Marc Zyngier , "linux-kernel@vger.kernel.org" , linux-arm-kernel , PCI , Toan Le , Lorenzo Pieralisi , Krzysztof =?utf-8?Q?Wilczy=C5=84ski?= , Bjorn Helgaas , =?iso-8859-1?Q?St=E9phane?= Graber , Android Kernel Team Subject: Re: [PATCH v2 0/2] PCI: xgene: Restore working PCIe functionnality Message-ID: References: <20220321104843.949645-1-maz@kernel.org> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20220321_153253_390106_4AD0DCB8 X-CRM114-Status: GOOD ( 35.36 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org On Mon, Mar 21, 2022 at 11:08:20AM -0500, Rob Herring wrote: > On Mon, Mar 21, 2022 at 09:50:24AM -0600, dann frazier wrote: > > On Mon, Mar 21, 2022 at 10:17:34AM -0500, Rob Herring wrote: > > > On Mon, Mar 21, 2022 at 5:49 AM Marc Zyngier wrote: > > > > > > > > Since 6dce5aa59e0b ("PCI: xgene: Use inbound resources for setup") was > > > > merged in the 5.5 time frame, PCIe on the venerable XGene platform has > > > > been unusable: 6dce5aa59e0b broke both XGene-1 (Mustang and m400) and > > > > XGene-2 (Merlin), while the addition of c7a75d07827a ("PCI: xgene: Fix > > > > IB window setup") fixed XGene-2, but left the rest of the zoo > > > > unusable. > > > > > > > > It is understood that this systems come with "creative" DTs that don't > > > > match the expectations of modern kernels. However, there is little to > > > > be gained by forcing these changes on users -- the firmware is not > > > > upgradable, and the current owner of the IP will deny that these > > > > machines have ever existed. > > > > > > The gain for fixing this properly is not having drivers do their own > > > dma-ranges parsing. We've seen what happens when drivers do their own > > > parsing of standard properties (e.g. interrupt-map). Currently, we > > > don't have any drivers doing their own parsing: > > > > > > $ git grep of_pci_dma_range_parser_init > > > drivers/of/address.c:int of_pci_dma_range_parser_init(struct > > > of_pci_range_parser *parser, > > > drivers/of/address.c:EXPORT_SYMBOL_GPL(of_pci_dma_range_parser_init); > > > drivers/of/address.c:#define of_dma_range_parser_init > > > of_pci_dma_range_parser_init > > > drivers/of/unittest.c: if (of_pci_dma_range_parser_init(&parser, np)) { > > > drivers/pci/of.c: err = of_pci_dma_range_parser_init(&parser, dev_node); > > > include/linux/of_address.h:extern int > > > of_pci_dma_range_parser_init(struct of_pci_range_parser *parser, > > > include/linux/of_address.h:static inline int > > > of_pci_dma_range_parser_init(struct of_pci_range_parser *parser, > > > > > > And we can probably further refactor this to be private to drivers/pci/of.c. > > > > > > For XGene-2 the issue is simply that the driver depends on the order > > > of dma-ranges entries. > > > > > > For XGene-1, I'd still like to understand what the issue is. Reverting > > > the first fix and fixing 'dma-ranges' should have fixed it. I need a > > > dump of how the IB registers are initialized in both cases. > > > > Happy to provide that for the m400 if told how :) > > Something like the below patch. This should be with the 'dma-ranges' > DT change and only c7a75d07827a reverted. https://paste.ubuntu.com/p/RHzBd5jT6v/ Note that networking does come up with this setup. That surprised me because I thought I'd tested this combo before, but apparently what I'd tested before was 6dce5aa59e0b reverted + the dtb change: https://lore.kernel.org/linux-pci/YgXG838iMrS1l8SC@xps13.dannf/ -dann > 8<------------------------------------------------------------------- > diff --git a/drivers/pci/controller/pci-xgene.c b/drivers/pci/controller/pci-xgene.c > index 0d5acbfc7143..6a435c31f45e 100644 > --- a/drivers/pci/controller/pci-xgene.c > +++ b/drivers/pci/controller/pci-xgene.c > @@ -78,6 +78,7 @@ static u32 xgene_pcie_readl(struct xgene_pcie *port, u32 reg) > > static void xgene_pcie_writel(struct xgene_pcie *port, u32 reg, u32 val) > { > + dev_info(port->dev, "0x%04x <- 0x%08x\n", reg, val); > writel(val, port->csr_base + reg); > } > > @@ -508,7 +509,9 @@ static void xgene_pcie_setup_ib_reg(struct xgene_pcie *port, > case 0: > xgene_pcie_set_ib_mask(port, BRIDGE_CFG_4, flags, size); > bar_addr = cfg_base + PCI_BASE_ADDRESS_0; > + dev_info(port->dev, "BAR0L <- 0x%08x\n", bar_low); > writel(bar_low, bar_addr); > + dev_info(port->dev, "BAR0H <- 0x%08x\n", upper_32_bits(cpu_addr)); > writel(upper_32_bits(cpu_addr), bar_addr + 0x4); > pim_reg = PIM1_1L; > break; _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel