From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 8C4DFCF31BF for ; Thu, 3 Oct 2024 05:52:45 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender:List-Subscribe:List-Help :List-Post:List-Archive:List-Unsubscribe:List-Id:In-Reply-To: Content-Transfer-Encoding:Content-Type:MIME-Version:References:Message-ID: Subject:Cc:To:From:Date:Reply-To:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=x+I/rurAYPkV9R/iih9/yeq0qeeCIBS1txmeO8x6Thc=; b=J7TXDCxlLHhihs2+92Zinap9El aXfO3woDLP/qv5T5nRxa1xN8KkdBd1vgIym337TeDsvjKpjhYhkKB0ZS8mHzaSYKOwPMnjKoVLU46 zb8DsGjnC5q6S3QCcjF34vFwWsyXQVffn3eHKKZhLa+UiTA+1psZM/nvaVHgt5j893GyrrE0ED9Xq 0HyxXL0n6ihiOUB8XpFSUVhHffnLNOuiu44Ffm+bGNcXVaEBZNPohTTs6gHIFeoAwxNBgXsyqS4rH 94Dq680B2caIxEu5MQjO3n2Jmm5VBhFhRhepL3C+Lbs+Z9OUJYhjYkgyBxrTit7pDaWtKfeevW5SB a6o+yYIw==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.98 #2 (Red Hat Linux)) id 1swElM-00000008EsB-2w0X; Thu, 03 Oct 2024 05:52:32 +0000 Received: from mail-pj1-x1030.google.com ([2607:f8b0:4864:20::1030]) by bombadil.infradead.org with esmtps (Exim 4.98 #2 (Red Hat Linux)) id 1swEk6-00000008EkS-2W2L for linux-arm-kernel@lists.infradead.org; Thu, 03 Oct 2024 05:51:16 +0000 Received: by mail-pj1-x1030.google.com with SMTP id 98e67ed59e1d1-2e192a2fe6cso436026a91.3 for ; Wed, 02 Oct 2024 22:51:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; t=1727934674; x=1728539474; darn=lists.infradead.org; h=in-reply-to:content-transfer-encoding:content-disposition :mime-version:references:message-id:subject:cc:to:from:date:from:to :cc:subject:date:message-id:reply-to; bh=x+I/rurAYPkV9R/iih9/yeq0qeeCIBS1txmeO8x6Thc=; b=F6oEJNmS3mV293MrqR8J5P14bO18lmoYEvl6PnneDBmco/3lY2BO5D+WZjAgTbyMyK Eq5XPZlmlv0X1wiJZ/qFdYKImIBZKkUAupnTPyNNc7LlGKJYMgVNw2k48ktk/L/Vg0Cx aJwBt431LyyT5ng+2rg/7petyrDp9/dxj63PxrdOmCFgu226AT9i7ydKrGzVVyoqk8kM 27LHqUiqOFmECM0VOR/qq0SxNrNswwX4A18lmSXBOJey7k2cgt1j48+MjwQcqMZt6hy6 CxLUTpS1gF8nbDmY6IcuQw2wcu0NlGjND05/CV0XJsLillurEO8xH0ExkRM6+Suiurp2 6MBA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1727934674; x=1728539474; h=in-reply-to:content-transfer-encoding:content-disposition :mime-version:references:message-id:subject:cc:to:from:date :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=x+I/rurAYPkV9R/iih9/yeq0qeeCIBS1txmeO8x6Thc=; b=CacGQs7L0R/NEr5WjkVII/bg3XWEmb/9dpDR7AqQqh6dvIAGGSJmSVTL0o4ljgZ/YN 4MAURz1fo7ng1uLfPxDyevZJZQUvwKbst6fT8G4t9k0DsC+h3qv34CEuNZ9Racq/PZ5c IWIqaPg3sR7fnhIgfc7Fkw/19RUDMsk97Qqeq8IOjclH8pgB/0HFpeN+xVH1VwCZsPAh oD87gJBEVzZFeE9e6xLlS6IjJklJVGtI2ZrPWYuzNwOcuRukQ6TkTBhGQtsYM2YrGUCM 1UQmg1VJKc3wzSzHRFQ7ukAxsC/mebmg+5tCuj/5nyXNxJwOVs3jskC+fiHBPzx/bWio sP/w== X-Forwarded-Encrypted: i=1; AJvYcCVjYTQtOT7sgcc0JN0g3W4z4A6BeKXHa5ineZvPlEKqWZfm5BK7U69DF+TRk7uiwmDkjZAtZX2+a21XogqA1jsy@lists.infradead.org X-Gm-Message-State: AOJu0YwqVdlK9P1iNFkrZR6o3jAil4SzmH0zyCY8ejbYRhV0GycZEQqQ cUuB9Wn3ukWxlQHz72ihpqLhzTOje4AJNvN7cCTBcW6slBBgsyTjdWCARIvgTg== X-Google-Smtp-Source: AGHT+IH4jjkOJP1RtIXH+LBCTfHZBvB58vRfsRO3uSDukfy6Z2x05FLvSSpdy6l8f7b6/7D4/s/J2A== X-Received: by 2002:a17:90b:1bc4:b0:2e0:a77e:8305 with SMTP id 98e67ed59e1d1-2e18496a8c7mr6423901a91.39.1727934673666; Wed, 02 Oct 2024 22:51:13 -0700 (PDT) Received: from thinkpad ([36.255.17.222]) by smtp.gmail.com with ESMTPSA id 98e67ed59e1d1-2e1bfb2f2dfsm579483a91.31.2024.10.02.22.51.08 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 02 Oct 2024 22:51:13 -0700 (PDT) Date: Thu, 3 Oct 2024 11:21:06 +0530 From: Manivannan Sadhasivam To: Frank Li Cc: Rob Herring , Saravana Kannan , Jingoo Han , Lorenzo Pieralisi , Krzysztof =?utf-8?Q?Wilczy=C5=84ski?= , Bjorn Helgaas , Richard Zhu , Lucas Stach , Shawn Guo , Sascha Hauer , Pengutronix Kernel Team , Fabio Estevam , devicetree@vger.kernel.org, linux-kernel@vger.kernel.org, linux-pci@vger.kernel.org, linux-arm-kernel@lists.infradead.org, imx@lists.linux.dev Subject: Re: [PATCH v3 2/3] PCI: dwc: Using parent_bus_addr in of_range to eliminate cpu_addr_fixup() Message-ID: <20241003055106.sm4x23sg4hh67els@thinkpad> References: <20240930-pci_fixup_addr-v3-0-80ee70352fc7@nxp.com> <20240930-pci_fixup_addr-v3-2-80ee70352fc7@nxp.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20240930-pci_fixup_addr-v3-2-80ee70352fc7@nxp.com> X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20241002_225114_711289_B2835856 X-CRM114-Status: GOOD ( 29.11 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org On Mon, Sep 30, 2024 at 02:44:54PM -0400, Frank Li wrote: > parent_bus_addr in struct of_range can indicate address information just > ahead of PCIe controller. Most system's bus fabric use 1:1 map between > input and output address. but some hardware like i.MX8QXP doesn't use 1:1 > map. See below diagram: > > ┌─────────┐ ┌────────────┐ > ┌─────┐ │ │ IA: 0x8ff0_0000 │ │ > │ CPU ├───►│ ┌────►├─────────────────┐ │ PCI │ > └─────┘ │ │ │ IA: 0x8ff8_0000 │ │ │ > CPU Addr │ │ ┌─►├─────────────┐ │ │ Controller │ > 0x7ff0_0000─┼───┘ │ │ │ │ │ │ > │ │ │ │ │ │ │ PCI Addr > 0x7ff8_0000─┼──────┘ │ │ └──► CfgSpace ─┼────────────► > │ │ │ │ │ 0 > 0x7000_0000─┼────────►├─────────┐ │ │ │ > └─────────┘ │ └──────► IOSpace ─┼────────────► > BUS Fabric │ │ │ 0 > │ │ │ > └──────────► MemSpace ─┼────────────► > IA: 0x8000_0000 │ │ 0x8000_0000 > └────────────┘ > > bus@5f000000 { > compatible = "simple-bus"; > #address-cells = <1>; > #size-cells = <1>; > ranges = <0x5f000000 0x0 0x5f000000 0x21000000>, > <0x80000000 0x0 0x70000000 0x10000000>; Does this address translation apply to all peripherals in the bus or just PCIe? If it is just PCIe, why can't you encode the mapping in the below PCIe node 'ranges' property itself? - Mani > > pcie@5f010000 { > compatible = "fsl,imx8q-pcie"; > reg = <0x5f010000 0x10000>, <0x8ff00000 0x80000>; > reg-names = "dbi", "config"; > #address-cells = <3>; > #size-cells = <2>; > device_type = "pci"; > bus-range = <0x00 0xff>; > ranges = <0x81000000 0 0x00000000 0x8ff80000 0 0x00010000>, > <0x82000000 0 0x80000000 0x80000000 0 0x0ff00000>; > ... > }; > }; > > Term internal address (IA) here means the address just before PCIe > controller. After ATU use this IA instead CPU address, cpu_addr_fixup() can > be removed. > > Signed-off-by: Frank Li > --- > Change from v2 to v3 > - %s/cpu_untranslate_addr/parent_bus_addr/g > - update diagram. > - improve commit message. > > Change from v1 to v2 > - update because patch1 change get untranslate address method. > - add using_dtbus_info in case break back compatibility for exited platform. > --- > drivers/pci/controller/dwc/pcie-designware-host.c | 42 +++++++++++++++++++++++ > drivers/pci/controller/dwc/pcie-designware.h | 8 +++++ > 2 files changed, 50 insertions(+) > > diff --git a/drivers/pci/controller/dwc/pcie-designware-host.c b/drivers/pci/controller/dwc/pcie-designware-host.c > index 3e41865c72904..823ff42c2e2c9 100644 > --- a/drivers/pci/controller/dwc/pcie-designware-host.c > +++ b/drivers/pci/controller/dwc/pcie-designware-host.c > @@ -418,6 +418,34 @@ static void dw_pcie_host_request_msg_tlp_res(struct dw_pcie_rp *pp) > } > } > > +static int dw_pcie_get_untranslate_addr(struct dw_pcie *pci, resource_size_t pci_addr, > + resource_size_t *i_addr) > +{ > + struct device *dev = pci->dev; > + struct device_node *np = dev->of_node; > + struct of_range_parser parser; > + struct of_range range; > + int ret; > + > + if (!pci->using_dtbus_info) { > + *i_addr = pci_addr; > + return 0; > + } > + > + ret = of_range_parser_init(&parser, np); > + if (ret) > + return ret; > + > + for_each_of_pci_range(&parser, &range) { > + if (pci_addr == range.bus_addr) { > + *i_addr = range.parent_bus_addr; > + break; > + } > + } > + > + return 0; > +} > + > int dw_pcie_host_init(struct dw_pcie_rp *pp) > { > struct dw_pcie *pci = to_dw_pcie_from_pp(pp); > @@ -427,6 +455,7 @@ int dw_pcie_host_init(struct dw_pcie_rp *pp) > struct resource_entry *win; > struct pci_host_bridge *bridge; > struct resource *res; > + int index; > int ret; > > raw_spin_lock_init(&pp->lock); > @@ -440,6 +469,13 @@ int dw_pcie_host_init(struct dw_pcie_rp *pp) > pp->cfg0_size = resource_size(res); > pp->cfg0_base = res->start; > > + if (pci->using_dtbus_info) { > + index = of_property_match_string(np, "reg-names", "config"); > + if (index < 0) > + return -EINVAL; > + of_property_read_reg(np, index, &pp->cfg0_base, NULL); > + } > + > pp->va_cfg0_base = devm_pci_remap_cfg_resource(dev, res); > if (IS_ERR(pp->va_cfg0_base)) > return PTR_ERR(pp->va_cfg0_base); > @@ -462,6 +498,9 @@ int dw_pcie_host_init(struct dw_pcie_rp *pp) > pp->io_base = pci_pio_to_address(win->res->start); > } > > + if (dw_pcie_get_untranslate_addr(pci, pp->io_bus_addr, &pp->io_base)) > + return -ENODEV; > + > /* Set default bus ops */ > bridge->ops = &dw_pcie_ops; > bridge->child_ops = &dw_child_pcie_ops; > @@ -733,6 +772,9 @@ static int dw_pcie_iatu_setup(struct dw_pcie_rp *pp) > atu.cpu_addr = entry->res->start; > atu.pci_addr = entry->res->start - entry->offset; > > + if (dw_pcie_get_untranslate_addr(pci, atu.pci_addr, &atu.cpu_addr)) > + return -EINVAL; > + > /* Adjust iATU size if MSG TLP region was allocated before */ > if (pp->msg_res && pp->msg_res->parent == entry->res) > atu.size = resource_size(entry->res) - > diff --git a/drivers/pci/controller/dwc/pcie-designware.h b/drivers/pci/controller/dwc/pcie-designware.h > index c189781524fb8..e22d32b5a5f19 100644 > --- a/drivers/pci/controller/dwc/pcie-designware.h > +++ b/drivers/pci/controller/dwc/pcie-designware.h > @@ -464,6 +464,14 @@ struct dw_pcie { > struct reset_control_bulk_data core_rsts[DW_PCIE_NUM_CORE_RSTS]; > struct gpio_desc *pe_rst; > bool suspended; > + /* > + * Use device tree 'ranges' property of bus node instead using > + * cpu_addr_fixup(). Some old platform dts 'ranges' in bus node may not > + * reflect real hardware's behavior. In case break these platform back > + * compatibility, add below flags. Set it true if dts already correct > + * indicate bus fabric address convert. > + */ > + bool using_dtbus_info; > }; > > #define to_dw_pcie_from_pp(port) container_of((port), struct dw_pcie, pp) > > -- > 2.34.1 > -- மணிவண்ணன் சதாசிவம்