From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-15.3 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER, INCLUDES_PATCH,MAILING_LIST_MULTI,NICE_REPLY_A,SPF_HELO_NONE,SPF_PASS, URIBL_BLOCKED,USER_AGENT_SANE_1 autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id D731BC433ED for ; Mon, 19 Apr 2021 20:04:51 +0000 (UTC) Received: from desiato.infradead.org (desiato.infradead.org [90.155.92.199]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 30B0261369 for ; Mon, 19 Apr 2021 20:04:51 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 30B0261369 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=nvidia.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=desiato.20200630; h=Sender:Content-Transfer-Encoding :Content-Type:List-Subscribe:List-Help:List-Post:List-Archive: List-Unsubscribe:List-Id:In-Reply-To:MIME-Version:Date:Message-ID:References: CC:To:From:Subject:Reply-To:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=ulUmEG+M9xqV6hkZbZj5VWcbZPrpnctNJCdswegBwBw=; b=FpJ+ULPeHU5hWXeADxlM6slo2 eFdQscR9z9g2fX7tWNWVXGTv8oGSjF2zhGRxxKQ/GEGxd3jmGrU+0hJVyoS6S8B/9t9OqNjWw24i6 YptebQKvsDsKpCF/vp/wgVJrMGYrfECszl2wSy809WwI4gZNRXhNKTayTzLE09qZV4q1aQXwmP0f2 rHnUIMZEOLCJkEmDxcaQAZtBrteVvGnWOAUQnYCy9wC4oFpWXjlIjPTWy7T/ORB2l+wKE2fdPByyl GW7u9HCCHnugAy/RLsqUYjsOubkcvkZnUXoU3+mARgh6hcL8/An+ltguqomm6dPrji6KHwJtz5Sdp BWpv2uO0w==; Received: from localhost ([::1] helo=desiato.infradead.org) by desiato.infradead.org with esmtp (Exim 4.94 #2 (Red Hat Linux)) id 1lYa6M-00AXli-Ar; Mon, 19 Apr 2021 20:02:34 +0000 Received: from bombadil.infradead.org ([2607:7c80:54:e::133]) by desiato.infradead.org with esmtps (Exim 4.94 #2 (Red Hat Linux)) id 1lYa6E-00AXlR-Hb; Mon, 19 Apr 2021 20:02:26 +0000 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=bombadil.20210309; h=Content-Transfer-Encoding: Content-Type:In-Reply-To:MIME-Version:Date:Message-ID:References:CC:To:From: Subject:Sender:Reply-To:Content-ID:Content-Description; bh=ZZxixqWTpQaPs0Lj1AKbNapjdDfZ0XnAoJoNovPaEp0=; b=aVv6p5c3kWWICN08gsjBoSEqyT KZCWJI539OTtN/e4GWzLmJWkWggEfW3qJJKGUvC7jnrzMmg4j5ucN6jzsuFcDgkZ5QohVinmgOL5D e4GVm+EuMPEBOAk3LwEN84IziYeDKriNCzhssV4zkPOPk9zvj01u6iZMWvdqrNlVDJ3nLrteuNLca ZL+7BuG97pOohZN5nnPXcOiqmGUx6Q/CDArrnMSY6z97tTanaWr9hGL99umWJt7Ag4cqduKQ1msyG oAGby9mfzIGsLRN6IvF949U8xM7FOvrFjIeL2GfME8mQSAUvdG0tNMjJxRaXAxuo1jbW46I2GEKAs FFJ+DroQ==; Received: from mail-eopbgr770049.outbound.protection.outlook.com ([40.107.77.49] helo=NAM02-SN1-obe.outbound.protection.outlook.com) by bombadil.infradead.org with esmtps (Exim 4.94 #2 (Red Hat Linux)) id 1lYa69-00Bd4J-2A; Mon, 19 Apr 2021 20:02:24 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=eouOPOWzdzkUdhzkH+bhj7zSZ5hLB/lBiolaNy3CGejW5/V6OJf6y1rpqPC9tctuY1TbJiN38PEy1X/kN6Ax3A7XSUi8GutgDFoDJkEIODyGQOt2WDdr+Wkm19XJUUpgv3JpYi6lAECh2B8Oan9qBADXRtFoXqjT8sHNfNuphOfr8ftGa4WIYJ6ZM748I65Muu4bjBqdyd9jQtDFsNhOleMMxHVboHYhak9JdvCWKjHHWG/YMnF/VPUQ9EYqtD/0FYl8MNC0JwZU4ibIu9Lv21Yuq48pPdNuvozMgZpAtxbFwQy2qNF8ZPQD/Y21hzqrg8Rc+45IANJC3E1B4TJbrg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=ZZxixqWTpQaPs0Lj1AKbNapjdDfZ0XnAoJoNovPaEp0=; b=eTWYXflxn/dd/pqNPaGoknZa+Bvz3xLRQa2OXFXGetsFa98yp8LM4nmV/oJWYpdldZlG4eNeYWd7hn/5xXrsjSz91x5FLIz0pVbGPJUpT377Af1mv+mzlSZ+hv25RN/dbNbSm3kyrJAnmnYyoPbrpWAzUmaq97MV4wb0gnWGTDZw9YB1wAgv9tJv6lgU1gMN1u9kQS9wuV5LzL+R0PD3L2UaVfsUh0YvwbWaCXmmFr2c5DDEQHk9LFx82H0222DEva9cgda4YXFm0yCVVCw4+Q3gpsGipAKpd5cSZpDN9wOPuK9MPVt9RCS3rmcqjg09T4nweUy2xoc5WGhs2vrIPw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.112.34) smtp.rcpttodomain=microsoft.com smtp.mailfrom=nvidia.com; dmarc=pass (p=none sp=none pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=ZZxixqWTpQaPs0Lj1AKbNapjdDfZ0XnAoJoNovPaEp0=; b=tUtRfJoYrhROAOwsFyQz921U9ONkcQbL4euxkrWl6F+icDUI3l2KC+zJ7aL2E7dFTzvGxAhpikOQGDsVWS6YNyWgHMEuNJRZOuH8GHfwjMrNprluRCimNwKWUjeOD8ieBnXZ5BYdk0HHe5565wh78XRmEVpDEYi/BHfldcwSdGngDNSt3mgSIcA9toa9+dKye4sLpOM3C31BJ1dtudKTrq7g4xuZnGoHYtVr8w6VJ2oFZLj9B0L1NGsj7fIt5MYfo2Y28QdbPhR/oRPvMqeQlTKjZW6BQEbAc0HOCJMpu1wBQVitRB0zZgXssoHP42XYZKCEY0cwWIB6EyOJVujRqg== Received: from DM5PR10CA0005.namprd10.prod.outlook.com (2603:10b6:4:2::15) by DM5PR12MB1708.namprd12.prod.outlook.com (2603:10b6:3:10e::22) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4042.16; Mon, 19 Apr 2021 20:02:18 +0000 Received: from DM6NAM11FT063.eop-nam11.prod.protection.outlook.com (2603:10b6:4:2:cafe::48) by DM5PR10CA0005.outlook.office365.com (2603:10b6:4:2::15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4042.16 via Frontend Transport; Mon, 19 Apr 2021 20:02:18 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.112.34) smtp.mailfrom=nvidia.com; microsoft.com; dkim=none (message not signed) header.d=none;microsoft.com; dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.112.34 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.112.34; helo=mail.nvidia.com; Received: from mail.nvidia.com (216.228.112.34) by DM6NAM11FT063.mail.protection.outlook.com (10.13.172.219) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.4042.16 via Frontend Transport; Mon, 19 Apr 2021 20:02:18 +0000 Received: from [10.26.49.10] (172.20.145.6) by HQMAIL107.nvidia.com (172.20.187.13) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Mon, 19 Apr 2021 20:02:12 +0000 Subject: Re: [PATCH v3 01/14] PCI: tegra: Convert to MSI domains From: Jon Hunter To: Marc Zyngier , Lorenzo Pieralisi , Bjorn Helgaas CC: Frank Wunderlich , Thierry Reding , Thomas Gleixner , Rob Herring , Will Deacon , "K. Y. Srinivasan" , Haiyang Zhang , "Stephen Hemminger" , Michael Kelley , Wei Liu , Thierry Reding , Ryder Lee , Marek Vasut , Yoshihiro Shimoda , Michal Simek , Paul Walmsley , Bharat Kumar Gogada , , , , , , , , References: <20210330151145.997953-1-maz@kernel.org> <20210330151145.997953-2-maz@kernel.org> <316e8be4-fa70-75e8-8483-ae38036306e0@nvidia.com> Message-ID: <638a9996-c762-fa11-b740-6a41d4a83bcc@nvidia.com> Date: Mon, 19 Apr 2021 21:02:10 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.7.1 MIME-Version: 1.0 In-Reply-To: <316e8be4-fa70-75e8-8483-ae38036306e0@nvidia.com> Content-Language: en-US X-Originating-IP: [172.20.145.6] X-ClientProxiedBy: HQMAIL101.nvidia.com (172.20.187.10) To HQMAIL107.nvidia.com (172.20.187.13) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 87d0fd90-ac65-4902-6297-08d9036e0905 X-MS-TrafficTypeDiagnostic: DM5PR12MB1708: X-LD-Processed: 43083d15-7273-40c1-b7db-39efd9ccc17a,ExtAddr X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:9508; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: Vo0eKVRbjFKAoXFuij8V8wmravDh1VQ/aNBzFg1JwUJCGbYHrU/84X3ie35meZBpLW5WIyu2T0aoG8EjllCkL9bgAPdrQFRX/kG0ULmI8FuPU+1HkHBAr8qnGu/BlKpUYmKVopKMumhyxivONrBir5DcXExqxBfy1QMx+FdhN1o/cgcGpZHC+/TZWpyHX/AUkAEoGOSjXLxP8DlZwdAiRvLwR6Rdib7qzKL75FmOzrisq1VpUYqL/rgfTR2nMyjfqoKFZ4HhSa/5gZ1J0xiFIAo1U7dgFy7bwHdlp23SQwp3ZPSdXpeVIBc8Hwvy+kmJOus5rYP/4w7+2zWIFrk6nLRJp+FxGYyvnn5cl1yudsccPc6CVpPattBGFuNWcC4PC4AMb9ab4HHmsdsin6Y+dlaS/k4EFpcdy6R+067Lr2t7B2tcjqy0kSeB+U7fRmPsAHxPySDcpkyVDrFmTQlbiywYVLTaeS+F1aRvhgNtTh41epQopI0LmliKEP0Q6u/qnLA8JYBfPJSnJ0rw9hwRkkQGqC4Hpi/dRjUXjw56kItsl9YENe8YWVqUU2qO8Fo9RLbbjgcD3Ex8kHqeWg0sB2YmMIRoPnw8BO087cKFnvpP4su0mB49D6GpfEeL2Td91I9reFRuF4Rkx9gdEXZqg2aKM/+KBm9QdEMG6jUy4HYceIJQN1OmTsVcqlCmOolJ X-Forefront-Antispam-Report: CIP:216.228.112.34; CTRY:US; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:mail.nvidia.com; PTR:schybrid03.nvidia.com; CAT:NONE; SFS:(4636009)(39860400002)(396003)(136003)(376002)(346002)(36840700001)(46966006)(36756003)(82310400003)(5660300002)(26005)(110136005)(36906005)(47076005)(16576012)(316002)(86362001)(31696002)(2906002)(36860700001)(8676002)(186003)(83380400001)(4326008)(16526019)(356005)(2616005)(54906003)(31686004)(70586007)(7416002)(7636003)(478600001)(8936002)(336012)(53546011)(82740400003)(426003)(70206006)(43740500002); DIR:OUT; SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 19 Apr 2021 20:02:18.1140 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 87d0fd90-ac65-4902-6297-08d9036e0905 X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a; Ip=[216.228.112.34]; Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: DM6NAM11FT063.eop-nam11.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM5PR12MB1708 X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20210419_130221_280894_79347080 X-CRM114-Status: GOOD ( 23.40 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org On 19/04/2021 20:19, Jon Hunter wrote: > Hi Marc, > > On 30/03/2021 16:11, Marc Zyngier wrote: >> In anticipation of the removal of the msi_controller structure, convert >> the Tegra host controller driver to MSI domains. >> >> We end-up with the usual two domain structure, the top one being a >> generic PCI/MSI domain, the bottom one being Tegra-specific and handling >> the actual HW interrupt allocation. >> >> While at it, convert the normal interrupt handler to a chained handler, >> handle the controller's MSI IRQ edge triggered, support multiple MSIs >> per device and use the AFI_MSI_EN_VEC* registers to provide MSI masking. >> >> Acked-by: Bjorn Helgaas >> [treding@nvidia.com: fix, clean up and address TODOs from Marc's draft] >> Signed-off-by: Thierry Reding >> Signed-off-by: Marc Zyngier > > > This change is breaking a suspend test that we are running on Tegra124 > Jetson-TK1. The Tegra124 Jetson TK1 uses a PCI based ethernet device ... > > $ lspci > 00:02.0 PCI bridge: NVIDIA Corporation TegraK1 PCIe x1 Bridge (rev a1) > 01:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. > RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 0c) > > After resuming from suspend, networking is no longer working. The reason > why this breaks our suspend test is because that setup is using NFS for > the rootfs. I am looking into it, but if anyone has any thoughts please > let me know. So the following does appear to fix it ... diff --git a/drivers/pci/controller/pci-tegra.c b/drivers/pci/controller/pci-tegra.c index eaba7b2fab4a..558f02e0693d 100644 --- a/drivers/pci/controller/pci-tegra.c +++ b/drivers/pci/controller/pci-tegra.c @@ -1802,13 +1802,17 @@ static void tegra_pcie_enable_msi(struct tegra_pcie *pcie) { const struct tegra_pcie_soc *soc = pcie->soc; struct tegra_msi *msi = &pcie->msi; - u32 reg; + u32 i, reg; afi_writel(pcie, msi->phys >> soc->msi_base_shift, AFI_MSI_FPCI_BAR_ST); afi_writel(pcie, msi->phys, AFI_MSI_AXI_BAR_ST); /* this register is in 4K increments */ afi_writel(pcie, 1, AFI_MSI_BAR_SZ); + /* enable all MSI vectors */ + for (i = 0; i < 8; i++) + afi_writel(pcie, 0xffffffff, AFI_MSI_EN_VEC(i)); + /* and unmask the MSI interrupt */ reg = afi_readl(pcie, AFI_INTR_MASK); reg |= AFI_INTR_MASK_MSI_MASK; @@ -1837,13 +1841,17 @@ static void tegra_pcie_msi_teardown(struct tegra_pcie *pcie) static int tegra_pcie_disable_msi(struct tegra_pcie *pcie) { - u32 value; + u32 i, value; /* mask the MSI interrupt */ value = afi_readl(pcie, AFI_INTR_MASK); value &= ~AFI_INTR_MASK_MSI_MASK; afi_writel(pcie, value, AFI_INTR_MASK); + /* disable all MSI vectors */ + for (i = 0; i < 8; i++) + afi_writel(pcie, 0, AFI_MSI_EN_VEC(i)); + return 0; } Any reason why that code was removed? Thanks Jon -- nvpublic _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel