From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 190D4CD5BAC for ; Thu, 21 May 2026 13:13:10 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender:List-Subscribe:List-Help :List-Post:List-Archive:List-Unsubscribe:List-Id:MIME-Version:In-Reply-To: Content-Type:References:Message-ID:Subject:Cc:To:From:Date:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=9AWPNTEyx6b99FtUG7Kp0z+zpui/ej/y72NDhWEXzJ4=; b=xbs72AWnbc2tne0L4whihCW/Cv mhjnJ0Cb1VsQQz6gpXOdfw28ZblawhU2ybrWpMttZRHKkljPPynNmfmxAkqR9FuemjWcJ6yJFwKDL QexDhLtKYS6PrzUjVQR76cFIvuTFK9NtkloZ6SQCHvifVlAKcJDhOmoI9bJ3MWl0dU/hn/eZ12ClC njAtptlw3dWrV90jDlXB6VeTckNn1jX1w59Hq8GiA5a9P+PTOY5wMVhE6qD30uY5bxXjYW15jLtYL KpiDaoDVhQokX/vLon4aPSQjUO8kRKaB1Lqu67mtRN+pfNKyUWJqxeFrr/Qr14+6r+mXf+j9lOnWM 5FCuNApQ==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.99.1 #2 (Red Hat Linux)) id 1wQ3Cx-00000007pZB-1jBq; Thu, 21 May 2026 13:13:03 +0000 Received: from mail-westus3azlp170110003.outbound.protection.outlook.com ([2a01:111:f403:c107::3] helo=PH0PR06CU001.outbound.protection.outlook.com) by bombadil.infradead.org with esmtps (Exim 4.99.1 #2 (Red Hat Linux)) id 1wQ3Cv-00000007pYf-1hK4 for linux-arm-kernel@lists.infradead.org; Thu, 21 May 2026 13:13:02 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=gM+DvkPKeQAmFA+uARCBwWTIHGBUahnzkKwTvbTTS8qRP7LylU+ysZ2T5rSOs8+pCBCBLHTZahfqClp4IJspXCHXxbSX1o5haKlX2lEJUWx2ST/nm8v4EPfkWw8KEZ0QRamBiaxblqCLoDgaScnzOvBRKn0L3cIicwsv6eAiD7+ygPoEEvxuKuI2LwcCe9rDFh3tHH5VsQJDw3JBE4KUzsW5P8DJss9cPUbJMJitMbJlTZunvLWad09mru0fXpOUOuVLs1MYUPUQ7JOtfYkQFrd7Ryu6iHbiDI//PaREUClVFuMqyCtIUQPEmB9VNnZKE61zbMV5lE8vEAL3PRl6MQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=9AWPNTEyx6b99FtUG7Kp0z+zpui/ej/y72NDhWEXzJ4=; b=DZadaSiin3D+LJkFml2GoVnrHCrpoL+GewKw4LAymxBhYd3lG4AOH1Sqo0eyYGjhNxwrYjMMo/Fo53NhRGFUdFupHropISBBE/qAWSmr4Zbt/m8w4PFxv6deAq7X9e3g0cYGqt1eUnWl9aArXcTNZSTOd771h1559Qy5JZ9gE3r5Ee90atAG0KA69EQmgDbB2erm5fYIuEijdBnDiE2Yp4LabUokr4uXWVS46MQvL2SMcYU+vYJjaV+ZjA9XzzssMMzQ3TxfemM5LBVYPvM/X/8eLw0pOUvAwcSIKmrEBgayCbcTJbipBmqCwZonPWD/xT7tQ+WVAMDcDVAwMrE93Q== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nvidia.com; dmarc=pass action=none header.from=nvidia.com; dkim=pass header.d=nvidia.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=9AWPNTEyx6b99FtUG7Kp0z+zpui/ej/y72NDhWEXzJ4=; b=HPWgrqwuZKhAQDS6Uz67muFFley5rVgoIcTTnjo9YNgTdsSmFq7Kfqnb7baJU0J502RWFeshHneI0+8igYe3umLLnqF5Wbf7dl55LYRvbSFLWzOxYTM3uDCvXIXrosy49Zj8bCQHc0LKc1hHj2Tnk2JMMjAuu/k5vZPyoJIhr5/y69CBV+PIRG1NUW5Czi62P26WEQ+GUaBOtran7jnGan2D2ddZAF1iFmd0b3jAcPagiRwiHY5UJxJ2IbO1wW6zgctzb2+78vxOVNeeO+9GwUg3IObtH5hVMHYaPQAa52qeW7iXvL1SilPdr1CslJOjlOEi1bxXPULcFonLA8u6Tg== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=nvidia.com; Received: from LV8PR12MB9620.namprd12.prod.outlook.com (2603:10b6:408:2a1::19) by MN0PR12MB6197.namprd12.prod.outlook.com (2603:10b6:208:3c6::22) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.21.25.19; Thu, 21 May 2026 13:12:50 +0000 Received: from LV8PR12MB9620.namprd12.prod.outlook.com ([fe80::299d:f5e0:3550:1528]) by LV8PR12MB9620.namprd12.prod.outlook.com ([fe80::299d:f5e0:3550:1528%5]) with mapi id 15.21.0048.013; Thu, 21 May 2026 13:12:50 +0000 Date: Thu, 21 May 2026 10:12:48 -0300 From: Jason Gunthorpe To: Nicolin Chen Cc: Will Deacon , Robin Murphy , Joerg Roedel , Bjorn Helgaas , "Rafael J . Wysocki" , Len Brown , Pranjal Shrivastava , Mostafa Saleh , Lu Baolu , Kevin Tian , linux-arm-kernel@lists.infradead.org, iommu@lists.linux.dev, linux-kernel@vger.kernel.org, linux-acpi@vger.kernel.org, linux-pci@vger.kernel.org, vsethi@nvidia.com, Shuai Xue Subject: Re: [PATCH v4 11/24] iommu: Add iommu_report_device_broken() to quarantine a broken device Message-ID: <20260521131248.GF3602937@nvidia.com> References: <20260519120737.GQ787748@nvidia.com> <20260519191626.GJ3602937@nvidia.com> <20260519230204.GM3602937@nvidia.com> <20260520003023.GR3602937@nvidia.com> <20260520175123.GZ3602937@nvidia.com> Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-ClientProxiedBy: YT1PR01CA0110.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:2c::19) To LV8PR12MB9620.namprd12.prod.outlook.com (2603:10b6:408:2a1::19) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: LV8PR12MB9620:EE_|MN0PR12MB6197:EE_ X-MS-Office365-Filtering-Correlation-Id: 5b6058cf-c015-4ce7-a91d-08deb73aa8c9 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|366016|1800799024|7416014|376014|18002099003|22082099003|56012099003|4143699003|11063799006|6133799003; X-Microsoft-Antispam-Message-Info: rn4A9OmIW1XsiBxxAzVJbx6VFMxhxNoLJ4M13HcgfqhQ+T4RZPSeBGTkoXkeTn/hNoII01zoIEW/p+Wbirr2oTbasqCuDpySXjPPAhOT8uZnDtKu+CksrcBmnVoRb523aGNmTp+zItJICUGaop8Ov0kA5mkx2VRQMaZJSsLGvzibMz6q42VFtMymIxHJnKdbtb8Vz8dyv8hzKx9yedzS0lcbvJnGoTzAXh6NrfLzYmBQPsIyJ4cAau/SR0u/KQRd6go14JhoHrmXBCg1OSfmn/I+5gP+hq46ItzRDp9UaAWvBwP/Ti8EokDzIUyVDYnDTGpuir9EP15rx4TeMcFfY8ScgG6Li4aTdbAcmZSRcnLi6jzv5+KXL/kAE5Vgmd05LnzzeTTv47JAMEyro1HjI1qSlel4HagWvNNmIh/ZAmN78SBv0Au5xGGY/FlmdtuJtZAvjQ0M9VSTv90MbDB4/wtXNj8fC1OZsamEqfkRVBiCe1n4U2LkGmJJXu/uLpT+VoCETOadfD/A5Hg/wQC7EYlUrMsa0bu/XTFVJ7yZ02bho+ikSdTnoFgnY6Udl+P37v4bq9zvrTTZM/fMuuLVTu7oz84wBMJE1hQcAuxuos9NwrmbMvDt/KKI3BvyW6k0W3FH477oepXg5LzdcKr1uZPjeCsaxTYyZ6QcT/F/8FprE0kwZByevqt81D7hs74b X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:LV8PR12MB9620.namprd12.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(366016)(1800799024)(7416014)(376014)(18002099003)(22082099003)(56012099003)(4143699003)(11063799006)(6133799003);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?QnKEZTupe4M9SwbM9NuyW9Np/24lkDZH1tsq4MTEcvj1ICJTTNi2YCaEvwVm?= =?us-ascii?Q?jI/ZinKBL/wSLgY16X8tMXYCVz8uTPhYuGNDWMzdkwVTwSKMbvZdB1BHdsl9?= =?us-ascii?Q?NwDGqyxCpU9XjnOrmXmtzTIVqKs4NW1cKo6vDrCKZB1jd3oifh211lQmMIot?= =?us-ascii?Q?41X2EJO1JkfqiJYclUN5j+bkYlxGIKZYMMjo0i66n44NkU6cyYdVWjwUh44a?= =?us-ascii?Q?rDn+uHDGFyqENeG/iFPCBOAtS+OdABe4RXLT8oesDtVhirSM/6VMdkSB5Xsd?= =?us-ascii?Q?Mgo9xT2R13UBl3fMoo/cxixZWtsBFZIG4mAMe58xvoUQg+FjhBpR3hoPr27a?= =?us-ascii?Q?p/UQDnPjiEmXSmeg6Q9235GGmZ54GmpxmO/2n1S4olidvA8uvEKtby/YYr4e?= =?us-ascii?Q?xygW8mX5ewbP534TbTQMpa4EyVXi/Ah0/54alIr3bU5vDTnslbiPOeWMr+7R?= =?us-ascii?Q?N2asc2bIleWhlg3fxNOOPXsq5CfvDqC/hCbn5xz7FRQmIzMijZ93dCnVtMyL?= =?us-ascii?Q?p5iYzlcATXRwVfIvscvHCRa7BFz3Y7kMaksnhR6jyvX0QlvZdEjDJhaC1IqH?= =?us-ascii?Q?i6o3x4uYHQeqcQjlfaUHW813+2OTXwLadgzAPlDXZ8Sln0Jr8stI/jR2TgXM?= =?us-ascii?Q?YaQb9XF0MpnX9TUE7AQCpZkOucm5YuJujtmslhIhj4AXXaKpBHQ1DC5E3rdm?= =?us-ascii?Q?GUh0MrjWGek49GgAiD1Vr2T0CcfDzhiaYIfRHBGTEvNSyXLve+FzhfFGVxwz?= =?us-ascii?Q?Kl2xALljmKop9o2O2WeFE7XfbYGjlj4AO/UXH8qsfGf4Vq1dFIX5e/f/4jF5?= =?us-ascii?Q?IzzUFiFUqvlIVLKctdK4WZlvTu4rRHpSMCeqGUJ+9xrephlTuimDG/l78+QC?= =?us-ascii?Q?eMbZvU2a5imFgu7rHvze61y3rnyFw9nF2X6fL1rqiy5bIPNsG2m+TIJ34WfY?= =?us-ascii?Q?BM53drcZQ91EO/Ko1bt4xtvIj/SEHvPU8sZkcpjccXp260WFXoeOrrI83mHn?= =?us-ascii?Q?x/RQEndn+zGK6cRg+ab9g8CML5bcWPct+99mGZWX++SXgL33/3PfEG/PC3vv?= =?us-ascii?Q?P6zr3F2q7vRRRiv3i1zjEgIMnoGSz3qTvxVmSsf6xAIMIN0+uUR9C/9djj/z?= =?us-ascii?Q?3IsPFJ9YhTOZ3cHH3UVk77ZEgArLnjj+93VOLJQBFdJClzPCn4H/OkFbt6ql?= =?us-ascii?Q?8tgLzZlFk/a5pPrpfDJugaFgvG3vBLEDyuLSKW73KmM8asvoQzCD19xk/7cu?= =?us-ascii?Q?CqcDyGXJv3AJjZLcIgazJL/RLHp+gYVxBr0b21TGZ/4NlbIwyAfZkDYitEez?= =?us-ascii?Q?dpd6aMBaG8qjDLiXOQ4I6ImvtbATuKIe4BY9b+zBaS1utwDrgrsObxXByNVT?= =?us-ascii?Q?7rVsvR5pTpcEtHK0REeqj6t14FDbqoYDDTbwKDOCUKk+Kw5BUYYC+FDcrjIP?= =?us-ascii?Q?nRsP76AvJ1a59rwG+Pd3MKG5z3Fhkozyu5MMv189IonqiVgWXjAPyKWo4aZo?= =?us-ascii?Q?uqe2mNQeyMldcstCDFR7vTlPNkcmy3o+7oaadS51PPNwT80Z903yLwXWSpq6?= =?us-ascii?Q?L1NmyjngLk3gsHjaQu/dt79fqLhK4Z0NsQX4IFEVj7EHyI5YENcL34SCs0TE?= =?us-ascii?Q?nDXYjx3CpN/ZMwG9CWJGWw52oaeZfwzUFKnh4RGlzUjdjMl8EWiyIbsgBmOw?= =?us-ascii?Q?/4s5vcuHrPkx0cB0B1eEboaJo95nlm2JRH2ikP9LMXV+xYju?= X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-Network-Message-Id: 5b6058cf-c015-4ce7-a91d-08deb73aa8c9 X-MS-Exchange-CrossTenant-AuthSource: LV8PR12MB9620.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 21 May 2026 13:12:50.2333 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: oAqAB3oZqj+8FyCQnwPNw78D9f6/Zn60bM72jaKYppLNTdhFTXKmFEGUZmlpi90I X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN0PR12MB6197 X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.9.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20260521_061301_448329_369BEE69 X-CRM114-Status: GOOD ( 22.33 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org On Wed, May 20, 2026 at 11:13:14AM -0700, Nicolin Chen wrote: > > > > We cannot eliminate parallel ATS invalidation. Two threads could be > > > > concurrently processing the invs list. So it has handle it, the driver > > > > is going to have to tolerate a number of redundant error events. > > > > > > OK. That sounds like we still need a flag or locking so that at > > > least pci_disable_ats() would not be called again. I will see > > > what I can do. > > > > I think we can call pci_disable_ats() as many times as we want > > That triggers WARN_ON(!dev->ats_enabled) in pci_disable_ats :-( IMHO I'd rather take that out than add a bunch of complication in the iommu drivers.. > > Still, I'd feel better if it is was definititive and we didn't rely on > > this. This further points that the driver has to merge multiple error > > notifications if it gets some AERs and a new "ATC ERROR" all for the > > same key event. > > I feel some race here... Part of the complexity of this v4 is to deal > with concurrent device reset during the async report() between IOMMU > core and driver. Now, we add AER that could compete on the device side > as well... It is always going to have concurrent events, so long as the resets sequence in an orderly way it doesn't matter if they overlap. Most likely the driver will have locking that prevents it from pushing concurrent resets. Jason