From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id BB3B9C3DA4A for ; Mon, 19 Aug 2024 18:39:55 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender:List-Subscribe:List-Help :List-Post:List-Archive:List-Unsubscribe:List-Id:In-Reply-To:Content-Type: MIME-Version:References:Message-ID:Subject:CC:To:From:Date:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=Bz+xMlRg8ADmAKZoH4DFsTkjTKJiDXTqyg7kKfL7exU=; b=oYUUn4bA7HwQXIQu7ArLVH24V6 1d10qTFVugP1tnP50H1FOJqUB/BaSSqKeH7Z/ccA+eSDP2vPzGDhCQph51KC12OWkT5zp12QaInAF wWGB0isqXqU8rCnapKQPngEMer4hnUQZSKHd/OEAwBtfeFJCBnnNEbC2oR/WqrDyztK91W9SZCoNY 5N2Yq7E+UQ5y8sIrSdsT61hS3d/Q9BxUGdapRLsRTvnFiIvXp3fz6KJ/+mf06eKLA0SgqldAksTdW 0JtFNA2owjHRMD1Xsu8P9Ei65Y5c9SfYaEoGYiR/WphdFRyqYZ0LM/QILBZ6YAtgB6G558CVm2T9l o1Xf4s6w==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.97.1 #2 (Red Hat Linux)) id 1sg7I3-00000002cE0-3A7H; Mon, 19 Aug 2024 18:39:39 +0000 Received: from mail-dm6nam11on20619.outbound.protection.outlook.com ([2a01:111:f403:2415::619] helo=NAM11-DM6-obe.outbound.protection.outlook.com) by bombadil.infradead.org with esmtps (Exim 4.97.1 #2 (Red Hat Linux)) id 1sg7HM-00000002c3F-3DXy for linux-arm-kernel@lists.infradead.org; Mon, 19 Aug 2024 18:38:58 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=OPleQNILMtJRw6QV8C5rUiXjFG2wkujm0SHMeN1vJrVgzm3HBTRVxWdmv31FYkhQkhejrcAa8tnc3NcUPzo7fQew5sJRYqm5zF94USAX05jLBQL19xC4mLcivdSmUfKyQAlSpv+e+4A78Tw96D7roAEzHcqNckMFzcjVr8YWoNdJH7a0hGKnYXpfJkXcUZWfQxbzGrtISoPKiXL75bvZ+UotGpDAmly237IQjsVcmJ2vtCn2UBUog9GQV0k0lwQpf6HlEmO9lAr/+V5pW+AXU9gFzy003dOxMu1EWU8bZJgIgarqGDXPnho21BK4LUuhlJYFnvdRbEYC1ByY0wA3vg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=Bz+xMlRg8ADmAKZoH4DFsTkjTKJiDXTqyg7kKfL7exU=; b=Kv7m3OaEUjcgb0qDTwTLQ6IvqIYRQhA0auJarcT1CxOsbnuZf9CsUWgyCRtO5ygv4zdusR0H6z8p+M+IFORy3dIJBK1nDJra6kz9zfTd2PqyVhNwtd4dM5Stf9QFxmkLPcZwvSibUZMH8AiApFwyt4U5/yuTwuvzSQkWK8NQNbV0mVnP5doGw55uc94i7cBYLpVYuGaLyrA6dLNmvGy5DZXUC6sJeqkvGDhYmCzkJWSB74tSHXvJs5MKTzkHQF3vlkzhD1K+jrwW+otv7P5CdQCHF2Fd5G/ilV94RHAMseoLSTWmo45WEqMT4kjq2Ihx/xtv+WgRhbeaz86qp5u3FA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.117.160) smtp.rcpttodomain=intel.com smtp.mailfrom=nvidia.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none (0) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Bz+xMlRg8ADmAKZoH4DFsTkjTKJiDXTqyg7kKfL7exU=; b=qbQm36fXeQM7LDVsdX/fgAoP7dgucYIYHqivY/oqWkhY33HBiZbioW0v9Im9hBCZtTXnvXN0WH9r3B9Epat/TwRgcNHhPegaiWqTJEK7J2U32WB8odR+YLVUG+QVSx7J4YALJ4BI5AuEAP7j7q/x6+d6KSmyKGXgHIUcWVbiT2CigkyVjeWpalSY7RUsy901ibj2HE991MFVpZAgJk+Y1kMAa+UXnEVIQaMSeeL1Q6UijW/EcCfuXHqY7ydx47CiFii9etRdcoE5uVIc2E5M2m9aUf5MazwrFXNCCJDlr0PxwlFRVaQ1PtkQxMNJGAqGX2Yjd7L/GiiuHrwT23NFTg== Received: from BN0PR04CA0154.namprd04.prod.outlook.com (2603:10b6:408:eb::9) by SA1PR12MB6751.namprd12.prod.outlook.com (2603:10b6:806:258::6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7875.21; Mon, 19 Aug 2024 18:38:47 +0000 Received: from BN3PEPF0000B076.namprd04.prod.outlook.com (2603:10b6:408:eb:cafe::a0) by BN0PR04CA0154.outlook.office365.com (2603:10b6:408:eb::9) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7875.21 via Frontend Transport; Mon, 19 Aug 2024 18:38:47 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.117.160) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.117.160 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.117.160; helo=mail.nvidia.com; pr=C Received: from mail.nvidia.com (216.228.117.160) by BN3PEPF0000B076.mail.protection.outlook.com (10.167.243.121) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7897.11 via Frontend Transport; Mon, 19 Aug 2024 18:38:46 +0000 Received: from rnnvmail204.nvidia.com (10.129.68.6) by mail.nvidia.com (10.129.200.66) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1544.4; Mon, 19 Aug 2024 11:38:26 -0700 Received: from rnnvmail205.nvidia.com (10.129.68.10) by rnnvmail204.nvidia.com (10.129.68.6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1544.4; Mon, 19 Aug 2024 11:38:26 -0700 Received: from Asurada-Nvidia (10.127.8.12) by mail.nvidia.com (10.129.68.10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1544.4 via Frontend Transport; Mon, 19 Aug 2024 11:38:24 -0700 Date: Mon, 19 Aug 2024 11:38:22 -0700 From: Nicolin Chen To: Jason Gunthorpe CC: , , , , , , , , , , , Subject: Re: [PATCH v1 15/16] iommu/arm-smmu-v3: Add viommu cache invalidation support Message-ID: References: <729dfd0808f85d88fd3ef8bcea0168cc1d2c0d59.1723061378.git.nicolinc@nvidia.com> <20240815233635.GV2032816@nvidia.com> <20240819173615.GN2032816@nvidia.com> <20240819182811.GR2032816@nvidia.com> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Disposition: inline In-Reply-To: <20240819182811.GR2032816@nvidia.com> X-NV-OnPremToCloud: ExternallySecured X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: BN3PEPF0000B076:EE_|SA1PR12MB6751:EE_ X-MS-Office365-Filtering-Correlation-Id: 4c5fd283-dd66-49a1-9014-08dcc07e2931 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|82310400026|7416014|376014|1800799024|36860700013; X-Microsoft-Antispam-Message-Info: =?us-ascii?Q?LuQO6vYKQfaFUDfeuCxfnady+NtkLZkgRVK4XO6N/dxZPKU5c1cJ2rAVtl6n?= =?us-ascii?Q?WljW0ETNxeZbah8+xIBELiwyq+1e5yAh8r0fZdjerGTAe5Vkkj1mMNMD1XRG?= =?us-ascii?Q?8VuDUV/UBic5VyicDvDmCzMy0TMHCCjlDeCl5ZS73viBm/BiUtboywPTX76i?= =?us-ascii?Q?aqhCUmbSvPv+kfx/AEOGiX4BGhrQdoxts126s4oQwM7/tkC4R1oIzOICuSWT?= =?us-ascii?Q?WYZeDrVZhSnI9UXYOm9ozlU5VOjMcpWAxbcYwTz4+2avN8ENZbt3Yl+L3sby?= =?us-ascii?Q?gTLuRB7VeSK2tBuP+quJppuMGob+kzk9VwQW9xRCMj4rA6iDguualwOKvujt?= =?us-ascii?Q?wZlvudpUNC2DGt4dB0AFQBK1bGzdU5HKtd5hshQ0Ic8uwZNNX/O1gNO98/Tt?= =?us-ascii?Q?CRp4PJ95rHbJZjRCZ5gd8UpH62uqK2gkT0gFrotVdTP9wUJqzMdzu0+xzEHL?= =?us-ascii?Q?faiECvzXBK2KwR25Qy82luTibXVO8NpJxaILxY5tVa/Y1eRAJFsqLkTsOXL/?= =?us-ascii?Q?OMN3zcKUUu4aHk1e8LBmtCVp+yXkP6LpNrLku5/1eMdFVyHOAkX+TvFFaY61?= =?us-ascii?Q?xj5YQP86A8+bxqEkoQ0ud/BEV0eGD7Kca3uZUs3D+m+59Mv/mujNCkG2y69n?= =?us-ascii?Q?rx689+v8Ttqy8FQfN0nkwz//xQeqTAQ9pJkc9/qLnvu60J8QZ5VKheQ6d2A+?= =?us-ascii?Q?kQpni0GJXtcHjm1Umyrbvqj9dsjnIFawcZ4NJdA5SsWAvtkiPhdDs2gJI5RK?= =?us-ascii?Q?tuUSQf7+KYgwd7YF7zVfHdbRKDxHVJDYUStGNXZba83BI2jqObH/+B8ZoMkz?= =?us-ascii?Q?SSijSGAKWYosUgxUXv4cQldklqRTldxo3bw7NX5G8Z9Wxbe7aXGNXUO13ejj?= =?us-ascii?Q?2mkPGVhqkrL6upTqLV7vslvW9OlPNp4vGiutZB1+zbx/4BjV4Dvh1v8/2V0X?= =?us-ascii?Q?JZYv0EqoCWinxppuHk+w2+7vx3+2sHSMwcIowN0EVacu5o/5Myw6gbtuMlua?= =?us-ascii?Q?n/wJt3vMmkcWsEat7Z7WLbdBjpCC3qx4Bf+O2hxBlJelV03V5ta9bmmSBs/9?= =?us-ascii?Q?EIsMjaOu2YYyoU9pu80KvVVTFdsuI600QdTX0GkcMxIVxAwzRWeDojo2Poxr?= =?us-ascii?Q?nw7kdbq0dbXwg3+iZmQGQ58JkwhPyRqsmt3SxnC67mNW4Rg0pT9HAP3cuDGu?= =?us-ascii?Q?pbp1I/4jUSFYrAV/F5fJVBfg0n+EwPHgsSkowythVkP166qft8r1IZDPpXnj?= =?us-ascii?Q?fI8EjTbniP+fzsrHwQCJ1pWEOEH5z/q+tmMiX9IV2YboRVGsOGxPLvgRgAUn?= =?us-ascii?Q?DkRCDfyUqJG0vu9YIIrBV5ykEIGIPIqXORMpeOidHyVi9INAD4c9pxNbcZdP?= =?us-ascii?Q?tbNNDxVAJHxAQLbt8nkttIGrh6ulmxFhfYfL7EzsHATz4ZJitjMPTKyZrXVn?= =?us-ascii?Q?Jr+FJI0HrdusJ4vU55r3slLVMnIJPui6?= X-Forefront-Antispam-Report: CIP:216.228.117.160;CTRY:US;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:mail.nvidia.com;PTR:dc6edge1.nvidia.com;CAT:NONE;SFS:(13230040)(82310400026)(7416014)(376014)(1800799024)(36860700013);DIR:OUT;SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 19 Aug 2024 18:38:46.7262 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 4c5fd283-dd66-49a1-9014-08dcc07e2931 X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a;Ip=[216.228.117.160];Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: BN3PEPF0000B076.namprd04.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: SA1PR12MB6751 X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20240819_113856_817537_7EDF7631 X-CRM114-Status: GOOD ( 14.84 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org On Mon, Aug 19, 2024 at 03:28:11PM -0300, Jason Gunthorpe wrote: > On Mon, Aug 19, 2024 at 11:19:39AM -0700, Nicolin Chen wrote: > > > > But nesting enablment with out viommu is alot less useful than I had > > > thought :( > > > > Actually, without viommu, the hwpt cache invalidate alone could > > still support non-SVA case? > > That is what I thought, but doesn't the guest still have to invalidate > the CD table entry # 0? I recall it doesn't. The CD cache invalidation is required in the viommu invalidation for an SVA case where we need a PASID number to specify CD to the substream. But the CD to the default stream is only changed during a vSTE setup, and the host knows the PASID number (=0)? > > Though we still have the blocker at the msi mapping... It still > > requires a solution, even for viommu series. > > Yes, small steps. The point of this step was to get the nested paging > only (without msi, pri, etc, etc) Ack. Thanks Nicolin