From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 7EBC4CEB2C9 for ; Mon, 30 Sep 2024 22:02:17 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender:List-Subscribe:List-Help :List-Post:List-Archive:List-Unsubscribe:List-Id:In-Reply-To:Content-Type: MIME-Version:References:Message-ID:Subject:CC:To:From:Date:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=EWO8Rbzd1HWSytRzd9R9DgyrIPXTBza6CCfnEacnHsU=; b=dZh6C3I4YUYq0SToo64P6Bavjl mvSo5nPkkJ3nfXHxVfkmNLdUuX9NntrvJIx1mG3puE83BkiYC3somVJj957Rsu21M79PoeciNCnto N3IaDvk+0irEYXzhkmxG9YY6avcd2yiuW5F7t+zm3fuTFiesVITRRq5Zo/nk2Kz9WZaVadQjfubbn AyUfwzSp6y3LcmFz8NtpAqIAq64B7JSeDKC1dlAhasKGPwVAkQkOB0cwMByrf9G/NrZbi1w/weKRD mSJkeP1X8CXAopJBpVPPJDt4tsNdJ7D60w1S9RzXpmB6o9ohpb3Ks26ec6I83UMktkTRu4sjX6PkI uh4H3Mmg==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.98 #2 (Red Hat Linux)) id 1svOT0-00000000ynj-1GRk; Mon, 30 Sep 2024 22:02:06 +0000 Received: from mail-bn8nam11on20613.outbound.protection.outlook.com ([2a01:111:f403:2414::613] helo=NAM11-BN8-obe.outbound.protection.outlook.com) by bombadil.infradead.org with esmtps (Exim 4.98 #2 (Red Hat Linux)) id 1svORH-00000000yZb-02b7 for linux-arm-kernel@lists.infradead.org; Mon, 30 Sep 2024 22:00:20 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=R9ALFCPvghIbW8uAaMGOFLa9/rwksQx0vtRruRPwwgE8mgwNZRDCDx9fYoD91VRMZKM//3kjrmIb5RuwOeRcUDwK3AR8nESB1rMFPAHTdmpdNZYx2jQdt/KxaRQWBO5HEtFFreRmFNPaG1Wl2J1KexpFPK+dyWzrDWmJjDfC326aqzqJPfTjtrTv/u07EfARKUezzeo9plG9qF9l62YlFM4vajS4h+PXZjAX4/ISG7I7bNiBya0C8x7uyXJ3T0OjExol7/R7v/tqvS4VZ6MQVSX3KZvz3M6RI9mvU73d/qFx/9gY54ommhRpZOc4Dm4ReJsdLMCKbdwECvplJmeU1w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=EWO8Rbzd1HWSytRzd9R9DgyrIPXTBza6CCfnEacnHsU=; b=ItZv9QNNSdWLN2kXhKLxNaIhU61VKLCVYzNAelGWnFdGDh8dxaXEPfke7r1Xlo2QO0wnZp0ZAlHb6ghfc4wjARtxUQB8+8hZmi05blFy5MfI1oC+9Nf28k4TBxbYe5aPytjzPKpAC+DPlPsYpn6dBZjljj32g2NuMvdH9694ULo0ECBozjF2xmLoN9yOxl4GaMW3mFBYkYDkqs5b6XTZXTXTjADXjEoxHjuOjz02oY0rer/2o60qTLpX4f7C/7lqVHx7mUuP8oYK1xSb7VPMOrxKBWvs9BrO67XWJN9ItJsMU8a1r05M208W8ZHnzqTvZIJWfv/ipg3CWngoC6gSKw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.117.161) smtp.rcpttodomain=intel.com smtp.mailfrom=nvidia.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none (0) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=EWO8Rbzd1HWSytRzd9R9DgyrIPXTBza6CCfnEacnHsU=; b=i2T9ttEuRAmrPIcWuAooEIzJ/6xZfIMNZfK+znXj8dkvt6X5T0rzR+xbOHu068lU8Q9pgFaVNqqWbDjxgLSVPoFY+By21qB7xNISLOqjVfIwmPyACLTyDJtz5AAFfbDSWDPWJvVhrTgnk3AwZ9pHWaBrk5SYWkJxIMgUFXlnVbOMuvh2UxYnGkRWVvntJ3pLs5vn9R1yH8XtoNTtNjtHxCB/GcmzXpdN+Fp1Sgpw6VrfOdWREp8oOMtq32M4/qilUmpAiLmkbYTln9zHYMzfZHIxq15Dtb1sQVJvTLfRAR05vnlLW6CV3R4lZkYmKL2rnLt/Iipa4jXK7NjlYeV4CA== Received: from CH2PR05CA0068.namprd05.prod.outlook.com (2603:10b6:610:38::45) by MN2PR12MB4255.namprd12.prod.outlook.com (2603:10b6:208:198::12) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8005.26; Mon, 30 Sep 2024 22:00:01 +0000 Received: from CH1PEPF0000A34A.namprd04.prod.outlook.com (2603:10b6:610:38:cafe::ef) by CH2PR05CA0068.outlook.office365.com (2603:10b6:610:38::45) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8026.15 via Frontend Transport; Mon, 30 Sep 2024 22:00:01 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.117.161) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.117.161 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.117.161; helo=mail.nvidia.com; pr=C Received: from mail.nvidia.com (216.228.117.161) by CH1PEPF0000A34A.mail.protection.outlook.com (10.167.244.5) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8026.11 via Frontend Transport; Mon, 30 Sep 2024 22:00:01 +0000 Received: from rnnvmail204.nvidia.com (10.129.68.6) by mail.nvidia.com (10.129.200.67) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1544.4; Mon, 30 Sep 2024 14:59:53 -0700 Received: from rnnvmail205.nvidia.com (10.129.68.10) by rnnvmail204.nvidia.com (10.129.68.6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1544.4; Mon, 30 Sep 2024 14:59:53 -0700 Received: from Asurada-Nvidia (10.127.8.13) by mail.nvidia.com (10.129.68.10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1544.4 via Frontend Transport; Mon, 30 Sep 2024 14:59:52 -0700 Date: Mon, 30 Sep 2024 14:59:50 -0700 From: Nicolin Chen To: Yi Liu CC: , , , , , , , , , , , , , , , , , , Subject: Re: [PATCH v2 00/19] iommufd: Add VIOMMU infrastructure (Part-1) Message-ID: References: <82632802-c55a-4199-b685-8b594a8e7104@intel.com> <8440cd72-ced6-4887-b724-ce6a1650db13@intel.com> <380fe58a-934a-4e57-aa18-f4e0841b5fb4@intel.com> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Disposition: inline In-Reply-To: <380fe58a-934a-4e57-aa18-f4e0841b5fb4@intel.com> X-NV-OnPremToCloud: ExternallySecured X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: CH1PEPF0000A34A:EE_|MN2PR12MB4255:EE_ X-MS-Office365-Filtering-Correlation-Id: ddf00f09-68ac-4eb3-85d7-08dce19b3b77 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|376014|7416014|1800799024|36860700013|82310400026; X-Microsoft-Antispam-Message-Info: =?us-ascii?Q?ONhqXyA12XlVHlboUzB6OHK6rxQTzNzP0g8NSTbam8SYXyLvBIn8sjKuQR7Q?= =?us-ascii?Q?L1bG9n+AWomdg01sIojCWnIJBOi1JdyYmdlxgW2DsWuIcYIGjWcpqAgbfqq4?= =?us-ascii?Q?G0UHnc9UHQ4Ydbb2MPRVa7ggruYrczGzmeWJbAqbNbymA8yTuO6/CQV629qH?= =?us-ascii?Q?GjPSDsCWeLV8YConBiQ09klbd9JXBu2NDQzbkrn96QeO80Y8Ol4EVcdvHYDi?= =?us-ascii?Q?6ic+prZlcXGCUOiRKh1iEiMPwUPWqUmAl4zC5nLQWPJQWb7hkvmQl34d54TA?= =?us-ascii?Q?biRzvTphMXQdaMxK0Yb5Qj82urJOUhpFOtSNu9bnwt3FyLs+AVATRNyBWiFt?= =?us-ascii?Q?7UJsLwYPKgbX7U4LRXvOqYn4L1gPkJ8V9aKtJn5Qp9hjChknbRKN5gP8vlDX?= =?us-ascii?Q?aWW3fGw2CWnlYKIsDEvpQTt7a3prjWw1EyhvZVWU3MLeJXwwy7TDu5z08hyy?= =?us-ascii?Q?2Rd9a2t7/bufDPLa1VYHSJy2QOcxYaJTlsfVGZDysC46QwyVGwhGKSJLzV3H?= =?us-ascii?Q?zGnRjybnl6B+VUXm8GtX9DboTCC4ICsQ3UPFfalew4OOOrP+f7R0kKCgJ1Lh?= =?us-ascii?Q?jwqI8b43NCdJTREN7K18FO5w+0d8TEQYCq13ma5jQvHL9JNAa5PxiUWzT2L5?= =?us-ascii?Q?WB71seF6IONqZ/E56EYANxYNxWeWe8GIvk5MYmb+OQZj/LEVURepTuZ/2dDc?= =?us-ascii?Q?TJ4GDyzqfij5cOTTgWK+eIY5KiIxEPLyuy60rUjGlhn+PWM1YGdZ9qmtfZgL?= =?us-ascii?Q?0FqwqAJE1unDX1xxCJKyRbiSKZL/VKux7tgO4PlVu16BIvE1GCse5hLkXGXS?= =?us-ascii?Q?G77T06IiIFdYuGi8hUsS2uHuEaFjEBV8t4vfOUPrbpj5YfMf/areAftVjOAw?= =?us-ascii?Q?AI9BCoY56m4q/3Sj+UTsFc1SzgaEE5YhHTho3Ph073qObhpJFCMsCBGulv+T?= =?us-ascii?Q?SeQLJiDXfoS9tc6nQlodkKEvVBOh3fI564ahJzI1BgXdqfZmzZdSxA5ymC96?= =?us-ascii?Q?B8oo9IbjoeOfxcumGteDMu99LBMUynVBis3vWJxoP34R6RTXOPcz+Ha9+6um?= =?us-ascii?Q?KwUo4wsp7nIQdR5hz6kX0BMKqnkvqWYLB/VAllTMbgp8ARFfRp9zmJX0Du2E?= =?us-ascii?Q?HfAIfWwycs+TDarxT9c3D6oqHcpbOVg2u/b3s1sJaIRPwR2lD7f7I9joZYFA?= =?us-ascii?Q?pRbV6SPUAFKPbusZEZzGWgpz+Xeo2ZJAuilL52z+31Ww5rm/ywqFSFteGvWU?= =?us-ascii?Q?xDKVFYYj8ZUX/l6pNnjMw4fKu7xpaLYZ5oW43bpzzGSPIKKqzLHsuCIscz9V?= =?us-ascii?Q?FW8AUDZuJ6NPYQPmviazjyA21zIWaLS5g0f+jvwwUP4zCbcaRNxULp2R+tHI?= =?us-ascii?Q?8LfHjer6ZhNms5bcrWsiiLO1Txr6?= X-Forefront-Antispam-Report: CIP:216.228.117.161;CTRY:US;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:mail.nvidia.com;PTR:dc6edge2.nvidia.com;CAT:NONE;SFS:(13230040)(376014)(7416014)(1800799024)(36860700013)(82310400026);DIR:OUT;SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 30 Sep 2024 22:00:01.2387 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: ddf00f09-68ac-4eb3-85d7-08dce19b3b77 X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a;Ip=[216.228.117.161];Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: CH1PEPF0000A34A.namprd04.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN2PR12MB4255 X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20240930_150019_084026_B5988302 X-CRM114-Status: GOOD ( 23.92 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org On Sun, Sep 29, 2024 at 03:16:55PM +0800, Yi Liu wrote: > > > > I feel these two might act somehow similarly to the two DIDs > > > > during nested translations? > > > > > > not quite the same. Is it possible that the ASID is the same for stage-1? > > > Intel VT-d side can have the pasid to be the same. Like the gIOVA, all > > > devices use the same ridpasid. Like the scenario I replied to Baolu[1], > > > do er choose to use different DIDs to differentiate the caches for the > > > two devices. > > > > On ARM, each S1 domain (either a normal stage-1 PASID=0 domain or > > an SVA PASID>0 domain) has a unique ASID. > > I see. Looks like ASID is not the PASID. It's not. PASID is called Substream ID in SMMU term. It's used to index the PASID table. For cache invalidations, a PASID (ssid) is for ATC (dev cache) or PASID table entry invalidation only. > > So it unlikely has the > > situation of two identical ASIDs if they are on the same vIOMMU, > > because the ASID pool is per IOMMU instance (whether p or v). > > > > With two vIOMMU instances, there might be the same ASIDs but they > > will be tagged with different VMIDs. > > > > > [1] > > > https://lore.kernel.org/linux-iommu/4bc9bd20-5aae-440d-84fd-f530d0747c23@intel.com/ > > > > Is "gIOVA" a type of invalidation that only uses "address" out of > > "PASID, DID and address"? I.e. PASID and DID are not provided via > > the invalidation request, so it's going to broadcast all viommus? > > gIOVA is just a term v.s. vSVA. Just want to differentiate it from vSVA. :) > PASID and DID are still provided in the invalidation. I am still not getting this gIOVA. What it does exactly v.s. vSVA? And should RIDPASID be IOMMU_NO_PASID? Nicolin