From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 659CFC02194 for ; Tue, 4 Feb 2025 13:04:08 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender:List-Subscribe:List-Help :List-Post:List-Archive:List-Unsubscribe:List-Id:MIME-Version:In-Reply-To: Content-Type:References:Message-ID:Subject:Cc:To:From:Date:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=95l+OCPZExP3PtjfTTFHiYOuFRzyHawgC6ZyZElbNcM=; b=H7LC1u9wTaCUDpgYcJk0NrT/GG UuNj8FjQgMqXxr4BUaYHLVCj6GF/kHaQwhG775fabCkk9O9p3UtSNJ3Lfw1qk6A/qz1yE9HiRMLGR GPPDQNHeO3grHumSYvBehfSol6Aj3qDs1/e/doLlivImv+YqjdOwD221MJ8ehAEr2Dj4NACaZkYOG jWrJvvJloxIQFxNUOONHDQaVXt4WNSQ5YiYLJYKSzHS60Pk1hbaeQapUc0aTB0UjI/8IOSZCcu+72 XYKoAK2vQMbzBNWcz/j8fU/HRxiDBpcns1+jPLwItR/TTxA53/eAabwhRE+8Tp0zeNgm61X/qaowI RhRmwMjg==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.98 #2 (Red Hat Linux)) id 1tfIap-00000000UJ7-2cgf; Tue, 04 Feb 2025 13:03:55 +0000 Received: from desiato.infradead.org ([2001:8b0:10b:1:d65d:64ff:fe57:4e05]) by bombadil.infradead.org with esmtps (Exim 4.98 #2 (Red Hat Linux)) id 1tfIZX-00000000UCp-0Zwr for linux-arm-kernel@bombadil.infradead.org; Tue, 04 Feb 2025 13:02:35 +0000 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=desiato.20200630; h=MIME-Version:In-Reply-To:Content-Type: References:Message-ID:Subject:Cc:To:From:Date:Sender:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description; bh=95l+OCPZExP3PtjfTTFHiYOuFRzyHawgC6ZyZElbNcM=; b=gjcBChEGQeb4XRUD/GQwLBk7o/ 3J5WPx+92ZGxn86NUd4UbstmfWtDDLzq+0EjGsWDTjBpWqZRKWAcKISYdLQqJmzFHocmtF83aTchl J+x/PUPhl5zri/S2TyQk1UuSmVEuxuKeQxL5JXQArXlpqlqOfeXz52nrdL0z2PbC8J3sVAqmEYIpY vS5FMKUtBdyPJUxkGc5L3ZxBh5LyePQnirUKUhCv6Z6p71aO6PzfHwxccD9B/mKpnEs24Mh3y9atH crAXzZStHPcCY0FBJ1/jAgIxtbooD+qEKHVVSK1LAFR90NqcDcaGPs+AUK9xJI48wn9OVAoHZAuzq /atm1Ojw==; Received: from mail-bn1nam02on20621.outbound.protection.outlook.com ([2a01:111:f403:2407::621] helo=NAM02-BN1-obe.outbound.protection.outlook.com) by desiato.infradead.org with esmtps (Exim 4.98 #2 (Red Hat Linux)) id 1tfIZT-0000000GJj2-2GV3 for linux-arm-kernel@lists.infradead.org; Tue, 04 Feb 2025 13:02:33 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=LQf8jWqLRsNeBQnJd8C4kdoS6AH62YFhRPh1cKrrSP2X2EuoZi6ooJfxS/WA/YFKO10Vl+7Q3qjSkhc9JAPkLEkxYfVqKUcq+/C7/rVFXF7ETfV+dgVI3E3bGXIh5xav2b8iwfyZdtxjKcPBfRs8pxumfg2s0gBtZWmAgtVyLMyiMyb/j34S6ipXEYemB62ff/e5ZYwCNo4wyBm59JxutRYMRSDfEM6abOdS/XgNVO4myWJ1SunPvi8A1Ut7rIKHzVl1K+BOUUvDmBMcPf6tFDCuJsLwk73SymBA/Rh+r3CC04m5ZOgT2tzQW66Fy0W7fyZuxaMQFJU8Ga2+yVnGGA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=95l+OCPZExP3PtjfTTFHiYOuFRzyHawgC6ZyZElbNcM=; b=IoglM9OdZqjbsshAXlCRoQOa4H26C8uqlllhhf96FV2p7mVpThpAMw2glw4AZvWPmY1G/Wy9yYoEonm/cl7OJ6lgB8k+9esp44YErHOmX4jXlpBrpwIJ6lwY1aJRNh9yIJRwy3hv2mucGfKtAhFKGcKHhV18rEb6RmmRinFXklN6RmBRpKPfp3+KDmuRN0KIWqXnuBtaUDXb870NPb0T1bjpVTiar6WNXwKRX41p0NlIMvJIndlCXlQSVuNP81JJQmRat7yX4eMAZt7SdBrBcU6KahGhI+A97zoyaTaNcAeCqIeQT/iZpBf4IL7JbIMtL/PZKxSjhFLM6hOUNVhM7w== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nvidia.com; dmarc=pass action=none header.from=nvidia.com; dkim=pass header.d=nvidia.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=95l+OCPZExP3PtjfTTFHiYOuFRzyHawgC6ZyZElbNcM=; b=qYnTFpMCZvPitBXSUyrNb7XWU525SFIQ+vyZcwdCMf+9rlMDU4fFD4zxpU4TMD6sHtCXo1CLJOnNrOg4Amuann+Zy17F2+U3Zsg7nyoT64FQu8XAipwA1xBR3Li7EWtBl26PUo5u49hklgq/XzG7TfWuzby53wu8Yyi3CvgmTZpfD9d1kLVgjg6eCiS81yHE7FSYGvKVpPn+AbcEfAyrQ+guM6XSulPKHEyRYpRjjBEA4yKLNThZbiw6lJ+y9ll+UfdNb64i5IJw8sVrMLcCYreteyPUwKw7KNgcE04pBZ3tRFwTLjlJIXJsRBYYm54pNE/rvH4c8c66HuRz6sV09g== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=nvidia.com; Received: from CH3PR12MB8659.namprd12.prod.outlook.com (2603:10b6:610:17c::13) by SA1PR12MB7368.namprd12.prod.outlook.com (2603:10b6:806:2b7::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8398.24; Tue, 4 Feb 2025 13:02:23 +0000 Received: from CH3PR12MB8659.namprd12.prod.outlook.com ([fe80::6eb6:7d37:7b4b:1732]) by CH3PR12MB8659.namprd12.prod.outlook.com ([fe80::6eb6:7d37:7b4b:1732%6]) with mapi id 15.20.8398.025; Tue, 4 Feb 2025 13:02:23 +0000 Date: Tue, 4 Feb 2025 09:02:22 -0400 From: Jason Gunthorpe To: Eric Auger Cc: Shameerali Kolothum Thodi , Nicolin Chen , "will@kernel.org" , "robin.murphy@arm.com" , "kevin.tian@intel.com" , "tglx@linutronix.de" , "maz@kernel.org" , "alex.williamson@redhat.com" , "joro@8bytes.org" , "shuah@kernel.org" , "reinette.chatre@intel.com" , "yebin (H)" , "apatel@ventanamicro.com" , "shivamurthy.shastri@linutronix.de" , "bhelgaas@google.com" , "anna-maria@linutronix.de" , "yury.norov@gmail.com" , "nipun.gupta@amd.com" , "iommu@lists.linux.dev" , "linux-kernel@vger.kernel.org" , "linux-arm-kernel@lists.infradead.org" , "kvm@vger.kernel.org" , "linux-kselftest@vger.kernel.org" , "patches@lists.linux.dev" , "jean-philippe@linaro.org" , "mdf@kernel.org" , "mshavit@google.com" , "smostafa@google.com" , "ddutile@redhat.com" Subject: Re: [PATCH RFCv2 00/13] iommu: Add MSI mapping support with nested SMMU Message-ID: <20250204130222.GY5556@nvidia.com> References: <4946ea266bdc4b1e8796dee1b228bd8f@huawei.com> <20250123132432.GJ5556@nvidia.com> <20250129150454.GH5556@nvidia.com> <8e4c21b5-3b79-4f0b-b920-59b825c2fb81@redhat.com> <20250129201307.GJ5556@nvidia.com> Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-ClientProxiedBy: BN9P221CA0001.NAMP221.PROD.OUTLOOK.COM (2603:10b6:408:10a::16) To CH3PR12MB8659.namprd12.prod.outlook.com (2603:10b6:610:17c::13) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: CH3PR12MB8659:EE_|SA1PR12MB7368:EE_ X-MS-Office365-Filtering-Correlation-Id: dcb40778-1169-4d57-a039-08dd451c2aa8 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|376014|7416014|366016|1800799024; X-Microsoft-Antispam-Message-Info: =?us-ascii?Q?U8mYGxsbjs3zEE40FLdCDqS6yOrplzTxH5fuzly21Mp/i06+rpgsRrGeKUX2?= =?us-ascii?Q?EKiVZ3FPNdOdzrgjhLGiBRQ8B5dyW2i2jq9+38BbsNpC48NjOBummANlKWog?= =?us-ascii?Q?Jst1KUP4ivG6eStaTRzIzE2TbfWpDzeOMVTUQi01yGkIKVp94ynMAqQE5j+q?= =?us-ascii?Q?KA43Hh6obHsFLUcunKwzBSS85vJOqzNKVTC5IjXVCl9sDrB+aH7PCx/Ju+pU?= =?us-ascii?Q?7oA76lXvwpoKXEZ51QPCG6lTZEtblDmFNHR5pZ6LAWgawpy8+rX+/5cJ2fxW?= =?us-ascii?Q?o7AdDAsxk6I7INowtflpkXpKKtbpXs5ocREFB+45jaJtIxW1HxS2o8t5TNj2?= =?us-ascii?Q?3VxjU8YgDC4Sg7bNgXMkmv0HMSLqNiEk5v2VlOFR4lUCN+h99m1Rxk0xaoip?= =?us-ascii?Q?ttM3u3oyzcloRFeDpHBttJvyszkMNz4Ls1Xh1+OCGAMQhbw9C9/2zUJylQpw?= =?us-ascii?Q?qB/02/6G9XVFdtqqIcrmGURn4yxYQEStKABabSnnOonvqBY4mjGCG8s1CZ15?= =?us-ascii?Q?ZxFTLyRUY8XvxLjGf9q40DOT5YzS0t3vhXsOU1KYu4Wu9NggIF4+sEZ69Ypi?= =?us-ascii?Q?iAegte82trsqYXSOo/udA9PXTd+EegikiF2Z5NAY732F+jn5iy6HwSQtYkjJ?= =?us-ascii?Q?JDzDNfn93Ewa/amXluCRYhKyP6GlFbN58xZdvPGoDb3NrnoPRB+/Qv9cuv3/?= =?us-ascii?Q?KBwFSDzODi1JCEb+yX78wqlJR26+rjvaxqD5QBxYLUPCtGJn7m3XcqQo+Qie?= =?us-ascii?Q?WvwwwjFrGyelFr21mHxq0ir+Bj4valLDuNupSUtDy7MjWOM2Kfib2tFkEIuq?= =?us-ascii?Q?thsL/LLUqaimbMF1aucl0SzhUryRMq1UXS7XQEgL/yBhIgSWjFG0O4POACQ3?= =?us-ascii?Q?nWgq4qrSeQ4U8jqUFcmIIygQFv5tZGjFzINxPPfOTF+pc7lvci/VuxxBxeH0?= =?us-ascii?Q?//mIaMjUuc3cHA/jFa5OqgIWOFHz8+z96j6WlAsgGqJclOofkxUdy4JVVqQ0?= =?us-ascii?Q?Fyo5vMa+t+UYFj07gMaHERA9/m5STSScQBE/Kw7giWI0yWVip9taUwXKkVwP?= =?us-ascii?Q?EP0/ZY6lE9rGIDdh+f1PhyjTmVmKVlxaklCa4RvH0aRT5FBFG44i6NWpMPVm?= =?us-ascii?Q?urOdNAoNLMidRioC0l4APcjvjl6p/tpb8a6OzIxFCAi9+vueQUh5P+/SVLmR?= =?us-ascii?Q?nqYtwUOoBtH7X4fxc2wN973XM1Iay305X92h8CNZRM2gc/gR4FG3lexxa7Mt?= =?us-ascii?Q?Vu6vUluPjobpkcv7IN+YTDqUecIBYuQuLFodxbLjSadLHpYePJSA5NXFHHpg?= =?us-ascii?Q?JPcaeDxqxtTwK/T4KX4TL3TsAW53ieQw9kvmZ5vB9jY0ESJ4PetQrAPmbg7U?= =?us-ascii?Q?SfLOug7r+gWIP6ULaC446XS6ogzn?= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:CH3PR12MB8659.namprd12.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(376014)(7416014)(366016)(1800799024);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?dYxX5FHTvQrQwGiupWBWC2KD/2FWuvERn/1ybXlwvg8OQ1SRJHnKiWUU1v7o?= =?us-ascii?Q?4yOCGg2vDSfeJZQIa11FIMB1YeafsvWPhiHNEqE9pNHF+CpLhJB8Qq2MHz2j?= =?us-ascii?Q?m0wRe0sA5EXxrTC+MxqQPzevbCov9Opa1gQS5RlhsHM6GyruAWo6dGq7iPOI?= =?us-ascii?Q?el76Hr7LsrRW77RyTDm3OuLevfs5ZcdSse7z6x+aSv7kwB7n9sUQvjjCdicS?= =?us-ascii?Q?rQA5MyzQ0rAGJutJGijj3kySIzdR9j/tTtyEAGts1Zb+YWGxPvgHgLPaYfvu?= =?us-ascii?Q?3tWV7RusiGwd3ozHfBKeM6vGqi56WF4rjNlJCKQnLt/plyo1XopugDiHWfOf?= =?us-ascii?Q?mgFWFaGIzLTy41I7sQdiGKw+jsd6AY3Qji4cMxJc08U7NH0cOLxrm7vezkr9?= =?us-ascii?Q?CmoRwoQ+GxmKtvwokqqTFQZ+Hf0NyHU99xFKcgP0wfu1TUTQ2cQn6qPkXqNM?= =?us-ascii?Q?Ml46RzJNIoGwRg68s5uKj/+PmjaH66F9oGxkZbsZ6hBCO7+eJIi1HWo39M6R?= =?us-ascii?Q?7EODMDfpqg+xBykQEs99m31ndyW+PryUOtSJHmbxu8AX2SPkWEg+92wzEndp?= =?us-ascii?Q?H7HXCxAb2Fzs87PAW8PFuFA8fu/Gi9UTePChIZ1zlw6u3VxurVWKXXAqTfFy?= =?us-ascii?Q?5qgRFmzWp58gZhd1Me9wZYiNLhGMNhoWEhEfqjBThCXEMYGArdWbQaSKlovC?= =?us-ascii?Q?2yvLXi5b2PyD3XNqSOSWa55WPxHKUkre/IBmlZIYgbNd6PuBtzFH9nO3NaXE?= =?us-ascii?Q?muXYXHCFgVoAu5MhaFcNUyrG6FzRl6o3G73hfg8lMpOE0WE5n9OSs6mrTno/?= =?us-ascii?Q?0vCFX0tH+xhvhBTGmJ/3kfy88JLrYG5xWSmGihEvv7v4gNmaHKUD5mPL+6RX?= =?us-ascii?Q?08500wYlz906lS6YWq7YOat6ryRn6a8vSft+g0bdqYW9I6UE4uAEEgS/WzZw?= =?us-ascii?Q?09Spsm3iLyFoPeMlAuHYUg771tuFf16m3cpBk/0TPbj0nO5d6DEI+m37iW8M?= =?us-ascii?Q?wB/NcLEtrWWURkqnPoOQp3wPKIS43yUrARrTOlggYTKK8zdT+fRdVjiXAsjH?= =?us-ascii?Q?DdHigb7+51p1+Az+yLRMEDlEhSAmvK9l0JXVL6y80ASN+6qxxcQ/FLO0+EYk?= =?us-ascii?Q?KchpnZSUpCQ6m91oWBOCCoHogoEnUMxxy0jovZZLMEDdS9fU4HZ+4wyje1GB?= =?us-ascii?Q?u0Wm/DnrS/xta6HQTrnCkwn08jeqGxcQyIKJQwrTCNjR30JQOBLq8vyT8hcT?= =?us-ascii?Q?IPaLwVTYMPHONfltRyaUz1tF4xlV+RBIwzYY/gR9dEzjC0FeKLdM1qSHc6hs?= =?us-ascii?Q?tea7r2M5oRPRFbkC2/Mj2HWEzl+T8v/n5zmsFhTmRwg9B8/s5VteQAn0EoZP?= =?us-ascii?Q?1TdeTiCJTBe9+O+2FTvCr5i2Uuw+LViNo8+5qg2SRo4fqf9tsZKudSR1t0lZ?= =?us-ascii?Q?Y77IBPn91HoueZolTR1I31BIVVoOD/GprOJ/20NBO4FcaF6d+RJJD3pCotzl?= =?us-ascii?Q?/KRHXCxC4Z7sJ5+2FZWY+rL/J1cqvd2bJphNk7nBv70N9UJR4KUoLUlGq6/D?= =?us-ascii?Q?dQt35arkPGBku/bqTFTqUpMugDMcl5nehQGxx0p3?= X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-Network-Message-Id: dcb40778-1169-4d57-a039-08dd451c2aa8 X-MS-Exchange-CrossTenant-AuthSource: CH3PR12MB8659.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 04 Feb 2025 13:02:23.5420 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: miNxtunb8l03bzEo+ALeX+gDXqQVIf6Hh/7UVlCnIPpmqhdpdDJhVmYuf4M4DRie X-MS-Exchange-Transport-CrossTenantHeadersStamped: SA1PR12MB7368 X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20250204_130231_747452_19FDE9EC X-CRM114-Status: UNSURE ( 8.49 ) X-CRM114-Notice: Please train this message. X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org On Tue, Feb 04, 2025 at 01:55:01PM +0100, Eric Auger wrote: > OK so you need to set host sw_msi_start to the guest doorbell GPA which > is currently set, in qemu, at > GITS_TRANSLATER 0x08080000 + 0x10000 Yes (but don't do this except for testing) The challenge that remains is how to build an API to get each ITS page mapped into the S2 at the right position - ideally statically before the VM is booted. Jason