From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 50BFAC7618A for ; Mon, 20 Mar 2023 13:00:37 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender: Content-Transfer-Encoding:Content-Type:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:MIME-Version:In-Reply-To:References: Message-ID:Subject:Cc:To:From:Date:Reply-To:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: List-Owner; bh=9P9LkF43Zx2kRHXz01wx3SDyugOH3yYfLGQJQfULQ5s=; b=ceOmTPRsQqQCdt eJVbF5sOcHCwc/e2gB1H+4++y18yu39bnP+gUmAhO8lbx1xjkXns/4IuffakjL2jIiH40frJ+6Czi nMPFjxcqwLCBOUochc1EC57F6sFZrCj7/nFd0vFvibohFWO/HSs8EdNGEoZNamqQCiUOLHVKTSsLD 3qNOYYK9qNmqE1O5jR5DyOsk3M2IMwMNQC8rgUTGswY13FLkGDWKtjY0z3eU0HaN7hZ4MgCTmZaMt ZUsQ+ek6YYDRhDDVHq6eSUBmWTbVAIO5+NIUR1SRBgjTGA9BAGN4p+eknDjNZBwGefFeHOI8s4KTA YOZc3RClWWV2as/a+b6w==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.96 #2 (Red Hat Linux)) id 1peF6q-00920q-33; Mon, 20 Mar 2023 12:59:32 +0000 Received: from mail-dm6nam11on20627.outbound.protection.outlook.com ([2a01:111:f400:7eaa::627] helo=NAM11-DM6-obe.outbound.protection.outlook.com) by bombadil.infradead.org with esmtps (Exim 4.96 #2 (Red Hat Linux)) id 1peF6o-0091zw-1v for linux-arm-kernel@lists.infradead.org; Mon, 20 Mar 2023 12:59:31 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=dslWETo+G8jpuj0V9Wly3RB5/P9CKIVF6gQcLv0GRyKj/YaX08mSnvgQO3t3VeCWdQ14EK5E+6FBG+ogfq5JytuqFeoxY9sI/6sl2rHFHHi00hhYZU6rVNeWIoXYnc35AU+B3xpTr+EXyzCDYOBygf52ouhPyl/+alGIeoQu83xarQ9Y+5iGCrIRC50YnIqiKdRLsYfs9tsPe8P1YGoHpoV9ct+vtxpeRlUkvGrYZ6RLwVLxMyYFpafTMV7HvpQRudSlBk6cf/60AG3Lc5lq3JMlOK2NoR9KeQoIkqFJCe6gtB0eObKESBcYMsc9jzcoS9seKkIB3JENb5BhMbOn6w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=d1yNvMDkZOBJxg3VDY5pRd7hUMGd4d3paDwDUtWlW3o=; b=EBkPTG55cxOOFAIDDy6sDPO2rMRK/rY7QWN3zZlHlMNAy7BWCkDva+BYhGvZtJaYLOV3KnilbxqCO8jbovwgPrS2pVseinPlRpw/X8cOTE8Y5QeD9m2iuOtIvHdpRVE1+Ixwd0Ep3sN59x32JbzIsFNPOmsnQfC22YmL4CGn/9FvR5gSjcLUPdkQuJku4bhTDH1L4XjmmQCVFC4XDV4Ic4k/HjQHyU+/Q8nqIdmtjSqqgOjL4O5aix4GsPxR/jrl/y8/WbjWlNlgk5JOPvUCTnEfqW30Jua2LQuK1H/E30Wz6qR+ob3C6L9GVcWkFhfXAtvBnK29oFkXh2fjzVq3sg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nvidia.com; dmarc=pass action=none header.from=nvidia.com; dkim=pass header.d=nvidia.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=d1yNvMDkZOBJxg3VDY5pRd7hUMGd4d3paDwDUtWlW3o=; b=GCoe5ytojtZFfj0HQ/j1wXaIUdyGmKcI23AYbmioiKHvGvbUj7MNwnUyHquQTk9i1LyXNNOFJATyccq/evHLQyiJ8HajIOOZHv28NxGrmz/Bq/0U4hKLTV7oSVLMSHh4NYVYgJyDfU4dPSeCgwQqy8CCQhWu5M2ryIDOP7d0zH6+maMPRRYWGRujk3++uBRFhCQeifjM7hVDc/R6SRCCY7EryZSKFLwquD62iQkOIg9xlyRXQWPKCud+RJubpaQo1ovEhh5egrolyH2GEv6zTyxPXThM1nbXVD/XA1XfHMUTr8mofO7edtEO6hpQtVLf+H9DoQegSyxqhjTbJ/d3lA== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=nvidia.com; Received: from LV2PR12MB5869.namprd12.prod.outlook.com (2603:10b6:408:176::16) by MW4PR12MB7030.namprd12.prod.outlook.com (2603:10b6:303:20a::8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6178.37; Mon, 20 Mar 2023 12:59:25 +0000 Received: from LV2PR12MB5869.namprd12.prod.outlook.com ([fe80::ef6d:fdf6:352f:efd1]) by LV2PR12MB5869.namprd12.prod.outlook.com ([fe80::ef6d:fdf6:352f:efd1%3]) with mapi id 15.20.6178.037; Mon, 20 Mar 2023 12:59:25 +0000 Date: Mon, 20 Mar 2023 09:59:23 -0300 From: Jason Gunthorpe To: "Tian, Kevin" Cc: Nicolin Chen , Robin Murphy , "will@kernel.org" , "eric.auger@redhat.com" , "baolu.lu@linux.intel.com" , "joro@8bytes.org" , "shameerali.kolothum.thodi@huawei.com" , "jean-philippe@linaro.org" , "linux-arm-kernel@lists.infradead.org" , "iommu@lists.linux.dev" , "linux-kernel@vger.kernel.org" Subject: Re: [PATCH v1 14/14] iommu/arm-smmu-v3: Add arm_smmu_cache_invalidate_user Message-ID: References: <1467e666-1b6c-c285-3f79-f8e8b088718b@arm.com> Content-Disposition: inline In-Reply-To: X-ClientProxiedBy: BL1PR13CA0450.namprd13.prod.outlook.com (2603:10b6:208:2c3::35) To LV2PR12MB5869.namprd12.prod.outlook.com (2603:10b6:408:176::16) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: LV2PR12MB5869:EE_|MW4PR12MB7030:EE_ X-MS-Office365-Filtering-Correlation-Id: 7c4865ef-32b5-4e9d-d267-08db2942ee68 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: LPFODBEKUNFleB5RiRLlDEB11Bt72KZXopSoGY/CYkrXoGgBM43iqqeIyZQvmM/nWW2mHQdKD62ToEpG9pNFNJ6CZioRUSvHLWg+CEY6OEa0njdwwaCBcKjhR+HCm748y/APsenBepYzj0xOS6MWqzuE9FQ2mkzSv/Ll3Tl2N2ZCnxFKhIdBJuIfa7PTkWTPS63ciCe8ShBydfDZavcYzOz3D763DksMQ2QwjVif3QDvrvieS7nZ+PwAA3KrCBhrln8lp5nmysm+5IKdzH4Vijh3oSFH4aYO8v4AmaM+9s1QaqSJYSA15eJcZXzppUiimqEEqr5ZUO+J6aBpRUqv9MTV/c1gMioxqqYNprKf+1Zr5v/fZ0JGTB6XscIuMjlshQG483Y+FNI/w8ZrVkFpGgMJzVGlW5oJJV2hERA4ORxO/YMidMyvcEGJi/o+tk82yTB4vLVFp+bTs8WgTbyvzRy56Yfq8MmO/oGtBr4lsGlHqDCE2/O2dKqELdl3bqhwlz5K/v0XOxYhcfOmZYwxWpg79zPFIUQnW2Tz7u0hSTAdReq3oQjEwkNuveb/JRFlKvh8z6voTssgzBXY7LK0QfiKizfziOBqcJDuW6XhKRXnuvzyuYjs+b+RCdER+yzq+h8UGunJx5iLrEjpXNZyXg== X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:LV2PR12MB5869.namprd12.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230025)(4636009)(346002)(136003)(376002)(39860400002)(396003)(366004)(451199018)(86362001)(38100700002)(36756003)(2906002)(5660300002)(41300700001)(8676002)(4326008)(7416002)(6916009)(8936002)(66476007)(2616005)(66556008)(6512007)(6506007)(186003)(26005)(316002)(66946007)(6486002)(478600001)(54906003)(66899018);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?PFSYoYnShXE14aJgNdWzocLqxQc8dv90uUJ8YlRfmPwAtIVwQsYmAZitvzBt?= =?us-ascii?Q?bGg5e/T856m3vzXaKKMuR0sYu4g3cHV9k60oOMOJn1vkLO24JC92/pakt85Y?= =?us-ascii?Q?TpcZleI9UD3eOGNg/95CBXrxSE5wzM31LxiVYIyOchTXX41eZiRmSrAyGUSu?= =?us-ascii?Q?go9so2UOlQXoCF9mV6Ql0QOeVYfUuWjqUNTIzzO3K9OAQ2cZYFHKvxAWpFRn?= =?us-ascii?Q?YGpIJDgrE1+avyW48KaNabKlcRWID9Or1yeKIc3YiK47G86b+thdFZvEtoyH?= =?us-ascii?Q?jsIVwyFP2cwIgqWFqZc3dtd8RAH55BETccIw4mWlpU+a8uASvFC5Kneo29v9?= =?us-ascii?Q?d4LFmMDWqH2mbcB0/UJmaxwu/OQomLj0477owXCs5cjlb0pKx1/wMk5+bfhM?= =?us-ascii?Q?9a4iaZn4mHN7CClCx7EBfzYZhd1+BOgS6lF5IA4ebJtsGdC/tNgAROz9wTnY?= =?us-ascii?Q?Y1SC5+Qk9OzdfVk2KE44bG3ItykSNNwf+D98qx9N4kaVDJY9ck3F48LKz0sR?= =?us-ascii?Q?wAdbLmluq0rqsDZo1Z/Hcmt1xdnO5WQQuCdx7MzIV/LUpkuvS6W0w1ER0nhX?= =?us-ascii?Q?U9jzLd4msju7UjsZj2BfP0TLrukcYIs+Wg6bjyZEY68DWWjO95pujQYouqwL?= =?us-ascii?Q?tqKgA9PxnI/aJ9RnnMvkBTHJFPsN0bQIWVcUABMvRfSVMWruvR1oUzt5m0XP?= =?us-ascii?Q?NJfmkHv0eBCydJlGbxbKIdIp2boFmI6mSl6LwHCtSe+fxUnQRqBw9timCvg2?= =?us-ascii?Q?macAJcjTMTkr28IVv6FZ+haBC9O4pQKzw/B/+82mqVE+O1ThT4jh1esjb2yX?= =?us-ascii?Q?EPJcRKNoSP0NfC7G9BpOLVfxyT6bWNn3IP2vPs7dGeTdNcOV6ccnXTp1OSM1?= =?us-ascii?Q?m2xkax0lt6LPKUWMqFpKChX3U2j9pNgtNyPw7dQq/9b8izgcD4uj25bSgbhn?= =?us-ascii?Q?fbkOPT2DVQlVrAqQA/zaSvuCqjlwEEYYVO4WkmNMT7XDov1LV7AoShdZbB5b?= =?us-ascii?Q?JCAheah/QVlRAu74B7/7Qa5dk3jeT5dqI1rb2Vz5B00vseh/od9EvBAy55tb?= =?us-ascii?Q?PgPqZ6GdYx/F/xUdgQAR+hIAVAW1A9J+eHy0noGo6vauyaVYy4NnHoKJiSws?= =?us-ascii?Q?HTBRKcVBYrUBOJuNi0+BAjZ5c9trWIYFAKU4TiZTWxxRgUWFI9zgfnxmREO9?= =?us-ascii?Q?6v8ToedrFoVUdSBG4rEuKU9z8LMPrUUylIHXJx60c8XNuB7p3eCrDk2fX3hf?= =?us-ascii?Q?c/PAK2wO3qwX/J1J1oybCgDF/JwUQhNfb++bq34STV/mp9Ed+Jixykfi9l9t?= =?us-ascii?Q?YymoL1svKupydaPRcYO5Je85e+ntz8gcGkG5nDIMU1ltKMnsR0XOp5mLfuw+?= =?us-ascii?Q?zkjV+00a9z2UUuDVg8pEvvoV7zvkfwT+1aJkVxg1s54N/KKDzJp8kBzvvHch?= =?us-ascii?Q?Yx37qtQnHUmuIZgsWp0CwFWHaUFZLLznKAXnRWHJjzN28t2S4kSUORPOXfbv?= =?us-ascii?Q?UgSSNacEs3RtmRUs4NFvyEuI7KUD4SnJ2uC27cE4CeDQDQpv9sc6wN2uvEU3?= =?us-ascii?Q?QzYKxRyvpSYHIgrtvs8IHVtsDlMFphTZD0s6Ema5?= X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-Network-Message-Id: 7c4865ef-32b5-4e9d-d267-08db2942ee68 X-MS-Exchange-CrossTenant-AuthSource: LV2PR12MB5869.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 20 Mar 2023 12:59:24.9046 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: pZ+kpNqRqytg2W5MGHmzCwjbrrjP9ElNknmS/rvV+uPzIdAib/00cjoyNobusqAw X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW4PR12MB7030 X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20230320_055930_639973_8D65B715 X-CRM114-Status: GOOD ( 14.64 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org On Fri, Mar 17, 2023 at 09:41:34AM +0000, Tian, Kevin wrote: > > From: Jason Gunthorpe > > Sent: Saturday, March 11, 2023 12:20 AM > > > > What I'm broadly thinking is if we have to make the infrastructure for > > VCMDQ HW accelerated invalidation then it is not a big step to also > > have the kernel SW path use the same infrastructure just with a CPU > > wake up instead of a MMIO poke. > > > > Ie we have a SW version of VCMDQ to speed up SMMUv3 cases without HW > > support. > > > > I thought about this in VT-d context. Looks there are some difficulties. > > The most prominent one is that head/tail of the VT-d invalidation queue > are in MMIO registers. Handling it in kernel iommu driver suggests > reading virtual tail register and updating virtual head register. Kind of > moving some vIOMMU awareness into the kernel which, iirc, is not > a welcomed model. qemu would trap the MMIO and generate an IOCTL with the written head pointer. It isn't as efficient as having the kernel do the trap, but does give batching. Jason _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel