From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id E2EA8C83F1A for ; Thu, 10 Jul 2025 05:32:33 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 86A5A6B00A8; Thu, 10 Jul 2025 01:32:33 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 81B7A6B00A9; Thu, 10 Jul 2025 01:32:33 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 6BCBF6B00AA; Thu, 10 Jul 2025 01:32:33 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0017.hostedemail.com [216.40.44.17]) by kanga.kvack.org (Postfix) with ESMTP id 533816B00A8 for ; Thu, 10 Jul 2025 01:32:33 -0400 (EDT) Received: from smtpin19.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay06.hostedemail.com (Postfix) with ESMTP id F0B6010BB8C for ; Thu, 10 Jul 2025 05:32:32 +0000 (UTC) X-FDA: 83647234944.19.6313D9D Received: from mgamail.intel.com (mgamail.intel.com [192.198.163.9]) by imf28.hostedemail.com (Postfix) with ESMTP id 6AE6AC000E for ; Thu, 10 Jul 2025 05:32:29 +0000 (UTC) Authentication-Results: imf28.hostedemail.com; dkim=pass header.d=intel.com header.s=Intel header.b=CCgSH4eT; arc=reject ("signature check failed: fail, {[1] = sig:microsoft.com:reject}"); spf=pass (imf28.hostedemail.com: domain of dan.j.williams@intel.com designates 192.198.163.9 as permitted sender) smtp.mailfrom=dan.j.williams@intel.com; dmarc=pass (policy=none) header.from=intel.com ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1752125549; a=rsa-sha256; cv=fail; b=vcQNF9ofIYOV67suB73Oac+O/8cjtMJrqAyuqWeEbxunV2mvs9Xw0jVJ1ms8DK119wpZ2t b+J1gdt47K0l63ZR2h2kMkavf1EMOxf/q509JK8a3cMP5howTiKhwWeTYthoA5+JzkCaID V57G2jnS+qnahjkHFILsNZc0ZiCoavA= ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1752125549; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=OM3EgCEMlRRyLOg13aIFxvh+SMErmeY9oKHfZA6g2R0=; b=LnY9PKm4dEeauXXRZgRF3HkXJQ6w7QlxiWxgH6M1f0XmkQW6eipUFxAp00Ve+Nyy7QDS8v M4Yi0fG04WCud4LHXWEWyTPqHRoOK5DsVeiysPxEBHkXwtAEbsRjlPRTSn7WTCaSzwD8aA bZt94gZFPfSQvs/Mh9Yy0hBbFUX1Tis= ARC-Authentication-Results: i=2; imf28.hostedemail.com; dkim=pass header.d=intel.com header.s=Intel header.b=CCgSH4eT; arc=reject ("signature check failed: fail, {[1] = sig:microsoft.com:reject}"); spf=pass (imf28.hostedemail.com: domain of dan.j.williams@intel.com designates 192.198.163.9 as permitted sender) smtp.mailfrom=dan.j.williams@intel.com; dmarc=pass (policy=none) header.from=intel.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1752125549; x=1783661549; h=from:date:to:cc:message-id:in-reply-to:references: subject:content-transfer-encoding:mime-version; bh=0eUi0bOTC2q3mJPx8TlXp7rFeynFkWYC6eXw3LRt38o=; b=CCgSH4eTL/8+wXffMOXxFAnsBg9oS3vW3XRmHzvSIBUGAyqnIfLZZhYV tb665Bk0kLpBoV6hR3ce2wuoCwLWe26JJ02HOXJKoS11pmoxUoWSLT9NB h/sxeF9+l5Vh+tb0Vpmht8Ex+BbiU2Ddkgr5pAk+ANOLmAJtGWFRMtBKN sVSg+qfZ5xJssNcSubqfXWXrnYiwQVJGstTIeec5e+WnNolbb8+Wd6BUr k7B5QSPr8LYpYLej2UbWUzQxJrb9b44eNuf7DtkE0Xr5HHc3+4dcUshD1 K7pBMC1JOgOnjjh/lC6i1glyAHQYi3HwVhIkvdLqrfVnJltB46We2aTwp A==; X-CSE-ConnectionGUID: WV2lcvecSkqYE6/DXz6JrQ== X-CSE-MsgGUID: kNzKcEXmTQGQqf2owlAO0A== X-IronPort-AV: E=McAfee;i="6800,10657,11489"; a="65096082" X-IronPort-AV: E=Sophos;i="6.16,299,1744095600"; d="scan'208";a="65096082" Received: from fmviesa001.fm.intel.com ([10.60.135.141]) by fmvoesa103.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 09 Jul 2025 22:32:25 -0700 X-CSE-ConnectionGUID: tdAPRH0WS1i9HqjYMHnEJA== X-CSE-MsgGUID: zD3izum6SjmYQmN/sG/JIg== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="6.16,299,1744095600"; d="scan'208";a="186955580" Received: from orsmsx901.amr.corp.intel.com ([10.22.229.23]) by fmviesa001.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 09 Jul 2025 22:32:24 -0700 Received: from ORSMSX902.amr.corp.intel.com (10.22.229.24) by ORSMSX901.amr.corp.intel.com (10.22.229.23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1544.25; Wed, 9 Jul 2025 22:32:21 -0700 Received: from ORSEDG902.ED.cps.intel.com (10.7.248.12) by ORSMSX902.amr.corp.intel.com (10.22.229.24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1544.25 via Frontend Transport; Wed, 9 Jul 2025 22:32:21 -0700 Received: from NAM02-DM3-obe.outbound.protection.outlook.com (40.107.95.64) by edgegateway.intel.com (134.134.137.112) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1544.25; Wed, 9 Jul 2025 22:32:21 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=mGNKglBngBcnp1XCJM4edLwNr2n9qOL0VONgfkfLqVb+fT6KhvC4HuppFgFtAQCzIeGN1OO7J/DhndvvToI7BuVovnUJ2eCNaRk4VgyMml+7DV/eT0fKLvyVH5X3B1xBMkluoHty2ngzzGbDSNcPNLPPg7T3fb3QbD5isxW353N/imx2mcUrNwomL1/43OghL4bBIayDT0qLZ5S1oiRrSe2u8StBcIBlCjaO6eSWGlHPJWRZ133L+UAo6pi8+2j/LlpjhbwGM90YreEAMGPexmFMBiP7FjH/NqMdo0AoCV5c5yHJpvkN7XpPmTWbfkg2wnagU4eL9PjYGiqsxLQ4dA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=OM3EgCEMlRRyLOg13aIFxvh+SMErmeY9oKHfZA6g2R0=; b=ObCYTHsArpNEvlBh/lqhId4akmNvy+yfWldyIqc8vLoMRYsvJJa6ju8F7kmzK1QN0YNLTMKc8wlE2EtvUhGBCgILaUGGjzoXgRNWo612u1QTk6xengSWGiu3Q1oN7g0AqiF/kQmU3wwqoOzXT50kizcVxHqaONuZ3UlXQ5GrbKNp3GwhsethGQiz0S6IC3rP2KN5nVaqzux6VkbMoB/ILJdctN8P2uZVUJVZOkf3+nWSuBv+OuxWbm9cGo/6/o+KCORIpn4SMd/ZmE4wvikSXSuTOtpIKVssN09Bx5D2ROGOi1bv0Yi0cpiLf+AZVqfNx3WF2MPSxu1gOP75GG6U5A== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none Received: from PH8PR11MB8107.namprd11.prod.outlook.com (2603:10b6:510:256::6) by SA1PR11MB6870.namprd11.prod.outlook.com (2603:10b6:806:2b4::16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8880.22; Thu, 10 Jul 2025 05:32:18 +0000 Received: from PH8PR11MB8107.namprd11.prod.outlook.com ([fe80::6b05:74cf:a304:ecd8]) by PH8PR11MB8107.namprd11.prod.outlook.com ([fe80::6b05:74cf:a304:ecd8%6]) with mapi id 15.20.8901.024; Thu, 10 Jul 2025 05:32:18 +0000 From: Date: Wed, 9 Jul 2025 22:32:16 -0700 To: Jonathan Cameron , Peter Zijlstra , CC: "H. Peter Anvin" , Catalin Marinas , , , , , , , , Will Deacon , Dan Williams , Davidlohr Bueso , Yicong Yang , Yushan Wang , Lorenzo Pieralisi , "Mark Rutland" , Dave Hansen , Thomas Gleixner , Ingo Molnar , Borislav Petkov , , Andy Lutomirski Message-ID: <686f506020726_1d3d10069@dwillia2-xfh.jf.intel.com.notmuch> In-Reply-To: <20250626105530.000010be@huawei.com> References: <20250624154805.66985-1-Jonathan.Cameron@huawei.com> <20250625085204.GC1613200@noisy.programming.kicks-ass.net> <20250625093152.GZ1613376@noisy.programming.kicks-ass.net> <20250625180343.000020de@huawei.com> <20250626105530.000010be@huawei.com> Subject: Re: [PATCH v2 0/8] Cache coherency management subsystem Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit X-ClientProxiedBy: BYAPR08CA0025.namprd08.prod.outlook.com (2603:10b6:a03:100::38) To PH8PR11MB8107.namprd11.prod.outlook.com (2603:10b6:510:256::6) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: PH8PR11MB8107:EE_|SA1PR11MB6870:EE_ X-MS-Office365-Filtering-Correlation-Id: e9f30fcd-fd75-4d15-0b89-08ddbf7322af X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|366016|1800799024|376014|7416014|7053199007; X-Microsoft-Antispam-Message-Info: =?utf-8?B?a2s0RnpBWFJUa0FLUU9DdzFJUklJOUlaUk1qQ1drQnNaeDFFVFZBclpoNEg2?= =?utf-8?B?UzJmL0RGNyszMCtHa21tREJCMGkxcGZQZE9UZ3BLT2JlRnl0VlRCdFRsZ3pR?= =?utf-8?B?OWVCOXBQMjBkR2d6eEV4WWorc0pWYmNGVm9ucW5kcVc2S0U1bk5iV1ZBenV4?= =?utf-8?B?MjVxTUlGZk9ERkFMb3BHOXYwZk1NakcyRUxHWldYTjBvUjRQVFR6WFpaUEpa?= =?utf-8?B?YUFuT3JtbDNHbUJsZVVIVk9ablErSTNQWW5welRCdkZCZU5adjkwbThqOUc5?= =?utf-8?B?amorSzlpTlovd2NjWjZ3TjFmNExXTmhjdGRaZEtPNWJJcnBTRVNrZVpMZDUw?= =?utf-8?B?bTZ3ZUlXaDlLSnZ2OTczeG5rakNFa2RUbTcreTUvYXF6aUZGdytLVVJtVVJ5?= =?utf-8?B?ZldoN0Q1and6bkpheTZpYjhDUS9SN1g1TlVPRitMclpVOVlGYVR5WElYSlpF?= =?utf-8?B?MXYvamdoejNIbFNkNTFCSm5oSW9VYzQ0bDdKUE9VbGsvRmhHR2dsNEVvWS9Y?= =?utf-8?B?SFpuUlhLVTZMR293bXNzMDg2OWQ2MlRMY01qTHQyK1hrd3k3dm0zc3FTR0RP?= =?utf-8?B?WXR5cVg5RkQ0QTJXbmdsVzc0M1BkWkF3QmVrZ3NZeG9BL2ZvWnVDNHBDYmtU?= =?utf-8?B?b2Y2R2VqUVNrbVlRVnVWdVVBMkRQOHBUaTVEdE1YbFJEQU5qTTBzajB5clNp?= =?utf-8?B?RG03NTl0SmM3OGVicDFXVThGSW4zZ2ZxT1lQSExxbUF6N1g1T21aZlhJVHQx?= =?utf-8?B?Z2tObHdoRnRZUXpvamttMGVRTVBlcGRyY1J3Wm9iRDljcEs1MDJhWkJWaElo?= =?utf-8?B?QzNSYXY0ejJXNHVSQjZXYjNLQ09lYVRTNFNxekMydEJIdlprR0FKd2drdWtt?= =?utf-8?B?M21sQXR4dlh3RFo3R2hFdGdTRHhRRVRodUpneDRZYzRibWduM3RMN2JQTW5y?= =?utf-8?B?cXFod3doZ3EyZjVQTTdzUVU2R3lFbHEyZUJqWFBxWE5XbjlkRlhWSjUzZlNk?= =?utf-8?B?Zi9Mc1JObFB3OWcraHVXWnUwcUxZRnFFdzdlQU1VY0J5SlJ5cGZ3dU95VkJ0?= =?utf-8?B?YzNNY1NJOElQMUJNTE1HQ1J6amZncFhPam9XaTZuM2J6NnlITCtHOVB4ZkJ6?= =?utf-8?B?NkV0bk1LdFJPak84YmN2b1dnUmIrdHphbDZxLzIxb1AwbE04TGtENThWK2U3?= =?utf-8?B?Mnl1MWNRZ1lFZW1ubW1NN0tvVW5obXdwOEtpYjljdStwWlFyelpxcUlHYzQr?= =?utf-8?B?MHNkWVZLMWJ0UndsQjR4U0tHWndxYVRCMmJtYVJEcW9pK0xINkpWNHB4Uzhz?= =?utf-8?B?MHpqN0NCbmZBS3pKK2RVSU1NTFRLbitNTnBMTGI5K0FVV0NoaDNFc1ZCTlJj?= =?utf-8?B?b2J0bUhXdmpIR1lucW1QRU93Nm1KNnZpNSs3cmM3VUVjVzltY2tiWDhZSE03?= =?utf-8?B?cnFyenQ3azNoM1FrZmNwK2ZCcGdGYksraTNjTEdKaUtPbzRlc2R2RkZ5WXVO?= =?utf-8?B?Z1B5UlRjVGlrcTRpWWViSzZ6a2JLS3VvYnpnMWU1NE5rZVdPQnVZWFh1Rjky?= =?utf-8?B?aGJtQVVkcUNIQ0xtcHV6a3BLTDF6TFBETXR1NjVXUEFmbVJqbWxSRGVmdXRT?= =?utf-8?B?SElCUW5Hb2VKVTlSd3F1VGFsak5xT0FZREhOelVjbURIS2ZTV2NFVzZxUU5X?= =?utf-8?B?dS9FMmd2QXhmVzBiS1F0UTQwMW5kSzlta3BzODh0OHdaUmRhVUswTVBWMDBk?= =?utf-8?B?S3YwTlpkWVpORnFWRlVDNXJFd1A2Q2hsSmppTlBteVc4V2pkSm0zK1FKMW9o?= =?utf-8?B?VjRtck1HWkNwa3hwcXdwdmJqdlpJMkRyNzk0VG8xSEJCeEZJQ1NQMWxScHh1?= =?utf-8?B?WGdhcWFsTlZHTnlYQlF3TERKY1pYYkEwT2U1alkvYkFyay9JWkJpY3hzc211?= =?utf-8?Q?vyySYQn3Cvw=3D?= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:PH8PR11MB8107.namprd11.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(366016)(1800799024)(376014)(7416014)(7053199007);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?L0IrVkUwOGJmd3RLN0JQVDMvVXpQTmlNRSt5UkZNZ0VzQVhEMlZoZVpBOW1w?= =?utf-8?B?b0dHcWlvM1kvZlpiYVFlMGVSeUM4c0ZJZHZScDFIRExGVDQ1dmJKTE5VVC9L?= =?utf-8?B?ZXd4Z3JlS0NlK0JwQnlDZkVtdkJocGVjN0hDSmJHMGQ5d2tlMS9MQjdBWUlV?= =?utf-8?B?MHlyNm5CRU9tbXN6VFkya0VKbWJyYUx5VFIveWdNeTdpTFFqNE9qb0Z1MHA2?= =?utf-8?B?Z1N0NEk4a2lqcytOOVNhLzZNYjJBUzJsQmFieU5NRU44R3R0OHdhNGFOSzdD?= =?utf-8?B?THFpRzFxOHp5STIwSGFQbTRZdFBrajBEQ1U0cTZoSUlvK09SUmo0R1oyTnRW?= =?utf-8?B?Z2hneFVYMHdiWGlCWWFqMGZzaGR3R0pabWxNUmIzZzA1VFhCbVJXcXlNTGpY?= =?utf-8?B?b2tVMjlEVWJRM0NwcUJvNk0zLzJ1MEdndUpSZ3NzenhBaVR6VjFQYzhTcVAw?= =?utf-8?B?c3Y2T3JGSTJtTmV0czFiZVduQTE4aHRpRERIQmVWYkRmaFA3dUxnMFlRV0lY?= =?utf-8?B?cS9maUNjM1Z6MEgvaFJobGF3U3ZyNTlXc3JsbEdBTjlBRldwU1RCdXgyaEhq?= =?utf-8?B?S1BSM0hSOHZ6bWh6TUhXbVFLTlI4WURrVnUwMFBzT0VMeUtuMXo0SEs5b2VU?= =?utf-8?B?elJwTVJrSFBxU21va002VTB1Z25DT0pvcVVvT052MXRZaXdkK1VNNGpxak8v?= =?utf-8?B?NnlyeXl1ZWw1cml6ajBibkk0dUZPSVJITzJRVXlnbUN4TmtGZEU0UWdTRHdI?= =?utf-8?B?Z0xMbzh5THd1dFVTaG5WanJWTTdnQ0s5a2FYdlVqZ2NUK3ZZbUpseThzejQz?= =?utf-8?B?dE5sY2dNK2hld0pMVjlHQzA4aUg4NFpVNjIwU0RlZE93dTlObStDMVVpbS9u?= =?utf-8?B?NVJMb0Q1N2FKd1R1ODhNVTdoK0FUNW42aklTNmFNOTFhMlQ1aFJiL0gycEhC?= =?utf-8?B?dE14WGtweFdSUkYyQmJjRlZpUTN4RDZUa0NQVVdQa3FrRVpKVVNNbGdSYUJx?= =?utf-8?B?TnljS2NGNUxzL3ZJUkp1Y0tqY2Z1V0VxSXFPdytLT085NkdXMUpXQ2txS0lC?= =?utf-8?B?SHIxOXJDbGdOeERFNVpEQnhVVEJVL3FWaTlJckgwTEtMVVRYMU43SE40dmxQ?= =?utf-8?B?K0Roc2U1VjcxemQ1dGFid1dVVEFSOVFIN05OQkN5UnVnbzNIN2M1Zys5NUIw?= =?utf-8?B?bkZFanRKeHFjNUxDUFFtelB4M0RZei80b0hoT1dIQzJPZ3NlUU1qdXUrNXBs?= =?utf-8?B?cWpYdzlPRW1ncHhwL0hyenladE56bGVkMi9wT0s3ODRLSElXWmRKRFhTeUln?= =?utf-8?B?RlBlWGJGOWZpU1JRc1VNaVZDNjE5cDR2OURsR3N4eWNyM3ZwNVo4Sko5YUhj?= =?utf-8?B?LzJKOXI1NytIMldqSlUwb1ZHdnYycE84WTMwRE1rbXJsazRCWjhaQlBMbHpt?= =?utf-8?B?UzB3S0poQ1BtcDE1MVhCMHBya1NOMEdxZ3ZsM3Flc2tIamU0dTQxM2Ftai9t?= =?utf-8?B?dXNVRmtqTkUxL1kwUWFEV2tjRkpNbXNZcjdxdVVPb05pTFRkL3B4RzRTbTd0?= =?utf-8?B?bWptZ3hjRW1xL1VYT2dOd1ZIaWwzaFZWSTRaMVdSUWVoU0JPdTB4QjR6dTdF?= =?utf-8?B?MVdTNDRoa21yYkkvU1k3bDZVNGdCNW1SMVphNk9ZUnZHZDB0ZEpjNmZuUnJS?= =?utf-8?B?cExFdGFCTEdpVERIRzVQKzJpb2xLN1ZnTVhvV0R0QnVub2NrUFFLYVpzN3Ni?= =?utf-8?B?QVI3dU9DVDRYY3owdkV0UVJEOTBWQjZ6NlJvREFBbUt5ZkJWcTN3MFV3UWFu?= =?utf-8?B?TU1hRXI3YzJnNm92aS9GaVRseDlaY3k3aUpaZFd4ZUdZL0FXOWVUTThObDRx?= =?utf-8?B?b1JoSnFENjBaYndubEtuV2ZXQzFRWGdlMnJSandqZlJBYU5Sb3c2MFlYc2pQ?= =?utf-8?B?S2dXNVFnbWJhRW1JN1lsYUJENHFlWFhqSENXazFuSDVyOXNZY3dzcEJOKzhY?= =?utf-8?B?N3ppUzZtRUMwa0tsVjZXcEtET3pCU2dhMFIwVEtpaWxyT0t5Y0tHTFNQcGdZ?= =?utf-8?B?UEs2RVI4RzZydWNvY2dEdmlLeWxRU2VRblRiYWFRNHltNkwyY2FTdUI0TDQz?= =?utf-8?B?NWUxYXM5a1QrUXBGTlBEOGJxdWROc3ZBQ3RwakpEM0h0SUdHZXBEVXloYjhC?= =?utf-8?B?SHc9PQ==?= X-MS-Exchange-CrossTenant-Network-Message-Id: e9f30fcd-fd75-4d15-0b89-08ddbf7322af X-MS-Exchange-CrossTenant-AuthSource: PH8PR11MB8107.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 10 Jul 2025 05:32:18.2090 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: cKjm2l80fMTnUKJwok4GMNhaC123KKcH1MVlOwcJiYApBh6WYiuR972MC1p89vcxShWQKcKE4Sy2A6+T2mMPxdx/L7Cyq66sApUcRhvFsJk= X-MS-Exchange-Transport-CrossTenantHeadersStamped: SA1PR11MB6870 X-OriginatorOrg: intel.com X-Rspam-User: X-Rspamd-Server: rspam05 X-Rspamd-Queue-Id: 6AE6AC000E X-Stat-Signature: 3bxbc933o5aqx5taam1tfppg6zo681hj X-HE-Tag: 1752125549-916225 X-HE-Meta: U2FsdGVkX19PIb/GrzJsmrPZZpa0Y0ffXH2aTTs/SwWkIv8F8YgJdfBHNr5DecoOKI+blAPDVxq+yWNBhjNVoNU2tjj/+DbY5FyGrZ4grgQtv8CEdNZGRQq7Up5ARiG6rmRrHMfhRLUIRybhEOPAWO7tIBq2I7lZxLY26dJxPsB3TN1JHGp0RrTmHnfq83BCE5d5sHOUwVaw+W+5HGpFLTYhq/v0yTY9JLht+aS1Jx29q9ETSy9mUAK8XJ8RaMjhD0dDJC45RbLDXdp6RvJwLHtOoA7ehL0CEfXf/o3MKOslGsFuecLzWDLIyvUQ2PiHJgXRp5rK4N6S50pJo8SWCkg9faWw5y02YEbz0aZQLdskuFLerlxDTQpRpOYIQjLHNxr0O8QAKTUnrr7CiqOVd0AVVYBdNWZf5utT8CNWtfoWDllMQq5yuff1j+Pan86QYtjsKLEMzxz5CnRv3ITGG6WrWW2yWgE92wy+4IGeLxDAu1/EF4mKdx30Pec68DW423VKNKczAossh0GSm+JHusuQpB+c7D2MQz2jMXM3YlWlc9m6dzk/7z8HKfuqR3qQQBd/bzt5d49T49PwyQNeJfgBj+4QKcR8WEfilhY+z43fw5Kj9fRFHBSCROxP4nxoAeL03La/x2lUwpKIfDuVkLJGGseBF1586suVBD8YawAYgJENeF8VTAstL5WnpF5UdMAkH2Nvx3RQkPRJyJSF41+u6Zxbo2zKtvnqubjuSKWJTyBJf/GSJ4D4FOxhTzFIUcEPKmRDzIAESUZxFeGL1Q4COaYSA1z6VYAD+KtrW8FHw0etlGRsY0sGHuJl2IP6r3Qr0T89/itZohSkrDfNeZnUJz2Ea77jK3jfsd59zQUfk+SDIQVsyn+yvkXB4LwzhrKCDDqE9yBtfbVPqU3MHsHd/MTmHQNNOpfKxXfwtn1w06DyiMIkKxSkb8nZWgEoKdyTevzsTAbVt0xPESD TtK/z8By FaxzGiPMDHewwjTWgQBJJ7jS/b/GCPMqa/WXxIQozdAxLAnCuYESidQIkbrNmrExJXY1376fancaa1bOSd4+qEblIOWBE/dzbK8EWIhO0tORpavEHYKNjH47TZt7QMcAEydJibXwo8rm+BME0L+M5WCJKjgQSsa/mBDPqCYHDsXgnt9ojYMSlZMC7YRO/Fv/huzc3JtmBPkShwq9m580SffXMvcz3S077JoR+GlsmrDt3UMR90RQFtKQicIVXAEl7jSDeB9LEu3vSlR9MmYh/XFbOr7PMH9nPPZNtI2tCL7LgaLgSmpw6AmOgxYybysL7WyK0jF7uOe8RHxKG3IAUxt4Les1bLbwb/pvsEaFhP88/UNJeoJ0vvRURoVBsFUHONWXfFWfHQzkTTuQHVcJm0YHTIwah3+UTR8na/4tV/gL8jZrOyPCI3A8KpGql4JgLts6xF8S3o2WF6AIA3Lz/x3f4qpahOYJUe2zvlgkH0bB1jz+bppS2PNooIEWdvrs+yCrMrmsZYTfmsM/SThZIsFQuG3yrkajTy/qEUwT143zq+lk0KFZGIWR/nBPOwnSoTkwW/QMTBf+JBxs6Mx1FXFEivQ7CTL8+VCYIzcCnGZls3xxOvjvo1WVkRw== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: Jonathan Cameron wrote: > On Wed, 25 Jun 2025 18:03:43 +0100 > Jonathan Cameron wrote: > > > On Wed, 25 Jun 2025 11:31:52 +0200 > > Peter Zijlstra wrote: > > > > > On Wed, Jun 25, 2025 at 02:12:39AM -0700, H. Peter Anvin wrote: > > > > On June 25, 2025 1:52:04 AM PDT, Peter Zijlstra wrote: > > > > >On Tue, Jun 24, 2025 at 04:47:56PM +0100, Jonathan Cameron wrote: > > > > > > > > > >> On x86 there is the much loved WBINVD instruction that causes a write back > > > > >> and invalidate of all caches in the system. It is expensive but it is > > > > > > > > > >Expensive is not the only problem. It actively interferes with things > > > > >like Cache-Allocation-Technology (RDT-CAT for the intel folks). Doing > > > > >WBINVD utterly destroys the cache subsystem for everybody on the > > > > >machine. > > > > > > > > > >> necessary in a few corner cases. > > > > > > > > > >Don't we have things like CLFLUSH/CLFLUSHOPT/CLWB exactly so that we can > > > > >avoid doing dumb things like WBINVD ?!? > > > > > > > > > >> These are cases where the contents of > > > > >> Physical Memory may change without any writes from the host. Whilst there > > > > >> are a few reasons this might happen, the one I care about here is when > > > > >> we are adding or removing mappings on CXL. So typically going from > > > > >> there being actual memory at a host Physical Address to nothing there > > > > >> (reads as zero, writes dropped) or visa-versa. > > > > > > > > > >> The > > > > >> thing that makes it very hard to handle with CPU flushes is that the > > > > >> instructions are normally VA based and not guaranteed to reach beyond > > > > >> the Point of Coherence or similar. You might be able to (ab)use > > > > >> various flush operations intended to ensure persistence memory but > > > > >> in general they don't work either. > > > > > > > > > >Urgh so this. Dan, Dave, are we getting new instructions to deal with > > > > >this? I'm really not keen on having WBINVD in active use. > > > > > > > > > > > > > WBINVD is the nuclear weapon to use when you have lost all notion of > > > > where the problematic data can be, and amounts to a full reset of the > > > > cache system. > > > > > > > > WBINVD can block interrupts for many *milliseconds*, system wide, and > > > > so is really only useful for once-per-boot type events, like MTRR > > > > initialization. > > > > > > Right this... But that CXL thing sounds like that's semi 'regular' to > > > the point that providing some infrastructure around it makes sense. This > > > should not be. > > > > I'm fully on board with the WBINVD issues (and hope for something new for > > the X86 world). However, this particular infrastructure (for those systems > > that can do so) is about pushing the problem and information to where it > > can be handled in a lot less disruptive fashion. It can take 'a while' but > > we are flushing only cache entries in the requested PA range. Other than > > some potential excess snoop traffic if the coherency tracking isn't precise, > > there should be limited affect on the rest of the system. > > > > So, for the systems I particularly care about, the CXL case isn't that bad. > > > > Just for giggles, if you want some horror stories the (dropped) ARM PSCI > > spec provides for approaches that require synchronization of calls across > > all CPUs. > > > > "CPU Rendezvous" in the attributes of CLEAN_INV_MEMREGION requires all > > CPUs to make a call within an impdef (discoverable) timeout. > > https://developer.arm.com/documentation/den0022/falp1/?lang=en > > > > I gather no one actually needs that on 'real' systems - that is systems > > where we actually need to do these flushes! The ACPI 'RFC' doesn't support > > that delight. > > Seems I introduced some confusion. Let me try summarizing: > > 1. x86 has a potential feature gap. From a CXL ecosystem point of view I'd > like to see that gap closed. (Inappropriate for me to make any proposals > on how to do it on that architecture). I disagree this is an x86 feature gap. This is CXL exporting complexity to Linux. Linux is better served in the long term by CXL cleaning up that problem than Linux deploying more software mitigations. > 2. This patch set has nothing to do with x86 (beyond modifying a function > signature). The hardware it is targeting avoids many of the issues around > WBINVD. The solution is not specific to ARM64, though the implementation > I care about is on an ARM64 implementation. > > Right now, on x86 we have a functionally correct solution, this patch set > adds infrastructure and 2 implementations to provide similar for other > architectures. Theoretically there could be a threshold at which a CLFLUSHOPT loop is a better option, but I would rather it be the case* that software CXL cache management is stop-gap for early generation CXL platforms. * personal kernel developer opinion, not necessarily opinion of $employer