From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mgamail.intel.com (mgamail.intel.com [192.198.163.13]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 4F2973CB2D4 for ; Mon, 22 Jun 2026 16:10:21 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=192.198.163.13 ARC-Seal:i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1782144622; cv=fail; b=P8b9OFtzYbPLpYnyPwnMLFV5Gii9IBHxeJRlXHKK6yyMdm74TEyKrBTGjA1Gdf+csFJGi+xuCjGBxdoVsngXseckNI/TvJyMX9bnUHQ2w0bbK6CSVJTxcOAU44MPNBP9eX56ohxKXePDsu1q36yo1yApfeGtrDb+JLpBcvvcWXM= ARC-Message-Signature:i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1782144622; c=relaxed/simple; bh=SkAT6I5dfB0y4h3i8ldDSf/8hjoMoQwZk12Rurat/RE=; h=Message-ID:Date:Subject:To:CC:References:From:In-Reply-To: Content-Type:MIME-Version; b=U6ozXBNVQAnDknjOEBKpq96/QnoQUsOuGvTm4uE7Kq04tZSjXWCVIGfprVZxJr0ann0KPvOqAQD40t7VKuq5hOwqnJg8+owE/VzSPk9WHaR7Y4rQhCBxNev+DpEvxQHmdpYEMNqJM5Iwg9WW7rp7zB4Aqo4YwR3evpXJSzkklAs= ARC-Authentication-Results:i=2; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=intel.com; spf=pass smtp.mailfrom=intel.com; dkim=pass (2048-bit key) header.d=intel.com header.i=@intel.com header.b=VZOUCK5r; arc=fail smtp.client-ip=192.198.163.13 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=intel.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=intel.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=intel.com header.i=@intel.com header.b="VZOUCK5r" DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1782144621; x=1813680621; h=message-id:date:subject:to:cc:references:from: in-reply-to:content-transfer-encoding:mime-version; bh=SkAT6I5dfB0y4h3i8ldDSf/8hjoMoQwZk12Rurat/RE=; b=VZOUCK5rHOyjKvt3ZGgqAizf6nXtR+ptDQ3G0AeRiC6FIW+RFdTP3yct 6jTXakEAQkjUziu0cEQjNmp+nosWMBPtvAeLhCJTjBQ9T61QRvf/Imzlp E6XXBOaGk2C6aKSP1o/FM6WaDF5iWq//zfKftCZxPpqWg1+n4QfpAvmqp QDO24bAq0cUtTWBUU94Bj0n7KJOSvEJEpPTwB95+FmITE9xolDiShPDOr Hk+S5C4qBUWUqFDzuSNWNkr2bfTjgkyGX4Z7rZAyMRe8mjeQcRUJknTIl yJdGCD9GExAmNLCrQWbV2j6RERIi/Fk50CySrydxWvoJQr+AfOclcly/Y Q==; X-CSE-ConnectionGUID: 4MA7Q5uRRS+qJZih1E+hGQ== X-CSE-MsgGUID: vfvhZLZDQpGK+JYPJ14gYw== X-IronPort-AV: E=McAfee;i="6800,10657,11825"; a="85430430" X-IronPort-AV: E=Sophos;i="6.24,219,1774335600"; d="scan'208";a="85430430" Received: from orviesa008.jf.intel.com ([10.64.159.148]) by fmvoesa107.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 22 Jun 2026 09:10:20 -0700 X-CSE-ConnectionGUID: UMVhVvNSSTGenTMQsIMKlQ== X-CSE-MsgGUID: b/+c60s6SIOjjOdYp2j3vw== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="6.24,219,1774335600"; d="scan'208";a="249116975" Received: from fmsmsx903.amr.corp.intel.com ([10.18.126.92]) by orviesa008.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 22 Jun 2026 09:10:21 -0700 Received: from FMSMSX903.amr.corp.intel.com (10.18.126.92) by fmsmsx903.amr.corp.intel.com (10.18.126.92) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.37; Mon, 22 Jun 2026 09:10:19 -0700 Received: from fmsedg903.ED.cps.intel.com (10.1.192.145) by FMSMSX903.amr.corp.intel.com (10.18.126.92) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.37 via Frontend Transport; Mon, 22 Jun 2026 09:10:19 -0700 Received: from CO1PR03CU002.outbound.protection.outlook.com (52.101.46.29) by edgegateway.intel.com (192.55.55.83) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.2562.37; Mon, 22 Jun 2026 09:10:19 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=FSPX9K3WC2cqRkh50hnpiR5M+uO4qt4CwGi6vL/ustWWbMTcQlr7NKtQ2yJpJCwlA1DJKM3NT8vTWQ3zAPIPyQMfldtlP2YdgVFfXT2qPPCQ5R84qiHFJ6ZhbG6Q0WyKCyolXNFD220gQmVLO290Up4EgLmwAIsCcQu7RFiWkiLo2GgfkZeJNPwcHdEREckSIuFLl6QWUxjS21YT1+iebrkXxL4iWjUHBdCJAxFqPE4HxcrwhXOxjVIY2T/NhVU15XNQEdsF49O2Kl+d586bNGqvC3DyJD1mXbUsUE3mHg9wsVmGiI26jj5kLV9tqH9pOp16HOcXKT8C70XlWAgsXA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=BqcX2Fa0G6byg6izG7PHYM2M+6u9EKg/FHkjOndBsRA=; b=y6faeun3vRJa5l3pu8bNlEDaSO427/TJqO5JLhUGHPG35b5wtvVdVolNcsgWOjueJzrPNa8iA6vWWtzJYDOANU+LHAbkNcmm4fPdhuQvUE8KkIuopVYmoX3VcXE89bsI+p+QEEYvYmTwLjaSVJBMFMfwR6p+BG/HDPF30i6s8TgWi0a430ei+gCAxRXl181EJOJlkAJBaigMtdXi0dUjRATRa431xGsFiccR7mLFiWnZME/77P6I14BRz11Z6adXsSc5lLWCAllfBB8tHtq3aFv2O/rYx/Hr4Q3Wk6caBqsIn1AGrk+XpL6MAQqcSjIzg3IpXCvzJVfmBrttVm0XQA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=intel.com; Received: from SJ2PR11MB8370.namprd11.prod.outlook.com (2603:10b6:a03:540::20) by CH0PR11MB5219.namprd11.prod.outlook.com (2603:10b6:610:e2::13) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.21.139.18; Mon, 22 Jun 2026 16:10:12 +0000 Received: from SJ2PR11MB8370.namprd11.prod.outlook.com ([fe80::b6cf:ce77:3cdf:7cc]) by SJ2PR11MB8370.namprd11.prod.outlook.com ([fe80::b6cf:ce77:3cdf:7cc%5]) with mapi id 15.21.0139.018; Mon, 22 Jun 2026 16:10:11 +0000 Message-ID: <5a11d23f-1229-45c1-bf02-ea41c70c1d69@intel.com> Date: Mon, 22 Jun 2026 09:10:08 -0700 User-Agent: Mozilla Thunderbird Subject: Re: [RFC] mpam,x86,fs/resctrl: Generic schema description Proof of Concept To: "Shaopeng Tan (Fujitsu)" , Ben Horgan , Drew Fustini CC: Tony Luck , James Morse , "Dave Martin" , Babu Moger , Fenghua Yu , Chen Yu , Borislav Petkov , Thomas Gleixner , Dave Hansen , Peter Newman , "x86@kernel.org" , "linux-kernel@vger.kernel.org" References: From: Reinette Chatre Content-Language: en-US In-Reply-To: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-ClientProxiedBy: MW4PR03CA0114.namprd03.prod.outlook.com (2603:10b6:303:b7::29) To SJ2PR11MB8370.namprd11.prod.outlook.com (2603:10b6:a03:540::20) Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: SJ2PR11MB8370:EE_|CH0PR11MB5219:EE_ X-MS-Office365-Filtering-Correlation-Id: 35e82348-0c38-4157-e2b1-08ded078bcaa X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|23010399003|7416014|376014|1800799024|366016|6133799003|22082099003|18002099003|11063799006|4143699003|56012099006; X-Microsoft-Antispam-Message-Info: LqXKb1hq6GBxOB1HZIy2DyYzpfdLi6CIZhCBSNWYvehasM76tVsXLGM2nISvlhmCdtUOrznVZFxOYAZCpO/2NhgHHNVH1983HPT0O4qP4q2ugbtJ0RhVbZ3t8EvJ5wyxjxRIynIbgMinJEH8RLUj/zkfSVOECNp+yNl2k+vHHruWL+84sZCRVer9PVLUiwP0Q4rpnjH1AYa94NKwvFPZJ9mrMUUkwr9I1//ubcdYTbpQpUt8sKKzZEu/FsyZo32weQka4kOnQo/sIiSZSg+J/ZO8aSftGDo4gEovBcLbNFrr7+oq6dLntmWvZaL63OlRA8cehMjtnDcN4bRHTiiBkklKW8uHiEUXGrSDER59WP+3MMwLRXMvwXiEVuxo40w5upAXoCytU01DLR19/mYMZK6MiUdhtm8l3ljDFNZET2p1IZkfASPvMnYh0mru7D78RVN80ctE4tz+QUnXd14LPIGbY2xz6zT48fUKKrm982Es1rPXYsC/fGn99J8lai/RO9EQ7TeJYcjUaOawVrKDIt3uE+Nvp2Aae+urdfjHZFqxj0FI2DGp6W94EjFbhZZj+jaO7kiUM6ekFwSs+iH0VLoP/Kq+ERo/eH6jI0278HVctYLAcJigeODLk3YXjnSr X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:SJ2PR11MB8370.namprd11.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(23010399003)(7416014)(376014)(1800799024)(366016)(6133799003)(22082099003)(18002099003)(11063799006)(4143699003)(56012099006);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?STZDdC9pU1lJWjBjTlFlb0QydEpuYlJpb1lFOE9SR0s0RVI1cDk4aUlFL05k?= =?utf-8?B?cmF4TUxXOGJ4MnIxeEJUWEtwcG9CQW5LZVZMZnpqMlRXNlJDMHY5R3RpWklp?= =?utf-8?B?ei9UOFNSb1phOGFZb2xIcXBSSEFUV09uQTlDWWhma0ZEbWJIQURhU2tUNVlZ?= =?utf-8?B?QW9IbGNLMzJJb1U4a2M4U2RwdXhiUDB5NmRBRnN1eXNwZUhjY01xd1c3WFlV?= =?utf-8?B?QnBSQW5hVEdaUFlUU04zRitZY3lFVUlORE5jcklJYkFnNUNxTEpFS3ltZDVy?= =?utf-8?B?YUVNTEYvWWpRYXg5alhZM0xJNlkwdWFSMFlrb21qQVpXbVJUWEhiRkdJU2FF?= =?utf-8?B?RjgxL0RrUndqYzJjUHMrbkVOQzRVYzcyWFVoTEIxQ00vT29pbTM2TGo3QzY1?= =?utf-8?B?Q3RndTJsTzZsYmtPdjFTRHUxKys5bDZKOEJ0SU9kZnVnaU1WcHM0anU2RFps?= =?utf-8?B?cmlTaG1aSDdweThJYjJ0TnN1TUp5eGlCcjlMWUFJUCtTUzltL2g3TWFqSEpO?= =?utf-8?B?VlpyYlpzQXlFVkkwM2NCNWxEMzdiU3crMXVmTURqNGRtOGdmUHhzZlAyRXRK?= =?utf-8?B?bW5qUjg4Q2l5SEhuL2ZyZnlLQWMrQWd4dU8wUTVnLzhOMU5KdllOQnYzWGFi?= =?utf-8?B?eDhjb0xHWjREdHN5cWFnSEthMzdodWdLYmtjNmFyZ2gvdVVuVWpwL2RrREQ0?= =?utf-8?B?V1ZlRmdLWDJ0dUZQSWVEK1NodytxZG8yckl4M3MrVUM0U3hSUG9mNGZReW56?= =?utf-8?B?d2pFc0oyQ0pLcXRqamtod2RsdEVXaUtXV0JiZkx4eXB2TlJkc3FzZy9xVGla?= =?utf-8?B?OWUxYUV1L0ZNeFI3dXNDMllyYWpjdGQzeVQxcnJMcWZZWm9kcVo0OXl1S1Vl?= =?utf-8?B?b0l1cGhlZWg1aDZFV2ZrVHl2MkZRN3QxU2xoN2JkMnYzMmZQblhJbDVPd010?= =?utf-8?B?TGM5bkNHdXZmUld0c3pCSlVTb2RjRHlwY20weTI0ZEgxbjRWOXRuMGtwWVh6?= =?utf-8?B?alpaRnhTVjZoQmVJaFZWSDVFb3JhZ1FYNmorY2lBcDZpMFNveVoxcm9tTkNq?= =?utf-8?B?OTB1Q1VqSHFGMGVWRzY4U1F5LzM1YmtDUG9DekUvby9QM2NnK0FkN0lSb2xP?= =?utf-8?B?Q01Sa2ZURDVYYWFkbGtQUnY0eTBZQUFOVU1rdnpHWlo4VUxqUHBZWEoxWjIz?= =?utf-8?B?dnBkV0pxVUZsTlZnbUZRR2M1dUZ1OC9nTVhRYk1QTmY2YXZBbmpHcm54MzBQ?= =?utf-8?B?WlRwRFUvalg5eEh6UkF6TVlKbTBZS2tnbmk5ektrbUtkZlo0WWhpVk95eGVm?= =?utf-8?B?WGt5N2xDcXZ0bDBlMWN2TlNNRkhQdDN6bUcwZEdsTlVHL2V4NDVqaTBXTUt0?= =?utf-8?B?amNSMDZGVkhjZ0Y2cmo3VDlHMHd3Y3F1aDNRSFBJbkxVZm5ZdTcwS1lyTjht?= =?utf-8?B?RjdmQnB0aGVWTk4xSHRmY0lFQmx0WGc2bEEwRlg1ai83c3J3OUZ6RGMyVXVE?= =?utf-8?B?a003WFpCY2daYmdrMndhRmhNQ3RHcEp6bVJFcG8zclRha0JsRGJFWFo2M2ZF?= =?utf-8?B?UWxvcXc4SExYNzVlRVB2d3ZEUU1yblRWY1VYU3N5Lzd0UzM5U0VhbDNmVXNM?= =?utf-8?B?NnNTUXg3WS91WVFMY0hCQzE3dGQ0V05uUENtOGNBaXV1MTdkWkp1Y3NOcDJm?= =?utf-8?B?eEJkbmxjTlUvN2NwdlBxZ1phTWhxZjdtVWJKMm1rdnhxclZUUDUzRTZqbDA2?= =?utf-8?B?bnBwRE5UOHdTSTJacE1hWDlDWlcxQWpNOTNWellWaUppWkc3ZVlzQjYzUzhI?= =?utf-8?B?NWtNMnhmYUQzVEFhNElPakZQR0h5bUJJNHFqeGVNSFp5NlNoT0FJTmtPWFkx?= =?utf-8?B?dlAxMEhldkhveFpJekNlRHJNWlgzMXQzMWwvejFBMWkvdVVxNTJQYWVxWW1x?= =?utf-8?B?K2RJRm85UG5yWWNXOHk5SXFYckoxWHJVU2c2OWdmK3dFSXlJNHNwYlVJQUoz?= =?utf-8?B?eFgzR1RFaHZDV3VpV2owaDZ1MTJlT3AveDVSYnBreEN6aUdYNy9QcW0wbWI3?= =?utf-8?B?U3hMOW1yWTZTcVFVSktueWwwOCt1MUJ3RW55ZnE4NjNaRmV4SkU5SmMrd0pV?= =?utf-8?B?aW5Vay9HbGtMMGc1azNzd1Q1b3NDekhjUHBQK0RIUmtWNHdmcmxVbVVydis2?= =?utf-8?B?SlB4Vm9IUytaZWtYVitBOTFjWU85ZWgvQkZnME5uVVJtTkNETVBxaDhVS2NI?= =?utf-8?B?TkxHUmNzK0lPVll4NThSMDNkS0pCaHdvbHdidkVLdkRXMDNsSFFQeGlaTmMr?= =?utf-8?B?cU1MbUltZVVrUGppdHd1Y3JuMTRZZ1gvTW5jK0Z4cVdaa1ZtY2ZrUGtvN2t6?= =?utf-8?Q?voziJuGOAYrMZJ5g=3D?= X-Exchange-RoutingPolicyChecked: IY42SRVLCDKkdJGzvPgUDZy79dQE07DeV2Fzxt6vAKISA5wrK8077JIONOssx4Egr3LrjnwEdJhdXYsUu5HY/9QV3e8aPNpFit11UdA2NQR4xtA82KdjsLPkFZC0Xrgo/XwlzGsue1vGqMYeU8aSy94aZOUMqwMSidkRxKB9qAJCGdClTDNRyHRl7FGz82LRGUpy1pE2yvbJghj/zNpqsZuJsjY9nYe9QsEG3IfhQVPbrEzzbTIlzQOu821jF7qleO5mIWLY0+m/pG4Gs9bibu78Ah8SJxGLveBJjfxZoSfqEJzB2pL3U/5MR9oer3PuvzDMw0ye+Lpn1/q54G+3mQ== X-MS-Exchange-CrossTenant-Network-Message-Id: 35e82348-0c38-4157-e2b1-08ded078bcaa X-MS-Exchange-CrossTenant-AuthSource: SJ2PR11MB8370.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 22 Jun 2026 16:10:11.5023 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: gGNTowcnPw8BOO8mDdeiDEzMj3lFS847G23Ab1lyzRvOvy27ON3NCn8w6ukwlJ1pdmoZMgb5pXLWrTBdvlLXS8y4WCjaisQpUHBO1VZkAgc= X-MS-Exchange-Transport-CrossTenantHeadersStamped: CH0PR11MB5219 X-OriginatorOrg: intel.com Hi Shaopeng Tan, On 6/18/26 6:42 PM, Shaopeng Tan (Fujitsu) wrote: > >> On 6/11/26 6:30 PM, Shaopeng Tan (Fujitsu) wrote: >>> Second, regarding the naming of "mbm_total_bytes", >>> the meaning of this name seems to differ from what is typically found under mon_data/mon_L3_/mbm_total_bytes. >> >> Could you please elaborate how the meaning is different? The only information I have about >> the systems needing this is in Nvidia's portion of >> https://lpc.events/event/19/contributions/2093/attachments/1958/4172/resctrl%20Microconference%20LPC%202025%20Tokyo.pdf >> >>> To avoid confusion and better reflect its different nature, >>> how about considering an alternative name such as mbm_global_bytes or another more appropriate identifier. > > Current MBM events in resctrl are per L3 to monitor MB between L3 and memory, > and mbm_total_bytes monitors the L3 total external bandwidth to the next level of the memory hierarchy. > Is my understanding of this correct? It is my understanding also. > > Based on NVIDIA's information, they even assume that CPU-less nodes will not feature an L3 cache. > I believe NVIDIA's objective is to collect traffic data for each NODE/NUMA, > without needing to distinguish which specific L3 cache the traffic originated from. That is what associating monitoring with scope (instead of L3 resource), and supporting node scope, aims to address. > > This aligns with the fact that, in ARM architectures (e.g., on NVIDIA's platforms or Fujitsu's MONAKA), > the MPAM MSC (Memory System Component) can also be located on the memory controller. > In such cases,it becomes impossible to distinguish which L3 cache the traffic came from. This is not clear to me. Is the goal to expose the bandwidth at each memory controller? > > Therefore, the proposed 'mbm_global_bytes' refers to account for traffic from all L3 cache within the global system. > As I see it the directory name would make the monitoring scope clear, whether it is at L3 scope or NUMA node scope. Within the directory there would be the individual files that should be interpreted based on the scope of the directory they are in. I thus see a "mbm_total_bytes" in a "L3 scope" directory to have different meaning from a "mbm_total_bytes" in a "NUMA node scope" directory. Reinette