From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id C6405C7EE33 for ; Thu, 26 Jun 2025 09:08:42 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 578896B008A; Thu, 26 Jun 2025 05:08:42 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 5569F6B0092; Thu, 26 Jun 2025 05:08:42 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 440488D0001; Thu, 26 Jun 2025 05:08:42 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0014.hostedemail.com [216.40.44.14]) by kanga.kvack.org (Postfix) with ESMTP id 26E716B00A3 for ; Thu, 26 Jun 2025 05:08:42 -0400 (EDT) Received: from smtpin11.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay03.hostedemail.com (Postfix) with ESMTP id 92E8BBC3E6 for ; Thu, 26 Jun 2025 09:08:41 +0000 (UTC) X-FDA: 83596976442.11.3C5737B Received: from mgamail.intel.com (mgamail.intel.com [198.175.65.19]) by imf29.hostedemail.com (Postfix) with ESMTP id BCF57120013 for ; Thu, 26 Jun 2025 09:08:37 +0000 (UTC) Authentication-Results: imf29.hostedemail.com; dkim=pass header.d=intel.com header.s=Intel header.b=hP9GunPb; spf=pass (imf29.hostedemail.com: domain of yu.c.chen@intel.com designates 198.175.65.19 as permitted sender) smtp.mailfrom=yu.c.chen@intel.com; dmarc=pass (policy=none) header.from=intel.com; arc=reject ("signature check failed: fail, {[1] = sig:microsoft.com:reject}") ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1750928918; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=upiRjs4GC9gXY0P6l7mjtHJN1zKTI3BOwCkrcmc8dtc=; b=oX5s2e+baZNob6MtQkM3mfYRuuyodfAAl13a3rp0931khcc76SHvpJ3TJQr+mP2iUFnL6R g/CI9YDq1HM61iLxASRqoC6QLsx3cHRb+Mpq46w/6AHD1jO6cr1PwMCIn3htv19ect/5Up 194JsQb/8BSqhrSmLth2t/3HhwwvSjo= ARC-Authentication-Results: i=2; imf29.hostedemail.com; dkim=pass header.d=intel.com header.s=Intel header.b=hP9GunPb; spf=pass (imf29.hostedemail.com: domain of yu.c.chen@intel.com designates 198.175.65.19 as permitted sender) smtp.mailfrom=yu.c.chen@intel.com; dmarc=pass (policy=none) header.from=intel.com; arc=reject ("signature check failed: fail, {[1] = sig:microsoft.com:reject}") ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1750928918; a=rsa-sha256; cv=fail; b=zSaSXr61q6w36A+Z9BP5rkMRNT253AsyoE7QN2pI5MV4weSpANp+OgaSE1YJaKEGj8pvvU Q81gnT+YQlS2forW1e0GToe1BxlumQMJ2KiEToif2n3f/PrqVBgk7J2RMhRcDP2o+bvRo+ 2jx8+FM22HRQ/vqwFn0ghlQRbpjjPJo= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1750928918; x=1782464918; h=message-id:date:subject:to:cc:references:from: in-reply-to:content-transfer-encoding:mime-version; bh=7wx3mXTBNDDqRl05Q3nG5/Z848VQioOJXDc+AfywENg=; b=hP9GunPbvVPpZcIozU1UqX5uRZhEyNMa4XfSLWhv5AL7DF4BkSk1WJHv 2dfNaiK69+BHFGLLW1Dhk5twmCvRC4vaE4CyVJwTup1Kw6esCBPklBhoF 2qqZ4cxtlsd4/tQsp0Yq+/y35xIUsgtOARzdFyXZMrQ5KNaKUcW3QTUCN bNtcmfMl+tf2NHPOJF5NjWNAFEx4dP+UFiBP0KVBinBpsBabvpF8wBscb eHCTDQwGfg8JsR+PFQPfi5kIS5o1BeAjsfbIF/xVlLQbUk3QicvfFjDZf 8X0CmJrRdMybbMMKCIL5JdpFZU7QPdZnQehwZwACuO4A9oNAhjTVlgFse w==; X-CSE-ConnectionGUID: 2/HzRrHLTJ6UPBoaFkz7ng== X-CSE-MsgGUID: gg3twoEvQ3y7k6ffxSEu9A== X-IronPort-AV: E=McAfee;i="6800,10657,11475"; a="53089171" X-IronPort-AV: E=Sophos;i="6.16,267,1744095600"; d="scan'208";a="53089171" Received: from orviesa003.jf.intel.com ([10.64.159.143]) by orvoesa111.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 26 Jun 2025 02:08:28 -0700 X-CSE-ConnectionGUID: ocUZMuUPSP+CIB1lKpv8rg== X-CSE-MsgGUID: +N9u8Q8FQmGQfZtM+WkJeQ== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="6.16,267,1744095600"; d="scan'208";a="156842162" Received: from orsmsx901.amr.corp.intel.com ([10.22.229.23]) by orviesa003.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 26 Jun 2025 02:08:26 -0700 Received: from ORSMSX901.amr.corp.intel.com (10.22.229.23) by ORSMSX901.amr.corp.intel.com (10.22.229.23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1544.25; Thu, 26 Jun 2025 02:08:25 -0700 Received: from ORSEDG901.ED.cps.intel.com (10.7.248.11) by ORSMSX901.amr.corp.intel.com (10.22.229.23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1544.25 via Frontend Transport; Thu, 26 Jun 2025 02:08:25 -0700 Received: from NAM10-BN7-obe.outbound.protection.outlook.com (40.107.92.85) by edgegateway.intel.com (134.134.137.111) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1544.25; Thu, 26 Jun 2025 02:08:23 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=wJx3GxKElwBVxKKfVNyFx9D0D/RuV794dxdqphvAjQdiaqMQC+6zFjeFIFQpORNo/cGZ0T1SGDQmFJlJNxUo3/wGSEN5q7VGTGtVwTg04+kFn3xl7p72nQmVf6YLVedHLL2TWxqyH3ugnaUr8r20wTCc6TPA3G9AJrdrsAP+Ur3Xr39dFaeAzUzVimOiegHxOTXgzVHQrErmst56fp3ztggKl/cMpJTsAkpEFEZnkEaSh1GEk/Cn8mb/LDGHA+SBUYLihd/LI3DWdXfg5bXhXzBa9TMND6BUJjb7cbhCTSwshV5hif5GiyPyp/Vdl0QqJbnPIfxKfGQiFDrLr8hwag== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=upiRjs4GC9gXY0P6l7mjtHJN1zKTI3BOwCkrcmc8dtc=; b=ZnnZKLI/2a0ypMs4Et2NqOfHRjX4Pe+uJbSgkPdSkbtdmTNglZn5b8vzNsaLpzPE8IH3NI/eejnTJKyQP7RsuLs32Y7GHmcUQG7CSHaxcSH0ZnnOube1V9w6esaFKUk0CPb+JrHNW+hwzzvfumxQx2WJ+ZpOjTL43843F+J9mU2hrLarEZlzsxZ2Il79lAid90ncoqSrtnQdkQbx5yFMOjX0GmvgcSQ+z1ErR1Aki0Q7xoyNSJuv582H0J3qceN/Zam96W9IgbdXA2wGJziyKC+DOK4CBvkbCwk4vvAzoQ+/cRMCO1z4etk1AdxbbGvCfXOJ9Zd3M7Rdb5uP/h5kAA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none Received: from DM4PR11MB6020.namprd11.prod.outlook.com (2603:10b6:8:61::19) by IA1PR11MB6194.namprd11.prod.outlook.com (2603:10b6:208:3ea::22) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8857.31; Thu, 26 Jun 2025 09:08:08 +0000 Received: from DM4PR11MB6020.namprd11.prod.outlook.com ([fe80::4af6:d44e:b6b0:fdce]) by DM4PR11MB6020.namprd11.prod.outlook.com ([fe80::4af6:d44e:b6b0:fdce%6]) with mapi id 15.20.8857.026; Thu, 26 Jun 2025 09:08:08 +0000 Message-ID: <2cdba052-0c67-40f3-b5fd-dd9dbd08461f@intel.com> Date: Thu, 26 Jun 2025 17:07:52 +0800 User-Agent: Mozilla Thunderbird Subject: Re: [PATCH v2] sched/numa: Introduce per cgroup numa balance control To: =?UTF-8?Q?Michal_Koutn=C3=BD?= CC: Jonathan Corbet , Peter Zijlstra , Ingo Molnar , Shakeel Butt , "Juri Lelli" , Ben Segall , Libo Chen , Mel Gorman , Valentin Schneider , Andrew Morton , "Liam R. Howlett" , Lorenzo Stoakes , Vlastimil Babka , Phil Auld , Tejun Heo , Daniel Jordan , Jann Horn , Pedro Falcato , Aubrey Li , Tim Chen , "Huang, Ying" , , , , Xunlei Pang , References: <20250625102337.3128193-1-yu.c.chen@intel.com> Content-Language: en-US From: "Chen, Yu C" In-Reply-To: Content-Type: text/plain; charset="UTF-8"; format=flowed Content-Transfer-Encoding: 8bit X-ClientProxiedBy: SG2PR04CA0212.apcprd04.prod.outlook.com (2603:1096:4:187::8) To DM4PR11MB6020.namprd11.prod.outlook.com (2603:10b6:8:61::19) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: DM4PR11MB6020:EE_|IA1PR11MB6194:EE_ X-MS-Office365-Filtering-Correlation-Id: 24c7ce32-7661-4f62-768b-08ddb490f766 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|7416014|1800799024|376014|366016; X-Microsoft-Antispam-Message-Info: =?utf-8?B?Z0YvZzZQejI3TGhnVm8zalZ4SHNmYnZmM2RuMUhhMnYrTzBZbWQ4OXhUaCtp?= =?utf-8?B?cktTcHBGUDlMRUNlRm8xd2N6U2QvU2ZWWHZpeEIwNzI1NFE3T0FEVE5OTlJi?= =?utf-8?B?ME1pTk9sQkVCU2wyZTIrSTFVUFl6azFRUm80ODFEOG1naFdOL0JOTmVHZkQ0?= =?utf-8?B?cVIrVzhXWVlmQXk5V2MzeHJJSDdXV1lxQXdiNS9lbnc2b285TnJZOWZMT3hR?= =?utf-8?B?VWVNRkpwTFAvTFBRSnF6THk0ZGxEa0xxd1BaSUtNdkgyVVpmTWhWR3QrWFBu?= =?utf-8?B?WEtZWmh0ZWtxMmozTEt6M3ZKTWdYTWpCeG01bmgwdWtrd3hKNTFhVGN4ZlY5?= =?utf-8?B?WlZwZitrd2gvN0cxU2dJUFlNR2tEcElTVlRmc0Z3WFNab0pSV2tDOG54WVZG?= =?utf-8?B?SHZRT3kvUVMrQ0l4MExBY2EyVURwZWJwaEU5YTc1VVJ3MUVaNjh5QkwwUlhq?= =?utf-8?B?blVyTnBDMTBldXlLSW9CQmZpV1dNY09jV0daWVkwRnNIaVlVL0VHU3FlOExw?= =?utf-8?B?OFJRcGhnZXc0emU5S2dERG5nUk9jenNabnBNZWpoYzV5engxamswNUR4WDRZ?= =?utf-8?B?NndLRktzSmk4QkQ2Z2NlT2VKNFNsbElwZ3YwQXZkcHd6SHVQU3lFb0tXZFRE?= =?utf-8?B?TFFaOGErdllmcHA4YlVlT2xPR3dKRzBoWVVNWDVqK3JMQVhwYnk3WW51WVps?= =?utf-8?B?Qnd0V3gydFg4dFhkSDJNMEVUbWhjQWk4OWsyUmtNcGRONytVa2M4NXFMQ1Ey?= =?utf-8?B?elJ1cERUZ0xvb200TlJDZzJ5S0RIK2cvOVRZSXZxZjlsdThDYUZvOUhDWTNF?= =?utf-8?B?cTE4UllTYW9tYURVOThHMEt2Q1dDbC9FVEJxVXJsRTl4VC9FaHo1SEdZanZS?= =?utf-8?B?LzdMZ1MzUGRKR0pTUGJhTXY3eGhRa2Z0QjdVanFZeEVlRXI2WiswL1VsSTVU?= =?utf-8?B?YXMvYUNRM2Z4SWQzVzg1elR6eGJGUWsrbUtBclJjQndWcysvLzNJMGhJak8v?= =?utf-8?B?eTdIRWtSbGk2QUtzM3pFa3BBZVgrbFozNUQ0OEg4TWRHaTUza052WFJDVHQ2?= =?utf-8?B?L1ZrbXVMY1NPTUg1dVU2ZCtZamlnQnJ6MHQwZnhDWWlyU2hmRUNVOVNoaEwv?= =?utf-8?B?UnZ6OGVXSVRVQklJWGtMU2NUV1llWGhOaVNPRWMrRTNsei9VQ2VYTkZsNmFJ?= =?utf-8?B?NTFQRndQTzhNWjFyemJmdEtnU3pPd01hMld0Tm5MWERuc1QvVTUvTGx3cVFO?= =?utf-8?B?djVHWUhZYWFha1ZGMGhWUUt0RzdJZGJPQWhpQWhyMko1MmM5NUgweUp0S2d3?= =?utf-8?B?aVdPSUUyM0dkQlU2U0dVVGRUbWxqQk1IZUg1alAvaW8zSk1FdkJsWnlxa3dJ?= =?utf-8?B?R0c2ckFYLzRCVHNFcm5HMUZsUEovVnRCV0xKck9oY283NUVPS0VUTmVCa3I1?= =?utf-8?B?dEdpaHlQVmlCS3BqMjU5bVRUdjdhNktEalZIYVlwVnJvc2hsOTliMVZDTHN2?= =?utf-8?B?QUJwb3ZjVnhxVVNPQU9Rd2xOeWdPYXN3ampRMU5hRGpHSnlKeHdUcDJuZHdG?= =?utf-8?B?OUltdW5hbm5TSS93eG1aL3RyYjY2WHZqNStSUk5wVFJibUtaZ0VLcjFHOFo4?= =?utf-8?B?YmQvWVpPejhRMDhDc0czWDBZSXhSanZ0SlFvZFVsblI2SDlKdFU4cDE0OTNN?= =?utf-8?B?M1MvU1UvV1JDVzJaZkQxenJjc29DSVdMaHlrUnZMY2lCNXVWKytYQk01eHdr?= =?utf-8?B?RDhvb2lJNEF4NWQwNk1yWmZyb3BON2NTQ0pwYzJvdkwzVUF2akYrRWY1Q01v?= =?utf-8?B?WDFlcUdKUWU3NXp2dy80S2g0RXhaWGdIVmZoOEtEWi9HQTZtVUtjQVI1d0VF?= =?utf-8?B?dWh1T0tLVFRaM1VESDZCbURaOHNkWDBwa1UzY1JDNytObVVOT3F5T2xCeU1o?= =?utf-8?Q?2bSYh14bing=3D?= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:DM4PR11MB6020.namprd11.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(7416014)(1800799024)(376014)(366016);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?UUwvblJ0R0pTaFpVWVpsTDBGUVVhYjVRcC9kSy9IeUJPTkUrQjNISExzb2wv?= =?utf-8?B?MmhnTjk2bllWQzVKWkFrb1VkWHhHOTZpcFRDRTdXU21NcjlqOEJyWWpRZy9Z?= =?utf-8?B?WjAvelVmVFNvSGFZdHk2d0dTalBvQUVXbGtGT1hnL0VHbjQvamlsVFVQR2ZX?= =?utf-8?B?NFBFNGpaT2hIMFhFSWs0bWNVdGkxQ2pFd3VucSs4a2owZStwaGhNOWFVWHVu?= =?utf-8?B?NDZvREs1dkd0VExSdW0zYU5DSXpLRlBnUFE3dk1oa3F4b05sZnpvT0Z3RWlz?= =?utf-8?B?N3ZjNnNyQ2lhUXlXMFhKT0ZacHFxMm4yVllFVWpTRzJZQXF1YTB0MmhhUmJU?= =?utf-8?B?ZEVhME9pSTQwT2grU0x2SC96d1k2Si9MUFpNWVdGWkF0UDN5S2p5NVplRk94?= =?utf-8?B?RW1YVHdjQkxaZVFjUmNXazQ5REdqaGJ2VDNSNVNkVkgyL1Vyc2Z5YmNxelE1?= =?utf-8?B?K2dPZXArK3gvc2NPZU5EOG1ZSEQya2Y0TGFzMVBxQ0psblBnR0xpR0ZOZ2Rk?= =?utf-8?B?dlVMMDJOVVgzZitmRmY5Mm1jMk5ycmt6ckM0WTV6Q1N3UkpJdkcvQ0tScUdk?= =?utf-8?B?OWhzcGZpWVk0ejI4MVBXeXM5OW1YZExKYmJjWmxWWnF4dHQ0STFUNWhMRGFV?= =?utf-8?B?dWU0VmY5N3FoKzYreVN2OTlTU0JadDRSUjFxdVgxMXU4WHpPeUlwV09GaXpw?= =?utf-8?B?Wi9DeUJzbjNVSWN1TG5adi9uNitpRFFXY3Y1bXZrM1NQeExMbUdCUkt2LzFJ?= =?utf-8?B?ekJlQTRCUjFoNmRZS1JMOWluQ1hsRlE1ejYzK3ZXT2o1Nnh4YTVubEcwODd4?= =?utf-8?B?eFdZMGxTSWpNall6c2w3YkhVaUtrdFJ5RlJialZpZWUvL0ZubHpqRE9mQkll?= =?utf-8?B?TmFPRU5iU1dxcCswU2NxYkE1OEplREF3U1ZFb3Z0UTRnZ1hvb0NIVC9BMlp4?= =?utf-8?B?VjdNNFZEY25iZnlNU0l3eWJvYnNWQlIxUTFxcDVsMElhbzFPWWxTZEpscGJk?= =?utf-8?B?Qi9QaVNXMGlYeFlnUHAyZzhoYzAvUjRwL1I1V1JnQkMyakIxVEc4aHBaRjQv?= =?utf-8?B?NUROL0c2ZTVNVitoMk1vamxKSU1lSExxa3R6bG1pZEdHcWFQVVM1d1pYR3ZQ?= =?utf-8?B?aUtIMDlXeDNoY0pkU0hXTlVybnRhajFzc3pWNGoxeEl5TG96ZnFZYWFVdzR3?= =?utf-8?B?UnIyZXpZcWxiQVJOQUxuNDBRL0twQjVkOW5iT1hjSGdKZVdlVklqUlprcTNt?= =?utf-8?B?M1lkMnE5NVd6Q0tJMmIwV1dTdnpjdE1LZnJXZlZHWWFJWHpTTlVJNjA5ckFE?= =?utf-8?B?TDZ0Znl1UjJoR2VmbDUvMVdMeTVHWFdTZlE4cCtBdjBGclB6aTFiODRCVXBk?= =?utf-8?B?VjdBSUxseldxekJkNG5ETFdSWFZiNHNITG1sM3FTUzJ2akRueHpUTmQ5amYw?= =?utf-8?B?R016OUsyeWZ0UUN5aXp0VU9sRndNQTJVVmRaaDhJVWp4UDFtcytzRHpsaTBT?= =?utf-8?B?N3UrYnhlZFM0WE5xcUVjeHNTcXVjZU16a2RsNCthVmVjamlaL1M4cGJsQmJE?= =?utf-8?B?WkQ5SWxIS0lPSTJCOW1GWEkrSHB2QnJKeE5QWk45SFNCQWhmcUcxd011b2JM?= =?utf-8?B?SG9TdzRZVWZHaXJRdW9kWW91cmJ0c1NkeWlwUC9udzcveEM2d0pBSUhicURo?= =?utf-8?B?Q1dDMUtxOUJEY3h5a1FteTgxTUI5d0QrOENoVlBURWVQOW9YanI4ZmdEbXdD?= =?utf-8?B?NittS3RFVU9rS3B5Z2VKMlg2T3EzUW9WaytXbVVqZXUxVXMzYURVdmxPcldS?= =?utf-8?B?dzl1clhTVkFJay9aUkxqUDh5cUZDeFlhZGpITmtOWkxMUTMranVHdmdJY2hV?= =?utf-8?B?WG50QnZNQnVNaDArQTJEenEzT0dIcG9CK0FpaW1NNlQydnN1ZkpCbGYyK2hh?= =?utf-8?B?TmdCemIxVXJoc0tYL0E5WUdscUthdXRvUHVCZmFsYTNTajE0MEpRUlVtaXVS?= =?utf-8?B?V1d1cWJ5UWd0elVYT2h1Zk9BK1RDTnlvZm92VE5QVFVnRC9VNWNjVEFwVlA1?= =?utf-8?B?aFg4NmgxQ1FBSytqb1QyL0VBamV5c2lFb1d1YkFmakxLTktoSmJuTzRuQlUz?= =?utf-8?Q?OZG2YYvdkWUnFtapwSCltnwvL?= X-MS-Exchange-CrossTenant-Network-Message-Id: 24c7ce32-7661-4f62-768b-08ddb490f766 X-MS-Exchange-CrossTenant-AuthSource: DM4PR11MB6020.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 26 Jun 2025 09:08:07.9386 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: Eb9+XpgHulDN8nQv3LnnILpLTIzS0LicEVPUMj25o7wRXUOBeOyTUE/dXAlpgOYKvj5Dm8b90eMfCxfjEWT6tQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: IA1PR11MB6194 X-OriginatorOrg: intel.com X-Rspamd-Server: rspam03 X-Rspamd-Queue-Id: BCF57120013 X-Stat-Signature: uegbj5zcm6t66qiokmt5pfze6jibkz5d X-Rspam-User: X-HE-Tag: 1750928917-456980 X-HE-Meta: U2FsdGVkX1/2qafkrQ6OtgMPp+VgufSAsr768Mgxe6HYKy0gyZ0y5UEIYSEMiZlfdvaYGXHzHLazVwzkjXHxGThIwj56Z3eDGh0EJez54SdTg8LaOwIDmsxniTIkKrmvvUDrYSNOW7Jq1c60ClYkGNPeV9WDljHovY3ksmQ/ZHhXoVQBVMkJpe10mcyIFc1yVdFxDIknZsZe/D/C6B2E7oyAbHoNKLwX1FfWC59vFotnGeZjuONg9SiBVLqF21/i3GoEcEX7sWIESQEaD17bGpCc0l2OwXPH4cQEuCBAqgojOuJli0NP/llRawIFQU/bmOUBQ0fgRqfrUY1ksLNnt190mNJ/QqUgDSi4zhtOyjB5jsc7NAQC6fshAYo5P+388jHY1/9LmiSN60D5c6hlEVoZNmRirdnZVtoPG+lo+t6+Iq68dQCyHjrxaudAuPTFV6RgVEP9FSLjOyU6Eg2XagnQ5JYb4uJ+iHQgXTo7qjIJjD2AnVSwF6+/F1XDQ6q/YGPBUjaTmLzIzd7kcSRdRUZXKdZbWX0IuyFlf78+XobfLvGzro+LQLTLg5kvm0/LaL6vdqtP7NvtFftvyC9zImtjuevvVqi15jXNuEaO/ND2HyCI97VaKuRDHYC6Gcw4rUlkwrSBnQF5mDPXVS7XolSUsMnsi0tPrI2Ett2tZcBkPdVpMQKE+SaLmWDiWecn39lefyyOLNqWn411OqsRcPp+EDW/YJls3QQMC+PPnXUrmoJPI2cWdypz846TbcSsI62eEk/b75aL/nW5MsBPah308dZ2D4KMxaz05wn2ooytUXZmEF3Y901i2GXhzM5ukPp2GYmYn+CjtN7hizTqD+Zk9r7My+28bWsvRiv0/5J2FQE8JxGI/Nlh+ERjTPxBXZ4MjJP2efxnZPpZ8naSuhOzbC66D3h/4V6zf9qwLvX96IXRZXBJyLXcjAZhOckyQGRA/OvKGH+wWqE31Dd n/3Qn1kW /1NaT6HCs2ZWzUr1md/CD4AEbTjhXuDdSQDDrGOAIrzuLsPaBTPkO4IPvXu81Q6QF/Tp7DPlQWN89w/S0kyDFLqi5goVR3r9vq/FUmAtm2EhmzYhNj8KkYJFwdG6H0v3IZnGSeASSTxbelFs8h3ve+WOoEYu1WqfO7SAQOV1RpC1somokenZyWpBbXq25gA7Ue/aNia8uxUtLki8mOYnGyUmZKqlQIwra1/iKDDpPd+GLWsONpg/K5vz2yJUJeyDGoGij/f87bJ69u/NRzw3AoRjMp2O4NCtI5X19+17i98trx66bF+uIwqXm0uk9/FGa5YFXYOBXiCi0SzmiNzGOmnGRH8hMq4klxGEon0OesQPKr8JyzxoInjPM9h+O4amSQE3F1slbsBhojGDKUdlAmFUeEKgM8NTacd7G0W/dqlolUxUcAg2SBRPM+m0dWaWEjgfS6w1OE8Kpe7jK6tfMj1ORwBcReiaxSRbcFQ7GDjh9zKNLdk6BUfds4OjjrFZ/vuLxPlQEDEQ9f5aCVOPVcY73JPdm0TLXNOPrkCW3W+QnF3KN3vJODjCCiMJcG+8gk7wGxvY4hoCnftE= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: Hi Michal, Thanks for taking a look. On 6/25/2025 8:19 PM, Michal Koutný wrote: > On Wed, Jun 25, 2025 at 06:23:37PM +0800, Chen Yu wrote: >> [Problem Statement] >> Currently, NUMA balancing is configured system-wide. >> However, in some production environments, different >> cgroups may have varying requirements for NUMA balancing. >> Some cgroups are CPU-intensive, while others are >> memory-intensive. Some do not benefit from NUMA balancing >> due to the overhead associated with VMA scanning, while >> others prefer NUMA balancing as it helps improve memory >> locality. In this case, system-wide NUMA balancing is >> usually disabled to avoid causing regressions. >> >> [Proposal] >> Introduce a per-cgroup interface to enable NUMA balancing >> for specific cgroups. > > The balancing works with task granularity already and this new attribute > is not much of a resource to control. > Have you considered a per-task attribute? (sched_setattr(), prctl() or > similar) That one could be inherited and respective cgroups would be > seeded with a process with intended values. OK, the prctl approach should work. However, setting this attribute via cgroup might be more convenient for the userspace IMHO. The original requirement stems from cloud environments, where it's typically unacceptable to require applications to modify their code to add prctl(). Thus, the orchestration layer must handle this. For example, the initial process of the container needs adjustment. After consulting with cloud-native developers, I learned that containerd-shim-runc-v2 serves as the first process. Therefore, we may need to modify the containerd-shim-runc-v2 code to use prctl for the NUMA balancing attribute, allowing child processes to inherit the settings. While if it is per cgroup control, the user can just touch one sysfs item. > And cpuset could be > traditionally used to restrict the scope of balancing of such tasks. > > WDYT? > In some scenarios, cgroups serve as micro-service containers. They are not bound to any CPU sets and instead run freely on all online CPUs. These cgroups can be sensitive to CPU capacity, as well as NUMA locality (involving page migration and task migration). >> This interface is associated with the CPU subsystem, which >> does not support threaded subtrees, and close to CPU bandwidth >> control. > (??) does support > Ah yes, it supports threaded cgroup type. In this case, we might need to disable the per-cgroup NUMA balance for threaded cgroup type. >> The system administrator needs to set the NUMA balancing mode to >> NUMA_BALANCING_CGROUP=4 to enable this feature. When the system is in >> NUMA_BALANCING_CGROUP mode, NUMA balancing for all cgroups is disabled >> by default. After the administrator enables this feature for a >> specific cgroup, NUMA balancing for that cgroup is enabled. > > How much dynamic do you such changes to be? In relation to given > cgroup's/process's lifecycle. > I think it depends on the design. Starting from Kubernetes v1.33, there is a feature called "in-place Pod resize," which allows users to modify CPU and memory requests and limits for containers(via cgroup interfaces) in a running Pod — often without needing to restart the container. That said, if an admin wants to adjust NUMA balancing settings at runtime (after the monitor detects excessive remote NUMA memory access), using prctl might require iterating through each process in the cgroup and invoking prctl on them individually. thanks, Chenyu > Thanks, > Michal