From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mgamail.intel.com (mgamail.intel.com [198.175.65.18]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 40FA7EC4 for ; Wed, 9 Jul 2025 00:50:32 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=198.175.65.18 ARC-Seal:i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1752022233; cv=fail; b=jpe7Q2oDwsAkoNUY6Y3W1/gjaxeAPpKTysSpw1eip3kAb9DDg5S8IR2aO6QYRRmAVbOvfhZn2ibapafnpfD+qaDf9UM0qZFz5xBmR5puJa6dNvDSrjdveDqPf0ePtHQHi0xCA5mYo+J406TvxwO//zDbC84FQ9wz8/dYu1kAj3o= ARC-Message-Signature:i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1752022233; c=relaxed/simple; bh=h3OoZeTJnbUJUxwJwJfqMy/3A5n7Ams5KsS54nomeOQ=; h=Message-ID:Date:Subject:From:To:CC:References:In-Reply-To: Content-Type:MIME-Version; b=igvktz9TXDIHzqqD1RorfwnnV57L2OUUXMoFO19L8lkRw3yCS0ii0+gp/Bu9dJQXa/tNkebB5MvZj2/27VLPxhjCEpPDmnPdBsM3ChTaUINyZKJV9oLksKApemoPoBtDtilG7Omr/TVYSBKAk9FpJK8i3BIv3UFe8GyK/O/ns/8= ARC-Authentication-Results:i=2; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=intel.com; spf=pass smtp.mailfrom=intel.com; dkim=pass (2048-bit key) header.d=intel.com header.i=@intel.com header.b=DjZI6wkx; arc=fail smtp.client-ip=198.175.65.18 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=intel.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=intel.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=intel.com header.i=@intel.com header.b="DjZI6wkx" DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1752022232; x=1783558232; h=message-id:date:subject:from:to:cc:references: in-reply-to:mime-version; bh=h3OoZeTJnbUJUxwJwJfqMy/3A5n7Ams5KsS54nomeOQ=; b=DjZI6wkxXMe0DVPmuv4Cc8Z/7cykWsVWq51G2+xvgxJQBXmbFPX3GEBj VYJCtlz9gVQHF1F3ikHkKTnHtebGW7Wye1iPo2EtmnA6JXLk1Hv0Rc5OZ 0EsxhyIVasBLloffch48nFioCdGrg4eAmvTbJMn2PtPGZTVnruTCXIY9d e25iMEHJlWzg/dwhduN/uQn0IAJFYLcs9YZa5bimQjSLS4R/xz/0B1Qvw WS/15mFbsNyA0j5xhLjg3G8yq3yrVfsD8ZuWTxq4w/6EM0XxQWoYk1Zsl D2o2fs13RP4CMpo+eeXw+OdAd5IDCVsvZIQXK48ohucNt4HCDM81+NS/O g==; X-CSE-ConnectionGUID: DWsnfXqtSWycfRTWZp++hg== X-CSE-MsgGUID: EAc99fk1QEW1RtRH1W2wpw== X-IronPort-AV: E=McAfee;i="6800,10657,11487"; a="54403419" X-IronPort-AV: E=Sophos;i="6.16,298,1744095600"; d="asc'?scan'208";a="54403419" Received: from orviesa009.jf.intel.com ([10.64.159.149]) by orvoesa110.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 08 Jul 2025 17:50:31 -0700 X-CSE-ConnectionGUID: MC2oJgsgSdmC///ZzH5clQ== X-CSE-MsgGUID: tGuCMijzRwOkbxMW8yf3aQ== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="6.16,298,1744095600"; d="asc'?scan'208";a="155367707" Received: from orsmsx902.amr.corp.intel.com ([10.22.229.24]) by orviesa009.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 08 Jul 2025 17:50:32 -0700 Received: from ORSMSX902.amr.corp.intel.com (10.22.229.24) by ORSMSX902.amr.corp.intel.com (10.22.229.24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1544.25; Tue, 8 Jul 2025 17:50:31 -0700 Received: from ORSEDG903.ED.cps.intel.com (10.7.248.13) by ORSMSX902.amr.corp.intel.com (10.22.229.24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1544.25 via Frontend Transport; Tue, 8 Jul 2025 17:50:31 -0700 Received: from NAM11-BN8-obe.outbound.protection.outlook.com (40.107.236.59) by edgegateway.intel.com (134.134.137.113) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1544.25; Tue, 8 Jul 2025 17:50:30 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=UkmcrmDPBwgDL5Mc8WGZnsHvjH0zvbA0mN4RbAxQMQXHkzxjzligDq2EjTwI/JOjsB31vjXvwXSAcYf+I2KGgvKOqbSsY9tENtcSKHBC2zetguwFENlzaiLAnjJP/ncX5AngjQFeym5cE0T/zTFaZ+H1heW7ODWHDC6DlA5OrwE6LvnmuBW4o2l+GWic19+A94aWPiwM/q33jMpyNW/JnZfYNZCXIjbtZIo5yXFtKhKjie8CrGb3T5VsBGayMOuqrllPejF+vzmEc2LkH2FMZ+pnMleX3bIyqCbGhWbrj+Bd1OKOiIOPh1O/pBG3nDupNYoDEgwzK56CSrIDMjAaxA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=h3OoZeTJnbUJUxwJwJfqMy/3A5n7Ams5KsS54nomeOQ=; b=sFYEkUqCNRQpmPaE7wl+c9UwuMYNvSUuC1TeUYdy/ks+JbLn58SwK4MzYeCE6C88SAmIEbwYlkZUbvdHY7WsY+XAU2oJxZQkVDRh+l0jGuszDuuawX9ahbojx65GqaL5c7eP/dfm3RcsnIacK/hbFTVC7c62DTiolMKAyafZSN08rTLnuJE9ObvZQiwKUArRD45+DLBnmsdzDrJhxfDnNC9XCt1l3zbC48MLBuYvFAi2oNod6banx0dxYNngy5SXzYjCjEjQ230RZnDq/1tJQr8DNnPRyELq9uTH8YgZQrZViiRUwnNjScUGXcYPXGvahDX47VykWbdcOLZtrOZWdA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=intel.com; Received: from CO1PR11MB5089.namprd11.prod.outlook.com (2603:10b6:303:9b::16) by IA0PR11MB7882.namprd11.prod.outlook.com (2603:10b6:208:40f::10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8901.27; Wed, 9 Jul 2025 00:50:27 +0000 Received: from CO1PR11MB5089.namprd11.prod.outlook.com ([fe80::81f7:c6c0:ca43:11c3]) by CO1PR11MB5089.namprd11.prod.outlook.com ([fe80::81f7:c6c0:ca43:11c3%5]) with mapi id 15.20.8901.024; Wed, 9 Jul 2025 00:50:27 +0000 Message-ID: Date: Tue, 8 Jul 2025 17:50:23 -0700 User-Agent: Mozilla Thunderbird Subject: Re: [Intel-wired-lan] Increased memory usage on NUMA nodes with ICE driver after upgrade to 6.13.y (regression in commit 492a044508ad) From: Jacob Keller To: Jaroslav Pulchart CC: Maciej Fijalkowski , Jakub Kicinski , Przemek Kitszel , "intel-wired-lan@lists.osuosl.org" , "Damato, Joe" , "netdev@vger.kernel.org" , "Nguyen, Anthony L" , Michal Swiatkowski , "Czapnik, Lukasz" , "Dumazet, Eric" , "Zaki, Ahmed" , Martin Karsten , "Igor Raits" , Daniel Secik , "Zdenek Pesek" References: <08fae312-2e3e-4622-94ab-7960accc8008@intel.com> <366dbe9f-af4d-48ec-879e-1ac54cd5f3b6@intel.com> <252667f3-47b2-4d1f-86d6-c34ba43a6d47@intel.com> Content-Language: en-US Autocrypt: addr=jacob.e.keller@intel.com; keydata= xjMEaFx9ShYJKwYBBAHaRw8BAQdAE+TQsi9s60VNWijGeBIKU6hsXLwMt/JY9ni1wnsVd7nN J0phY29iIEtlbGxlciA8amFjb2IuZS5rZWxsZXJAaW50ZWwuY29tPsKTBBMWCgA7FiEEIEBU qdczkFYq7EMeapZdPm8PKOgFAmhcfUoCGwMFCwkIBwICIgIGFQoJCAsCBBYCAwECHgcCF4AA CgkQapZdPm8PKOiZAAEA4UV0uM2PhFAw+tlK81gP+fgRqBVYlhmMyroXadv0lH4BAIf4jLxI UPEL4+zzp4ekaw8IyFz+mRMUBaS2l+cpoBUBzjgEaFx9ShIKKwYBBAGXVQEFAQEHQF386lYe MPZBiQHGXwjbBWS5OMBems5rgajcBMKc4W4aAwEIB8J4BBgWCgAgFiEEIEBUqdczkFYq7EMe apZdPm8PKOgFAmhcfUoCGwwACgkQapZdPm8PKOjbUQD+MsPBANqBUiNt+7w0dC73R6UcQzbg cFx4Yvms6cJjeD4BAKf193xbq7W3T7r9BdfTw6HRFYDiHXgkyoc/2Q4/T+8H In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="------------ojVJDDYBbyvl0r81ShAMXUsc" X-ClientProxiedBy: MW2PR16CA0071.namprd16.prod.outlook.com (2603:10b6:907:1::48) To CO1PR11MB5089.namprd11.prod.outlook.com (2603:10b6:303:9b::16) Precedence: bulk X-Mailing-List: netdev@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: CO1PR11MB5089:EE_|IA0PR11MB7882:EE_ X-MS-Office365-Filtering-Correlation-Id: 11cc8220-eb50-47ea-08ea-08ddbe829839 X-LD-Processed: 46c98d88-e344-4ed4-8496-4ed7712e255d,ExtAddr X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|366016|1800799024|7416014|376014; X-Microsoft-Antispam-Message-Info: =?utf-8?B?UWtBUnZPTFM4SE1MRkhTc1JoZmNEWFlGQnQ5YnF0clJGczlaNEtlc3BBSi85?= =?utf-8?B?a21DeW8reFAvZUdlcXBLWi96YkVaazg4bTFIOHdmNDZUMkhscVYrZDVZM0cx?= =?utf-8?B?MTJxUjEyVUpOWDVGcFRFNmkrbnlkR2FQRGpvdG1UanhCakNZUUR6SDFGbWFq?= =?utf-8?B?M1lCcW9UcWQ2dE82N2ZJWUlCNzEyek5rdXZDd3hsMDFOa21TRWkySzd1MFhS?= =?utf-8?B?QTFSVE44WkxjUmxzWlUxK3JMV1JBUHRRcDJveDhKS25zajdyN1hLbUoza2Nk?= =?utf-8?B?VDhYNVA0SUpDZzdmZG9MRWZ0QzJQNElEMW5FanpWVWg1amtVV0VpOVorRGgw?= =?utf-8?B?MTlNa09hR0NrcU9Gd0M3MFpYVktpZWtoQ1FTSVRYVEJRMzgxUEJoQVFIcjF1?= =?utf-8?B?SSt1WEVxa1ErUkFhMWdDK1F6V1lnbzE0clErZkJkd3B4c1pBV2NscGtuWjFa?= =?utf-8?B?dFhnejM2dGd4OHZRd0UyamVJQ1RMRGlxcktGclF4eEJwb0tjNzc3dmY4QW5h?= =?utf-8?B?RkFJbVhET29jTTBtbFJkUld4VW52WUtRZjE0bjU0UWNCZDg3UUEzWGpSVGJa?= =?utf-8?B?TU9qem40cXoxTC9qVUNoVlpvSDlITVEyUGptaWhBNE1zSk4xQkw1MlBjMy9X?= =?utf-8?B?eVpSRVY0QXhxc3N5NGFLaWpPQlJIQjBKeS94OTdIb2FCNHBERlVnVHBGaVFC?= =?utf-8?B?bGIwR0NuQmpWdzlaNjlsRVJ3QjU3N0QzYTJ6ZjhvTWdqRnpiUi9PQk1sSzA0?= =?utf-8?B?V2syZzFUTFVCMStqb09zcld0VHRQUmVXNnpXdlI1Y3ByRkJJa2xhTno0bjJl?= =?utf-8?B?d1ZHa1luMEJ3ZmJqSm02ZEU2emFIVjZPb2pzZVp0VFRFRStvUEdpbnkyMVZs?= =?utf-8?B?WHJlRksxWEdDNjlkUFMzckNqZmlnL01PVk5ZZGQwdHNNaDVDSGhKbnF1eXg5?= =?utf-8?B?dnh4NEtpZWxMK1haWnRHTDVmSWxxcWk2bkgyRERIS2ZNcHoyNFRWS3A1bGhk?= =?utf-8?B?UEpTRXhabUJXN0lmeDVJUVo1MGtVVWpEbS9HK2grbjdGcHdFMXkySVNkY0dN?= =?utf-8?B?Yng2alZFR3FQYTZQS1dNakZrYTdnT3UwZkNZbDI3MU1adlFHb0FnRU5mZTM3?= =?utf-8?B?NnJxVmFTamN1RmVvcFhKNUF6UFVJVnhmcWkrNWdOTkdDeDh5L1V1R2NBT25y?= =?utf-8?B?NUExYmhqQ2NKVDRRS3hhelQ5MDM5NXJKb0NCb1JnOUhFWWxNWVd0VTA4YzZZ?= =?utf-8?B?Y0JDV3Bhc0RsVUp4c016WEQ5R3FjVHlQMXJqaWNJMDRRNkY0amxxZDAzRzkv?= =?utf-8?B?cXZGVEtPb3Fib1p4MkVSbGFxMEowc3YvUnRKVk0zRmc5K0sybjZDbURyQU44?= =?utf-8?B?YlVCTXpzeTJlNDNkcHhvOTNFZTlVaCtNaU1yTURuR2VjRDVtMzNBa1d5Vytu?= =?utf-8?B?Y0t4NVFkcTg5Y3B6K1FsR3BMTGM2ZGpOVEMxL01iUUpiZUxlaXJWM2tLdDFH?= =?utf-8?B?TTVyYSt5T3dEdXNXUThVc1czWEQzOVhUVTJpRW10M21aVmErZk9aeGtHMU1N?= =?utf-8?B?WXBCd3MwOE9WUGs4cm8rZG44bnRrdTZYTHJpNzNnMC9vbjk4T1pIbVlIeENt?= =?utf-8?B?Snp1Y3pXcVl2Q3BGOENsWTJ6djhmQjg2NG5kSEw4L0lLS2VmWm14bjBQeHFw?= =?utf-8?B?ZzBvZWJqdFkrUVAzSG9UMzNKSkc4bzNvOExpYzBqN1AwUXFhU2JzL210R2ZF?= =?utf-8?B?RWxoUXVpVUw1Tmw4NDJYbHpZOE5hUG95dVI3VWZ5WUhaeW1vclB6SWxWNHlj?= =?utf-8?B?L0F0eVgxdU5WbWpmNGJtalRXSEVlWnNRR1pmSDFDSHRJckl0OU9Ub2REOUxn?= =?utf-8?B?T0FzMXhxQ0hpOTVjZkE5QTdqTzRVYkRQTkNIbC91ZklwR3RhYnRYa2cyK3ly?= =?utf-8?Q?Fha1E0ddxZo=3D?= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:CO1PR11MB5089.namprd11.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(366016)(1800799024)(7416014)(376014);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?UjAzL3JzM1FYaTFzYzVhSVgyTGlkWFdZQnpzWHBzdzBQTXZYYllSNjRNSVVn?= =?utf-8?B?SzIrcVJZRnBsMWUrdHlNOUdxR0VhekFDZGRibUZwRGRXdmw0ZWpVN1ZrTEl2?= =?utf-8?B?bUl1Ui95OVRYcHFBUlVSWHBlaUoxVloxRlJXeVpBTHlSTExoaStYS2huRDFv?= =?utf-8?B?MWxDK3BDaE9Uc0Z2RGdRL2FPdldTaURyajd0Wk9ReVcybWN1cS9nNzQ1QkFS?= =?utf-8?B?c0ozUWFUTkRCY2tyby9aeUJIdHdyN0tkUS9COGhXUmFRWUZaTzZGckFMclVE?= =?utf-8?B?aUg2MVZJdm91SUpTYlZPdmdyOVZHd0Q1QXBpTEdKRVdIN2dsUkVZcWtZS0lN?= =?utf-8?B?d0lZTldmSGtWOWQwc0Rlc3ZPdlN6c0ExZjdkcTU5OEZOc2pOTHFGZmdWT3o1?= =?utf-8?B?YVZOUWlDdi81cEQ1TVZYYXpGSjFpbE51emNvUjhKWVF0MGRDdlJnYkxTa3A5?= =?utf-8?B?eVBCVnZtZUMxOFFOTnVYc2xFanhtRGdRVVBaRGF6RkhZQ0FQckM1cStVL1Ny?= =?utf-8?B?cW1nMlozUHE2NVBINjlXaGJ5dnF6L2pGejJyaEQzOWI1UjA4REVQWUVianZs?= =?utf-8?B?Y3lydzQ1eUd6N3hZZStnNXVvMWZ3clNXYlVUL3dWM09wOVg3cGQ3OWpYT0gr?= =?utf-8?B?cytUVEk3d1FFUkJxMk10MFQrNndsbVp3YWQrc0o1RmpMaEp1T1dkclF6Tm1J?= =?utf-8?B?RjdQeDFNVjBnU1RHQWxPM3RJSUZQME1Pc3FtdTVoWXYrTkcvNkNHc2htRXNM?= =?utf-8?B?ZHYybUc0TGJ2Yyt3ZGRBVGlVRVEvU3ErN3QrQjR5Vm1xRXcvVUo0aXZnZmhK?= =?utf-8?B?dzZaa1Ivb3JWYjlyOGh6MUxKbXMxV0FnQnpyNXVCeXZCZlEvcUVadDFZYkli?= =?utf-8?B?Zk1PRE1zTHZNNXVyODYxdWZhUFFlM0RVTXBaRTRhaTJGV0xJVlVBME12S3Ez?= =?utf-8?B?NnJzdm9qWHlDSVpsSW9Zd29vRUdzWDBwKzlMRDdxYi8zc3JLRWIvVVd0VExj?= =?utf-8?B?cTNYSHJnMi9qc1c2eW1qNEc1MTRvZ0tyOGlHMmVtZkVLRDhOdWJteFY0SG4r?= =?utf-8?B?a0ZtVS9lR3NUejNVSi9UMi9CTXhHOCtmTm1kVVNKWkRBYndFOU81bUFDQU1Q?= =?utf-8?B?dndwQ1VFUTNXM1ZSV0Fkc3VxTlNUQmQ3dXRjdXRRSkllQy84VEgrNGY1cWJH?= =?utf-8?B?UW5xamtSeThTZGh5ems2bmZPTnJoN1JkUUI2cmNxc3RVcEhoR0lmV2g1SjZM?= =?utf-8?B?aUJTQWN5WmUwczdhRGRUUHRMK2dyRlhYV0pKa3dyVzJyc2g0OHN2KzJwZlla?= =?utf-8?B?VmNyWnRxYWxkcGh3bkFUSmk4SEJSYkpaS1ZuNjIzcTkrbXUvVFZHOFBGUmZC?= =?utf-8?B?MXpDdkRTKzE2K2NpQzRYd0J4TjZmWHdrb1ZhNkU4dXRtZ2oxcE5GM2V6V0Ft?= =?utf-8?B?bTE2cGNNc0h6NVFQdG5jSUgvVE1qRlYzcVZtWUNUWEN4Wk1SUURBVVpJSU9y?= =?utf-8?B?dUZhNUlqVEtiS0VtdllYeGFPTFo3aWJhWXNheWRxc2hZTTJ4ekRTMUtJUEJT?= =?utf-8?B?NW9EVEgvbXIvUWtzZkhmeWl3cmtDL0NLQUlHVUR0cVhFYnA5c09VOHE4OUFG?= =?utf-8?B?UlFqL2FQVUVYa21HY2FiYlVTUE53QzdEYU9NQTBwbXBKdXJHU0JneVJ6RHc2?= =?utf-8?B?ZzNiRUJoNnhIRTlBdVhSQW1ILzdMWFFZbXJjdGxuaWZKR2FodkVvbGNCYXdC?= =?utf-8?B?MjhETEhHMkluaGZNWUNqR0JqVlJBbklWLzVxVE1zUzBCV2Z4dHc0enA4SnUx?= =?utf-8?B?Z0NIVTFndmc0MGNqc0lHNEZaNHA3N1VNVmVwLzVIenRXTWdOQURPOHRIMEkx?= =?utf-8?B?VEhsajh5VWNpMHZhclJzVE9XN3FYUXVGeDN4TWdEV1l1MjEzVUJLdmo2S1Zn?= =?utf-8?B?MUNpN21ZaTJsY1JkZWx3emVlWGJEM2hRRERTMWg3UmhKalMxZ1IySUVLejhX?= =?utf-8?B?bFZPZVFPLzdpcDgxQlFZTEFKNWNYN2JjQkFqNXoxTWgvTzUwelpFQ1dpOHVL?= =?utf-8?B?aThUcVJqMDhBSHBSWlQrVk9RSHJ3eHlQbFVoVU9oZG1MSGF3cEtkajhqOWp3?= =?utf-8?B?bEtOTkFGYmsxelZ5SWFaeHlJSE9iRkd2UmVFaWdFWDE4WXF5YjlVRk9XWStB?= =?utf-8?B?Y3c9PQ==?= X-MS-Exchange-CrossTenant-Network-Message-Id: 11cc8220-eb50-47ea-08ea-08ddbe829839 X-MS-Exchange-CrossTenant-AuthSource: CO1PR11MB5089.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 09 Jul 2025 00:50:26.9542 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: vaVZODRR0VLwUQGgh0lrUaXKcjSJEqOOrgsb8EOg//Zg4H/grv589lkIemJ39cxeDkI7fKO5Nf80g6GNVHZz8rdgHBBO2nryah/GqvtjZ7M= X-MS-Exchange-Transport-CrossTenantHeadersStamped: IA0PR11MB7882 X-OriginatorOrg: intel.com --------------ojVJDDYBbyvl0r81ShAMXUsc Content-Type: multipart/mixed; boundary="------------kNlAxPnNOGb9XrM3qAb0hvc6"; protected-headers="v1" From: Jacob Keller To: Jaroslav Pulchart Cc: Maciej Fijalkowski , Jakub Kicinski , Przemek Kitszel , "intel-wired-lan@lists.osuosl.org" , "Damato, Joe" , "netdev@vger.kernel.org" , "Nguyen, Anthony L" , Michal Swiatkowski , "Czapnik, Lukasz" , "Dumazet, Eric" , "Zaki, Ahmed" , Martin Karsten , Igor Raits , Daniel Secik , Zdenek Pesek Message-ID: Subject: Re: [Intel-wired-lan] Increased memory usage on NUMA nodes with ICE driver after upgrade to 6.13.y (regression in commit 492a044508ad) References: <20250625132545.1772c6ab@kernel.org> <08fae312-2e3e-4622-94ab-7960accc8008@intel.com> <366dbe9f-af4d-48ec-879e-1ac54cd5f3b6@intel.com> <252667f3-47b2-4d1f-86d6-c34ba43a6d47@intel.com> In-Reply-To: --------------kNlAxPnNOGb9XrM3qAb0hvc6 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable On 7/7/2025 3:03 PM, Jacob Keller wrote: > Bad news: my hypothesis was incorrect. >=20 > Good news: I can immediately see the problem if I set MTU to 9K and > start an iperf3 session and just watch the count of allocations from > ice_alloc_mapped_pages(). It goes up consistently, so I can quickly tel= l > if a change is helping. >=20 > I ported the stats from i40e for tracking the page allocations, and I > can see that we're allocating new pages despite not actually performing= > releases. >=20 > I don't yet have a good understanding of what causes this, and the logi= c > in ice is pretty hard to track... >=20 > I'm going to try the page pool patches myself to see if this test bed > triggers the same problems. Unfortunately I think I need someone else > with more experience with the hotpath code to help figure out whats > going wrong here... I believe I have isolated this and figured out the issue: With 9K MTU, sometimes the hardware posts a multi-buffer frame with an extra descriptor that has a size of 0 bytes with no data in it. When this happens, our logic for tracking buffers fails to free this buffer. We then later overwrite the page because we failed to either free or re-use the page, and our overwriting logic doesn't verify this. I will have a fix with a more detailed description posted tomorrow. --------------kNlAxPnNOGb9XrM3qAb0hvc6-- --------------ojVJDDYBbyvl0r81ShAMXUsc Content-Type: application/pgp-signature; name="OpenPGP_signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="OpenPGP_signature.asc" -----BEGIN PGP SIGNATURE----- wnsEABYIACMWIQQgQFSp1zOQVirsQx5qll0+bw8o6AUCaG28zwUDAAAAAAAKCRBqll0+bw8o6CvA AQCt/Qw80vmB1iPjuxn3xf74fcyPYv9Fg34MiU6NaKVdcAEAlSIqzxQvrlCOpuwwKGFNFUuyGluJ VwLvFvAzrVoncQM= =ChyH -----END PGP SIGNATURE----- --------------ojVJDDYBbyvl0r81ShAMXUsc--