From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mail-pl1-f179.google.com (mail-pl1-f179.google.com [209.85.214.179]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 7686C231A41 for ; Thu, 5 Feb 2026 05:18:18 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.214.179 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1770268698; cv=none; b=s16ObOQ3Fvv4peWf1b7L/OF2DUUmYXP3dpiNwR50Af6YKh3BO/GoP8MsADIuXEkzzUcm5XmYNKgWjhpkueTOSG42/LNZBscZuv/7VGeNSHp9iGeS+D1T43T/F4P73j9oe2uoyVBP04OPaTLZfATfjg7lsBh7www8TKeeVvSrqKM= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1770268698; c=relaxed/simple; bh=cEXuLehvBn+2pImWf1+z9xzVNDyIU3cr+ZH8w6I8KMg=; h=From:To:Cc:References:In-Reply-To:Subject:Date:Message-ID: MIME-Version:Content-Type; b=aU8/ckaYMpppW7r0xp2z+6zebH164Kl++dS/8JhXsLT/UytQ35m8X5ZRKOmP+oprWONbuAq8uvQtovBsouH3THZb1TtPfXNei5ho/EzJZVXvHhW0pH7t59n/dvp9i7X55XSXGCDRqruAAdRq5cKl/bizvZud8nofdC1pOE1kksk= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=telus.net; spf=pass smtp.mailfrom=telus.net; dkim=pass (2048-bit key) header.d=telus.net header.i=@telus.net header.b=byOnT5XJ; arc=none smtp.client-ip=209.85.214.179 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=telus.net Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=telus.net Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=telus.net header.i=@telus.net header.b="byOnT5XJ" Received: by mail-pl1-f179.google.com with SMTP id d9443c01a7336-2a102494058so8085625ad.0 for ; Wed, 04 Feb 2026 21:18:18 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=telus.net; s=google; t=1770268698; x=1770873498; darn=vger.kernel.org; h=thread-index:content-language:content-transfer-encoding :mime-version:message-id:date:subject:in-reply-to:references:cc:to :from:from:to:cc:subject:date:message-id:reply-to; bh=wFEsJmFyloDZYoxGCsVExINbvwTfq3ZujsW3cyOFjqk=; b=byOnT5XJGDXYkRHlySnP1FlCP+09+TFSHVxj1glxMEqYm123O+wuhOHLEWrEvK1f0O GJ38GAaXIqqtm5qSzFdwUQrhuOG4RJwrnKVCtLy1cMIbn0fbu4UhmS7m3w0ric95g0/I AlDMYfBuWKPMr9mAH55AQwBN5z9QShlv6utcB9xOgmqoDcqYmMqYAbgQHeltXje2MCRw 9GY5mg/MBnoVEWnvUxx9JzEgOVdidNgQXpWgIYf7ZkEHTqsEwlSnhPPT6eAQyQlXlSbk 2aIRD5F9ze6BNI+82BgpfgufLS2YI3NaXHLBzJmxEcyW8McJdsnyMT/TWpLgPMJaCt0d qzVQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1770268698; x=1770873498; h=thread-index:content-language:content-transfer-encoding :mime-version:message-id:date:subject:in-reply-to:references:cc:to :from:x-gm-gg:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=wFEsJmFyloDZYoxGCsVExINbvwTfq3ZujsW3cyOFjqk=; b=FleP3fONnvfvERak/bDx+TYNz0XVGeCGhRJ7kiPCPIq4A/qET/G+YbUge/9YuWtBNn yyfOtNCU9hCaO0fagk/SGHi4UBsqmmkVtcxC5bGcU9qBnrV345SlO7iutlmUY3+x0Pn/ ZOJhkZxHL/Qw9rsGhgD6zlj8Prou7wap7+gwmvytFZq2fd3144WYEXSqaE9koNtuA+NA p5MsSL9o31QMpVnq6b40JHUiQ682eDkipH9ZgLNj/TcAriadEUWTu318X+AvINNs0Ps6 JyPBLKj2SKBWBa96F6xj3vaOkoK/VhjGH9ig4M5Nq+2tzG7FoHY/268cgCT1HSphuf3J QDPg== X-Forwarded-Encrypted: i=1; AJvYcCVLKHM/MAmOLR8q4orlQm04uKBbZMpH9Jh6+dU1KcZ1Az8YDWyDOqgXwAk7oevG/XAu58wKrAw=@vger.kernel.org X-Gm-Message-State: AOJu0Yy4PEMjZVLlT4WPoFcyvRZGD0wVRvcsCpNK8UB/NaoV3iG6Yd3A 1xCkx4tIgiIdqjvKKRZERvVIq/KEIlwoik3zj6x+yACuiByJuPQF1vU2aLaGsIB2H3Q= X-Gm-Gg: AZuq6aJLQUf+uGaipYqF1Cr+KO83k6GOw8jTFKhHaooOZ9u3Ze0m3Pdv7oHmlk7WgTZ kZ+MHw/N4BQEBxaBvv2Is/i/GovfWcKfttP2Lo2PVG1Hc1JVdCQR9Eoasl+jlskxK7QRDVRJW3u DToVOWq92eK71CaNG3PYUpaZJIO9zoD7tm6OGmtWgVGYCaItbNhtwY+bTGnhaduId71AIAORm6n 9lO1YXWJzN8McSR7+OPMkJBOw9fcPaLTYA/JrFECWpqq0KjkfI7WbF/7ZjA0xN8l6tnSfub+P2Q b/N6W4kDfzcSOlXGrpvq4RSTsuCa//XmgRtcReu+TSoz89HqDUR8ssaPKbsRbbS64NSPlhmtp96 e/j5ml2kFn3HJrvxChYnykAxCNB/A1Usqev2NKrOrzDheAt6YFkaPTRUssDNYEiNx05VBcP8of5 TMB8sFs1Epy5ZlmWh8OY8CALbAp0uGLR2mKweMN23xq/R0/Se3akgjYyQ= X-Received: by 2002:a17:902:f650:b0:2a7:a1f3:f327 with SMTP id d9443c01a7336-2a9411991dfmr12853985ad.20.1770268697835; Wed, 04 Feb 2026 21:18:17 -0800 (PST) Received: from DougS18 (s66-183-142-209.bc.hsia.telus.net. [66.183.142.209]) by smtp.gmail.com with ESMTPSA id d9443c01a7336-2a933965c49sm37561315ad.72.2026.02.04.21.18.17 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 04 Feb 2026 21:18:17 -0800 (PST) From: "Doug Smythies" To: "'Sergey Senozhatsky'" Cc: "'Rafael J. Wysocki'" , "'Christian Loehle'" , "'Harshvardhan Jha'" , "'Sasha Levin'" , "'Greg Kroah-Hartman'" , , , "'Daniel Lezcano'" , "Doug Smythies" References: <004e01dc90b1$4b28f9e0$e17aeda0$@telus.net> <002601dc916e$6acbe650$4063b2f0$@telus.net> <3b0720d2-9b72-48d0-998a-1fd091cec44f@arm.com> <5d4b624c-f993-49aa-95ab-5f279f7f6599@oracle.com> <8fd5a9d4-e555-4db1-aa02-8fe5b8a2962c@arm.com> <3395ad0b-425e-40f5-844c-627cff471353@oracle.com> <3f0cfac2-b753-413c-9a7e-0892c23cdbf4@arm.com> <005401dc9638$b3e2ea40$1ba8bec0$@telus.net> In-Reply-To: Subject: RE: Performance regressions introduced via Revert "cpuidle: menu: Avoid discarding useful information" on 5.15 LTS Date: Wed, 4 Feb 2026 21:18:20 -0800 Message-ID: <006e01dc965e$d82c33e0$88849ba0$@telus.net> Precedence: bulk X-Mailing-List: stable@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Outlook 16.0 Content-Language: en-ca Thread-Index: AQFHdCyGI9ZGDCiLCETmSGOiCXX2eAI+s1WmAgYl0xoAoGj4UAIEsRd0AnUSn+MA+swQZwLLiiWuAOVzse4CJZtTtgJFWskbtgokIIA= On 2026.02.04 18:37 Sergey Senozhatsky wrote: > On (26/02/04 16:45), Doug Smythies wrote: >>>> What is "established" and "newer" for a stable kernel is quite handwavy >>>> IMO but even here Sergey's regression report is a clear data point... >>> >>> Which wasn't known at the time commit 85975daeaa4d went in. >>> >>>> Your report is only restoring 5.15 (and others) performance to 5.15 >>>> upstream-ish levels which is within the expectations of running a stable >>>> kernel. No doubt it's frustrating either way! >>> >>> That is a consequence of the time it takes for mainline changes to >>> propagate to distributions (Chrome OS in this particular case) at >>> which point they get tested on a wider range of systems. Until that >>> happens, it is not really guaranteed that the given change will stay >>> in. >>> >>> In this particular case, restoring commit 85975daeaa4d would cause the >>> same problems on the systems adversely affected by it to become >>> visible again and I don't think it would be fair to say "Too bad" to >>> the users of those systems. IMV, it cannot be restored without a way >>> to at least limit the adverse effect on performance. >> >> I have been going over the old emails and the turbostat data again and again >> and again. >> >> I still do not understand how to breakdown Sergey's results into its >> component contributions. I am certain there is power limit throttling >> during the test, but have no idea to much or how little it contributes to the >> differing results. >> >> I think more work is needed to fully understand Sergey's test results from October. >> I struggle with the dramatic test results difference of base=84.5 and revert=59.5 >> as being due to only the idle code changes. >> >> That is why I keep asking for a test to be done with the CPU clock frequency limited >> such that power limit throttling can not occur. I don't know what limit to use, but suggest >> 2.2 GHZ to start with. Capture turbostat data with the tests. And record the test results. > >> @Sergey: are you willing to do the test? > > I can run tests, not immediately, though, but within some reasonable > time frame. Thanks. > (I'll need some help with instructions/etc.) >From your turbostat data from October you are using the intel_pstate CPU frequency scaling driver and the powersave CPU frequency scaling governor and HWP enabled. Also your maximum CPU frequency is 3,300 MHz. To limit the maximum CPU frequency to around 2,200 MHz do: echo 67 |sudo tee /sys/devices/system/cpu/intel_pstate/max_perf_pct Then run the tests acquiring turbostat logs the same way you did in October. To restore the maximum CPU frequency afterwards do: echo 100 |sudo tee /sys/devices/system/cpu/intel_pstate/max_perf_pct