From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from desiato.infradead.org (desiato.infradead.org [90.155.92.199]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 8AF391B85D7 for ; Tue, 21 Jan 2025 08:49:15 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=90.155.92.199 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1737449357; cv=none; b=D13s5UPH4NX3zTncn5Y+xZkZX+lSkPkLQB+jGcSHtqKM7It8PQvpxPMNPy0FoVT73stOcikmjHAonD3ZZ/P9GPaeuhCrYxIsfGze5PeQLhJDRSPEhNJh2r4DBIz8YmLHLkd47gMAUn6T4RCNpcxaKtidRpPt4FaR0vVC6xME/xU= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1737449357; c=relaxed/simple; bh=fyNX1jR7gj+F7MDjTC3pAAoidgUeaOsyFSzA5P1/zsE=; h=Date:From:To:Cc:Subject:Message-ID:References:MIME-Version: Content-Type:Content-Disposition:In-Reply-To; b=A6r+uWa5wgMTq7R8xe+2+df7bK4o8yedhngWqYLOjeEHQRTYKifc9XAhEJa5b4F8BGyiWD3o1/9OeNY6G+hJ962kC5VHyI90Q9hH1QysRbJfe8+kOVE6JUsF6KNSJpO4X1MmIKdKOeTw26mZ7bRZ7S2ldnmtcMf6mWqyWUPd+0g= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=none (p=none dis=none) header.from=infradead.org; spf=none smtp.mailfrom=infradead.org; dkim=pass (2048-bit key) header.d=infradead.org header.i=@infradead.org header.b=AwHDZzPV; arc=none smtp.client-ip=90.155.92.199 Authentication-Results: smtp.subspace.kernel.org; dmarc=none (p=none dis=none) header.from=infradead.org Authentication-Results: smtp.subspace.kernel.org; spf=none smtp.mailfrom=infradead.org Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=infradead.org header.i=@infradead.org header.b="AwHDZzPV" DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=desiato.20200630; h=In-Reply-To:Content-Type:MIME-Version: References:Message-ID:Subject:Cc:To:From:Date:Sender:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description; bh=RzrKo44NNaVW8coRDVXcXg/Rb6nbQcStUzJnmUBzy/U=; b=AwHDZzPVt9sSmydFrEhbp7ysaT eMVuaGAnDesYhcu+5XUDQiJ9/qJ09frd9pCmGmhNR/Bgk8tG5ojR5zh8IFP9SBxfWj1l9FdvfdZxX DCMDJRlAd3z2OLe5tRCN3ebnLQ4ZzqpgPezfnUSHXx/3camwikGvut6jAnu2eec3MGIQeMR5rgtpB 4OBuzBZ1GwV0N+673FqTQtvuqMgq/y7YIHSURCoSWEBI041n5qo2QzJL+g4o+ncfQwjk9kOXlXos0 Pk3ZD+8DrWN8571Ll/p5WrJ8YoYy/kOU9oohtC+egR8O/b7SmsAvrOG5WRCCxQp/amE5ICqbyOG8C ScgR/cWA==; Received: from 77-249-17-89.cable.dynamic.v4.ziggo.nl ([77.249.17.89] helo=noisy.programming.kicks-ass.net) by desiato.infradead.org with esmtpsa (Exim 4.98 #2 (Red Hat Linux)) id 1ta9wb-0000000DE2C-47Yb; Tue, 21 Jan 2025 08:49:10 +0000 Received: by noisy.programming.kicks-ass.net (Postfix, from userid 1000) id C1B20300619; Tue, 21 Jan 2025 09:49:08 +0100 (CET) Date: Tue, 21 Jan 2025 09:49:08 +0100 From: Peter Zijlstra To: Doug Smythies Cc: linux-kernel@vger.kernel.org, vincent.guittot@linaro.org, 'Ingo Molnar' , wuyun.abel@bytedance.com Subject: Re: [REGRESSION] Re: [PATCH 00/24] Complete EEVDF Message-ID: <20250121084908.GD8603@noisy.programming.kicks-ass.net> References: <001501db618c$67bd8170$37388450$@telus.net> <20250108131205.GO20870@noisy.programming.kicks-ass.net> <001b01db61e4$c3ce5a40$4b6b0ec0$@telus.net> <20250109105959.GA2981@noisy.programming.kicks-ass.net> <002f01db631d$d265a600$7730f200$@telus.net> <20250110115720.GA17405@noisy.programming.kicks-ass.net> <00c201db6547$b43b9a50$1cb2cef0$@telus.net> <20250113110312.GD5388@noisy.programming.kicks-ass.net> <20250114105847.GC8385@noisy.programming.kicks-ass.net> <004901db6a06$59b12050$0d1360f0$@telus.net> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <004901db6a06$59b12050$0d1360f0$@telus.net> On Sat, Jan 18, 2025 at 04:09:02PM -0800, Doug Smythies wrote: > Hi Peter, > > An update. > > On 2025.01.14 02:59 Peter Zijlstra wrote: > > On Mon, Jan 13, 2025 at 12:03:12PM +0100, Peter Zijlstra wrote: > >> On Sun, Jan 12, 2025 at 03:14:17PM -0800, Doug Smythies wrote: > > >>> means that there were 19 occurrences of turbostat interval times > >>> between 1.016 and 1.016999 seconds. > >> > >> OK, let me lower my threshold to 10ms and change the turbostat > >> invocation -- see if I can catch me some wabbits :-) > > > > I've had it run overnight and have not caught a single >10ms event :-( > > Okay, so both you and I have many many hours of testing and > never see >= 10ms in that area of the turbostat code anymore. Hehe, yeah, I actually had it run for 3 solid days in the end. > The lingering >= 10ms (but I have never seen more than 25 ms) > is outside of that timing. As previously reported, I thought it might > be in the sampling interval sleep step, but I did a bunch of testing > and it doesn't appear to be there. That leaves: > > delta_platform(&platform_counters_even, &platform_counters_odd); > compute_average(ODD_COUNTERS); > format_all_counters(ODD_COUNTERS); > flush_output_stdout(); > > I modified your tracing trigger thing in turbostat to this: Shiny! What turbostat invocation do I use? I think the last I had was: tools/power/x86/turbostat/turbostat --quiet --show Busy%,IRQ,Time_Of_Day_Seconds,CPU,usec --interval 1 I've started a new run of yes-vs-turbostate with the modified trigger condition. Lets see what pops out.