From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from desiato.infradead.org (desiato.infradead.org [90.155.92.199]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 130181F5438 for ; Tue, 7 Jan 2025 19:23:44 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=90.155.92.199 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1736277826; cv=none; b=DSujIzcS4ynxGkGlhSeGhpm6ZuW0zUTwrIIh1h6O6wWZxu77ANJSLsSL1bBoJnM2n6teMn2kavSfeIMgZvo1XOljEjRBNq/Llk/CGDC2XxN0Lb7bT3PQn3ioEJeRrTf3dDPkoON9tiuRIF81/QAHpUwxiblbx6tSfwZcqXzEBrY= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1736277826; c=relaxed/simple; bh=4qbbKNSgKvCZWW6Bww4yzMGoT8pJkKQaoA7OfzNKB+w=; h=Date:From:To:Cc:Subject:Message-ID:References:MIME-Version: Content-Type:Content-Disposition:In-Reply-To; b=EVIMmZkMhFE8uP+z2H0W3ToprMzl0NSiRgPxMmt109Au+n1LVqjoLIyp7P1qvUxTPKkpopCBj7HZwvtBhznaYkgZ6itEkmfACh+YvViYh44e/J6Jsg5Gbn7lY1H0+EEeRil/IsFegOP2dQzlfxRgcXoiiNZVP8uqGL/m8ilS3fQ= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=none (p=none dis=none) header.from=infradead.org; spf=none smtp.mailfrom=infradead.org; dkim=pass (2048-bit key) header.d=infradead.org header.i=@infradead.org header.b=rSRHOX+J; arc=none smtp.client-ip=90.155.92.199 Authentication-Results: smtp.subspace.kernel.org; dmarc=none (p=none dis=none) header.from=infradead.org Authentication-Results: smtp.subspace.kernel.org; spf=none smtp.mailfrom=infradead.org Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=infradead.org header.i=@infradead.org header.b="rSRHOX+J" DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=desiato.20200630; h=In-Reply-To:Content-Type:MIME-Version: References:Message-ID:Subject:Cc:To:From:Date:Sender:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description; bh=0xMU2DNH60Ch3qBfzHc+wk8OUABjj3m53uRbRIyHkwU=; b=rSRHOX+JHf9gkfVfN/t2JHh9eZ G6EwaB4yogZOibQ3gyH61A28ATKrwWMeYtaLTE9+O6KEeVvksAqiUmUIuK1PSj+SIPIsL7TZCR0N4 42QCc/qJjAojij2y8ijGSo3yYuykiQrmJHAFMVMZFcC6MkP+rrDgNB7j0eumeRZGLZCEgoMjgb2sf 18osE1OvAeGrpwLNgepQENfOD6dEm1aNckKGb2Gvnbowzu3T5esG1ezkpusmquPyoOrTIQOPaZq9s isEATw6W+r/p555hjY3XHegot169aOA2wJwsKvuBM7zJ7nNV48FIiKTqJLWuHrvWHGo3hyNVenI+E 3gBaQdSg==; Received: from 77-249-17-89.cable.dynamic.v4.ziggo.nl ([77.249.17.89] helo=noisy.programming.kicks-ass.net) by desiato.infradead.org with esmtpsa (Exim 4.98 #2 (Red Hat Linux)) id 1tVFAz-00000009C0s-0nHE; Tue, 07 Jan 2025 19:23:42 +0000 Received: by noisy.programming.kicks-ass.net (Postfix, from userid 1000) id AEDC730057A; Tue, 7 Jan 2025 20:23:40 +0100 (CET) Date: Tue, 7 Jan 2025 20:23:40 +0100 From: Peter Zijlstra To: Doug Smythies Cc: linux-kernel@vger.kernel.org, vincent.guittot@linaro.org Subject: Re: [REGRESSION] Re: [PATCH 00/24] Complete EEVDF Message-ID: <20250107192340.GB36003@noisy.programming.kicks-ass.net> References: <005f01db5a44$3bb698e0$b323caa0$@telus.net> <20250106115732.GE20870@noisy.programming.kicks-ass.net> <000801db604b$e0f6b580$a2e42080$@telus.net> <20250106165932.GG20870@noisy.programming.kicks-ass.net> <20250106170455.GB22191@noisy.programming.kicks-ass.net> <001b01db608a$56d3dc40$047b94c0$@telus.net> <20250107112606.GN20870@noisy.programming.kicks-ass.net> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20250107112606.GN20870@noisy.programming.kicks-ass.net> On Tue, Jan 07, 2025 at 12:26:07PM +0100, Peter Zijlstra wrote: > So I've taken the second node offline, running with 10 cores (20 > threads) now. > > usec Time_Of_Day_Seconds CPU Busy% IRQ > 106783 1736248404.951438 - 100.00 20119 > 46 1736248404.844701 0 100.00 1005 > 41 1736248404.844742 20 100.00 1007 > 42 1736248404.844784 1 100.00 1005 > 40 1736248404.844824 21 100.00 1006 > 41 1736248404.844865 2 100.00 1005 > 40 1736248404.844905 22 100.00 1006 > 41 1736248404.844946 3 100.00 1006 > 40 1736248404.844986 23 100.00 1005 > 41 1736248404.845027 4 100.00 1005 > 40 1736248404.845067 24 100.00 1006 > 41 1736248404.845108 5 100.00 1011 > 40 1736248404.845149 25 100.00 1005 > 41 1736248404.845190 6 100.00 1005 > 40 1736248404.845230 26 100.00 1005 > 42 1736248404.845272 7 100.00 1007 > 41 1736248404.845313 27 100.00 1005 > 41 1736248404.845355 8 100.00 1005 > 42 1736248404.845397 28 100.00 1006 > 46 1736248404.845443 9 100.00 1009 > 105995 1736248404.951438 29 100.00 1005 > > Is by far the worst I've had in the past few minutes playing with this. Much also depends on how much (or if at all) cgroups are used. What exact cgroup config are you having? /sys/kernel/debug/sched/debug should be able to tell you.