From: Shrikanth Hegde <sshegde@linux.ibm.com>
To: Andrea Righi <arighi@nvidia.com>
Cc: Ingo Molnar <mingo@redhat.com>,
Peter Zijlstra <peterz@infradead.org>,
Juri Lelli <juri.lelli@redhat.com>,
Vincent Guittot <vincent.guittot@linaro.org>,
Dietmar Eggemann <dietmar.eggemann@arm.com>,
Steven Rostedt <rostedt@goodmis.org>,
Ben Segall <bsegall@google.com>, Mel Gorman <mgorman@suse.de>,
Valentin Schneider <vschneid@redhat.com>,
K Prateek Nayak <kprateek.nayak@amd.com>,
Christian Loehle <christian.loehle@arm.com>,
Phil Auld <pauld@redhat.com>, Mete Durlu <meted@linux.ibm.com>,
linux-kernel@vger.kernel.org
Subject: Re: [PATCH v4] sched/fair: Prefer fully idle cores for NOHZ balancing
Date: Wed, 5 Aug 2026 02:48:24 +0530 [thread overview]
Message-ID: <7e49236e-7f17-4583-8196-34ce9a2fa762@linux.ibm.com> (raw)
In-Reply-To: <anIq6pU5KXTTFCDN@gpd4>
On 8/4/26 11:39 PM, Andrea Righi wrote:
> Hi Shrikanth,
>
>> Just Curious, making nohz_full=<except first core> yeilds similar numbers?
>
> Yes, provided that the housekeeping core is also excluded from the workload.
>
> I tested this booting with:
>
> nohz_full=1-175,177-351
>
> This leaves CPUs 0 and 176 for housekeeping. I excluded that core from the
> workload and ran 87 OpenMP tasks on the remaining node-0 cores (1 task per core,
> excluding the housekeeping one):
>
> $ env OMP_NUM_THREADS=87 \
> OMP_DYNAMIC=false \
> OPENBLAS_LOOPS=10 \
> OPENBLAS_PARAM_M=16384 \
> OPENBLAS_PARAM_N=16384 \
> OPENBLAS_PARAM_K=16384 \
> numactl -C 1-87,177-263 --membind=0 \
> ./benchmark/sgemm.goto 1 1 1
>
> Results:
>
> unpatched : 5.246 TFLOP/s
> unpatched+nohz_full : 6.953 TFLOP/s
> patched : 6.861 TFLOP/s
> patched+nohz_full : 6.984 TFLOP/s
>
> So, nohz_full seems to prevent the problematic ILB wakeups and can produce
> similar results for this CPU-bound workload. However, it shouldn't be considered
> a sobstiute for the ILB fix, since it requires explicit partitioning and
> reserved housekeeping CPUs. Full dyntick also enables context tracking on the
> isolated CPUs, adding kernel entry/exit overhead.
>
That's good to know. Thanks for running them.
I put "just curious", knowing nohz_full is not a solution.
next prev parent reply other threads:[~2026-08-04 21:19 UTC|newest]
Thread overview: 7+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-08-04 15:13 [PATCH v4] sched/fair: Prefer fully idle cores for NOHZ balancing Andrea Righi
2026-08-04 15:19 ` Shrikanth Hegde
2026-08-04 18:09 ` Andrea Righi
2026-08-04 21:18 ` Shrikanth Hegde [this message]
2026-08-05 10:31 ` Vincent Guittot
2026-08-06 10:26 ` Shrikanth Hegde
2026-08-06 13:18 ` Andrea Righi
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=7e49236e-7f17-4583-8196-34ce9a2fa762@linux.ibm.com \
--to=sshegde@linux.ibm.com \
--cc=arighi@nvidia.com \
--cc=bsegall@google.com \
--cc=christian.loehle@arm.com \
--cc=dietmar.eggemann@arm.com \
--cc=juri.lelli@redhat.com \
--cc=kprateek.nayak@amd.com \
--cc=linux-kernel@vger.kernel.org \
--cc=meted@linux.ibm.com \
--cc=mgorman@suse.de \
--cc=mingo@redhat.com \
--cc=pauld@redhat.com \
--cc=peterz@infradead.org \
--cc=rostedt@goodmis.org \
--cc=vincent.guittot@linaro.org \
--cc=vschneid@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).