From: Juri Lelli <juri.lelli@redhat.com>
To: Frederic Weisbecker <frederic@kernel.org>
Cc: Ingo Molnar <mingo@redhat.com>,
Peter Zijlstra <peterz@infradead.org>,
Vincent Guittot <vincent.guittot@linaro.org>,
Dietmar Eggemann <dietmar.eggemann@arm.com>,
Steven Rostedt <rostedt@goodmis.org>,
Ben Segall <bsegall@google.com>, Mel Gorman <mgorman@suse.de>,
Valentin Schneider <vschneid@redhat.com>,
K Prateek Nayak <kprateek.nayak@amd.com>,
Andrea Righi <arighi@nvidia.com>,
linux-kernel@vger.kernel.org,
David Haufe <dhaufe@simplextrading.com>,
Cao Ruichuang <create0818@163.com>, Tejun Heo <tj@kernel.org>
Subject: Re: [PATCH] sched/deadline: Make dl-server nohz full aware
Date: Tue, 12 May 2026 17:31:45 +0200 [thread overview]
Message-ID: <agNH4TT-7XFg8spg@jlelli-thinkpadt14gen4.remote.csb> (raw)
In-Reply-To: <agMzMxpfnis1V0Gj@localhost.localdomain>
On 12/05/26 16:03, Frederic Weisbecker wrote:
> Le Tue, May 12, 2026 at 11:02:37AM +0200, Juri Lelli a écrit :
> > The dl_server_timer() causes spurious IPIs on nohz_full cores, breaking
> > isolation guarantees. The timer executes on a housekeeping core and
> > eventually calls tick_nohz_dep_set_cpu(), sending IPIs to isolated cores
> > even when only a single task is running.
> >
> > The problem is that dl-servers are not coordinated with nohz_full tick
> > state. Timers can fire and send IPIs to otherwise undisturbed cores.
> >
> > Fix by managing servers in sched_can_stop_tick():
> >
> > - When RT tasks run with CFS/SCX tasks, start the appropriate server
> > and keep the tick running
> > - When only RT tasks remain, stop all servers and allow tick to stop
> > (except for >1 RR tasks which need the tick for round-robin)
> > - When only CFS/SCX tasks remain, stop all servers before stopping tick
> >
> > Introduce dl_servers_stop_all() to reduce duplication and abstract
> > server management from core.c. Unify RT handling into one block that
> > handles both RR and FIFO cases.
> >
> > Fixes: 557a6bfc662c ("sched/fair: Add trivial fair server")
> > Reported-by: David Haufe <dhaufe@simplextrading.com>
> > Closes: https://lore.kernel.org/lkml/CAKJHwtOw_G67edzuHVtL1xC5Vyt6StcZzihtDd0yaKudW=rwVw@mail.gmail.com
> > Signed-off-by: Juri Lelli <juri.lelli@redhat.com>
>
> I indeed observed IPIs originating from dl_server some time
> ago but that magically disappeared after some commit from Peter.
>
> Perhaps it came back somehow? Lemme run dynticks-testing again on
> latest upstream...
So, the IPIs seem to be indeed gone also from my recent testing (decided
to keep the reference/context in the changelog for historical reasons,
but can remove). But the dl_task_timer (dl-server timer) for isolated
CPUs is still firing on housekeeping and that is what this is
addressing.
> > ---
> > I had to modify my first original attempt at fixing this (please take a
> > look at the linked report/discussion) to also take SCX into
> > consideration.
>
> I thought SCX was disabled when CPU isolation is running?
>
> 9f391f94a173 ("sched_ext: Disallow loading BPF scheduler if isolcpus= domain
> isolation is in effect")
Ah, thanks for poiting it out, it indeed simplify things. :)
And thanks for the super quick review!
Best,
Juri
next prev parent reply other threads:[~2026-05-12 15:31 UTC|newest]
Thread overview: 10+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-05-12 9:02 [PATCH] sched/deadline: Make dl-server nohz full aware Juri Lelli
2026-05-12 10:06 ` Furkan Çalışkan
2026-05-12 12:27 ` Juri Lelli
2026-05-12 14:03 ` Frederic Weisbecker
2026-05-12 15:31 ` Juri Lelli [this message]
2026-05-12 14:55 ` Andrea Righi
2026-05-12 15:34 ` Juri Lelli
2026-05-13 6:16 ` Juri Lelli
2026-05-13 6:38 ` Andrea Righi
2026-05-13 12:09 ` Frederic Weisbecker
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=agNH4TT-7XFg8spg@jlelli-thinkpadt14gen4.remote.csb \
--to=juri.lelli@redhat.com \
--cc=arighi@nvidia.com \
--cc=bsegall@google.com \
--cc=create0818@163.com \
--cc=dhaufe@simplextrading.com \
--cc=dietmar.eggemann@arm.com \
--cc=frederic@kernel.org \
--cc=kprateek.nayak@amd.com \
--cc=linux-kernel@vger.kernel.org \
--cc=mgorman@suse.de \
--cc=mingo@redhat.com \
--cc=peterz@infradead.org \
--cc=rostedt@goodmis.org \
--cc=tj@kernel.org \
--cc=vincent.guittot@linaro.org \
--cc=vschneid@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.