From: Andrea Righi <arighi@nvidia.com>
To: Juri Lelli <juri.lelli@redhat.com>
Cc: Ingo Molnar <mingo@redhat.com>,
Peter Zijlstra <peterz@infradead.org>,
Vincent Guittot <vincent.guittot@linaro.org>,
Dietmar Eggemann <dietmar.eggemann@arm.com>,
Steven Rostedt <rostedt@goodmis.org>,
Ben Segall <bsegall@google.com>, Mel Gorman <mgorman@suse.de>,
Valentin Schneider <vschneid@redhat.com>,
Joel Fernandes <joelagnelf@nvidia.com>, Tejun Heo <tj@kernel.org>,
David Vernet <void@manifault.com>,
Changwoo Min <changwoo@igalia.com>, Shuah Khan <shuah@kernel.org>,
sched-ext@lists.linux.dev, bpf@vger.kernel.org,
linux-kernel@vger.kernel.org,
Luigi De Matteis <ldematteis123@gmail.com>
Subject: Re: [PATCH 06/14] sched_ext: Add a DL server for sched_ext tasks
Date: Mon, 20 Oct 2025 15:50:56 +0200 [thread overview]
Message-ID: <aPY-QOXV5USEHVIq@gpd4> (raw)
In-Reply-To: <aPYj-iOdvgUYQFpn@jlelli-thinkpadt14gen4.remote.csb>
Hi Juri,
On Mon, Oct 20, 2025 at 01:58:50PM +0200, Juri Lelli wrote:
> Hi!
>
> On 17/10/25 11:25, Andrea Righi wrote:
> > From: Joel Fernandes <joelagnelf@nvidia.com>
> >
> > sched_ext currently suffers starvation due to RT. The same workload when
> > converted to EXT can get zero runtime if RT is 100% running, causing EXT
> > processes to stall. Fix it by adding a DL server for EXT.
> >
> > A kselftest is also provided later to verify:
> >
> > ./runner -t rt_stall
> > ===== START =====
> > TEST: rt_stall
> > DESCRIPTION: Verify that RT tasks cannot stall SCHED_EXT tasks
> > OUTPUT:
> > TAP version 13
> > 1..1
> > ok 1 PASS: CFS task got more than 4.00% of runtime
> >
> > [ arighi: drop ->balance() now that pick_task() has an rf argument ]
> >
> > Cc: Luigi De Matteis <ldematteis123@gmail.com>
> > Co-developed-by: Andrea Righi <arighi@nvidia.com>
> > Signed-off-by: Andrea Righi <arighi@nvidia.com>
> > Signed-off-by: Joel Fernandes <joelagnelf@nvidia.com>
> > ---
> > kernel/sched/core.c | 3 +++
> > kernel/sched/deadline.c | 2 +-
> > kernel/sched/ext.c | 51 +++++++++++++++++++++++++++++++++++++++--
> > kernel/sched/sched.h | 2 ++
> > 4 files changed, 55 insertions(+), 3 deletions(-)
> >
> > diff --git a/kernel/sched/core.c b/kernel/sched/core.c
> > index 096e8d03d85e7..31a9c9381c63f 100644
> > --- a/kernel/sched/core.c
> > +++ b/kernel/sched/core.c
> > @@ -8679,6 +8679,9 @@ void __init sched_init(void)
> > hrtick_rq_init(rq);
> > atomic_set(&rq->nr_iowait, 0);
> > fair_server_init(rq);
> > +#ifdef CONFIG_SCHED_CLASS_EXT
> > + ext_server_init(rq);
> > +#endif
> >
> > #ifdef CONFIG_SCHED_CORE
> > rq->core = rq;
> > diff --git a/kernel/sched/deadline.c b/kernel/sched/deadline.c
> > index 0680e0186577a..3c1fd2190949e 100644
> > --- a/kernel/sched/deadline.c
> > +++ b/kernel/sched/deadline.c
> > @@ -1504,7 +1504,7 @@ static void update_curr_dl_se(struct rq *rq, struct sched_dl_entity *dl_se, s64
> > * The fair server (sole dl_server) does not account for real-time
>
> Fair server is not alone anymore. :))
>
> Please update the comment as well.
>
> > * workload because it is running fair work.
> > */
> > - if (dl_se == &rq->fair_server)
> > + if (dl_se->dl_server)
> > return;
> >
> > #ifdef CONFIG_RT_GROUP_SCHED
>
> ...
>
> > @@ -1487,6 +1499,11 @@ static bool dequeue_task_scx(struct rq *rq, struct task_struct *p, int deq_flags
> > sub_nr_running(rq, 1);
> >
> > dispatch_dequeue(rq, p);
> > +
> > + /* Stop the server if this was the last task */
> > + if (rq->scx.nr_running == 0)
> > + dl_server_stop(&rq->ext_server);
> > +
>
> Do we want to use the delayed stop behavior for scx-server as we have
> for fair-server? Wonder if it's a matter of removing this explicit stop
> and wait for a full period to elapse as we do for fair. It should reduce
> timer reprogramming overhead for scx as well.
So, IIUC we could just remove this explicit dl_server_stop() and the server
would naturally stop at the end of its current deadline period, if there
are still no runnable tasks, right?
In that case it's worth a try.
Thanks,
-Andrea
next prev parent reply other threads:[~2025-10-20 13:51 UTC|newest]
Thread overview: 45+ messages / expand[flat|nested] mbox.gz Atom feed top
2025-10-17 9:25 [PATCHSET v9 sched_ext/for-6.19] Add a deadline server for sched_ext tasks Andrea Righi
2025-10-17 9:25 ` [PATCH 01/14] sched/debug: Fix updating of ppos on server write ops Andrea Righi
2025-10-20 8:36 ` Juri Lelli
2025-10-17 9:25 ` [PATCH 02/14] sched/debug: Stop and start server based on if it was active Andrea Righi
2025-10-20 9:12 ` Juri Lelli
2025-10-20 9:27 ` Juri Lelli
2025-10-17 9:25 ` [PATCH 03/14] sched/deadline: Clear the defer params Andrea Righi
2025-10-17 9:25 ` [PATCH 04/14] sched/deadline: Return EBUSY if dl_bw_cpus is zero Andrea Righi
2025-10-20 9:49 ` Juri Lelli
2025-10-20 13:38 ` Andrea Righi
2025-10-20 14:03 ` Andrea Righi
2025-10-20 14:12 ` Juri Lelli
2025-10-17 9:25 ` [PATCH 05/14] sched: Add a server arg to dl_server_update_idle_time() Andrea Righi
2025-10-20 9:54 ` Juri Lelli
2025-10-20 12:49 ` Peter Zijlstra
2025-10-17 9:25 ` [PATCH 06/14] sched_ext: Add a DL server for sched_ext tasks Andrea Righi
2025-10-17 15:40 ` Tejun Heo
2025-10-17 19:00 ` Andrea Righi
2025-10-17 15:47 ` Tejun Heo
2025-10-17 18:58 ` Andrea Righi
2025-10-17 19:04 ` Tejun Heo
2025-10-17 19:06 ` Andrea Righi
2025-10-20 11:58 ` Juri Lelli
2025-10-20 13:50 ` Andrea Righi [this message]
2025-10-20 14:09 ` Juri Lelli
2025-10-17 9:25 ` [PATCH 07/14] sched/debug: Add support to change sched_ext server params Andrea Righi
2025-10-20 12:45 ` Juri Lelli
2025-10-21 6:23 ` Andrea Righi
2025-10-17 9:25 ` [PATCH 08/14] sched/deadline: Add support to remove DL server's bandwidth contribution Andrea Righi
2025-10-20 13:46 ` Juri Lelli
2025-10-17 9:25 ` [PATCH 09/14] sched/deadline: Account ext server bandwidth Andrea Righi
2025-10-17 9:25 ` [PATCH 10/14] sched/deadline: Allow to initialize DL server when needed Andrea Righi
2025-10-17 9:25 ` [PATCH 11/14] sched/deadline: Fix DL server crash in inactive_timer callback Andrea Righi
2025-10-17 9:25 ` [PATCH 12/14] sched_ext: Selectively enable ext and fair DL servers Andrea Righi
2025-10-17 9:26 ` [PATCH 13/14] selftests/sched_ext: Add test for sched_ext dl_server Andrea Righi
2025-10-19 19:04 ` Emil Tsalapatis
2025-10-20 13:22 ` Andrea Righi
2025-10-20 13:44 ` Andrea Righi
2025-10-20 13:26 ` Christian Loehle
2025-10-20 13:55 ` Andrea Righi
2025-10-20 14:00 ` Andrea Righi
2025-10-20 14:21 ` Christian Loehle
2025-10-23 15:01 ` Christian Loehle
2025-10-23 15:11 ` Andrea Righi
2025-10-17 9:26 ` [PATCH 14/14] selftests/sched_ext: Add test for DL server total_bw consistency Andrea Righi
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=aPY-QOXV5USEHVIq@gpd4 \
--to=arighi@nvidia.com \
--cc=bpf@vger.kernel.org \
--cc=bsegall@google.com \
--cc=changwoo@igalia.com \
--cc=dietmar.eggemann@arm.com \
--cc=joelagnelf@nvidia.com \
--cc=juri.lelli@redhat.com \
--cc=ldematteis123@gmail.com \
--cc=linux-kernel@vger.kernel.org \
--cc=mgorman@suse.de \
--cc=mingo@redhat.com \
--cc=peterz@infradead.org \
--cc=rostedt@goodmis.org \
--cc=sched-ext@lists.linux.dev \
--cc=shuah@kernel.org \
--cc=tj@kernel.org \
--cc=vincent.guittot@linaro.org \
--cc=void@manifault.com \
--cc=vschneid@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox