[PATCHSET sched_ext/for-6.12] sched_ext: Implement scx_bpf_dispatch[_vtime]_from_dsq()

Tejun Heo
2024-08-30T11:04:22Z

Once a task is put into a DSQ, the allowed operations are fairly limited.
Tasks in the built-in local and global DSQs are executed automatically and,
ignoring dequeue, there is only one way a task in a user DSQ can be
manipulated - scx_bpf_consume() moves the first task to the dispatching
local DSQ. This inflexibility sometimes gets in the way and is an area where
multiple feature requests have been made.

Implement scx_bpf_dispatch[_vtime]_from_dsq(), which can be called during
DSQ iteration and can move the task to any DSQ - local DSQs, global DSQ and
user DSQs. The kfuncs can be called from ops.dispatch() and any BPF context
which dosen't hold a rq lock including BPF timers and SYSCALL programs.

This patchset is on top of:

sched_ext/for-6.12 bf934bed5e2f ("sched_ext: Add missing cfi stub for ops.tick")
+ two fix patches (http://lkml.kernel.org/r/ZtGkPKgoE5BeI7fN@slm.duckdns.org)

and is also available at:

git://git.kernel.org/pub/scm/linux/kernel/git/tj/sched_ext.git scx-dispatch_from_dsq

This patchset contains the following patches:

0001-sched_ext-Rename-scx_kfunc_set_sleepable-to-unlocked.patch
0002-sched_ext-Refactor-consume_remote_task.patch
0003-sched_ext-Make-find_dsq_for_dispatch-handle-SCX_DSQ_.patch
0004-sched_ext-Make-dispatch_to_local_dsq-return-void.patch
0005-sched_ext-Restructure-dispatch_to_local_dsq.patch
0006-sched_ext-Reorder-args-for-consume_local-remote_task.patch
0007-sched_ext-Move-sanity-check-and-dsq_mod_nr-into-task.patch
0008-sched_ext-Move-consume_local_task-upward.patch
0009-sched_ext-Replace-consume_local_task-with-move_local.patch
0010-sched_ext-Implement-scx_bpf_dispatch-_vtime-_from_ds.patch
0011-scx_qmap-Implement-highpri-boosting.patch

0001-0009 are prep patches. The logic to bounce tasks across DSQs and CPUs
is rather complicated due to synchronization. The prep patches do quite a
bit of refactoring so that the helpers are more composable and can be used
for the new kfuncs.

0010 implements scx_bpf_dispatch[_vtime]_from_dsq().

0011 adds demo usages to scx_qmap.

diffstat follows. Thanks.

kernel/sched/ext.c | 592 ++++++++++++++++++++++++++++++++++++----------------------
tools/sched_ext/include/scx/common.bpf.h | 8
tools/sched_ext/scx_qmap.bpf.c | 142 ++++++++++++-
tools/sched_ext/scx_qmap.c | 11 -
4 files changed, 519 insertions(+), 234 deletions(-)

--
tejun