From: Peter Zijlstra <peterz@infradead.org>
To: Oliver Sang <oliver.sang@intel.com>
Cc: oe-lkp@lists.linux.dev, lkp@intel.com,
linux-kernel@vger.kernel.org, aubrey.li@linux.intel.com,
yu.c.chen@intel.com, tim.c.chen@intel.com,
vinicius.gomes@intel.com, ehab.ababneh@intel.com,
thomas.falcon@intel.com, philip.li@intel.com
Subject: Re: [linux-next:master] [sched/fair] fb1050ac8e: netperf.Throughput_Mbps 14.6% regression
Date: Thu, 30 Jul 2026 16:36:15 +0200 [thread overview]
Message-ID: <20260730143615.GA788244@noisy.programming.kicks-ass.net> (raw)
In-Reply-To: <20260730143239.GA687043@noisy.programming.kicks-ass.net>
On Thu, Jul 30, 2026 at 04:32:39PM +0200, Peter Zijlstra wrote:
> On Thu, Jul 30, 2026 at 02:14:21PM +0800, Oliver Sang wrote:
> > hi, Peter Zijlstra,
> >
> > we are currently piloting AI integrations to help enhance 0-Day's performance
> > analysis and regression-detection capabilities. Since this is in an early trial
> > phase, we want to ensure we build features that genuinely support your workflow.
> > We would love to hear what you would like to see from AI-assisted reports, whether
> > it's specific bottleneck explanations, a cleaner format, or filtering ideas.
> >
> > Please share your thoughts and suggestions with us to help guide our development!
>
> As with most AI output, I find it incredibly hard to read -- for some
> reason my brain keeps wandering and then I have to restart and refocus.
> I'm not entirely sure what causes this, but I know I'm not the only one
> faced with this.
>
> That said, I struggled through it, and while it goes a little off the
> rails at times (eg. the callgraph stuff doesn't at all seem relevant
> here), it seems to be mostly on point.
>
> There are a few things that I find missing that might be possible:
>
> - determine the specific task that is now preempting less; I suspect it
> is ksoftirqd because network workload.
>
> I suspect it doesn't have the data to determine this, but it should
> probably ask for such data and or, if it has access to the guest
> running this, gather it itself.
>
> - a section on possible 'mitigations' for this regression given
> existing configuration options. It touched upon the new debugfs knob
> to revert to the old behaviour, but I suspect that setting a shorter
> slice on ksoftirq might also help.
>
> That is, something like so:
>
> ps -def | awk '/ksoftirqd/ { if ($0 !~ /awk/) print $2}' | while read pid;
> do
> chrt --pid -o -T $((`cat /sys/kernel/debug/sched/base_slice_ns`/10)) $pid;
> done
>
> or perhaps the opposite, giving the netperf thing a larger slice such
> that ksoftirq will more reaily preempt it.
>
> And then there is of course the option to renice things, the netperf
> cgroup could be given a smaller slice or ksoftirq a larger.
'weight' not 'slice' here.
>
> (all operating under the assumption that it is indeed ksoftirq that
> is now ran less readily)
>
>
> This is the only regression found so far for tip/sched/core?
prev parent reply other threads:[~2026-07-30 14:36 UTC|newest]
Thread overview: 4+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-07-15 13:39 [linux-next:master] [sched/fair] fb1050ac8e: netperf.Throughput_Mbps 14.6% regression kernel test robot
2026-07-30 6:14 ` Oliver Sang
2026-07-30 14:32 ` Peter Zijlstra
2026-07-30 14:36 ` Peter Zijlstra [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20260730143615.GA788244@noisy.programming.kicks-ass.net \
--to=peterz@infradead.org \
--cc=aubrey.li@linux.intel.com \
--cc=ehab.ababneh@intel.com \
--cc=linux-kernel@vger.kernel.org \
--cc=lkp@intel.com \
--cc=oe-lkp@lists.linux.dev \
--cc=oliver.sang@intel.com \
--cc=philip.li@intel.com \
--cc=thomas.falcon@intel.com \
--cc=tim.c.chen@intel.com \
--cc=vinicius.gomes@intel.com \
--cc=yu.c.chen@intel.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.