All of lore.kernel.org
 help / color / mirror / Atom feed
From: Tejun Heo <tj@kernel.org>
To: Steven Rostedt <rostedt@goodmis.org>
Cc: LKML <linux-kernel@vger.kernel.org>,
	Peter Zijlstra <peterz@infradead.org>,
	Juri Lelli <juri.lelli@redhat.com>,
	Vincent Guittot <vincent.guittot@linaro.org>,
	Dietmar Eggemann <dietmar.eggemann@arm.com>,
	Ben Segall <bsegall@google.com>, Mel Gorman <mgorman@suse.de>,
	Valentin Schneider <vschneid@redhat.com>,
	K Prateek Nayak <kprateek.nayak@amd.com>,
	Kyle McMartin <jkkm@meta.com>
Subject: Re: [PATCH v2] sched/rt: Have RT_PUSH_IPI be default off for non PREEMPT_RT
Date: Fri, 15 May 2026 12:27:12 -1000	[thread overview]
Message-ID: <agedwG-ZQNCrBDdn@slm.duckdns.org> (raw)
In-Reply-To: <20260515145608.2039b4cf@gandalf.local.home>

Hello,

On Fri, May 15, 2026 at 02:56:08PM -0400, Steven Rostedt wrote:
> I just want to make sure that my analysis is correct. Since only one CPU
> can initiate the RT_PUSH_IPI. That for this to be a problem, other CPUs
> need to be constantly running RT tasks for short periods of time so that
> when the RT task schedules off the CPU, the CPU then initiates the "pull".
> And it's not that it happens all at once. It's more serialized where the RT
> tasks are scheduling off at different times to constantly feed the
> RT_PUSH_IPI logic without seeing that it's already in place.
> 
> It would require this to happen enough times to keep the overloaded CPU
> from finishing the softirq until a time when the softirq is scheduled
> again. And it would maintain this abuse for long enough to trigger the
> watchdog.
> 
> Does that fit the scenario of your environment?

Yeah, I think that's coming from the FIFO threaded irq handling for mpi3mr.
We tried two mitigations - one dropping the irq threads to SCHED_OTHER and
NO_RT_PUSH_IPI. Both worked. While the former is not conclusive in itself,
it is in line with the theory at least.

Thanks.

-- 
tejun

      reply	other threads:[~2026-05-15 22:27 UTC|newest]

Thread overview: 6+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-05-15 14:37 [PATCH v2] sched/rt: Have RT_PUSH_IPI be default off for non PREEMPT_RT Steven Rostedt
2026-05-15 17:17 ` Tejun Heo
2026-05-15 18:38   ` Steven Rostedt
2026-05-15 18:47     ` Tejun Heo
2026-05-15 18:56       ` Steven Rostedt
2026-05-15 22:27         ` Tejun Heo [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=agedwG-ZQNCrBDdn@slm.duckdns.org \
    --to=tj@kernel.org \
    --cc=bsegall@google.com \
    --cc=dietmar.eggemann@arm.com \
    --cc=jkkm@meta.com \
    --cc=juri.lelli@redhat.com \
    --cc=kprateek.nayak@amd.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=mgorman@suse.de \
    --cc=peterz@infradead.org \
    --cc=rostedt@goodmis.org \
    --cc=vincent.guittot@linaro.org \
    --cc=vschneid@redhat.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.