Linux Documentation
 help / color / mirror / Atom feed
From: Yury Norov <ynorov@nvidia.com>
To: Shrikanth Hegde <sshegde@linux.ibm.com>
Cc: linux-kernel@vger.kernel.org, mingo@kernel.org,
	peterz@infradead.org, juri.lelli@redhat.com,
	vincent.guittot@linaro.org, yury.norov@gmail.com,
	kprateek.nayak@amd.com, iii@linux.ibm.com, corbet@lwn.net,
	tglx@kernel.org, gregkh@linuxfoundation.org, pbonzini@redhat.com,
	seanjc@google.com, vschneid@redhat.com, huschle@linux.ibm.com,
	rostedt@goodmis.org, dietmar.eggemann@arm.com,
	maddy@linux.ibm.com, srikar@linux.ibm.com, hdanton@sina.com,
	chleroy@kernel.org, vineeth@bitbyteword.org, frederic@kernel.org,
	arighi@nvidia.com, pauld@redhat.com, christian.loehle@arm.com,
	tj@kernel.org, tommaso.cucinotta@gmail.com, maz@kernel.org,
	rafael@kernel.org, rdunlap@infradead.org, kernellwp@gmail.com,
	linux-doc@vger.kernel.org
Subject: Re: [PATCH v6 20/23] virt/steal_monitor: Act on steal values at regular intervals
Date: Wed, 8 Jul 2026 12:13:23 -0400	[thread overview]
Message-ID: <ak53I9beUB-2plNQ@yury> (raw)
In-Reply-To: <be544e00-8cf7-4a09-8b13-2d8b5a98c2ce@linux.ibm.com>

On Wed, Jul 08, 2026 at 04:03:18PM +0530, Shrikanth Hegde wrote:
> 
> 
> On 7/7/26 12:46 PM, Shrikanth Hegde wrote:
> > 
> > 
> > On 7/7/26 2:03 AM, Yury Norov wrote:
> > > On Wed, Jul 01, 2026 at 07:46:51PM +0530, Shrikanth Hegde wrote:
> > > > This is the steal_monitor core functionality done in periodic work
> > > > 
> > > > - Calculate the steal_ratio. It is multiplied by 100 to consider the
> > > >    fractional values of steal time. I.e 10 means 0.1% steal time.
> > > > - If steal value is higher than high threshold, call the method
> > > > to reduce
> > > >    the preferred CPUs.
> > > > - If steal value is lower or equal to low threshold, call the method to
> > > >    increase the preferred CPUs.
> > > > - If the steal value is in between, no action is taken.
> > > > - Save the values for next delta calculations.
> > > > 
> > > > Signed-off-by: Shrikanth Hegde <sshegde@linux.ibm.com>
> > > > ---
> > > > v5->v6:
> > > > - Address u64 overflow concerns.
> > > > 
> > > >   drivers/virt/steal_monitor/sm_core.c | 33 ++++++++++++++++++++++++++++
> > > >   1 file changed, 33 insertions(+)
> > > > 
> > > > diff --git a/drivers/virt/steal_monitor/sm_core.c
> > > > b/drivers/virt/ steal_monitor/sm_core.c
> > > > index b499faa61010..7b7435f79b85 100644
> > > > --- a/drivers/virt/steal_monitor/sm_core.c
> > > > +++ b/drivers/virt/steal_monitor/sm_core.c
> > > > @@ -34,6 +34,37 @@ MODULE_PARM_DESC(low_threshold,
> > > >   static void compute_preferred_cpus_work(struct work_struct *work)
> > > >   {
> > > > +    u64 curr_steal, delta_steal, delta_ns, steal_ratio;
> > > > +    ktime_t now;
> > > > +
> > > > +    curr_steal = get_system_steal_time();
> > > > +    now = ktime_get();
> > > > +
> > > > +    /* get the deltas */
> > > > +    delta_steal = curr_steal > sm_core_ctx.prev_steal ?
> > > > +              curr_steal - sm_core_ctx.prev_steal : 0;
> > > > +    delta_ns = max_t(u64, ktime_to_ns(ktime_sub(now,
> > > > sm_core_ctx.prev_time)), 1);
> > > 
> > > The below return on '!delta_ns' makes this max(...) useless, right?
> > > Regardless, if the time between 2 measures is less then 1ns, I
> > > believe, the whole measure is not trustworthy
> > > 
> > 
> > Seeing sashiko comment on divide by zero, i forgot I had max above there :(
> > 
> > > > +
> > > > +    /* Update for next calculation */
> > > > +    sm_core_ctx.prev_steal = curr_steal;
> > > > +    sm_core_ctx.prev_time = now;
> > > 
> > > So below return should go prior to this update, because 'now' is actually
> > > the same as 'prev_time', right?
> > > 
> > > I don't understand why 'now' can be so close to prev_time, because
> > > you've scheduled this callback on the regular interval. But if that's
> > > possible, can you explain that and do like this at the very beginning
> > > of the function:
> > > 
> 
> I don't think it is possible.
> 
> > >          now = ktime_get();
> > >          if (unlikely(now < sm_core_ctx.prev_time +
> > > sm_core_ctx.interval / 2)) {
> > >                  pr_warn(...);
> > >                  return;
> > >          }
> > 
> > Pretty much, just have to requeue the work.
> > 
> > > 
> > > And if it's a never-happen condition, just use WARN_ON().
> > > 
> 
> I have decided keep just max_t() to ensure no divide by zero happens.
> 
> Issue with putting sm_core_ctx.interval_ms check is that, one may edit
> it while the work is queued, but not yet called. It would print wrongly
> in that case.

Who is that 'one'? If it's userspace, you can simply disallow changing
the interval. If it's kernel, you're already compromised, and
everything is not trustworthy.

I would simply disallow to change any parameters while the driver is
loaded. If I need to change something - I unload it and load with new
interval, or whatever.

> Even if work function gets called prematurely, it should be fine since the
> steal also increases accordingly. No issues in delta logic.
> 
> So capping to 1 to ensure no divide by 0 happens due to scaling of
> delta_ns is good enough.
 
If there's 1 nanosecond between two calls, your statistics is very
inaccurate, pretty much a noise. You want to make decision based on
noise. That's simply wrong.
 
> > Ya, it is a never-happen condition. I will use WARN_ON.
> > 

  reply	other threads:[~2026-07-08 16:13 UTC|newest]

Thread overview: 59+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-07-01 14:16 [PATCH v6 00/23] sched: Introduce cpu_preferred_mask and steal-driven vCPU backoff Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 01/23] sched/docs: Document cpu_preferred_mask and Preferred CPU concept Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 02/23] kconfig: Provide PREFERRED_CPU option Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 03/23] cpumask: Introduce cpu_preferred_mask Shrikanth Hegde
2026-07-01 15:35   ` Yury Norov
2026-07-01 16:40     ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 04/23] sysfs: Add preferred CPU file Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 05/23] sched/core: Try to use a preferred CPU in is_cpu_allowed Shrikanth Hegde
2026-07-01 16:09   ` Yury Norov
2026-07-01 16:49     ` Shrikanth Hegde
2026-07-02  6:30       ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 06/23] sched/fair: Load balance only among preferred CPUs Shrikanth Hegde
2026-07-01 16:19   ` Yury Norov
2026-07-01 16:41     ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 07/23] sched/fair: Pull the load on preferred CPU Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 08/23] sched/core: Keep tick on non-preferred CPUs until tasks are out Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 09/23] sched/core: Push current task from non preferred CPU Shrikanth Hegde
2026-07-01 16:50   ` Yury Norov
2026-07-01 17:03     ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 10/23] sched/debug: Add migration stats due to non preferred CPUs Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 11/23] virt/steal_monitor: Add documentation Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 12/23] virt: Introduce steal monitor driver Shrikanth Hegde
2026-07-03 18:20   ` Yury Norov
2026-07-03 18:27     ` Yury Norov
2026-07-06  8:24       ` Shrikanth Hegde
2026-07-06 18:49         ` Yury Norov
2026-07-07  6:47           ` Shrikanth Hegde
2026-07-06  8:09     ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 13/23] virt/steal_monitor: Restore to active on module disable Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 14/23] virt/steal_monitor: Define steal_monitor structure Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 15/23] virt/steal_monitor: Add control knobs for handling steal values Shrikanth Hegde
2026-07-02  7:16   ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 16/23] virt/steal_monitor: Compute work at regular intervals Shrikanth Hegde
2026-07-03 18:14   ` Yury Norov
2026-07-06  8:38     ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 17/23] virt/steal_monitor: Provide default method to get systemwide steal time Shrikanth Hegde
2026-07-03 19:16   ` Yury Norov
2026-07-06  8:47     ` Shrikanth Hegde
2026-07-06 19:04       ` Yury Norov
2026-07-07  6:50         ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 18/23] virt/steal_monitor: Provide default method to inc/dec preferred CPUs Shrikanth Hegde
2026-07-03 21:11   ` Yury Norov
2026-07-06  9:20     ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 19/23] virt/steal_monitor: Provide default method to get num of CPUs for steal ratio Shrikanth Hegde
2026-07-06 19:26   ` Yury Norov
2026-07-07  6:55     ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 20/23] virt/steal_monitor: Act on steal values at regular intervals Shrikanth Hegde
2026-07-02  7:18   ` Shrikanth Hegde
2026-07-06 20:33   ` Yury Norov
2026-07-07  7:16     ` Shrikanth Hegde
2026-07-08 10:33       ` Shrikanth Hegde
2026-07-08 16:13         ` Yury Norov [this message]
2026-07-08 16:55           ` Shrikanth Hegde
2026-07-08 19:59             ` Yury Norov
2026-07-01 14:16 ` [PATCH v6 21/23] virt/steal_monitor: Add direction control Shrikanth Hegde
2026-07-06 20:36   ` Yury Norov
2026-07-07  7:16     ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 22/23] virt/steal_monitor: Add design check of preferred subset of active Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 23/23] virt/steal_monitor: Optimise decrease_preferred_cpus when all CPUs are housekeeping Shrikanth Hegde

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=ak53I9beUB-2plNQ@yury \
    --to=ynorov@nvidia.com \
    --cc=arighi@nvidia.com \
    --cc=chleroy@kernel.org \
    --cc=christian.loehle@arm.com \
    --cc=corbet@lwn.net \
    --cc=dietmar.eggemann@arm.com \
    --cc=frederic@kernel.org \
    --cc=gregkh@linuxfoundation.org \
    --cc=hdanton@sina.com \
    --cc=huschle@linux.ibm.com \
    --cc=iii@linux.ibm.com \
    --cc=juri.lelli@redhat.com \
    --cc=kernellwp@gmail.com \
    --cc=kprateek.nayak@amd.com \
    --cc=linux-doc@vger.kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=maddy@linux.ibm.com \
    --cc=maz@kernel.org \
    --cc=mingo@kernel.org \
    --cc=pauld@redhat.com \
    --cc=pbonzini@redhat.com \
    --cc=peterz@infradead.org \
    --cc=rafael@kernel.org \
    --cc=rdunlap@infradead.org \
    --cc=rostedt@goodmis.org \
    --cc=seanjc@google.com \
    --cc=srikar@linux.ibm.com \
    --cc=sshegde@linux.ibm.com \
    --cc=tglx@kernel.org \
    --cc=tj@kernel.org \
    --cc=tommaso.cucinotta@gmail.com \
    --cc=vincent.guittot@linaro.org \
    --cc=vineeth@bitbyteword.org \
    --cc=vschneid@redhat.com \
    --cc=yury.norov@gmail.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox