Linux Documentation
 help / color / mirror / Atom feed
From: Shrikanth Hegde <sshegde@linux.ibm.com>
To: Yury Norov <ynorov@nvidia.com>
Cc: linux-kernel@vger.kernel.org, mingo@kernel.org,
	peterz@infradead.org, juri.lelli@redhat.com,
	vincent.guittot@linaro.org, yury.norov@gmail.com,
	kprateek.nayak@amd.com, iii@linux.ibm.com, corbet@lwn.net,
	tglx@kernel.org, gregkh@linuxfoundation.org, pbonzini@redhat.com,
	seanjc@google.com, vschneid@redhat.com, huschle@linux.ibm.com,
	rostedt@goodmis.org, dietmar.eggemann@arm.com,
	maddy@linux.ibm.com, srikar@linux.ibm.com, hdanton@sina.com,
	chleroy@kernel.org, vineeth@bitbyteword.org, frederic@kernel.org,
	arighi@nvidia.com, pauld@redhat.com, christian.loehle@arm.com,
	tj@kernel.org, tommaso.cucinotta@gmail.com, maz@kernel.org,
	rafael@kernel.org, rdunlap@infradead.org, kernellwp@gmail.com,
	linux-doc@vger.kernel.org
Subject: Re: [PATCH v6 20/23] virt/steal_monitor: Act on steal values at regular intervals
Date: Wed, 8 Jul 2026 22:25:09 +0530	[thread overview]
Message-ID: <7eea685e-e5ab-4487-bafb-3131969e5acd@linux.ibm.com> (raw)
In-Reply-To: <ak53I9beUB-2plNQ@yury>



On 7/8/26 9:43 PM, Yury Norov wrote:
> On Wed, Jul 08, 2026 at 04:03:18PM +0530, Shrikanth Hegde wrote:
>>
>>
>> On 7/7/26 12:46 PM, Shrikanth Hegde wrote:
>>>
>>>
>>> On 7/7/26 2:03 AM, Yury Norov wrote:
>>>> On Wed, Jul 01, 2026 at 07:46:51PM +0530, Shrikanth Hegde wrote:
>>>>> This is the steal_monitor core functionality done in periodic work
>>>>>
>>>>> - Calculate the steal_ratio. It is multiplied by 100 to consider the
>>>>>     fractional values of steal time. I.e 10 means 0.1% steal time.
>>>>> - If steal value is higher than high threshold, call the method
>>>>> to reduce
>>>>>     the preferred CPUs.
>>>>> - If steal value is lower or equal to low threshold, call the method to
>>>>>     increase the preferred CPUs.
>>>>> - If the steal value is in between, no action is taken.
>>>>> - Save the values for next delta calculations.
>>>>>
>>>>> Signed-off-by: Shrikanth Hegde <sshegde@linux.ibm.com>
>>>>> ---
>>>>> v5->v6:
>>>>> - Address u64 overflow concerns.
>>>>>
>>>>>    drivers/virt/steal_monitor/sm_core.c | 33 ++++++++++++++++++++++++++++
>>>>>    1 file changed, 33 insertions(+)
>>>>>
>>>>> diff --git a/drivers/virt/steal_monitor/sm_core.c
>>>>> b/drivers/virt/ steal_monitor/sm_core.c
>>>>> index b499faa61010..7b7435f79b85 100644
>>>>> --- a/drivers/virt/steal_monitor/sm_core.c
>>>>> +++ b/drivers/virt/steal_monitor/sm_core.c
>>>>> @@ -34,6 +34,37 @@ MODULE_PARM_DESC(low_threshold,
>>>>>    static void compute_preferred_cpus_work(struct work_struct *work)
>>>>>    {
>>>>> +    u64 curr_steal, delta_steal, delta_ns, steal_ratio;
>>>>> +    ktime_t now;
>>>>> +
>>>>> +    curr_steal = get_system_steal_time();
>>>>> +    now = ktime_get();
>>>>> +
>>>>> +    /* get the deltas */
>>>>> +    delta_steal = curr_steal > sm_core_ctx.prev_steal ?
>>>>> +              curr_steal - sm_core_ctx.prev_steal : 0;
>>>>> +    delta_ns = max_t(u64, ktime_to_ns(ktime_sub(now,
>>>>> sm_core_ctx.prev_time)), 1);
>>>>
>>>> The below return on '!delta_ns' makes this max(...) useless, right?
>>>> Regardless, if the time between 2 measures is less then 1ns, I
>>>> believe, the whole measure is not trustworthy
>>>>
>>>
>>> Seeing sashiko comment on divide by zero, i forgot I had max above there :(
>>>
>>>>> +
>>>>> +    /* Update for next calculation */
>>>>> +    sm_core_ctx.prev_steal = curr_steal;
>>>>> +    sm_core_ctx.prev_time = now;
>>>>
>>>> So below return should go prior to this update, because 'now' is actually
>>>> the same as 'prev_time', right?
>>>>
>>>> I don't understand why 'now' can be so close to prev_time, because
>>>> you've scheduled this callback on the regular interval. But if that's
>>>> possible, can you explain that and do like this at the very beginning
>>>> of the function:
>>>>
>>
>> I don't think it is possible.
>>
>>>>           now = ktime_get();
>>>>           if (unlikely(now < sm_core_ctx.prev_time +
>>>> sm_core_ctx.interval / 2)) {
>>>>                   pr_warn(...);
>>>>                   return;
>>>>           }
>>>
>>> Pretty much, just have to requeue the work.
>>>
>>>>
>>>> And if it's a never-happen condition, just use WARN_ON().
>>>>
>>
>> I have decided keep just max_t() to ensure no divide by zero happens.
>>
>> Issue with putting sm_core_ctx.interval_ms check is that, one may edit
>> it while the work is queued, but not yet called. It would print wrongly
>> in that case.
> 
> Who is that 'one'? If it's userspace, you can simply disallow changing
> the interval. If it's kernel, you're already compromised, and
> everything is not trustworthy.
> 
> I would simply disallow to change any parameters while the driver is
> loaded. If I need to change something - I unload it and load with new
> interval, or whatever.

It is user writing to /sys/module/steal_monitor/parameters/interval_ms
that i thought of. So user.

If we disable then those checks can be valid.

> 
>> Even if work function gets called prematurely, it should be fine since the
>> steal also increases accordingly. No issues in delta logic.
>>
>> So capping to 1 to ensure no divide by 0 happens due to scaling of
>> delta_ns is good enough.
>   
> If there's 1 nanosecond between two calls, your statistics is very
> inaccurate, pretty much a noise. You want to make decision based on
> noise. That's simply wrong.


yes, that makes sense too. I have kept interval_ms/8 as safe bet.
Return will not queue the timer and effectively disables it.

         ktime_t now;

         now = ktime_get();
         delta_ns = ktime_to_ns(ktime_sub(now, sm_core_ctx.prev_time));

         if (unlikely(delta_ns < sm_core_ctx.interval_ms * ((u64)NSEC_PER_MSEC >> 3))) {
                 pr_err("work scheduled too soon delta_time: %llu ns. Abort steal_monitor.\n",
                        delta_ns);

                 guard(cpus_read_lock)();
                 cpumask_copy(&__cpu_preferred_mask, cpu_active_mask);
                 return;
         }


>   
>>> Ya, it is a never-happen condition. I will use WARN_ON.
>>>


  reply	other threads:[~2026-07-08 16:55 UTC|newest]

Thread overview: 59+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-07-01 14:16 [PATCH v6 00/23] sched: Introduce cpu_preferred_mask and steal-driven vCPU backoff Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 01/23] sched/docs: Document cpu_preferred_mask and Preferred CPU concept Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 02/23] kconfig: Provide PREFERRED_CPU option Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 03/23] cpumask: Introduce cpu_preferred_mask Shrikanth Hegde
2026-07-01 15:35   ` Yury Norov
2026-07-01 16:40     ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 04/23] sysfs: Add preferred CPU file Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 05/23] sched/core: Try to use a preferred CPU in is_cpu_allowed Shrikanth Hegde
2026-07-01 16:09   ` Yury Norov
2026-07-01 16:49     ` Shrikanth Hegde
2026-07-02  6:30       ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 06/23] sched/fair: Load balance only among preferred CPUs Shrikanth Hegde
2026-07-01 16:19   ` Yury Norov
2026-07-01 16:41     ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 07/23] sched/fair: Pull the load on preferred CPU Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 08/23] sched/core: Keep tick on non-preferred CPUs until tasks are out Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 09/23] sched/core: Push current task from non preferred CPU Shrikanth Hegde
2026-07-01 16:50   ` Yury Norov
2026-07-01 17:03     ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 10/23] sched/debug: Add migration stats due to non preferred CPUs Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 11/23] virt/steal_monitor: Add documentation Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 12/23] virt: Introduce steal monitor driver Shrikanth Hegde
2026-07-03 18:20   ` Yury Norov
2026-07-03 18:27     ` Yury Norov
2026-07-06  8:24       ` Shrikanth Hegde
2026-07-06 18:49         ` Yury Norov
2026-07-07  6:47           ` Shrikanth Hegde
2026-07-06  8:09     ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 13/23] virt/steal_monitor: Restore to active on module disable Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 14/23] virt/steal_monitor: Define steal_monitor structure Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 15/23] virt/steal_monitor: Add control knobs for handling steal values Shrikanth Hegde
2026-07-02  7:16   ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 16/23] virt/steal_monitor: Compute work at regular intervals Shrikanth Hegde
2026-07-03 18:14   ` Yury Norov
2026-07-06  8:38     ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 17/23] virt/steal_monitor: Provide default method to get systemwide steal time Shrikanth Hegde
2026-07-03 19:16   ` Yury Norov
2026-07-06  8:47     ` Shrikanth Hegde
2026-07-06 19:04       ` Yury Norov
2026-07-07  6:50         ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 18/23] virt/steal_monitor: Provide default method to inc/dec preferred CPUs Shrikanth Hegde
2026-07-03 21:11   ` Yury Norov
2026-07-06  9:20     ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 19/23] virt/steal_monitor: Provide default method to get num of CPUs for steal ratio Shrikanth Hegde
2026-07-06 19:26   ` Yury Norov
2026-07-07  6:55     ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 20/23] virt/steal_monitor: Act on steal values at regular intervals Shrikanth Hegde
2026-07-02  7:18   ` Shrikanth Hegde
2026-07-06 20:33   ` Yury Norov
2026-07-07  7:16     ` Shrikanth Hegde
2026-07-08 10:33       ` Shrikanth Hegde
2026-07-08 16:13         ` Yury Norov
2026-07-08 16:55           ` Shrikanth Hegde [this message]
2026-07-08 19:59             ` Yury Norov
2026-07-01 14:16 ` [PATCH v6 21/23] virt/steal_monitor: Add direction control Shrikanth Hegde
2026-07-06 20:36   ` Yury Norov
2026-07-07  7:16     ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 22/23] virt/steal_monitor: Add design check of preferred subset of active Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 23/23] virt/steal_monitor: Optimise decrease_preferred_cpus when all CPUs are housekeeping Shrikanth Hegde

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=7eea685e-e5ab-4487-bafb-3131969e5acd@linux.ibm.com \
    --to=sshegde@linux.ibm.com \
    --cc=arighi@nvidia.com \
    --cc=chleroy@kernel.org \
    --cc=christian.loehle@arm.com \
    --cc=corbet@lwn.net \
    --cc=dietmar.eggemann@arm.com \
    --cc=frederic@kernel.org \
    --cc=gregkh@linuxfoundation.org \
    --cc=hdanton@sina.com \
    --cc=huschle@linux.ibm.com \
    --cc=iii@linux.ibm.com \
    --cc=juri.lelli@redhat.com \
    --cc=kernellwp@gmail.com \
    --cc=kprateek.nayak@amd.com \
    --cc=linux-doc@vger.kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=maddy@linux.ibm.com \
    --cc=maz@kernel.org \
    --cc=mingo@kernel.org \
    --cc=pauld@redhat.com \
    --cc=pbonzini@redhat.com \
    --cc=peterz@infradead.org \
    --cc=rafael@kernel.org \
    --cc=rdunlap@infradead.org \
    --cc=rostedt@goodmis.org \
    --cc=seanjc@google.com \
    --cc=srikar@linux.ibm.com \
    --cc=tglx@kernel.org \
    --cc=tj@kernel.org \
    --cc=tommaso.cucinotta@gmail.com \
    --cc=vincent.guittot@linaro.org \
    --cc=vineeth@bitbyteword.org \
    --cc=vschneid@redhat.com \
    --cc=ynorov@nvidia.com \
    --cc=yury.norov@gmail.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox