The Linux Kernel Mailing List
 help / color / mirror / Atom feed
From: Shrikanth Hegde <sshegde@linux.ibm.com>
To: Yury Norov <ynorov@nvidia.com>
Cc: linux-kernel@vger.kernel.org, mingo@kernel.org,
	peterz@infradead.org, juri.lelli@redhat.com,
	vincent.guittot@linaro.org, yury.norov@gmail.com,
	kprateek.nayak@amd.com, iii@linux.ibm.com, corbet@lwn.net,
	tglx@kernel.org, gregkh@linuxfoundation.org, pbonzini@redhat.com,
	seanjc@google.com, vschneid@redhat.com, huschle@linux.ibm.com,
	rostedt@goodmis.org, dietmar.eggemann@arm.com,
	maddy@linux.ibm.com, srikar@linux.ibm.com, hdanton@sina.com,
	chleroy@kernel.org, vineeth@bitbyteword.org, frederic@kernel.org,
	arighi@nvidia.com, pauld@redhat.com, christian.loehle@arm.com,
	tj@kernel.org, tommaso.cucinotta@gmail.com, maz@kernel.org,
	rafael@kernel.org, rdunlap@infradead.org, kernellwp@gmail.com,
	linux-doc@vger.kernel.org
Subject: Re: [PATCH v6 12/23] virt: Introduce steal monitor driver
Date: Mon, 6 Jul 2026 13:39:59 +0530	[thread overview]
Message-ID: <b1f03a02-b573-4779-95e4-c65e6b50c03e@linux.ibm.com> (raw)
In-Reply-To: <akf9cE22wvPeYNiM@yury>

Hi Yury.

On 7/3/26 11:50 PM, Yury Norov wrote:
> On Wed, Jul 01, 2026 at 07:46:43PM +0530, Shrikanth Hegde wrote:
>> Introduce a new driver in virt named steal_monitor. This driver
>> will compute the steal time and drive the policy decisions of preferred
>> CPU state.
>>
>> More on it can be found in the Documentation/driver-api/steal-monitor.rst
>> Introduce the skeleton code first.
>>
>> There is no new kconfig. It depends on CONFIG_PREFERRED_CPU.
>> - If CONFIG_PREFERRED_CPU=y, it gets compiled as a module. It is not
>>    loaded by default.
>> - If CONFIG_PREFERRED_CPU=n, module isn't compiled.
>>
>> File layout of the driver is designed with having arch specific
>> files in the future.
>>
>> - sm_core.c - contains main driver code. This includes the periodic
>>    work function and take action on steal time.
>> - defaults.c - contains the default implementation defined with __weak
>>    symbols.
>> - sm_core.h - header file which includes data structure.
>>
>> Signed-off-by: Shrikanth Hegde <sshegde@linux.ibm.com>
> 
> You've split the driver code into 12 patches. It makes it impossible
> to review the driver as a whole. Please make it less granular. 2 or 3
> patches for the new driver is more than enough, I think.
> 

Ok. I assumed splitting into more makes it easy to review.

I will plan to make it 4-5 patches.

1. Introduce the driver (include doc, skeleton code, datastructure)
    0011-virt-steal_monitor-Add-documentation.patch
    0012-virt-Introduce-steal-monitor-driver.patch
    0013-virt-steal_monitor-Restore-to-active-on-module-di.patch
    0014-virt-steal_monitor-Define-steal_monitor-structure.patch

2. Add debug knobs as module parameters. (as it is slightly longer patch with module_named_cb methods)
    0015-virt-steal_monitor-Add-control-knobs-for-handling.patch

3. Add default callback functions (i.e implemented as __weak)
    0017-virt-steal_monitor-Provide-default-method-to-get-.patch
    0018-virt-steal_monitor-Provide-default-method-to-inc-.patch
    0019-virt-steal_monitor-Provide-default-method-to-get-.patch

4. Handle periodic work and act on steal time.
    0016-virt-steal_monitor-Compute-work-at-regular-interv.patch
    0020-virt-steal_monitor-Act-on-steal-values-at-regular.patch
    0021-virt-steal_monitor-Add-direction-control.patch
    0022-virt-steal_monitor-Add-design-checks.patch

Does that look better?

>> ---
>>   drivers/virt/Makefile                |  1 +
>>   drivers/virt/steal_monitor/Makefile  | 14 ++++++++++++
>>   drivers/virt/steal_monitor/sm_core.c | 33 ++++++++++++++++++++++++++++
>>   drivers/virt/steal_monitor/sm_core.h | 11 ++++++++++
>>   4 files changed, 59 insertions(+)
>>   create mode 100644 drivers/virt/steal_monitor/Makefile
>>   create mode 100644 drivers/virt/steal_monitor/sm_core.c
>>   create mode 100644 drivers/virt/steal_monitor/sm_core.h
>>
>> diff --git a/drivers/virt/Makefile b/drivers/virt/Makefile
>> index f29901bd7820..aff715cea42d 100644
>> --- a/drivers/virt/Makefile
>> +++ b/drivers/virt/Makefile
>> @@ -9,4 +9,5 @@ obj-y				+= vboxguest/
>>   
>>   obj-$(CONFIG_NITRO_ENCLAVES)	+= nitro_enclaves/
>>   obj-$(CONFIG_ACRN_HSM)		+= acrn/
>> +obj-$(CONFIG_PREFERRED_CPU)	+= steal_monitor/
>>   obj-y				+= coco/
>> diff --git a/drivers/virt/steal_monitor/Makefile b/drivers/virt/steal_monitor/Makefile
>> new file mode 100644
>> index 000000000000..24cee55342ce
>> --- /dev/null
>> +++ b/drivers/virt/steal_monitor/Makefile
>> @@ -0,0 +1,14 @@
>> +# SPDX-License-Identifier: GPL-2.0-only
>> +#
>> +# Steal time monitor to alter preferred CPU state.
>> +#
>> +# Arch can implement strong function definitions and override the
>> +# default by adding them in arch specific file. It must ensure
>> +# that preferred is always subset of active.
>> +#
>> +# It is always compiled as module if CONFIG_PREFERRED_CPU=y
>> +# One has to enable the module.
> 
> Why?
> 

Few Reasons on Why i made it as default no:

- Since it is co-operative scheme, admin user/root user will enable it.
   When he does that, we have asked him/her to ensure it is enabled on all
   VM's. At-least he/she will check other VM's kernel versions when enabling it.

- This periodic work has a bit of overhead. So enabling it by default, one may question
   why add it when user's don't need it. For example, in powerpc a VM can be brought up
   a dedicated. In that it is not expected to see any steal time. By same logic, having this
   module enabled in Host kernel doesn't make any sense since it will never see steal time.
   (If one compiles the same kernel for both guest and host)

  parent reply	other threads:[~2026-07-06  8:10 UTC|newest]

Thread overview: 55+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-07-01 14:16 [PATCH v6 00/23] sched: Introduce cpu_preferred_mask and steal-driven vCPU backoff Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 01/23] sched/docs: Document cpu_preferred_mask and Preferred CPU concept Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 02/23] kconfig: Provide PREFERRED_CPU option Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 03/23] cpumask: Introduce cpu_preferred_mask Shrikanth Hegde
2026-07-01 15:35   ` Yury Norov
2026-07-01 16:40     ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 04/23] sysfs: Add preferred CPU file Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 05/23] sched/core: Try to use a preferred CPU in is_cpu_allowed Shrikanth Hegde
2026-07-01 16:09   ` Yury Norov
2026-07-01 16:49     ` Shrikanth Hegde
2026-07-02  6:30       ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 06/23] sched/fair: Load balance only among preferred CPUs Shrikanth Hegde
2026-07-01 16:19   ` Yury Norov
2026-07-01 16:41     ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 07/23] sched/fair: Pull the load on preferred CPU Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 08/23] sched/core: Keep tick on non-preferred CPUs until tasks are out Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 09/23] sched/core: Push current task from non preferred CPU Shrikanth Hegde
2026-07-01 16:50   ` Yury Norov
2026-07-01 17:03     ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 10/23] sched/debug: Add migration stats due to non preferred CPUs Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 11/23] virt/steal_monitor: Add documentation Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 12/23] virt: Introduce steal monitor driver Shrikanth Hegde
2026-07-03 18:20   ` Yury Norov
2026-07-03 18:27     ` Yury Norov
2026-07-06  8:24       ` Shrikanth Hegde
2026-07-06 18:49         ` Yury Norov
2026-07-07  6:47           ` Shrikanth Hegde
2026-07-06  8:09     ` Shrikanth Hegde [this message]
2026-07-01 14:16 ` [PATCH v6 13/23] virt/steal_monitor: Restore to active on module disable Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 14/23] virt/steal_monitor: Define steal_monitor structure Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 15/23] virt/steal_monitor: Add control knobs for handling steal values Shrikanth Hegde
2026-07-02  7:16   ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 16/23] virt/steal_monitor: Compute work at regular intervals Shrikanth Hegde
2026-07-03 18:14   ` Yury Norov
2026-07-06  8:38     ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 17/23] virt/steal_monitor: Provide default method to get systemwide steal time Shrikanth Hegde
2026-07-03 19:16   ` Yury Norov
2026-07-06  8:47     ` Shrikanth Hegde
2026-07-06 19:04       ` Yury Norov
2026-07-07  6:50         ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 18/23] virt/steal_monitor: Provide default method to inc/dec preferred CPUs Shrikanth Hegde
2026-07-03 21:11   ` Yury Norov
2026-07-06  9:20     ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 19/23] virt/steal_monitor: Provide default method to get num of CPUs for steal ratio Shrikanth Hegde
2026-07-06 19:26   ` Yury Norov
2026-07-07  6:55     ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 20/23] virt/steal_monitor: Act on steal values at regular intervals Shrikanth Hegde
2026-07-02  7:18   ` Shrikanth Hegde
2026-07-06 20:33   ` Yury Norov
2026-07-07  7:16     ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 21/23] virt/steal_monitor: Add direction control Shrikanth Hegde
2026-07-06 20:36   ` Yury Norov
2026-07-07  7:16     ` Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 22/23] virt/steal_monitor: Add design check of preferred subset of active Shrikanth Hegde
2026-07-01 14:16 ` [PATCH v6 23/23] virt/steal_monitor: Optimise decrease_preferred_cpus when all CPUs are housekeeping Shrikanth Hegde

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=b1f03a02-b573-4779-95e4-c65e6b50c03e@linux.ibm.com \
    --to=sshegde@linux.ibm.com \
    --cc=arighi@nvidia.com \
    --cc=chleroy@kernel.org \
    --cc=christian.loehle@arm.com \
    --cc=corbet@lwn.net \
    --cc=dietmar.eggemann@arm.com \
    --cc=frederic@kernel.org \
    --cc=gregkh@linuxfoundation.org \
    --cc=hdanton@sina.com \
    --cc=huschle@linux.ibm.com \
    --cc=iii@linux.ibm.com \
    --cc=juri.lelli@redhat.com \
    --cc=kernellwp@gmail.com \
    --cc=kprateek.nayak@amd.com \
    --cc=linux-doc@vger.kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=maddy@linux.ibm.com \
    --cc=maz@kernel.org \
    --cc=mingo@kernel.org \
    --cc=pauld@redhat.com \
    --cc=pbonzini@redhat.com \
    --cc=peterz@infradead.org \
    --cc=rafael@kernel.org \
    --cc=rdunlap@infradead.org \
    --cc=rostedt@goodmis.org \
    --cc=seanjc@google.com \
    --cc=srikar@linux.ibm.com \
    --cc=tglx@kernel.org \
    --cc=tj@kernel.org \
    --cc=tommaso.cucinotta@gmail.com \
    --cc=vincent.guittot@linaro.org \
    --cc=vineeth@bitbyteword.org \
    --cc=vschneid@redhat.com \
    --cc=ynorov@nvidia.com \
    --cc=yury.norov@gmail.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox