Linux Documentation
 help / color / mirror / Atom feed
From: "Moger, Babu" <bmoger@amd.com>
To: Reinette Chatre <reinette.chatre@intel.com>,
	Babu Moger <babu.moger@amd.com>,
	corbet@lwn.net, tony.luck@intel.com, Dave.Martin@arm.com,
	james.morse@arm.com, tglx@kernel.org, bp@alien8.de,
	dave.hansen@linux.intel.com
Cc: skhan@linuxfoundation.org, x86@kernel.org, mingo@redhat.com,
	hpa@zytor.com, akpm@linux-foundation.org, rdunlap@infradead.org,
	pawan.kumar.gupta@linux.intel.com, feng.tang@linux.alibaba.com,
	dapeng1.mi@linux.intel.com, kees@kernel.org, elver@google.com,
	lirongqing@baidu.com, paulmck@kernel.org, bhelgaas@google.com,
	seanjc@google.com, alexandre.chartre@oracle.com,
	yazen.ghannam@amd.com, peterz@infradead.org,
	chang.seok.bae@intel.com, kim.phillips@amd.com, xin@zytor.com,
	naveen@kernel.org, thomas.lendacky@amd.com,
	linux-doc@vger.kernel.org, linux-kernel@vger.kernel.org,
	eranian@google.com, peternewman@google.com
Subject: Re: [PATCH v3 04/12] x86,fs/resctrl: Program PLZA through kmode arch hooks
Date: Wed, 17 Jun 2026 18:15:21 -0500	[thread overview]
Message-ID: <e2f118b8-289c-481f-bf57-33a698598034@amd.com> (raw)
In-Reply-To: <6273f424-9701-4731-9568-10b3eef8b5fd@intel.com>

Hi Reinette,

On 6/16/2026 6:33 PM, Reinette Chatre wrote:
> Hi Babu,
> 
> On 4/30/26 4:24 PM, Babu Moger wrote:
>> AMD Privilege Level Zero Association (PLZA) exposes kernel CLOSID/RMID
>> association through MSR_IA32_PQR_PLZA_ASSOC.  Generic resctrl already
>> tracks supported and effective kernel-mode policy in struct
>> resctrl_kmode_cfg, but the architecture layer needs a callable entry point
>> that can push those values into per-CPU hardware on a chosen CPU mask.
>>
>> Declare resctrl_arch_configure_kmode() in linux/resctrl.h with kernel-doc.
>> Implement it on x86: add an SMP callback that writes
>> MSR_IA32_PQR_PLZA_ASSOC on each targeted CPU, and use on_each_cpu_mask()
>> for the broadcast.
> 
> Above is clear from the patch. Please start with focus on why this patch is
> needed.
> 
>>
>> The hook is unused in this patch; later patches in the series wire it into
> 
> Similar to previous work: write changelog in imperative tone and do not
> refer to patches in series but instead let each patch stand on its own.

Will rewrite the changelog.

> 
>> generic resctrl when an effective kernel-mode policy is selected or a CPU
>> mask changes.
>>
>> Signed-off-by: Babu Moger <babu.moger@amd.com>
>> ---
> 
> 
>> ---
>>   arch/x86/kernel/cpu/resctrl/ctrlmondata.c | 35 +++++++++++++++++++++++
>>   include/linux/resctrl.h                   | 10 +++++++
>>   2 files changed, 45 insertions(+)
>>
>> diff --git a/arch/x86/kernel/cpu/resctrl/ctrlmondata.c b/arch/x86/kernel/cpu/resctrl/ctrlmondata.c
>> index b20e705606b8..68f1cf503904 100644
>> --- a/arch/x86/kernel/cpu/resctrl/ctrlmondata.c
>> +++ b/arch/x86/kernel/cpu/resctrl/ctrlmondata.c
>> @@ -131,3 +131,38 @@ int resctrl_arch_io_alloc_enable(struct rdt_resource *r, bool enable)
>>   
>>   	return 0;
>>   }
>> +
>> +/*
>> + * SMP call-function callback: each CPU writes its own MSR_IA32_PQR_PLZA_ASSOC
>> + * (AMD PLZA).  Invoked via on_each_cpu_mask() with wait=1 so the on-stack
>> + * union pointed at by @arg is safe.
>> + */
>> +static void resctrl_kmode_set_one_amd(void *arg)
>> +{
>> +	union msr_pqr_plza_assoc *plza = arg;
>> +
>> +	wrmsrl(MSR_IA32_PQR_PLZA_ASSOC, plza->full);
> 
> fyi ...
> commit 2232959db26d ("x86/msr: Switch wrmsrl() users to wrmsrq()")
> commit b5884070f9da ("x86/msr: Remove wrmsrl()")
> 

Yes. Saw that. Will change it to wrmsrq.

>> +}
>> +
>> +/**
>> + * resctrl_arch_configure_kmode() - x86/AMD: program PLZA MSR on a CPU subset
>> + * @cpu_mask:	CPUs to receive the update (see on_each_cpu_mask() for online subset).
> 
> Why is the caveat added? Will resctrl ever provide offline CPUs in the mask?

No. Offline CPUs will not be provided. I am not sure why I added that 
caveat. Probably came from AI review. Will remove.

> 
>> + * @closid:	CLOSID field written into the MSR with CLOSID_EN set.
>> + * @rmid:	RMID field written into the MSR with RMID_EN set.
>> + * @enable:	Value for the PLZA_EN split field.
> 
> Please describe the meaning of the fields instead the mechanics of the code
> that are obvious.

ok.

> 
>> + *
>> + * Context: Do not call with IRQs off or from IRQ context except as allowed for
>> + * on_each_cpu_mask(); see kernel/smp.c.
> 
> Why is this context caveat needed?

Again, Probably came from AI review. Does not look relevant. Will remove.

> 
>> + */
>> +void resctrl_arch_configure_kmode(cpumask_var_t cpu_mask, u32 closid, u32 rmid, bool enable)
> 
> Please replace "cpumask_var_t cpu_mask" with "const struct cpumask *cpu_mask".

Sure.

> 
>> +{
>> +	union msr_pqr_plza_assoc plza = { 0 };
>> +
>> +	plza.split.rmid = rmid;
>> +	plza.split.rmid_en = 1;
>> +	plza.split.closid = closid;
>> +	plza.split.closid_en = 1;
>> +	plza.split.plza_en = enable;
>> +
>> +	on_each_cpu_mask(cpu_mask, resctrl_kmode_set_one_amd, &plza, 1);
>> +}
> 
> function self has been discussed already
> 
>> diff --git a/include/linux/resctrl.h b/include/linux/resctrl.h
>> index ce28418df00f..570918e57e24 100644
>> --- a/include/linux/resctrl.h
>> +++ b/include/linux/resctrl.h
>> @@ -712,6 +712,16 @@ bool resctrl_arch_get_io_alloc_enabled(struct rdt_resource *r);
>>    */
>>   void resctrl_arch_get_kmode_support(struct resctrl_kmode_cfg *kcfg);
>>   
>> +/**
>> + * resctrl_arch_configure_kmode() - Program MSR_IA32_PQR_PLZA_ASSOC on CPUs in @cpu_mask
>> + * @cpu_mask:	Target CPUs; on_each_cpu_mask() applies the callback on the online subset.
>> + * @closid:	CLOSID written to the MSR with CLOSID_EN set.
>> + * @rmid:	RMID written to the MSR with RMID_EN set.
>> + * @enable:	PLZA_EN field value for this update.
> 
> This is a resctrl fs API - please replace all the AMD architecture specific implementation details
> with what the parameters actually mean/represent.

Sure. Will rewrite it.

Thanks

Babu

  reply	other threads:[~2026-06-17 23:15 UTC|newest]

Thread overview: 44+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-04-30 23:24 [PATCH v3 00/12] [PATCH v3 00/12] x86/resctrl: Add kernel-mode (e.g., PLZA) support to the resctrl subsystem Babu Moger
2026-04-30 23:24 ` [PATCH v3 01/12] x86/resctrl: Support Privilege-Level Zero Association (PLZA) Babu Moger
2026-06-11 23:23   ` Reinette Chatre
2026-06-12 16:56     ` Moger, Babu
2026-06-12 17:00       ` Moger, Babu
2026-06-17  0:00       ` Reinette Chatre
2026-06-17 16:28         ` Babu Moger
2026-04-30 23:24 ` [PATCH v3 02/12] x86/resctrl: Add data structures and definitions for PLZA configuration Babu Moger
2026-06-11 23:40   ` Reinette Chatre
2026-06-12 15:40     ` Luck, Tony
2026-06-12 17:46       ` Moger, Babu
2026-06-12 17:32     ` Moger, Babu
2026-06-12 17:49       ` Moger, Babu
2026-04-30 23:24 ` [PATCH v3 03/12] fs/resctrl: Add kernel mode (kmode) data structures and arch hook Babu Moger
2026-06-16 23:30   ` Reinette Chatre
2026-06-17 19:36     ` Babu Moger
2026-04-30 23:24 ` [PATCH v3 04/12] x86,fs/resctrl: Program PLZA through kmode arch hooks Babu Moger
2026-05-19 20:59   ` Luck, Tony
2026-05-20 17:49     ` Babu Moger
2026-05-20 22:16       ` Luck, Tony
2026-05-20 23:09         ` Moger, Babu
2026-06-11 11:44           ` Peter Newman
2026-06-11 14:46             ` Babu Moger
2026-06-16 23:33   ` Reinette Chatre
2026-06-17 23:15     ` Moger, Babu [this message]
2026-04-30 23:24 ` [PATCH v3 05/12] x86/resctrl: Initialize supported kernel modes for PLZA Babu Moger
2026-06-16 23:35   ` Reinette Chatre
2026-04-30 23:24 ` [PATCH v3 06/12] fs/resctrl: Initialize the global kernel-mode policy at subsystem init Babu Moger
2026-06-16 23:36   ` Reinette Chatre
2026-04-30 23:24 ` [PATCH v3 07/12] fs/resctrl: Add info/kernel_mode for kernel-mode policy introspection Babu Moger
2026-06-16 23:38   ` Reinette Chatre
2026-04-30 23:24 ` [PATCH v3 08/12] fs/resctrl: Make info/kernel_mode writable and identify the bound group Babu Moger
2026-06-16 23:42   ` Reinette Chatre
2026-04-30 23:24 ` [PATCH v3 09/12] fs/resctrl: Reset kernel-mode binding when its rdtgroup goes away Babu Moger
2026-06-16 23:42   ` Reinette Chatre
2026-04-30 23:24 ` [PATCH v3 10/12] fs/resctrl: Expose kmode_cpus / kmode_cpus_list per rdtgroup Babu Moger
2026-04-30 23:24 ` [PATCH v3 11/12] resctrl: Hide kmode_cpus[_list] on groups not bound to kernel-mode Babu Moger
2026-04-30 23:24 ` [PATCH v3 12/12] fs/resctrl: Allow user space to write kmode_cpus / kmode_cpus_list Babu Moger
2026-06-11 21:53 ` [PATCH v3 00/12] [PATCH v3 00/12] x86/resctrl: Add kernel-mode (e.g., PLZA) support to the resctrl subsystem Reinette Chatre
2026-06-12 15:37   ` Moger, Babu
2026-06-17  4:34     ` Reinette Chatre
2026-06-17 15:56       ` Babu Moger
2026-06-17 17:33         ` Reinette Chatre
2026-06-17 19:55           ` Babu Moger

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=e2f118b8-289c-481f-bf57-33a698598034@amd.com \
    --to=bmoger@amd.com \
    --cc=Dave.Martin@arm.com \
    --cc=akpm@linux-foundation.org \
    --cc=alexandre.chartre@oracle.com \
    --cc=babu.moger@amd.com \
    --cc=bhelgaas@google.com \
    --cc=bp@alien8.de \
    --cc=chang.seok.bae@intel.com \
    --cc=corbet@lwn.net \
    --cc=dapeng1.mi@linux.intel.com \
    --cc=dave.hansen@linux.intel.com \
    --cc=elver@google.com \
    --cc=eranian@google.com \
    --cc=feng.tang@linux.alibaba.com \
    --cc=hpa@zytor.com \
    --cc=james.morse@arm.com \
    --cc=kees@kernel.org \
    --cc=kim.phillips@amd.com \
    --cc=linux-doc@vger.kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=lirongqing@baidu.com \
    --cc=mingo@redhat.com \
    --cc=naveen@kernel.org \
    --cc=paulmck@kernel.org \
    --cc=pawan.kumar.gupta@linux.intel.com \
    --cc=peternewman@google.com \
    --cc=peterz@infradead.org \
    --cc=rdunlap@infradead.org \
    --cc=reinette.chatre@intel.com \
    --cc=seanjc@google.com \
    --cc=skhan@linuxfoundation.org \
    --cc=tglx@kernel.org \
    --cc=thomas.lendacky@amd.com \
    --cc=tony.luck@intel.com \
    --cc=x86@kernel.org \
    --cc=xin@zytor.com \
    --cc=yazen.ghannam@amd.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox