From: Ben Horgan <ben.horgan@arm.com>
To: Marc Zyngier <maz@kernel.org>
Cc: amitsinght@marvell.com, baisheng.gao@unisoc.com,
baolin.wang@linux.alibaba.com, carl@os.amperecomputing.com,
dave.martin@arm.com, david@kernel.org, dfustini@baylibre.com,
fenghuay@nvidia.com, gshan@redhat.com, james.morse@arm.com,
jonathan.cameron@huawei.com, kobak@nvidia.com,
lcherian@marvell.com, linux-arm-kernel@lists.infradead.org,
linux-kernel@vger.kernel.org, peternewman@google.com,
punit.agrawal@oss.qualcomm.com, quic_jiles@quicinc.com,
reinette.chatre@intel.com, rohit.mathew@arm.com,
scott@os.amperecomputing.com, sdonthineni@nvidia.com,
tan.shaopeng@fujitsu.com, xhao@linux.alibaba.com,
catalin.marinas@arm.com, will@kernel.org, corbet@lwn.net,
oupton@kernel.org, joey.gouly@arm.com, suzuki.poulose@arm.com,
kvmarm@lists.linux.dev
Subject: Re: [PATCH v3 12/47] KVM: arm64: Force guest EL1 to use user-space's partid configuration
Date: Thu, 15 Jan 2026 11:14:36 +0000 [thread overview]
Message-ID: <585ef596-47bf-462f-92da-4a322178115c@arm.com> (raw)
In-Reply-To: <86ldhzkzzb.wl-maz@kernel.org>
Hi Marc,
On 1/15/26 09:05, Marc Zyngier wrote:
> On Wed, 14 Jan 2026 14:50:22 +0000,
> Ben Horgan <ben.horgan@arm.com> wrote:
>>
>> Hi Marc,
>>
>> On 1/14/26 12:06, Marc Zyngier wrote:
>>> On Mon, 12 Jan 2026 16:58:39 +0000,
>>> Ben Horgan <ben.horgan@arm.com> wrote:
>>>>
>>>> From: James Morse <james.morse@arm.com>
>>>>
>>>> While we trap the guest's attempts to read/write the MPAM control
>>>> registers, the hardware continues to use them. Guest-EL0 uses KVM's
>>>> user-space's configuration, as the value is left in the register, and
>>>> guest-EL1 uses either the host kernel's configuration, or in the case of
>>>> VHE, the UNKNOWN reset value of MPAM1_EL1.
>>>>
>>>> We want to force the guest-EL1 to use KVM's user-space's MPAM
>>>> configuration. On nVHE rely on MPAM0_EL1 and MPAM1_EL1 always being
>>>> programmed the same and on VHE copy MPAM0_EL1 into the guest's
>>>> MPAM1_EL1. There is no need to restore as this is out of context once TGE
>>>> is set.
>>>>
>>>> Signed-off-by: James Morse <james.morse@arm.com>
>>>> Signed-off-by: Ben Horgan <ben.horgan@arm.com>
>>>> ---
>>>> Changes since rfc:
>>>> Drop the unneeded __mpam_guest_load() in nvhre and the MPAM1_EL1 save restore
>>>> Defer EL2 handling until next patch
>>>>
>>>> Changes since v2:
>>>> Use mask (Oliver)
>>>> ---
>>>> arch/arm64/kvm/hyp/vhe/sysreg-sr.c | 13 +++++++++++++
>>>> 1 file changed, 13 insertions(+)
>>>>
>>>> diff --git a/arch/arm64/kvm/hyp/vhe/sysreg-sr.c b/arch/arm64/kvm/hyp/vhe/sysreg-sr.c
>>>> index f28c6cf4fe1b..9fb8e6628611 100644
>>>> --- a/arch/arm64/kvm/hyp/vhe/sysreg-sr.c
>>>> +++ b/arch/arm64/kvm/hyp/vhe/sysreg-sr.c
>>>> @@ -183,6 +183,18 @@ void sysreg_restore_guest_state_vhe(struct kvm_cpu_context *ctxt)
>>>> }
>>>> NOKPROBE_SYMBOL(sysreg_restore_guest_state_vhe);
>>>>
>>>> +/*
>>>> + * The _EL0 value was written by the host's context switch and belongs to the
>>>> + * VMM. Copy this into the guest's _EL1 register.
>>>> + */
>>>> +static inline void __mpam_guest_load(void)
>>>> +{
>>>> + u64 mask = MPAM0_EL1_PARTID_D | MPAM0_EL1_PARTID_I | MPAM0_EL1_PMG_D | MPAM0_EL1_PMG_I;
>>>> +
>>>> + if (system_supports_mpam())
>>>> + write_sysreg_el1(read_sysreg_s(SYS_MPAM0_EL1) & mask, SYS_MPAM1);
>>>> +}
>>>> +
>>>> /**
>>>> * __vcpu_load_switch_sysregs - Load guest system registers to the physical CPU
>>>> *
>>>> @@ -222,6 +234,7 @@ void __vcpu_load_switch_sysregs(struct kvm_vcpu *vcpu)
>>>> */
>>>> __sysreg32_restore_state(vcpu);
>>>> __sysreg_restore_user_state(guest_ctxt);
>>>> + __mpam_guest_load();
>>>
>>> What's the rationale for doing this independently of rest of the MPAM
>>> stuff in __activate_traps_mpam()?
>>
>> The __activate_traps_mpam() is relevant even for nvhe but
>> __mpam_guest_load() is only need in vhe as otherwise we can rely on
>> MPAM1_EL1 and MPAM0_EL0 having the same partid/pmg configuration
>
> It is completely unclear to me what enforces this. Please point me to
> the code that does that.
The new MPAM arch code always configures kernel space MPAM configuration
in tandem, same value to MPAM0_EL1 and MPAM1_EL1 (will access MPAM2_EL2
in vhe).
For the cpu part see
PATCH v3 07 arm64: mpam: Re-initialise MPAM regs when CPU comes online
and for context switching part see
PATCH v3 06 arm64: mpam: Context switch the MPAM registers
>
>> (although this MPAM policy will likely become configurable sometime down
>> the line).
>
> Or not. the VM only exists as an extension of userspace, and I don't
> see on what grounds it should get its own MPAM configuration.
There are no plans to give the VM it's own MPAM configuration. The
intent of this patch is to give all the code running in the VM, whether
or not it is at EL0 or EL1, uses the MPAM partid/pmg configuration of
the userspace VMM that is running it. What I was alluding to here is
that if a future host MPAM policy allows the partid/pmg to differ for
the kernel and userspace then we won't be able rely on the EL1
configuration matching EL0 in the nvhe case and so would have to copy
the host EL0 configuration to EL1 (and add a restore).
>
>> Besides that it just makes the naming less exact.
>
> I don't care about the naming. I care about how the configuration flow
> is organised. And so far, this seems extremely messy.
>
> Can you please document what gets configured when and in which mode?
The goal is that all times the VM runs with the same MPAM partid/pmg
configuration
as the userspace vmm running it.
In VHE:
Host kernel configuration is in MPAM2_EL2
Host userspace configuration is in MPAM0_EL1
Guest kernel configuration needs to be in MPAM1_EL1 and so we copy it
there from MPAM0_EL1 when
switching to the guest. On switching back to the host we can just leave
it there as the host doesn't use it.
Guest userspace configuration is in MPAM0_EL1, just keep that unchanged.
In nVHE:
Host kernel configuration is in MPAM1_EL1
Host userspace configuration is in MPAM0_EL1
Once again, guest userspace configuration is in MPAM0_EL1, just keep
that unchanged. As host policy ensures MPAM0_EL1 == MPAM1_EL1 for
pmg/partid we rely on this to skip changing MPAM1_EL1 on guest entry and
to skip the restore on guest exit.
I hope this makes the intent clearer.
Would you prefer to decouple the kvm handling of the MPAM configuration
from the host policy? If so, I expect the MPAM handling can be done
together in __activate_traps_mpam().
Thoughts?
Thanks,
Ben
next prev parent reply other threads:[~2026-01-15 11:15 UTC|newest]
Thread overview: 160+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-01-12 16:58 [PATCH v3 00/47] arm_mpam: Add KVM/arm64 and resctrl glue code Ben Horgan
2026-01-12 16:58 ` [PATCH v3 01/47] arm_mpam: Remove duplicate linux/srcu.h header Ben Horgan
2026-01-12 17:13 ` Fenghua Yu
2026-01-15 2:12 ` Gavin Shan
2026-01-12 16:58 ` [PATCH v3 02/47] arm_mpam: Use non-atomic bitops when modifying feature bitmap Ben Horgan
2026-01-15 2:14 ` Gavin Shan
2026-01-16 11:57 ` Catalin Marinas
2026-01-16 12:02 ` Ben Horgan
2026-01-16 12:12 ` Ben Horgan
2026-01-16 15:51 ` Catalin Marinas
2026-01-12 16:58 ` [PATCH v3 03/47] arm64/sysreg: Add MPAMSM_EL1 register Ben Horgan
2026-01-15 2:16 ` Gavin Shan
2026-01-15 17:59 ` Catalin Marinas
2026-01-12 16:58 ` [PATCH v3 04/47] KVM: arm64: Preserve host MPAM configuration when changing traps Ben Horgan
2026-01-15 2:33 ` Gavin Shan
2026-01-12 16:58 ` [PATCH v3 05/47] KVM: arm64: Make MPAMSM_EL1 accesses UNDEF Ben Horgan
2026-01-15 2:34 ` Gavin Shan
2026-01-12 16:58 ` [PATCH v3 06/47] arm64: mpam: Context switch the MPAM registers Ben Horgan
2026-01-15 6:47 ` Gavin Shan
2026-01-15 12:09 ` Jonathan Cameron
2026-01-19 14:00 ` Ben Horgan
2026-01-20 1:42 ` Gavin Shan
2026-01-15 17:58 ` Catalin Marinas
2026-01-19 12:23 ` Ben Horgan
2026-01-23 14:29 ` Catalin Marinas
2026-01-26 14:30 ` Ben Horgan
2026-01-26 14:50 ` Ben Horgan
2026-01-12 16:58 ` [PATCH v3 07/47] arm64: mpam: Re-initialise MPAM regs when CPU comes online Ben Horgan
2026-01-15 6:50 ` Gavin Shan
2026-01-15 18:14 ` Catalin Marinas
2026-01-19 13:38 ` Ben Horgan
2026-01-19 14:22 ` Ben Horgan
2026-01-12 16:58 ` [PATCH v3 08/47] arm64: mpam: Advertise the CPUs MPAM limits to the driver Ben Horgan
2026-01-15 18:16 ` Catalin Marinas
2026-01-19 6:37 ` Gavin Shan
2026-01-19 14:49 ` Ben Horgan
2026-01-12 16:58 ` [PATCH v3 09/47] arm64: mpam: Add cpu_pm notifier to restore MPAM sysregs Ben Horgan
2026-01-15 18:20 ` Catalin Marinas
2026-01-19 6:40 ` Gavin Shan
2026-01-19 6:50 ` Gavin Shan
2026-01-19 15:08 ` Ben Horgan
2026-01-12 16:58 ` [PATCH v3 10/47] arm64: mpam: Initialise and context switch the MPAMSM_EL1 register Ben Horgan
2026-01-15 19:08 ` Catalin Marinas
2026-01-19 13:40 ` Ben Horgan
2026-01-19 6:51 ` Gavin Shan
2026-01-19 15:31 ` Ben Horgan
2026-01-12 16:58 ` [PATCH v3 11/47] arm64: mpam: Add helpers to change a task or cpu's MPAM PARTID/PMG values Ben Horgan
2026-01-15 19:13 ` Catalin Marinas
2026-01-19 6:56 ` Gavin Shan
2026-01-19 15:47 ` Ben Horgan
2026-01-19 7:01 ` Gavin Shan
2026-01-19 15:49 ` Ben Horgan
2026-01-12 16:58 ` [PATCH v3 12/47] KVM: arm64: Force guest EL1 to use user-space's partid configuration Ben Horgan
2026-01-13 14:19 ` Jonathan Cameron
2026-01-14 12:06 ` Marc Zyngier
2026-01-14 14:50 ` Ben Horgan
2026-01-15 9:05 ` Marc Zyngier
2026-01-15 11:14 ` Ben Horgan [this message]
2026-01-12 16:58 ` [PATCH v3 13/47] KVM: arm64: Use kernel-space partid configuration for hypercalls Ben Horgan
2026-01-13 14:21 ` Jonathan Cameron
2026-01-13 14:35 ` Ben Horgan
2026-01-14 12:09 ` Marc Zyngier
2026-01-14 14:39 ` Ben Horgan
2026-01-14 16:50 ` Ben Horgan
2026-01-14 17:50 ` Marc Zyngier
2026-01-12 16:58 ` [PATCH v3 14/47] arm_mpam: resctrl: Add boilerplate cpuhp and domain allocation Ben Horgan
2026-01-13 16:49 ` Reinette Chatre
2026-01-19 17:20 ` Ben Horgan
2026-01-12 16:58 ` [PATCH v3 15/47] arm_mpam: resctrl: Sort the order of the domain lists Ben Horgan
2026-01-12 16:58 ` [PATCH v3 16/47] arm_mpam: resctrl: Pick the caches we will use as resctrl resources Ben Horgan
2026-01-12 16:58 ` [PATCH v3 17/47] arm_mpam: resctrl: Implement resctrl_arch_reset_all_ctrls() Ben Horgan
2026-01-13 14:46 ` Jonathan Cameron
2026-01-13 14:58 ` Ben Horgan
2026-01-12 16:58 ` [PATCH v3 18/47] arm_mpam: resctrl: Add resctrl_arch_get_config() Ben Horgan
2026-01-12 16:58 ` [PATCH v3 19/47] arm_mpam: resctrl: Implement helpers to update configuration Ben Horgan
2026-01-12 16:58 ` [PATCH v3 20/47] arm_mpam: resctrl: Add plumbing against arm64 task and cpu hooks Ben Horgan
2026-01-12 16:58 ` [PATCH v3 21/47] arm_mpam: resctrl: Add CDP emulation Ben Horgan
2026-01-12 16:58 ` [PATCH v3 22/47] arm_mpam: resctrl: Convert to/from MPAMs fixed-point formats Ben Horgan
2026-01-12 16:58 ` [PATCH v3 23/47] arm_mpam: resctrl: Add kunit test for control format conversions Ben Horgan
2026-01-12 16:58 ` [PATCH v3 24/47] arm_mpam: resctrl: Add rmid index helpers Ben Horgan
2026-01-13 14:55 ` Jonathan Cameron
2026-01-12 16:58 ` [PATCH v3 25/47] arm_mpam: resctrl: Add kunit test for rmid idx conversions Ben Horgan
2026-01-13 14:59 ` Jonathan Cameron
2026-01-12 16:58 ` [PATCH v3 26/47] arm_mpam: resctrl: Wait for cacheinfo to be ready Ben Horgan
2026-01-13 15:01 ` Jonathan Cameron
2026-01-13 15:15 ` Ben Horgan
2026-01-12 16:58 ` [PATCH v3 27/47] arm_mpam: resctrl: Add support for 'MB' resource Ben Horgan
2026-01-13 15:06 ` Jonathan Cameron
2026-01-13 22:18 ` Reinette Chatre
2026-01-19 11:53 ` Gavin Shan
2026-01-19 13:53 ` Ben Horgan
2026-01-12 16:58 ` [PATCH v3 28/47] arm_mpam: resctrl: Add support for csu counters Ben Horgan
2026-01-13 23:14 ` Reinette Chatre
2026-01-15 15:43 ` Ben Horgan
2026-01-15 18:54 ` Reinette Chatre
2026-01-16 10:29 ` Ben Horgan
2026-01-20 15:28 ` Peter Newman
2026-01-21 17:58 ` Reinette Chatre
2026-01-30 11:07 ` Ben Horgan
2026-01-30 11:19 ` Ben Horgan
2026-01-12 16:58 ` [PATCH v3 29/47] arm_mpam: resctrl: Pick classes for use as mbm counters Ben Horgan
2026-01-15 15:49 ` Peter Newman
2026-01-19 12:04 ` James Morse
2026-01-19 12:47 ` Peter Newman
2026-01-26 16:00 ` Ben Horgan
2026-01-30 13:04 ` Peter Newman
2026-01-30 14:38 ` Ben Horgan
2026-01-12 16:58 ` [PATCH v3 30/47] arm_mpam: resctrl: Pre-allocate free running monitors Ben Horgan
2026-01-13 15:10 ` Jonathan Cameron
2026-01-19 11:57 ` Gavin Shan
2026-01-19 20:27 ` Ben Horgan
2026-01-12 16:58 ` [PATCH v3 31/47] arm_mpam: resctrl: Pre-allocate assignable monitors Ben Horgan
2026-01-16 10:34 ` Shaopeng Tan (Fujitsu)
2026-01-16 11:04 ` Ben Horgan
2026-01-19 20:34 ` Ben Horgan
2026-01-12 16:58 ` [PATCH v3 32/47] arm_mpam: resctrl: Add kunit test for ABMC/CDP interactions Ben Horgan
2026-01-13 15:26 ` Jonathan Cameron
2026-01-12 16:59 ` [PATCH v3 33/47] arm_mpam: resctrl: Add resctrl_arch_config_cntr() for ABMC use Ben Horgan
2026-01-12 16:59 ` [PATCH v3 34/47] arm_mpam: resctrl: Allow resctrl to allocate monitors Ben Horgan
2026-01-12 16:59 ` [PATCH v3 35/47] arm_mpam: resctrl: Add resctrl_arch_rmid_read() and resctrl_arch_reset_rmid() Ben Horgan
2026-01-12 16:59 ` [PATCH v3 36/47] arm_mpam: resctrl: Add resctrl_arch_cntr_read() & resctrl_arch_reset_cntr() Ben Horgan
2026-01-12 16:59 ` [PATCH v3 37/47] arm_mpam: resctrl: Update the rmid reallocation limit Ben Horgan
2026-01-15 10:05 ` Shaopeng Tan (Fujitsu)
2026-01-15 16:02 ` Ben Horgan
2026-01-12 16:59 ` [PATCH v3 38/47] arm_mpam: resctrl: Add empty definitions for assorted resctrl functions Ben Horgan
2026-01-12 16:59 ` [PATCH v3 39/47] arm64: mpam: Select ARCH_HAS_CPU_RESCTRL Ben Horgan
2026-01-15 19:16 ` Catalin Marinas
2026-01-12 16:59 ` [PATCH v3 40/47] arm_mpam: resctrl: Call resctrl_init() on platforms that can support resctrl Ben Horgan
2026-01-12 16:59 ` [PATCH v3 41/47] arm_mpam: Generate a configuration for min controls Ben Horgan
2026-01-13 15:39 ` Jonathan Cameron
2026-01-30 14:17 ` Ben Horgan
2026-01-31 2:30 ` Shanker Donthineni
2026-02-02 10:21 ` Ben Horgan
2026-02-02 16:34 ` Shanker Donthineni
2026-02-03 9:33 ` Ben Horgan
2026-01-12 16:59 ` [PATCH v3 42/47] arm_mpam: resctrl: Add kunit test for mbw min control generation Ben Horgan
2026-01-13 15:43 ` Jonathan Cameron
2026-01-12 16:59 ` [PATCH v3 43/47] arm_mpam: Add quirk framework Ben Horgan
2026-01-19 12:14 ` Gavin Shan
2026-01-19 20:48 ` Ben Horgan
2026-01-12 16:59 ` [PATCH v3 44/47] arm_mpam: Add workaround for T241-MPAM-1 Ben Horgan
2026-01-19 12:16 ` Gavin Shan
2026-01-19 20:54 ` Ben Horgan
2026-01-12 16:59 ` [PATCH v3 45/47] arm_mpam: Add workaround for T241-MPAM-4 Ben Horgan
2026-01-15 23:20 ` Fenghua Yu
2026-01-19 20:56 ` Ben Horgan
2026-01-29 22:14 ` Fenghua Yu
2026-01-30 12:21 ` Ben Horgan
2026-01-12 16:59 ` [PATCH v3 46/47] arm_mpam: Add workaround for T241-MPAM-6 Ben Horgan
2026-01-12 16:59 ` [PATCH v3 47/47] arm_mpam: Quirk CMN-650's CSU NRDY behaviour Ben Horgan
2026-01-19 12:18 ` Gavin Shan
2026-01-19 20:58 ` Ben Horgan
2026-01-14 6:51 ` [PATCH RESEND v2 0/45] arm_mpam: Add KVM/arm64 and resctrl glue code Zeng Heng
2026-01-15 14:37 ` Ben Horgan
2026-01-15 11:14 ` [PATCH v3 00/47] " Peter Newman
2026-01-15 11:36 ` Ben Horgan
2026-01-16 10:47 ` Shaopeng Tan (Fujitsu)
2026-01-16 11:05 ` Ben Horgan
2026-01-16 15:47 ` (subset) " Catalin Marinas
2026-01-19 1:30 ` Gavin Shan
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=585ef596-47bf-462f-92da-4a322178115c@arm.com \
--to=ben.horgan@arm.com \
--cc=amitsinght@marvell.com \
--cc=baisheng.gao@unisoc.com \
--cc=baolin.wang@linux.alibaba.com \
--cc=carl@os.amperecomputing.com \
--cc=catalin.marinas@arm.com \
--cc=corbet@lwn.net \
--cc=dave.martin@arm.com \
--cc=david@kernel.org \
--cc=dfustini@baylibre.com \
--cc=fenghuay@nvidia.com \
--cc=gshan@redhat.com \
--cc=james.morse@arm.com \
--cc=joey.gouly@arm.com \
--cc=jonathan.cameron@huawei.com \
--cc=kobak@nvidia.com \
--cc=kvmarm@lists.linux.dev \
--cc=lcherian@marvell.com \
--cc=linux-arm-kernel@lists.infradead.org \
--cc=linux-kernel@vger.kernel.org \
--cc=maz@kernel.org \
--cc=oupton@kernel.org \
--cc=peternewman@google.com \
--cc=punit.agrawal@oss.qualcomm.com \
--cc=quic_jiles@quicinc.com \
--cc=reinette.chatre@intel.com \
--cc=rohit.mathew@arm.com \
--cc=scott@os.amperecomputing.com \
--cc=sdonthineni@nvidia.com \
--cc=suzuki.poulose@arm.com \
--cc=tan.shaopeng@fujitsu.com \
--cc=will@kernel.org \
--cc=xhao@linux.alibaba.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox