Linux KVM/arm64 development list
 help / color / mirror / Atom feed
From: Sascha Bischoff <Sascha.Bischoff@arm.com>
To: "sashiko-reviews@lists.linux.dev" <sashiko-reviews@lists.linux.dev>
Cc: "maz@kernel.org" <maz@kernel.org>,
	"kvm@vger.kernel.org" <kvm@vger.kernel.org>,
	"kvmarm@lists.linux.dev" <kvmarm@lists.linux.dev>,
	"oupton@kernel.org" <oupton@kernel.org>, nd <nd@arm.com>
Subject: Re: [PATCH v5 20/49] KVM: arm64: gic-v5: Add GICv5 IRS IODEV and MMIO emulation
Date: Fri, 4 Sep 2026 08:47:46 +0000	[thread overview]
Message-ID: <4689ec951b2a526903573825b4ffd0bddb1c35bb.camel@arm.com> (raw)
In-Reply-To: <20260807143425.E88601F000E9@smtp.kernel.org>

On Fri, 2026-08-07 at 14:34 +0000, sashiko-bot@kernel.org wrote:
> Thank you for your contribution! Sashiko AI review found 3 potential
> issue(s) to consider:
> - [High] 64-bit IRS MMIO registers lack support for 32-bit accesses,
> leading to unhandled MMIO aborts and broken read-modify-write
> behavior.
> - [Medium] Missing locking in the IRS IST MMIO read handler allows
> guests to observe logically torn register states.
> - [Medium] Lockless, sequential updates to GICV5_IRS_CR1 can result
> in a torn MMIO write.
> --
> 
> --- Patch [20]: [PATCH v5 20/49] KVM: arm64: gic-v5: Add GICv5 IRS
> IODEV and MMIO emulation ---
> commit e3d747ac0ec8b60b894092ad4f2dc0c7959423ef
> Author: Sascha Bischoff <Sascha.Bischoff@arm.com>
> 
> KVM: arm64: gic-v5: Add GICv5 IRS IODEV and MMIO emulation
>     
> In order to properly support GICv5-based VMs in KVM, emulate the
> CONFIG_FRAME for a virtual IRS. This emulation needs to handle guest
> accesses to the MMIO region and mimic the behaviour of a real IRS.
> 
> > diff --git a/arch/arm64/kvm/vgic/vgic-irs-v5.c
> > b/arch/arm64/kvm/vgic/vgic-irs-v5.c
> > new file mode 100644
> > index 0000000000000..c6280795ab551
> > --- /dev/null
> > +++ b/arch/arm64/kvm/vgic/vgic-irs-v5.c
> 
> [ ... ]
> 
> > @@ -0,0 +1,765 @@
> [ ... ]
> > +static void vgic_v5_mmio_write_irs_misc(struct kvm_vcpu *vcpu,
> > gpa_t addr,
> > +					unsigned int len, unsigned
> > long val)
> > +{
> > +	struct vgic_v5_irs *irs = vgic_v5_get_irs(vcpu);
> > +	struct vgic_dist *vgic = vgic_v5_get_vgic(vcpu);
> > +	const size_t offset = addr & (SZ_64K - 1);
> > +
> > +	switch (offset) {
> [ ... ]
> > +	case GICV5_IRS_CR1:
> > +		irs->cr1.sh = FIELD_GET(GICV5_IRS_CR1_SH, val);
> > +		irs->cr1.oc = FIELD_GET(GICV5_IRS_CR1_OC, val);
> > +		irs->cr1.ic = FIELD_GET(GICV5_IRS_CR1_IC, val);
> > +		irs->cr1.ist_ra = !!(val & GICV5_IRS_CR1_IST_RA);
> > +		irs->cr1.ist_wa = !!(val & GICV5_IRS_CR1_IST_WA);
> > +		irs->cr1.vmt_ra = !!(val & GICV5_IRS_CR1_VMT_RA);
> > +		irs->cr1.vpet_ra = !!(val &
> > GICV5_IRS_CR1_VPET_RA);
> > +		irs->cr1.vmd_ra = !!(val & GICV5_IRS_CR1_VMD_RA);
> > +		irs->cr1.vmd_wa = !!(val & GICV5_IRS_CR1_VMD_WA);
> > +		irs->cr1.vped_ra = !!(val &
> > GICV5_IRS_CR1_VPED_RA);
> > +		irs->cr1.vped_wa = !!(val &
> > GICV5_IRS_CR1_VPED_WA);
> > +		return;
> 
> [Severity: Medium]
> Since these sequential writes are performed without holding
> config_lock,
> is there a risk of data races? If multiple vCPUs concurrently write
> different values to GICV5_IRS_CR1, it seems like the internal KVM
> state
> for irs->cr1 could end up in a torn state combining the concurrent
> writes.

While I agree that this would break, it would be broken software, and
we don't actually use the values written to this register - we just
provide them back to the guest if and what it reads them. Therefore, I
don't think that this is worth the extra complications of changing it.

> 
> [ ... ]
> 
> > +static unsigned long vgic_v5_mmio_read_irs_ist(struct kvm_vcpu
> > *vcpu,
> > +					       gpa_t addr,
> > unsigned int len)
> > +{
> > +	struct vgic_v5_irs *irs = vgic_v5_get_irs(vcpu);
> > +	const size_t offset = addr & (SZ_64K - 1);
> > +	u64 value = 0;
> > +
> > +	switch (offset) {
> [ ... ]
> > +	case GICV5_IRS_IST_BASER:
> > +		value = FIELD_PREP(GICV5_IRS_IST_BASER_ADDR_MASK,
> > +				   irs->ist_baser.addr >>
> > GICV5_IRS_IST_BASER_ADDR_SHIFT);
> > +		if (irs->ist_baser.valid)
> > +			value |= GICV5_IRS_IST_BASER_VALID;
> > +		break;
> 
> [Severity: Medium]
> Can guests observe logically torn register states here? The write
> handler
> vgic_v5_mmio_write_irs_ist() correctly holds config_lock to
> sequentially
> update irs->ist_baser.valid and irs->ist_baser.addr, but this read
> handler accesses them locklessly. If a vCPU reads GICV5_IRS_IST_BASER
> concurrently with a write, it could see an impossible state combining
> the
> old address with the new valid bit or vice-versa.

As above, this is something that we shouldn't need to guard against. If
software both writes and reads this register at the same time from
multiple vCPUs, then that software should expect races. Frankly, this
is broken software, and it will potentially get gibberish back.

> 
> [ ... ]
> 
> > +static void vgic_v5_mmio_write_irs_ist(struct kvm_vcpu *vcpu,
> > gpa_t addr,
> > +				       unsigned int len, unsigned
> > long val)
> > +{
> > +	struct vgic_v5_irs *irs = vgic_v5_get_irs(vcpu);
> > +	const size_t offset = addr & (SZ_64K - 1);
> > +	enum gicv5_vcpu_cmd cmd = LPI_VIST_MAKE_INVALID;
> > +
> > +	switch (offset) {
> [ ... ]
> > +	case GICV5_IRS_IST_BASER: {
> 
> [Severity: High]
> Does this strict matching on exact offsets break read-modify-write
> for
> 32-bit accesses to the high half of the register? If a guest performs
> a
> 32-bit write to offset + 4, it looks like this switch statement drops
> it.
> Also, interpreting a 32-bit payload as a full 64-bit value without
> adjusting for the offset would corrupt the register state.

I've extended the accessors to cope with 32-bit accesses for the
IRS_IST_BASER. This is the only implemented register we have that
supports both 32- and 64-bit accesses. The rest are RAZ/WI in the
current implementation. I've also enabled the 32-bit accesses for
those, but they have no effects otherwise.

> 
> [ ... ]
> 
> > +static const struct vgic_register_region vgic_v5_irs_registers[] =
> > {
> [ ... ]
> > +	REGISTER_DESC_WITH_LENGTH(GICV5_IRS_IST_BASER,
> > vgic_v5_mmio_read_irs_ist,
> > +				  vgic_v5_mmio_write_irs_ist, 8,
> > +				  VGIC_ACCESS_64bit),
> 
> [Severity: High]
> Could omitting VGIC_ACCESS_32bit for this 64-bit register cause the
> KVM
> IO bus to reject valid 32-bit guest accesses? If KVM's mmio
> dispatcher
> rejects a 32-bit access, the request will fall back to userspace IO.
> Since
> userspace does not emulate the in-kernel IRS, this usually results in
> an
> unhandled data abort injected into the guest.
> 

See my comment above - I have added 32-bit accesses for the
IRS_IST_BASER.

Thanks,
Sascha


  reply	other threads:[~2026-09-04  8:48 UTC|newest]

Thread overview: 118+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-08-07 11:12 [PATCH v5 00/49] KVM: arm64: Add GICv5 IRS support Sascha Bischoff
2026-08-07 11:13 ` [PATCH v5 01/49] irqchip/gic-v5: Allow KVM setup without a maintenance IRQ Sascha Bischoff
2026-08-07 11:13 ` [PATCH v5 02/49] irqchip/gic-v5: Provide OF IRS config frame attrs to KVM Sascha Bischoff
2026-08-07 11:53   ` sashiko-bot
2026-09-03 14:20     ` Sascha Bischoff
2026-08-07 11:14 ` [PATCH v5 03/49] irqchip/gic-v5: Set up gic_kvm_info on ACPI hosts Sascha Bischoff
2026-08-07 12:01   ` sashiko-bot
2026-09-03 14:22     ` Sascha Bischoff
2026-08-07 13:44   ` Lorenzo Pieralisi
2026-09-03 14:25     ` Sascha Bischoff
2026-08-07 11:14 ` [PATCH v5 04/49] KVM: arm64: gic-v5: Define remaining IRS MMIO registers Sascha Bischoff
2026-08-07 12:05   ` sashiko-bot
2026-09-03 14:34     ` Sascha Bischoff
2026-08-07 11:15 ` [PATCH v5 05/49] arm64/sysreg: Add GICv5 GIC VDPEND encoding Sascha Bischoff
2026-08-07 11:15 ` [PATCH v5 06/49] arm64/sysreg: Update ICC_CR0_EL1 with LINK and LINK_IDLE fields Sascha Bischoff
2026-08-07 12:17   ` sashiko-bot
2026-09-03 16:33     ` Sascha Bischoff
2026-08-07 11:16 ` [PATCH v5 07/49] KVM: arm64: gic-v5: Cache host IRS ID registers Sascha Bischoff
2026-08-07 12:27   ` sashiko-bot
2026-09-04  6:36     ` Sascha Bischoff
2026-08-07 11:16 ` [PATCH v5 08/49] KVM: arm64: gic-v5: Add VPE doorbell domain Sascha Bischoff
2026-08-07 12:45   ` sashiko-bot
2026-09-04  7:27     ` Sascha Bischoff
2026-08-07 11:17 ` [PATCH v5 09/49] KVM: arm64: gic-v5: Create and manage VM and VPE tables Sascha Bischoff
2026-08-07 12:50   ` sashiko-bot
2026-09-04  8:00     ` Sascha Bischoff
2026-08-07 11:17 ` [PATCH v5 10/49] KVM: arm64: gic-v5: Introduce guest IST alloc and management Sascha Bischoff
2026-08-07 13:07   ` sashiko-bot
2026-09-04  8:08     ` Sascha Bischoff
2026-08-07 11:18 ` [PATCH v5 11/49] KVM: arm64: gic-v5: Implement VMT/vIST IRS MMIO Ops Sascha Bischoff
2026-08-07 13:13   ` sashiko-bot
2026-09-04  8:15     ` Sascha Bischoff
2026-08-07 11:18 ` [PATCH v5 12/49] KVM: arm64: gic-v5: Keep GICv5 vCPU limit model-specific Sascha Bischoff
2026-08-07 13:30   ` sashiko-bot
2026-09-04 10:03     ` Sascha Bischoff
2026-08-07 11:19 ` [PATCH v5 13/49] KVM: arm64: gic-v5: Implement VPE IRS MMIO Ops Sascha Bischoff
2026-08-07 11:19 ` [PATCH v5 14/49] KVM: arm64: gic-v5: Set up VMTEs and VPE doorbells Sascha Bischoff
2026-08-07 13:42   ` sashiko-bot
2026-09-04  8:22     ` Sascha Bischoff
2026-08-07 11:20 ` [PATCH v5 15/49] KVM: arm64: gic-v5: Add resident/non-resident hyp calls Sascha Bischoff
2026-08-07 11:20 ` [PATCH v5 16/49] KVM: arm64: gic-v5: Request doorbells when VPEs enter WFI Sascha Bischoff
2026-08-07 14:17   ` sashiko-bot
2026-09-04  8:31     ` Sascha Bischoff
2026-08-07 11:21 ` [PATCH v5 17/49] KVM: arm64: gic-v5: Introduce struct vgic_v5_irs and IRS base address Sascha Bischoff
2026-08-07 11:21 ` [PATCH v5 18/49] KVM: arm64: gic-v5: Add IRS IODEV support to MMIO handlers Sascha Bischoff
2026-08-07 11:22 ` [PATCH v5 19/49] KVM: arm64: gic-v5: Add KVM_VGIC_V5_ADDR_TYPE_IRS to UAPI Sascha Bischoff
2026-08-07 14:27   ` sashiko-bot
2026-09-04  8:42     ` Sascha Bischoff
2026-08-07 11:22 ` [PATCH v5 20/49] KVM: arm64: gic-v5: Add GICv5 IRS IODEV and MMIO emulation Sascha Bischoff
2026-08-07 14:34   ` sashiko-bot
2026-09-04  8:47     ` Sascha Bischoff [this message]
2026-08-07 11:23 ` [PATCH v5 21/49] KVM: arm64: gic-v5: Initialise per-VM IRS state Sascha Bischoff
2026-08-07 14:49   ` sashiko-bot
2026-09-04  8:51     ` Sascha Bischoff
2026-08-07 11:23 ` [PATCH v5 22/49] KVM: arm64: gic-v5: Register the IRS IODEV Sascha Bischoff
2026-08-07 14:52   ` sashiko-bot
2026-09-04  8:57     ` Sascha Bischoff
2026-08-07 11:24 ` [PATCH v5 23/49] KVM: arm64: gic-v5: Set IRICHPPIDIS based on IRS enable state Sascha Bischoff
2026-08-07 11:24 ` [PATCH v5 24/49] KVM: arm64: selftests: Update vGICv5 selftest to set IRS address Sascha Bischoff
2026-08-07 15:04   ` sashiko-bot
2026-09-04  9:03     ` Sascha Bischoff
2026-08-07 11:25 ` [PATCH v5 25/49] KVM: arm64: gic-v5: Add GIC VDPEND hyp call Sascha Bischoff
2026-08-07 11:25 ` [PATCH v5 26/49] KVM: arm64: gic: Introduce set_pending_state() to irq_ops Sascha Bischoff
2026-08-07 15:14   ` sashiko-bot
2026-09-04  9:28     ` Sascha Bischoff
2026-08-07 11:26 ` [PATCH v5 27/49] KVM: arm64: gic-v5: Support SPI injection Sascha Bischoff
2026-08-07 15:23   ` sashiko-bot
2026-09-04  9:22     ` Sascha Bischoff
2026-08-07 11:26 ` [PATCH v5 28/49] Documentation: KVM: Extend VGICv5 device attribute docs Sascha Bischoff
2026-08-07 15:29   ` sashiko-bot
2026-09-04  9:30     ` Sascha Bischoff
2026-08-07 11:27 ` [PATCH v5 29/49] KVM: arm64: gic-v5: Add GICv5 SPI injection to irqfd Sascha Bischoff
2026-08-07 15:40   ` sashiko-bot
2026-09-04  9:47     ` Sascha Bischoff
2026-08-07 11:27 ` [PATCH v5 30/49] KVM: arm64: gic-v5: Mask per-vCPU PPI state in vgic_v5_finalize_ppi_state() Sascha Bischoff
2026-08-07 11:28 ` [PATCH v5 31/49] KVM: arm64: gic-v5: Add GICv5 EL1 sysreg userspace accessors Sascha Bischoff
2026-08-07 16:27   ` sashiko-bot
2026-09-04 10:01     ` Sascha Bischoff
2026-08-07 11:28 ` [PATCH v5 32/49] KVM: arm64: gic-v5: Handle userspace accesses to IRS MMIO region Sascha Bischoff
2026-08-07 16:20   ` sashiko-bot
2026-09-04  9:59     ` Sascha Bischoff
2026-08-07 11:29 ` [PATCH v5 33/49] KVM: arm64: gic-v5: Add CoreSight MMIO regs to IRS Sascha Bischoff
2026-08-07 11:29 ` [PATCH v5 34/49] KVM: arm64: gic-v5: Add VGICv5 IST save/restore UAPI Sascha Bischoff
2026-08-07 16:30   ` sashiko-bot
2026-09-04 10:06     ` Sascha Bischoff
2026-08-07 11:30 ` [PATCH v5 35/49] KVM: arm64: gic-v5: Implement save/restore mechanisms for ISTs Sascha Bischoff
2026-08-07 16:48   ` sashiko-bot
2026-09-04 10:23     ` Sascha Bischoff
2026-08-07 11:30 ` [PATCH v5 36/49] Documentation: KVM: Document KVM_DEV_ARM_VGIC_GRP_CPU_SYSREGS for VGICv5 Sascha Bischoff
2026-08-07 16:55   ` sashiko-bot
2026-09-04 11:04     ` Sascha Bischoff
2026-08-07 11:31 ` [PATCH v5 37/49] Documentation: KVM: Add KVM_DEV_ARM_VGIC_GRP_IRS_REGS to VGICv5 docs Sascha Bischoff
2026-08-07 16:52   ` sashiko-bot
2026-09-04 10:09     ` Sascha Bischoff
2026-08-07 11:31 ` [PATCH v5 38/49] Documentation: KVM: Add docs for KVM_DEV_ARM_VGIC_GRP_IST Sascha Bischoff
2026-08-07 11:32 ` [PATCH v5 39/49] Documentation: KVM: Add the VGICv5 IRS save/restore sequences Sascha Bischoff
2026-08-07 11:32 ` [PATCH v5 40/49] KVM: selftests: Add VGICv5 IRS address attribute tests Sascha Bischoff
2026-08-07 11:33 ` [PATCH v5 41/49] KVM: selftests: Add VGICv5 NR_IRQS " Sascha Bischoff
2026-08-07 17:12   ` sashiko-bot
2026-09-04 10:15     ` Sascha Bischoff
2026-08-07 11:33 ` [PATCH v5 42/49] KVM: selftests: Add VGICv5 IRS_REGS " Sascha Bischoff
2026-08-07 17:17   ` sashiko-bot
2026-09-04 10:38     ` Sascha Bischoff
2026-08-07 11:34 ` [PATCH v5 43/49] KVM: selftests: Add VGICv5 IST " Sascha Bischoff
2026-08-07 17:21   ` sashiko-bot
2026-09-04 10:45     ` Sascha Bischoff
2026-08-07 11:35 ` [PATCH v5 44/49] KVM: selftests: Add VGICv5 USERSPACE_PPIS tests Sascha Bischoff
2026-08-07 11:35 ` [PATCH v5 45/49] KVM: selftests: Add VGICv5 CPU sysreg attribute tests Sascha Bischoff
2026-08-07 11:36 ` [PATCH v5 46/49] KVM: selftests: Add VGICv5 SPI injection tests Sascha Bischoff
2026-08-07 11:36 ` [PATCH v5 47/49] KVM: selftests: Add VGICv5 LPI delivery tests Sascha Bischoff
2026-08-07 17:39   ` sashiko-bot
2026-09-04 10:48     ` Sascha Bischoff
2026-08-07 11:37 ` [PATCH v5 48/49] KVM: selftests: Add VGICv5 IST save/restore coverage Sascha Bischoff
2026-08-07 17:50   ` sashiko-bot
2026-09-04 10:54     ` Sascha Bischoff
2026-08-07 11:37 ` [PATCH v5 49/49] KVM: selftests: Add VGICv5 sparse vCPU IDs test Sascha Bischoff
2026-08-07 17:56   ` sashiko-bot
2026-09-04 10:57     ` Sascha Bischoff

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=4689ec951b2a526903573825b4ffd0bddb1c35bb.camel@arm.com \
    --to=sascha.bischoff@arm.com \
    --cc=kvm@vger.kernel.org \
    --cc=kvmarm@lists.linux.dev \
    --cc=maz@kernel.org \
    --cc=nd@arm.com \
    --cc=oupton@kernel.org \
    --cc=sashiko-reviews@lists.linux.dev \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox