Linux-ARM-Kernel Archive on lore.kernel.org
 help / color / mirror / Atom feed
From: Sascha Bischoff <Sascha.Bischoff@arm.com>
To: "fuad.tabba@linux.dev" <fuad.tabba@linux.dev>
Cc: "yuzenghui@huawei.com" <yuzenghui@huawei.com>,
	"lpieralisi@kernel.org" <lpieralisi@kernel.org>,
	Timothy Hayes <Timothy.Hayes@arm.com>,
	Suzuki Poulose <Suzuki.Poulose@arm.com>, nd <nd@arm.com>,
	"peter.maydell@linaro.org" <peter.maydell@linaro.org>,
	"kvmarm@lists.linux.dev" <kvmarm@lists.linux.dev>,
	"linux-arm-kernel@lists.infradead.org"
	<linux-arm-kernel@lists.infradead.org>,
	"kvm@vger.kernel.org" <kvm@vger.kernel.org>,
	Joey Gouly <Joey.Gouly@arm.com>,
	"maz@kernel.org" <maz@kernel.org>,
	"oliver.upton@linux.dev" <oliver.upton@linux.dev>
Subject: Re: [PATCH v4 35/48] KVM: arm64: gic-v5: Implement save/restore mechanisms for ISTs
Date: Fri, 31 Jul 2026 08:55:46 +0000	[thread overview]
Message-ID: <7b25b4313db1bab3f82679b1c2fe5e7925cc66c0.camel@arm.com> (raw)
In-Reply-To: <CA+EHjTwrx6Ce4LMHFz9MNGo87PvFFHxEOY7Dqrk85j3W+wDtxQ@mail.gmail.com>

Hi Fuad,

On Mon, 2026-07-27 at 19:56 +0100, Fuad Tabba wrote:
> On Fri, 24 Jul 2026 at 11:58, Sascha Bischoff
> <Sascha.Bischoff@arm.com> wrote:
> ...
> 
> > +/*
> > + * Save the LPI IST to userspace memory.
> > + *
> > + * The LPI IST may be linear or two-level, so host iteration
> > depends on the
> > + * allocated host shape.
> > + */
> > +int vgic_v5_save_lpi_ist(struct kvm *kvm, struct kvm_vgic_v5_ist
> > *ist_attr)
> > +{
> > +       struct vgic_v5_ist_desc ist;
> > +       u32 __user *uaddr;
> > +       int ret;
> > +
> > +       ret = vgic_v5_get_lpi_ist_desc(kvm, &ist);
> > +       if (ret)
> > +               return ret;
> > +
> > +       if (!ist.present)
> > +               return 0;
> > +
> > +       uaddr = (u32 __user *)(unsigned long)ist_attr-
> > >lpi_ist_addr;
> > +
> > +       if (!ist.vmi->h_lpi_ist_structure)
> > +               return vgic_v5_save_linear_ist(&ist, uaddr,
> > +                                              BIT(ist.id_bits));
> > +
> > +       return vgic_v5_save_two_level_ist(&ist, uaddr);
> > +}
> 
> This bounds the walk with the ID_BITS stamped into the VMTE when the
> host IST was allocated...
> 
> ...
> 
> > +static int vgic_v5_validate_ist_attr(struct kvm *kvm,
> > +                                    const struct kvm_vgic_v5_ist
> > *ist_attr)
> > +{
> > +       unsigned int id_bits;
> > +       int ret;
> > +
> > +       /* We always have SPIs to save */
> > +       ret = vgic_v5_validate_ist_user_buffer(ist_attr-
> > >spi_ist_addr,
> > +                                       ist_attr->spi_ist_size,
> > +                                       kvm->arch.vgic.nr_spis *
> > sizeof(__u32));
> > +       if (ret)
> > +               return ret;
> > +
> > +       /* We don't always have LPIs to save */
> > +       ret = vgic_v5_irs_lpi_ist_id_bits(kvm, &id_bits);
> > +       if (ret < 0)
> > +               return ret;
> > +
> > +       /* No LPI IST */
> > +       if (!ret) {
> > +               if (ist_attr->lpi_ist_addr || ist_attr-
> > >lpi_ist_size)
> > +                       return -EINVAL;
> > +
> > +               return 0;
> > +       }
> > +
> > +       return vgic_v5_validate_ist_user_buffer(ist_attr-
> > >lpi_ist_addr,
> > +                                              ist_attr-
> > >lpi_ist_size,
> > +                                              BIT(id_bits) *
> > sizeof(__u32));
> > +}
> 
> ... and this sizes the buffer from the emulated IRS_IST_CFGR. I think
> the two are using different values, and I could not find anything
> that
> re-syncs them.
> 
> The two writers of IRS_IST_CFGR differ:
> `vgic_v5_mmio_write_irs_ist()`
> returns early while `ist_baser.valid` is set,
> `vgic_v5_mmio_uaccess_write_irs()` does not. So userspace can restore
> the IST, stamping the VMTE from the larger LPI_ID_BITS, rewrite
> IRS_IST_CFGR smaller, and then save with the matching smaller buffer.
> `vgic_v5_ist_cfgr_valid()` accepts down to IRS_IDR2.MIN_LPI_ID_BITS,
> so on a part reporting 0 that is BIT(16) entries into a buffer
> validated at 4 bytes. `test_vgic_v5_ist_save_restore()` in patch 48
> already restores and then re-saves before any vCPU runs, it just does
> not write IRS_IST_CFGR in that window.

Yeah, that's very much not desired! I've gone and have restricted what
userspace can realistically do - we shouldn't be in a situation where
userspace can force things to go out of sync, IMO. 

I've updated the code to reject userspace writes to the IRS_IST_CFGR
once and LPI IST has been allocated - unless userspace just so happens
to write the same value in which case the NOP is allowed. The
allocation of the LPI IST happens as part of restoring the IST, so
broadly userspace is allowed to do whatever it likes, until the IST has
been created, at which point the values are frozen. I've added a
similar restriction for the IRS_IST_BASER - the value is frozen once
the IST is allocated.

> 
> arm-vgic-v5.rst says the LPI buffer size must be BIT(lpi_id_bits) *
> sizeof(__u32), "where lpi_id_bits is the LPI ID width configured in
> IRS_IST_CFGR", which is the value the validation uses and not the one
> the walk uses.

Yeah, but we should mandate that these are the same. Therefore, the
code now rejects LPI IST saves when the VMTE’s IST_ID_BITS differ from
IRS_IST_CFGR.LPI_ID_BITS.

> 
> Adding the `ist_baser.valid` check to the uaccess path would break
> restore, since the same file says the IRS registers may be restored
> in
> any order. Validating against the value the walk uses, or rejecting a
> save when the register and the VMTE disagree,
> both look workable. Bounding the walk by the register instead would
> read past the host allocation whenever the register is the larger of
> the two, so I do not think that direction works.

Agreed, I don't think that direction works. The limit needs to be based
on what the host has allocated.

In general, I've done the following:

- Reject LPI IST saves when the VMTE’s IST_ID_BITS is different from
IRS_IST_CFGR.LPI_ID_BITS.
- Make IRS_IST_CFGR and IRS_IST_BASER immutable after allocating the
LPI IST. Identical userspace writes are accepted but are NOPs.
- Added tests for the BASER and CFGR restrictions to the selftests.

> 
> `put_user()` targets the caller's own mapping and the host-side reads
> stay in bounds, so I think this is a correctness problem rather than
> a
> security one. The SPI save uses `nr_spis` on both sides and restore
> stamps the VMTE from the value it validated,
> so only the LPI save looks affected, linear and two-level alike.
> 
> Cheers,
> /fuad

Thanks,
Sascha


  reply	other threads:[~2026-07-31  8:57 UTC|newest]

Thread overview: 62+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-07-24 10:48 [PATCH v4 00/48] KVM: arm64: Add GICv5 IRS support Sascha Bischoff
2026-07-24 10:48 ` [PATCH v4 01/48] irqchip/gic-v5: Allow KVM setup without a maintenance IRQ Sascha Bischoff
2026-07-24 10:48 ` [PATCH v4 02/48] irqchip/gic-v5: Provide OF IRS config frame attrs to KVM Sascha Bischoff
2026-07-25  9:06   ` Marc Zyngier
2026-07-25  9:18     ` Marc Zyngier
2026-07-24 10:49 ` [PATCH v4 03/48] irqchip/gic-v5: Set up gic_kvm_info on ACPI hosts Sascha Bischoff
2026-07-25  9:35   ` Marc Zyngier
2026-07-31  7:21     ` Sascha Bischoff
2026-07-24 10:49 ` [PATCH v4 04/48] KVM: arm64: gic-v5: Define remaining IRS MMIO registers Sascha Bischoff
2026-07-24 10:49 ` [PATCH v4 05/48] arm64/sysreg: Add GICv5 GIC VDPEND encoding Sascha Bischoff
2026-07-24 10:49 ` [PATCH v4 06/48] arm64/sysreg: Update ICC_CR0_EL1 with LINK and LINK_IDLE fields Sascha Bischoff
2026-07-24 10:50 ` [PATCH v4 07/48] KVM: arm64: gic-v5: Extract host IRS caps from IRS config frame Sascha Bischoff
2026-07-25 10:40   ` Marc Zyngier
2026-07-31  7:24     ` Sascha Bischoff
2026-07-24 10:50 ` [PATCH v4 08/48] KVM: arm64: gic-v5: Add VPE doorbell domain Sascha Bischoff
2026-07-25 10:56   ` Marc Zyngier
2026-07-31  8:35     ` Sascha Bischoff
2026-07-24 10:50 ` [PATCH v4 09/48] KVM: arm64: gic-v5: Create and manage VM and VPE tables Sascha Bischoff
2026-07-24 10:50 ` [PATCH v4 10/48] KVM: arm64: gic-v5: Introduce guest IST alloc and management Sascha Bischoff
2026-07-27 17:55   ` Fuad Tabba
2026-07-31  9:11     ` Sascha Bischoff
2026-07-24 10:51 ` [PATCH v4 11/48] KVM: arm64: gic-v5: Implement VMT/vIST IRS MMIO Ops Sascha Bischoff
2026-07-24 10:51 ` [PATCH v4 12/48] KVM: arm64: gic-v5: Keep GICv5 vCPU limit model-specific Sascha Bischoff
2026-07-24 10:51 ` [PATCH v4 13/48] KVM: arm64: gic-v5: Implement VPE IRS MMIO Ops Sascha Bischoff
2026-07-24 10:52 ` [PATCH v4 14/48] KVM: arm64: gic-v5: Set up VMTEs and VPE doorbells Sascha Bischoff
2026-07-24 10:52 ` [PATCH v4 15/48] KVM: arm64: gic-v5: Add resident/non-resident hyp calls Sascha Bischoff
2026-07-24 10:52 ` [PATCH v4 16/48] KVM: arm64: gic-v5: Request doorbells when VPEs enter WFI Sascha Bischoff
2026-07-24 10:52 ` [PATCH v4 17/48] KVM: arm64: gic-v5: Introduce struct vgic_v5_irs and IRS base address Sascha Bischoff
2026-07-24 10:53 ` [PATCH v4 18/48] KVM: arm64: gic-v5: Add IRS IODEV support to MMIO handlers Sascha Bischoff
2026-07-24 10:53 ` [PATCH v4 19/48] KVM: arm64: gic-v5: Add KVM_VGIC_V5_ADDR_TYPE_IRS to UAPI Sascha Bischoff
2026-07-24 10:53 ` [PATCH v4 20/48] KVM: arm64: gic-v5: Add GICv5 IRS IODEV and MMIO emulation Sascha Bischoff
2026-07-27 18:34   ` Fuad Tabba
2026-07-30 16:06     ` Sascha Bischoff
2026-07-24 10:53 ` [PATCH v4 21/48] KVM: arm64: gic-v5: Initialise per-VM IRS state Sascha Bischoff
2026-07-24 10:54 ` [PATCH v4 22/48] KVM: arm64: gic-v5: Register the IRS IODEV Sascha Bischoff
2026-07-24 10:54 ` [PATCH v4 23/48] KVM: arm64: gic-v5: Set IRICHPPIDIS based on IRS enable state Sascha Bischoff
2026-07-24 10:54 ` [PATCH v4 24/48] KVM: arm64: selftests: Update vGICv5 selftest to set IRS address Sascha Bischoff
2026-07-24 10:55 ` [PATCH v4 26/48] KVM: arm64: gic: Introduce set_pending_state() to irq_op Sascha Bischoff
2026-07-24 10:55 ` [PATCH v4 28/48] Documentation: KVM: Extend VGICv5 device attribute docs Sascha Bischoff
2026-07-24 10:56 ` [PATCH v4 30/48] KVM: arm64: gic-v5: Mask per-vcpu PPI state in vgic_v5_finalize_ppi_state() Sascha Bischoff
2026-07-24 10:56 ` [PATCH v4 31/48] KVM: arm64: gic-v5: Add GICv5 EL1 sysreg userspace accessors Sascha Bischoff
2026-07-24 10:56 ` [PATCH v4 32/48] KVM: arm64: gic-v5: Handle userspace accesses to IRS MMIO region Sascha Bischoff
2026-07-24 10:56 ` [PATCH v4 33/48] KVM: arm64: gic-v5: Add CoreSight MMIO regs to IRS Sascha Bischoff
2026-07-24 10:57 ` [PATCH v4 34/48] KVM: arm64: gic-v5: Add VGICv5 IST save/restore UAPI Sascha Bischoff
2026-07-24 10:57 ` [PATCH v4 35/48] KVM: arm64: gic-v5: Implement save/restore mechanisms for ISTs Sascha Bischoff
2026-07-27 18:56   ` Fuad Tabba
2026-07-31  8:55     ` Sascha Bischoff [this message]
2026-07-24 10:57 ` [PATCH v4 36/48] Documentation: KVM: Document KVM_DEV_ARM_VGIC_GRP_CPU_SYSREGS for VGICv5 Sascha Bischoff
2026-07-24 10:57 ` [PATCH v4 37/48] Documentation: KVM: Add KVM_DEV_ARM_VGIC_GRP_IRS_REGS to VGICv5 docs Sascha Bischoff
2026-07-24 10:58 ` [PATCH v4 38/48] Documentation: KVM: Add docs for KVM_DEV_ARM_VGIC_GRP_IST Sascha Bischoff
2026-07-27 19:26   ` Fuad Tabba
2026-07-31  9:19     ` Sascha Bischoff
2026-07-24 10:58 ` [PATCH v4 39/48] Documentation: KVM: Add the VGICv5 IRS save/restore sequences Sascha Bischoff
2026-07-24 10:58 ` [PATCH v4 40/48] KVM: selftests: Add VGICv5 IRS address attribute tests Sascha Bischoff
2026-07-24 10:58 ` [PATCH v4 41/48] KVM: selftests: Add VGICv5 NR_IRQS " Sascha Bischoff
2026-07-24 10:59 ` [PATCH v4 42/48] KVM: selftests: Add VGICv5 IRS_REGS " Sascha Bischoff
2026-07-24 10:59 ` [PATCH v4 43/48] KVM: selftests: Add VGICv5 IST " Sascha Bischoff
2026-07-24 10:59 ` [PATCH v4 44/48] KVM: selftests: Add VGICv5 USERSPACE_PPIS tests Sascha Bischoff
2026-07-24 11:00 ` [PATCH v4 45/48] KVM: selftests: Add VGICv5 CPU sysreg attribute tests Sascha Bischoff
2026-07-24 11:00 ` [PATCH v4 46/48] KVM: selftests: Add VGICv5 SPI injection tests Sascha Bischoff
2026-07-24 11:00 ` [PATCH v4 47/48] KVM: selftests: Add VGICv5 LPI delivery tests Sascha Bischoff
2026-07-24 11:00 ` [PATCH v4 48/48] KVM: selftests: Add VGICv5 IST save/restore coverage Sascha Bischoff

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=7b25b4313db1bab3f82679b1c2fe5e7925cc66c0.camel@arm.com \
    --to=sascha.bischoff@arm.com \
    --cc=Joey.Gouly@arm.com \
    --cc=Suzuki.Poulose@arm.com \
    --cc=Timothy.Hayes@arm.com \
    --cc=fuad.tabba@linux.dev \
    --cc=kvm@vger.kernel.org \
    --cc=kvmarm@lists.linux.dev \
    --cc=linux-arm-kernel@lists.infradead.org \
    --cc=lpieralisi@kernel.org \
    --cc=maz@kernel.org \
    --cc=nd@arm.com \
    --cc=oliver.upton@linux.dev \
    --cc=peter.maydell@linaro.org \
    --cc=yuzenghui@huawei.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox