From: Magnus Kulke <magnuskulke@linux.microsoft.com>
To: qemu-devel@nongnu.org
Cc: kvm@vger.kernel.org, "Magnus Kulke" <magnuskulke@microsoft.com>,
"Wei Liu" <liuwe@microsoft.com>,
"Michael S. Tsirkin" <mst@redhat.com>,
"Cédric Le Goater" <clg@redhat.com>,
"Zhao Liu" <zhao1.liu@intel.com>,
"Richard Henderson" <richard.henderson@linaro.org>,
"Paolo Bonzini" <pbonzini@redhat.com>,
"Wei Liu" <wei.liu@kernel.org>,
"Magnus Kulke" <magnuskulke@linux.microsoft.com>,
"Alex Williamson" <alex@shazbot.org>,
"Marcel Apfelbaum" <marcel.apfelbaum@gmail.com>,
"Philippe Mathieu-Daudé" <philmd@linaro.org>,
"Marcelo Tosatti" <mtosatti@redhat.com>
Subject: [PATCH 00/34] Add migration support to the MSHV accelerator
Date: Fri, 17 Apr 2026 12:55:44 +0200 [thread overview]
Message-ID: <20260417105618.3621-1-magnuskulke@linux.microsoft.com> (raw)
Hey all, This is a patch series for live migration support in the MSHV
accelerator. Since this is somewhat invasive and touches various parts
outside of the accel's folder hierarchies I'm sending an RFC series to
collect early feedback.
This patches are sent in sent in isolation, but for LM to be fully
functional we will require require the recently submitted patch series
"Support QEMU cpu models in MSHV accelerator" (at v6 currently) to be
merged, since on some hosts we will need the CPUID infra to disable
features that we currently are not able to migrate yet (e.g. AMX tiles).
In this series we perform some preperatory refactorings and introduce
new abstractions where required, particulary for irqchips and MSR
logic. We also have to introduce some generic logic for XSAVE
de/compaction to allow migration of XSAVE state.
Note: there is some pending optimization to avoid a buffer copy
and rework existing xsave helper code to be generic over a
compacted or standard layout. We'll address this in a later revision
or in a discrete patch.
The guest state components that are covered by migration are:
- standard regs
- special regs
- xcr0
- (legacy) FPU regs
- XSAVE
- LAPIC
- MSRs
- SynIC state (SIMP, SIEFP, STIMER)
- pending interrupts/exceptions
- MP state (AP cpu modes)
Finally, routines for dirty-page tracking to reduce migration downtime
have beend added and integrated in the respective hooks.
best,
magnus
Changes since RFC:
- Added CET SS/IBT MSR migration
- Assert 64bit padding on CPUX86State->sysenter_cs statically
Magnus Kulke (34):
target/i386/mshv: use arch_load/store_reg fns
target/i386/mshv: use generic FPU/xcr0 state
target/i386/mshv: impl init/load/store_vcpu_state
accel/accel-irq: add AccelRouteChange abstraction
accel/accel-irq: add generic begin_route_changes
accel/accel-irq: add generic commit_route_changes
accel/mshv: add irq_routes to state
accel/mshv: update s->irq_routes in add_msi_route
accel/mshv: update s->irq_routes in update_msi_route
accel/mshv: update s->irq_routes in release_virq
accel/mshv: use s->irq_routes in commit_routes
accel/mshv: reserve ioapic routes on s->irq_routes
accel/mshv: remove redundant msi controller
target/i386/mshv: move apic logic into own file
target/i386/mshv: remove redundant apic helpers
target/i386/mshv: migrate LAPIC state
target/i386/mshv: move msr code to arch
accel/mshv: store partition proc features
target/i386/mshv: expose msvh_get_generic_regs
target/i386/mshv: migrate MSRs
target/i386/mshv: migrate MTRR MSRs
target/i386/mshv: migrate Synic SINT MSRs
target/i386/mshv: migrate CET/SS MSRs
target/i386/mshv: migrate SIMP and SIEFP state
target/i386/mshv: migrate STIMER state
accel/mshv: introduce SaveVMHandler
accel/mshv: write synthetic MSRs after migration
accel/mshv: migrate REFERENCE_TIME
target/i386/mshv: migrate pending ints/excs
target/i386: add de/compaction to xsave_helper
target/i386/mshv: migrate XSAVE state
target/i386/mshv: reconstruct hflags after load
target/i386/mshv: migrate MP_STATE
accel/mshv: enable dirty page tracking
accel/accel-irq.c | 41 +-
accel/kvm/kvm-all.c | 6 +-
accel/mshv/irq.c | 360 ++++++------
accel/mshv/mem.c | 211 +++++++
accel/mshv/meson.build | 1 -
accel/mshv/mshv-all.c | 243 +++++++-
accel/mshv/msr.c | 375 -------------
accel/stubs/kvm-stub.c | 2 +-
accel/stubs/mshv-stub.c | 6 +-
hw/intc/apic_common.c | 3 +
hw/misc/ivshmem-pci.c | 8 +-
hw/vfio/pci.c | 11 +-
hw/virtio/virtio-pci.c | 3 +-
include/accel/accel-route.h | 17 +
include/hw/hyperv/hvgdk_mini.h | 33 ++
include/hw/hyperv/hvhdk.h | 150 +++++
include/hw/i386/apic_internal.h | 5 +
include/system/accel-irq.h | 6 +-
include/system/kvm.h | 23 +-
include/system/mshv.h | 15 +-
include/system/mshv_int.h | 89 +--
target/i386/cpu.h | 14 +-
target/i386/kvm/kvm.c | 5 +-
target/i386/machine.c | 46 ++
target/i386/mshv/meson.build | 3 +
target/i386/mshv/mshv-apic.c | 78 +++
target/i386/mshv/mshv-cpu.c | 958 +++++++++++++++++++++++---------
target/i386/mshv/msr.c | 467 ++++++++++++++++
target/i386/mshv/synic.c | 206 +++++++
target/i386/xsave_helper.c | 255 +++++++++
30 files changed, 2684 insertions(+), 956 deletions(-)
delete mode 100644 accel/mshv/msr.c
create mode 100644 include/accel/accel-route.h
create mode 100644 target/i386/mshv/mshv-apic.c
create mode 100644 target/i386/mshv/msr.c
create mode 100644 target/i386/mshv/synic.c
--
2.34.1
next reply other threads:[~2026-04-17 10:56 UTC|newest]
Thread overview: 40+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-04-17 10:55 Magnus Kulke [this message]
2026-04-17 10:55 ` [PATCH 01/34] target/i386/mshv: use arch_load/store_reg fns Magnus Kulke
2026-04-17 10:55 ` [PATCH 02/34] target/i386/mshv: use generic FPU/xcr0 state Magnus Kulke
2026-04-17 10:55 ` [PATCH 03/34] target/i386/mshv: impl init/load/store_vcpu_state Magnus Kulke
2026-04-17 10:55 ` [PATCH 04/34] accel/accel-irq: add AccelRouteChange abstraction Magnus Kulke
2026-04-17 10:55 ` [PATCH 05/34] accel/accel-irq: add generic begin_route_changes Magnus Kulke
2026-04-17 10:55 ` [PATCH 06/34] accel/accel-irq: add generic commit_route_changes Magnus Kulke
2026-04-17 10:55 ` [PATCH 07/34] accel/mshv: add irq_routes to state Magnus Kulke
2026-04-17 10:55 ` [PATCH 08/34] accel/mshv: update s->irq_routes in add_msi_route Magnus Kulke
2026-04-17 10:55 ` [PATCH 09/34] accel/mshv: update s->irq_routes in update_msi_route Magnus Kulke
2026-04-17 10:55 ` [PATCH 10/34] accel/mshv: update s->irq_routes in release_virq Magnus Kulke
2026-04-17 10:55 ` [PATCH 11/34] accel/mshv: use s->irq_routes in commit_routes Magnus Kulke
2026-04-17 10:55 ` [PATCH 12/34] accel/mshv: reserve ioapic routes on s->irq_routes Magnus Kulke
2026-04-17 10:55 ` [PATCH 13/34] accel/mshv: remove redundant msi controller Magnus Kulke
2026-04-17 10:55 ` [PATCH 14/34] target/i386/mshv: move apic logic into own file Magnus Kulke
2026-04-17 10:55 ` [PATCH 15/34] target/i386/mshv: remove redundant apic helpers Magnus Kulke
2026-04-17 10:56 ` [PATCH 16/34] target/i386/mshv: migrate LAPIC state Magnus Kulke
2026-04-17 11:54 ` Mohamed Mediouni
2026-04-20 11:37 ` Magnus Kulke
2026-04-17 10:56 ` [PATCH 17/34] target/i386/mshv: move msr code to arch Magnus Kulke
2026-04-17 10:56 ` [PATCH 18/34] accel/mshv: store partition proc features Magnus Kulke
2026-04-17 10:56 ` [PATCH 19/34] target/i386/mshv: expose msvh_get_generic_regs Magnus Kulke
2026-04-17 10:56 ` [PATCH 20/34] target/i386/mshv: migrate MSRs Magnus Kulke
2026-04-17 10:56 ` [PATCH 21/34] target/i386/mshv: migrate MTRR MSRs Magnus Kulke
2026-04-17 10:56 ` [PATCH 22/34] target/i386/mshv: migrate Synic SINT MSRs Magnus Kulke
2026-04-17 10:56 ` [PATCH 23/34] target/i386/mshv: migrate CET/SS MSRs Magnus Kulke
2026-04-17 10:56 ` [PATCH 24/34] target/i386/mshv: migrate SIMP and SIEFP state Magnus Kulke
2026-04-17 10:56 ` [PATCH 25/34] target/i386/mshv: migrate STIMER state Magnus Kulke
2026-04-17 10:56 ` [PATCH 26/34] accel/mshv: introduce SaveVMHandler Magnus Kulke
2026-04-17 10:56 ` [PATCH 27/34] accel/mshv: write synthetic MSRs after migration Magnus Kulke
2026-04-17 10:56 ` [PATCH 28/34] accel/mshv: migrate REFERENCE_TIME Magnus Kulke
2026-04-17 10:56 ` [PATCH 29/34] target/i386/mshv: migrate pending ints/excs Magnus Kulke
2026-04-17 10:56 ` [PATCH 30/34] target/i386: add de/compaction to xsave_helper Magnus Kulke
2026-04-17 11:56 ` Mohamed Mediouni
2026-04-18 17:46 ` Mohamed Mediouni
2026-04-20 12:02 ` Magnus Kulke
2026-04-17 10:56 ` [PATCH 31/34] target/i386/mshv: migrate XSAVE state Magnus Kulke
2026-04-17 10:56 ` [PATCH 32/34] target/i386/mshv: reconstruct hflags after load Magnus Kulke
2026-04-17 10:56 ` [PATCH 33/34] target/i386/mshv: migrate MP_STATE Magnus Kulke
2026-04-17 10:56 ` [PATCH 34/34] accel/mshv: enable dirty page tracking Magnus Kulke
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20260417105618.3621-1-magnuskulke@linux.microsoft.com \
--to=magnuskulke@linux.microsoft.com \
--cc=alex@shazbot.org \
--cc=clg@redhat.com \
--cc=kvm@vger.kernel.org \
--cc=liuwe@microsoft.com \
--cc=magnuskulke@microsoft.com \
--cc=marcel.apfelbaum@gmail.com \
--cc=mst@redhat.com \
--cc=mtosatti@redhat.com \
--cc=pbonzini@redhat.com \
--cc=philmd@linaro.org \
--cc=qemu-devel@nongnu.org \
--cc=richard.henderson@linaro.org \
--cc=wei.liu@kernel.org \
--cc=zhao1.liu@intel.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox