[PATCH v6 00/12] KVM/ARM Implementation

Christoffer Dall
2012-02-23T07:32:16Z

The following series implements KVM support for ARM processors,
specifically on the Cortex A-15 platform.

The patch series applies to commit 24c9a7d43e695f0183ba99638edfcd265bc7a0ca
on Catalin Marinas' linux-arm-arch tree.

The patch series further depends on these two patches:
https://lists.cs.columbia.edu/pipermail/android-virt/2012-February/000603.html
https://lists.cs.columbia.edu/pipermail/android-virt/2012-February/000590.html

This is Version 6 of the patch series, but the first two versions
were reviewed outside of the KVM mailing list. Changes can also be
pulled from:
git://github.com/virtualopensystems/linux-kvm-arm.git kvm-a15-v6

The implementation is broken up into a logical set of patches, the first
one a preparatory patch and the second one containing a skeleton of files,
makefile changes, the basic user space interface and KVM architecture specific
stubs. Subsequent patches implement parts of the system as listed:
1. Preparatory patch introducing KVM
2. Skeleton
3. Identity Mapping for Hyp mode
4. Hypervisor initialization
5. Memory virtualization setup (hyp mode mappings and 2nd stage)
6. Inject IRQs and FIQs from userspace
7. World-switch implementation and Hyp exception vectors
8. Emulation framework and CP15 emulation
9. Handle guest user memory aborts
10. Handle guest MMIO aborts
11. Support guest wait-for-interrupt instructions.
12. Handle CP15 CR9 emulation /* hack alert! */

Testing:
Limited testing, but have run GCC inside guest, which compiled a small
hello-world program, which was successfully run. Hardware still
unavailable, so all testing has been done on ARM Fast Models.

For a guide on how to set up a testing environment and try out these
patches, see:
http://www.virtualopensystems.com/media/pdf/kvm-arm-guide.pdf
https://wiki.linaro.org/PeterMaydell/KVM/HowTo/ModelSetup

There is an issue list available using the issue tracker on:
https://github.com/virtualopensystems/linux-kvm-arm

Changes since v5:
- General bugfixes and nit fixes from reviews
- Implemented re-use of VMIDs
- Cleaned up the Hyp-mapping code to be readable by non-mm hackers
(including myself)
- Integrated preliminary SMP support in base patches
- Lock-less interrupt injection and WFI support
- Fixed signal-handling in while in guest (increases overall stability)

Changes since v4:
- Addressed reviewer comments from v4
* cleanup debug and trace code
* remove printks
* fixup kvm_arch_vcpu_ioctl_run
* add trace details to mmio emulation
- Fix from Marc Zyngier: Move kvm_guest_enter/exit into non-preemptible
section (squashed into world-switch patch)
- Cleanup create_hyp_mappings/remove_hyp_mappings from Marc Zyngier
(squashed into hypervisor initialization patch)
- Removed the remove_hyp_mappings feature. Removing hypervisor mappings
could potentially unmap other important data shared in the same page.
- Removed the arm_ prefix from the arch-specific files.
- Initial SMP host/guest support

Changes since v3:
- v4 actually works, fully boots a guest
- Support compiling as a module
- Use static inlines instead of macros for vcpu_reg and friends
- Optimize kvm_vcpu_reg function
- Use Ftrace for trace capabilities
- Updated documentation and commenting
- Use KVM_IRQ_LINE instead of KVM_INTERRUPT
- Emulates load/store instructions not supported through HSR
syndrome information.
- Frees 2nd stage translation tables on VM teardown
- Handles IRQ/FIQ instructions
- Handles more CP15 accesses
- Support guest WFI calls
- Uses debugfs instead of /proc
- Support compiling in Thumb mode

Changes since v2:
- Performs world-switch code
- Maps guest memory using 2nd stage translation
- Emulates co-processor 15 instructions
- Forwards I/O faults to QEMU.

---

Christoffer Dall (11):
KVM: Introduce __KVM_HAVE_IRQ_LINE
ARM: KVM: Initial skeleton to compile KVM support
ARM: KVM: Hypervisor identity mapping
ARM: KVM: Hypervisor inititalization
ARM: KVM: Memory virtualization setup
ARM: KVM: Inject IRQs and FIQs from userspace
ARM: KVM: World-switch implementation
ARM: KVM: Emulation framework and CP15 emulation
ARM: KVM: Handle guest faults in KVM
ARM: KVM: Handle I/O aborts
ARM: KVM: Guest wait-for-interrupts (WFI) support

Marc Zyngier (1):
ARM: KVM: Handle CP15 CR9 accesses for L2CTLR emulation

Documentation/virtual/kvm/api.txt | 12
arch/arm/Kconfig | 2
arch/arm/Makefile | 1
arch/arm/include/asm/kvm.h | 81 +++
arch/arm/include/asm/kvm_arm.h | 130 +++++
arch/arm/include/asm/kvm_asm.h | 51 ++
arch/arm/include/asm/kvm_emulate.h | 101 ++++
arch/arm/include/asm/kvm_host.h | 118 ++++
arch/arm/include/asm/kvm_mmu.h | 42 +
arch/arm/include/asm/kvm_para.h | 9
arch/arm/include/asm/pgtable-3level-hwdef.h | 5
arch/arm/include/asm/pgtable-3level.h | 12
arch/arm/include/asm/pgtable.h | 10
arch/arm/include/asm/unified.h | 12
arch/arm/kernel/armksyms.c | 7
arch/arm/kernel/asm-offsets.c | 34 +
arch/arm/kernel/entry-armv.S | 1
arch/arm/kvm/Kconfig | 45 ++
arch/arm/kvm/Makefile | 17 +
arch/arm/kvm/arm.c | 777 +++++++++++++++++++++++++++
arch/arm/kvm/emulate.c | 640 ++++++++++++++++++++++
arch/arm/kvm/exports.c | 32 +
arch/arm/kvm/guest.c | 147 +++++
arch/arm/kvm/init.S | 115 ++++
arch/arm/kvm/interrupts.S | 546 +++++++++++++++++++
arch/arm/kvm/mmu.c | 545 +++++++++++++++++++
arch/arm/kvm/trace.h | 117 ++++
arch/arm/mm/Kconfig | 8
arch/arm/mm/idmap.c | 47 +-
arch/arm/mm/mmu.c | 3
arch/ia64/include/asm/kvm.h | 1
arch/x86/include/asm/kvm.h | 1
include/linux/kvm.h | 1
include/trace/events/kvm.h | 4
mm/memory.c | 2
35 files changed, 3667 insertions(+), 9 deletions(-)
create mode 100644 arch/arm/include/asm/kvm.h
create mode 100644 arch/arm/include/asm/kvm_arm.h
create mode 100644 arch/arm/include/asm/kvm_asm.h
create mode 100644 arch/arm/include/asm/kvm_emulate.h
create mode 100644 arch/arm/include/asm/kvm_host.h
create mode 100644 arch/arm/include/asm/kvm_mmu.h
create mode 100644 arch/arm/include/asm/kvm_para.h
create mode 100644 arch/arm/kvm/Kconfig
create mode 100644 arch/arm/kvm/Makefile
create mode 100644 arch/arm/kvm/arm.c
create mode 100644 arch/arm/kvm/emulate.c
create mode 100644 arch/arm/kvm/exports.c
create mode 100644 arch/arm/kvm/guest.c
create mode 100644 arch/arm/kvm/init.S
create mode 100644 arch/arm/kvm/interrupts.S
create mode 100644 arch/arm/kvm/mmu.c
create mode 100644 arch/arm/kvm/trace.h

--