Linux-ARM-Kernel Archive on lore.kernel.org
 help / color / mirror / Atom feed
From: Steffen Eiden <seiden@linux.ibm.com>
To: Sean Christopherson <seanjc@google.com>
Cc: kvm@vger.kernel.org, kvmarm@lists.linux.dev,
	linux-arm-kernel@lists.infradead.org,
	linux-kernel@vger.kernel.org, linux-s390@vger.kernel.org,
	Alexander Gordeev <agordeev@linux.ibm.com>,
	Andreas Grapentin <gra@linux.ibm.com>,
	Arnd Bergmann <arnd@arndb.de>,
	Catalin Marinas <catalin.marinas@arm.com>,
	Christian Borntraeger <borntraeger@linux.ibm.com>,
	Claudio Imbrenda <imbrenda@linux.ibm.com>,
	David Hildenbrand <david@kernel.org>,
	Friedrich Welter <fritz@linux.ibm.com>,
	Fuad Tabba <tabba@google.com>, Gautam Gala <ggala@linux.ibm.com>,
	Hariharan Mari <hari55@linux.ibm.com>,
	Heiko Carstens <hca@linux.ibm.com>,
	Hendrik Brueckner <brueckner@linux.ibm.com>,
	Ilya Leoshkevich <iii@linux.ibm.com>,
	Janosch Frank <frankja@linux.ibm.com>,
	Joey Gouly <joey.gouly@arm.com>, Marc Zyngier <maz@kernel.org>,
	Nico Boehr <nrb@linux.ibm.com>,
	Nina Schoetterl-Glausch <oss@nina.schoetterlglausch.eu>,
	Oliver Upton <oupton@kernel.org>,
	Paolo Bonzini <pbonzini@redhat.com>,
	Suzuki K Poulose <suzuki.poulose@arm.com>,
	Sven Schnelle <svens@linux.ibm.com>,
	Ulrich Weigand <Ulrich.Weigand@de.ibm.com>,
	Vasily Gorbik <gor@linux.ibm.com>, Will Deacon <will@kernel.org>,
	Zenghui Yu <yuzenghui@huawei.com>
Subject: Re: [PATCH v7 23/23] KVM: s390: arm64: Add KVM_S390_ARM64 Kconfig and Makefile
Date: Thu, 3 Sep 2026 17:43:17 +0200	[thread overview]
Message-ID: <20260903154317.246414-A-seiden@linux.ibm.com> (raw)
In-Reply-To: <apmHrnxRLl9BuVhn@google.com>

On Thu, Sep 03, 2026 at 07:43:58AM -0700, Sean Christopherson wrote:
> On Thu, Sep 03, 2026, Steffen Eiden wrote:
> > On Wed, Sep 02, 2026 at 09:20:23AM -0700, Sean Christopherson wrote:
> > > On Mon, Aug 31, 2026, Steffen Eiden wrote:
> > > > diff --git a/arch/s390/kvm/Kconfig b/arch/s390/kvm/Kconfig
> > > > index 8d3ee17a1bcb..9c69ea16031e 100644
> > > > --- a/arch/s390/kvm/Kconfig
> > > > +++ b/arch/s390/kvm/Kconfig
> > > > @@ -53,4 +53,33 @@ config KVM_S390_UCONTROL
> > > >  
> > > >  	  If unsure, say N.
> > > >  
> > > > +config KVM_S390_ARM64
> > > > +	def_tristate y
> > > > +	prompt "KVM support for hardware accelerated arm64 guests"
> > > > +	depends on HAS_IOMEM
> > > > +	depends on KVM
> > > 
> > > Is this actually necessary?  I.e. does kvm.ko need to be *loaded* in order for
> > > kvm-arm64.ko to be loaded?
> > > 
> > > If kvm-arm64.ko does indeed have a hard dependency on kvm.ko, then I think it
> > > makes sense to not have redundant "select" statements below.  As an outsider,
> > > it's super confusing because the KVM_S390_ARM64 are incomplete, e.g. are lacking
> > > things like VIRT_XFER_TO_GUEST_WORK (at least, I assume those are lacking), and
> > > makes it hard to see what is actually unique to kvm-arm64.ko.
> > > 
> > > If kvm-arm64.ko doesn't have a dependency on kvm.ko, e.g. to initialize hardware
> > > or something, then this "depends on" should go away.
> > 
> > 
> > It is a bit more complicated unfortunately. KVM_S390_ARM64 depends on
> > KVM as there is code around in the kernel & drivers (arch and common)
> > which depends on CONFIG_KVM we need as well. I did not want to leak arch
> > local configs to common code if I can avoid that.
> > I could change it to select KVM ? Do you have another idea on how to
> > solve this issue?
> 
> I would do something similar to what KVM x86 does.
> 
> > The two modules are completely independent at compile and runtime. So
> > kvm does not have to be loaded for kvm-arm64 to work.
> > 
> > VIRT_XFER_TO_GUEST_WORK is only lacking for now. I will add it later.
> > Currently the kvm-arm64 module is incomplete anyways but I did not want
> > to send a 60+patches series and rather stage the introduction over
> > multiple series.
> > 
> > I will remove the duplicated config selections. Thanks for pointing it
> > out. In previous series I had an explicit KVM_S390 config. Both KVM_S390
> > and KVM_ARM64 selected KVM. But this created too much churn around the
> > whole tech-stack 
> 
> LOL, what exactly are you expecting to happen?  You're trying to squeeze support
> in for a completely different architecture, of course there's going to be churn.
> 
> This absolutely needs to be as precisely and correct as possible, otherwise it'll
> be painfully difficult to maintain,  And to some extent, just for others to review.
> E.g. as is, it's at all not clear to me which of the IS_ENABLED(CONFIG_KVM) checks
> in arch/s390 apply to both flavors of virtualization, versus which are specific to
> "native" s390 virtualization.
> 
> I realize this is outside of my immediate scope, but getting this "right" isn't
> just an s390 thing, because these details bleed into common KVM, and even affect
> other architectures, e.g. when trying to make "treewide" KVM changes.

I want to find the 'right' way as well - any ideas are welcome.

> 
> And FWIW, while it might seem daunting, from my perspective it's not actually that
> much churn to do things "right".  Provide KVM_S390_NATIVE, and then have KVM reflect
> the "weakest" of S390_NATIVE vs. S390_ARCH.  I.e. make KVM=m if either of the "real"
> KVMs will be a module.  That requires some creative shenanigans, but it's not hard,
> just weird.

FYI the first versions of this series had a 3 configs approach very
similar to yours. 

IIRC it was not so much the churn we have in (upstream) kernel code but
more on the distro side and to everyone building the kernel in their
favourite architecture (s390 :))
Suddenly the KVM config changed its behaviour (effectively becoming a noop)

I am starting to think that having no separate config option for arm on
s390 might be the easisest way. Just KVM and guard both modules behind
it. It reduces the config space bloat and I do not see a reason why somoeone
should only compile one KVM module but not the other. kvm-arm64 won't
load if you do not have the hardware anyways.

But I am not opposed to the x86 approach. Just thinking loud.

Anyways, I am off for vacation expect a reduced reply frequency from my
side :) 

	Steffen
> 
> > (default config change, s390 is the odd one out for the KVM config meaning, ...).
> 
> Nah, x86 is the odd one, where CONFIG_KVM=m doesn't even guarantee kvm.ko gets
> built :-)
> 
> E.g. something like this, which probably doesn't compile and isn't the desired
> end state, as several of the Kconfig selections need to be reworked into #defines
> provided by header files, but AFAICT it does what I want/intend.
> 
> config KVM
> 	def_tristate m if (KVM_S390_NATIVE = m || KVM_S390_ARM64 = m)
> 	select HAVE_KVM_CPU_RELAX_INTERCEPT
> 	select KVM_COMMON
> 	select HAVE_KVM_IRQCHIP
> 	select HAVE_KVM_IRQ_ROUTING
> 	select KVM_VFIO
> 	select VIRT_XFER_TO_GUEST_WORK
> 
> config KVM_S390_NATIVE
> 	def_tristate y
> 	prompt "Kernel-based Virtual Machine (KVM) support"
> 	select KVM if (y && KVM_S390_ARM64 != m)
> 	select KVM_ASYNC_PF
> 	select KVM_ASYNC_PF_SYNC
> 	select HAVE_KVM_NO_POLL
> 	select KVM_MMU_LOCKLESS_AGING
> 	select KVM_GENERIC_PRE_FAULT_MEMORY
> 	select HAVE_KVM_INVALID_WAKEUPS
> 	help
> 	  Support hosting paravirtualized guest machines using the SIE
> 	  virtualization capability on the mainframe. This should work
> 	  on any 64bit machine.
> 
> 	  This module provides access to the hardware capabilities through
> 	  a character device node named /dev/kvm.
> 
> 	  To compile this as a module, choose M here: the module
> 	  will be called kvm.
> 
> 	  If unsure, say N.
> 
> config KVM_S390_UCONTROL
> 	bool "Userspace controlled virtual machines"
> 	depends on KVM
> 	help
> 	  Allow CAP_SYS_ADMIN users to create KVM virtual machines that are
> 	  controlled by userspace.
> 
> 	  If unsure, say N.
> 
> config KVM_S390_ARM64
> 	def_tristate y
> 	prompt "KVM support for hardware accelerated arm64 guests"
> 	depends on HAS_IOMEM
> 	select KVM if (y && KVM_S390_NATIVE != m)
> 	select GUEST_PERF_EVENTS if PERF_EVENTS
> 	select HAVE_KVM_VCPU_RUN_PID_CHANGE
> 	select HAVE_KVM_IRQ_BYPASS
> 	select KVM_MMIO
> 	select SCHED_INFO
> 	select XARRAY_MULTI
> 	help
> 	  Enable support for hosting virtualized, hardware-accelerated arm64
> 	  virtual machines on s390 systems using the Start ARM Execution (SAE)
> 	  instruction. This requires hardware models that support the Arm
> 	  execution facility (AEF).
> 
> 	  The module provides a character device named /dev/kvm-arm64 to expose
> 	  the hardware capabilities.
> 
> 	  To compile this driver as a module, choose M here. The module will
> 	  be called kvm-arm64.
> 
> 	  If unsure, say N.


  reply	other threads:[~2026-09-03 15:43 UTC|newest]

Thread overview: 53+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-08-31 14:47 [PATCH v7 00/23] KVM: s390: Introduce arm64 KVM Steffen Eiden
2026-08-31 14:47 ` [PATCH v7 01/23] vfio: Use file-based reference counting for KVM Steffen Eiden
2026-08-31 14:47 ` [PATCH v7 02/23] KVM: Make device name configurable Steffen Eiden
2026-09-02  0:40   ` Sean Christopherson
2026-09-02  7:50     ` Steffen Eiden
2026-09-02 16:14       ` Sean Christopherson
2026-09-03 11:42         ` Steffen Eiden
2026-09-03 14:30           ` Sean Christopherson
2026-09-03 14:32             ` Sean Christopherson
2026-09-03 14:45               ` Sean Christopherson
2026-09-03 14:55                 ` Paolo Bonzini
2026-09-03 15:54                   ` Sean Christopherson
2026-09-03 19:13                     ` Paolo Bonzini
2026-09-03 20:58                       ` Sean Christopherson
2026-09-03 15:48           ` Sean Christopherson
2026-08-31 14:47 ` [PATCH v7 03/23] KVM: Allow KVM implementations to switch off MMIO independent of Kconfig Steffen Eiden
2026-09-02  0:38   ` Sean Christopherson
2026-09-02  8:22     ` Steffen Eiden
2026-09-02  8:30     ` Marc Zyngier
2026-09-02  9:13       ` Steffen Eiden
2026-09-02 13:00         ` Sean Christopherson
2026-09-02 15:50           ` Sean Christopherson
2026-08-31 14:47 ` [PATCH v7 04/23] arm64: Use proper include variant Steffen Eiden
2026-08-31 14:47 ` [PATCH v7 05/23] arm64: ptrace: Use constants for compat register numbers Steffen Eiden
2026-08-31 14:47 ` [PATCH v7 06/23] arm64: sysreg: Convert SPSR_ELx to automatic register generation Steffen Eiden
2026-08-31 14:47 ` [PATCH v7 07/23] KVM: arm64: Access elements of vcpu_gp_regs individually Steffen Eiden
2026-08-31 14:47 ` [PATCH v7 08/23] KVM: arm64: Use accessor functions for core regs Steffen Eiden
2026-08-31 14:47 ` [PATCH v7 09/23] arm64: Prepare sharing arm64 headers with s390 Steffen Eiden
2026-08-31 14:47 ` [PATCH v7 10/23] arm64: Share " Steffen Eiden
2026-08-31 14:47 ` [PATCH v7 11/23] KVM: arm64: Share arm64 code " Steffen Eiden
2026-09-01  8:13   ` Marc Zyngier
2026-09-01  8:40     ` Steffen Eiden
2026-09-02  7:41       ` Marc Zyngier
2026-09-02 12:41         ` Steffen Eiden
2026-08-31 14:47 ` [PATCH v7 12/23] s390/tools: Use arm64 headers Steffen Eiden
2026-08-31 14:47 ` [PATCH v7 13/23] KVM: s390: Use arm64 code Steffen Eiden
2026-08-31 14:47 ` [PATCH v7 14/23] KVM: s390: Prepare KVM/s390 for a second KVM module Steffen Eiden
2026-08-31 14:47 ` [PATCH v7 15/23] s390: Introduce Start Arm Execution instruction Steffen Eiden
2026-08-31 14:47 ` [PATCH v7 16/23] KVM: s390: arm64: Introduce host definitions Steffen Eiden
2026-08-31 14:47 ` [PATCH v7 17/23] s390/hwcaps: Report SAE support as hwcap Steffen Eiden
2026-08-31 14:47 ` [PATCH v7 18/23] KVM: s390: Add basic arm64 kvm module Steffen Eiden
2026-08-31 14:47 ` [PATCH v7 19/23] KVM: s390: arm64: Implement required functions Steffen Eiden
2026-08-31 14:47 ` [PATCH v7 20/23] KVM: s390: arm64: Implement vm/vcpu create destroy Steffen Eiden
2026-08-31 14:47 ` [PATCH v7 21/23] KVM: s390: arm64: Implement vCPU IOCTLs Steffen Eiden
2026-09-03 13:27   ` Janosch Frank
2026-08-31 14:47 ` [PATCH v7 22/23] KVM: s390: arm64: Implement basic page fault handler Steffen Eiden
2026-08-31 14:48 ` [PATCH v7 23/23] KVM: s390: arm64: Add KVM_S390_ARM64 Kconfig and Makefile Steffen Eiden
2026-09-02 16:20   ` Sean Christopherson
2026-09-03  8:38     ` Steffen Eiden
2026-09-03 14:43       ` Sean Christopherson
2026-09-03 15:43         ` Steffen Eiden [this message]
2026-09-03 16:33           ` Sean Christopherson
2026-09-03 16:41             ` Paolo Bonzini

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20260903154317.246414-A-seiden@linux.ibm.com \
    --to=seiden@linux.ibm.com \
    --cc=Ulrich.Weigand@de.ibm.com \
    --cc=agordeev@linux.ibm.com \
    --cc=arnd@arndb.de \
    --cc=borntraeger@linux.ibm.com \
    --cc=brueckner@linux.ibm.com \
    --cc=catalin.marinas@arm.com \
    --cc=david@kernel.org \
    --cc=frankja@linux.ibm.com \
    --cc=fritz@linux.ibm.com \
    --cc=ggala@linux.ibm.com \
    --cc=gor@linux.ibm.com \
    --cc=gra@linux.ibm.com \
    --cc=hari55@linux.ibm.com \
    --cc=hca@linux.ibm.com \
    --cc=iii@linux.ibm.com \
    --cc=imbrenda@linux.ibm.com \
    --cc=joey.gouly@arm.com \
    --cc=kvm@vger.kernel.org \
    --cc=kvmarm@lists.linux.dev \
    --cc=linux-arm-kernel@lists.infradead.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-s390@vger.kernel.org \
    --cc=maz@kernel.org \
    --cc=nrb@linux.ibm.com \
    --cc=oss@nina.schoetterlglausch.eu \
    --cc=oupton@kernel.org \
    --cc=pbonzini@redhat.com \
    --cc=seanjc@google.com \
    --cc=suzuki.poulose@arm.com \
    --cc=svens@linux.ibm.com \
    --cc=tabba@google.com \
    --cc=will@kernel.org \
    --cc=yuzenghui@huawei.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox