qemu-devel.nongnu.org archive mirror
 help / color / mirror / Atom feed
From: David Woodhouse <dwmw2@infradead.org>
To: Paolo Bonzini <pbonzini@redhat.com>,
	Xiaoyao Li <xiaoyao.li@intel.com>,
	 Peter Maydell <peter.maydell@linaro.org>,
	qemu-devel@nongnu.org
Cc: "Paul Durrant" <paul@xen.org>,
	"Joao Martins" <joao.m.martins@oracle.com>,
	"Ankur Arora" <ankur.a.arora@oracle.com>,
	"Philippe Mathieu-Daudé" <philmd@linaro.org>,
	"Thomas Huth" <thuth@redhat.com>,
	"Alex Bennée" <alex.bennee@linaro.org>,
	"Juan Quintela" <quintela@redhat.com>,
	"Dr . David Alan Gilbert" <dgilbert@redhat.com>,
	"Claudio Fontana" <cfontana@suse.de>,
	"Julien Grall" <julien@xen.org>,
	"Michael S. Tsirkin" <mst@redhat.com>,
	"Marcel Apfelbaum" <marcel.apfelbaum@gmail.com>,
	armbru@redhat.com, "Stefano Stabellini" <sstabellini@kernel.org>,
	vikram.garhwal@amd.com
Subject: [PATCH] hw/xen: Simplify emulated Xen platform init
Date: Fri, 10 Mar 2023 10:54:45 +0000	[thread overview]
Message-ID: <4bae59aba8f3016afe295b2525ab76bb51ac3229.camel@infradead.org> (raw)
In-Reply-To: <7d6e4ef2-1f27-f210-0378-879852a70024@redhat.com>

[-- Attachment #1: Type: text/plain, Size: 6532 bytes --]

From: David Woodhouse <dwmw@amazon.co.uk>

I initially put the basic platform init (overlay pages, grant tables,
event channels) into mc->kvm_type because that was the earliest place
that could sensibly test for xen_mode==XEN_EMULATE.

The intent was to do this early enough that we could then initialise the
XenBus and other parts which would have depended on them, from a generic
location for both Xen and KVM/Xen in the PC-specific code, as seen in
https://lore.kernel.org/qemu-devel/20230116221919.1124201-16-dwmw2@infradead.org/

However, then the Xen on Arm patches came along, and *they* wanted to
do the XenBus init from a 'generic' Xen-specific location instead:
https://lore.kernel.org/qemu-devel/20230210222729.957168-4-sstabellini@kernel.org/

Since there's no generic location that covers all three, I conceded to
do it for XEN_EMULATE mode in pc_basic_devices_init().

And now there's absolutely no point in having some of the platform init
done from pc_machine_kvm_type(); we can move it all up to live in a
single place in pc_basic_devices_init(). This has the added benefit that
we can drop the separate xen_evtchn_connect_gsis() function completely,
and pass just the system GSIs in directly to xen_evtchn_create().

While I'm at it, it does no harm to explicitly pass in the *number* of
said GSIs, because it does make me twitch a bit to pass an array of
impicit size. During the lifetime of the KVM/Xen patchset, that had
already changed (albeit just cosmetically) from GSI_NUM_PINS to
IOAPIC_NUM_PINS.

And document a bit better that this is for the *output* GSI for raising
CPU0's events when the per-CPU vector isn't available. The fact that
we create a whole set of them and then only waggle the one we're told
to, instead of having a single output and only *connecting* it to the
GSI that it should be connected to, is still non-intuitive for me.

Signed-off-by: David Woodhouse <dwmw@amazon.co.uk>
---
 hw/i386/kvm/xen_evtchn.c | 40 ++++++++++++++++++++--------------------
 hw/i386/kvm/xen_evtchn.h |  3 +--
 hw/i386/pc.c             | 13 ++++---------
 3 files changed, 25 insertions(+), 31 deletions(-)

diff --git a/hw/i386/kvm/xen_evtchn.c b/hw/i386/kvm/xen_evtchn.c
index 98a7b85047..f4204949fb 100644
--- a/hw/i386/kvm/xen_evtchn.c
+++ b/hw/i386/kvm/xen_evtchn.c
@@ -146,7 +146,10 @@ struct XenEvtchnState {
     QemuMutex port_lock;
     uint32_t nr_ports;
     XenEvtchnPort port_table[EVTCHN_2L_NR_CHANNELS];
-    qemu_irq gsis[IOAPIC_NUM_PINS];
+
+    /* Connected to the system GSIs for raising callback as GSI / INTx */
+    unsigned int nr_callback_gsis;
+    qemu_irq *callback_gsis;
 
     struct xenevtchn_handle *be_handles[EVTCHN_2L_NR_CHANNELS];
 
@@ -298,7 +301,7 @@ static void gsi_assert_bh(void *opaque)
     }
 }
 
-void xen_evtchn_create(void)
+void xen_evtchn_create(unsigned int nr_gsis, qemu_irq *system_gsis)
 {
     XenEvtchnState *s = XEN_EVTCHN(sysbus_create_simple(TYPE_XEN_EVTCHN,
                                                         -1, NULL));
@@ -309,8 +312,19 @@ void xen_evtchn_create(void)
     qemu_mutex_init(&s->port_lock);
     s->gsi_bh = aio_bh_new(qemu_get_aio_context(), gsi_assert_bh, s);
 
-    for (i = 0; i < IOAPIC_NUM_PINS; i++) {
-        sysbus_init_irq(SYS_BUS_DEVICE(s), &s->gsis[i]);
+    /*
+     * These are the *output* GSI from event channel support, for
+     * signalling CPU0's events via GSI or PCI INTx instead of the
+     * per-CPU vector. We create a *set* of irqs and connect one to
+     * each of the system GSIs which were passed in from the platform
+     * code, and then just trigger the right one as appropriate from
+     * xen_evtchn_set_callback_level().
+     */
+    s->nr_callback_gsis = nr_gsis;
+    s->callback_gsis = g_new0(qemu_irq, nr_gsis);
+    for (i = 0; i < nr_gsis; i++) {
+        sysbus_init_irq(SYS_BUS_DEVICE(s), &s->callback_gsis[i]);
+        sysbus_connect_irq(SYS_BUS_DEVICE(s), i, system_gsis[i]);
     }
 
     /*
@@ -335,20 +349,6 @@ void xen_evtchn_create(void)
     xen_evtchn_ops = &emu_evtchn_backend_ops;
 }
 
-void xen_evtchn_connect_gsis(qemu_irq *system_gsis)
-{
-    XenEvtchnState *s = xen_evtchn_singleton;
-    int i;
-
-    if (!s) {
-        return;
-    }
-
-    for (i = 0; i < IOAPIC_NUM_PINS; i++) {
-        sysbus_connect_irq(SYS_BUS_DEVICE(s), i, system_gsis[i]);
-    }
-}
-
 static void xen_evtchn_register_types(void)
 {
     type_register_static(&xen_evtchn_info);
@@ -429,8 +429,8 @@ void xen_evtchn_set_callback_level(int level)
         return;
     }
 
-    if (s->callback_gsi && s->callback_gsi < IOAPIC_NUM_PINS) {
-        qemu_set_irq(s->gsis[s->callback_gsi], level);
+    if (s->callback_gsi && s->callback_gsi < s->nr_callback_gsis) {
+        qemu_set_irq(s->callback_gsis[s->callback_gsi], level);
         if (level) {
             /* Ensure the vCPU polls for deassertion */
             kvm_xen_set_callback_asserted();
diff --git a/hw/i386/kvm/xen_evtchn.h b/hw/i386/kvm/xen_evtchn.h
index bfb67ac2bc..b740acfc0d 100644
--- a/hw/i386/kvm/xen_evtchn.h
+++ b/hw/i386/kvm/xen_evtchn.h
@@ -16,10 +16,9 @@
 
 typedef uint32_t evtchn_port_t;
 
-void xen_evtchn_create(void);
+void xen_evtchn_create(unsigned int nr_gsis, qemu_irq *system_gsis);
 int xen_evtchn_soft_reset(void);
 int xen_evtchn_set_callback_param(uint64_t param);
-void xen_evtchn_connect_gsis(qemu_irq *system_gsis);
 void xen_evtchn_set_callback_level(int level);
 
 int xen_evtchn_set_port(uint16_t port);
diff --git a/hw/i386/pc.c b/hw/i386/pc.c
index 1489abf010..25584cb8f3 100644
--- a/hw/i386/pc.c
+++ b/hw/i386/pc.c
@@ -1319,7 +1319,10 @@ void pc_basic_device_init(struct PCMachineState *pcms,
 
 #ifdef CONFIG_XEN_EMU
     if (xen_mode == XEN_EMULATE) {
-        xen_evtchn_connect_gsis(gsi);
+        xen_overlay_create();
+        xen_evtchn_create(IOAPIC_NUM_PINS, gsi);
+        xen_gnttab_create();
+        xen_xenstore_create();
         if (pcms->bus) {
             pci_create_simple(pcms->bus, -1, "xen-platform");
         }
@@ -1868,14 +1871,6 @@ static void pc_machine_initfn(Object *obj)
 
 int pc_machine_kvm_type(MachineState *machine, const char *kvm_type)
 {
-#ifdef CONFIG_XEN_EMU
-    if (xen_mode == XEN_EMULATE) {
-        xen_overlay_create();
-        xen_evtchn_create();
-        xen_gnttab_create();
-        xen_xenstore_create();
-    }
-#endif
     return 0;
 }
 
-- 
2.34.1



[-- Attachment #2: smime.p7s --]
[-- Type: application/pkcs7-signature, Size: 5965 bytes --]

  parent reply	other threads:[~2023-03-10 10:55 UTC|newest]

Thread overview: 67+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2023-03-01 13:51 [PATCH v15 00/60] Xen HVM support under KVM David Woodhouse
2023-03-01 13:51 ` [PATCH v15 01/60] include: import Xen public headers to hw/xen/interface David Woodhouse
2023-03-01 13:51 ` [PATCH v15 02/60] xen: add CONFIG_XEN_BUS and CONFIG_XEN_EMU options for Xen emulation David Woodhouse
2023-03-01 13:51 ` [PATCH v15 03/60] xen: Add XEN_DISABLED mode and make it default David Woodhouse
2023-03-01 13:51 ` [PATCH v15 04/60] i386/kvm: Add xen-version KVM accelerator property and init KVM Xen support David Woodhouse
2023-03-01 13:51 ` [PATCH v15 05/60] i386/kvm: handle Xen HVM cpuid leaves David Woodhouse
2023-03-01 13:51 ` [PATCH v15 06/60] i386/kvm: Set Xen vCPU ID in KVM David Woodhouse
2023-03-01 13:51 ` [PATCH v15 07/60] xen-platform: exclude vfio-pci from the PCI platform unplug David Woodhouse
2023-03-01 13:51 ` [PATCH v15 08/60] xen-platform: allow its creation with XEN_EMULATE mode David Woodhouse
2023-03-01 13:51 ` [PATCH v15 09/60] i386/xen: handle guest hypercalls David Woodhouse
2023-03-01 13:51 ` [PATCH v15 10/60] i386/xen: implement HYPERVISOR_xen_version David Woodhouse
2023-03-01 13:51 ` [PATCH v15 11/60] i386/xen: implement HYPERVISOR_sched_op, SCHEDOP_shutdown David Woodhouse
2023-03-01 13:51 ` [PATCH v15 12/60] i386/xen: Implement SCHEDOP_poll and SCHEDOP_yield David Woodhouse
2023-03-01 13:51 ` [PATCH v15 13/60] hw/xen: Add xen_overlay device for emulating shared xenheap pages David Woodhouse
2023-03-01 13:51 ` [PATCH v15 14/60] xen: Permit --xen-domid argument when accel is KVM David Woodhouse
2023-03-01 13:51 ` [PATCH v15 15/60] i386/xen: add pc_machine_kvm_type to initialize XEN_EMULATE mode David Woodhouse
2023-03-10  3:15   ` Xiaoyao Li
2023-03-10  8:28     ` David Woodhouse
2023-03-10  8:52       ` Paolo Bonzini
2023-03-10  9:21         ` David Woodhouse
2023-03-10 10:54         ` David Woodhouse [this message]
2023-03-24  9:10           ` [PATCH] hw/xen: Simplify emulated Xen platform init Paul Durrant
2023-03-01 13:51 ` [PATCH v15 16/60] i386/xen: manage and save/restore Xen guest long_mode setting David Woodhouse
2023-03-01 13:51 ` [PATCH v15 17/60] i386/xen: implement HYPERVISOR_memory_op David Woodhouse
2023-03-01 13:51 ` [PATCH v15 18/60] i386/xen: implement XENMEM_add_to_physmap_batch David Woodhouse
2023-03-01 13:51 ` [PATCH v15 19/60] i386/xen: implement HYPERVISOR_hvm_op David Woodhouse
2023-03-01 13:51 ` [PATCH v15 20/60] i386/xen: implement HYPERVISOR_vcpu_op David Woodhouse
2023-03-01 13:51 ` [PATCH v15 21/60] i386/xen: handle VCPUOP_register_vcpu_info David Woodhouse
2023-03-01 13:51 ` [PATCH v15 22/60] i386/xen: handle VCPUOP_register_vcpu_time_info David Woodhouse
2023-03-01 13:51 ` [PATCH v15 23/60] i386/xen: handle VCPUOP_register_runstate_memory_area David Woodhouse
2023-03-01 13:51 ` [PATCH v15 24/60] i386/xen: implement HYPERVISOR_event_channel_op David Woodhouse
2023-03-01 13:51 ` [PATCH v15 25/60] i386/xen: implement HVMOP_set_evtchn_upcall_vector David Woodhouse
2023-03-01 13:51 ` [PATCH v15 26/60] i386/xen: implement HVMOP_set_param David Woodhouse
2023-03-01 13:51 ` [PATCH v15 27/60] hw/xen: Add xen_evtchn device for event channel emulation David Woodhouse
2023-03-01 13:51 ` [PATCH v15 28/60] i386/xen: Add support for Xen event channel delivery to vCPU David Woodhouse
2023-03-01 13:51 ` [PATCH v15 29/60] hw/xen: Implement EVTCHNOP_status David Woodhouse
2023-03-01 13:51 ` [PATCH v15 30/60] hw/xen: Implement EVTCHNOP_close David Woodhouse
2023-03-01 13:51 ` [PATCH v15 31/60] hw/xen: Implement EVTCHNOP_unmask David Woodhouse
2023-03-01 13:51 ` [PATCH v15 32/60] hw/xen: Implement EVTCHNOP_bind_virq David Woodhouse
2023-03-01 13:51 ` [PATCH v15 33/60] hw/xen: Implement EVTCHNOP_bind_ipi David Woodhouse
2023-03-01 13:51 ` [PATCH v15 34/60] hw/xen: Implement EVTCHNOP_send David Woodhouse
2023-03-01 13:51 ` [PATCH v15 35/60] hw/xen: Implement EVTCHNOP_alloc_unbound David Woodhouse
2023-03-01 13:51 ` [PATCH v15 36/60] hw/xen: Implement EVTCHNOP_bind_interdomain David Woodhouse
2023-03-01 13:52 ` [PATCH v15 37/60] hw/xen: Implement EVTCHNOP_bind_vcpu David Woodhouse
2023-03-01 13:52 ` [PATCH v15 38/60] hw/xen: Implement EVTCHNOP_reset David Woodhouse
2023-03-01 13:52 ` [PATCH v15 39/60] i386/xen: add monitor commands to test event injection David Woodhouse
2023-03-01 13:52 ` [PATCH v15 40/60] hw/xen: Support HVM_PARAM_CALLBACK_TYPE_GSI callback David Woodhouse
2023-03-01 13:52 ` [PATCH v15 41/60] hw/xen: Support HVM_PARAM_CALLBACK_TYPE_PCI_INTX callback David Woodhouse
2023-03-01 13:52 ` [PATCH v15 42/60] kvm/i386: Add xen-gnttab-max-frames property David Woodhouse
2023-03-01 13:52 ` [PATCH v15 43/60] hw/xen: Add xen_gnttab device for grant table emulation David Woodhouse
2023-03-01 13:52 ` [PATCH v15 44/60] hw/xen: Support mapping grant frames David Woodhouse
2023-03-01 13:52 ` [PATCH v15 45/60] i386/xen: Implement HYPERVISOR_grant_table_op and GNTTABOP_[gs]et_verson David Woodhouse
2023-03-01 13:52 ` [PATCH v15 46/60] hw/xen: Implement GNTTABOP_query_size David Woodhouse
2023-03-01 13:52 ` [PATCH v15 47/60] i386/xen: handle PV timer hypercalls David Woodhouse
2023-03-01 13:52 ` [PATCH v15 48/60] i386/xen: Reserve Xen special pages for console, xenstore rings David Woodhouse
2023-03-01 13:52 ` [PATCH v15 49/60] i386/xen: handle HVMOP_get_param David Woodhouse
2023-03-01 13:52 ` [PATCH v15 50/60] hw/xen: Add backend implementation of interdomain event channel support David Woodhouse
2023-03-01 13:52 ` [PATCH v15 51/60] hw/xen: Add xen_xenstore device for xenstore emulation David Woodhouse
2023-03-01 13:52 ` [PATCH v15 52/60] hw/xen: Add basic ring handling to xenstore David Woodhouse
2023-03-01 13:52 ` [PATCH v15 53/60] hw/xen: Automatically add xen-platform PCI device for emulated Xen guests David Woodhouse
2023-03-01 13:52 ` [PATCH v15 54/60] i386/xen: Implement HYPERVISOR_physdev_op David Woodhouse
2023-03-01 13:52 ` [PATCH v15 55/60] hw/xen: Implement emulated PIRQ hypercall support David Woodhouse
2023-03-01 13:52 ` [PATCH v15 56/60] hw/xen: Support GSI mapping to PIRQ David Woodhouse
2023-03-01 13:52 ` [PATCH v15 57/60] hw/xen: Support MSI " David Woodhouse
2023-03-01 13:52 ` [PATCH v15 58/60] kvm/i386: Add xen-evtchn-max-pirq property David Woodhouse
2023-03-01 13:52 ` [PATCH v15 59/60] i386/xen: Document Xen HVM emulation David Woodhouse
2023-03-01 13:52 ` [PATCH v15 60/60] hw/xen: Subsume xen_be_register_common() into xen_be_init() David Woodhouse

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=4bae59aba8f3016afe295b2525ab76bb51ac3229.camel@infradead.org \
    --to=dwmw2@infradead.org \
    --cc=alex.bennee@linaro.org \
    --cc=ankur.a.arora@oracle.com \
    --cc=armbru@redhat.com \
    --cc=cfontana@suse.de \
    --cc=dgilbert@redhat.com \
    --cc=joao.m.martins@oracle.com \
    --cc=julien@xen.org \
    --cc=marcel.apfelbaum@gmail.com \
    --cc=mst@redhat.com \
    --cc=paul@xen.org \
    --cc=pbonzini@redhat.com \
    --cc=peter.maydell@linaro.org \
    --cc=philmd@linaro.org \
    --cc=qemu-devel@nongnu.org \
    --cc=quintela@redhat.com \
    --cc=sstabellini@kernel.org \
    --cc=thuth@redhat.com \
    --cc=vikram.garhwal@amd.com \
    --cc=xiaoyao.li@intel.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).