From: "Michael S. Tsirkin" <mst@redhat.com>
To: Stefan Hajnoczi <stefanha@redhat.com>
Cc: elena.ufimtseva@oracle.com, fam@euphon.net,
swapnil.ingle@nutanix.com, john.g.johnson@oracle.com,
qemu-devel@nongnu.org, kraxel@redhat.com, jag.raman@oracle.com,
quintela@redhat.com, armbru@redhat.com,
kanth.ghatraju@oracle.com, felipe@nutanix.com, thuth@redhat.com,
ehabkost@redhat.com, konrad.wilk@oracle.com, dgilbert@redhat.com,
liran.alon@oracle.com, thanos.makatos@nutanix.com,
rth@twiddle.net, kwolf@redhat.com, berrange@redhat.com,
mreitz@redhat.com, ross.lagerwall@citrix.com,
marcandre.lureau@gmail.com, pbonzini@redhat.com
Subject: Re: [PATCH RESEND v6 00/36] Initial support for multi-process qemu
Date: Tue, 28 Apr 2020 13:47:24 -0400 [thread overview]
Message-ID: <20200428134350-mutt-send-email-mst@kernel.org> (raw)
In-Reply-To: <20200428172920.GA111124@stefanha-x1.localdomain>
On Tue, Apr 28, 2020 at 06:29:20PM +0100, Stefan Hajnoczi wrote:
> On Wed, Apr 22, 2020 at 09:13:35PM -0700, elena.ufimtseva@oracle.com wrote:
> > We will post separate patchsets for the following improvements for
> > the experimental Qemu multi-process:
> > - Live migration;
> > - Asynchronous communication channel;
> > - Libvirt support;
> >
> > We welcome all your ideas, concerns, and questions for this patchset.
>
> This patch series does two things:
> 1. It introduces the remote device infrastructure.
> 2. It creates the remote device program and the associated build changes
> (makefiles, stubs, etc).
>
> There are many patches and it's likely that a bunch more revisions will
> be necessary before this can be merged.
>
> I want to share an idea to reduce the scope and get patches merged more
> quickly. It looks like the series can be reduced to 21 patches using
> this approach.
>
> I suggest dropping the remote device program from this patch series (and
> maybe never bringing it back). Instead, use the softmmu target for the
> remote device.
>
> Why? Because the remote device program is just a QEMU that uses the
> remote machine type and has no vCPUs:
>
> $ qemu-system-x86_64 -chardev id=char0,... \
> -M remote,chardev=char0 \
> -device lsi53c810 \
> -drive if=none,id=drive0,file=vm.img,format=raw \
> -device scsi-hd,drive=drive0
>
> This will use the remote machine type, interrupt controller, and PCI bus
> that you have created.
>
> The remote machine type should default to no vCPUs and no memory
> creation (the memory comes via the mpqemu link communications channel).
>
> At this point qemu-system-x86_64 contains a lot of code that you don't
> want in the final remote device program. Let's ignore that for a
> second.
>
> Now you can submit a 21-patch series containing just the remote device
> infrastructure. This will be easier to merge.
>
> Returning to code size, the next step is to reduce the binary. QEMU has
> a Kconfig-style system for optional features and dependencies. It's a
> better approach than creating a separate make target because it
> eliminates the duplication and mess in the makefiles.
>
> For example, you can disable TCG and KVM so that your binary has no
> ability to execute guest code. Currently ./configure disallows this but
> I've tried it and it works.
>
> You can add a new default-configs/ file that disables CONFIG_ISAPC,
> CONFIG_I440FX, etc. When you compile QEMU most of hw/ will not be built
> anymore. At this point you have a smaller binary that is still a
> softmmu target so the makefiles are shared with the regular
> qemu-system-x86_64.
>
> There will be some code for which there is no Kconfig option yet.
> Further improvements can be made by adding Kconfig options for any code
> that you wish to eliminate. Instead of writing makefile changes like
> you did in this patch series you would be adding Kconfig options. The
> nice thing is that this work isn't specific to the remote device program
> - anyone can use the new Kconfig options to reduce the size of their
> QEMU. So not only is it less messy than duplicating the makefiles,
> but it also benefits everyone.
>
> The downside to doing this is that it will take a while to eliminate all
> code that you don't want via Kconfig. However, your initial patch
> series can be merged sooner and I think this direction is also cleaner.
>
> I hope I've explained the idea properly :). We can continue reviewing
> the current series if you prefer, but I think it would be quicker to
> drop the remote device program.
>
> Stefan
Building QEMU twices just to get the remote is however not very
attractive. So how about making remote a special target?
Either remote-softmmu/ or if impossible x86_64-remote-softmmu/
--
MST
next prev parent reply other threads:[~2020-04-28 17:52 UTC|newest]
Thread overview: 94+ messages / expand[flat|nested] mbox.gz Atom feed top
2020-04-23 4:13 [PATCH RESEND v6 00/36] Initial support for multi-process qemu elena.ufimtseva
2020-04-23 4:13 ` [PATCH RESEND v6 01/36] memory: alloc RAM from file at offset elena.ufimtseva
2020-05-12 8:26 ` Stefan Hajnoczi
2020-05-12 8:48 ` Daniel P. Berrangé
2020-05-12 11:56 ` Jag Raman
2020-05-13 8:40 ` Stefan Hajnoczi
2020-05-13 15:25 ` Igor Mammedov
2020-05-13 20:08 ` Jag Raman
2020-05-14 9:47 ` Igor Mammedov
2020-05-14 9:51 ` Dr. David Alan Gilbert
2020-04-23 4:13 ` [PATCH RESEND v6 02/36] multi-process: Refactor machine_init and exit notifiers elena.ufimtseva
2020-04-23 14:13 ` Philippe Mathieu-Daudé
2020-04-23 4:13 ` [PATCH RESEND v6 03/36] command-line: refractor parser code elena.ufimtseva
2020-04-24 12:55 ` Stefan Hajnoczi
2020-04-23 4:13 ` [PATCH RESEND v6 04/36] multi-process: Refactor chardev functions out of vl.c elena.ufimtseva
2020-04-23 4:13 ` [PATCH RESEND v6 05/36] multi-process: Refactor monitor " elena.ufimtseva
2020-04-24 13:02 ` Stefan Hajnoczi
2020-04-23 4:13 ` [PATCH RESEND v6 06/36] monitor: destaticize HMP commands elena.ufimtseva
2020-04-23 14:14 ` Philippe Mathieu-Daudé
2020-04-23 15:07 ` Jag Raman
2020-04-23 15:58 ` Philippe Mathieu-Daudé
2020-04-23 4:13 ` [PATCH RESEND v6 07/36] multi-process: add a command line option for debug file elena.ufimtseva
2020-04-23 4:13 ` [PATCH RESEND v6 08/36] multi-process: Add stub functions to facilitate build of multi-process elena.ufimtseva
2020-04-24 13:12 ` Stefan Hajnoczi
2020-04-24 13:47 ` Jag Raman
2020-04-28 16:29 ` Stefan Hajnoczi
2020-04-28 18:58 ` Jag Raman
2020-04-29 9:41 ` Stefan Hajnoczi
2020-04-23 4:13 ` [PATCH RESEND v6 09/36] multi-process: Add config option for multi-process QEMU elena.ufimtseva
2020-04-24 13:47 ` Stefan Hajnoczi
2020-04-23 4:13 ` [PATCH RESEND v6 10/36] multi-process: build system for remote device process elena.ufimtseva
2020-04-24 15:04 ` Stefan Hajnoczi
2020-04-23 4:13 ` [PATCH RESEND v6 11/36] multi-process: define mpqemu-link object elena.ufimtseva
2020-05-12 8:56 ` Stefan Hajnoczi
2020-05-12 12:09 ` Jag Raman
2020-04-23 4:13 ` [PATCH RESEND v6 12/36] multi-process: add functions to synchronize proxy and remote endpoints elena.ufimtseva
2020-05-12 10:21 ` Stefan Hajnoczi
2020-05-12 12:28 ` Jag Raman
2020-05-13 8:43 ` Stefan Hajnoczi
2020-04-23 4:13 ` [PATCH RESEND v6 13/36] multi-process: setup PCI host bridge for remote device elena.ufimtseva
2020-05-12 10:31 ` Stefan Hajnoczi
2020-04-23 4:13 ` [PATCH RESEND v6 14/36] multi-process: setup a machine object for remote device process elena.ufimtseva
2020-05-12 10:43 ` Stefan Hajnoczi
2020-05-12 12:12 ` Jag Raman
2020-04-23 4:13 ` [PATCH RESEND v6 15/36] multi-process: setup memory manager for remote device elena.ufimtseva
2020-05-12 12:11 ` Stefan Hajnoczi
2020-04-23 4:13 ` [PATCH RESEND v6 16/36] multi-process: remote process initialization elena.ufimtseva
2020-04-23 4:13 ` [PATCH RESEND v6 17/36] multi-process: introduce proxy object elena.ufimtseva
2020-05-12 12:23 ` Stefan Hajnoczi
2020-05-12 12:35 ` Jag Raman
2020-04-23 4:13 ` [PATCH RESEND v6 18/36] multi-process: Initialize Proxy Object's communication channel elena.ufimtseva
2020-05-12 12:35 ` Stefan Hajnoczi
2020-04-23 4:13 ` [PATCH RESEND v6 19/36] multi-process: Connect Proxy Object with device in the remote process elena.ufimtseva
2020-05-12 12:54 ` Stefan Hajnoczi
2020-04-23 4:13 ` [PATCH RESEND v6 20/36] multi-process: Forward PCI config space acceses to " elena.ufimtseva
2020-05-12 13:50 ` Stefan Hajnoczi
2020-04-23 4:13 ` [PATCH RESEND v6 21/36] multi-process: PCI BAR read/write handling for proxy & remote endpoints elena.ufimtseva
2020-05-12 14:19 ` Stefan Hajnoczi
2020-04-23 4:13 ` [PATCH RESEND v6 22/36] multi-process: Synchronize remote memory elena.ufimtseva
2020-05-12 15:07 ` Stefan Hajnoczi
2020-05-12 15:49 ` Dr. David Alan Gilbert
2020-04-23 4:13 ` [PATCH RESEND v6 23/36] multi-process: create IOHUB object to handle irq elena.ufimtseva
2020-05-12 15:57 ` Stefan Hajnoczi
2020-05-12 16:12 ` Stefan Hajnoczi
2020-04-23 4:13 ` [PATCH RESEND v6 24/36] multi-process: Retrieve PCI info from remote process elena.ufimtseva
2020-05-12 16:07 ` Stefan Hajnoczi
2020-04-23 4:14 ` [PATCH RESEND v6 25/36] multi-process: Introduce build flags to separate remote process code elena.ufimtseva
2020-04-23 4:14 ` [PATCH RESEND v6 26/36] multi-process: add parse_cmdline in remote process elena.ufimtseva
2020-04-23 4:14 ` [PATCH RESEND v6 27/36] multi-process: add support to parse device option elena.ufimtseva
2020-04-23 4:14 ` [PATCH RESEND v6 28/36] multi-process: send heartbeat messages to remote elena.ufimtseva
2020-04-23 4:14 ` [PATCH RESEND v6 29/36] multi-process: handle heartbeat messages in remote process elena.ufimtseva
2020-04-23 4:14 ` [PATCH RESEND v6 30/36] multi-process: perform device reset in the " elena.ufimtseva
2020-04-23 4:14 ` [PATCH RESEND v6 31/36] multi-process/mon: choose HMP commands based on target elena.ufimtseva
2020-04-23 4:14 ` [PATCH RESEND v6 32/36] multi-process/mon: stub functions to enable QMP module for remote process elena.ufimtseva
2020-04-23 4:14 ` [PATCH RESEND v6 33/36] multi-process/mon: enable QMP module support in the " elena.ufimtseva
2020-04-23 4:14 ` [PATCH RESEND v6 34/36] multi-process/mon: Initialize QMP module for remote processes elena.ufimtseva
2020-04-23 4:14 ` [PATCH RESEND v6 35/36] multi-process: add the concept description to docs/devel/qemu-multiprocess elena.ufimtseva
2020-04-23 4:14 ` [PATCH RESEND v6 36/36] multi-process: add configure and usage information elena.ufimtseva
2020-04-23 13:54 ` 罗勇刚(Yonggang Luo)
2020-04-23 15:01 ` Jag Raman
2020-04-23 22:56 ` 罗勇刚(Yonggang Luo)
2020-04-24 0:34 ` 罗勇刚(Yonggang Luo)
2020-04-24 12:48 ` [PATCH RESEND v6 00/36] Initial support for multi-process qemu Stefan Hajnoczi
2020-04-24 12:53 ` Daniel P. Berrangé
2020-04-24 12:53 ` Eric Blake
2020-04-24 13:42 ` Max Reitz
2020-04-28 17:29 ` Stefan Hajnoczi
2020-04-28 17:47 ` Michael S. Tsirkin [this message]
2020-04-29 9:30 ` Stefan Hajnoczi
2020-04-29 9:59 ` Michael S. Tsirkin
2020-05-11 14:40 ` Stefan Hajnoczi
2020-05-11 19:30 ` Jag Raman
2020-05-12 16:13 ` Stefan Hajnoczi
2020-05-12 16:55 ` Jag Raman
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20200428134350-mutt-send-email-mst@kernel.org \
--to=mst@redhat.com \
--cc=armbru@redhat.com \
--cc=berrange@redhat.com \
--cc=dgilbert@redhat.com \
--cc=ehabkost@redhat.com \
--cc=elena.ufimtseva@oracle.com \
--cc=fam@euphon.net \
--cc=felipe@nutanix.com \
--cc=jag.raman@oracle.com \
--cc=john.g.johnson@oracle.com \
--cc=kanth.ghatraju@oracle.com \
--cc=konrad.wilk@oracle.com \
--cc=kraxel@redhat.com \
--cc=kwolf@redhat.com \
--cc=liran.alon@oracle.com \
--cc=marcandre.lureau@gmail.com \
--cc=mreitz@redhat.com \
--cc=pbonzini@redhat.com \
--cc=qemu-devel@nongnu.org \
--cc=quintela@redhat.com \
--cc=ross.lagerwall@citrix.com \
--cc=rth@twiddle.net \
--cc=stefanha@redhat.com \
--cc=swapnil.ingle@nutanix.com \
--cc=thanos.makatos@nutanix.com \
--cc=thuth@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).