From: Elena Ufimtseva <elena.ufimtseva@oracle.com>
To: qemu-devel@nongnu.org
Cc: fam@euphon.net, john.g.johnson@oracle.com,
swapnil.ingle@nutanix.com, mst@redhat.com, kraxel@redhat.com,
jag.raman@oracle.com, quintela@redhat.com, armbru@redhat.com,
kanth.ghatraju@oracle.com, felipe@nutanix.com, thuth@redhat.com,
ehabkost@redhat.com, konrad.wilk@oracle.com, dgilbert@redhat.com,
alex.williamson@redhat.com, stefanha@redhat.com,
pbonzini@redhat.com, kwolf@redhat.com, berrange@redhat.com,
mreitz@redhat.com, ross.lagerwall@citrix.com,
marcandre.lureau@gmail.com, thanos.makatos@nutanix.com
Subject: Re: [PATCH v14 00/21] Initial support for multi-process Qemu
Date: Thu, 17 Dec 2020 21:19:43 -0800 [thread overview]
Message-ID: <20201218051943.GA111182@flaka> (raw)
In-Reply-To: <cover.1608263017.git.elena.ufimtseva@oracle.com>
On Thu, Dec 17, 2020 at 07:57:47PM -0800, elena.ufimtseva@oracle.com wrote:
> From: Elena Ufimtseva <elena.ufimtseva@oracle.com>
>
> Hi
>
For some reason the patchset was not sent fully and only few patches
made trough.
I am resending the series with prefix in the subject "[PATCH v14 RESEND... "
I am sorry for this inconvenience.
Elena
> This is the v14 of the patchset. Thank you very much for reviewing v13 and
> sharing your feedback.
>
> We have addressed all the comments from the v13 review with changelog below:
>
> - [PATCH v14 05/21] multi-process: Add config option for multi-process QEMU
> add config option to disable the feature (--disable-multiprocess).
>
> - [PATCH v14 08/21] multi-process: add qio channel write function
> - [PATCH v14 09/21] multi-process: add qio channel read function
> refactor code in qio channel and split in two for read and write.
>
> - [PATCH v14 04/21] socket: export socket_get_fd() function
> export socket_get_fd() and use in remote process with some
> modifications.
>
> In addition, we will be sending a follow-up patch with the acceptance
> test that can be used to verify that this feature is working correctly.
>
> From the v13 review few items are TODOs:
> - Prefix log messages with PID in the logging subsystem.
> - Refactor the MemoryListener code in vfio-user and multi-process code
> to avoid logic duplication.
>
> To touch upon the history of this project, we posted the Proof Of Concept
> patches before the BoF session in 2018. Subsequently, we have posted 13
> versions on the qemu-devel mailing list. You can find them by following the
> links below ([1] - [13]). Following people contributed to the design and
> implementation of this project:
> Jagannathan Raman <jag.raman@oracle.com>
> Elena Ufimtseva <elena.ufimtseva@oracle.com>
> John G Johnson <john.g.johnson@oracle.com>
> Stefan Hajnoczi <stefanha@redhat.com>
> Konrad Wilk <konrad.wilk@oracle.com>
> Kanth Ghatraju <kanth.ghatraju@oracle.com>
>
> We would like to thank the QEMU community for your feedback in the
> design and implementation of this project. Qemu wiki page:
> https://wiki.qemu.org/Features/MultiProcessQEMU
>
> For the full concept writeup about QEMU multi-process, please
> refer to docs/devel/qemu-multiprocess.rst. Also, see
> docs/qemu-multiprocess.txt for usage information.
>
> Thank you for reviewing these series.
>
> [POC]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg566538.html
> [1]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg602285.html
> [2]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg624877.html
> [3]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg642000.html
> [4]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg655118.html
> [5]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg682429.html
> [6]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg697484.html
> [7]: https://patchew.org/QEMU/cover.1593273671.git.elena.ufimtseva@oracle.com/
> [8]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg727007.html
> [9]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg734275.html
> [10]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg747638.html
> [11]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg750972.html
> [12]: https://patchew.org/QEMU/cover.1606853298.git.jag.raman@oracle.com/
> [13]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg766825.html
>
> Elena Ufimtseva (8):
> multi-process: add configure and usage information
> multi-process: add qio channel write function
> multi-process: add qio channel read function
> multi-process: define MPQemuMsg format and transmission functions
> multi-process: introduce proxy object
> multi-process: add proxy communication functions
> multi-process: Forward PCI config space acceses to the remote process
> multi-process: perform device reset in the remote process
>
> Jagannathan Raman (12):
> memory: alloc RAM from file at offset
> socket: export socket_get_fd() function
> multi-process: Add config option for multi-process QEMU
> multi-process: setup PCI host bridge for remote device
> multi-process: setup a machine object for remote device process
> multi-process: Initialize message handler in remote device
> multi-process: Associate fd of a PCIDevice with its object
> multi-process: setup memory manager for remote device
> multi-process: PCI BAR read/write handling for proxy & remote
> endpoints
> multi-process: Synchronize remote memory
> multi-process: create IOHUB object to handle irq
> multi-process: Retrieve PCI info from remote process
>
> John G Johnson (1):
> multi-process: add the concept description to
> docs/devel/qemu-multiprocess
>
> docs/devel/index.rst | 1 +
> docs/devel/multi-process.rst | 966 ++++++++++++++++++++++
> docs/multi-process.rst | 64 ++
> configure | 10 +
> meson.build | 3 +
> hw/remote/trace.h | 1 +
> include/exec/memory.h | 2 +
> include/exec/ram_addr.h | 2 +-
> include/hw/pci-host/remote.h | 31 +
> include/hw/pci/pci_ids.h | 3 +
> include/hw/remote/iohub.h | 42 +
> include/hw/remote/machine.h | 40 +
> include/hw/remote/memory.h | 19 +
> include/hw/remote/mpqemu-link.h | 99 +++
> include/hw/remote/proxy-memory-listener.h | 28 +
> include/hw/remote/proxy.h | 52 ++
> include/io/channel.h | 50 ++
> include/qemu/mmap-alloc.h | 4 +-
> include/qemu/sockets.h | 1 +
> include/sysemu/iothread.h | 6 +
> backends/hostmem-memfd.c | 2 +-
> hw/misc/ivshmem.c | 3 +-
> hw/pci-host/remote.c | 75 ++
> hw/remote/iohub.c | 119 +++
> hw/remote/machine.c | 80 ++
> hw/remote/memory.c | 65 ++
> hw/remote/message.c | 230 ++++++
> hw/remote/mpqemu-link.c | 267 ++++++
> hw/remote/proxy-memory-listener.c | 227 +++++
> hw/remote/proxy.c | 371 +++++++++
> hw/remote/remote-obj.c | 194 +++++
> io/channel.c | 88 +-
> iothread.c | 6 +
> softmmu/memory.c | 3 +-
> softmmu/physmem.c | 11 +-
> stubs/monitor.c | 2 +-
> tests/test-util-sockets.c | 2 +-
> util/mmap-alloc.c | 7 +-
> util/oslib-posix.c | 2 +-
> util/qemu-sockets.c | 18 +-
> Kconfig.host | 4 +
> MAINTAINERS | 24 +
> hw/Kconfig | 1 +
> hw/meson.build | 1 +
> hw/pci-host/Kconfig | 3 +
> hw/pci-host/meson.build | 1 +
> hw/remote/Kconfig | 4 +
> hw/remote/meson.build | 13 +
> hw/remote/trace-events | 4 +
> 49 files changed, 3202 insertions(+), 49 deletions(-)
> create mode 100644 docs/devel/multi-process.rst
> create mode 100644 docs/multi-process.rst
> create mode 100644 hw/remote/trace.h
> create mode 100644 include/hw/pci-host/remote.h
> create mode 100644 include/hw/remote/iohub.h
> create mode 100644 include/hw/remote/machine.h
> create mode 100644 include/hw/remote/memory.h
> create mode 100644 include/hw/remote/mpqemu-link.h
> create mode 100644 include/hw/remote/proxy-memory-listener.h
> create mode 100644 include/hw/remote/proxy.h
> create mode 100644 hw/pci-host/remote.c
> create mode 100644 hw/remote/iohub.c
> create mode 100644 hw/remote/machine.c
> create mode 100644 hw/remote/memory.c
> create mode 100644 hw/remote/message.c
> create mode 100644 hw/remote/mpqemu-link.c
> create mode 100644 hw/remote/proxy-memory-listener.c
> create mode 100644 hw/remote/proxy.c
> create mode 100644 hw/remote/remote-obj.c
> create mode 100644 hw/remote/Kconfig
> create mode 100644 hw/remote/meson.build
> create mode 100644 hw/remote/trace-events
>
> --
> 2.25.GIT
>
next prev parent reply other threads:[~2020-12-18 5:21 UTC|newest]
Thread overview: 33+ messages / expand[flat|nested] mbox.gz Atom feed top
2020-12-18 3:57 [PATCH v14 00/21] Initial support for multi-process Qemu elena.ufimtseva
2020-12-18 5:20 ` [PATCH v14 RESEND " elena.ufimtseva
2020-12-18 3:57 ` [PATCH v14 01/21] multi-process: add the concept description to docs/devel/qemu-multiprocess elena.ufimtseva
2020-12-18 5:20 ` [PATCH v14 RESEND " elena.ufimtseva
2020-12-18 3:57 ` [PATCH v14 02/21] multi-process: add configure and usage information elena.ufimtseva
2020-12-18 5:20 ` [PATCH v14 RESEND " elena.ufimtseva
2020-12-18 3:57 ` [PATCH v14 03/21] memory: alloc RAM from file at offset elena.ufimtseva
2020-12-18 5:20 ` [PATCH v14 RESEND " elena.ufimtseva
2020-12-18 3:57 ` [PATCH v14 04/21] socket: export socket_get_fd() function elena.ufimtseva
2020-12-18 5:20 ` [PATCH v14 RESEND " elena.ufimtseva
2020-12-18 11:39 ` [PATCH v14 " Marc-André Lureau
2020-12-18 5:19 ` Elena Ufimtseva [this message]
2020-12-18 5:40 ` [PATCH v14 RESEND 05/21] multi-process: Add config option for multi-process QEMU elena.ufimtseva
2020-12-22 10:22 ` Stefan Hajnoczi
2020-12-18 5:40 ` [PATCH v14 RESEND 06/21] multi-process: setup PCI host bridge for remote device elena.ufimtseva
2020-12-18 5:40 ` [PATCH v14 RESEND 07/21] multi-process: setup a machine object for remote device process elena.ufimtseva
2020-12-18 5:40 ` [PATCH v14 RESEND 08/21] multi-process: add qio channel write function elena.ufimtseva
2020-12-22 10:24 ` Stefan Hajnoczi
2020-12-18 5:40 ` [PATCH v14 RESEND 09/21] multi-process: add qio channel read function elena.ufimtseva
2020-12-22 10:29 ` Stefan Hajnoczi
2020-12-18 5:40 ` [PATCH v14 RESEND 10/21] multi-process: define MPQemuMsg format and transmission functions elena.ufimtseva
2020-12-18 5:40 ` [PATCH v14 RESEND 11/21] multi-process: Initialize message handler in remote device elena.ufimtseva
2020-12-18 5:40 ` [PATCH v14 RESEND 12/21] multi-process: Associate fd of a PCIDevice with its object elena.ufimtseva
2020-12-18 5:40 ` [PATCH v14 RESEND 13/21] multi-process: setup memory manager for remote device elena.ufimtseva
2020-12-18 5:40 ` [PATCH v14 RESEND 14/21] multi-process: introduce proxy object elena.ufimtseva
2020-12-18 5:40 ` [PATCH v14 RESEND 15/21] multi-process: add proxy communication functions elena.ufimtseva
2020-12-18 5:40 ` [PATCH v14 RESEND 16/21] multi-process: Forward PCI config space acceses to the remote process elena.ufimtseva
2020-12-18 5:40 ` [PATCH v14 RESEND 17/21] multi-process: PCI BAR read/write handling for proxy & remote endpoints elena.ufimtseva
2020-12-18 5:40 ` [PATCH v14 RESEND 18/21] multi-process: Synchronize remote memory elena.ufimtseva
2020-12-18 5:40 ` [PATCH v14 RESEND 19/21] multi-process: create IOHUB object to handle irq elena.ufimtseva
2020-12-18 5:40 ` [PATCH v14 RESEND 20/21] multi-process: Retrieve PCI info from remote process elena.ufimtseva
2020-12-18 5:40 ` [PATCH v14 RESEND 21/21] multi-process: perform device reset in the " elena.ufimtseva
2020-12-22 10:38 ` [PATCH v14 00/21] Initial support for multi-process Qemu Stefan Hajnoczi
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20201218051943.GA111182@flaka \
--to=elena.ufimtseva@oracle.com \
--cc=alex.williamson@redhat.com \
--cc=armbru@redhat.com \
--cc=berrange@redhat.com \
--cc=dgilbert@redhat.com \
--cc=ehabkost@redhat.com \
--cc=fam@euphon.net \
--cc=felipe@nutanix.com \
--cc=jag.raman@oracle.com \
--cc=john.g.johnson@oracle.com \
--cc=kanth.ghatraju@oracle.com \
--cc=konrad.wilk@oracle.com \
--cc=kraxel@redhat.com \
--cc=kwolf@redhat.com \
--cc=marcandre.lureau@gmail.com \
--cc=mreitz@redhat.com \
--cc=mst@redhat.com \
--cc=pbonzini@redhat.com \
--cc=qemu-devel@nongnu.org \
--cc=quintela@redhat.com \
--cc=ross.lagerwall@citrix.com \
--cc=stefanha@redhat.com \
--cc=swapnil.ingle@nutanix.com \
--cc=thanos.makatos@nutanix.com \
--cc=thuth@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.