From: Jagannathan Raman <jag.raman@oracle.com>
To: qemu-devel@nongnu.org
Cc: elena.ufimtseva@oracle.com, fam@euphon.net,
swapnil.ingle@nutanix.com, john.g.johnson@oracle.com,
kraxel@redhat.com, jag.raman@oracle.com, quintela@redhat.com,
mst@redhat.com, armbru@redhat.com, kanth.ghatraju@oracle.com,
felipe@nutanix.com, thuth@redhat.com, ehabkost@redhat.com,
konrad.wilk@oracle.com, dgilbert@redhat.com,
alex.williamson@redhat.com, stefanha@redhat.com,
thanos.makatos@nutanix.com, kwolf@redhat.com,
berrange@redhat.com, mreitz@redhat.com,
ross.lagerwall@citrix.com, marcandre.lureau@gmail.com,
pbonzini@redhat.com
Subject: [PATCH v13 00/19] Initial support for multi-process Qemu
Date: Mon, 14 Dec 2020 00:14:40 -0500 [thread overview]
Message-ID: <cover.1607922214.git.jag.raman@oracle.com> (raw)
Hello,
This is the v13 of the patchset. Thank you very much for reviewing v12 and
sharing your feedback.
We have addressed all the comments from the v12 review except for the
following two items, which we will be addressing in subsequent patches:
- Prefix log messages with PID in the logging subsystem.
- Refactor vfio-user and multi-process code to avoid logic duplication.
To touch upon the history of this project, we posted the Proof Of Concept
patches before the BoF session in 2018. Subsequently, we have posted 12
versions on the qemu-devel mailing list. You can find them by following the
links below ([1] - [12]). Following people contributed to the design and
implementation of this project:
Jagannathan Raman <jag.raman@oracle.com>
Elena Ufimtseva <elena.ufimtseva@oracle.com>
John G Johnson <john.g.johnson@oracle.com>
Stefan Hajnoczi <stefanha@redhat.com>
Konrad Wilk <konrad.wilk@oracle.com>
Kanth Ghatraju <kanth.ghatraju@oracle.com>
We would like to thank the QEMU community for your feedback in the
design and implementation of this project. Qemu wiki page:
https://wiki.qemu.org/Features/MultiProcessQEMU
For the full concept writeup about QEMU multi-process, please
refer to docs/devel/qemu-multiprocess.rst. Also, see
docs/qemu-multiprocess.txt for usage information.
We have retained Stefan's "Reviewed-by" in the commit messages. Thank you
very much for your time in reviewing these patches!
[POC]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg566538.html
[1]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg602285.html
[2]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg624877.html
[3]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg642000.html
[4]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg655118.html
[5]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg682429.html
[6]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg697484.html
[7]: https://patchew.org/QEMU/cover.1593273671.git.elena.ufimtseva@oracle.com/
[8]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg727007.html
[9]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg734275.html
[10]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg747638.html
[11]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg750972.html
[12]: https://patchew.org/QEMU/cover.1606853298.git.jag.raman@oracle.com/
Elena Ufimtseva (7):
multi-process: add configure and usage information
multi-process: add qio channel function to transmit data and fds
multi-process: define MPQemuMsg format and transmission functions
multi-process: introduce proxy object
multi-process: add proxy communication functions
multi-process: Forward PCI config space acceses to the remote process
multi-process: perform device reset in the remote process
Jagannathan Raman (11):
memory: alloc RAM from file at offset
multi-process: Add config option for multi-process QEMU
multi-process: setup PCI host bridge for remote device
multi-process: setup a machine object for remote device process
multi-process: Initialize message handler in remote device
multi-process: Associate fd of a PCIDevice with its object
multi-process: setup memory manager for remote device
multi-process: PCI BAR read/write handling for proxy & remote
endpoints
multi-process: Synchronize remote memory
multi-process: create IOHUB object to handle irq
multi-process: Retrieve PCI info from remote process
John G Johnson (1):
multi-process: add the concept description to
docs/devel/qemu-multiprocess
docs/devel/index.rst | 1 +
docs/devel/multi-process.rst | 966 ++++++++++++++++++++++++++++++
docs/multi-process.rst | 64 ++
meson.build | 1 +
hw/remote/trace.h | 1 +
include/exec/memory.h | 2 +
include/exec/ram_addr.h | 2 +-
include/hw/pci-host/remote.h | 31 +
include/hw/pci/pci_ids.h | 3 +
include/hw/remote/iohub.h | 42 ++
include/hw/remote/machine.h | 40 ++
include/hw/remote/memory.h | 19 +
include/hw/remote/mpqemu-link.h | 99 +++
include/hw/remote/proxy-memory-listener.h | 28 +
include/hw/remote/proxy.h | 52 ++
include/io/channel.h | 50 ++
include/qemu/mmap-alloc.h | 4 +-
include/sysemu/iothread.h | 6 +
backends/hostmem-memfd.c | 2 +-
hw/misc/ivshmem.c | 3 +-
hw/pci-host/remote.c | 75 +++
hw/remote/iohub.c | 119 ++++
hw/remote/machine.c | 80 +++
hw/remote/memory.c | 65 ++
hw/remote/message.c | 230 +++++++
hw/remote/mpqemu-link.c | 267 +++++++++
hw/remote/proxy-memory-listener.c | 227 +++++++
hw/remote/proxy.c | 371 ++++++++++++
hw/remote/remote-obj.c | 206 +++++++
io/channel.c | 63 +-
iothread.c | 6 +
softmmu/memory.c | 3 +-
softmmu/physmem.c | 11 +-
util/mmap-alloc.c | 7 +-
util/oslib-posix.c | 2 +-
MAINTAINERS | 24 +
accel/Kconfig | 1 +
hw/Kconfig | 1 +
hw/meson.build | 1 +
hw/pci-host/Kconfig | 3 +
hw/pci-host/meson.build | 1 +
hw/remote/Kconfig | 4 +
hw/remote/meson.build | 13 +
hw/remote/trace-events | 4 +
44 files changed, 3186 insertions(+), 14 deletions(-)
create mode 100644 docs/devel/multi-process.rst
create mode 100644 docs/multi-process.rst
create mode 100644 hw/remote/trace.h
create mode 100644 include/hw/pci-host/remote.h
create mode 100644 include/hw/remote/iohub.h
create mode 100644 include/hw/remote/machine.h
create mode 100644 include/hw/remote/memory.h
create mode 100644 include/hw/remote/mpqemu-link.h
create mode 100644 include/hw/remote/proxy-memory-listener.h
create mode 100644 include/hw/remote/proxy.h
create mode 100644 hw/pci-host/remote.c
create mode 100644 hw/remote/iohub.c
create mode 100644 hw/remote/machine.c
create mode 100644 hw/remote/memory.c
create mode 100644 hw/remote/message.c
create mode 100644 hw/remote/mpqemu-link.c
create mode 100644 hw/remote/proxy-memory-listener.c
create mode 100644 hw/remote/proxy.c
create mode 100644 hw/remote/remote-obj.c
create mode 100644 hw/remote/Kconfig
create mode 100644 hw/remote/meson.build
create mode 100644 hw/remote/trace-events
--
1.8.3.1
next reply other threads:[~2020-12-14 5:35 UTC|newest]
Thread overview: 33+ messages / expand[flat|nested] mbox.gz Atom feed top
2020-12-14 5:14 Jagannathan Raman [this message]
2020-12-14 5:14 ` [PATCH v13 01/19] multi-process: add the concept description to docs/devel/qemu-multiprocess Jagannathan Raman
2020-12-14 5:14 ` [PATCH v13 02/19] multi-process: add configure and usage information Jagannathan Raman
2020-12-14 5:14 ` [PATCH v13 03/19] memory: alloc RAM from file at offset Jagannathan Raman
2020-12-14 5:14 ` [PATCH v13 04/19] multi-process: Add config option for multi-process QEMU Jagannathan Raman
2020-12-14 5:14 ` [PATCH v13 05/19] multi-process: setup PCI host bridge for remote device Jagannathan Raman
2020-12-14 5:14 ` [PATCH v13 06/19] multi-process: setup a machine object for remote device process Jagannathan Raman
2020-12-14 5:14 ` [PATCH v13 07/19] multi-process: add qio channel function to transmit data and fds Jagannathan Raman
2020-12-15 10:49 ` Marc-André Lureau
2020-12-15 20:42 ` Elena Ufimtseva
2020-12-15 21:22 ` Elena Ufimtseva
2020-12-16 10:02 ` Stefan Hajnoczi
2020-12-14 5:14 ` [PATCH v13 08/19] multi-process: define MPQemuMsg format and transmission functions Jagannathan Raman
2020-12-14 5:14 ` [PATCH v13 09/19] multi-process: Initialize message handler in remote device Jagannathan Raman
2020-12-14 5:14 ` [PATCH v13 10/19] multi-process: Associate fd of a PCIDevice with its object Jagannathan Raman
2020-12-14 21:23 ` Stefan Hajnoczi
2020-12-16 13:43 ` Marc-André Lureau
2020-12-16 17:06 ` Jag Raman
2020-12-16 17:34 ` Marc-André Lureau
2020-12-16 17:39 ` Jag Raman
2020-12-14 5:14 ` [PATCH v13 11/19] multi-process: setup memory manager for remote device Jagannathan Raman
2020-12-14 5:14 ` [PATCH v13 12/19] multi-process: introduce proxy object Jagannathan Raman
2020-12-16 13:45 ` Marc-André Lureau
2020-12-14 5:14 ` [PATCH v13 13/19] multi-process: add proxy communication functions Jagannathan Raman
2020-12-14 5:14 ` [PATCH v13 14/19] multi-process: Forward PCI config space acceses to the remote process Jagannathan Raman
2020-12-14 5:14 ` [PATCH v13 15/19] multi-process: PCI BAR read/write handling for proxy & remote endpoints Jagannathan Raman
2020-12-14 5:14 ` [PATCH v13 16/19] multi-process: Synchronize remote memory Jagannathan Raman
2020-12-14 5:14 ` [PATCH v13 17/19] multi-process: create IOHUB object to handle irq Jagannathan Raman
2020-12-14 5:14 ` [PATCH v13 18/19] multi-process: Retrieve PCI info from remote process Jagannathan Raman
2020-12-14 5:14 ` [PATCH v13 19/19] multi-process: perform device reset in the " Jagannathan Raman
2020-12-14 21:17 ` [PATCH v13 00/19] Initial support for multi-process Qemu Stefan Hajnoczi
2020-12-14 23:49 ` Jag Raman
2020-12-15 10:45 ` Stefan Hajnoczi
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=cover.1607922214.git.jag.raman@oracle.com \
--to=jag.raman@oracle.com \
--cc=alex.williamson@redhat.com \
--cc=armbru@redhat.com \
--cc=berrange@redhat.com \
--cc=dgilbert@redhat.com \
--cc=ehabkost@redhat.com \
--cc=elena.ufimtseva@oracle.com \
--cc=fam@euphon.net \
--cc=felipe@nutanix.com \
--cc=john.g.johnson@oracle.com \
--cc=kanth.ghatraju@oracle.com \
--cc=konrad.wilk@oracle.com \
--cc=kraxel@redhat.com \
--cc=kwolf@redhat.com \
--cc=marcandre.lureau@gmail.com \
--cc=mreitz@redhat.com \
--cc=mst@redhat.com \
--cc=pbonzini@redhat.com \
--cc=qemu-devel@nongnu.org \
--cc=quintela@redhat.com \
--cc=ross.lagerwall@citrix.com \
--cc=stefanha@redhat.com \
--cc=swapnil.ingle@nutanix.com \
--cc=thanos.makatos@nutanix.com \
--cc=thuth@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).