From: elena.ufimtseva@oracle.com
To: qemu-devel@nongnu.org
Cc: elena.ufimtseva@oracle.com, fam@euphon.net,
swapnil.ingle@nutanix.com, john.g.johnson@oracle.com,
kraxel@redhat.com, jag.raman@oracle.com, quintela@redhat.com,
mst@redhat.com, armbru@redhat.com, kanth.ghatraju@oracle.com,
felipe@nutanix.com, thuth@redhat.com, ehabkost@redhat.com,
konrad.wilk@oracle.com, dgilbert@redhat.com,
alex.williamson@redhat.com, stefanha@redhat.com,
thanos.makatos@nutanix.com, kwolf@redhat.com,
berrange@redhat.com, mreitz@redhat.com,
ross.lagerwall@citrix.com, marcandre.lureau@gmail.com,
pbonzini@redhat.com
Subject: [PATCH v15 00/20] Initial support for multi-process Qemu
Date: Tue, 22 Dec 2020 22:14:35 -0800 [thread overview]
Message-ID: <cover.1608702853.git.elena.ufimtseva@oracle.com> (raw)
From: Elena Ufimtseva <elena.ufimtseva@oracle.com>
Hi
This is the v15 of the patchset.
Thank you for your time reviewing v14.
This version has the following changes:
- [PATCH v15 08/20] multi-process: add qio channel read function
Prevent memory leaks by closing file descriptors and freeing memory
for fd array on failure in qio_channel_readv_full_all(..).
- The patch from v14 was dropped (See [PATCH v14 04/21] socket: export
socket_get_fd() function) and instead the monitor_fd_param(..) and
fd_is_socket(..) are used in the patches:
[PATCH v15 11/20] "multi-process: Associate fd of a PCIDevice with its
object"
and
[PATCH v15 13/20] "multi-process: introduce proxy object".
In addition, we will be sending a follow-up patch with the acceptance
test that can be used to verify that this feature is working correctly.
From the previous reviews the TODOs are:
- Prefix log messages with PID in the logging subsystem.
- Refactor the MemoryListener code in vfio-user and multi-process code
to avoid logic duplication.
To touch upon the history of this project, we posted the Proof Of Concept
patches before the BoF session in 2018. Subsequently, we have posted 14
versions on the qemu-devel mailing list. You can find them by following the
links below ([1] - [14]). Following people contributed to the design and
implementation of this project:
Jagannathan Raman <jag.raman@oracle.com>
Elena Ufimtseva <elena.ufimtseva@oracle.com>
John G Johnson <john.g.johnson@oracle.com>
Stefan Hajnoczi <stefanha@redhat.com>
Konrad Wilk <konrad.wilk@oracle.com>
Kanth Ghatraju <kanth.ghatraju@oracle.com>
We would like to thank the QEMU community for your feedback in the
design and implementation of this project. Qemu wiki page:
https://wiki.qemu.org/Features/MultiProcessQEMU
For the full concept writeup about QEMU multi-process, please
refer to docs/devel/qemu-multiprocess.rst. Also, see
docs/qemu-multiprocess.txt for usage information.
Thank you for reviewing these series.
[POC]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg566538.html
[1]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg602285.html
[2]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg624877.html
[3]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg642000.html
[4]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg655118.html
[5]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg682429.html
[6]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg697484.html
[7]: https://patchew.org/QEMU/cover.1593273671.git.elena.ufimtseva@oracle.com/
[8]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg727007.html
[9]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg734275.html
[10]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg747638.html
[11]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg750972.html
[12]: https://patchew.org/QEMU/cover.1606853298.git.jag.raman@oracle.com/
[13]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg766825.html
[14]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg768376.html
Elena Ufimtseva (8):
multi-process: add configure and usage information
multi-process: add qio channel write function
multi-process: add qio channel read function
multi-process: define MPQemuMsg format and transmission functions
multi-process: introduce proxy object
multi-process: add proxy communication functions
multi-process: Forward PCI config space acceses to the remote process
multi-process: perform device reset in the remote process
Jagannathan Raman (11):
memory: alloc RAM from file at offset
multi-process: Add config option for multi-process QEMU
multi-process: setup PCI host bridge for remote device
multi-process: setup a machine object for remote device process
multi-process: Initialize message handler in remote device
multi-process: Associate fd of a PCIDevice with its object
multi-process: setup memory manager for remote device
multi-process: PCI BAR read/write handling for proxy & remote
endpoints
multi-process: Synchronize remote memory
multi-process: create IOHUB object to handle irq
multi-process: Retrieve PCI info from remote process
John G Johnson (1):
multi-process: add the concept description to
docs/devel/qemu-multiprocess
docs/devel/index.rst | 1 +
docs/devel/multi-process.rst | 966 ++++++++++++++++++++++
docs/multi-process.rst | 64 ++
configure | 10 +
meson.build | 3 +
hw/remote/trace.h | 1 +
include/exec/memory.h | 2 +
include/exec/ram_addr.h | 2 +-
include/hw/pci-host/remote.h | 31 +
include/hw/pci/pci_ids.h | 3 +
include/hw/remote/iohub.h | 42 +
include/hw/remote/machine.h | 40 +
include/hw/remote/memory.h | 19 +
include/hw/remote/mpqemu-link.h | 99 +++
include/hw/remote/proxy-memory-listener.h | 28 +
include/hw/remote/proxy.h | 52 ++
include/io/channel.h | 50 ++
include/qemu/mmap-alloc.h | 4 +-
include/sysemu/iothread.h | 6 +
backends/hostmem-memfd.c | 2 +-
hw/misc/ivshmem.c | 3 +-
hw/pci-host/remote.c | 75 ++
hw/remote/iohub.c | 119 +++
hw/remote/machine.c | 80 ++
hw/remote/memory.c | 65 ++
hw/remote/message.c | 230 ++++++
hw/remote/mpqemu-link.c | 267 ++++++
hw/remote/proxy-memory-listener.c | 227 +++++
hw/remote/proxy.c | 379 +++++++++
hw/remote/remote-obj.c | 208 +++++
io/channel.c | 102 ++-
iothread.c | 6 +
softmmu/memory.c | 3 +-
softmmu/physmem.c | 11 +-
util/mmap-alloc.c | 7 +-
util/oslib-posix.c | 2 +-
Kconfig.host | 4 +
MAINTAINERS | 24 +
hw/Kconfig | 1 +
hw/meson.build | 1 +
hw/pci-host/Kconfig | 3 +
hw/pci-host/meson.build | 1 +
hw/remote/Kconfig | 4 +
hw/remote/meson.build | 13 +
hw/remote/trace-events | 4 +
45 files changed, 3225 insertions(+), 39 deletions(-)
create mode 100644 docs/devel/multi-process.rst
create mode 100644 docs/multi-process.rst
create mode 100644 hw/remote/trace.h
create mode 100644 include/hw/pci-host/remote.h
create mode 100644 include/hw/remote/iohub.h
create mode 100644 include/hw/remote/machine.h
create mode 100644 include/hw/remote/memory.h
create mode 100644 include/hw/remote/mpqemu-link.h
create mode 100644 include/hw/remote/proxy-memory-listener.h
create mode 100644 include/hw/remote/proxy.h
create mode 100644 hw/pci-host/remote.c
create mode 100644 hw/remote/iohub.c
create mode 100644 hw/remote/machine.c
create mode 100644 hw/remote/memory.c
create mode 100644 hw/remote/message.c
create mode 100644 hw/remote/mpqemu-link.c
create mode 100644 hw/remote/proxy-memory-listener.c
create mode 100644 hw/remote/proxy.c
create mode 100644 hw/remote/remote-obj.c
create mode 100644 hw/remote/Kconfig
create mode 100644 hw/remote/meson.build
create mode 100644 hw/remote/trace-events
--
2.25.GIT
next reply other threads:[~2020-12-23 6:35 UTC|newest]
Thread overview: 25+ messages / expand[flat|nested] mbox.gz Atom feed top
2020-12-23 6:14 elena.ufimtseva [this message]
2020-12-23 6:14 ` [PATCH v15 01/20] multi-process: add the concept description to docs/devel/qemu-multiprocess elena.ufimtseva
2020-12-23 6:14 ` [PATCH v15 02/20] multi-process: add configure and usage information elena.ufimtseva
2020-12-23 6:14 ` [PATCH v15 03/20] memory: alloc RAM from file at offset elena.ufimtseva
2020-12-23 6:14 ` [PATCH v15 04/20] multi-process: Add config option for multi-process QEMU elena.ufimtseva
2020-12-23 6:14 ` [PATCH v15 05/20] multi-process: setup PCI host bridge for remote device elena.ufimtseva
2020-12-23 6:14 ` [PATCH v15 06/20] multi-process: setup a machine object for remote device process elena.ufimtseva
2020-12-23 6:14 ` [PATCH v15 07/20] multi-process: add qio channel write function elena.ufimtseva
2021-01-04 15:02 ` Daniel P. Berrangé
2020-12-23 6:14 ` [PATCH v15 08/20] multi-process: add qio channel read function elena.ufimtseva
2020-12-23 11:24 ` Marc-André Lureau
2020-12-23 21:57 ` Jag Raman
2021-01-04 15:16 ` Daniel P. Berrangé
2020-12-23 6:14 ` [PATCH v15 09/20] multi-process: define MPQemuMsg format and transmission functions elena.ufimtseva
2020-12-23 6:14 ` [PATCH v15 10/20] multi-process: Initialize message handler in remote device elena.ufimtseva
2020-12-23 6:14 ` [PATCH v15 11/20] multi-process: Associate fd of a PCIDevice with its object elena.ufimtseva
2020-12-23 6:14 ` [PATCH v15 12/20] multi-process: setup memory manager for remote device elena.ufimtseva
2020-12-23 6:14 ` [PATCH v15 13/20] multi-process: introduce proxy object elena.ufimtseva
2020-12-23 6:14 ` [PATCH v15 14/20] multi-process: add proxy communication functions elena.ufimtseva
2020-12-23 6:14 ` [PATCH v15 15/20] multi-process: Forward PCI config space acceses to the remote process elena.ufimtseva
2020-12-23 6:14 ` [PATCH v15 16/20] multi-process: PCI BAR read/write handling for proxy & remote endpoints elena.ufimtseva
2020-12-23 6:14 ` [PATCH v15 17/20] multi-process: Synchronize remote memory elena.ufimtseva
2020-12-23 6:14 ` [PATCH v15 18/20] multi-process: create IOHUB object to handle irq elena.ufimtseva
2020-12-23 6:14 ` [PATCH v15 19/20] multi-process: Retrieve PCI info from remote process elena.ufimtseva
2020-12-23 6:14 ` [PATCH v15 20/20] multi-process: perform device reset in the " elena.ufimtseva
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=cover.1608702853.git.elena.ufimtseva@oracle.com \
--to=elena.ufimtseva@oracle.com \
--cc=alex.williamson@redhat.com \
--cc=armbru@redhat.com \
--cc=berrange@redhat.com \
--cc=dgilbert@redhat.com \
--cc=ehabkost@redhat.com \
--cc=fam@euphon.net \
--cc=felipe@nutanix.com \
--cc=jag.raman@oracle.com \
--cc=john.g.johnson@oracle.com \
--cc=kanth.ghatraju@oracle.com \
--cc=konrad.wilk@oracle.com \
--cc=kraxel@redhat.com \
--cc=kwolf@redhat.com \
--cc=marcandre.lureau@gmail.com \
--cc=mreitz@redhat.com \
--cc=mst@redhat.com \
--cc=pbonzini@redhat.com \
--cc=qemu-devel@nongnu.org \
--cc=quintela@redhat.com \
--cc=ross.lagerwall@citrix.com \
--cc=stefanha@redhat.com \
--cc=swapnil.ingle@nutanix.com \
--cc=thanos.makatos@nutanix.com \
--cc=thuth@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).