From: Jagannathan Raman <jag.raman@oracle.com>
To: qemu-devel@nongnu.org
Cc: elena.ufimtseva@oracle.com, fam@euphon.net,
swapnil.ingle@nutanix.com, john.g.johnson@oracle.com,
kraxel@redhat.com, jag.raman@oracle.com, quintela@redhat.com,
mst@redhat.com, armbru@redhat.com, kanth.ghatraju@oracle.com,
felipe@nutanix.com, thuth@redhat.com, ehabkost@redhat.com,
konrad.wilk@oracle.com, dgilbert@redhat.com,
alex.williamson@redhat.com, stefanha@redhat.com,
thanos.makatos@nutanix.com, kwolf@redhat.com,
berrange@redhat.com, mreitz@redhat.com,
ross.lagerwall@citrix.com, marcandre.lureau@gmail.com,
pbonzini@redhat.com
Subject: [PATCH v17 00/20] Initial support for multi-process Qemu
Date: Wed, 13 Jan 2021 11:42:12 -0500 [thread overview]
Message-ID: <cover.1610556046.git.jag.raman@oracle.com> (raw)
Hi,
This is the v17 of the patchset. Thank you for your time reviewing v16.
This version has the following changes:
[PATCH v17 08/20] io: add qio_channel_readv_full_all_eof &
qio_channel_readv_full_all helpers
- Addresses operator precedence issues based on feedback
- Initializes/Clears *nfds & *fds in qio_channel_readv_full_all_eof()
To touch upon the history of this project, we posted the Proof Of Concept
patches before the BoF session in 2018. Subsequently, we have posted 16
versions on the qemu-devel mailing list. You can find them by following
the links below ([1] - [16]). Following people contributed to the design and
implementation of this project:
Jagannathan Raman <jag.raman@oracle.com>
Elena Ufimtseva <elena.ufimtseva@oracle.com>
John G Johnson <john.g.johnson@oracle.com>
Stefan Hajnoczi <stefanha@redhat.com>
Konrad Wilk <konrad.wilk@oracle.com>
Kanth Ghatraju <kanth.ghatraju@oracle.com>
We would like to thank the QEMU community for your feedback in the
design and implementation of this project. Qemu wiki page:
https://wiki.qemu.org/Features/MultiProcessQEMU
For the full concept writeup about QEMU multi-process, please
refer to docs/devel/qemu-multiprocess.rst. Also, see
docs/qemu-multiprocess.txt for usage information.
Thank you for reviewing this series!
[POC]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg566538.html
[1]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg602285.html
[2]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg624877.html
[3]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg642000.html
[4]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg655118.html
[5]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg682429.html
[6]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg697484.html
[7]: https://patchew.org/QEMU/cover.1593273671.git.elena.ufimtseva@oracle.com/
[8]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg727007.html
[9]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg734275.html
[10]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg747638.html
[11]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg750972.html
[12]: https://patchew.org/QEMU/cover.1606853298.git.jag.raman@oracle.com/
[13]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg766825.html
[14]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg768376.html
[15]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg769178.html
[16]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg771455.html
Elena Ufimtseva (8):
multi-process: add configure and usage information
io: add qio_channel_writev_full_all helper
io: add qio_channel_readv_full_all_eof & qio_channel_readv_full_all
helpers
multi-process: define MPQemuMsg format and transmission functions
multi-process: introduce proxy object
multi-process: add proxy communication functions
multi-process: Forward PCI config space acceses to the remote process
multi-process: perform device reset in the remote process
Jagannathan Raman (11):
memory: alloc RAM from file at offset
multi-process: Add config option for multi-process QEMU
multi-process: setup PCI host bridge for remote device
multi-process: setup a machine object for remote device process
multi-process: Initialize message handler in remote device
multi-process: Associate fd of a PCIDevice with its object
multi-process: setup memory manager for remote device
multi-process: PCI BAR read/write handling for proxy & remote
endpoints
multi-process: Synchronize remote memory
multi-process: create IOHUB object to handle irq
multi-process: Retrieve PCI info from remote process
John G Johnson (1):
multi-process: add the concept description to
docs/devel/qemu-multiprocess
docs/devel/index.rst | 1 +
docs/devel/multi-process.rst | 966 ++++++++++++++++++++++++++++++
docs/multi-process.rst | 64 ++
configure | 10 +
meson.build | 5 +-
hw/remote/trace.h | 1 +
include/exec/memory.h | 2 +
include/exec/ram_addr.h | 2 +-
include/hw/pci-host/remote.h | 30 +
include/hw/pci/pci_ids.h | 3 +
include/hw/remote/iohub.h | 42 ++
include/hw/remote/machine.h | 38 ++
include/hw/remote/memory.h | 19 +
include/hw/remote/mpqemu-link.h | 99 +++
include/hw/remote/proxy-memory-listener.h | 28 +
include/hw/remote/proxy.h | 48 ++
include/io/channel.h | 76 +++
include/qemu/mmap-alloc.h | 4 +-
include/sysemu/iothread.h | 6 +
backends/hostmem-memfd.c | 2 +-
hw/misc/ivshmem.c | 3 +-
hw/pci-host/remote.c | 75 +++
hw/remote/iohub.c | 119 ++++
hw/remote/machine.c | 80 +++
hw/remote/memory.c | 65 ++
hw/remote/message.c | 230 +++++++
hw/remote/mpqemu-link.c | 267 +++++++++
hw/remote/proxy-memory-listener.c | 227 +++++++
hw/remote/proxy.c | 379 ++++++++++++
hw/remote/remote-obj.c | 203 +++++++
io/channel.c | 102 +++-
iothread.c | 6 +
softmmu/memory.c | 3 +-
softmmu/physmem.c | 11 +-
util/mmap-alloc.c | 7 +-
util/oslib-posix.c | 2 +-
Kconfig.host | 4 +
MAINTAINERS | 24 +
hw/Kconfig | 1 +
hw/meson.build | 1 +
hw/pci-host/Kconfig | 3 +
hw/pci-host/meson.build | 1 +
hw/remote/Kconfig | 4 +
hw/remote/meson.build | 13 +
hw/remote/trace-events | 4 +
45 files changed, 3248 insertions(+), 32 deletions(-)
create mode 100644 docs/devel/multi-process.rst
create mode 100644 docs/multi-process.rst
create mode 100644 hw/remote/trace.h
create mode 100644 include/hw/pci-host/remote.h
create mode 100644 include/hw/remote/iohub.h
create mode 100644 include/hw/remote/machine.h
create mode 100644 include/hw/remote/memory.h
create mode 100644 include/hw/remote/mpqemu-link.h
create mode 100644 include/hw/remote/proxy-memory-listener.h
create mode 100644 include/hw/remote/proxy.h
create mode 100644 hw/pci-host/remote.c
create mode 100644 hw/remote/iohub.c
create mode 100644 hw/remote/machine.c
create mode 100644 hw/remote/memory.c
create mode 100644 hw/remote/message.c
create mode 100644 hw/remote/mpqemu-link.c
create mode 100644 hw/remote/proxy-memory-listener.c
create mode 100644 hw/remote/proxy.c
create mode 100644 hw/remote/remote-obj.c
create mode 100644 hw/remote/Kconfig
create mode 100644 hw/remote/meson.build
create mode 100644 hw/remote/trace-events
--
1.8.3.1
next reply other threads:[~2021-01-13 16:45 UTC|newest]
Thread overview: 21+ messages / expand[flat|nested] mbox.gz Atom feed top
2021-01-13 16:42 Jagannathan Raman [this message]
2021-01-13 16:42 ` [PATCH v17 01/20] multi-process: add the concept description to docs/devel/qemu-multiprocess Jagannathan Raman
2021-01-13 16:42 ` [PATCH v17 02/20] multi-process: add configure and usage information Jagannathan Raman
2021-01-13 16:42 ` [PATCH v17 03/20] memory: alloc RAM from file at offset Jagannathan Raman
2021-01-13 16:42 ` [PATCH v17 04/20] multi-process: Add config option for multi-process QEMU Jagannathan Raman
2021-01-13 16:42 ` [PATCH v17 05/20] multi-process: setup PCI host bridge for remote device Jagannathan Raman
2021-01-13 16:42 ` [PATCH v17 06/20] multi-process: setup a machine object for remote device process Jagannathan Raman
2021-01-13 16:42 ` [PATCH v17 07/20] io: add qio_channel_writev_full_all helper Jagannathan Raman
2021-01-13 16:42 ` [PATCH v17 08/20] io: add qio_channel_readv_full_all_eof & qio_channel_readv_full_all helpers Jagannathan Raman
2021-01-13 16:42 ` [PATCH v17 09/20] multi-process: define MPQemuMsg format and transmission functions Jagannathan Raman
2021-01-13 16:42 ` [PATCH v17 10/20] multi-process: Initialize message handler in remote device Jagannathan Raman
2021-01-13 16:42 ` [PATCH v17 11/20] multi-process: Associate fd of a PCIDevice with its object Jagannathan Raman
2021-01-13 16:42 ` [PATCH v17 12/20] multi-process: setup memory manager for remote device Jagannathan Raman
2021-01-13 16:42 ` [PATCH v17 13/20] multi-process: introduce proxy object Jagannathan Raman
2021-01-13 16:42 ` [PATCH v17 14/20] multi-process: add proxy communication functions Jagannathan Raman
2021-01-13 16:42 ` [PATCH v17 15/20] multi-process: Forward PCI config space acceses to the remote process Jagannathan Raman
2021-01-13 16:42 ` [PATCH v17 16/20] multi-process: PCI BAR read/write handling for proxy & remote endpoints Jagannathan Raman
2021-01-13 16:42 ` [PATCH v17 17/20] multi-process: Synchronize remote memory Jagannathan Raman
2021-01-13 16:42 ` [PATCH v17 18/20] multi-process: create IOHUB object to handle irq Jagannathan Raman
2021-01-13 16:42 ` [PATCH v17 19/20] multi-process: Retrieve PCI info from remote process Jagannathan Raman
2021-01-13 16:42 ` [PATCH v17 20/20] multi-process: perform device reset in the " Jagannathan Raman
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=cover.1610556046.git.jag.raman@oracle.com \
--to=jag.raman@oracle.com \
--cc=alex.williamson@redhat.com \
--cc=armbru@redhat.com \
--cc=berrange@redhat.com \
--cc=dgilbert@redhat.com \
--cc=ehabkost@redhat.com \
--cc=elena.ufimtseva@oracle.com \
--cc=fam@euphon.net \
--cc=felipe@nutanix.com \
--cc=john.g.johnson@oracle.com \
--cc=kanth.ghatraju@oracle.com \
--cc=konrad.wilk@oracle.com \
--cc=kraxel@redhat.com \
--cc=kwolf@redhat.com \
--cc=marcandre.lureau@gmail.com \
--cc=mreitz@redhat.com \
--cc=mst@redhat.com \
--cc=pbonzini@redhat.com \
--cc=qemu-devel@nongnu.org \
--cc=quintela@redhat.com \
--cc=ross.lagerwall@citrix.com \
--cc=stefanha@redhat.com \
--cc=swapnil.ingle@nutanix.com \
--cc=thanos.makatos@nutanix.com \
--cc=thuth@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).