qemu-devel.nongnu.org archive mirror
 help / color / mirror / Atom feed
From: Jagannathan Raman <jag.raman@oracle.com>
To: qemu-devel@nongnu.org
Cc: elena.ufimtseva@oracle.com, fam@euphon.net,
	swapnil.ingle@nutanix.com, john.g.johnson@oracle.com,
	kraxel@redhat.com, jag.raman@oracle.com, quintela@redhat.com,
	mst@redhat.com, armbru@redhat.com, kanth.ghatraju@oracle.com,
	felipe@nutanix.com, thuth@redhat.com, ehabkost@redhat.com,
	konrad.wilk@oracle.com, dgilbert@redhat.com,
	alex.williamson@redhat.com, stefanha@redhat.com,
	thanos.makatos@nutanix.com, rth@twiddle.net, kwolf@redhat.com,
	berrange@redhat.com, mreitz@redhat.com,
	ross.lagerwall@citrix.com, marcandre.lureau@gmail.com,
	pbonzini@redhat.com
Subject: [PATCH v11 00/19] Initial support for multi-process Qemu
Date: Thu, 15 Oct 2020 14:04:53 -0400	[thread overview]
Message-ID: <cover.1602784930.git.jag.raman@oracle.com> (raw)

Hello,

This is the v11 of the patchset. Thank you very much for the
review of the v10 of the series. We are glad to hear the
patchset is getting in a better shape.

We made changes to the following patches in this series.

[PATCH v10 06/19] multi-process: define MPQemuMsg format and transmission functions
[PATCH v10 08/19] multi-process: Associate fd of a PCIDevice with its object
[PATCH v10 10/19] multi-process: introduce proxy object

To touch upon the history of this project, we posted the
Proof Of Concept patches before the BoF session in 2018.
Subsequently, we posted 9 versions on the qemu-devel mailist.
You can find them by following the links below ([1] - [9]).

Following people contributed to the design and
implementation of this project:
Jagannathan Raman <jag.raman@oracle.com>
Elena Ufimtseva <elena.ufimtseva@oracle.com>
John G Johnson <john.g.johnson@oracle.com>
Stefan Hajnoczi <stefanha@redhat.com>
Konrad Wilk <konrad.wilk@oracle.com>
Kanth Ghatraju <kanth.ghatraju@oracle.com>

We would like to thank QEMU community for your feedback in the
design and implementation of this project.

Qemu wiki page:
https://wiki.qemu.org/Features/MultiProcessQEMU

For the full concept writeup about QEMU multi-process, please refer to
docs/devel/qemu-multiprocess.rst. Also see docs/qemu-multiprocess.txt for
usage information.


We welcome all your ideas, concerns, and questions for this patchset.
[POC]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg566538.html
[1]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg602285.html
[2]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg624877.html
[3]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg642000.html
[4]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg655118.html
[5]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg682429.html
[6]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg697484.html
[7]: https://patchew.org/QEMU/cover.1593273671.git.elena.ufimtseva@oracle.com/
[8]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg727007.html
[9]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg734275.html
[10]: https://www.mail-archive.com/qemu-devel@nongnu.org/msg747638.html

Elena Ufimtseva (7):
  multi-process: add qio channel function to transmit
  multi-process: define MPQemuMsg format and transmission functions
  multi-process: introduce proxy object
  multi-process: add proxy communication functions
  multi-process: Forward PCI config space acceses to the remote process
  multi-process: perform device reset in the remote process
  multi-process: add configure and usage information

Jagannathan Raman (11):
  memory: alloc RAM from file at offset
  multi-process: Add config option for multi-process QEMU
  multi-process: setup PCI host bridge for remote device
  multi-process: setup a machine object for remote device process
  multi-process: Initialize message handler in remote device
  multi-process: Associate fd of a PCIDevice with its object
  multi-process: setup memory manager for remote device
  multi-process: PCI BAR read/write handling for proxy & remote
    endpoints
  multi-process: Synchronize remote memory
  multi-process: create IOHUB object to handle irq
  multi-process: Retrieve PCI info from remote process

John G Johnson (1):
  multi-process: add the concept description to
    docs/devel/qemu-multiprocess

 MAINTAINERS                     |  26 ++
 backends/hostmem-memfd.c        |   2 +-
 configure                       |  10 +
 docs/devel/index.rst            |   1 +
 docs/devel/multi-process.rst    | 966 ++++++++++++++++++++++++++++++++++++++++
 docs/multi-process.rst          |  67 +++
 hw/i386/meson.build             |   5 +
 hw/i386/remote-iohub.c          | 123 +++++
 hw/i386/remote-memory.c         |  58 +++
 hw/i386/remote-msg.c            | 241 ++++++++++
 hw/i386/remote-obj.c            | 154 +++++++
 hw/i386/remote.c                |  79 ++++
 hw/misc/ivshmem.c               |   3 +-
 hw/pci-host/meson.build         |   1 +
 hw/pci-host/remote.c            |  75 ++++
 hw/pci/memory-sync.c            | 210 +++++++++
 hw/pci/meson.build              |   3 +
 hw/pci/proxy.c                  | 377 ++++++++++++++++
 include/exec/memory.h           |   2 +
 include/exec/ram_addr.h         |   2 +-
 include/hw/i386/remote-iohub.h  |  42 ++
 include/hw/i386/remote-memory.h |  19 +
 include/hw/i386/remote-obj.h    |  42 ++
 include/hw/i386/remote.h        |  40 ++
 include/hw/pci-host/remote.h    |  31 ++
 include/hw/pci/memory-sync.h    |  27 ++
 include/hw/pci/pci_ids.h        |   3 +
 include/hw/pci/proxy.h          |  53 +++
 include/io/channel.h            |  24 +
 include/io/mpqemu-link.h        |  98 ++++
 include/qemu/mmap-alloc.h       |   3 +-
 io/channel.c                    |  45 ++
 io/meson.build                  |   2 +
 io/mpqemu-link.c                | 303 +++++++++++++
 meson.build                     |   1 +
 scripts/mpqemu-launcher.py      |  49 ++
 softmmu/memory.c                |   3 +-
 softmmu/physmem.c               |  11 +-
 util/mmap-alloc.c               |   7 +-
 util/oslib-posix.c              |   2 +-
 40 files changed, 3197 insertions(+), 13 deletions(-)
 create mode 100644 docs/devel/multi-process.rst
 create mode 100644 docs/multi-process.rst
 create mode 100644 hw/i386/remote-iohub.c
 create mode 100644 hw/i386/remote-memory.c
 create mode 100644 hw/i386/remote-msg.c
 create mode 100644 hw/i386/remote-obj.c
 create mode 100644 hw/i386/remote.c
 create mode 100644 hw/pci-host/remote.c
 create mode 100644 hw/pci/memory-sync.c
 create mode 100644 hw/pci/proxy.c
 create mode 100644 include/hw/i386/remote-iohub.h
 create mode 100644 include/hw/i386/remote-memory.h
 create mode 100644 include/hw/i386/remote-obj.h
 create mode 100644 include/hw/i386/remote.h
 create mode 100644 include/hw/pci-host/remote.h
 create mode 100644 include/hw/pci/memory-sync.h
 create mode 100644 include/hw/pci/proxy.h
 create mode 100644 include/io/mpqemu-link.h
 create mode 100644 io/mpqemu-link.c
 create mode 100755 scripts/mpqemu-launcher.py

-- 
1.8.3.1



             reply	other threads:[~2020-10-15 18:07 UTC|newest]

Thread overview: 31+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2020-10-15 18:04 Jagannathan Raman [this message]
2020-10-15 18:04 ` [PATCH v11 01/19] memory: alloc RAM from file at offset Jagannathan Raman
2020-10-15 18:04 ` [PATCH v11 02/19] multi-process: Add config option for multi-process QEMU Jagannathan Raman
2020-10-23 16:49   ` Philippe Mathieu-Daudé
2020-10-15 18:04 ` [PATCH v11 03/19] multi-process: setup PCI host bridge for remote device Jagannathan Raman
2020-10-15 18:04 ` [PATCH v11 04/19] multi-process: setup a machine object for remote device process Jagannathan Raman
2020-10-23 16:33   ` Philippe Mathieu-Daudé
2020-10-15 18:04 ` [PATCH v11 05/19] multi-process: add qio channel function to transmit Jagannathan Raman
2020-10-23 16:36   ` Philippe Mathieu-Daudé
2020-12-04 14:39   ` Marc-André Lureau
2020-10-15 18:04 ` [PATCH v11 06/19] multi-process: define MPQemuMsg format and transmission functions Jagannathan Raman
2020-10-23 13:53   ` Stefan Hajnoczi
2020-10-15 18:05 ` [PATCH v11 07/19] multi-process: Initialize message handler in remote device Jagannathan Raman
2020-10-15 18:05 ` [PATCH v11 08/19] multi-process: Associate fd of a PCIDevice with its object Jagannathan Raman
2020-10-23 13:55   ` Stefan Hajnoczi
2020-10-15 18:05 ` [PATCH v11 09/19] multi-process: setup memory manager for remote device Jagannathan Raman
2020-10-15 18:05 ` [PATCH v11 10/19] multi-process: introduce proxy object Jagannathan Raman
2020-10-23 13:56   ` Stefan Hajnoczi
2020-10-15 18:05 ` [PATCH v11 11/19] multi-process: add proxy communication functions Jagannathan Raman
2020-10-15 18:05 ` [PATCH v11 12/19] multi-process: Forward PCI config space acceses to the remote process Jagannathan Raman
2020-10-23 16:59   ` Philippe Mathieu-Daudé
2020-10-23 17:20     ` Philippe Mathieu-Daudé
2020-10-15 18:05 ` [PATCH v11 13/19] multi-process: PCI BAR read/write handling for proxy & remote endpoints Jagannathan Raman
2020-10-15 18:05 ` [PATCH v11 14/19] multi-process: Synchronize remote memory Jagannathan Raman
2020-10-15 18:05 ` [PATCH v11 15/19] multi-process: create IOHUB object to handle irq Jagannathan Raman
2020-10-15 18:05 ` [PATCH v11 16/19] multi-process: Retrieve PCI info from remote process Jagannathan Raman
2020-10-15 18:05 ` [PATCH v11 17/19] multi-process: perform device reset in the " Jagannathan Raman
2020-10-15 18:05 ` [PATCH v11 18/19] multi-process: add the concept description to docs/devel/qemu-multiprocess Jagannathan Raman
2020-10-15 18:05 ` [PATCH v11 19/19] multi-process: add configure and usage information Jagannathan Raman
2020-11-04 18:39   ` Philippe Mathieu-Daudé
2020-10-23 13:57 ` [PATCH v11 00/19] Initial support for multi-process Qemu Stefan Hajnoczi

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=cover.1602784930.git.jag.raman@oracle.com \
    --to=jag.raman@oracle.com \
    --cc=alex.williamson@redhat.com \
    --cc=armbru@redhat.com \
    --cc=berrange@redhat.com \
    --cc=dgilbert@redhat.com \
    --cc=ehabkost@redhat.com \
    --cc=elena.ufimtseva@oracle.com \
    --cc=fam@euphon.net \
    --cc=felipe@nutanix.com \
    --cc=john.g.johnson@oracle.com \
    --cc=kanth.ghatraju@oracle.com \
    --cc=konrad.wilk@oracle.com \
    --cc=kraxel@redhat.com \
    --cc=kwolf@redhat.com \
    --cc=marcandre.lureau@gmail.com \
    --cc=mreitz@redhat.com \
    --cc=mst@redhat.com \
    --cc=pbonzini@redhat.com \
    --cc=qemu-devel@nongnu.org \
    --cc=quintela@redhat.com \
    --cc=ross.lagerwall@citrix.com \
    --cc=rth@twiddle.net \
    --cc=stefanha@redhat.com \
    --cc=swapnil.ingle@nutanix.com \
    --cc=thanos.makatos@nutanix.com \
    --cc=thuth@redhat.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).