qemu-devel.nongnu.org archive mirror
 help / color / mirror / Atom feed
From: Juan Quintela <quintela@redhat.com>
To: qemu-devel@nongnu.org
Cc: amit.shah@redhat.com, dgilbert@redhat.com
Subject: [Qemu-devel] [PULL 00/57] Migration pull
Date: Mon,  9 Nov 2015 18:28:04 +0100	[thread overview]
Message-ID: <1447090141-29074-1-git-send-email-quintela@redhat.com> (raw)


Hi

two items:

- Postcopy pull request (dave)
- fix for qemu_completion (Denis)

Please apply.

Thanks, Juan.


The following changes since commit ce278618b088afd10b91a05311eaeb6401bb5004:

  configure: Don't disable optimization for non-fortify builds (2015-11-09 16:28:09 +0000)

are available in the git repository at:

  git://github.com/juanquintela/qemu.git tags/migration/20151109

for you to fetch changes up to d1de612d6ed199a52a6f4823d89c1731c74edcb6:

  migration: qemu_savevm_state_cleanup becomes mandatory operation (2015-11-09 18:26:06 +0100)

----------------------------------------------------------------
migration/next for 20151109

----------------------------------------------------------------
Denis V. Lunev (1):
      migration: qemu_savevm_state_cleanup becomes mandatory operation

Dr. David Alan Gilbert (56):
      Add postcopy documentation
      Provide runtime Target page information
      Move configuration section writing
      Move page_size_init earlier
      qemu_ram_block_from_host
      qemu_ram_block_by_name
      Rename mis->file to from_src_file
      Add qemu_get_buffer_in_place to avoid copies some of the time
      Add wrapper for setting blocking status on a QEMUFile
      Add QEMU_MADV_NOHUGEPAGE
      ram_debug_dump_bitmap: Dump a migration bitmap as text
      ram_load: Factor out host_from_stream_offset call and check
      migrate_init: Call from savevm
      Rename save_live_complete to save_live_complete_precopy
      Add Linux userfaultfd.h header
      Return path: Open a return path on QEMUFile for sockets
      Return path: socket_writev_buffer: Block even on non-blocking fd's
      Migration commands
      Return path: Control commands
      Return path: Send responses from destination to source
      migration_is_setup_or_active
      Return path: Source handling of return path
      Rework loadvm path for subloops
      Add migration-capability boolean for postcopy-ram.
      Add wrappers and handlers for sending/receiving the postcopy-ram migration messages.
      MIG_CMD_PACKAGED: Send a packaged chunk of migration stream
      Modify save_live_pending for postcopy
      postcopy: OS support test
      migrate_start_postcopy: Command to trigger transition to postcopy
      migration_completion: Take current state
      MIGRATION_STATUS_POSTCOPY_ACTIVE: Add new migration state
      Avoid sending vmdescription during postcopy
      Add qemu_savevm_state_complete_postcopy
      Postcopy: Maintain unsentmap
      migration_completion: Take current state
      postcopy: Incoming initialisation
      postcopy: ram_enable_notify to switch on userfault
      Postcopy: Postcopy startup in migration thread
      Postcopy: End of iteration
      Page request: Add MIG_RP_MSG_REQ_PAGES reverse command
      Page request: Process incoming page request
      Page request: Consume pages off the post-copy queue
      postcopy_ram.c: place_page and helpers
      Postcopy: Use helpers to map pages during migration
      postcopy: Check order of received target pages
      Don't sync dirty bitmaps in postcopy
      Don't iterate on precopy-only devices during postcopy
      Host page!=target page: Cleanup bitmaps
      Round up RAMBlock sizes to host page sizes
      Postcopy; Handle userfault requests
      Start up a postcopy/listener thread ready for incoming page data
      postcopy: Wire up loadvm_postcopy_handle_ commands
      Postcopy: Mark nohugepage before discard
      End of migration for postcopy
      Disable mlock around incoming postcopy
      Inhibit ballooning during postcopy

 balloon.c                         |  11 +
 docs/migration.txt                | 191 ++++++++
 exec.c                            |  92 +++-
 hmp-commands.hx                   |  15 +
 hmp.c                             |   7 +
 hmp.h                             |   1 +
 hw/ppc/spapr.c                    |   2 +-
 hw/virtio/virtio-balloon.c        |   4 +-
 include/exec/cpu-common.h         |   4 +
 include/exec/exec-all.h           |   1 -
 include/exec/ram_addr.h           |   2 -
 include/migration/migration.h     | 121 ++++-
 include/migration/postcopy-ram.h  |  99 ++++
 include/migration/qemu-file.h     |  10 +
 include/migration/vmstate.h       |   8 +-
 include/qemu-common.h             |   1 +
 include/qemu/osdep.h              |   9 +
 include/qemu/typedefs.h           |   3 +
 include/sysemu/balloon.h          |   2 +
 include/sysemu/sysemu.h           |  46 +-
 kvm-all.c                         |   1 -
 linux-headers/linux/userfaultfd.h | 167 +++++++
 migration/Makefile.objs           |   2 +-
 migration/block.c                 |   9 +-
 migration/migration.c             | 723 +++++++++++++++++++++++++--
 migration/postcopy-ram.c          | 767 +++++++++++++++++++++++++++++
 migration/qemu-file-unix.c        | 111 ++++-
 migration/qemu-file.c             |  64 +++
 migration/ram.c                   | 999 +++++++++++++++++++++++++++++++++++---
 migration/savevm.c                | 825 +++++++++++++++++++++++++++----
 qapi-schema.json                  |  18 +-
 qmp-commands.hx                   |  19 +
 qtest.c                           |   1 -
 trace-events                      |  84 +++-
 vl.c                              |   1 +
 35 files changed, 4168 insertions(+), 252 deletions(-)
 create mode 100644 include/migration/postcopy-ram.h
 create mode 100644 linux-headers/linux/userfaultfd.h
 create mode 100644 migration/postcopy-ram.c

             reply	other threads:[~2015-11-09 17:29 UTC|newest]

Thread overview: 74+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2015-11-09 17:28 Juan Quintela [this message]
2015-11-09 17:28 ` [Qemu-devel] [PULL 01/57] Add postcopy documentation Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 02/57] Provide runtime Target page information Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 03/57] Move configuration section writing Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 04/57] Move page_size_init earlier Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 05/57] qemu_ram_block_from_host Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 06/57] qemu_ram_block_by_name Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 07/57] Rename mis->file to from_src_file Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 08/57] Add qemu_get_buffer_in_place to avoid copies some of the time Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 09/57] Add wrapper for setting blocking status on a QEMUFile Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 10/57] Add QEMU_MADV_NOHUGEPAGE Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 11/57] ram_debug_dump_bitmap: Dump a migration bitmap as text Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 12/57] ram_load: Factor out host_from_stream_offset call and check Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 13/57] migrate_init: Call from savevm Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 14/57] Rename save_live_complete to save_live_complete_precopy Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 15/57] Add Linux userfaultfd.h header Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 16/57] Return path: Open a return path on QEMUFile for sockets Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 17/57] Return path: socket_writev_buffer: Block even on non-blocking fd's Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 18/57] Migration commands Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 19/57] Return path: Control commands Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 20/57] Return path: Send responses from destination to source Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 21/57] migration_is_setup_or_active Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 22/57] Return path: Source handling of return path Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 23/57] Rework loadvm path for subloops Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 24/57] Add migration-capability boolean for postcopy-ram Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 25/57] Add wrappers and handlers for sending/receiving the postcopy-ram migration messages Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 26/57] MIG_CMD_PACKAGED: Send a packaged chunk of migration stream Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 27/57] Modify save_live_pending for postcopy Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 28/57] postcopy: OS support test Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 29/57] migrate_start_postcopy: Command to trigger transition to postcopy Juan Quintela
2015-11-09 22:19   ` Eric Blake
2015-11-10 10:38     ` Dr. David Alan Gilbert
2015-11-10 16:36       ` Eric Blake
2015-11-09 17:28 ` [Qemu-devel] [PULL 30/57] migration_completion: Take current state Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 31/57] MIGRATION_STATUS_POSTCOPY_ACTIVE: Add new migration state Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 32/57] Avoid sending vmdescription during postcopy Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 33/57] Add qemu_savevm_state_complete_postcopy Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 34/57] Postcopy: Maintain unsentmap Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 35/57] migration_completion: Take current state Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 36/57] postcopy: Incoming initialisation Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 37/57] postcopy: ram_enable_notify to switch on userfault Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 38/57] Postcopy: Postcopy startup in migration thread Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 39/57] Postcopy: End of iteration Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 40/57] Page request: Add MIG_RP_MSG_REQ_PAGES reverse command Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 41/57] Page request: Process incoming page request Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 42/57] Page request: Consume pages off the post-copy queue Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 43/57] postcopy_ram.c: place_page and helpers Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 44/57] Postcopy: Use helpers to map pages during migration Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 45/57] postcopy: Check order of received target pages Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 46/57] Don't sync dirty bitmaps in postcopy Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 47/57] Don't iterate on precopy-only devices during postcopy Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 48/57] Host page!=target page: Cleanup bitmaps Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 49/57] Round up RAMBlock sizes to host page sizes Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 50/57] Postcopy; Handle userfault requests Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 51/57] Start up a postcopy/listener thread ready for incoming page data Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 52/57] postcopy: Wire up loadvm_postcopy_handle_ commands Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 53/57] Postcopy: Mark nohugepage before discard Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 54/57] End of migration for postcopy Juan Quintela
2015-11-09 17:28 ` [Qemu-devel] [PULL 55/57] Disable mlock around incoming postcopy Juan Quintela
2015-11-09 17:29 ` [Qemu-devel] [PULL 56/57] Inhibit ballooning during postcopy Juan Quintela
2015-11-09 17:29 ` [Qemu-devel] [PULL 57/57] migration: qemu_savevm_state_cleanup becomes mandatory operation Juan Quintela
2015-11-09 17:33 ` [Qemu-devel] [PULL 00/57] Migration pull Peter Maydell
2015-11-09 17:40   ` Juan Quintela
2015-11-09 17:40   ` Dr. David Alan Gilbert
2015-11-09 17:49     ` Peter Maydell
2015-11-09 17:50 ` Peter Maydell
2015-11-09 18:29   ` Juan Quintela
2015-11-09 22:36     ` Eric Blake
2015-11-10 10:53       ` Peter Maydell
2015-11-10 12:18         ` Peter Maydell
2015-11-10 12:22           ` Dr. David Alan Gilbert
2015-11-10 12:43             ` Peter Maydell
2015-11-09 18:49   ` Juan Quintela
2015-11-09 19:02   ` Markus Armbruster

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=1447090141-29074-1-git-send-email-quintela@redhat.com \
    --to=quintela@redhat.com \
    --cc=amit.shah@redhat.com \
    --cc=dgilbert@redhat.com \
    --cc=qemu-devel@nongnu.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).