From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:4830:134:3::10]:40221) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1VjQJ2-0006a7-An for qemu-devel@nongnu.org; Thu, 21 Nov 2013 04:12:19 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1VjQIr-0003Ly-3O for qemu-devel@nongnu.org; Thu, 21 Nov 2013 04:12:12 -0500 Received: from e28smtp09.in.ibm.com ([122.248.162.9]:47673) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1VjQIq-0003Lp-H0 for qemu-devel@nongnu.org; Thu, 21 Nov 2013 04:12:01 -0500 Received: from /spool/local by e28smtp09.in.ibm.com with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted for from ; Thu, 21 Nov 2013 14:41:55 +0530 Received: from d28relay04.in.ibm.com (d28relay04.in.ibm.com [9.184.220.61]) by d28dlp02.in.ibm.com (Postfix) with ESMTP id 8BF89394003F for ; Thu, 21 Nov 2013 14:41:52 +0530 (IST) Received: from d28av03.in.ibm.com (d28av03.in.ibm.com [9.184.220.65]) by d28relay04.in.ibm.com (8.13.8/8.13.8/NCO v10.0) with ESMTP id rAL9Bg4c23462012 for ; Thu, 21 Nov 2013 14:41:44 +0530 Received: from d28av03.in.ibm.com (localhost [127.0.0.1]) by d28av03.in.ibm.com (8.14.4/8.14.4/NCO v10.0 AVout) with ESMTP id rAL9BjWe028626 for ; Thu, 21 Nov 2013 14:41:46 +0530 From: Lei Li Date: Thu, 21 Nov 2013 17:11:23 +0800 Message-Id: <1385025100-3191-1-git-send-email-lilei@linux.vnet.ibm.com> Subject: [Qemu-devel] [PATCH 0/17 v3] Localhost migration with side channel for ram List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: qemu-devel@nongnu.org Cc: aarcange@redhat.com, Lei Li , quintela@redhat.com, mdroth@linux.vnet.ibm.com, mrhines@linux.vnet.ibm.com, aliguori@amazon.com, lagarcia@br.ibm.com, pbonzini@redhat.com, rcj@linux.vnet.ibm.com This patch series tries to introduce a mechanism using side channel pipe for RAM via SCM_RIGHTS with unix domain socket protocol migration. This side channel is used for the page flipping by vmsplice, which is the internal mechanism for localhost migration that we are trying to add to QEMU. The backgroud info and previous patch series for reference, Localhost migration http://lists.nongnu.org/archive/html/qemu-devel/2013-08/msg02916.html migration: Introduce side channel for RAM http://lists.gnu.org/archive/html/qemu-devel/2013-09/msg04043.html I have picked patches from the localhost migration series and rebased it on the series of side channel, now it is a complete series that passed the basic test. Please let me know if there is anything needs to be fixed or improved. Your suggestions and comments are very welcome, and thanks to Paolo for his continued review and useful suggestions. Changes since V2; Address comments from Paolo including: - Doc improvement for QAPI. - Use callback get_buffer as the only one receiver. - Rename the new RunState flipping-migrate to memory-stale, and add transition from 'prelaunch' to 'memory-stale'. - Other minor fixes. Changes since V1: Address suggestions from Paolo Bonzini including: - Use Unix socket QEMUFile as basis of code and adjust the way of overriding RDMA hooks. - Involve the vmsplice for page flipping. - Add new RunState RUN_STATE_FLIPPING_MIGRATE and add it to runstate_needs_reset() for the adjustment of the current migration process with page flipping. Lei Li (17): QAPI: introduce magration capability unix_page_flipping migration: add migrate_unix_page_flipping() qmp-command.hx: add missing docs for migration capabilites migration-local: add QEMUFileLocal with socket based QEMUFile migration-local: introduce qemu_fopen_socket_local() migration-local: add send_pipefd() migration-local: override before_ram_iterate to send pipefd add unix_msgfd_lookup() to callback get_buffer save_page: replace block_offset with a MemoryRegion migration-local: override save_page for page transmit savevm: adjust ram_control_save_page with page flipping migration-local: override hook_ram_load migration-unix: replace qemu_fopen_socket with qemu_fopen_socket_local add new RanState RAN_STATE_MEMORY_STALE migration-unix: page flipping support on unix outgoing migration: adjust migration_thread() process for unix_page_flipping hmp: better fomat for info migrate_capabilities Makefile.target | 1 + arch_init.c | 4 +- migration-local.c | 512 ++++++++++++++++++++++++++++++++++++++++++ hmp.c | 5 +- include/migration/migration.h | 3 + include/migration/qemu-file.h | 2 + migration-unix.c | 27 ++- migration-rdma.c | 4 +- migration.c | 18 +- qapi-schema.json | 18 +- qmp-commands.hx | 8 + savevm.c | 21 +- vl.c | 12 +- 13 files changed, 617 insertions(+), 27 deletions(-) create mode 100644 migration-local.c