From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:4830:134:3::10]:40249) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1fNxe8-0000K5-NT for qemu-devel@nongnu.org; Wed, 30 May 2018 05:43:57 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1fNxe5-0006nM-Ld for qemu-devel@nongnu.org; Wed, 30 May 2018 05:43:56 -0400 Received: from mail-pl0-x22d.google.com ([2607:f8b0:400e:c01::22d]:40360) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1fNxe5-0006n8-FU for qemu-devel@nongnu.org; Wed, 30 May 2018 05:43:53 -0400 Received: by mail-pl0-x22d.google.com with SMTP id t12-v6so10758579plo.7 for ; Wed, 30 May 2018 02:43:53 -0700 (PDT) From: Lidong Chen Date: Wed, 30 May 2018 17:43:24 +0800 Message-Id: <1527673416-31268-1-git-send-email-lidongchen@tencent.com> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Subject: [Qemu-devel] [PATCH v4 00/12] Enable postcopy RDMA live migration List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: zhang.zhanghailiang@huawei.com, quintela@redhat.com, dgilbert@redhat.com, berrange@redhat.com, aviadye@mellanox.com, pbonzini@redhat.com Cc: qemu-devel@nongnu.org, adido@mellanox.com, Lidong Chen The RDMA QIOChannel does not support bi-directional communication, so when RDMA live migration with postcopy enabled, the source qemu return path get qemu file error. These patches implement bi-directional communication for RDMA QIOChannel and disable the RDMA WRITE during the postcopy phase. This patch just make postcopy works, and will improve performance later. [v4] - not wait RDMA_CM_EVENT_DISCONNECTED event after rdma_disconnect - implement io_set_aio_fd_handler function for RDMA QIOChannel (Juan Quintela) - invoke qio_channel_yield only when qemu_in_coroutine() (Juan Quintela) - create a dedicated thread to release rdma resource - poll the cm event while wait RDMA work request completion - implement the shutdown function for RDMA QIOChannel [v3] - add a mutex in QEMUFile struct to avoid concurrent channel close (Daniel) - destroy the mutex before free QEMUFile (David) - use rdmain and rmdaout instead of rdma->return_path (Daniel) [v2] - does not update bytes_xfer when disable RDMA WRITE (David) - implement bi-directional communication for RDMA QIOChannel (Daniel) Lidong Chen (12): migration: disable RDMA WRITE after postcopy started migration: create a dedicated connection for rdma return path migration: remove unnecessary variables len in QIOChannelRDMA migration: avoid concurrent invoke channel_close by different threads migration: implement bi-directional RDMA QIOChannel migration: Stop rdma yielding during incoming postcopy migration: not wait RDMA_CM_EVENT_DISCONNECTED event after rdma_disconnect migration: implement io_set_aio_fd_handler function for RDMA QIOChannel migration: invoke qio_channel_yield only when qemu_in_coroutine() migration: create a dedicated thread to release rdma resource migration: poll the cm event while wait RDMA work request completion migration: implement the shutdown for RDMA QIOChannel migration/colo.c | 2 + migration/migration.c | 2 + migration/postcopy-ram.c | 2 + migration/qemu-file-channel.c | 12 +- migration/qemu-file.c | 13 +- migration/ram.c | 4 + migration/rdma.c | 435 ++++++++++++++++++++++++++++++++++++------ migration/savevm.c | 3 + migration/trace-events | 1 - 9 files changed, 411 insertions(+), 63 deletions(-) -- 1.8.3.1