From: Zhang Chen <zhangckid@gmail.com>
To: qemu-devel@nongnu.org
Cc: Paolo Bonzini <pbonzini@redhat.com>,
zhanghailiang <zhang.zhanghailiang@huawei.com>,
Juan Quintela <quintela@redhat.com>,
"Dr . David Alan Gilbert" <dgilbert@redhat.com>,
Jason Wang <jasowang@redhat.com>, Eric Blake <eblake@redhat.com>,
Markus Armbruster <armbru@redhat.com>,
Zhang Chen <zhangckid@gmail.com>,
Li Zhijian <lizhijian@cn.fujitsu.com>
Subject: [Qemu-devel] [PATCH V5 00/17] COLO: integrate colo frame with block replication and COLO proxy
Date: Sun, 11 Mar 2018 05:21:50 +0800 [thread overview]
Message-ID: <1520716927-17068-1-git-send-email-zhangckid@gmail.com> (raw)
Hi~
COLO Frame, block replication and COLO proxy(colo-compare,filter-mirror,
filter-redirector,filter-rewriter) have been exist in qemu
for long time, it's time to integrate these three parts to make COLO really works.
In this series, we have some optimizations for COLO frame, including separating the
process of saving ram and device state, using an COLO_EXIT event to notify users that
VM exits COLO, for these parts, most of them have been reviewed long time ago in old version,
but since this series have just rebased on upstream which had merged a new series of migration,
parts of pathes in this series deserve review again.
We use notifier/callback method for COLO compare to notify COLO frame about
net packets inconsistent event, and add a handle_event method for NetFilterClass to
help COLO frame to notify filters and colo-compare about checkpoint/failover event,
it is flexible.
For the neweset version, please refer to:
https://github.com/zhangckid/qemu/tree/qemu-colo-18mar10
Please review, thanks.
V5:
- Addressed Markus's comments add new command to
query COLO status(patch 11/17).
- Rebased on upstream codes.
- Fixed qapi header problem in patch 10/17.
- Fixed the conflict of "qemu_anon_ram_alloc()" in patch 07/17.
V4:
- Address Eric's comments in patch 10/16.
- Rebase on upstream codes.
- Fix mingw compile error in patch 02/16.
- Fix some comments.
- Fix conflect with the patch "migration: remove "enable_colo" var" in patch 06/16.
V3:
- Address community comments from V2.
- Rebase on upstream codes.
- Fix several bugs.
- Splite shared disk part to indepentent patch set.
- Optimize codes.
Zhang Chen (10):
filter-rewriter: fix memory leak for connection in
connection_track_table
colo-compare: implement the process of checkpoint
colo-compare: use notifier to notify packets comparing result
COLO: integrate colo compare with colo frame
COLO: Add block replication into colo process
COLO: Remove colo_state migration struct
ram/COLO: Record the dirty pages that SVM received
qapi: Add new command to query colo status
filter: Add handle_event method for NetFilterClass
filter-rewriter: handle checkpoint and failover event
zhanghailiang (7):
COLO: Load dirty pages into SVM's RAM cache firstly
COLO: Flush memory data from ram cache
qmp event: Add COLO_EXIT event to notify users while exited COLO
savevm: split the process of different stages for loadvm/savevm
COLO: flush host dirty ram from cache
COLO: notify net filters about checkpoint/failover event
COLO: quick failover process by kick COLO thread
include/exec/ram_addr.h | 1 +
include/migration/colo.h | 11 ++-
include/net/filter.h | 5 ++
migration/Makefile.objs | 2 +-
migration/colo-comm.c | 76 ----------------
migration/colo.c | 220 ++++++++++++++++++++++++++++++++++++++++++++---
migration/migration.c | 38 +++++++-
migration/ram.c | 183 ++++++++++++++++++++++++++++++++++++++-
migration/ram.h | 4 +
migration/savevm.c | 54 ++++++++++--
migration/savevm.h | 5 ++
migration/trace-events | 3 +
net/colo-compare.c | 108 +++++++++++++++++++++--
net/colo-compare.h | 24 ++++++
net/colo.h | 4 +
net/filter-rewriter.c | 109 +++++++++++++++++++++--
net/filter.c | 17 ++++
net/net.c | 28 ++++++
qapi/migration.json | 70 +++++++++++++++
vl.c | 2 -
20 files changed, 846 insertions(+), 118 deletions(-)
delete mode 100644 migration/colo-comm.c
create mode 100644 net/colo-compare.h
--
2.7.4
next reply other threads:[~2018-03-10 21:22 UTC|newest]
Thread overview: 20+ messages / expand[flat|nested] mbox.gz Atom feed top
2018-03-10 21:21 Zhang Chen [this message]
2018-03-10 21:21 ` [Qemu-devel] [PATCH V5 01/17] filter-rewriter: fix memory leak for connection in connection_track_table Zhang Chen
2018-03-10 21:21 ` [Qemu-devel] [PATCH V5 02/17] colo-compare: implement the process of checkpoint Zhang Chen
2018-03-10 21:21 ` [Qemu-devel] [PATCH V5 03/17] colo-compare: use notifier to notify packets comparing result Zhang Chen
2018-03-10 21:21 ` [Qemu-devel] [PATCH V5 04/17] COLO: integrate colo compare with colo frame Zhang Chen
2018-03-10 21:21 ` [Qemu-devel] [PATCH V5 05/17] COLO: Add block replication into colo process Zhang Chen
2018-03-10 21:21 ` [Qemu-devel] [PATCH V5 06/17] COLO: Remove colo_state migration struct Zhang Chen
2018-03-10 21:21 ` [Qemu-devel] [PATCH V5 07/17] COLO: Load dirty pages into SVM's RAM cache firstly Zhang Chen
2018-03-10 21:21 ` [Qemu-devel] [PATCH V5 08/17] ram/COLO: Record the dirty pages that SVM received Zhang Chen
2018-03-10 21:21 ` [Qemu-devel] [PATCH V5 09/17] COLO: Flush memory data from ram cache Zhang Chen
2018-03-10 21:22 ` [Qemu-devel] [PATCH V5 10/17] qmp event: Add COLO_EXIT event to notify users while exited COLO Zhang Chen
2018-03-10 21:22 ` [Qemu-devel] [PATCH V5 11/17] qapi: Add new command to query colo status Zhang Chen
2018-03-10 21:33 ` Eric Blake
2018-03-11 7:59 ` Zhang Chen
2018-03-10 21:22 ` [Qemu-devel] [PATCH V5 12/17] savevm: split the process of different stages for loadvm/savevm Zhang Chen
2018-03-10 21:22 ` [Qemu-devel] [PATCH V5 13/17] COLO: flush host dirty ram from cache Zhang Chen
2018-03-10 21:22 ` [Qemu-devel] [PATCH V5 14/17] filter: Add handle_event method for NetFilterClass Zhang Chen
2018-03-10 21:22 ` [Qemu-devel] [PATCH V5 15/17] filter-rewriter: handle checkpoint and failover event Zhang Chen
2018-03-10 21:22 ` [Qemu-devel] [PATCH V5 16/17] COLO: notify net filters about checkpoint/failover event Zhang Chen
2018-03-10 21:22 ` [Qemu-devel] [PATCH V5 17/17] COLO: quick failover process by kick COLO thread Zhang Chen
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1520716927-17068-1-git-send-email-zhangckid@gmail.com \
--to=zhangckid@gmail.com \
--cc=armbru@redhat.com \
--cc=dgilbert@redhat.com \
--cc=eblake@redhat.com \
--cc=jasowang@redhat.com \
--cc=lizhijian@cn.fujitsu.com \
--cc=pbonzini@redhat.com \
--cc=qemu-devel@nongnu.org \
--cc=quintela@redhat.com \
--cc=zhang.zhanghailiang@huawei.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).