qemu-devel.nongnu.org archive mirror
 help / color / mirror / Atom feed
* [Qemu-devel] [PATCH RESEND V3 00/16] COLO: integrate colo frame with block replication and COLO proxy
@ 2018-01-04  6:00 Zhang Chen
  2018-01-04  6:01 ` [Qemu-devel] [PATCH RESEND V3 01/16] filter-rewriter: fix memory leak for connection in connection_track_table Zhang Chen
                   ` (16 more replies)
  0 siblings, 17 replies; 20+ messages in thread
From: Zhang Chen @ 2018-01-04  6:00 UTC (permalink / raw)
  To: qemu devel; +Cc: Zhang Chen

Hi~

(Sorry, I forgot add the qemu-devel maillist, resend this series)

COLO Frame, block replication and COLO proxy(colo-compare,filter-mirror,
filter-redirector,filter-rewriter) have been exist in qemu
for long time, it's time to integrate these three parts to make COLO really works.

In this series, we have some optimizations for COLO frame, including separating the
process of saving ram and device state, using an COLO_EXIT event to notify users that
VM exits COLO, for these parts, most of them have been reviewed long time ago in old version,
but since this series have just rebased on upstream which had merged a new series of migration,
parts of pathes in this series deserve review again.

We use notifier/callback method for COLO compare to notify COLO frame about
net packets inconsistent event, and add a handle_event method for NetFilterClass to
help COLO frame to notify filters and colo-compare about checkpoint/failover event, 
it is flexible.

For the neweset version, please refer to:
https://github.com/zhangckid/qemu/tree/qemu-colo-18jan4

Please review, thanks.

V3:
 - Address community comments from V2.
 - Rebase on upstream codes.
 - Fix several bugs.
 - Splite shared disk part to indepentent patch set.
 - Optimize codes.

Zhang Chen (8):
  filter-rewriter: fix memory leak for connection in
    connection_track_table
  colo-compare: implement the process of checkpoint
  colo-compare: use notifier to notify packets comparing result
  COLO: integrate colo compare with colo frame
  COLO: Add block replication into colo process
  ram/COLO: Record the dirty pages that SVM received
  filter: Add handle_event method for NetFilterClass
  filter-rewriter: handle checkpoint and failover event

zhanghailiang (8):
  COLO: Remove colo_state migration struct
  COLO: Load dirty pages into SVM's RAM cache firstly
  COLO: Flush memory data from ram cache
  qmp event: Add COLO_EXIT event to notify users while exited COLO
  savevm: split the process of different stages for loadvm/savevm
  COLO: flush host dirty ram from cache
  COLO: notify net filters about checkpoint/failover event
  COLO: quick failover process by kick COLO thread

 include/exec/ram_addr.h  |   1 +
 include/migration/colo.h |  11 ++-
 include/net/filter.h     |   5 ++
 migration/Makefile.objs  |   2 +-
 migration/colo-comm.c    |  76 -------------------
 migration/colo.c         | 188 ++++++++++++++++++++++++++++++++++++++++++++---
 migration/migration.c    |  38 +++++++++-
 migration/ram.c          | 181 ++++++++++++++++++++++++++++++++++++++++++++-
 migration/ram.h          |   4 +
 migration/savevm.c       |  54 ++++++++++++--
 migration/savevm.h       |   5 ++
 migration/trace-events   |   3 +
 net/colo-compare.c       | 103 ++++++++++++++++++++++++--
 net/colo-compare.h       |  24 ++++++
 net/colo.h               |   4 +
 net/filter-rewriter.c    | 109 +++++++++++++++++++++++++--
 net/filter.c             |  17 +++++
 net/net.c                |  28 +++++++
 qapi-schema.json         |  21 ++++++
 qapi/migration.json      |  13 ++++
 vl.c                     |   2 -
 21 files changed, 771 insertions(+), 118 deletions(-)
 delete mode 100644 migration/colo-comm.c
 create mode 100644 net/colo-compare.h

-- 
2.7.4

^ permalink raw reply	[flat|nested] 20+ messages in thread

end of thread, other threads:[~2018-01-07 13:46 UTC | newest]

Thread overview: 20+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2018-01-04  6:00 [Qemu-devel] [PATCH RESEND V3 00/16] COLO: integrate colo frame with block replication and COLO proxy Zhang Chen
2018-01-04  6:01 ` [Qemu-devel] [PATCH RESEND V3 01/16] filter-rewriter: fix memory leak for connection in connection_track_table Zhang Chen
2018-01-04  6:01 ` [Qemu-devel] [PATCH RESEND V3 02/16] colo-compare: implement the process of checkpoint Zhang Chen
2018-01-04  6:01 ` [Qemu-devel] [PATCH RESEND V3 03/16] colo-compare: use notifier to notify packets comparing result Zhang Chen
2018-01-04  6:01 ` [Qemu-devel] [PATCH RESEND V3 04/16] COLO: integrate colo compare with colo frame Zhang Chen
2018-01-04  6:01 ` [Qemu-devel] [PATCH RESEND V3 05/16] COLO: Add block replication into colo process Zhang Chen
2018-01-04  6:01 ` [Qemu-devel] [PATCH RESEND V3 06/16] COLO: Remove colo_state migration struct Zhang Chen
2018-01-04  6:01 ` [Qemu-devel] [PATCH RESEND V3 07/16] COLO: Load dirty pages into SVM's RAM cache firstly Zhang Chen
2018-01-04  6:01 ` [Qemu-devel] [PATCH RESEND V3 08/16] ram/COLO: Record the dirty pages that SVM received Zhang Chen
2018-01-04  6:01 ` [Qemu-devel] [PATCH RESEND V3 09/16] COLO: Flush memory data from ram cache Zhang Chen
2018-01-04  6:01 ` [Qemu-devel] [PATCH RESEND V3 10/16] qmp event: Add COLO_EXIT event to notify users while exited COLO Zhang Chen
2018-01-04 17:10   ` Eric Blake
2018-01-07 13:46     ` Zhang Chen
2018-01-04  6:01 ` [Qemu-devel] [PATCH RESEND V3 11/16] savevm: split the process of different stages for loadvm/savevm Zhang Chen
2018-01-04  6:01 ` [Qemu-devel] [PATCH RESEND V3 12/16] COLO: flush host dirty ram from cache Zhang Chen
2018-01-04  6:01 ` [Qemu-devel] [PATCH RESEND V3 13/16] filter: Add handle_event method for NetFilterClass Zhang Chen
2018-01-04  6:01 ` [Qemu-devel] [PATCH RESEND V3 14/16] filter-rewriter: handle checkpoint and failover event Zhang Chen
2018-01-04  6:01 ` [Qemu-devel] [PATCH RESEND V3 15/16] COLO: notify net filters about checkpoint/failover event Zhang Chen
2018-01-04  6:01 ` [Qemu-devel] [PATCH RESEND V3 16/16] COLO: quick failover process by kick COLO thread Zhang Chen
2018-01-04  6:32 ` [Qemu-devel] [PATCH RESEND V3 00/16] COLO: integrate colo frame with block replication and COLO proxy no-reply

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).