From: Hailiang Zhang <zhang.zhanghailiang@huawei.com>
To: "Dr. David Alan Gilbert" <dgilbert@redhat.com>
Cc: lizhijian@cn.fujitsu.com, quintela@redhat.com,
yunhong.jiang@intel.com, eddie.dong@intel.com,
peter.huangpeng@huawei.com, qemu-devel@nongnu.org,
arei.gonglei@huawei.com, stefanha@redhat.com,
amit.shah@redhat.com, hongyang.yang@easystack.cn
Subject: Re: [Qemu-devel] [PATCH COLO-Frame v12 27/38] COLO failover: Don't do failover during loading VM's state
Date: Fri, 25 Dec 2015 09:02:30 +0800 [thread overview]
Message-ID: <567C95A6.1010205@huawei.com> (raw)
In-Reply-To: <20151215102139.GB2500@work-vm>
On 2015/12/15 18:21, Dr. David Alan Gilbert wrote:
> * zhanghailiang (zhang.zhanghailiang@huawei.com) wrote:
>> We should not do failover work while the main thread is loading
>> VM's state, otherwise it will destroy the consistent of VM's memory and
>> device state.
>>
>> Here we add a new failover status 'RELAUNCH' which means we should
>> relaunch the process of failover.
>>
>> Signed-off-by: zhanghailiang <zhang.zhanghailiang@huawei.com>
>> Signed-off-by: Li Zhijian <lizhijian@cn.fujitsu.com>
>> ---
>> include/migration/failover.h | 2 ++
>> migration/colo.c | 25 +++++++++++++++++++++++++
>> 2 files changed, 27 insertions(+)
>>
>> diff --git a/include/migration/failover.h b/include/migration/failover.h
>> index fba3931..e115d25 100644
>> --- a/include/migration/failover.h
>> +++ b/include/migration/failover.h
>> @@ -20,6 +20,8 @@ typedef enum COLOFailoverStatus {
>> FAILOVER_STATUS_REQUEST = 1, /* Request but not handled */
>> FAILOVER_STATUS_HANDLING = 2, /* In the process of handling failover */
>> FAILOVER_STATUS_COMPLETED = 3, /* Finish the failover process */
>> + /* Optional, Relaunch the failover process, again 'NONE' -> 'COMPLETED' */
>> + FAILOVER_STATUS_RELAUNCH = 4,
>> } COLOFailoverStatus;
>>
>> void failover_init_state(void);
>> diff --git a/migration/colo.c b/migration/colo.c
>> index 58531e7..f4bb661 100644
>> --- a/migration/colo.c
>> +++ b/migration/colo.c
>> @@ -20,6 +20,8 @@
>> #include "migration/failover.h"
>> #include "qapi-event.h"
>>
>> +static bool vmstate_loading;
>> +
>> /* colo buffer */
>> #define COLO_BUFFER_BASE_SIZE (4 * 1024 * 1024)
>>
>> @@ -52,6 +54,19 @@ static void secondary_vm_do_failover(void)
>> int old_state;
>> MigrationIncomingState *mis = migration_incoming_get_current();
>>
>> + /* Can not do failover during the process of VM's loading VMstate, Or
>> + * it will break the secondary VM.
>> + */
>> + if (vmstate_loading) {
>> + old_state = failover_set_state(FAILOVER_STATUS_HANDLING,
>> + FAILOVER_STATUS_RELAUNCH);
>> + if (old_state != FAILOVER_STATUS_HANDLING) {
>> + error_report("Unknow error while do failover for secondary VM,"
>> + "old_state: %d", old_state);
>
> Typo: 'Unknown' and it would be good to say it was during vmstate_loading.
>
> The state is being loaded from the qemu buffer, not the real file descriptor,
> so we're guaranteed that the vmstate will finish loading; so yes, this is OK.
>
I will fix it in next version.
Thanks.
Hailiang
> Reviewed-by: Dr. David Alan Gilbert <dgilbert@redhat.com>
>
>
>> + }
>> + return;
>> + }
>> +
>> migrate_set_state(&mis->state, MIGRATION_STATUS_COLO,
>> MIGRATION_STATUS_COMPLETED);
>>
>> @@ -535,13 +550,23 @@ void *colo_process_incoming_thread(void *opaque)
>>
>> qemu_mutex_lock_iothread();
>> qemu_system_reset(VMRESET_SILENT);
>> + vmstate_loading = true;
>> if (qemu_loadvm_state(fb) < 0) {
>> error_report("COLO: loadvm failed");
>> + vmstate_loading = false;
>> qemu_mutex_unlock_iothread();
>> goto out;
>> }
>> +
>> + vmstate_loading = false;
>> qemu_mutex_unlock_iothread();
>>
>> + if (failover_get_state() == FAILOVER_STATUS_RELAUNCH) {
>> + failover_set_state(FAILOVER_STATUS_RELAUNCH, FAILOVER_STATUS_NONE);
>> + failover_request_active(NULL);
>> + goto out;
>> + }
>> +
>> ret = colo_put_cmd(mis->to_src_file, COLO_COMMAND_VMSTATE_LOADED);
>> if (ret < 0) {
>> goto out;
>> --
>> 1.8.3.1
>>
>>
> --
> Dr. David Alan Gilbert / dgilbert@redhat.com / Manchester, UK
>
> .
>
next prev parent reply other threads:[~2015-12-25 1:03 UTC|newest]
Thread overview: 94+ messages / expand[flat|nested] mbox.gz Atom feed top
2015-12-15 8:22 [Qemu-devel] [PATCH COLO-Frame v12 00/38] COarse-grain LOck-stepping(COLO) Virtual Machines for Non-stop Service (FT) zhanghailiang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 01/38] configure: Add parameter for configure to enable/disable COLO support zhanghailiang
2015-12-15 9:46 ` Wen Congyang
2015-12-15 11:19 ` Hailiang Zhang
2015-12-15 11:31 ` Hailiang Zhang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 02/38] migration: Introduce capability 'x-colo' to migration zhanghailiang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 03/38] COLO: migrate colo related info to secondary node zhanghailiang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 04/38] migration: Export migrate_set_state() zhanghailiang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 05/38] migration: Add state records for migration incoming zhanghailiang
2015-12-15 17:36 ` Dr. David Alan Gilbert
2015-12-16 5:37 ` Hailiang Zhang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 06/38] migration: Integrate COLO checkpoint process into migration zhanghailiang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 07/38] migration: Integrate COLO checkpoint process into loadvm zhanghailiang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 08/38] migration: Rename the'file' member of MigrationState zhanghailiang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 09/38] COLO/migration: Create a new communication path from destination to source zhanghailiang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 10/38] COLO: Implement colo checkpoint protocol zhanghailiang
2015-12-18 14:52 ` Dr. David Alan Gilbert
2015-12-28 7:34 ` Hailiang Zhang
2015-12-19 8:54 ` Markus Armbruster
2015-12-22 7:00 ` Hailiang Zhang
2016-01-11 12:47 ` Markus Armbruster
2016-01-12 12:57 ` Hailiang Zhang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 11/38] COLO: Add a new RunState RUN_STATE_COLO zhanghailiang
2015-12-19 9:27 ` Markus Armbruster
2015-12-22 13:32 ` Hailiang Zhang
2016-01-11 13:16 ` Markus Armbruster
2016-01-12 12:54 ` Hailiang Zhang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 12/38] QEMUSizedBuffer: Introduce two help functions for qsb zhanghailiang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 13/38] COLO: Save PVM state to secondary side when do checkpoint zhanghailiang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 14/38] ram: Split host_from_stream_offset() into two helper functions zhanghailiang
2015-12-18 15:18 ` Dr. David Alan Gilbert
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 15/38] COLO: Load PVM's dirty pages into SVM's RAM cache temporarily zhanghailiang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 16/38] ram/COLO: Record the dirty pages that SVM received zhanghailiang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 17/38] COLO: Load VMState into qsb before restore it zhanghailiang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 18/38] COLO: Flush PVM's cached RAM into SVM's memory zhanghailiang
2015-12-15 11:07 ` Changlong Xie
2015-12-25 3:03 ` Hailiang Zhang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 19/38] COLO: Add checkpoint-delay parameter for migrate-set-parameters zhanghailiang
2015-12-19 9:33 ` Markus Armbruster
2015-12-22 13:43 ` Hailiang Zhang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 20/38] COLO: synchronize PVM's state to SVM periodically zhanghailiang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 21/38] COLO failover: Introduce a new command to trigger a failover zhanghailiang
2015-12-18 15:27 ` Dr. David Alan Gilbert
2015-12-19 9:38 ` Markus Armbruster
2015-12-22 13:50 ` Hailiang Zhang
2015-12-25 2:27 ` Hailiang Zhang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 22/38] COLO failover: Introduce state to record failover process zhanghailiang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 23/38] COLO: Implement failover work for Primary VM zhanghailiang
2015-12-18 15:35 ` Dr. David Alan Gilbert
2015-12-28 7:39 ` Hailiang Zhang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 24/38] COLO: Implement failover work for Secondary VM zhanghailiang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 25/38] qmp event: Add event notification for COLO error zhanghailiang
2015-12-18 16:03 ` Eric Blake
2015-12-23 1:55 ` Hailiang Zhang
2015-12-19 10:02 ` Markus Armbruster
2015-12-21 21:14 ` [Qemu-devel] [Qemu-block] " John Snow
2015-12-23 3:14 ` Hailiang Zhang
2015-12-23 1:24 ` [Qemu-devel] " Wen Congyang
2016-01-05 19:21 ` [Qemu-devel] [Qemu-block] " John Snow
2015-12-23 3:10 ` [Qemu-devel] " Hailiang Zhang
2016-01-11 13:24 ` Markus Armbruster
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 26/38] COLO failover: Shutdown related socket fd when do failover zhanghailiang
2015-12-15 9:44 ` Dr. David Alan Gilbert
2015-12-15 10:23 ` Dr. David Alan Gilbert
2015-12-16 5:58 ` Hailiang Zhang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 27/38] COLO failover: Don't do failover during loading VM's state zhanghailiang
2015-12-15 10:21 ` Dr. David Alan Gilbert
2015-12-25 1:02 ` Hailiang Zhang [this message]
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 28/38] COLO: Process shutdown command for VM in COLO state zhanghailiang
2015-12-15 11:31 ` Dr. David Alan Gilbert
2015-12-25 6:13 ` Hailiang Zhang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 29/38] COLO: Update the global runstate after going into colo state zhanghailiang
2015-12-15 11:52 ` Dr. David Alan Gilbert
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 30/38] savevm: Split load vm state function qemu_loadvm_state zhanghailiang
2015-12-15 12:08 ` Dr. David Alan Gilbert
2015-12-25 6:37 ` Hailiang Zhang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 31/38] COLO: Separate the process of saving/loading ram and device state zhanghailiang
2015-12-18 10:53 ` Dr. David Alan Gilbert
2015-12-28 3:46 ` Hailiang Zhang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 32/38] COLO: Split qemu_savevm_state_begin out of checkpoint process zhanghailiang
2015-12-18 12:01 ` Dr. David Alan Gilbert
2015-12-28 7:29 ` Hailiang Zhang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 33/38] net/filter-buffer: Add default filter-buffer for each netdev zhanghailiang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 34/38] filter-buffer: Accept zero interval zhanghailiang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 35/38] filter-buffer: Introduce a helper function to enable/disable default filter zhanghailiang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 36/38] filter-buffer: Introduce a helper function to release packets zhanghailiang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 37/38] colo: Use default buffer-filter to buffer and " zhanghailiang
2015-12-15 8:22 ` [Qemu-devel] [PATCH COLO-Frame v12 38/38] COLO: Add block replication into colo process zhanghailiang
2015-12-15 12:14 ` [Qemu-devel] [PATCH COLO-Frame v12 00/38] COarse-grain LOck-stepping(COLO) Virtual Machines for Non-stop Service (FT) Dr. David Alan Gilbert
2015-12-15 12:41 ` Hailiang Zhang
2015-12-17 10:52 ` Dr. David Alan Gilbert
2015-12-18 1:10 ` Hailiang Zhang
2015-12-18 15:47 ` Dr. David Alan Gilbert
2015-12-23 1:24 ` Hailiang Zhang
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=567C95A6.1010205@huawei.com \
--to=zhang.zhanghailiang@huawei.com \
--cc=amit.shah@redhat.com \
--cc=arei.gonglei@huawei.com \
--cc=dgilbert@redhat.com \
--cc=eddie.dong@intel.com \
--cc=hongyang.yang@easystack.cn \
--cc=lizhijian@cn.fujitsu.com \
--cc=peter.huangpeng@huawei.com \
--cc=qemu-devel@nongnu.org \
--cc=quintela@redhat.com \
--cc=stefanha@redhat.com \
--cc=yunhong.jiang@intel.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).