qemu-devel.nongnu.org archive mirror
 help / color / mirror / Atom feed
From: Peter Xu <peterx@redhat.com>
To: "Dr. David Alan Gilbert" <dgilbert@redhat.com>
Cc: qemu-devel@nongnu.org, Alexey Perevalov <a.perevalov@samsung.com>,
	"Daniel P . Berrange" <berrange@redhat.com>,
	Juan Quintela <quintela@redhat.com>,
	Andrea Arcangeli <aarcange@redhat.com>
Subject: Re: [Qemu-devel] [PATCH v6 27/28] migration/qmp: add command migrate-pause
Date: Wed, 14 Feb 2018 12:56:39 +0800	[thread overview]
Message-ID: <20180214045639.GI4472@xz-mi> (raw)
In-Reply-To: <20180213201059.GU2378@work-vm>

On Tue, Feb 13, 2018 at 08:11:00PM +0000, Dr. David Alan Gilbert wrote:
> * Peter Xu (peterx@redhat.com) wrote:
> > It pauses an ongoing migration.  Currently it only supports postcopy.
> > Note that this command will work on either side of the migration.
> > Basically when we trigger this on one side, it'll interrupt the other
> > side as well since the other side will get notified on the disconnect
> > event.
> > 
> > However, it's still possible that the other side is not notified, for
> > example, when the network is totally broken, or due to some firewall
> > configuration changes.  In that case, we will also need to run the same
> > command on the other side so both sides will go into the paused state.
> > 
> > Signed-off-by: Peter Xu <peterx@redhat.com>
> > ---
> >  migration/migration.c | 27 +++++++++++++++++++++++++++
> >  qapi/migration.json   | 16 ++++++++++++++++
> >  2 files changed, 43 insertions(+)
> > 
> > diff --git a/migration/migration.c b/migration/migration.c
> > index bb57ed9ade..139abec0c3 100644
> > --- a/migration/migration.c
> > +++ b/migration/migration.c
> > @@ -1448,6 +1448,33 @@ void qmp_migrate_recover(const char *uri, Error **errp)
> >      qemu_start_incoming_migration(uri, errp);
> >  }
> >  
> > +void qmp_migrate_pause(Error **errp)
> > +{
> > +    MigrationState *ms = migrate_get_current();
> > +    MigrationIncomingState *mis = migration_incoming_get_current();
> > +    int ret;
> > +
> > +    if (ms->state == MIGRATION_STATUS_POSTCOPY_ACTIVE) {
> > +        /* Source side, during postcopy */
> > +        ret = qemu_file_shutdown(ms->to_dst_file);
> 
> This doesn't feel thread safe; although I'm not sure how to make it so.
> If the migration finishes just after we check the state but before the
> shutdown we end up using a bogus QEMUFile*
> Making all the places that close a QEMUFile* set hte pointer Null before
> they do the close doesn't help because you still race with that.
> 
> (The race is small, but still)

IMHO we can fix it by adding a migration lock for management code. If
you see my previous migrate cleanup series, it's in my todo. ;)

The basic idea is that we take the lock for critical paths (but not
during most of the migration process).  E.g., we may need the lock
for:

- very beginning of migration, during setup
- reaching the end of migration
- every single migration QMP command (since HMP calls them so HMP will
  also acquire the lock)
- anywhere else I didn't mention that may necessary, e.g., when we
  change migrate state, meanwhile we do something else - basically
  that should be an "atomic operation", and we need the lock to make
  sure of that.

For the recovery series, I would prefer that we ignore this issue for
now - since this problem is there for quite a long time AFAICT in the
whole migration code rather than this series only, and we need to
solve it once and for all.

Thanks,

-- 
Peter Xu

  reply	other threads:[~2018-02-14  4:56 UTC|newest]

Thread overview: 56+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2018-02-08 10:31 [Qemu-devel] [PATCH v6 00/28] Migration: postcopy failure recovery Peter Xu
2018-02-08 10:31 ` [Qemu-devel] [PATCH v6 01/28] migration: better error handling with QEMUFile Peter Xu
2018-02-08 10:31 ` [Qemu-devel] [PATCH v6 02/28] migration: reuse mis->userfault_quit_fd Peter Xu
2018-02-08 10:31 ` [Qemu-devel] [PATCH v6 03/28] migration: provide postcopy_fault_thread_notify() Peter Xu
2018-02-08 10:31 ` [Qemu-devel] [PATCH v6 04/28] migration: new postcopy-pause state Peter Xu
2018-02-08 10:31 ` [Qemu-devel] [PATCH v6 05/28] migration: implement "postcopy-pause" src logic Peter Xu
2018-02-08 10:31 ` [Qemu-devel] [PATCH v6 06/28] migration: allow dst vm pause on postcopy Peter Xu
2018-02-08 10:31 ` [Qemu-devel] [PATCH v6 07/28] migration: allow src return path to pause Peter Xu
2018-02-08 10:31 ` [Qemu-devel] [PATCH v6 08/28] migration: allow send_rq to fail Peter Xu
2018-02-08 10:31 ` [Qemu-devel] [PATCH v6 09/28] migration: allow fault thread to pause Peter Xu
2018-02-08 10:31 ` [Qemu-devel] [PATCH v6 10/28] qmp: hmp: add migrate "resume" option Peter Xu
2018-02-08 10:31 ` [Qemu-devel] [PATCH v6 11/28] migration: pass MigrationState to migrate_init() Peter Xu
2018-02-08 10:31 ` [Qemu-devel] [PATCH v6 12/28] migration: rebuild channel on source Peter Xu
2018-02-08 10:31 ` [Qemu-devel] [PATCH v6 13/28] migration: new state "postcopy-recover" Peter Xu
2018-02-08 10:31 ` [Qemu-devel] [PATCH v6 14/28] migration: wakeup dst ram-load-thread for recover Peter Xu
2018-02-08 10:31 ` [Qemu-devel] [PATCH v6 15/28] migration: new cmd MIG_CMD_RECV_BITMAP Peter Xu
2018-02-08 10:31 ` [Qemu-devel] [PATCH v6 16/28] migration: new message MIG_RP_MSG_RECV_BITMAP Peter Xu
2018-02-08 10:31 ` [Qemu-devel] [PATCH v6 17/28] migration: new cmd MIG_CMD_POSTCOPY_RESUME Peter Xu
2018-02-08 10:31 ` [Qemu-devel] [PATCH v6 18/28] migration: new message MIG_RP_MSG_RESUME_ACK Peter Xu
2018-02-08 10:31 ` [Qemu-devel] [PATCH v6 19/28] migration: introduce SaveVMHandlers.resume_prepare Peter Xu
2018-02-08 10:31 ` [Qemu-devel] [PATCH v6 20/28] migration: synchronize dirty bitmap for resume Peter Xu
2018-02-08 10:31 ` [Qemu-devel] [PATCH v6 21/28] migration: setup ramstate " Peter Xu
2018-02-13 18:17   ` Dr. David Alan Gilbert
2018-02-14  4:20     ` Peter Xu
2018-02-14 18:40       ` Dr. David Alan Gilbert
2018-02-22  7:34         ` Peter Xu
2018-02-08 10:31 ` [Qemu-devel] [PATCH v6 22/28] migration: final handshake for the resume Peter Xu
2018-02-08 10:31 ` [Qemu-devel] [PATCH v6 23/28] migration: init dst in migration_object_init too Peter Xu
2018-02-08 10:31 ` [Qemu-devel] [PATCH v6 24/28] io: let watcher of the channel run in same ctx Peter Xu
2018-02-08 10:31 ` [Qemu-devel] [PATCH v6 25/28] qmp/migration: new command migrate-recover Peter Xu
2018-02-13 18:56   ` Dr. David Alan Gilbert
2018-02-14  4:30     ` Peter Xu
2018-02-08 10:31 ` [Qemu-devel] [PATCH v6 26/28] hmp/migration: add migrate_recover command Peter Xu
2018-02-13 19:45   ` Dr. David Alan Gilbert
2018-02-14  4:48     ` Peter Xu
2018-02-08 10:31 ` [Qemu-devel] [PATCH v6 27/28] migration/qmp: add command migrate-pause Peter Xu
2018-02-13 20:11   ` Dr. David Alan Gilbert
2018-02-14  4:56     ` Peter Xu [this message]
2018-02-14 18:56       ` Dr. David Alan Gilbert
2018-02-22  7:43         ` Peter Xu
2018-02-28 20:14           ` Dr. David Alan Gilbert
2018-03-13  9:13             ` Peter Xu
2018-03-13 12:35               ` Dr. David Alan Gilbert
2018-03-13 15:57                 ` Peter Xu
2018-03-13 16:05                   ` Dr. David Alan Gilbert
2018-02-08 10:31 ` [Qemu-devel] [PATCH v6 28/28] migration/hmp: add migrate_pause command Peter Xu
2018-02-13 20:14   ` Dr. David Alan Gilbert
2018-02-08 10:38 ` [Qemu-devel] [PATCH v6 00/28] Migration: postcopy failure recovery Peter Xu
2018-02-08 11:25 ` no-reply
2018-02-09  6:07   ` Peter Xu
2018-02-09  6:19     ` Fam Zheng
2018-02-08 11:27 ` no-reply
2018-02-08 11:28 ` no-reply
2018-02-08 11:30 ` no-reply
2018-02-08 12:18 ` no-reply
2018-02-09  6:28 ` Peter Xu

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20180214045639.GI4472@xz-mi \
    --to=peterx@redhat.com \
    --cc=a.perevalov@samsung.com \
    --cc=aarcange@redhat.com \
    --cc=berrange@redhat.com \
    --cc=dgilbert@redhat.com \
    --cc=qemu-devel@nongnu.org \
    --cc=quintela@redhat.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).