From: "Michael S. Tsirkin" <mst@redhat.com>
To: Alexandr Moshkov <dtalexundeer@yandex-team.ru>
Cc: qemu-devel@nongnu.org, "Hanna Reitz" <hreitz@redhat.com>,
"Jason Wang" <jasowangio@gmail.com>,
"Vladimir Sementsov-Ogievskiy" <vsementsov@yandex-team.ru>,
"Gonglei (Arei)" <arei.gonglei@huawei.com>,
"Jason Wang" <jasowang@redhat.com>, "Fam Zheng" <fam@euphon.net>,
qemu-block@nongnu.org, "Stefan Hajnoczi" <stefanha@redhat.com>,
"Alex Bennée" <alex.bennee@linaro.org>,
"yc-core@yandex-team.ru" <yc-core@yandex-team.ru>,
"Pierrick Bouvier" <pierrick.bouvier@linaro.org>,
"Pierrick Bouvier" <pierrick.bouvier@oss.qualcomm.com>,
virtio-fs@lists.linux.dev, "Kevin Wolf" <kwolf@redhat.com>,
"zhenwei pi" <zhenwei.pi@linux.dev>,
"Paolo Bonzini" <pbonzini@redhat.com>,
"Stefano Garzarella" <sgarzare@redhat.com>,
"Milan Zamazal" <mzamazal@redhat.com>,
"Raphael Norwitz" <rnorwitz@nvidia.com>
Subject: Re: [PATCH v5 4/6] vhost-user-blk: make inflight-migration prop mutable
Date: Wed, 29 Jul 2026 06:48:19 -0400 [thread overview]
Message-ID: <20260729064648-mutt-send-email-mst@kernel.org> (raw)
In-Reply-To: <a4db1b40-d48c-473b-86a7-63a0c0cc5ccf@yandex-team.ru>
On Wed, Jul 29, 2026 at 03:35:31PM +0500, Alexandr Moshkov wrote:
>
> On 7/29/26 15:14, Michael S. Tsirkin wrote:
> > On Wed, Jul 29, 2026 at 03:09:57PM +0500, Alexandr Moshkov wrote:
> > > On 7/29/26 14:32, Michael S. Tsirkin wrote:
> > >
> > > On Tue, Jul 28, 2026 at 03:08:39PM +0500, Alexandr Moshkov wrote:
> > >
> > > When migrating from a QEMU version that supports inflight-migration to
> > > an older one that does not, there is no way to disable the feature at
> > > runtime — the VM must be stopped and reconfigured. This is impractical
> > > in production environments.
> > >
> > > Make the inflight-migration property mutable after device realization
> > > so it can be toggled via qom-set without restarting the VM.
> > >
> > > Acked-by: Raphael Norwitz <rnorwitz@nvidia.com>
> > > Signed-off-by: Alexandr Moshkov <dtalexundeer@yandex-team.ru>
> > >
> > >
> > >
> > > I think I am beginning to understand.
> > >
> > >
> > > You are running qemu with inflight-migration on and want to migrate
> > > to qemu without inflight-migration at all.
> > >
> > >
> > > Since it is guest transparent you could retrofit it like this.
> > >
> > > My question is why is it worth it, we do not normally support
> > > migrating between qemu versions with different command lines.
> > >
> > > I think you right. Maybe I've been focusing too much on the ability to migrate
> > > between versions of qemu with and without inflight migration.
> > >
> > > This series allows to turn off and on the inflight-migration feature at runtime
> > > without recreating the VM (it was the only way to turn off the feature, since
> > > the protocol feature could no longer be turned off, after initialization with
> > > the backend). This is more important feature, and it leads to the fact that
> > > this feature allows to migrate between different versions of qemu (with and
> > > without inflight-migration support).
> > >
> > >
> > > ---
> > > hw/block/vhost-user-blk.c | 10 ++++++++--
> > > 1 file changed, 8 insertions(+), 2 deletions(-)
> > >
> > > diff --git a/hw/block/vhost-user-blk.c b/hw/block/vhost-user-blk.c
> > > index e3b873af7c..650c004bde 100644
> > > --- a/hw/block/vhost-user-blk.c
> > > +++ b/hw/block/vhost-user-blk.c
> > > @@ -619,6 +619,8 @@ static const VMStateDescription vmstate_vhost_user_blk = {
> > > }
> > > };
> > >
> > > +static PropertyInfo vhost_user_blk_inflight_migration_prop;
> > > +
> > > static const Property vhost_user_blk_properties[] = {
> > > DEFINE_PROP_CHR("chardev", VHostUserBlk, chardev),
> > > DEFINE_PROP_UINT16("num-queues", VHostUserBlk, num_queues,
> > > @@ -632,8 +634,9 @@ static const Property vhost_user_blk_properties[] = {
> > > VIRTIO_BLK_F_WRITE_ZEROES, true),
> > > DEFINE_PROP_BOOL("skip-get-vring-base-on-force-shutdown", VHostUserBlk,
> > > skip_get_vring_base_on_force_shutdown, false),
> > > - DEFINE_PROP_BOOL("inflight-migration", VHostUserBlk,
> > > - inflight_migration, false),
> > > + DEFINE_PROP("inflight-migration", VHostUserBlk, inflight_migration,
> > > + vhost_user_blk_inflight_migration_prop, bool,
> > > + .set_default = true, .defval.u = false),
> > > };
> > >
> > > static void vhost_user_blk_class_init(ObjectClass *klass, const void *data)
> > > @@ -665,6 +668,9 @@ static const TypeInfo vhost_user_blk_info = {
> > >
> > > static void virtio_register_types(void)
> > > {
> > > + vhost_user_blk_inflight_migration_prop = qdev_prop_bool;
> > > + vhost_user_blk_inflight_migration_prop.realized_set_allowed = true;
> > > +
> > > type_register_static(&vhost_user_blk_info);
> > > }
> > >
> > > So then, for example, let us say I paused the VM, then set the flag,
> > > now inflight is on but GET_BASE did not drain it?
> > >
> > > If I understood the question correctly, this is valid behavior. Before
> > > migration QEMU check protocol features to understand does the backend support
> > > inflight migration. If it does, after that QEMU migrate inflight buffer to
> > > other VM. If it's not, return error before migration started.
> >
> > I apologise i reverted the logic in the question.
> >
> >
> > I start vm and inflight is on.
> > I stop vm get base does not drain.
>
> In case of VM stop, backend wait to drain all requests. Ability to perform
> drain or not available only during migration by skip_drain variable in
> vhost_user_blk_stop().
What if it was migration but it failed?
> skip_drain true only if inflight_migration is on and runstate is
> FINISH_MIGRATION.
This btw I don't much like, a stopped VM would preferably
behave the same whatever the reason to stop.
>
> > i turn inflight off.
> > now it looks like it will happily migrate?
>
> So in this case, when vm migrated with inflight off, it will leads to using
> GET_VRING_BASE message, that wait all requests to be drained.
>
> >
> > > --
> > > 2.34.1
> > >
next prev parent reply other threads:[~2026-07-29 10:48 UTC|newest]
Thread overview: 17+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-07-28 10:08 [PATCH v5 0/6] vhost-user-blk: add compatibility with older qemu versions Alexandr Moshkov
2026-07-28 10:08 ` [PATCH v5 1/6] vhost-user: add skip_drain param to do_vhost_virtqueue_stop Alexandr Moshkov
2026-07-28 10:08 ` [PATCH v5 2/6] vhost-user: add GET_VRING_BASE_SKIP_DRAIN message Alexandr Moshkov
2026-07-29 9:14 ` Michael S. Tsirkin
2026-07-29 10:49 ` Alexandr Moshkov
2026-07-28 10:08 ` [PATCH v5 3/6] vhost-user: use skip_drain with " Alexandr Moshkov
2026-07-28 10:08 ` [PATCH v5 4/6] vhost-user-blk: make inflight-migration prop mutable Alexandr Moshkov
2026-07-29 9:32 ` Michael S. Tsirkin
2026-07-29 10:09 ` Alexandr Moshkov
2026-07-29 10:14 ` Michael S. Tsirkin
2026-07-29 10:35 ` Alexandr Moshkov
2026-07-29 10:48 ` Michael S. Tsirkin [this message]
2026-07-29 10:56 ` Alexandr Moshkov
2026-07-29 12:13 ` Michael S. Tsirkin
2026-07-28 10:08 ` [PATCH v5 5/6] vhost-user-blk: move inflight_needed higher Alexandr Moshkov
2026-07-28 10:08 ` [PATCH v5 6/6] vhost-user-blk: use GET_VRING_BASE_SKIP_DRAIN during inflight migration Alexandr Moshkov
2026-07-29 9:14 ` [PATCH v5 0/6] vhost-user-blk: add compatibility with older qemu versions Michael S. Tsirkin
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20260729064648-mutt-send-email-mst@kernel.org \
--to=mst@redhat.com \
--cc=alex.bennee@linaro.org \
--cc=arei.gonglei@huawei.com \
--cc=dtalexundeer@yandex-team.ru \
--cc=fam@euphon.net \
--cc=hreitz@redhat.com \
--cc=jasowang@redhat.com \
--cc=jasowangio@gmail.com \
--cc=kwolf@redhat.com \
--cc=mzamazal@redhat.com \
--cc=pbonzini@redhat.com \
--cc=pierrick.bouvier@linaro.org \
--cc=pierrick.bouvier@oss.qualcomm.com \
--cc=qemu-block@nongnu.org \
--cc=qemu-devel@nongnu.org \
--cc=rnorwitz@nvidia.com \
--cc=sgarzare@redhat.com \
--cc=stefanha@redhat.com \
--cc=virtio-fs@lists.linux.dev \
--cc=vsementsov@yandex-team.ru \
--cc=yc-core@yandex-team.ru \
--cc=zhenwei.pi@linux.dev \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.