All of lore.kernel.org
 help / color / mirror / Atom feed
From: Wei Wang <wei.w.wang@intel.com>
To: Peter Xu <peterx@redhat.com>
Cc: "Michael S. Tsirkin" <mst@redhat.com>,
	qemu-devel@nongnu.org, virtio-dev@lists.oasis-open.org,
	quintela@redhat.com, dgilbert@redhat.com, pbonzini@redhat.com,
	liliang.opensource@gmail.com, yang.zhang.wz@gmail.com,
	quan.xu0@gmail.com, nilal@redhat.com, riel@redhat.com,
	zhang.zhanghailiang@huawei.com
Subject: [virtio-dev] Re: [PATCH v7 4/5] virtio-balloon: VIRTIO_BALLOON_F_FREE_PAGE_HINT
Date: Fri, 08 Jun 2018 15:14:38 +0800	[thread overview]
Message-ID: <5B1A2CDE.7000905@intel.com> (raw)
In-Reply-To: <20180608021758.GS750@xz-mi>

On 06/08/2018 10:17 AM, Peter Xu wrote:
> On Thu, Jun 07, 2018 at 07:59:22PM +0800, Wei Wang wrote:
>> Not necessarily _need_ to share it, I meant it can be shared using qemu
>> command line.
>> Live migration doesn't happen all the time, and that optimization doesn't
>> run that long, if users want to have other BHs run in this iothread context,
>> they can only create one iothread via the qemu cmd line.
> IMO iothreads and aiocontexts are for event-driven model.

To me it's just a thread which polls for submitted callbacks to run. 
When migration reaches the place that needs to submit the optimization 
function, it calls start() to submit it. I'm not sure why there is a 
worry about what's inside the callback.

> Busy loop
> is not an event-driven model.  Here if we want a busy loop I'll create
> a thread when start page hinting, then join the thread when done.

  The old (v4) implementation worked that way as you mentioned above, 
and Michael suggested to use iothread in the previous discussion. I'm 
fine with both actually. For the virtio part, we've had many 
discussions, I would take the choice I had with Michael before, unless 
there is an obvious advantage (e.g. proved better performance).


>
> But I'll stop commenting on this.  Please prepare a more clear
> interface for migration in your next post.  I'll read that.
>

Sure, thanks. The new version is coming soon.




>>
>>>>> I'm a bit curious on how much time will it use to do
>>>>> one round of the free page hints (e.g., an idle guest with 8G mem, or
>>>>> any configuration you tested)?  I suppose during that time the
>>>>> iothread will be held steady with 100% cpu usage, am I right?
>>>> Compared to the time spent by the legacy migration to send free pages, that
>>>> small amount of CPU usage spent on filtering free pages could be neglected.
>>>> Grinding a chopper will not hold up the work of cutting firewood :)
>>> Sorry I didn't express myself clearly.
>>>
>>> My question was that, have you measured how long time it will take
>>> from starting of the free page hints (when balloon state is set to
>>> FREE_PAGE_REPORT_S_REQUESTED), until it completes (when QEMU receives
>>> the VIRTIO_BALLOON_FREE_PAGE_REPORT_STOP_ID, then set the status to
>>> FREE_PAGE_REPORT_S_STOP)?
>>>
>> I vaguely remember it's several ms (for around 7.5G free pages) long time
>> ago. What would be the concern behind that number you want to know?
> Because roughly I know the time between two bitmap syncs.  Then I will
> know how possible a free page hinting process won't stop until the
> next bitmap sync happens.

We have a function, stop(), to stop the optimization before the next 
bitmap sync if the optimization is still running. But I never saw that 
case happens (the free page hinting finishes itself before that).

Best,
Wei


---------------------------------------------------------------------
To unsubscribe, e-mail: virtio-dev-unsubscribe@lists.oasis-open.org
For additional commands, e-mail: virtio-dev-help@lists.oasis-open.org


WARNING: multiple messages have this Message-ID (diff)
From: Wei Wang <wei.w.wang@intel.com>
To: Peter Xu <peterx@redhat.com>
Cc: "Michael S. Tsirkin" <mst@redhat.com>,
	qemu-devel@nongnu.org, virtio-dev@lists.oasis-open.org,
	quintela@redhat.com, dgilbert@redhat.com, pbonzini@redhat.com,
	liliang.opensource@gmail.com, yang.zhang.wz@gmail.com,
	quan.xu0@gmail.com, nilal@redhat.com, riel@redhat.com,
	zhang.zhanghailiang@huawei.com
Subject: Re: [Qemu-devel] [PATCH v7 4/5] virtio-balloon: VIRTIO_BALLOON_F_FREE_PAGE_HINT
Date: Fri, 08 Jun 2018 15:14:38 +0800	[thread overview]
Message-ID: <5B1A2CDE.7000905@intel.com> (raw)
In-Reply-To: <20180608021758.GS750@xz-mi>

On 06/08/2018 10:17 AM, Peter Xu wrote:
> On Thu, Jun 07, 2018 at 07:59:22PM +0800, Wei Wang wrote:
>> Not necessarily _need_ to share it, I meant it can be shared using qemu
>> command line.
>> Live migration doesn't happen all the time, and that optimization doesn't
>> run that long, if users want to have other BHs run in this iothread context,
>> they can only create one iothread via the qemu cmd line.
> IMO iothreads and aiocontexts are for event-driven model.

To me it's just a thread which polls for submitted callbacks to run. 
When migration reaches the place that needs to submit the optimization 
function, it calls start() to submit it. I'm not sure why there is a 
worry about what's inside the callback.

> Busy loop
> is not an event-driven model.  Here if we want a busy loop I'll create
> a thread when start page hinting, then join the thread when done.

  The old (v4) implementation worked that way as you mentioned above, 
and Michael suggested to use iothread in the previous discussion. I'm 
fine with both actually. For the virtio part, we've had many 
discussions, I would take the choice I had with Michael before, unless 
there is an obvious advantage (e.g. proved better performance).


>
> But I'll stop commenting on this.  Please prepare a more clear
> interface for migration in your next post.  I'll read that.
>

Sure, thanks. The new version is coming soon.




>>
>>>>> I'm a bit curious on how much time will it use to do
>>>>> one round of the free page hints (e.g., an idle guest with 8G mem, or
>>>>> any configuration you tested)?  I suppose during that time the
>>>>> iothread will be held steady with 100% cpu usage, am I right?
>>>> Compared to the time spent by the legacy migration to send free pages, that
>>>> small amount of CPU usage spent on filtering free pages could be neglected.
>>>> Grinding a chopper will not hold up the work of cutting firewood :)
>>> Sorry I didn't express myself clearly.
>>>
>>> My question was that, have you measured how long time it will take
>>> from starting of the free page hints (when balloon state is set to
>>> FREE_PAGE_REPORT_S_REQUESTED), until it completes (when QEMU receives
>>> the VIRTIO_BALLOON_FREE_PAGE_REPORT_STOP_ID, then set the status to
>>> FREE_PAGE_REPORT_S_STOP)?
>>>
>> I vaguely remember it's several ms (for around 7.5G free pages) long time
>> ago. What would be the concern behind that number you want to know?
> Because roughly I know the time between two bitmap syncs.  Then I will
> know how possible a free page hinting process won't stop until the
> next bitmap sync happens.

We have a function, stop(), to stop the optimization before the next 
bitmap sync if the optimization is still running. But I never saw that 
case happens (the free page hinting finishes itself before that).

Best,
Wei

  reply	other threads:[~2018-06-08  7:11 UTC|newest]

Thread overview: 93+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2018-04-24  6:13 [virtio-dev] [PATCH v7 0/5] virtio-balloon: free page hint reporting support Wei Wang
2018-04-24  6:13 ` [Qemu-devel] " Wei Wang
2018-04-24  6:13 ` [virtio-dev] [PATCH v7 1/5] bitmap: bitmap_count_one_with_offset Wei Wang
2018-04-24  6:13   ` [Qemu-devel] " Wei Wang
2018-04-24  6:13 ` [virtio-dev] [PATCH v7 2/5] migration: use bitmap_mutex in migration_bitmap_clear_dirty Wei Wang
2018-04-24  6:13   ` [Qemu-devel] " Wei Wang
2018-06-01  3:37   ` Peter Xu
2018-04-24  6:13 ` [virtio-dev] [PATCH v7 3/5] migration: API to clear bits of guest free pages from the dirty bitmap Wei Wang
2018-04-24  6:13   ` [Qemu-devel] " Wei Wang
2018-06-01  4:00   ` Peter Xu
2018-06-01  7:36     ` [virtio-dev] " Wei Wang
2018-06-01  7:36       ` Wei Wang
2018-06-01 10:06       ` Peter Xu
2018-06-01 12:32         ` [virtio-dev] " Wei Wang
2018-06-01 12:32           ` Wei Wang
2018-06-04  2:49           ` Peter Xu
2018-06-04  7:43             ` [virtio-dev] " Wei Wang
2018-06-04  7:43               ` Wei Wang
2018-04-24  6:13 ` [virtio-dev] [PATCH v7 4/5] virtio-balloon: VIRTIO_BALLOON_F_FREE_PAGE_HINT Wei Wang
2018-04-24  6:13   ` [Qemu-devel] " Wei Wang
2018-05-29 15:24   ` [virtio-dev] " Michael S. Tsirkin
2018-05-29 15:24     ` [Qemu-devel] " Michael S. Tsirkin
2018-05-30  9:12     ` [virtio-dev] " Wei Wang
2018-05-30  9:12       ` [Qemu-devel] " Wei Wang
2018-05-30 12:47       ` [virtio-dev] " Michael S. Tsirkin
2018-05-30 12:47         ` [Qemu-devel] " Michael S. Tsirkin
2018-05-31  2:27         ` [virtio-dev] " Wei Wang
2018-05-31  2:27           ` [Qemu-devel] " Wei Wang
2018-05-31 17:42           ` [virtio-dev] " Michael S. Tsirkin
2018-05-31 17:42             ` [Qemu-devel] " Michael S. Tsirkin
2018-06-01  3:18             ` [virtio-dev] " Wei Wang
2018-06-01  3:18               ` [Qemu-devel] " Wei Wang
2018-06-04  8:04         ` [virtio-dev] " Wei Wang
2018-06-04  8:04           ` [Qemu-devel] " Wei Wang
2018-06-05  6:58           ` Peter Xu
2018-06-05 13:22             ` [virtio-dev] " Wei Wang
2018-06-05 13:22               ` [Qemu-devel] " Wei Wang
2018-06-06  5:42               ` Peter Xu
2018-06-06 10:04                 ` [virtio-dev] " Wei Wang
2018-06-06 10:04                   ` [Qemu-devel] " Wei Wang
2018-06-06 11:02                   ` Peter Xu
2018-06-07  5:24                     ` [virtio-dev] " Wei Wang
2018-06-07  5:24                       ` [Qemu-devel] " Wei Wang
2018-06-07  6:32                       ` Peter Xu
2018-06-07 11:59                         ` [virtio-dev] " Wei Wang
2018-06-07 11:59                           ` [Qemu-devel] " Wei Wang
2018-06-08  2:17                           ` Peter Xu
2018-06-08  7:14                             ` Wei Wang [this message]
2018-06-08  7:14                               ` Wei Wang
2018-06-08  7:31                         ` [virtio-dev] " Wei Wang
2018-06-08  7:31                           ` [Qemu-devel] " Wei Wang
2018-06-06  6:43   ` Peter Xu
2018-06-06 10:11     ` [virtio-dev] " Wei Wang
2018-06-06 10:11       ` Wei Wang
2018-06-07  3:17       ` Peter Xu
2018-06-07  5:29         ` [virtio-dev] " Wei Wang
2018-06-07  5:29           ` Wei Wang
2018-06-07  6:58           ` Peter Xu
2018-06-07 12:01             ` [virtio-dev] " Wei Wang
2018-06-07 12:01               ` Wei Wang
2018-06-08  1:37               ` Peter Xu
2018-06-08  1:58                 ` Peter Xu
2018-06-08  1:58                 ` [virtio-dev] " Michael S. Tsirkin
2018-06-08  1:58                   ` Michael S. Tsirkin
2018-06-08  2:34                   ` Peter Xu
2018-06-08  2:49                     ` [virtio-dev] " Michael S. Tsirkin
2018-06-08  2:49                       ` Michael S. Tsirkin
2018-06-08  3:34                       ` Peter Xu
2018-04-24  6:13 ` [virtio-dev] [PATCH v7 5/5] migration: use the free page hint feature from balloon Wei Wang
2018-04-24  6:13   ` [Qemu-devel] " Wei Wang
2018-04-24  6:42 ` [virtio-dev] Re: [PATCH v7 0/5] virtio-balloon: free page hint reporting support Wei Wang
2018-04-24  6:42   ` [Qemu-devel] " Wei Wang
2018-05-14  1:22 ` [virtio-dev] " Wei Wang
2018-05-14  1:22   ` [Qemu-devel] " Wei Wang
2018-05-29 15:00 ` Hailiang Zhang
2018-05-29 15:24   ` [virtio-dev] " Michael S. Tsirkin
2018-05-29 15:24     ` Michael S. Tsirkin
2018-06-01  4:58 ` Peter Xu
2018-06-01  5:07   ` Peter Xu
2018-06-01  7:29     ` [virtio-dev] " Wei Wang
2018-06-01  7:29       ` Wei Wang
2018-06-01 10:02       ` Peter Xu
2018-06-01 12:31         ` [virtio-dev] " Wei Wang
2018-06-01 12:31           ` Wei Wang
2018-06-01  7:21   ` [virtio-dev] " Wei Wang
2018-06-01  7:21     ` Wei Wang
2018-06-01 10:40     ` Peter Xu
2018-06-01 15:33       ` Dr. David Alan Gilbert
2018-06-05  6:42         ` Peter Xu
2018-06-05 14:40           ` [virtio-dev] " Michael S. Tsirkin
2018-06-05 14:40             ` Michael S. Tsirkin
2018-06-05 14:39         ` [virtio-dev] " Michael S. Tsirkin
2018-06-05 14:39           ` Michael S. Tsirkin

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=5B1A2CDE.7000905@intel.com \
    --to=wei.w.wang@intel.com \
    --cc=dgilbert@redhat.com \
    --cc=liliang.opensource@gmail.com \
    --cc=mst@redhat.com \
    --cc=nilal@redhat.com \
    --cc=pbonzini@redhat.com \
    --cc=peterx@redhat.com \
    --cc=qemu-devel@nongnu.org \
    --cc=quan.xu0@gmail.com \
    --cc=quintela@redhat.com \
    --cc=riel@redhat.com \
    --cc=virtio-dev@lists.oasis-open.org \
    --cc=yang.zhang.wz@gmail.com \
    --cc=zhang.zhanghailiang@huawei.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.