From: "Michael S. Tsirkin" <mst@redhat.com>
To: Liang Li <liang.z.li@intel.com>
Cc: linux-kernel@vger.kernel.org,
virtualization@lists.linux-foundation.org, kvm@vger.kernel.org,
qemu-devel@nongnu.org, virtio-dev@lists.oasis-open.org,
dgilbert@redhat.com, quintela@redhat.com, linux-mm@kvack.org
Subject: Re: [PATCH v2 kernel 0/7] Extend virtio-balloon for fast (de)inflating & fast live migration
Date: Tue, 26 Jul 2016 21:55:13 +0300 [thread overview]
Message-ID: <20160726215256-mutt-send-email-mst@kernel.org> (raw)
In-Reply-To: <1467196340-22079-1-git-send-email-liang.z.li@intel.com>
On Wed, Jun 29, 2016 at 06:32:13PM +0800, Liang Li wrote:
> This patch set contains two parts of changes to the virtio-balloon.
>
> One is the change for speeding up the inflating & deflating process,
> the main idea of this optimization is to use bitmap to send the page
> information to host instead of the PFNs, to reduce the overhead of
> virtio data transmission, address translation and madvise(). This can
> help to improve the performance by about 85%.
>
> Another change is for speeding up live migration. By skipping process
> guest's free pages in the first round of data copy, to reduce needless
> data processing, this can help to save quite a lot of CPU cycles and
> network bandwidth. We put guest's free page information in bitmap and
> send it to host with the virt queue of virtio-balloon. For an idle 8GB
> guest, this can help to shorten the total live migration time from 2Sec
> to about 500ms in the 10Gbps network environment.
So I'm fine with this patchset, but I noticed it was not
yet reviewed by MM people. And that is not surprising since
you did not copy memory management mailing list on it.
I added linux-mm@kvack.org Cc on this mail but this might not be enough.
Please repost (e.g. [PATCH v2 repost]) copying the relevant mailing list
so we can get some reviews.
>
> Changes from v1 to v2:
> * Abandon the patch for dropping page cache.
> * Put some structures to uapi head file.
> * Use a new way to determine the page bitmap size.
> * Use a unified way to send the free page information with the bitmap
> * Address the issues referred in MST's comments
>
> Liang Li (7):
> virtio-balloon: rework deflate to add page to a list
> virtio-balloon: define new feature bit and page bitmap head
> mm: add a function to get the max pfn
> virtio-balloon: speed up inflate/deflate process
> virtio-balloon: define feature bit and head for misc virt queue
> mm: add the related functions to get free page info
> virtio-balloon: tell host vm's free page info
>
> drivers/virtio/virtio_balloon.c | 306 +++++++++++++++++++++++++++++++-----
> include/uapi/linux/virtio_balloon.h | 41 +++++
> mm/page_alloc.c | 52 ++++++
> 3 files changed, 359 insertions(+), 40 deletions(-)
>
> --
> 1.8.3.1
WARNING: multiple messages have this Message-ID (diff)
From: "Michael S. Tsirkin" <mst@redhat.com>
To: Liang Li <liang.z.li@intel.com>
Cc: linux-kernel@vger.kernel.org,
virtualization@lists.linux-foundation.org, kvm@vger.kernel.org,
qemu-devel@nongnu.org, virtio-dev@lists.oasis-open.org,
dgilbert@redhat.com, quintela@redhat.com, linux-mm@kvack.org
Subject: Re: [PATCH v2 kernel 0/7] Extend virtio-balloon for fast (de)inflating & fast live migration
Date: Tue, 26 Jul 2016 21:55:13 +0300 [thread overview]
Message-ID: <20160726215256-mutt-send-email-mst@kernel.org> (raw)
In-Reply-To: <1467196340-22079-1-git-send-email-liang.z.li@intel.com>
On Wed, Jun 29, 2016 at 06:32:13PM +0800, Liang Li wrote:
> This patch set contains two parts of changes to the virtio-balloon.
>
> One is the change for speeding up the inflating & deflating process,
> the main idea of this optimization is to use bitmap to send the page
> information to host instead of the PFNs, to reduce the overhead of
> virtio data transmission, address translation and madvise(). This can
> help to improve the performance by about 85%.
>
> Another change is for speeding up live migration. By skipping process
> guest's free pages in the first round of data copy, to reduce needless
> data processing, this can help to save quite a lot of CPU cycles and
> network bandwidth. We put guest's free page information in bitmap and
> send it to host with the virt queue of virtio-balloon. For an idle 8GB
> guest, this can help to shorten the total live migration time from 2Sec
> to about 500ms in the 10Gbps network environment.
So I'm fine with this patchset, but I noticed it was not
yet reviewed by MM people. And that is not surprising since
you did not copy memory management mailing list on it.
I added linux-mm@kvack.org Cc on this mail but this might not be enough.
Please repost (e.g. [PATCH v2 repost]) copying the relevant mailing list
so we can get some reviews.
>
> Changes from v1 to v2:
> * Abandon the patch for dropping page cache.
> * Put some structures to uapi head file.
> * Use a new way to determine the page bitmap size.
> * Use a unified way to send the free page information with the bitmap
> * Address the issues referred in MST's comments
>
> Liang Li (7):
> virtio-balloon: rework deflate to add page to a list
> virtio-balloon: define new feature bit and page bitmap head
> mm: add a function to get the max pfn
> virtio-balloon: speed up inflate/deflate process
> virtio-balloon: define feature bit and head for misc virt queue
> mm: add the related functions to get free page info
> virtio-balloon: tell host vm's free page info
>
> drivers/virtio/virtio_balloon.c | 306 +++++++++++++++++++++++++++++++-----
> include/uapi/linux/virtio_balloon.h | 41 +++++
> mm/page_alloc.c | 52 ++++++
> 3 files changed, 359 insertions(+), 40 deletions(-)
>
> --
> 1.8.3.1
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
WARNING: multiple messages have this Message-ID (diff)
From: "Michael S. Tsirkin" <mst@redhat.com>
To: Liang Li <liang.z.li@intel.com>
Cc: linux-kernel@vger.kernel.org,
virtualization@lists.linux-foundation.org, kvm@vger.kernel.org,
qemu-devel@nongnu.org, virtio-dev@lists.oasis-open.org,
dgilbert@redhat.com, quintela@redhat.com, linux-mm@kvack.org
Subject: Re: [Qemu-devel] [PATCH v2 kernel 0/7] Extend virtio-balloon for fast (de)inflating & fast live migration
Date: Tue, 26 Jul 2016 21:55:13 +0300 [thread overview]
Message-ID: <20160726215256-mutt-send-email-mst@kernel.org> (raw)
In-Reply-To: <1467196340-22079-1-git-send-email-liang.z.li@intel.com>
On Wed, Jun 29, 2016 at 06:32:13PM +0800, Liang Li wrote:
> This patch set contains two parts of changes to the virtio-balloon.
>
> One is the change for speeding up the inflating & deflating process,
> the main idea of this optimization is to use bitmap to send the page
> information to host instead of the PFNs, to reduce the overhead of
> virtio data transmission, address translation and madvise(). This can
> help to improve the performance by about 85%.
>
> Another change is for speeding up live migration. By skipping process
> guest's free pages in the first round of data copy, to reduce needless
> data processing, this can help to save quite a lot of CPU cycles and
> network bandwidth. We put guest's free page information in bitmap and
> send it to host with the virt queue of virtio-balloon. For an idle 8GB
> guest, this can help to shorten the total live migration time from 2Sec
> to about 500ms in the 10Gbps network environment.
So I'm fine with this patchset, but I noticed it was not
yet reviewed by MM people. And that is not surprising since
you did not copy memory management mailing list on it.
I added linux-mm@kvack.org Cc on this mail but this might not be enough.
Please repost (e.g. [PATCH v2 repost]) copying the relevant mailing list
so we can get some reviews.
>
> Changes from v1 to v2:
> * Abandon the patch for dropping page cache.
> * Put some structures to uapi head file.
> * Use a new way to determine the page bitmap size.
> * Use a unified way to send the free page information with the bitmap
> * Address the issues referred in MST's comments
>
> Liang Li (7):
> virtio-balloon: rework deflate to add page to a list
> virtio-balloon: define new feature bit and page bitmap head
> mm: add a function to get the max pfn
> virtio-balloon: speed up inflate/deflate process
> virtio-balloon: define feature bit and head for misc virt queue
> mm: add the related functions to get free page info
> virtio-balloon: tell host vm's free page info
>
> drivers/virtio/virtio_balloon.c | 306 +++++++++++++++++++++++++++++++-----
> include/uapi/linux/virtio_balloon.h | 41 +++++
> mm/page_alloc.c | 52 ++++++
> 3 files changed, 359 insertions(+), 40 deletions(-)
>
> --
> 1.8.3.1
next prev parent reply other threads:[~2016-07-26 18:55 UTC|newest]
Thread overview: 39+ messages / expand[flat|nested] mbox.gz Atom feed top
2016-06-29 10:32 [PATCH v2 kernel 0/7] Extend virtio-balloon for fast (de)inflating & fast live migration Liang Li
2016-06-29 10:32 ` [Qemu-devel] " Liang Li
2016-06-29 10:32 ` Liang Li
2016-06-29 10:32 ` [PATCH v2 kernel 1/7] virtio-balloon: rework deflate to add page to a list Liang Li
2016-06-29 10:32 ` [Qemu-devel] " Liang Li
2016-06-29 10:32 ` Liang Li
2016-06-29 10:32 ` [PATCH v2 kernel 2/7] virtio-balloon: define new feature bit and page bitmap head Liang Li
2016-06-29 10:32 ` [Qemu-devel] " Liang Li
2016-06-29 10:32 ` Liang Li
2016-06-29 10:32 ` [PATCH v2 kernel 3/7] mm: add a function to get the max pfn Liang Li
2016-06-29 10:32 ` Liang Li
2016-06-29 10:32 ` [Qemu-devel] " Liang Li
2016-06-29 10:32 ` [PATCH v2 kernel 4/7] virtio-balloon: speed up inflate/deflate process Liang Li
2016-06-29 10:32 ` [Qemu-devel] " Liang Li
2016-06-29 10:32 ` Liang Li
2016-06-29 10:32 ` [PATCH v2 kernel 5/7] virtio-balloon: define feature bit and head for misc virt queue Liang Li
2016-06-29 10:32 ` Liang Li
2016-06-29 10:32 ` [Qemu-devel] " Liang Li
2016-06-29 10:32 ` [PATCH v2 kernel 6/7] mm: add the related functions to get free page info Liang Li
2016-06-29 10:32 ` [Qemu-devel] " Liang Li
2016-06-29 10:32 ` Liang Li
2016-06-29 10:32 ` [PATCH v2 kernel 7/7] virtio-balloon: tell host vm's " Liang Li
2016-06-29 10:32 ` [Qemu-devel] " Liang Li
2016-06-29 10:32 ` Liang Li
2016-07-06 0:43 ` [PATCH v2 kernel 0/7] Extend virtio-balloon for fast (de)inflating & fast live migration Li, Liang Z
2016-07-06 0:43 ` [Qemu-devel] " Li, Liang Z
2016-07-06 0:43 ` Li, Liang Z
2016-07-21 8:14 ` Li, Liang Z
2016-07-21 8:14 ` [Qemu-devel] " Li, Liang Z
2016-07-21 8:14 ` Li, Liang Z
2016-07-26 18:55 ` Michael S. Tsirkin
2016-07-26 18:55 ` Michael S. Tsirkin [this message]
2016-07-26 18:55 ` [Qemu-devel] " Michael S. Tsirkin
2016-07-26 18:55 ` Michael S. Tsirkin
2016-07-27 1:32 ` [virtio-dev] " Li, Liang Z
2016-07-27 1:32 ` Li, Liang Z
2016-07-27 1:32 ` [Qemu-devel] [virtio-dev] " Li, Liang Z
2016-07-27 1:32 ` Li, Liang Z
2016-07-27 1:32 ` Li, Liang Z
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20160726215256-mutt-send-email-mst@kernel.org \
--to=mst@redhat.com \
--cc=dgilbert@redhat.com \
--cc=kvm@vger.kernel.org \
--cc=liang.z.li@intel.com \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=qemu-devel@nongnu.org \
--cc=quintela@redhat.com \
--cc=virtio-dev@lists.oasis-open.org \
--cc=virtualization@lists.linux-foundation.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.