From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: virtio-dev-return-2810-cohuck=redhat.com@lists.oasis-open.org Sender: List-Post: List-Help: List-Unsubscribe: List-Subscribe: Received: from lists.oasis-open.org (oasis-open.org [66.179.20.138]) by lists.oasis-open.org (Postfix) with ESMTP id ADAC05818C6E for ; Tue, 12 Dec 2017 04:19:39 -0800 (PST) Message-ID: <5A2FC9CB.7030508@intel.com> Date: Tue, 12 Dec 2017 20:21:31 +0800 From: Wei Wang MIME-Version: 1.0 References: <1511963726-34070-1-git-send-email-wei.w.wang@intel.com> <1511963726-34070-11-git-send-email-wei.w.wang@intel.com> <20171201173951-mutt-send-email-mst@kernel.org> <5A2E27F5.2010703@intel.com> <20171211152258-mutt-send-email-mst@kernel.org> In-Reply-To: <20171211152258-mutt-send-email-mst@kernel.org> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit Subject: [virtio-dev] Re: [PATCH v18 10/10] virtio-balloon: don't report free pages when page poisoning is enabled To: "Michael S. Tsirkin" Cc: virtio-dev@lists.oasis-open.org, linux-kernel@vger.kernel.org, qemu-devel@nongnu.org, virtualization@lists.linux-foundation.org, kvm@vger.kernel.org, linux-mm@kvack.org, mhocko@kernel.org, akpm@linux-foundation.org, mawilcox@microsoft.com, david@redhat.com, penguin-kernel@I-love.SAKURA.ne.jp, cornelia.huck@de.ibm.com, mgorman@techsingularity.net, aarcange@redhat.com, amit.shah@redhat.com, pbonzini@redhat.com, willy@infradead.org, liliang.opensource@gmail.com, yang.zhang.wz@gmail.com, quan.xu@aliyun.com, nilal@redhat.com, riel@redhat.com List-ID: On 12/11/2017 09:24 PM, Michael S. Tsirkin wrote: > On Mon, Dec 11, 2017 at 02:38:45PM +0800, Wei Wang wrote: >> On 12/01/2017 11:49 PM, Michael S. Tsirkin wrote: >>> On Wed, Nov 29, 2017 at 09:55:26PM +0800, Wei Wang wrote: >>>> The guest free pages should not be discarded by the live migration thread >>>> when page poisoning is enabled with PAGE_POISONING_NO_SANITY=n, because >>>> skipping the transfer of such poisoned free pages will trigger false >>>> positive when new pages are allocated and checked on the destination. >>>> This patch skips the reporting of free pages in the above case. >>>> >>>> Reported-by: Michael S. Tsirkin >>>> Signed-off-by: Wei Wang >>>> Cc: Michal Hocko >>>> --- >>>> drivers/virtio/virtio_balloon.c | 4 +++- >>>> 1 file changed, 3 insertions(+), 1 deletion(-) >>>> >>>> diff --git a/drivers/virtio/virtio_balloon.c b/drivers/virtio/virtio_balloon.c >>>> index 035bd3a..6ac4cff 100644 >>>> --- a/drivers/virtio/virtio_balloon.c >>>> +++ b/drivers/virtio/virtio_balloon.c >>>> @@ -652,7 +652,9 @@ static void report_free_page(struct work_struct *work) >>>> /* Start by sending the obtained cmd id to the host with an outbuf */ >>>> send_one_desc(vb, vb->free_page_vq, virt_to_phys(&vb->start_cmd_id), >>>> sizeof(uint32_t), false, true, false); >>>> - walk_free_mem_block(vb, 0, &virtio_balloon_send_free_pages); >>>> + if (!(page_poisoning_enabled() && >>>> + !IS_ENABLED(CONFIG_PAGE_POISONING_NO_SANITY))) >>>> + walk_free_mem_block(vb, 0, &virtio_balloon_send_free_pages); >>>> /* >>>> * End by sending the stop id to the host with an outbuf. Use the >>>> * non-batching mode here to trigger a kick after adding the stop id. >>> PAGE_POISONING_ZERO is actually OK. >>> >>> But I really would prefer it that we still send pages to host, >>> otherwise debugging becomes much harder. >>> >>> And it does not have to be completely useless, even though >>> you can not discard them as they would be zero-filled then. >>> >>> How about a config field telling host what should be there in the free >>> pages? This way even though host can not discard them, host can send >>> them out without reading them, still a win. >>> >>> >> Since this poison value comes with the free page reporting feature, how >> about sending the poison value via the free_page_vq, along with the cmd id >> in the outbuf? That is, use the following interface: >> >> struct virtio_balloon_free_page_vq_hdr { >> bool page_poisoning; >> __virtio32 poison_value; >> __virtio32 cmd_id; >> } > Can we put the value in config space instead? > >> We need "bool page_poisoning" because "poison_value=0" doesn't tell whether >> page poising is in use by the guest. > Can we use a feature bit for this? > >> PAGE_POISONING_ZERO sets >> "page_poisoning=true, poisoning_value=0", and the host will send the >> 0-filled pages to the destination (if not sending 0-filled pages, the >> destination host would offer non-zero pages to the guest) > Why would it? Linux zeroes all pages on alloc. > Thanks, that is the case. I think we don't need a feature bit then. Please have a check the v19 patches. Best, Wei --------------------------------------------------------------------- To unsubscribe, e-mail: virtio-dev-unsubscribe@lists.oasis-open.org For additional commands, e-mail: virtio-dev-help@lists.oasis-open.org From mboxrd@z Thu Jan 1 00:00:00 1970 From: Wei Wang Subject: Re: [PATCH v18 10/10] virtio-balloon: don't report free pages when page poisoning is enabled Date: Tue, 12 Dec 2017 20:21:31 +0800 Message-ID: <5A2FC9CB.7030508@intel.com> References: <1511963726-34070-1-git-send-email-wei.w.wang@intel.com> <1511963726-34070-11-git-send-email-wei.w.wang@intel.com> <20171201173951-mutt-send-email-mst@kernel.org> <5A2E27F5.2010703@intel.com> <20171211152258-mutt-send-email-mst@kernel.org> Mime-Version: 1.0 Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit Cc: virtio-dev@lists.oasis-open.org, linux-kernel@vger.kernel.org, qemu-devel@nongnu.org, virtualization@lists.linux-foundation.org, kvm@vger.kernel.org, linux-mm@kvack.org, mhocko@kernel.org, akpm@linux-foundation.org, mawilcox@microsoft.com, david@redhat.com, penguin-kernel@I-love.SAKURA.ne.jp, cornelia.huck@de.ibm.com, mgorman@techsingularity.net, aarcange@redhat.com, amit.shah@redhat.com, pbonzini@redhat.com, willy@infradead.org, liliang.opensource@gmail.com, yang.zhang.wz@gmail.com, quan.xu@aliyun.com, nilal@redhat.com, riel@redhat.com To: "Michael S. Tsirkin" Return-path: In-Reply-To: <20171211152258-mutt-send-email-mst@kernel.org> Sender: owner-linux-mm@kvack.org List-Id: kvm.vger.kernel.org On 12/11/2017 09:24 PM, Michael S. Tsirkin wrote: > On Mon, Dec 11, 2017 at 02:38:45PM +0800, Wei Wang wrote: >> On 12/01/2017 11:49 PM, Michael S. Tsirkin wrote: >>> On Wed, Nov 29, 2017 at 09:55:26PM +0800, Wei Wang wrote: >>>> The guest free pages should not be discarded by the live migration thread >>>> when page poisoning is enabled with PAGE_POISONING_NO_SANITY=n, because >>>> skipping the transfer of such poisoned free pages will trigger false >>>> positive when new pages are allocated and checked on the destination. >>>> This patch skips the reporting of free pages in the above case. >>>> >>>> Reported-by: Michael S. Tsirkin >>>> Signed-off-by: Wei Wang >>>> Cc: Michal Hocko >>>> --- >>>> drivers/virtio/virtio_balloon.c | 4 +++- >>>> 1 file changed, 3 insertions(+), 1 deletion(-) >>>> >>>> diff --git a/drivers/virtio/virtio_balloon.c b/drivers/virtio/virtio_balloon.c >>>> index 035bd3a..6ac4cff 100644 >>>> --- a/drivers/virtio/virtio_balloon.c >>>> +++ b/drivers/virtio/virtio_balloon.c >>>> @@ -652,7 +652,9 @@ static void report_free_page(struct work_struct *work) >>>> /* Start by sending the obtained cmd id to the host with an outbuf */ >>>> send_one_desc(vb, vb->free_page_vq, virt_to_phys(&vb->start_cmd_id), >>>> sizeof(uint32_t), false, true, false); >>>> - walk_free_mem_block(vb, 0, &virtio_balloon_send_free_pages); >>>> + if (!(page_poisoning_enabled() && >>>> + !IS_ENABLED(CONFIG_PAGE_POISONING_NO_SANITY))) >>>> + walk_free_mem_block(vb, 0, &virtio_balloon_send_free_pages); >>>> /* >>>> * End by sending the stop id to the host with an outbuf. Use the >>>> * non-batching mode here to trigger a kick after adding the stop id. >>> PAGE_POISONING_ZERO is actually OK. >>> >>> But I really would prefer it that we still send pages to host, >>> otherwise debugging becomes much harder. >>> >>> And it does not have to be completely useless, even though >>> you can not discard them as they would be zero-filled then. >>> >>> How about a config field telling host what should be there in the free >>> pages? This way even though host can not discard them, host can send >>> them out without reading them, still a win. >>> >>> >> Since this poison value comes with the free page reporting feature, how >> about sending the poison value via the free_page_vq, along with the cmd id >> in the outbuf? That is, use the following interface: >> >> struct virtio_balloon_free_page_vq_hdr { >> bool page_poisoning; >> __virtio32 poison_value; >> __virtio32 cmd_id; >> } > Can we put the value in config space instead? > >> We need "bool page_poisoning" because "poison_value=0" doesn't tell whether >> page poising is in use by the guest. > Can we use a feature bit for this? > >> PAGE_POISONING_ZERO sets >> "page_poisoning=true, poisoning_value=0", and the host will send the >> 0-filled pages to the destination (if not sending 0-filled pages, the >> destination host would offer non-zero pages to the guest) > Why would it? Linux zeroes all pages on alloc. > Thanks, that is the case. I think we don't need a feature bit then. Please have a check the v19 patches. Best, Wei -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to majordomo@kvack.org. For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: email@kvack.org From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1752553AbdLLMTd (ORCPT ); Tue, 12 Dec 2017 07:19:33 -0500 Received: from mga18.intel.com ([134.134.136.126]:10756 "EHLO mga18.intel.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751678AbdLLMT3 (ORCPT ); Tue, 12 Dec 2017 07:19:29 -0500 X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.45,395,1508828400"; d="scan'208";a="875376" Message-ID: <5A2FC9CB.7030508@intel.com> Date: Tue, 12 Dec 2017 20:21:31 +0800 From: Wei Wang User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.7.0 MIME-Version: 1.0 To: "Michael S. Tsirkin" CC: virtio-dev@lists.oasis-open.org, linux-kernel@vger.kernel.org, qemu-devel@nongnu.org, virtualization@lists.linux-foundation.org, kvm@vger.kernel.org, linux-mm@kvack.org, mhocko@kernel.org, akpm@linux-foundation.org, mawilcox@microsoft.com, david@redhat.com, penguin-kernel@I-love.SAKURA.ne.jp, cornelia.huck@de.ibm.com, mgorman@techsingularity.net, aarcange@redhat.com, amit.shah@redhat.com, pbonzini@redhat.com, willy@infradead.org, liliang.opensource@gmail.com, yang.zhang.wz@gmail.com, quan.xu@aliyun.com, nilal@redhat.com, riel@redhat.com Subject: Re: [PATCH v18 10/10] virtio-balloon: don't report free pages when page poisoning is enabled References: <1511963726-34070-1-git-send-email-wei.w.wang@intel.com> <1511963726-34070-11-git-send-email-wei.w.wang@intel.com> <20171201173951-mutt-send-email-mst@kernel.org> <5A2E27F5.2010703@intel.com> <20171211152258-mutt-send-email-mst@kernel.org> In-Reply-To: <20171211152258-mutt-send-email-mst@kernel.org> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 12/11/2017 09:24 PM, Michael S. Tsirkin wrote: > On Mon, Dec 11, 2017 at 02:38:45PM +0800, Wei Wang wrote: >> On 12/01/2017 11:49 PM, Michael S. Tsirkin wrote: >>> On Wed, Nov 29, 2017 at 09:55:26PM +0800, Wei Wang wrote: >>>> The guest free pages should not be discarded by the live migration thread >>>> when page poisoning is enabled with PAGE_POISONING_NO_SANITY=n, because >>>> skipping the transfer of such poisoned free pages will trigger false >>>> positive when new pages are allocated and checked on the destination. >>>> This patch skips the reporting of free pages in the above case. >>>> >>>> Reported-by: Michael S. Tsirkin >>>> Signed-off-by: Wei Wang >>>> Cc: Michal Hocko >>>> --- >>>> drivers/virtio/virtio_balloon.c | 4 +++- >>>> 1 file changed, 3 insertions(+), 1 deletion(-) >>>> >>>> diff --git a/drivers/virtio/virtio_balloon.c b/drivers/virtio/virtio_balloon.c >>>> index 035bd3a..6ac4cff 100644 >>>> --- a/drivers/virtio/virtio_balloon.c >>>> +++ b/drivers/virtio/virtio_balloon.c >>>> @@ -652,7 +652,9 @@ static void report_free_page(struct work_struct *work) >>>> /* Start by sending the obtained cmd id to the host with an outbuf */ >>>> send_one_desc(vb, vb->free_page_vq, virt_to_phys(&vb->start_cmd_id), >>>> sizeof(uint32_t), false, true, false); >>>> - walk_free_mem_block(vb, 0, &virtio_balloon_send_free_pages); >>>> + if (!(page_poisoning_enabled() && >>>> + !IS_ENABLED(CONFIG_PAGE_POISONING_NO_SANITY))) >>>> + walk_free_mem_block(vb, 0, &virtio_balloon_send_free_pages); >>>> /* >>>> * End by sending the stop id to the host with an outbuf. Use the >>>> * non-batching mode here to trigger a kick after adding the stop id. >>> PAGE_POISONING_ZERO is actually OK. >>> >>> But I really would prefer it that we still send pages to host, >>> otherwise debugging becomes much harder. >>> >>> And it does not have to be completely useless, even though >>> you can not discard them as they would be zero-filled then. >>> >>> How about a config field telling host what should be there in the free >>> pages? This way even though host can not discard them, host can send >>> them out without reading them, still a win. >>> >>> >> Since this poison value comes with the free page reporting feature, how >> about sending the poison value via the free_page_vq, along with the cmd id >> in the outbuf? That is, use the following interface: >> >> struct virtio_balloon_free_page_vq_hdr { >> bool page_poisoning; >> __virtio32 poison_value; >> __virtio32 cmd_id; >> } > Can we put the value in config space instead? > >> We need "bool page_poisoning" because "poison_value=0" doesn't tell whether >> page poising is in use by the guest. > Can we use a feature bit for this? > >> PAGE_POISONING_ZERO sets >> "page_poisoning=true, poisoning_value=0", and the host will send the >> 0-filled pages to the destination (if not sending 0-filled pages, the >> destination host would offer non-zero pages to the guest) > Why would it? Linux zeroes all pages on alloc. > Thanks, that is the case. I think we don't need a feature bit then. Please have a check the v19 patches. Best, Wei From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:4830:134:3::10]:59831) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1eOjX5-0005ny-13 for qemu-devel@nongnu.org; Tue, 12 Dec 2017 07:19:36 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1eOjX0-00029K-OA for qemu-devel@nongnu.org; Tue, 12 Dec 2017 07:19:35 -0500 Received: from mga02.intel.com ([134.134.136.20]:53574) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1eOjX0-00028o-Du for qemu-devel@nongnu.org; Tue, 12 Dec 2017 07:19:30 -0500 Message-ID: <5A2FC9CB.7030508@intel.com> Date: Tue, 12 Dec 2017 20:21:31 +0800 From: Wei Wang MIME-Version: 1.0 References: <1511963726-34070-1-git-send-email-wei.w.wang@intel.com> <1511963726-34070-11-git-send-email-wei.w.wang@intel.com> <20171201173951-mutt-send-email-mst@kernel.org> <5A2E27F5.2010703@intel.com> <20171211152258-mutt-send-email-mst@kernel.org> In-Reply-To: <20171211152258-mutt-send-email-mst@kernel.org> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit Subject: Re: [Qemu-devel] [PATCH v18 10/10] virtio-balloon: don't report free pages when page poisoning is enabled List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: "Michael S. Tsirkin" Cc: virtio-dev@lists.oasis-open.org, linux-kernel@vger.kernel.org, qemu-devel@nongnu.org, virtualization@lists.linux-foundation.org, kvm@vger.kernel.org, linux-mm@kvack.org, mhocko@kernel.org, akpm@linux-foundation.org, mawilcox@microsoft.com, david@redhat.com, penguin-kernel@I-love.SAKURA.ne.jp, cornelia.huck@de.ibm.com, mgorman@techsingularity.net, aarcange@redhat.com, amit.shah@redhat.com, pbonzini@redhat.com, willy@infradead.org, liliang.opensource@gmail.com, yang.zhang.wz@gmail.com, quan.xu@aliyun.com, nilal@redhat.com, riel@redhat.com On 12/11/2017 09:24 PM, Michael S. Tsirkin wrote: > On Mon, Dec 11, 2017 at 02:38:45PM +0800, Wei Wang wrote: >> On 12/01/2017 11:49 PM, Michael S. Tsirkin wrote: >>> On Wed, Nov 29, 2017 at 09:55:26PM +0800, Wei Wang wrote: >>>> The guest free pages should not be discarded by the live migration thread >>>> when page poisoning is enabled with PAGE_POISONING_NO_SANITY=n, because >>>> skipping the transfer of such poisoned free pages will trigger false >>>> positive when new pages are allocated and checked on the destination. >>>> This patch skips the reporting of free pages in the above case. >>>> >>>> Reported-by: Michael S. Tsirkin >>>> Signed-off-by: Wei Wang >>>> Cc: Michal Hocko >>>> --- >>>> drivers/virtio/virtio_balloon.c | 4 +++- >>>> 1 file changed, 3 insertions(+), 1 deletion(-) >>>> >>>> diff --git a/drivers/virtio/virtio_balloon.c b/drivers/virtio/virtio_balloon.c >>>> index 035bd3a..6ac4cff 100644 >>>> --- a/drivers/virtio/virtio_balloon.c >>>> +++ b/drivers/virtio/virtio_balloon.c >>>> @@ -652,7 +652,9 @@ static void report_free_page(struct work_struct *work) >>>> /* Start by sending the obtained cmd id to the host with an outbuf */ >>>> send_one_desc(vb, vb->free_page_vq, virt_to_phys(&vb->start_cmd_id), >>>> sizeof(uint32_t), false, true, false); >>>> - walk_free_mem_block(vb, 0, &virtio_balloon_send_free_pages); >>>> + if (!(page_poisoning_enabled() && >>>> + !IS_ENABLED(CONFIG_PAGE_POISONING_NO_SANITY))) >>>> + walk_free_mem_block(vb, 0, &virtio_balloon_send_free_pages); >>>> /* >>>> * End by sending the stop id to the host with an outbuf. Use the >>>> * non-batching mode here to trigger a kick after adding the stop id. >>> PAGE_POISONING_ZERO is actually OK. >>> >>> But I really would prefer it that we still send pages to host, >>> otherwise debugging becomes much harder. >>> >>> And it does not have to be completely useless, even though >>> you can not discard them as they would be zero-filled then. >>> >>> How about a config field telling host what should be there in the free >>> pages? This way even though host can not discard them, host can send >>> them out without reading them, still a win. >>> >>> >> Since this poison value comes with the free page reporting feature, how >> about sending the poison value via the free_page_vq, along with the cmd id >> in the outbuf? That is, use the following interface: >> >> struct virtio_balloon_free_page_vq_hdr { >> bool page_poisoning; >> __virtio32 poison_value; >> __virtio32 cmd_id; >> } > Can we put the value in config space instead? > >> We need "bool page_poisoning" because "poison_value=0" doesn't tell whether >> page poising is in use by the guest. > Can we use a feature bit for this? > >> PAGE_POISONING_ZERO sets >> "page_poisoning=true, poisoning_value=0", and the host will send the >> 0-filled pages to the destination (if not sending 0-filled pages, the >> destination host would offer non-zero pages to the guest) > Why would it? Linux zeroes all pages on alloc. > Thanks, that is the case. I think we don't need a feature bit then. Please have a check the v19 patches. Best, Wei