All of lore.kernel.org
 help / color / mirror / Atom feed
From: "Michael S. Tsirkin" <mst@redhat.com>
To: Rafael Aquini <aquini@redhat.com>
Cc: "Paul E. McKenney" <paulmck@linux.vnet.ibm.com>,
	Peter Zijlstra <peterz@infradead.org>,
	linux-mm@kvack.org, linux-kernel@vger.kernel.org,
	virtualization@lists.linux-foundation.org,
	Rusty Russell <rusty@rustcorp.com.au>,
	Rik van Riel <riel@redhat.com>, Mel Gorman <mel@csn.ul.ie>,
	Andi Kleen <andi@firstfloor.org>,
	Andrew Morton <akpm@linux-foundation.org>,
	Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>,
	Minchan Kim <minchan@kernel.org>
Subject: Re: [PATCH v8 1/5] mm: introduce a common interface for balloon pages mobility
Date: Thu, 23 Aug 2012 13:01:07 +0300	[thread overview]
Message-ID: <20120823100107.GA17409@redhat.com> (raw)
In-Reply-To: <20120823021903.GA23660@x61.redhat.com>

On Wed, Aug 22, 2012 at 11:19:04PM -0300, Rafael Aquini wrote:
> On Wed, Aug 22, 2012 at 12:33:17PM +0300, Michael S. Tsirkin wrote:
> > Hmm, so this will busy wait which is unelegant.
> > We need some event IMO.
> 
> No, it does not busy wait. leak_balloon() is mutual exclusive with migration
> steps, so for the case we have one racing against the other, we really want
> leak_balloon() dropping the mutex temporarily to allow migration complete its
> work of refilling vb->pages list. Also, leak_balloon() calls tell_host(), which
> will potentially make it to schedule for each round of vb->pfns leak_balloon()
> will release.

tell_host might not even cause an exit to host. Even if it does
it does not involve guest scheduler.

> So, when remove_common() calls leak_balloon() looping on
> vb->num_pages, that won't become a tight loop. 
> The scheme was apparently working before this series, and it will remain working
> after it.

It seems that before we would always leak all requested memory
in one go. I can't tell why we have a while loop there at all.
Rusty, could you clarify please?

> 
> > Also, reading num_pages without a lock here
> > which seems wrong.
> 
> I'll protect it with vb->balloon_lock mutex. That will be consistent with the
> lock protection scheme this patch is introducing for struct virtio_balloon
> elements.
> 
> 
> > A similar concern applies to normal leaking
> > of the balloon: here we might leak less than
> > required, then wait for the next config change
> > event.
> 
> Just as before, same thing here. If you leaked less than required, balloon()
> will keep calling leak_balloon() until the balloon target is reached. This
> scheme was working before, and it will keep working after this patch.
>

IIUC we never hit this path before.
 
> > How about we signal config_change
> > event when pages are back to pages_list?
> 
> I really don't know what to tell you here, but, to me, it seems like an
> overcomplication that isn't directly entangled with this patch purposes.
> Besides, you cannot expect compation / migration happening and racing against
> leak_balloon() all the time to make them signal events to the later, so we might
> just be creating a wait-forever condition for leak_balloon(), IMHO.

So use wait_event or similar, check for existance of isolated pages.

> Cheers!

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

WARNING: multiple messages have this Message-ID (diff)
From: "Michael S. Tsirkin" <mst@redhat.com>
To: Rafael Aquini <aquini@redhat.com>
Cc: "Paul E. McKenney" <paulmck@linux.vnet.ibm.com>,
	Peter Zijlstra <peterz@infradead.org>,
	linux-mm@kvack.org, linux-kernel@vger.kernel.org,
	virtualization@lists.linux-foundation.org,
	Rusty Russell <rusty@rustcorp.com.au>,
	Rik van Riel <riel@redhat.com>, Mel Gorman <mel@csn.ul.ie>,
	Andi Kleen <andi@firstfloor.org>,
	Andrew Morton <akpm@linux-foundation.org>,
	Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>,
	Minchan Kim <minchan@kernel.org>
Subject: Re: [PATCH v8 1/5] mm: introduce a common interface for balloon pages mobility
Date: Thu, 23 Aug 2012 13:01:07 +0300	[thread overview]
Message-ID: <20120823100107.GA17409@redhat.com> (raw)
In-Reply-To: <20120823021903.GA23660@x61.redhat.com>

On Wed, Aug 22, 2012 at 11:19:04PM -0300, Rafael Aquini wrote:
> On Wed, Aug 22, 2012 at 12:33:17PM +0300, Michael S. Tsirkin wrote:
> > Hmm, so this will busy wait which is unelegant.
> > We need some event IMO.
> 
> No, it does not busy wait. leak_balloon() is mutual exclusive with migration
> steps, so for the case we have one racing against the other, we really want
> leak_balloon() dropping the mutex temporarily to allow migration complete its
> work of refilling vb->pages list. Also, leak_balloon() calls tell_host(), which
> will potentially make it to schedule for each round of vb->pfns leak_balloon()
> will release.

tell_host might not even cause an exit to host. Even if it does
it does not involve guest scheduler.

> So, when remove_common() calls leak_balloon() looping on
> vb->num_pages, that won't become a tight loop. 
> The scheme was apparently working before this series, and it will remain working
> after it.

It seems that before we would always leak all requested memory
in one go. I can't tell why we have a while loop there at all.
Rusty, could you clarify please?

> 
> > Also, reading num_pages without a lock here
> > which seems wrong.
> 
> I'll protect it with vb->balloon_lock mutex. That will be consistent with the
> lock protection scheme this patch is introducing for struct virtio_balloon
> elements.
> 
> 
> > A similar concern applies to normal leaking
> > of the balloon: here we might leak less than
> > required, then wait for the next config change
> > event.
> 
> Just as before, same thing here. If you leaked less than required, balloon()
> will keep calling leak_balloon() until the balloon target is reached. This
> scheme was working before, and it will keep working after this patch.
>

IIUC we never hit this path before.
 
> > How about we signal config_change
> > event when pages are back to pages_list?
> 
> I really don't know what to tell you here, but, to me, it seems like an
> overcomplication that isn't directly entangled with this patch purposes.
> Besides, you cannot expect compation / migration happening and racing against
> leak_balloon() all the time to make them signal events to the later, so we might
> just be creating a wait-forever condition for leak_balloon(), IMHO.

So use wait_event or similar, check for existance of isolated pages.

> Cheers!

  reply	other threads:[~2012-08-23 10:00 UTC|newest]

Thread overview: 155+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2012-08-21 12:47 [PATCH v8 0/5] make balloon pages movable by compaction Rafael Aquini
2012-08-21 12:47 ` Rafael Aquini
2012-08-21 12:47 ` [PATCH v8 1/5] mm: introduce a common interface for balloon pages mobility Rafael Aquini
2012-08-21 12:47   ` Rafael Aquini
2012-08-21 12:47   ` Rafael Aquini
2012-08-21 13:52   ` Michael S. Tsirkin
2012-08-21 13:52     ` Michael S. Tsirkin
2012-08-21 14:25     ` Michael S. Tsirkin
2012-08-21 14:25     ` Michael S. Tsirkin
2012-08-21 14:25       ` Michael S. Tsirkin
2012-08-21 15:16     ` Peter Zijlstra
2012-08-21 15:16       ` Peter Zijlstra
2012-08-21 15:41       ` Michael S. Tsirkin
2012-08-21 15:41       ` Michael S. Tsirkin
2012-08-21 15:41         ` Michael S. Tsirkin
2012-08-21 17:42         ` Rafael Aquini
2012-08-21 17:42           ` Rafael Aquini
2012-08-21 19:28           ` Michael S. Tsirkin
2012-08-21 19:28             ` Michael S. Tsirkin
2012-08-21 19:28             ` Michael S. Tsirkin
2012-08-21 17:42         ` Rafael Aquini
2012-08-21 15:16     ` Peter Zijlstra
2012-08-21 17:55     ` Rafael Aquini
2012-08-21 17:55     ` Rafael Aquini
2012-08-21 17:55       ` Rafael Aquini
2012-08-21 19:16       ` Michael S. Tsirkin
2012-08-21 19:16         ` Michael S. Tsirkin
2012-08-21 19:34         ` Rafael Aquini
2012-08-21 19:34           ` Rafael Aquini
2012-08-21 19:34           ` Rafael Aquini
2012-08-22  0:06           ` Michael S. Tsirkin
2012-08-22  0:06           ` Michael S. Tsirkin
2012-08-22  0:06             ` Michael S. Tsirkin
2012-08-21 19:16       ` Michael S. Tsirkin
2012-08-21 13:52   ` Michael S. Tsirkin
2012-08-21 15:20   ` Peter Zijlstra
2012-08-21 15:20     ` Peter Zijlstra
2012-08-21 16:24     ` Paul E. McKenney
2012-08-21 16:24       ` Paul E. McKenney
2012-08-21 16:24       ` Paul E. McKenney
2012-08-21 17:28       ` Rafael Aquini
2012-08-21 17:28         ` Rafael Aquini
2012-08-21 19:13         ` Michael S. Tsirkin
2012-08-21 19:13           ` Michael S. Tsirkin
2012-08-21 19:13           ` Michael S. Tsirkin
2012-08-21 19:23           ` Rafael Aquini
2012-08-21 19:23             ` Rafael Aquini
2012-08-21 19:30             ` Michael S. Tsirkin
2012-08-21 19:30               ` Michael S. Tsirkin
2012-08-21 19:30               ` Michael S. Tsirkin
2012-08-21 20:45               ` Rafael Aquini
2012-08-21 20:45                 ` Rafael Aquini
2012-08-22  0:07                 ` Michael S. Tsirkin
2012-08-22  0:07                   ` Michael S. Tsirkin
2012-08-22  1:19                   ` Rafael Aquini
2012-08-22  1:19                     ` Rafael Aquini
2012-08-22  9:33                     ` Michael S. Tsirkin
2012-08-22  9:33                     ` Michael S. Tsirkin
2012-08-22  9:33                       ` Michael S. Tsirkin
2012-08-23  2:19                       ` Rafael Aquini
2012-08-23  2:19                         ` Rafael Aquini
2012-08-23 10:01                         ` Michael S. Tsirkin [this message]
2012-08-23 10:01                           ` Michael S. Tsirkin
2012-08-23 12:13                           ` Rafael Aquini
2012-08-23 12:13                           ` Rafael Aquini
2012-08-23 12:13                             ` Rafael Aquini
2012-08-23 12:34                             ` Michael S. Tsirkin
2012-08-23 12:34                             ` Michael S. Tsirkin
2012-08-23 12:34                               ` Michael S. Tsirkin
2012-08-23 13:06                               ` Rafael Aquini
2012-08-23 13:06                               ` Rafael Aquini
2012-08-23 13:06                                 ` Rafael Aquini
2012-08-23 13:53                                 ` Michael S. Tsirkin
2012-08-23 13:53                                   ` Michael S. Tsirkin
2012-08-23 15:21                                   ` Rafael Aquini
2012-08-23 15:21                                     ` Rafael Aquini
2012-08-23 15:54                                     ` Michael S. Tsirkin
2012-08-23 15:54                                     ` Michael S. Tsirkin
2012-08-23 15:54                                       ` Michael S. Tsirkin
2012-08-23 16:03                                       ` Rik van Riel
2012-08-23 16:03                                       ` Rik van Riel
2012-08-23 16:03                                         ` Rik van Riel
2012-08-23 16:06                                         ` Rafael Aquini
2012-08-23 16:06                                           ` Rafael Aquini
2012-08-23 16:10                                           ` Michael S. Tsirkin
2012-08-23 16:10                                           ` Michael S. Tsirkin
2012-08-23 16:10                                             ` Michael S. Tsirkin
2012-08-23 16:06                                         ` Rafael Aquini
2012-08-23 15:21                                   ` Rafael Aquini
2012-08-23 16:25                                   ` Michael S. Tsirkin
2012-08-23 16:25                                     ` Michael S. Tsirkin
2012-08-23 17:28                                     ` Rafael Aquini
2012-08-23 17:28                                     ` Rafael Aquini
2012-08-23 17:28                                       ` Rafael Aquini
2012-08-23 17:59                                       ` Rik van Riel
2012-08-23 17:59                                         ` Rik van Riel
2012-08-23 17:59                                       ` Rik van Riel
2012-08-23 23:36                                       ` Michael S. Tsirkin
2012-08-23 23:36                                       ` Michael S. Tsirkin
2012-08-23 23:36                                         ` Michael S. Tsirkin
2012-08-24  0:26                                         ` Rafael Aquini
2012-08-24  0:26                                           ` Rafael Aquini
2012-08-24  0:26                                         ` Rafael Aquini
2012-08-24  0:33                                         ` Rafael Aquini
2012-08-24  0:33                                           ` Rafael Aquini
2012-08-24  0:38                                           ` Rafael Aquini
2012-08-24  0:38                                             ` Rafael Aquini
2012-08-24  0:49                                             ` Rafael Aquini
2012-08-24  0:49                                               ` Rafael Aquini
2012-08-24  0:49                                             ` Rafael Aquini
2012-08-24  0:38                                           ` Rafael Aquini
2012-08-24  0:33                                         ` Rafael Aquini
2012-08-24  3:12                                         ` Rik van Riel
2012-08-24  3:12                                           ` Rik van Riel
2012-08-24  8:03                                           ` Michael S. Tsirkin
2012-08-24  8:03                                           ` Michael S. Tsirkin
2012-08-24  8:03                                             ` Michael S. Tsirkin
2012-08-24  3:12                                         ` Rik van Riel
2012-08-23 16:25                                   ` Michael S. Tsirkin
2012-08-23 13:53                                 ` Michael S. Tsirkin
2012-08-23 10:01                         ` Michael S. Tsirkin
2012-08-23  2:19                       ` Rafael Aquini
2012-08-22  1:19                   ` Rafael Aquini
2012-08-22  0:07                 ` Michael S. Tsirkin
2012-08-21 20:45               ` Rafael Aquini
2012-08-21 19:23           ` Rafael Aquini
2012-08-21 17:28       ` Rafael Aquini
2012-08-21 15:20   ` Peter Zijlstra
2012-08-21 12:47 ` [PATCH v8 2/5] mm: introduce compaction and migration for ballooned pages Rafael Aquini
2012-08-21 12:47   ` Rafael Aquini
2012-08-21 12:47 ` Rafael Aquini
2012-08-21 12:47 ` [PATCH v8 3/5] virtio_balloon: introduce migration primitives to balloon pages Rafael Aquini
2012-08-21 12:47 ` Rafael Aquini
2012-08-21 12:47   ` Rafael Aquini
2012-08-21 14:40   ` Michael S. Tsirkin
2012-08-21 14:40     ` Michael S. Tsirkin
2012-08-21 15:34     ` Peter Zijlstra
2012-08-21 15:34       ` Peter Zijlstra
2012-08-21 15:34     ` Peter Zijlstra
2012-08-21 15:37     ` Peter Zijlstra
2012-08-21 15:37     ` Peter Zijlstra
2012-08-21 15:37       ` Peter Zijlstra
2012-08-21 14:40   ` Michael S. Tsirkin
2012-08-21 14:57   ` Michael S. Tsirkin
2012-08-21 14:57   ` Michael S. Tsirkin
2012-08-21 14:57     ` Michael S. Tsirkin
2012-08-21 12:47 ` [PATCH v8 4/5] mm: introduce putback_movable_pages() Rafael Aquini
2012-08-21 12:47   ` Rafael Aquini
2012-08-21 14:42   ` Michael S. Tsirkin
2012-08-21 14:42   ` Michael S. Tsirkin
2012-08-21 14:42     ` Michael S. Tsirkin
2012-08-21 12:47 ` Rafael Aquini
2012-08-21 12:47 ` [PATCH v8 5/5] mm: add vm event counters for balloon pages compaction Rafael Aquini
2012-08-21 12:47 ` Rafael Aquini
2012-08-21 12:47   ` Rafael Aquini

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20120823100107.GA17409@redhat.com \
    --to=mst@redhat.com \
    --cc=akpm@linux-foundation.org \
    --cc=andi@firstfloor.org \
    --cc=aquini@redhat.com \
    --cc=konrad.wilk@oracle.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=mel@csn.ul.ie \
    --cc=minchan@kernel.org \
    --cc=paulmck@linux.vnet.ibm.com \
    --cc=peterz@infradead.org \
    --cc=riel@redhat.com \
    --cc=rusty@rustcorp.com.au \
    --cc=virtualization@lists.linux-foundation.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.