All of lore.kernel.org
 help / color / mirror / Atom feed
From: Joel Schopp <jschopp@austin.ibm.com>
To: Nick Piggin <npiggin@suse.de>
Cc: Linus Torvalds <torvalds@linux-foundation.org>,
	Andrew Morton <akpm@linux-foundation.org>,
	Mel Gorman <mel@skynet.ie>,
	clameter@engr.sgi.com, mingo@elte.hu, arjan@infradead.org,
	mbligh@mbligh.org, linux-mm@kvack.org,
	linux-kernel@vger.kernel.org
Subject: Re: The performance and behaviour of the anti-fragmentation related patches
Date: Mon, 05 Mar 2007 09:20:10 -0600	[thread overview]
Message-ID: <45EC352A.7060802@austin.ibm.com> (raw)
In-Reply-To: <20070305032116.GA29678@wotan.suse.de>

> But if you don't require a lot of higher order allocations anyway, then
> guest fragmentation caused by ballooning doesn't seem like much problem.

If you only need to allocate 1 page size and smaller allocations then no it's not a 
problem.  As soon as you go above that it will be.  You don't need to go all the way 
up to MAX_ORDER size to see an impact, it's just increasingly more severe as you get 
away from 1 page and towards MAX_ORDER.

> 
> If you need higher order allocations, then ballooning is bad because of
> fragmentation, so you need memory unplug, so you need higher order
> allocations. Goto 1.

Yes, it's a closed loop.  But hotplug isn't the only one that needs higher order 
allocations.  In fact it's pretty far down the list.  I look at it like this, a lot 
of users need high order allocations for better performance and things like on-demand 
hugepages.  As a bonus you get memory hot-remove.

> Balooning probably does skew memory management stats and watermarks, but
> that's just because it is implemented as a module. A couple of hooks
> should be enough to allow things to be adjusted?

That is a good idea independent of the current discussion.


WARNING: multiple messages have this Message-ID (diff)
From: Joel Schopp <jschopp@austin.ibm.com>
To: Nick Piggin <npiggin@suse.de>
Cc: Linus Torvalds <torvalds@linux-foundation.org>,
	Andrew Morton <akpm@linux-foundation.org>,
	Mel Gorman <mel@skynet.ie>,
	clameter@engr.sgi.com, mingo@elte.hu, arjan@infradead.org,
	mbligh@mbligh.org, linux-mm@kvack.org,
	linux-kernel@vger.kernel.org
Subject: Re: The performance and behaviour of the anti-fragmentation related patches
Date: Mon, 05 Mar 2007 09:20:10 -0600	[thread overview]
Message-ID: <45EC352A.7060802@austin.ibm.com> (raw)
In-Reply-To: <20070305032116.GA29678@wotan.suse.de>

> But if you don't require a lot of higher order allocations anyway, then
> guest fragmentation caused by ballooning doesn't seem like much problem.

If you only need to allocate 1 page size and smaller allocations then no it's not a 
problem.  As soon as you go above that it will be.  You don't need to go all the way 
up to MAX_ORDER size to see an impact, it's just increasingly more severe as you get 
away from 1 page and towards MAX_ORDER.

> 
> If you need higher order allocations, then ballooning is bad because of
> fragmentation, so you need memory unplug, so you need higher order
> allocations. Goto 1.

Yes, it's a closed loop.  But hotplug isn't the only one that needs higher order 
allocations.  In fact it's pretty far down the list.  I look at it like this, a lot 
of users need high order allocations for better performance and things like on-demand 
hugepages.  As a bonus you get memory hot-remove.

> Balooning probably does skew memory management stats and watermarks, but
> that's just because it is implemented as a module. A couple of hooks
> should be enough to allow things to be adjusted?

That is a good idea independent of the current discussion.

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

  reply	other threads:[~2007-03-05 15:20 UTC|newest]

Thread overview: 203+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2007-03-01 10:12 The performance and behaviour of the anti-fragmentation related patches Mel Gorman
2007-03-01 10:12 ` Mel Gorman
2007-03-02  0:09 ` Andrew Morton
2007-03-02  0:44   ` Linus Torvalds
2007-03-02  1:52     ` Balbir Singh
2007-03-02  1:52       ` Balbir Singh
2007-03-02  3:44       ` Linus Torvalds
2007-03-02  3:44         ` Linus Torvalds
2007-03-02  3:59         ` Andrew Morton
2007-03-02  3:59           ` Andrew Morton
2007-03-02  5:11           ` Linus Torvalds
2007-03-02  5:11             ` Linus Torvalds
2007-03-02  5:50             ` KAMEZAWA Hiroyuki
2007-03-02  5:50               ` KAMEZAWA Hiroyuki
2007-03-02  6:15               ` Paul Mundt
2007-03-02  6:15                 ` Paul Mundt
2007-03-02 17:01                 ` Mel Gorman
2007-03-02 17:01                   ` Mel Gorman
2007-03-02 16:20             ` Mark Gross
2007-03-02 16:20               ` Mark Gross
2007-03-02 17:07               ` Andrew Morton
2007-03-02 17:07                 ` Andrew Morton
2007-03-02 17:35                 ` Mark Gross
2007-03-02 17:35                   ` Mark Gross
2007-03-02 18:02                   ` Andrew Morton
2007-03-02 18:02                     ` Andrew Morton
2007-03-02 19:02                     ` Mark Gross
2007-03-02 19:02                       ` Mark Gross
2007-03-02 17:16               ` Linus Torvalds
2007-03-02 17:16                 ` Linus Torvalds
2007-03-02 18:45                 ` Mark Gross
2007-03-02 18:45                   ` Mark Gross
2007-03-02 19:03                   ` Linus Torvalds
2007-03-02 19:03                     ` Linus Torvalds
2007-03-02 23:58                 ` Martin J. Bligh
2007-03-02 23:58                   ` Martin J. Bligh
2007-03-02  4:18         ` Balbir Singh
2007-03-02  4:18           ` Balbir Singh
2007-03-02  5:13         ` Jeremy Fitzhardinge
2007-03-02  5:13           ` Jeremy Fitzhardinge
2007-03-06  4:16         ` Paul Mackerras
2007-03-06  4:16           ` Paul Mackerras
2007-03-02 16:58     ` Mel Gorman
2007-03-02 16:58       ` Mel Gorman
2007-03-02 17:05     ` Joel Schopp
2007-03-02 17:05       ` Joel Schopp
2007-03-05  3:21       ` Nick Piggin
2007-03-05  3:21         ` Nick Piggin
2007-03-05 15:20         ` Joel Schopp [this message]
2007-03-05 15:20           ` Joel Schopp
2007-03-05 16:01           ` Nick Piggin
2007-03-05 16:01             ` Nick Piggin
2007-03-05 16:45             ` Joel Schopp
2007-03-05 16:45               ` Joel Schopp
2007-05-03  8:49           ` Andy Whitcroft
2007-05-03  8:49             ` Andy Whitcroft
2007-03-02  1:39   ` Balbir Singh
2007-03-02  1:39     ` Balbir Singh
2007-03-02  2:34   ` KAMEZAWA Hiroyuki
2007-03-02  2:34     ` KAMEZAWA Hiroyuki
2007-03-02  3:05   ` Christoph Lameter
2007-03-02  3:05     ` Christoph Lameter
2007-03-02  3:57     ` Nick Piggin
2007-03-02  3:57       ` Nick Piggin
2007-03-02  4:06       ` Christoph Lameter
2007-03-02  4:06         ` Christoph Lameter
2007-03-02  4:21         ` Nick Piggin
2007-03-02  4:21           ` Nick Piggin
2007-03-02  4:31           ` Christoph Lameter
2007-03-02  4:31             ` Christoph Lameter
2007-03-02  5:06             ` Nick Piggin
2007-03-02  5:06               ` Nick Piggin
2007-03-02  5:40               ` Christoph Lameter
2007-03-02  5:40                 ` Christoph Lameter
2007-03-02  5:49                 ` Nick Piggin
2007-03-02  5:49                   ` Nick Piggin
2007-03-02  5:53                   ` Christoph Lameter
2007-03-02  5:53                     ` Christoph Lameter
2007-03-02  6:08                     ` Nick Piggin
2007-03-02  6:08                       ` Nick Piggin
2007-03-02  6:19                       ` Christoph Lameter
2007-03-02  6:19                         ` Christoph Lameter
2007-03-02  6:29                         ` Nick Piggin
2007-03-02  6:29                           ` Nick Piggin
2007-03-02  6:51                           ` Christoph Lameter
2007-03-02  6:51                             ` Christoph Lameter
2007-03-02  7:03                             ` Andrew Morton
2007-03-02  7:03                               ` Andrew Morton
2007-03-02  7:19                             ` Nick Piggin
2007-03-02  7:19                               ` Nick Piggin
2007-03-02  7:44                               ` Christoph Lameter
2007-03-02  7:44                                 ` Christoph Lameter
2007-03-02  8:12                                 ` Nick Piggin
2007-03-02  8:12                                   ` Nick Piggin
2007-03-02  8:21                                   ` Christoph Lameter
2007-03-02  8:21                                     ` Christoph Lameter
2007-03-02  8:38                                     ` Nick Piggin
2007-03-02  8:38                                       ` Nick Piggin
2007-03-02 17:09                                       ` Christoph Lameter
2007-03-02 17:09                                         ` Christoph Lameter
2007-03-04  1:26                                   ` Rik van Riel
2007-03-04  1:26                                     ` Rik van Riel
2007-03-04  1:51                                     ` Andrew Morton
2007-03-04  1:51                                       ` Andrew Morton
2007-03-04  1:58                                       ` Rik van Riel
2007-03-04  1:58                                         ` Rik van Riel
2007-03-02  5:50               ` Christoph Lameter
2007-03-02  5:50                 ` Christoph Lameter
2007-03-02  4:29         ` Andrew Morton
2007-03-02  4:29           ` Andrew Morton
2007-03-02  4:33           ` Christoph Lameter
2007-03-02  4:33             ` Christoph Lameter
2007-03-02  4:58             ` Andrew Morton
2007-03-02  4:58               ` Andrew Morton
2007-03-02  4:20       ` Paul Mundt
2007-03-02  4:20         ` Paul Mundt
2007-03-02 13:50   ` Arjan van de Ven
2007-03-02 13:50     ` Arjan van de Ven
2007-03-02 15:29   ` Rik van Riel
2007-03-02 15:29     ` Rik van Riel
2007-03-02 16:58     ` Andrew Morton
2007-03-02 16:58       ` Andrew Morton
2007-03-02 17:09       ` Mel Gorman
2007-03-02 17:09         ` Mel Gorman
2007-03-02 17:23       ` Christoph Lameter
2007-03-02 17:23         ` Christoph Lameter
2007-03-02 17:35         ` Andrew Morton
2007-03-02 17:35           ` Andrew Morton
2007-03-02 17:43           ` Rik van Riel
2007-03-02 17:43             ` Rik van Riel
2007-03-02 18:06             ` Andrew Morton
2007-03-02 18:06               ` Andrew Morton
2007-03-02 18:15               ` Christoph Lameter
2007-03-02 18:15                 ` Christoph Lameter
2007-03-02 18:23                 ` Andrew Morton
2007-03-02 18:23                   ` Andrew Morton
2007-03-02 18:23                 ` Rik van Riel
2007-03-02 18:23                   ` Rik van Riel
2007-03-02 19:31                   ` Christoph Lameter
2007-03-02 19:31                     ` Christoph Lameter
2007-03-02 19:40                     ` Rik van Riel
2007-03-02 19:40                       ` Rik van Riel
2007-03-02 21:12                   ` Bill Irwin
2007-03-02 21:12                     ` Bill Irwin
2007-03-02 21:19                     ` Rik van Riel
2007-03-02 21:19                       ` Rik van Riel
2007-03-02 21:52                       ` Andrew Morton
2007-03-02 21:52                         ` Andrew Morton
2007-03-02 22:03                         ` Rik van Riel
2007-03-02 22:03                           ` Rik van Riel
2007-03-02 22:22                           ` Andrew Morton
2007-03-02 22:22                             ` Andrew Morton
2007-03-02 22:34                             ` Rik van Riel
2007-03-02 22:34                               ` Rik van Riel
2007-03-02 22:51                               ` Martin Bligh
2007-03-02 22:51                                 ` Martin Bligh
2007-03-02 22:54                                 ` Rik van Riel
2007-03-02 22:54                                   ` Rik van Riel
2007-03-02 23:28                                   ` Martin J. Bligh
2007-03-02 23:28                                     ` Martin J. Bligh
2007-03-03  0:24                                     ` Andrew Morton
2007-03-03  0:24                                       ` Andrew Morton
2007-03-02 22:52                               ` Chuck Ebbert
2007-03-02 22:52                                 ` Chuck Ebbert
2007-03-02 22:59                               ` Andrew Morton
2007-03-02 22:59                                 ` Andrew Morton
2007-03-02 23:20                                 ` Rik van Riel
2007-03-02 23:20                                   ` Rik van Riel
2007-03-03  1:40                                 ` William Lee Irwin III
2007-03-03  1:40                                   ` William Lee Irwin III
2007-03-03  1:58                                   ` Andrew Morton
2007-03-03  1:58                                     ` Andrew Morton
2007-03-03  3:55                                     ` William Lee Irwin III
2007-03-03  3:55                                       ` William Lee Irwin III
2007-03-02 23:16                             ` [PATCH] : Optimizes timespec_trunc() Eric Dumazet
2007-03-03  0:33                             ` The performance and behaviour of the anti-fragmentation related patches William Lee Irwin III
2007-03-03  0:33                               ` William Lee Irwin III
2007-03-03  0:54                               ` Andrew Morton
2007-03-03  0:54                                 ` Andrew Morton
2007-03-03  3:15                               ` Christoph Lameter
2007-03-03  3:15                                 ` Christoph Lameter
2007-03-03  4:19                                 ` William Lee Irwin III
2007-03-03  4:19                                   ` William Lee Irwin III
2007-03-03 17:16                                 ` Martin J. Bligh
2007-03-03 17:16                                   ` Martin J. Bligh
2007-03-03 17:50                                   ` Christoph Lameter
2007-03-03 17:50                                     ` Christoph Lameter
2007-03-02 20:59               ` Bill Irwin
2007-03-02 20:59                 ` Bill Irwin
2007-03-02 16:32   ` Mel Gorman
2007-03-02 17:19     ` Christoph Lameter
2007-03-02 17:28       ` Mel Gorman
2007-03-02 17:48         ` Christoph Lameter
2007-03-02 17:59           ` Mel Gorman
2007-03-03  4:54     ` KAMEZAWA Hiroyuki
2007-03-02  1:52 ` Bill Irwin
2007-03-02  1:52   ` Bill Irwin
2007-03-02 10:38   ` Mel Gorman
2007-03-02 10:38     ` Mel Gorman
2007-03-02 16:31     ` Joel Schopp
2007-03-02 16:31       ` Joel Schopp
2007-03-02 21:37       ` Bill Irwin
2007-03-02 21:37         ` Bill Irwin

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=45EC352A.7060802@austin.ibm.com \
    --to=jschopp@austin.ibm.com \
    --cc=akpm@linux-foundation.org \
    --cc=arjan@infradead.org \
    --cc=clameter@engr.sgi.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=mbligh@mbligh.org \
    --cc=mel@skynet.ie \
    --cc=mingo@elte.hu \
    --cc=npiggin@suse.de \
    --cc=torvalds@linux-foundation.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.