All of lore.kernel.org
 help / color / mirror / Atom feed
From: Andrew Morton <akpm@linux-foundation.org>
To: Mel Gorman <mel@csn.ul.ie>
Cc: linuxppc-dev@ozlabs.org, Eric Munson <ebmunson@us.ibm.com>,
	libhugetlbfs-devel@lists.sourceforge.net,
	linux-kernel@vger.kernel.org, linux-mm@kvack.org
Subject: Re: [RFC] [PATCH 0/5 V2] Huge page backed user-space stacks
Date: Wed, 30 Jul 2008 10:34:07 -0700	[thread overview]
Message-ID: <20080730103407.b110afc2.akpm@linux-foundation.org> (raw)
In-Reply-To: <20080730172317.GA14138@csn.ul.ie>

On Wed, 30 Jul 2008 18:23:18 +0100 Mel Gorman <mel@csn.ul.ie> wrote:

> On (30/07/08 01:43), Andrew Morton didst pronounce:
> > On Mon, 28 Jul 2008 12:17:10 -0700 Eric Munson <ebmunson@us.ibm.com> wrote:
> > 
> > > Certain workloads benefit if their data or text segments are backed by
> > > huge pages.
> > 
> > oh.  As this is a performance patch, it would be much better if its
> > description contained some performance measurement results!  Please.
> > 
> 
> I ran these patches through STREAM (http://www.cs.virginia.edu/stream/).
> STREAM itself was patched to allocate data from the stack instead of statically
> for the test. They completed without any problem on x86, x86_64 and PPC64
> and each test showed a performance gain from using hugepages.  I can post
> the raw figures but they are not currently in an eye-friendly format. Here
> are some plots of the data though;
> 
> x86: http://www.csn.ul.ie/~mel/postings/stack-backing-20080730/x86-stream-stack.ps
> x86_64: http://www.csn.ul.ie/~mel/postings/stack-backing-20080730/x86_64-stream-stack.ps
> ppc64-small: http://www.csn.ul.ie/~mel/postings/stack-backing-20080730/ppc64-small-stream-stack.ps
> ppc64-large: http://www.csn.ul.ie/~mel/postings/stack-backing-20080730/ppc64-large-stream-stack.ps
> 
> The test was to run STREAM with different array sizes (plotted on X-axis)
> and measure the average throughput (y-axis). In each case, backing the stack
> with large pages with a performance gain.

So about a 10% speedup on x86 for most STREAM configurations.  Handy -
that's somewhat larger than most hugepage-conversions, iirc.

Do we expect that this change will be replicated in other
memory-intensive apps?  (I do).

WARNING: multiple messages have this Message-ID (diff)
From: Andrew Morton <akpm@linux-foundation.org>
To: Mel Gorman <mel@csn.ul.ie>
Cc: Eric Munson <ebmunson@us.ibm.com>,
	linux-mm@kvack.org, linux-kernel@vger.kernel.org,
	linuxppc-dev@ozlabs.org,
	libhugetlbfs-devel@lists.sourceforge.net
Subject: Re: [RFC] [PATCH 0/5 V2] Huge page backed user-space stacks
Date: Wed, 30 Jul 2008 10:34:07 -0700	[thread overview]
Message-ID: <20080730103407.b110afc2.akpm@linux-foundation.org> (raw)
In-Reply-To: <20080730172317.GA14138@csn.ul.ie>

On Wed, 30 Jul 2008 18:23:18 +0100 Mel Gorman <mel@csn.ul.ie> wrote:

> On (30/07/08 01:43), Andrew Morton didst pronounce:
> > On Mon, 28 Jul 2008 12:17:10 -0700 Eric Munson <ebmunson@us.ibm.com> wrote:
> > 
> > > Certain workloads benefit if their data or text segments are backed by
> > > huge pages.
> > 
> > oh.  As this is a performance patch, it would be much better if its
> > description contained some performance measurement results!  Please.
> > 
> 
> I ran these patches through STREAM (http://www.cs.virginia.edu/stream/).
> STREAM itself was patched to allocate data from the stack instead of statically
> for the test. They completed without any problem on x86, x86_64 and PPC64
> and each test showed a performance gain from using hugepages.  I can post
> the raw figures but they are not currently in an eye-friendly format. Here
> are some plots of the data though;
> 
> x86: http://www.csn.ul.ie/~mel/postings/stack-backing-20080730/x86-stream-stack.ps
> x86_64: http://www.csn.ul.ie/~mel/postings/stack-backing-20080730/x86_64-stream-stack.ps
> ppc64-small: http://www.csn.ul.ie/~mel/postings/stack-backing-20080730/ppc64-small-stream-stack.ps
> ppc64-large: http://www.csn.ul.ie/~mel/postings/stack-backing-20080730/ppc64-large-stream-stack.ps
> 
> The test was to run STREAM with different array sizes (plotted on X-axis)
> and measure the average throughput (y-axis). In each case, backing the stack
> with large pages with a performance gain.

So about a 10% speedup on x86 for most STREAM configurations.  Handy -
that's somewhat larger than most hugepage-conversions, iirc.

Do we expect that this change will be replicated in other
memory-intensive apps?  (I do).


WARNING: multiple messages have this Message-ID (diff)
From: Andrew Morton <akpm@linux-foundation.org>
To: Mel Gorman <mel@csn.ul.ie>
Cc: Eric Munson <ebmunson@us.ibm.com>,
	linux-mm@kvack.org, linux-kernel@vger.kernel.org,
	linuxppc-dev@ozlabs.org,
	libhugetlbfs-devel@lists.sourceforge.net
Subject: Re: [RFC] [PATCH 0/5 V2] Huge page backed user-space stacks
Date: Wed, 30 Jul 2008 10:34:07 -0700	[thread overview]
Message-ID: <20080730103407.b110afc2.akpm@linux-foundation.org> (raw)
In-Reply-To: <20080730172317.GA14138@csn.ul.ie>

On Wed, 30 Jul 2008 18:23:18 +0100 Mel Gorman <mel@csn.ul.ie> wrote:

> On (30/07/08 01:43), Andrew Morton didst pronounce:
> > On Mon, 28 Jul 2008 12:17:10 -0700 Eric Munson <ebmunson@us.ibm.com> wrote:
> > 
> > > Certain workloads benefit if their data or text segments are backed by
> > > huge pages.
> > 
> > oh.  As this is a performance patch, it would be much better if its
> > description contained some performance measurement results!  Please.
> > 
> 
> I ran these patches through STREAM (http://www.cs.virginia.edu/stream/).
> STREAM itself was patched to allocate data from the stack instead of statically
> for the test. They completed without any problem on x86, x86_64 and PPC64
> and each test showed a performance gain from using hugepages.  I can post
> the raw figures but they are not currently in an eye-friendly format. Here
> are some plots of the data though;
> 
> x86: http://www.csn.ul.ie/~mel/postings/stack-backing-20080730/x86-stream-stack.ps
> x86_64: http://www.csn.ul.ie/~mel/postings/stack-backing-20080730/x86_64-stream-stack.ps
> ppc64-small: http://www.csn.ul.ie/~mel/postings/stack-backing-20080730/ppc64-small-stream-stack.ps
> ppc64-large: http://www.csn.ul.ie/~mel/postings/stack-backing-20080730/ppc64-large-stream-stack.ps
> 
> The test was to run STREAM with different array sizes (plotted on X-axis)
> and measure the average throughput (y-axis). In each case, backing the stack
> with large pages with a performance gain.

So about a 10% speedup on x86 for most STREAM configurations.  Handy -
that's somewhat larger than most hugepage-conversions, iirc.

Do we expect that this change will be replicated in other
memory-intensive apps?  (I do).

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

  reply	other threads:[~2008-07-30 17:34 UTC|newest]

Thread overview: 108+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2008-07-28 19:17 [RFC] [PATCH 0/5 V2] Huge page backed user-space stacks Eric Munson
2008-07-28 19:17 ` Eric Munson
2008-07-28 19:17 ` Eric Munson
2008-07-28 19:17 ` [PATCH 1/5 V2] Align stack boundaries based on personality Eric Munson
2008-07-28 19:17   ` Eric Munson
2008-07-28 19:17   ` Eric Munson
2008-07-28 20:09   ` Dave Hansen
2008-07-28 20:09     ` Dave Hansen
2008-07-28 20:09     ` Dave Hansen
2008-07-28 19:17 ` [PATCH 2/5 V2] Add shared and reservation control to hugetlb_file_setup Eric Munson
2008-07-28 19:17   ` Eric Munson
2008-07-28 19:17   ` Eric Munson
2008-07-28 19:17 ` [PATCH 3/5] Split boundary checking from body of do_munmap Eric Munson
2008-07-28 19:17   ` Eric Munson
2008-07-28 19:17   ` Eric Munson
2008-07-28 19:17 ` [PATCH 4/5 V2] Build hugetlb backed process stacks Eric Munson
2008-07-28 19:17   ` Eric Munson
2008-07-28 19:17   ` Eric Munson
2008-07-28 20:37   ` Dave Hansen
2008-07-28 20:37     ` Dave Hansen
2008-07-28 20:37     ` Dave Hansen
2008-07-28 19:17 ` [PATCH 5/5 V2] [PPC] Setup stack memory segment for hugetlb pages Eric Munson
2008-07-28 19:17   ` Eric Munson
2008-07-28 19:17   ` Eric Munson
2008-07-28 20:33 ` [RFC] [PATCH 0/5 V2] Huge page backed user-space stacks Dave Hansen
2008-07-28 20:33   ` Dave Hansen
2008-07-28 20:33   ` Dave Hansen
2008-07-28 21:23   ` Eric B Munson
2008-07-28 21:23     ` Eric B Munson
2008-07-30  8:41 ` Andrew Morton
2008-07-30  8:41   ` Andrew Morton
2008-07-30  8:41   ` Andrew Morton
2008-07-30 15:04   ` Eric B Munson
2008-07-30 15:04     ` Eric B Munson
2008-07-30 15:08   ` Eric B Munson
2008-07-30 15:08     ` Eric B Munson
2008-07-30  8:43 ` Andrew Morton
2008-07-30  8:43   ` Andrew Morton
2008-07-30  8:43   ` Andrew Morton
2008-07-30 17:23   ` Mel Gorman
2008-07-30 17:23     ` Mel Gorman
2008-07-30 17:23     ` Mel Gorman
2008-07-30 17:34     ` Andrew Morton [this message]
2008-07-30 17:34       ` Andrew Morton
2008-07-30 17:34       ` Andrew Morton
2008-07-30 19:30       ` Mel Gorman
2008-07-30 19:30         ` Mel Gorman
2008-07-30 19:30         ` Mel Gorman
2008-07-30 19:40         ` Christoph Lameter
2008-07-30 19:40           ` Christoph Lameter
2008-07-30 19:40           ` Christoph Lameter
2008-07-30 20:07         ` Andrew Morton
2008-07-30 20:07           ` Andrew Morton
2008-07-30 20:07           ` Andrew Morton
2008-07-31 10:31           ` Mel Gorman
2008-07-31 10:31             ` Mel Gorman
2008-07-31 10:31             ` Mel Gorman
2008-08-04 21:10             ` Dave Hansen
2008-08-04 21:10               ` Dave Hansen
2008-08-04 21:10               ` Dave Hansen
2008-08-05 11:11               ` Mel Gorman
2008-08-05 11:11                 ` Mel Gorman
2008-08-05 11:11                 ` Mel Gorman
2008-08-05 16:12                 ` Dave Hansen
2008-08-05 16:12                   ` Dave Hansen
2008-08-05 16:12                   ` Dave Hansen
2008-08-05 16:28                   ` Mel Gorman
2008-08-05 16:28                     ` Mel Gorman
2008-08-05 16:28                     ` Mel Gorman
2008-08-05 17:53                     ` Dave Hansen
2008-08-05 17:53                       ` Dave Hansen
2008-08-05 17:53                       ` Dave Hansen
2008-08-06  9:02                       ` Mel Gorman
2008-08-06  9:02                         ` Mel Gorman
2008-08-06  9:02                         ` Mel Gorman
2008-08-06 19:50                         ` Dave Hansen
2008-08-06 19:50                           ` Dave Hansen
2008-08-06 19:50                           ` Dave Hansen
2008-08-07 16:06                           ` Mel Gorman
2008-08-07 16:06                             ` Mel Gorman
2008-08-07 16:06                             ` Mel Gorman
2008-08-07 17:29                             ` Dave Hansen
2008-08-07 17:29                               ` Dave Hansen
2008-08-07 17:29                               ` Dave Hansen
2008-08-11  8:04                               ` Mel Gorman
2008-08-11  8:04                                 ` Mel Gorman
2008-08-11  8:04                                 ` Mel Gorman
2008-07-31  6:04       ` Nick Piggin
2008-07-31  6:04         ` Nick Piggin
2008-07-31  6:04         ` Nick Piggin
2008-07-31  6:14         ` Andrew Morton
2008-07-31  6:14           ` Andrew Morton
2008-07-31  6:14           ` Andrew Morton
2008-07-31  6:26           ` Nick Piggin
2008-07-31  6:26             ` Nick Piggin
2008-07-31  6:26             ` Nick Piggin
2008-07-31 11:27             ` Mel Gorman
2008-07-31 11:27               ` Mel Gorman
2008-07-31 11:27               ` Mel Gorman
2008-07-31 11:51               ` Nick Piggin
2008-07-31 11:51                 ` Nick Piggin
2008-07-31 11:51                 ` Nick Piggin
2008-07-31 13:50                 ` Mel Gorman
2008-07-31 13:50                   ` Mel Gorman
2008-07-31 13:50                   ` Mel Gorman
2008-07-31 14:32                   ` Michael Ellerman
2008-08-06 18:49       ` Andi Kleen
2008-08-06 18:49         ` Andi Kleen

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20080730103407.b110afc2.akpm@linux-foundation.org \
    --to=akpm@linux-foundation.org \
    --cc=ebmunson@us.ibm.com \
    --cc=libhugetlbfs-devel@lists.sourceforge.net \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=linuxppc-dev@ozlabs.org \
    --cc=mel@csn.ul.ie \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.