All of lore.kernel.org
 help / color / mirror / Atom feed
From: Paul Mundt <lethal@linux-sh.org>
To: Andrew Morton <akpm@linux-foundation.org>
Cc: Rik van Riel <riel@redhat.com>,
	clameter@sgi.com, linux-kernel@vger.kernel.org,
	lee.schermerhorn@hp.com, kosaki.motohiro@jp.fujitsu.com,
	linux-mm@kvack.org, eric.whitney@hp.com,
	Andi Kleen <andi@firstfloor.org>, Ingo Molnar <mingo@elte.hu>,
	Andy Whitcroft <apw@shadowen.org>
Subject: Re: [PATCH -mm 13/25] Noreclaim LRU Infrastructure
Date: Wed, 11 Jun 2008 15:29:22 +0900	[thread overview]
Message-ID: <20080611062922.GA30983@linux-sh.org> (raw)
In-Reply-To: <20080610231642.6b4b5a53.akpm@linux-foundation.org>

On Tue, Jun 10, 2008 at 11:16:42PM -0700, Andrew Morton wrote:
> On Wed, 11 Jun 2008 14:09:15 +0900 Paul Mundt <lethal@linux-sh.org> wrote:
> > On Tue, Jun 10, 2008 at 02:33:34PM -0700, Andrew Morton wrote:
> > > Maybe it's time to bite the bullet and kill i386 NUMA support.  afaik
> > > it's just NUMAQ and a 2-node NUMAish machine which IBM made (as400?)
> > > 
> > > arch/sh uses NUMA for 32-bit, I believe. But I don't know what its
> > > maximum node count is.  The default for sh NODES_SHIFT is 3.  
> > 
> > In terms of memory nodes, systems vary from 2 up to 16 or so. It gets
> > gradually more complex in the SMP cases where we are 3-4 levels deep in
> > various types of memories that we expose as nodes (ie, 4-8 CPUs with a
> > dozen different memories or so at various interconnect levels).
> 
> Thanks.
> 
> Andi has suggested that we can remove the node-ID encoding from
> page.flags on x86 because that info is available elsewhere, although a
> bit more slowly.
> 
> <looks at page_zone(), wonders whether we care about performance anyway>
> 
> There wouldn't be much point in doing that unless we did it for all
> 32-bit architectures.  How much trouble would it cause sh?
> 
At first glance I don't think that should be too bad. We only do NUMA
through sparsemem anyways, and we have pretty much no overlap in any of
the ranges, so simply setting NODE_NOT_IN_PAGE_FLAGS should be ok there.
Given the relatively small number of pages we have, the added cost of
page_to_nid() referencing section_to_node_table should still be
tolerable. I'll give it a go and see what the numbers look like.

> > As far as testing goes, it's part of the regular build and regression
> > testing for a number of boards, which we verify on a daily basis
> > (although admittedly -mm gets far less testing, even though that's where
> > most of the churn in this area tends to be).
> 
> Oh well, that's what -rc is for :(
> 
> It would be good if someone over there could start testing linux-next. 
> Once I get my act together that will include most-of-mm anyway.
> 
Agreed. This is something we're attempting to add in to our automated
testing at present.

WARNING: multiple messages have this Message-ID (diff)
From: Paul Mundt <lethal@linux-sh.org>
To: Andrew Morton <akpm@linux-foundation.org>
Cc: Rik van Riel <riel@redhat.com>,
	clameter@sgi.com, linux-kernel@vger.kernel.org,
	lee.schermerhorn@hp.com, kosaki.motohiro@jp.fujitsu.com,
	linux-mm@kvack.org, eric.whitney@hp.com,
	Andi Kleen <andi@firstfloor.org>, Ingo Molnar <mingo@elte.hu>,
	Andy Whitcroft <apw@shadowen.org>
Subject: Re: [PATCH -mm 13/25] Noreclaim LRU Infrastructure
Date: Wed, 11 Jun 2008 15:29:22 +0900	[thread overview]
Message-ID: <20080611062922.GA30983@linux-sh.org> (raw)
In-Reply-To: <20080610231642.6b4b5a53.akpm@linux-foundation.org>

On Tue, Jun 10, 2008 at 11:16:42PM -0700, Andrew Morton wrote:
> On Wed, 11 Jun 2008 14:09:15 +0900 Paul Mundt <lethal@linux-sh.org> wrote:
> > On Tue, Jun 10, 2008 at 02:33:34PM -0700, Andrew Morton wrote:
> > > Maybe it's time to bite the bullet and kill i386 NUMA support.  afaik
> > > it's just NUMAQ and a 2-node NUMAish machine which IBM made (as400?)
> > > 
> > > arch/sh uses NUMA for 32-bit, I believe. But I don't know what its
> > > maximum node count is.  The default for sh NODES_SHIFT is 3.  
> > 
> > In terms of memory nodes, systems vary from 2 up to 16 or so. It gets
> > gradually more complex in the SMP cases where we are 3-4 levels deep in
> > various types of memories that we expose as nodes (ie, 4-8 CPUs with a
> > dozen different memories or so at various interconnect levels).
> 
> Thanks.
> 
> Andi has suggested that we can remove the node-ID encoding from
> page.flags on x86 because that info is available elsewhere, although a
> bit more slowly.
> 
> <looks at page_zone(), wonders whether we care about performance anyway>
> 
> There wouldn't be much point in doing that unless we did it for all
> 32-bit architectures.  How much trouble would it cause sh?
> 
At first glance I don't think that should be too bad. We only do NUMA
through sparsemem anyways, and we have pretty much no overlap in any of
the ranges, so simply setting NODE_NOT_IN_PAGE_FLAGS should be ok there.
Given the relatively small number of pages we have, the added cost of
page_to_nid() referencing section_to_node_table should still be
tolerable. I'll give it a go and see what the numbers look like.

> > As far as testing goes, it's part of the regular build and regression
> > testing for a number of boards, which we verify on a daily basis
> > (although admittedly -mm gets far less testing, even though that's where
> > most of the churn in this area tends to be).
> 
> Oh well, that's what -rc is for :(
> 
> It would be good if someone over there could start testing linux-next. 
> Once I get my act together that will include most-of-mm anyway.
> 
Agreed. This is something we're attempting to add in to our automated
testing at present.

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

  reply	other threads:[~2008-06-11  6:31 UTC|newest]

Thread overview: 151+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2008-06-06 20:28 [PATCH -mm 00/25] VM pageout scalability improvements (V10) Rik van Riel, Rik van Riel
2008-06-06 20:28 ` [PATCH -mm 01/25] move isolate_lru_page() to vmscan.c Rik van Riel, Rik van Riel
2008-06-06 20:28 ` [PATCH -mm 02/25] Use an indexed array for LRU variables Rik van Riel, Rik van Riel
2008-06-07  1:04   ` Andrew Morton
2008-06-07  5:43     ` KOSAKI Motohiro
2008-06-07 14:47       ` Rik van Riel
2008-06-08 11:22         ` KOSAKI Motohiro
2008-06-07 18:42     ` Rik van Riel
2008-06-06 20:28 ` [PATCH -mm 03/25] use an array for the LRU pagevecs Rik van Riel, Rik van Riel
2008-06-06 20:28 ` [PATCH -mm 04/25] free swap space on swap-in/activation Rik van Riel, Rik van Riel
2008-06-07  1:04   ` Andrew Morton
2008-06-07 19:56     ` Rik van Riel
2008-06-09  2:14     ` MinChan Kim
2008-06-09  2:42       ` Rik van Riel
2008-06-09 13:38       ` KOSAKI Motohiro
2008-06-10  2:30         ` MinChan Kim
2008-06-06 20:28 ` [PATCH -mm 05/25] define page_file_cache() function Rik van Riel, Rik van Riel
2008-06-07  1:04   ` Andrew Morton
2008-06-07 23:38     ` Rik van Riel
2008-06-06 20:28 ` [PATCH -mm 06/25] split LRU lists into anon & file sets Rik van Riel, Rik van Riel
2008-06-07  1:04   ` Andrew Morton
2008-06-07  1:22     ` Rik van Riel
2008-06-07  1:52       ` Andrew Morton
2008-06-06 20:28 ` [PATCH -mm 07/25] second chance replacement for anonymous pages Rik van Riel, Rik van Riel
2008-06-07  1:04   ` Andrew Morton
2008-06-07  6:03     ` KOSAKI Motohiro
2008-06-07  6:43       ` Andrew Morton
2008-06-08 15:04     ` Rik van Riel
2008-06-06 20:28 ` [PATCH -mm 08/25] add some sanity checks to get_scan_ratio Rik van Riel, Rik van Riel
2008-06-07  1:04   ` Andrew Morton
2008-06-08 15:11     ` Rik van Riel
2008-06-06 20:28 ` [PATCH -mm 09/25] fix pagecache reclaim referenced bit check Rik van Riel, Rik van Riel
2008-06-07  1:04   ` Andrew Morton
2008-06-07  1:08     ` Rik van Riel
2008-06-08 10:02       ` Peter Zijlstra
2008-06-06 20:28 ` [PATCH -mm 10/25] add newly swapped in pages to the inactive list Rik van Riel, Rik van Riel
2008-06-07  1:04   ` Andrew Morton
2008-06-06 20:28 ` [PATCH -mm 11/25] more aggressively use lumpy reclaim Rik van Riel, Rik van Riel
2008-06-07  1:05   ` Andrew Morton
2008-06-06 20:28 ` [PATCH -mm 12/25] pageflag helpers for configed-out flags Rik van Riel, Rik van Riel
2008-06-06 20:28 ` [PATCH -mm 13/25] Noreclaim LRU Infrastructure Rik van Riel, Rik van Riel
2008-06-06 20:28   ` Rik van Riel, Rik van Riel
2008-06-07  1:05   ` Andrew Morton
2008-06-07  1:05     ` Andrew Morton
2008-06-08 20:34     ` Rik van Riel
2008-06-08 20:34       ` Rik van Riel
2008-06-08 20:57       ` Andrew Morton
2008-06-08 20:57         ` Andrew Morton
2008-06-08 21:32         ` Rik van Riel
2008-06-08 21:32           ` Rik van Riel
2008-06-08 21:43           ` Ray Lee
2008-06-08 21:43             ` Ray Lee
2008-06-08 23:22           ` Andrew Morton
2008-06-08 23:22             ` Andrew Morton
2008-06-08 23:34             ` Rik van Riel
2008-06-08 23:34               ` Rik van Riel
2008-06-08 23:54               ` Andrew Morton
2008-06-08 23:54                 ` Andrew Morton
2008-06-09  0:56                 ` Rik van Riel
2008-06-09  0:56                   ` Rik van Riel
2008-06-09  6:10                   ` Andrew Morton
2008-06-09  6:10                     ` Andrew Morton
2008-06-09 13:44                     ` Rik van Riel
2008-06-09 13:44                       ` Rik van Riel
2008-06-09  2:58                 ` Rik van Riel
2008-06-09  2:58                   ` Rik van Riel
2008-06-09  5:44                   ` Andrew Morton
2008-06-09  5:44                     ` Andrew Morton
2008-06-10 19:17                 ` Christoph Lameter
2008-06-10 19:17                   ` Christoph Lameter
2008-06-10 19:37                   ` Rik van Riel
2008-06-10 19:37                     ` Rik van Riel
2008-06-10 21:33                     ` Andrew Morton
2008-06-10 21:33                       ` Andrew Morton
2008-06-10 21:48                       ` Andi Kleen
2008-06-10 21:48                         ` Andi Kleen
2008-06-10 22:05                       ` Dave Hansen
2008-06-10 22:05                         ` Dave Hansen
2008-06-11  5:09                       ` Paul Mundt
2008-06-11  5:09                         ` Paul Mundt
2008-06-11  6:16                         ` Andrew Morton
2008-06-11  6:16                           ` Andrew Morton
2008-06-11  6:29                           ` Paul Mundt [this message]
2008-06-11  6:29                             ` Paul Mundt
2008-06-11 12:06                           ` Andi Kleen
2008-06-11 12:06                             ` Andi Kleen
2008-06-11 14:09                           ` Removing node flags from page->flags was Re: [PATCH -mm 13/25] Noreclaim LRU Infrastructure II Andi Kleen
2008-06-11 14:09                             ` Andi Kleen
2008-06-11 19:03                       ` [PATCH -mm 13/25] Noreclaim LRU Infrastructure Andy Whitcroft
2008-06-11 19:03                         ` Andy Whitcroft
2008-06-11 20:52                         ` Andi Kleen
2008-06-11 20:52                           ` Andi Kleen
2008-06-11 23:25                         ` Christoph Lameter
2008-06-11 23:25                           ` Christoph Lameter
2008-06-08 22:03         ` Rik van Riel
2008-06-08 22:03           ` Rik van Riel
2008-06-08 21:07       ` KOSAKI Motohiro
2008-06-08 21:07         ` KOSAKI Motohiro
2008-06-10 20:09     ` Rik van Riel
2008-06-10 20:09       ` Rik van Riel
2008-06-06 20:28 ` [PATCH -mm 14/25] Noreclaim LRU Page Statistics Rik van Riel, Rik van Riel
2008-06-06 20:28 ` [PATCH -mm 15/25] Ramfs and Ram Disk pages are non-reclaimable Rik van Riel, Rik van Riel
2008-06-06 20:28   ` Rik van Riel, Rik van Riel
2008-06-07  1:05   ` Andrew Morton
2008-06-07  1:05     ` Andrew Morton
2008-06-08  4:32     ` Greg KH
2008-06-08  4:32       ` Greg KH
2008-06-06 20:28 ` [PATCH -mm 16/25] SHM_LOCKED " Rik van Riel, Rik van Riel
2008-06-07  1:05   ` Andrew Morton
2008-06-07  5:21     ` KOSAKI Motohiro
2008-06-10 21:03     ` Rik van Riel
2008-06-10 21:22       ` Lee Schermerhorn
2008-06-10 21:49         ` Andrew Morton
2008-06-06 20:28 ` [PATCH -mm 17/25] Mlocked Pages " Rik van Riel, Rik van Riel
2008-06-06 20:28   ` Rik van Riel, Rik van Riel
2008-06-07  1:07   ` Andrew Morton
2008-06-07  1:07     ` Andrew Morton
2008-06-07  5:38     ` KOSAKI Motohiro
2008-06-07  5:38       ` KOSAKI Motohiro
2008-06-10  3:31     ` Nick Piggin
2008-06-10  3:31       ` Nick Piggin
2008-06-10 12:50       ` Rik van Riel
2008-06-10 12:50         ` Rik van Riel
2008-06-10 21:14       ` Rik van Riel
2008-06-10 21:14         ` Rik van Riel
2008-06-10 21:43         ` Lee Schermerhorn
2008-06-10 21:43           ` Lee Schermerhorn
2008-06-10 21:57           ` Andrew Morton
2008-06-10 21:57             ` Andrew Morton
2008-06-11 16:01             ` Lee Schermerhorn
2008-06-11 16:01               ` Lee Schermerhorn
2008-06-10 23:48           ` Rik van Riel
2008-06-10 23:48             ` Rik van Riel
2008-06-11 15:29             ` Lee Schermerhorn
2008-06-11 15:29               ` Lee Schermerhorn
2008-06-11  1:00     ` Rik van Riel
2008-06-11  1:00       ` Rik van Riel
2008-06-06 20:28 ` [PATCH -mm 18/25] Downgrade mmap sem while populating mlocked regions Rik van Riel, Rik van Riel
2008-06-06 20:28 ` [PATCH -mm 19/25] Handle mlocked pages during map, remap, unmap Rik van Riel, Rik van Riel
2008-06-06 20:28   ` Rik van Riel, Rik van Riel
2008-06-06 20:28 ` [PATCH -mm 20/25] Mlocked Pages statistics Rik van Riel, Rik van Riel
2008-06-06 20:28 ` [PATCH -mm 21/25] Cull non-reclaimable pages in fault path Rik van Riel, Rik van Riel
2008-06-06 20:28   ` Rik van Riel, Rik van Riel, Lee Schermerhorn
2008-06-06 20:29 ` [PATCH -mm 22/25] Noreclaim and Mlocked pages vm events Rik van Riel, Rik van Riel
2008-06-06 20:29 ` [PATCH -mm 23/25] Noreclaim LRU scan sysctl Rik van Riel, Rik van Riel
2008-06-06 20:29   ` Rik van Riel, Rik van Riel, Lee Schermerhorn
2008-06-06 20:29 ` [PATCH -mm 24/25] Mlocked Pages: count attempts to free mlocked page Rik van Riel, Rik van Riel
2008-06-06 20:29 ` [PATCH -mm 25/25] Noreclaim LRU and Mlocked Pages Documentation Rik van Riel, Rik van Riel
2008-06-06 20:29   ` Rik van Riel, Rik van Riel
2008-06-06 21:02 ` [PATCH -mm 00/25] VM pageout scalability improvements (V10) Andrew Morton
2008-06-06 21:08   ` Rik van Riel

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20080611062922.GA30983@linux-sh.org \
    --to=lethal@linux-sh.org \
    --cc=akpm@linux-foundation.org \
    --cc=andi@firstfloor.org \
    --cc=apw@shadowen.org \
    --cc=clameter@sgi.com \
    --cc=eric.whitney@hp.com \
    --cc=kosaki.motohiro@jp.fujitsu.com \
    --cc=lee.schermerhorn@hp.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=mingo@elte.hu \
    --cc=riel@redhat.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.