From: Andi Kleen <ak@muc.de>
To: "David S. Miller" <davem@davemloft.net>
Cc: akpm@osdl.org, clameter@sgi.com, ak@suse.de, wli@holomorphy.com,
davem@redhat.com, raybry@sgi.com, benh@kernel.crashing.org,
manfred@colorfullife.com, linux-ia64@vger.kernel.org,
linux-kernel@vger.kernel.org, vrajesh@umich.edu,
hugh@veritas.com
Subject: Re: page fault scalability patch final : i386 tested, x86_64 support added
Date: Sat, 28 Aug 2004 01:17:59 +0000 [thread overview]
Message-ID: <20040828011759.GF50329@muc.de> (raw)
In-Reply-To: <20040827181142.7c382a65.davem@davemloft.net>
On Fri, Aug 27, 2004 at 06:11:42PM -0700, David S. Miller wrote:
> On 28 Aug 2004 03:05:42 +0200
> Andi Kleen <ak@muc.de> wrote:
>
> > I would expect most programs to be not have that many holes,
>
> Holes are not the issue.
Holey parts will be quickly skipped in pml4.
>
> clear_page_tables() doesn't even use the VMA list as a guide
> (it actually can't), it just walks the page tables one pgd at a
> time, one pmd at a time, one pte at a time. And this has the
> worst cache behavior even for simple cases like lat_proc
> in lmbench.
>
> Each pgd/pmd scan is a data reading walk of a whole page
> (or whatever size the particular page table level blocks
> are for the platform, usually they are PAGE_SIZE).
> It's very costly.
Ok, haven't done measurements yet. I would hope though that
on any arch that needs 4 levels reading another PAGE_SIZE worth
of memory is not prohibitive.
That said any optimizations are welcome of course.
-Andi
WARNING: multiple messages have this Message-ID (diff)
From: Andi Kleen <ak@muc.de>
To: "David S. Miller" <davem@davemloft.net>
Cc: akpm@osdl.org, clameter@sgi.com, ak@suse.de, wli@holomorphy.com,
davem@redhat.com, raybry@sgi.com, benh@kernel.crashing.org,
manfred@colorfullife.com, linux-ia64@vger.kernel.org,
linux-kernel@vger.kernel.org, vrajesh@umich.edu,
hugh@veritas.com
Subject: Re: page fault scalability patch final : i386 tested, x86_64 support added
Date: 28 Aug 2004 03:17:59 +0200
Date: Sat, 28 Aug 2004 03:17:59 +0200 [thread overview]
Message-ID: <20040828011759.GF50329@muc.de> (raw)
In-Reply-To: <20040827181142.7c382a65.davem@davemloft.net>
On Fri, Aug 27, 2004 at 06:11:42PM -0700, David S. Miller wrote:
> On 28 Aug 2004 03:05:42 +0200
> Andi Kleen <ak@muc.de> wrote:
>
> > I would expect most programs to be not have that many holes,
>
> Holes are not the issue.
Holey parts will be quickly skipped in pml4.
>
> clear_page_tables() doesn't even use the VMA list as a guide
> (it actually can't), it just walks the page tables one pgd at a
> time, one pmd at a time, one pte at a time. And this has the
> worst cache behavior even for simple cases like lat_proc
> in lmbench.
>
> Each pgd/pmd scan is a data reading walk of a whole page
> (or whatever size the particular page table level blocks
> are for the platform, usually they are PAGE_SIZE).
> It's very costly.
Ok, haven't done measurements yet. I would hope though that
on any arch that needs 4 levels reading another PAGE_SIZE worth
of memory is not prohibitive.
That said any optimizations are welcome of course.
-Andi
next prev parent reply other threads:[~2004-08-28 1:17 UTC|newest]
Thread overview: 195+ messages / expand[flat|nested] mbox.gz Atom feed top
2004-08-15 13:50 page fault fastpath: Increasing SMP scalability by introducing pte Christoph Lameter
2004-08-15 13:50 ` page fault fastpath: Increasing SMP scalability by introducing pte locks? Christoph Lameter
2004-08-15 20:09 ` page fault fastpath: Increasing SMP scalability by introducing David S. Miller
2004-08-15 20:09 ` page fault fastpath: Increasing SMP scalability by introducing pte locks? David S. Miller
2004-08-15 22:58 ` page fault fastpath: Increasing SMP scalability by introducing Christoph Lameter
2004-08-15 22:58 ` page fault fastpath: Increasing SMP scalability by introducing pte locks? Christoph Lameter
2004-08-15 23:58 ` page fault fastpath: Increasing SMP scalability by introducing David S. Miller
2004-08-15 23:58 ` page fault fastpath: Increasing SMP scalability by introducing pte locks? David S. Miller
2004-08-16 0:11 ` page fault fastpath: Increasing SMP scalability by introducing Christoph Lameter
2004-08-16 0:11 ` page fault fastpath: Increasing SMP scalability by introducing pte locks? Christoph Lameter
2004-08-16 1:56 ` page fault fastpath: Increasing SMP scalability by introducing David S. Miller
2004-08-16 1:56 ` page fault fastpath: Increasing SMP scalability by introducing pte locks? David S. Miller
2004-08-16 3:29 ` page fault fastpath: Increasing SMP scalability by introducing Christoph Lameter
2004-08-16 3:29 ` page fault fastpath: Increasing SMP scalability by introducing pte locks? Christoph Lameter
2004-08-16 6:59 ` page fault fastpath: Increasing SMP scalability by introducing Ray Bryant
2004-08-16 7:00 ` page fault fastpath: Increasing SMP scalability by introducing pte locks? Ray Bryant
2004-08-16 15:18 ` page fault fastpath: Increasing SMP scalability by introducing Christoph Lameter
2004-08-16 15:18 ` page fault fastpath: Increasing SMP scalability by introducing pte locks? Christoph Lameter
2004-08-16 16:18 ` William Lee Irwin III
2004-08-16 16:18 ` William Lee Irwin III
2004-08-16 14:39 ` William Lee Irwin III
2004-08-16 14:39 ` William Lee Irwin III
2004-08-17 15:28 ` page fault fastpath patch v2: fix race conditions, stats for 8,32 Christoph Lameter
2004-08-17 15:28 ` page fault fastpath patch v2: fix race conditions, stats for 8,32 and 512 cpu SMP Christoph Lameter
2004-08-17 15:37 ` Christoph Hellwig
2004-08-17 15:37 ` Christoph Hellwig
2004-08-17 15:51 ` William Lee Irwin III
2004-08-17 15:51 ` William Lee Irwin III
2004-08-18 17:55 ` page fault fastpath patch v2: fix race conditions, stats for 8,32 Hugh Dickins
2004-08-18 17:55 ` page fault fastpath patch v2: fix race conditions, stats for 8,32 and 512 cpu SMP Hugh Dickins
2004-08-18 20:20 ` William Lee Irwin III
2004-08-18 20:20 ` William Lee Irwin III
2004-08-19 1:19 ` page fault fastpath patch v2: fix race conditions, stats for Christoph Lameter
2004-08-19 1:19 ` page fault fastpath patch v2: fix race conditions, stats for 8,32 and 512 cpu SMP Christoph Lameter
[not found] ` <B6E8046E1E28D34EB815A11AC8CA3129027B679F@mtv-atc-605e--n.corp.sgi.com>
2004-08-24 4:43 ` page fault scalability patch v3: use cmpxchg, make rss atomic Christoph Lameter
2004-08-24 4:43 ` Christoph Lameter
2004-08-24 5:49 ` Christoph Lameter
2004-08-24 5:49 ` Christoph Lameter
2004-08-24 12:34 ` Matthew Wilcox
2004-08-24 12:34 ` Matthew Wilcox
2004-08-24 14:47 ` Christoph Lameter
2004-08-24 14:47 ` Christoph Lameter
[not found] ` <B6E8046E1E28D34EB815A11AC8CA3129027B67A9@mtv-atc-605e--n.corp.sgi.com>
2004-08-26 15:20 ` page fault scalability patch v4: reduce page_table_lock use, atomic Christoph Lameter
2004-08-26 15:20 ` page fault scalability patch v4: reduce page_table_lock use, atomic pmd,pgd handlin Christoph Lameter
[not found] ` <B6E8046E1E28D34EB815A11AC8CA3129027B67B4@mtv-atc-605e--n.corp.sgi.com>
2004-08-27 23:20 ` page fault scalability patch final : i386 tested, x86_64 support Christoph Lameter
2004-08-27 23:20 ` page fault scalability patch final : i386 tested, x86_64 support added Christoph Lameter
2004-08-27 23:36 ` Andi Kleen
2004-08-27 23:36 ` Andi Kleen
2004-08-27 23:43 ` page fault scalability patch final : i386 tested, x86_64 David S. Miller
2004-08-27 23:43 ` page fault scalability patch final : i386 tested, x86_64 support added David S. Miller
2004-08-28 0:19 ` page fault scalability patch final : i386 tested, x86_64 support Christoph Lameter
2004-08-28 0:19 ` page fault scalability patch final : i386 tested, x86_64 support added Christoph Lameter
2004-08-28 0:23 ` page fault scalability patch final : i386 tested, x86_64 David S. Miller
2004-08-28 0:23 ` page fault scalability patch final : i386 tested, x86_64 support added David S. Miller
2004-08-28 0:36 ` page fault scalability patch final : i386 tested, x86_64 Andrew Morton
2004-08-28 0:36 ` page fault scalability patch final : i386 tested, x86_64 support added Andrew Morton
2004-08-28 0:40 ` page fault scalability patch final : i386 tested, x86_64 David S. Miller
2004-08-28 0:40 ` page fault scalability patch final : i386 tested, x86_64 support added David S. Miller
2004-08-28 1:05 ` Andi Kleen
2004-08-28 1:05 ` Andi Kleen
2004-08-28 1:11 ` page fault scalability patch final : i386 tested, x86_64 David S. Miller
2004-08-28 1:11 ` page fault scalability patch final : i386 tested, x86_64 support added David S. Miller
2004-08-28 1:17 ` Andi Kleen [this message]
2004-08-28 1:17 ` Andi Kleen
2004-08-28 1:02 ` Andi Kleen
2004-08-28 1:02 ` Andi Kleen
2004-08-28 1:39 ` page fault scalability patch final : i386 tested, x86_64 Andrew Morton
2004-08-28 1:39 ` page fault scalability patch final : i386 tested, x86_64 support added Andrew Morton
2004-08-28 2:08 ` page fault scalability patch final : i386 tested, x86_64 Paul Mackerras
2004-08-28 2:08 ` page fault scalability patch final : i386 tested, x86_64 support added Paul Mackerras
2004-08-28 3:32 ` page fault scalability patch final : i386 tested, x86_64 support Christoph Lameter
2004-08-28 3:32 ` page fault scalability patch final : i386 tested, x86_64 support added Christoph Lameter
2004-08-28 3:42 ` page fault scalability patch final : i386 tested, x86_64 Andrew Morton
2004-08-28 3:42 ` page fault scalability patch final : i386 tested, x86_64 support added Andrew Morton
2004-08-28 4:24 ` page fault scalability patch final : i386 tested, x86_64 support Christoph Lameter
2004-08-28 4:24 ` page fault scalability patch final : i386 tested, x86_64 support added Christoph Lameter
2004-08-28 5:39 ` page fault scalability patch final : i386 tested, x86_64 Andrew Morton
2004-08-28 5:39 ` page fault scalability patch final : i386 tested, x86_64 support added Andrew Morton
2004-08-28 5:58 ` page fault scalability patch final : i386 tested, x86_64 support Christoph Lameter
2004-08-28 5:58 ` page fault scalability patch final : i386 tested, x86_64 support added Christoph Lameter
2004-08-28 6:03 ` William Lee Irwin III
2004-08-28 6:03 ` William Lee Irwin III
2004-08-28 6:06 ` page fault scalability patch final : i386 tested, x86_64 Andrew Morton
2004-08-28 6:06 ` page fault scalability patch final : i386 tested, x86_64 support added Andrew Morton
2004-08-30 17:02 ` Herbert Poetzl
2004-08-30 17:02 ` Herbert Poetzl
2004-08-30 17:05 ` Andi Kleen
2004-08-30 17:05 ` Andi Kleen
2004-08-28 13:19 ` page fault scalability patch final : i386 tested, x86_64 Andi Kleen
2004-08-28 13:19 ` page fault scalability patch final : i386 tested, x86_64 support added Andi Kleen
2004-08-28 15:48 ` Matt Mackall
2004-08-28 15:48 ` Matt Mackall
2004-09-01 4:13 ` page fault scalability patch final : i386 tested, x86_64 Benjamin Herrenschmidt
2004-09-01 4:13 ` page fault scalability patch final : i386 tested, x86_64 support added Benjamin Herrenschmidt
2004-09-02 21:26 ` Andi Kleen
2004-09-02 21:26 ` Andi Kleen
2004-09-02 21:55 ` page fault scalability patch final : i386 tested, x86_64 David S. Miller
2004-09-02 21:55 ` page fault scalability patch final : i386 tested, x86_64 support added David S. Miller
2004-09-01 18:03 ` Matthew Wilcox
2004-09-01 18:19 ` Andrew Morton
2004-09-01 19:06 ` William Lee Irwin III
2004-08-28 21:41 ` Daniel Phillips
2004-08-28 21:41 ` Daniel Phillips
2004-09-01 4:24 ` page fault scalability patch final : i386 tested, x86_64 Benjamin Herrenschmidt
2004-09-01 4:24 ` page fault scalability patch final : i386 tested, x86_64 support added Benjamin Herrenschmidt
2004-09-01 5:22 ` page fault scalability patch final : i386 tested, x86_64 David S. Miller
2004-09-01 5:22 ` page fault scalability patch final : i386 tested, x86_64 support added David S. Miller
2004-09-01 16:43 ` page fault scalability patch final : i386 tested, x86_64 support Christoph Lameter
2004-09-01 16:43 ` page fault scalability patch final : i386 tested, x86_64 support added Christoph Lameter
2004-09-01 23:09 ` page fault scalability patch final : i386 tested, x86_64 Benjamin Herrenschmidt
2004-09-01 23:09 ` page fault scalability patch final : i386 tested, x86_64 support added Benjamin Herrenschmidt
[not found] ` <Pine.LNX.4.58.0409012140440.23186@schroedinger.engr.sgi.com>
[not found] ` <20040901215741.3538bbf4.davem@davemloft.net>
2004-09-02 5:18 ` William Lee Irwin III
2004-09-02 5:18 ` William Lee Irwin III
2004-09-09 15:38 ` page fault scalability patch: V7 (+fallback for atomic page table Christoph Lameter
2004-09-09 15:38 ` page fault scalability patch: V7 (+fallback for atomic page table ops) Christoph Lameter
2004-09-02 16:24 ` page fault scalability patch final : i386 tested, x86_64 support Christoph Lameter
2004-09-02 16:24 ` page fault scalability patch final : i386 tested, x86_64 support added Christoph Lameter
2004-09-02 20:10 ` page fault scalability patch final : i386 tested, x86_64 David S. Miller
2004-09-02 20:10 ` page fault scalability patch final : i386 tested, x86_64 support added David S. Miller
2004-09-02 21:02 ` page fault scalability patch final : i386 tested, x86_64 support Christoph Lameter
2004-09-02 21:02 ` page fault scalability patch final : i386 tested, x86_64 support added Christoph Lameter
2004-09-02 21:07 ` page fault scalability patch final : i386 tested, x86_64 David S. Miller
2004-09-02 21:07 ` page fault scalability patch final : i386 tested, x86_64 support added David S. Miller
2004-09-18 23:23 ` page fault scalability patch V8: [0/7] Description Christoph Lameter
2004-09-18 23:23 ` Christoph Lameter
[not found] ` <B6E8046E1E28D34EB815A11AC8CA312902CD3243@mtv-atc-605e--n.corp.sgi.com>
2004-09-18 23:24 ` page fault scalability patch V8: [1/7] make mm->rss atomic Christoph Lameter
2004-09-18 23:24 ` Christoph Lameter
2004-09-18 23:26 ` page fault scalability patch V8: [2/7] avoid page_table_lock in Christoph Lameter
2004-09-18 23:26 ` page fault scalability patch V8: [2/7] avoid page_table_lock in handle_mm_fault Christoph Lameter
2004-09-19 9:04 ` Christoph Hellwig
2004-09-19 9:04 ` Christoph Hellwig
2004-09-18 23:27 ` page fault scalability patch V8: [3/7] atomic pte operations for Christoph Lameter
2004-09-18 23:27 ` page fault scalability patch V8: [3/7] atomic pte operations for ia64 Christoph Lameter
2004-09-18 23:28 ` page fault scalability patch V8: [4/7] universally available cmpxchg Christoph Lameter
2004-09-18 23:28 ` page fault scalability patch V8: [4/7] universally available cmpxchg on i386 Christoph Lameter
[not found] ` <200409191430.37444.vda@port.imtp.ilyichevsk.odessa.ua>
2004-09-19 12:11 ` Andi Kleen
2004-09-19 12:11 ` Andi Kleen
2004-09-20 15:45 ` page fault scalability patch V8: [4/7] universally available Christoph Lameter
2004-09-20 15:45 ` page fault scalability patch V8: [4/7] universally available cmpxchg on i386 Christoph Lameter
[not found] ` <200409202043.00580.vda@port.imtp.ilyichevsk.odessa.ua>
2004-09-20 20:49 ` page fault scalability patch V8: [4/7] universally available Christoph Lameter
2004-09-20 20:49 ` page fault scalability patch V8: [4/7] universally available cmpxchg on i386 Christoph Lameter
2004-09-20 20:57 ` Andi Kleen
2004-09-20 20:57 ` Andi Kleen
[not found] ` <200409211841.25507.vda@port.imtp.ilyichevsk.odessa.ua>
2004-09-21 15:45 ` Andi Kleen
2004-09-21 15:45 ` Andi Kleen
[not found] ` <200409212306.38800.vda@port.imtp.ilyichevsk.odessa.ua>
2004-09-21 20:14 ` Andi Kleen
2004-09-21 20:14 ` Andi Kleen
2004-09-23 7:17 ` page fault scalability patch V8: [4/7] universally available Andy Lutomirski
2004-09-23 7:17 ` page fault scalability patch V8: [4/7] universally available cmpxchg on i386 Andy Lutomirski
2004-09-23 9:03 ` Andi Kleen
2004-09-23 9:03 ` Andi Kleen
2004-09-27 19:06 ` page fault scalability patch V9: [0/7] overview Christoph Lameter
2004-10-15 19:02 ` page fault scalability patch V10: " Christoph Lameter
2004-10-15 19:02 ` Christoph Lameter
2004-10-15 19:03 ` page fault scalability patch V10: [1/7] make rss atomic Christoph Lameter
2004-10-15 19:03 ` Christoph Lameter
2004-10-15 19:04 ` page fault scalability patch V10: [2/7] defer/omit taking page_table_lock Christoph Lameter
2004-10-15 19:04 ` Christoph Lameter
2004-10-15 20:00 ` Marcelo Tosatti
2004-10-15 20:00 ` Marcelo Tosatti
2004-10-18 15:59 ` page fault scalability patch V10: [2/7] defer/omit taking Christoph Lameter
2004-10-18 15:59 ` page fault scalability patch V10: [2/7] defer/omit taking page_table_lock Christoph Lameter
2004-10-19 5:25 ` [revised] page fault scalability patch V10: [2/7] defer/omit taking Christoph Lameter
2004-10-19 5:25 ` [revised] page fault scalability patch V10: [2/7] defer/omit taking page_table_lock Christoph Lameter
2004-10-15 19:05 ` page fault scalability patch V10: [3/7] IA64 atomic pte operations Christoph Lameter
2004-10-15 19:05 ` Christoph Lameter
2004-10-15 19:06 ` page fault scalability patch V10: [4/7] cmpxchg for 386 and 486 Christoph Lameter
2004-10-15 19:06 ` Christoph Lameter
2004-10-15 19:06 ` page fault scalability patch V10: [5/7] i386 atomic pte operations Christoph Lameter
2004-10-15 19:06 ` Christoph Lameter
2004-10-15 19:07 ` page fault scalability patch V10: [6/7] x86_64 " Christoph Lameter
2004-10-15 19:07 ` Christoph Lameter
2004-10-15 19:08 ` page fault scalability patch V10: [7/7] s/390 " Christoph Lameter
2004-10-15 19:08 ` Christoph Lameter
[not found] ` <B6E8046E1E28D34EB815A11AC8CA312902CD3282@mtv-atc-605e--n.corp.sgi.com>
2004-09-27 19:07 ` page fault scalability patch V9: [1/7] make mm->rss atomic Christoph Lameter
2004-09-27 19:08 ` page fault scalability patch V9: [2/7] defer/remove page_table_lock Christoph Lameter
2004-09-27 19:10 ` page fault scalability patch V9: [3/7] atomic pte operatios for ia64 Christoph Lameter
2004-09-27 19:10 ` page fault scalability patch V9: [4/7] generally available cmpxchg on i386 Christoph Lameter
2004-09-27 19:11 ` page fault scalability patch V9: [5/7] atomic pte operations for i386 Christoph Lameter
2004-09-27 19:12 ` page fault scalability patch V9: [6/7] atomic pte operations for x86_64 Christoph Lameter
2004-09-27 19:13 ` page fault scalability patch V9: [7/7] atomic pte operatiosn for s390 Christoph Lameter
2004-09-18 23:29 ` page fault scalability patch V8: [5/7] atomic pte operations for Christoph Lameter
2004-09-18 23:29 ` page fault scalability patch V8: [5/7] atomic pte operations for i386 Christoph Lameter
2004-09-18 23:30 ` page fault scalability patch V8: [6/7] atomic pte operations for Christoph Lameter
2004-09-18 23:30 ` page fault scalability patch V8: [6/7] atomic pte operations for x86_64 Christoph Lameter
2004-09-18 23:31 ` page fault scalability patch V8: [7/7] atomic pte operations for Christoph Lameter
2004-09-18 23:31 ` page fault scalability patch V8: [7/7] atomic pte operations for s390 Christoph Lameter
[not found] ` <200409191435.09445.vda@port.imtp.ilyichevsk.odessa.ua>
2004-09-20 15:44 ` page fault scalability patch V8: [7/7] atomic pte operations Christoph Lameter
2004-09-20 15:44 ` page fault scalability patch V8: [7/7] atomic pte operations for s390 Christoph Lameter
2004-08-15 22:38 ` page fault fastpath: Increasing SMP scalability by introducing Benjamin Herrenschmidt
2004-08-15 22:38 ` page fault fastpath: Increasing SMP scalability by introducing pte locks? Benjamin Herrenschmidt
2004-08-16 17:28 ` page fault fastpath: Increasing SMP scalability by introducing Christoph Lameter
2004-08-16 17:28 ` page fault fastpath: Increasing SMP scalability by introducing pte locks? Christoph Lameter
2004-08-17 8:01 ` page fault fastpath: Increasing SMP scalability by introducing Benjamin Herrenschmidt
2004-08-17 8:01 ` page fault fastpath: Increasing SMP scalability by introducing pte locks? Benjamin Herrenschmidt
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20040828011759.GF50329@muc.de \
--to=ak@muc.de \
--cc=ak@suse.de \
--cc=akpm@osdl.org \
--cc=benh@kernel.crashing.org \
--cc=clameter@sgi.com \
--cc=davem@davemloft.net \
--cc=davem@redhat.com \
--cc=hugh@veritas.com \
--cc=linux-ia64@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=manfred@colorfullife.com \
--cc=raybry@sgi.com \
--cc=vrajesh@umich.edu \
--cc=wli@holomorphy.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.