linux-mm.kvack.org archive mirror
 help / color / mirror / Atom feed
From: Matt Mackall <mpm@selenic.com>
To: Andrew Morton <akpm@linux-foundation.org>
Cc: Tony Luck <tony.luck@gmail.com>,
	fengguang.wu@intel.com, mingo@elte.hu, rostedt@goodmis.org,
	fweisbec@gmail.com, lwoodman@redhat.com, a.p.zijlstra@chello.nl,
	penberg@cs.helsinki.fi, eduard.munteanu@linux360.ro,
	linux-kernel@vger.kernel.org, kosaki.motohiro@jp.fujitsu.com,
	andi@firstfloor.org, adobriyan@gmail.com, linux-mm@kvack.org
Subject: Re: [PATCH 5/5] proc: export more page flags in /proc/kpageflags
Date: Tue, 28 Apr 2009 16:49:55 -0500	[thread overview]
Message-ID: <1240955395.938.1031.camel@calx> (raw)
In-Reply-To: <20090428141738.77e599f4.akpm@linux-foundation.org>

On Tue, 2009-04-28 at 14:17 -0700, Andrew Morton wrote:
> On Tue, 28 Apr 2009 11:11:52 -0700
> Tony Luck <tony.luck@gmail.com> wrote:
> 
> > On Tue, Apr 28, 2009 at 1:33 AM, Wu Fengguang <fengguang.wu@intel.com> wrote:
> > > 1) FAST
> > >
> > > It takes merely 0.2s to scan 4GB pages:
> > >
> > > __ __ __ __./page-types __0.02s user 0.20s system 99% cpu 0.216 total
> > 
> > OK on a tiny system ... but sounds painful on a big
> > server. 0.2s for 4G scales up to 3 minutes 25 seconds
> > on a 4TB system (4TB systems were being sold two
> > years ago ... so by now the high end will have moved
> > up to 8TB or perhaps 16TB).
> > 
> > Would the resulting output be anything but noise on
> > a big system (a *lot* of pages can change state in
> > 3 minutes)?
> > 
> 
> Reading the state of all of memory in this fashion would be a somewhat
> peculiar thing to do.

Not entirely. If you've got, say, a large NUMA box, it could be
incredibly illustrative to see that "oh, this node is entirely dominated
by SLAB allocations". Or on a smaller machine "oh, this is fragmented to
hell and there's no way I'm going to get a huge page". Things you're not
going to get from individual stats.

> Generally, I think that pagemap is another of those things where we've
> failed on the follow-through.  There's a nice and powerful interface
> for inspecting the state of a process's VM, but nobody knows about it
> and there are no tools for accessing it and nobody is using it.

People keep finding bugs in the thing exercising it in new ways, so I
presume people are writing their own tools. My hope was that my original
tools would inspire someone to take it and run with it - I really have
no stomach for writing GUI tools.

However, I've recent gone and written a pretty generically useful
command-line tool that hopefully will get more traction:

http://www.selenic.com/smem/

I'm expecting it to get written up on LWN shortly, so I haven't spent
much time doing my own advertising.

-- 
http://selenic.com : development and support for Mercurial and Linux


--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

  reply	other threads:[~2009-04-28 21:49 UTC|newest]

Thread overview: 68+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2009-04-28  1:09 [PATCH 0/5] proc: export more page flags in /proc/kpageflags (take 4) Wu Fengguang
2009-04-28  1:09 ` [PATCH 1/5] pagemap: document clarifications Wu Fengguang
2009-04-28  7:11   ` Tommi Rantala
2009-04-28  1:09 ` [PATCH 2/5] pagemap: documentation 9 more exported page flags Wu Fengguang
2009-04-28  1:09 ` [PATCH 3/5] mm: introduce PageHuge() for testing huge/gigantic pages Wu Fengguang
2009-04-28  1:09 ` [PATCH 4/5] proc: kpagecount/kpageflags code cleanup Wu Fengguang
2009-04-28  1:09 ` [PATCH 5/5] proc: export more page flags in /proc/kpageflags Wu Fengguang
2009-04-28  6:55   ` Ingo Molnar
2009-04-28  7:40     ` Andi Kleen
2009-04-28  9:04       ` Pekka Enberg
2009-04-28  9:10         ` Andi Kleen
2009-04-28  9:15           ` Pekka Enberg
2009-04-28  9:15         ` Ingo Molnar
2009-04-28  9:19           ` Pekka Enberg
2009-04-28  9:25             ` Pekka Enberg
2009-04-28  9:36               ` Wu Fengguang
2009-04-28  9:36               ` Ingo Molnar
2009-04-28  9:57                 ` Pekka Enberg
2009-04-28 10:10                   ` KOSAKI Motohiro
2009-04-28 10:21                     ` Pekka Enberg
2009-04-28 10:56                       ` Ingo Molnar
2009-04-28 11:09                         ` KOSAKI Motohiro
2009-04-28 12:42                           ` Ingo Molnar
2009-04-28 11:03                   ` Ingo Molnar
2009-04-28 17:42                 ` Matt Mackall
2009-04-28  9:29             ` Ingo Molnar
2009-04-28  9:34               ` KOSAKI Motohiro
2009-04-28  9:38                 ` Ingo Molnar
2009-04-28  9:55                   ` Wu Fengguang
2009-04-28 10:11                     ` KOSAKI Motohiro
2009-04-28 11:05                     ` Ingo Molnar
2009-04-28 11:36                       ` Wu Fengguang
2009-04-28 12:17                         ` [rfc] object collection tracing (was: [PATCH 5/5] proc: export more page flags in /proc/kpageflags) Ingo Molnar
2009-04-28 13:31                           ` Wu Fengguang
2009-05-12 13:01                             ` Frederic Weisbecker
2009-05-17 13:36                               ` Wu Fengguang
2009-05-17 13:55                                 ` Frederic Weisbecker
2009-05-17 14:12                                   ` Wu Fengguang
2009-05-18 11:44                                 ` KOSAKI Motohiro
2009-05-18 11:47                                   ` Wu Fengguang
2009-04-28 10:18                   ` [PATCH 5/5] proc: export more page flags in /proc/kpageflags Andi Kleen
2009-04-28  8:33     ` Wu Fengguang
2009-04-28  9:24       ` Ingo Molnar
2009-04-28 18:11       ` Tony Luck
2009-04-28 18:34         ` Matt Mackall
2009-04-28 20:47           ` Tony Luck
2009-04-28 20:54             ` Andi Kleen
2009-04-28 20:59             ` Matt Mackall
2009-04-28 21:17         ` Andrew Morton
2009-04-28 21:49           ` Matt Mackall [this message]
2009-04-29  0:02             ` Robin Holt
2009-04-28 17:49   ` Matt Mackall
2009-04-29  8:05     ` Wu Fengguang
2009-04-29 19:13       ` Matt Mackall
2009-04-30  1:00         ` Wu Fengguang
2009-04-28 21:32   ` Andrew Morton
2009-04-28 22:46     ` Matt Mackall
2009-04-28 23:02       ` Andrew Morton
2009-04-28 23:31         ` Matt Mackall
2009-04-28 23:42           ` Andrew Morton
2009-04-28 23:55             ` Matt Mackall
2009-04-29  3:33               ` Wu Fengguang
2009-04-29  2:38     ` Wu Fengguang
2009-04-29  2:55       ` Andrew Morton
2009-04-29  3:48         ` Wu Fengguang
2009-04-29  5:09           ` Wu Fengguang
2009-04-29  4:41       ` Nathan Lynch
2009-04-29  4:50         ` Andrew Morton

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=1240955395.938.1031.camel@calx \
    --to=mpm@selenic.com \
    --cc=a.p.zijlstra@chello.nl \
    --cc=adobriyan@gmail.com \
    --cc=akpm@linux-foundation.org \
    --cc=andi@firstfloor.org \
    --cc=eduard.munteanu@linux360.ro \
    --cc=fengguang.wu@intel.com \
    --cc=fweisbec@gmail.com \
    --cc=kosaki.motohiro@jp.fujitsu.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=lwoodman@redhat.com \
    --cc=mingo@elte.hu \
    --cc=penberg@cs.helsinki.fi \
    --cc=rostedt@goodmis.org \
    --cc=tony.luck@gmail.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).