From: Lee Schermerhorn <Lee.Schermerhorn@hp.com>
To: KOSAKI Motohiro <kosaki.motohiro@jp.fujitsu.com>
Cc: Atsushi Tsuji <a-tsuji@bk.jp.nec.com>,
Peter Zijlstra <peterz@infradead.org>,
linux-kernel@vger.kernel.org, Jason Baron <jbaron@redhat.com>,
Ingo Molnar <mingo@elte.hu>,
Mathieu Desnoyers <compudj@krystal.dyndns.org>,
"Frank Ch. Eigler" <fche@redhat.com>,
Kazuto Miyoshi <miyoshi@linux.bs1.fc.nec.co.jp>,
rostedt@goodmis.org, linux-mm <linux-mm@kvack.org>,
Andrew Morton <akpm@linux-foundation.org>,
Nick Piggin <nickpiggin@yahoo.com.au>,
Hugh Dickins <hugh@veritas.com>
Subject: Re: [PATCH] Add tracepoints to track pagecache transition
Date: Thu, 19 Feb 2009 09:21:31 -0500 [thread overview]
Message-ID: <1235053291.8424.14.camel@lts-notebook> (raw)
In-Reply-To: <2f11576a0902190512y1ac60b11s4927533977dc01e7@mail.gmail.com>
On Thu, 2009-02-19 at 22:12 +0900, KOSAKI Motohiro wrote:
> > Hi Kosaki-san,
> >
> > Thank you for your comment.
> >
> > KOSAKI Motohiro wrote:
> >> Hi
> >>
> >>
> >> In my 1st impression, this patch description is a bit strange.
> >>
> >>> The below patch adds instrumentation for pagecache.
> >>>
> >>> I thought it would be useful to trace pagecache behavior for problem
> >>> analysis (performance bottlenecks, behavior differences between stable
> >>> time and trouble time).
> >>>
> >>> By using those tracepoints, we can describe and visualize pagecache
> >>> transition (file-by-file basis) in kernel and pagecache
> >>> consumes most of the memory in running system and pagecache hit rate
> >>> and writeback behavior will influence system load and performance.
> >>
> >> Why do you think this tracepoint describe pagecache hit rate?
> >> and, why describe writeback behavior?
> >
> > I mean, we can describe file-by-file basis pagecache usage by using
> > these tracepoints and it is important for analyzing process I/O behavior.
>
> More confusing.
> Your page cache tracepoint don't have any per-process information.
>
>
> > Currently, we can understand the amount of pagecache from "Cached"
> > in /proc/meminfo. So I'd like to understand which files are using pagecache.
>
> There is one meta question, Why do you think file-by-file pagecache
> infomartion is valueable?
>
One might take a look at Marcello Tosatti's old 'vmtrace' patch. It
contains it's own data store/transport via relayfs, but the trace points
could be ported to the current kernel tracing infrastructure.
Here's a starting point: http://linux-mm.org/VmTrace
Quoting from that page:
>From the previous email to linux-mm:
>"The sequence of pages which a given process or workload accesses
>during its lifetime, a.k.a. "reference trace", is very important
>information. It has been used in the past for comparison of page
>replacement algorithms and other optimizations..."
Lee
WARNING: multiple messages have this Message-ID (diff)
From: Lee Schermerhorn <Lee.Schermerhorn@hp.com>
To: KOSAKI Motohiro <kosaki.motohiro@jp.fujitsu.com>
Cc: Atsushi Tsuji <a-tsuji@bk.jp.nec.com>,
Peter Zijlstra <peterz@infradead.org>,
linux-kernel@vger.kernel.org, Jason Baron <jbaron@redhat.com>,
Ingo Molnar <mingo@elte.hu>,
Mathieu Desnoyers <compudj@krystal.dyndns.org>,
"Frank Ch. Eigler" <fche@redhat.com>,
Kazuto Miyoshi <miyoshi@linux.bs1.fc.nec.co.jp>,
rostedt@goodmis.org, linux-mm <linux-mm@kvack.org>,
Andrew Morton <akpm@linux-foundation.org>,
Nick Piggin <nickpiggin@yahoo.com.au>,
Hugh Dickins <hugh@veritas.com>
Subject: Re: [PATCH] Add tracepoints to track pagecache transition
Date: Thu, 19 Feb 2009 09:21:31 -0500 [thread overview]
Message-ID: <1235053291.8424.14.camel@lts-notebook> (raw)
In-Reply-To: <2f11576a0902190512y1ac60b11s4927533977dc01e7@mail.gmail.com>
On Thu, 2009-02-19 at 22:12 +0900, KOSAKI Motohiro wrote:
> > Hi Kosaki-san,
> >
> > Thank you for your comment.
> >
> > KOSAKI Motohiro wrote:
> >> Hi
> >>
> >>
> >> In my 1st impression, this patch description is a bit strange.
> >>
> >>> The below patch adds instrumentation for pagecache.
> >>>
> >>> I thought it would be useful to trace pagecache behavior for problem
> >>> analysis (performance bottlenecks, behavior differences between stable
> >>> time and trouble time).
> >>>
> >>> By using those tracepoints, we can describe and visualize pagecache
> >>> transition (file-by-file basis) in kernel and pagecache
> >>> consumes most of the memory in running system and pagecache hit rate
> >>> and writeback behavior will influence system load and performance.
> >>
> >> Why do you think this tracepoint describe pagecache hit rate?
> >> and, why describe writeback behavior?
> >
> > I mean, we can describe file-by-file basis pagecache usage by using
> > these tracepoints and it is important for analyzing process I/O behavior.
>
> More confusing.
> Your page cache tracepoint don't have any per-process information.
>
>
> > Currently, we can understand the amount of pagecache from "Cached"
> > in /proc/meminfo. So I'd like to understand which files are using pagecache.
>
> There is one meta question, Why do you think file-by-file pagecache
> infomartion is valueable?
>
One might take a look at Marcello Tosatti's old 'vmtrace' patch. It
contains it's own data store/transport via relayfs, but the trace points
could be ported to the current kernel tracing infrastructure.
Here's a starting point: http://linux-mm.org/VmTrace
Quoting from that page:
>From the previous email to linux-mm:
>"The sequence of pages which a given process or workload accesses
>during its lifetime, a.k.a. "reference trace", is very important
>information. It has been used in the past for comparison of page
>replacement algorithms and other optimizations..."
Lee
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
next prev parent reply other threads:[~2009-02-19 14:21 UTC|newest]
Thread overview: 27+ messages / expand[flat|nested] mbox.gz Atom feed top
2009-02-17 9:00 [PATCH] Add tracepoints to track pagecache transition Atsushi Tsuji
2009-02-17 9:33 ` Peter Zijlstra
2009-02-17 9:33 ` Peter Zijlstra
2009-02-17 11:04 ` Atsushi Tsuji
2009-02-17 11:04 ` Atsushi Tsuji
2009-02-17 11:38 ` KOSAKI Motohiro
2009-02-17 11:38 ` KOSAKI Motohiro
2009-02-17 11:54 ` Peter Zijlstra
2009-02-17 11:54 ` Peter Zijlstra
2009-02-17 12:33 ` KOSAKI Motohiro
2009-02-17 12:33 ` KOSAKI Motohiro
2009-02-17 14:33 ` Frederic Weisbecker
2009-02-17 14:33 ` Frederic Weisbecker
2009-02-18 0:29 ` KOSAKI Motohiro
2009-02-18 0:29 ` KOSAKI Motohiro
2009-02-19 4:41 ` Atsushi Tsuji
2009-02-19 4:41 ` Atsushi Tsuji
2009-02-19 13:12 ` KOSAKI Motohiro
2009-02-19 13:12 ` KOSAKI Motohiro
2009-02-19 14:21 ` Lee Schermerhorn [this message]
2009-02-19 14:21 ` Lee Schermerhorn
2009-02-20 1:13 ` KOSAKI Motohiro
2009-02-20 1:13 ` KOSAKI Motohiro
2009-02-17 15:24 ` Steven Rostedt
2009-02-17 15:24 ` Steven Rostedt
2009-02-19 18:51 ` Christoph Hellwig
2009-02-19 18:51 ` Christoph Hellwig
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1235053291.8424.14.camel@lts-notebook \
--to=lee.schermerhorn@hp.com \
--cc=a-tsuji@bk.jp.nec.com \
--cc=akpm@linux-foundation.org \
--cc=compudj@krystal.dyndns.org \
--cc=fche@redhat.com \
--cc=hugh@veritas.com \
--cc=jbaron@redhat.com \
--cc=kosaki.motohiro@jp.fujitsu.com \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=mingo@elte.hu \
--cc=miyoshi@linux.bs1.fc.nec.co.jp \
--cc=nickpiggin@yahoo.com.au \
--cc=peterz@infradead.org \
--cc=rostedt@goodmis.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.