All of lore.kernel.org
 help / color / mirror / Atom feed
From: Johannes Weiner <hannes@cmpxchg.org>
To: Vlastimil Babka <vbabka@suse.cz>
Cc: Andrew Morton <akpm@linux-foundation.org>,
	Andi Kleen <andi@firstfloor.org>,
	Andrea Arcangeli <aarcange@redhat.com>,
	Greg Thelen <gthelen@google.com>,
	Christoph Hellwig <hch@infradead.org>,
	Hugh Dickins <hughd@google.com>, Jan Kara <jack@suse.cz>,
	KOSAKI Motohiro <kosaki.motohiro@jp.fujitsu.com>,
	Mel Gorman <mgorman@suse.de>, Minchan Kim <minchan.kim@gmail.com>,
	Peter Zijlstra <peterz@infradead.org>,
	Rik van Riel <riel@redhat.com>,
	Michel Lespinasse <walken@google.com>,
	Seth Jennings <sjenning@linux.vnet.ibm.com>,
	Roman Gushchin <klamm@yandex-team.ru>,
	Ozgun Erdogan <ozgun@citusdata.com>,
	Metin Doslu <metin@citusdata.com>, Tejun Heo <tj@kernel.org>,
	linux-mm@kvack.org, linux-fsdevel@vger.kernel.org,
	linux-kernel@vger.kernel.org
Subject: Re: [patch 0/8] mm: thrash detection-based file cache sizing v5
Date: Tue, 22 Oct 2013 05:35:12 -0400	[thread overview]
Message-ID: <20131022093512.GC707@cmpxchg.org> (raw)
In-Reply-To: <5264F353.1080603@suse.cz>

On Mon, Oct 21, 2013 at 11:26:43AM +0200, Vlastimil Babka wrote:
> On 10/10/2013 11:46 PM, Johannes Weiner wrote:
> > Hi everyone,
> > 
> > here is an update to the cache sizing patches for 3.13.
> > 
> > 	Changes in this revision
> > 
> > o Drop frequency synchronization between refaulted and demoted pages
> >   and just straight up activate refaulting pages whose access
> >   frequency indicates they could stay in memory.  This was suggested
> >   by Rik van Riel a looong time ago but misinterpretation of test
> >   results during early stages of development took me a while to
> >   overcome.  It's still the same overall concept, but a little simpler
> >   and with even faster cache adaptation.  Yay!
> 
> Oh, I liked the previous approach with direct competition between the
> refaulted and demoted page :) Doesn't the new approach favor the
> refaulted page too much? No wonder it leads to faster cache adaptation,
> but could it also cause degradations for workloads that don't benefit
> from it? Were there any tests for performance regressions on workloads
> that were not the target of the patchset?

If anything, it's unfair to refaulting pages because it requires 3
references before they are activated instead of the regular 2.

We don't do the direct competition for regular in-core activation,
either, which has the same theoretical problem but was never an issue
in the real world.  Not that I know of anyway.

I ran a standard battery of mmtests (kernbench, dbench, postmark,
micro, fsmark, what have you) and did not notice any regressions.

WARNING: multiple messages have this Message-ID (diff)
From: Johannes Weiner <hannes@cmpxchg.org>
To: Vlastimil Babka <vbabka@suse.cz>
Cc: Andrew Morton <akpm@linux-foundation.org>,
	Andi Kleen <andi@firstfloor.org>,
	Andrea Arcangeli <aarcange@redhat.com>,
	Greg Thelen <gthelen@google.com>,
	Christoph Hellwig <hch@infradead.org>,
	Hugh Dickins <hughd@google.com>, Jan Kara <jack@suse.cz>,
	KOSAKI Motohiro <kosaki.motohiro@jp.fujitsu.com>,
	Mel Gorman <mgorman@suse.de>, Minchan Kim <minchan.kim@gmail.com>,
	Peter Zijlstra <peterz@infradead.org>,
	Rik van Riel <riel@redhat.com>,
	Michel Lespinasse <walken@google.com>,
	Seth Jennings <sjenning@linux.vnet.ibm.com>,
	Roman Gushchin <klamm@yandex-team.ru>,
	Ozgun Erdogan <ozgun@citusdata.com>,
	Metin Doslu <metin@citusdata.com>, Tejun Heo <tj@kernel.org>,
	linux-mm@kvack.org, linux-fsdevel@vger.kernel.org,
	linux-kernel@vger.kernel.org
Subject: Re: [patch 0/8] mm: thrash detection-based file cache sizing v5
Date: Tue, 22 Oct 2013 05:35:12 -0400	[thread overview]
Message-ID: <20131022093512.GC707@cmpxchg.org> (raw)
In-Reply-To: <5264F353.1080603@suse.cz>

On Mon, Oct 21, 2013 at 11:26:43AM +0200, Vlastimil Babka wrote:
> On 10/10/2013 11:46 PM, Johannes Weiner wrote:
> > Hi everyone,
> > 
> > here is an update to the cache sizing patches for 3.13.
> > 
> > 	Changes in this revision
> > 
> > o Drop frequency synchronization between refaulted and demoted pages
> >   and just straight up activate refaulting pages whose access
> >   frequency indicates they could stay in memory.  This was suggested
> >   by Rik van Riel a looong time ago but misinterpretation of test
> >   results during early stages of development took me a while to
> >   overcome.  It's still the same overall concept, but a little simpler
> >   and with even faster cache adaptation.  Yay!
> 
> Oh, I liked the previous approach with direct competition between the
> refaulted and demoted page :) Doesn't the new approach favor the
> refaulted page too much? No wonder it leads to faster cache adaptation,
> but could it also cause degradations for workloads that don't benefit
> from it? Were there any tests for performance regressions on workloads
> that were not the target of the patchset?

If anything, it's unfair to refaulting pages because it requires 3
references before they are activated instead of the regular 2.

We don't do the direct competition for regular in-core activation,
either, which has the same theoretical problem but was never an issue
in the real world.  Not that I know of anyway.

I ran a standard battery of mmtests (kernbench, dbench, postmark,
micro, fsmark, what have you) and did not notice any regressions.

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

  reply	other threads:[~2013-10-22  9:35 UTC|newest]

Thread overview: 41+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2013-10-10 21:46 [patch 0/8] mm: thrash detection-based file cache sizing v5 Johannes Weiner
2013-10-10 21:46 ` [patch 1/8] fs: cachefiles: use add_to_page_cache_lru() Johannes Weiner
2013-10-10 21:46 ` [patch 2/8] lib: radix-tree: radix_tree_delete_item() Johannes Weiner
2013-10-10 21:46 ` [patch 3/8] mm: shmem: save one radix tree lookup when truncating swapped pages Johannes Weiner
2013-10-10 21:46 ` [patch 4/8] mm: filemap: move radix tree hole searching here Johannes Weiner
2013-10-10 21:46 ` [patch 5/8] mm + fs: prepare for non-page entries in page cache radix trees Johannes Weiner
2013-10-10 21:47 ` [patch 6/8] mm + fs: store shadow entries in page cache Johannes Weiner
2013-10-10 21:47 ` [patch 7/8] mm: thrash detection-based file cache sizing Johannes Weiner
2013-10-10 21:47 ` [patch 8/8] mm: workingset: keep shadow entries in check Johannes Weiner
2013-10-11  0:39 ` [patch 0/8] mm: thrash detection-based file cache sizing v5 Dave Chinner
2013-10-11  0:39   ` Dave Chinner
2013-10-14 21:42   ` Johannes Weiner
2013-10-14 21:42     ` Johannes Weiner
2013-10-15  1:41     ` Dave Chinner
2013-10-15  1:41       ` Dave Chinner
2013-10-15 10:27       ` Jan Kara
2013-10-15 10:27         ` Jan Kara
2013-10-15 17:41       ` Johannes Weiner
2013-10-15 17:41         ` Johannes Weiner
2013-10-15 23:41         ` Dave Chinner
2013-10-15 23:41           ` Dave Chinner
2013-10-16  2:05           ` Rik van Riel
2013-10-16  2:05             ` Rik van Riel
2013-10-16  2:05             ` Rik van Riel
2013-10-16  2:26             ` Dave Chinner
2013-10-16  2:26               ` Dave Chinner
2013-10-16 22:31               ` Johannes Weiner
2013-10-16 22:31                 ` Johannes Weiner
2013-10-21 12:10                 ` Dave Chinner
2013-10-21 12:10                   ` Dave Chinner
2013-10-21  9:26 ` Vlastimil Babka
2013-10-21  9:26   ` Vlastimil Babka
2013-10-22  9:35   ` Johannes Weiner [this message]
2013-10-22  9:35     ` Johannes Weiner
2013-11-14 15:56   ` Rik van Riel
2013-11-14 15:56     ` Rik van Riel
2013-11-12 10:30 ` Bob Liu
2013-11-12 10:30   ` Bob Liu
2013-11-14 15:53   ` Rik van Riel
2013-11-14 15:53     ` Rik van Riel
2013-11-14 15:53     ` Rik van Riel

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20131022093512.GC707@cmpxchg.org \
    --to=hannes@cmpxchg.org \
    --cc=aarcange@redhat.com \
    --cc=akpm@linux-foundation.org \
    --cc=andi@firstfloor.org \
    --cc=gthelen@google.com \
    --cc=hch@infradead.org \
    --cc=hughd@google.com \
    --cc=jack@suse.cz \
    --cc=klamm@yandex-team.ru \
    --cc=kosaki.motohiro@jp.fujitsu.com \
    --cc=linux-fsdevel@vger.kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=metin@citusdata.com \
    --cc=mgorman@suse.de \
    --cc=minchan.kim@gmail.com \
    --cc=ozgun@citusdata.com \
    --cc=peterz@infradead.org \
    --cc=riel@redhat.com \
    --cc=sjenning@linux.vnet.ibm.com \
    --cc=tj@kernel.org \
    --cc=vbabka@suse.cz \
    --cc=walken@google.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.