From: Johannes Weiner <hannes@cmpxchg.org>
To: Andrew Morton <akpm@linux-foundation.org>
Cc: Andi Kleen <andi@firstfloor.org>,
Andrea Arcangeli <aarcange@redhat.com>,
Bob Liu <bob.liu@oracle.com>,
Christoph Hellwig <hch@infradead.org>,
Dave Chinner <david@fromorbit.com>,
Greg Thelen <gthelen@google.com>, Hugh Dickins <hughd@google.com>,
Jan Kara <jack@suse.cz>,
KOSAKI Motohiro <kosaki.motohiro@jp.fujitsu.com>,
Luigi Semenzato <semenzato@google.com>,
Mel Gorman <mgorman@suse.de>, Metin Doslu <metin@citusdata.com>,
Michel Lespinasse <walken@google.com>,
Minchan Kim <minchan.kim@gmail.com>,
Ozgun Erdogan <ozgun@citusdata.com>,
Peter Zijlstra <peterz@infradead.org>,
Rik van Riel <riel@redhat.com>,
Roman Gushchin <klamm@yandex-team.ru>,
Ryan Mallon <rmallon@gmail.com>, Tejun Heo <tj@kernel.org>,
Vlastimil Babka <vbabka@suse.cz>,
linux-mm@kvack.org, linux-fsdevel@vger.kernel.org,
linux-kernel@vger.kernel.org
Subject: Re: [patch 00/10] mm: thrash detection-based file cache sizing v9
Date: Tue, 4 Feb 2014 21:02:22 -0500 [thread overview]
Message-ID: <20140205020222.GX6963@cmpxchg.org> (raw)
In-Reply-To: <20140204151424.d08301233c1f1801f43498b1@linux-foundation.org>
On Tue, Feb 04, 2014 at 03:14:24PM -0800, Andrew Morton wrote:
> On Mon, 3 Feb 2014 19:53:32 -0500 Johannes Weiner <hannes@cmpxchg.org> wrote:
>
> > o Fix vmstat build problems on UP (Fengguang Wu's build bot)
> >
> > o Clarify why optimistic radix_tree_node->private_list link checking
> > is safe without holding the list_lru lock (Dave Chinner)
> >
> > o Assert locking balance when the list_lru isolator says it dropped
> > the list lock (Dave Chinner)
> >
> > o Remove remnant of a manual reclaim counter in the shadow isolator,
> > the list_lru-provided accounting is accurate now that we added
> > LRU_REMOVED_RETRY (Dave Chinner)
> >
> > o Set an object limit for the shadow shrinker instead of messing with
> > its seeks setting. The configured seeks define how pressure applied
> > to pages translates to pressure on the object pool, in itself it is
> > not enough to replace proper object valuation to classify expired
> > and in-use objects. Shadow nodes contain up to 64 shadow entries
> > from different/alternating zones that have their own atomic age
> > counter, so determining if a node is overall expired is crazy
> > expensive. Instead, use an object limit above which nodes are very
> > likely to be expired.
> >
> > o __pagevec_lookup and __find_get_pages kerneldoc fixes (Minchan Kim)
> >
> > o radix_tree_node->count accessors for pages and shadows (Minchan Kim)
> >
> > o Rebase to v3.14-rc1 and add review tags
>
> An earlier version caused a 24-byte inode bloatage. That appears to
> have been reduced to 8 bytes, yes? What was done there?
Instead of inodes, the shrinker now directly tracks radix tree nodes
that contain only shadow entries. So the 16 bytes for the list_head
are now in struct radix_tree_node, but due to different slab packing
it didn't increase memory consumption.
> > 69 files changed, 1438 insertions(+), 462 deletions(-)
>
> omigod
Most of it is comments and Minchan's accessor functions.
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
WARNING: multiple messages have this Message-ID (diff)
From: Johannes Weiner <hannes@cmpxchg.org>
To: Andrew Morton <akpm@linux-foundation.org>
Cc: Andi Kleen <andi@firstfloor.org>,
Andrea Arcangeli <aarcange@redhat.com>,
Bob Liu <bob.liu@oracle.com>,
Christoph Hellwig <hch@infradead.org>,
Dave Chinner <david@fromorbit.com>,
Greg Thelen <gthelen@google.com>, Hugh Dickins <hughd@google.com>,
Jan Kara <jack@suse.cz>,
KOSAKI Motohiro <kosaki.motohiro@jp.fujitsu.com>,
Luigi Semenzato <semenzato@google.com>,
Mel Gorman <mgorman@suse.de>, Metin Doslu <metin@citusdata.com>,
Michel Lespinasse <walken@google.com>,
Minchan Kim <minchan.kim@gmail.com>,
Ozgun Erdogan <ozgun@citusdata.com>,
Peter Zijlstra <peterz@infradead.org>,
Rik van Riel <riel@redhat.com>,
Roman Gushchin <klamm@yandex-team.ru>,
Ryan Mallon <rmallon@gmail.com>, Tejun Heo <tj@kernel.org>,
Vlastimil Babka <vbabka@suse.cz>,
linux-mm@kvack.org, linux-fsdevel@vger.kernel.org,
linux-kernel@vger.kernel.org
Subject: Re: [patch 00/10] mm: thrash detection-based file cache sizing v9
Date: Tue, 4 Feb 2014 21:02:22 -0500 [thread overview]
Message-ID: <20140205020222.GX6963@cmpxchg.org> (raw)
In-Reply-To: <20140204151424.d08301233c1f1801f43498b1@linux-foundation.org>
On Tue, Feb 04, 2014 at 03:14:24PM -0800, Andrew Morton wrote:
> On Mon, 3 Feb 2014 19:53:32 -0500 Johannes Weiner <hannes@cmpxchg.org> wrote:
>
> > o Fix vmstat build problems on UP (Fengguang Wu's build bot)
> >
> > o Clarify why optimistic radix_tree_node->private_list link checking
> > is safe without holding the list_lru lock (Dave Chinner)
> >
> > o Assert locking balance when the list_lru isolator says it dropped
> > the list lock (Dave Chinner)
> >
> > o Remove remnant of a manual reclaim counter in the shadow isolator,
> > the list_lru-provided accounting is accurate now that we added
> > LRU_REMOVED_RETRY (Dave Chinner)
> >
> > o Set an object limit for the shadow shrinker instead of messing with
> > its seeks setting. The configured seeks define how pressure applied
> > to pages translates to pressure on the object pool, in itself it is
> > not enough to replace proper object valuation to classify expired
> > and in-use objects. Shadow nodes contain up to 64 shadow entries
> > from different/alternating zones that have their own atomic age
> > counter, so determining if a node is overall expired is crazy
> > expensive. Instead, use an object limit above which nodes are very
> > likely to be expired.
> >
> > o __pagevec_lookup and __find_get_pages kerneldoc fixes (Minchan Kim)
> >
> > o radix_tree_node->count accessors for pages and shadows (Minchan Kim)
> >
> > o Rebase to v3.14-rc1 and add review tags
>
> An earlier version caused a 24-byte inode bloatage. That appears to
> have been reduced to 8 bytes, yes? What was done there?
Instead of inodes, the shrinker now directly tracks radix tree nodes
that contain only shadow entries. So the 16 bytes for the list_head
are now in struct radix_tree_node, but due to different slab packing
it didn't increase memory consumption.
> > 69 files changed, 1438 insertions(+), 462 deletions(-)
>
> omigod
Most of it is comments and Minchan's accessor functions.
next prev parent reply other threads:[~2014-02-05 2:02 UTC|newest]
Thread overview: 51+ messages / expand[flat|nested] mbox.gz Atom feed top
2014-02-04 0:53 [patch 00/10] mm: thrash detection-based file cache sizing v9 Johannes Weiner
2014-02-04 0:53 ` Johannes Weiner
2014-02-04 0:53 ` [patch 01/10] mm: vmstat: fix UP zone state accounting Johannes Weiner
2014-02-04 0:53 ` Johannes Weiner
2014-02-05 22:17 ` Andrew Morton
2014-02-05 22:17 ` Andrew Morton
2014-02-04 0:53 ` [patch 02/10] fs: cachefiles: use add_to_page_cache_lru() Johannes Weiner
2014-02-04 0:53 ` Johannes Weiner
2014-02-08 11:43 ` Rafael Aquini
2014-02-08 11:43 ` Rafael Aquini
2014-02-08 11:43 ` Rafael Aquini
2014-02-09 17:34 ` Johannes Weiner
2014-02-09 17:34 ` Johannes Weiner
2014-02-12 10:58 ` Mel Gorman
2014-02-12 10:58 ` Mel Gorman
2014-02-04 0:53 ` [patch 03/10] lib: radix-tree: radix_tree_delete_item() Johannes Weiner
2014-02-04 0:53 ` Johannes Weiner
2014-02-12 11:00 ` Mel Gorman
2014-02-12 11:00 ` Mel Gorman
2014-02-04 0:53 ` [patch 04/10] mm: shmem: save one radix tree lookup when truncating swapped pages Johannes Weiner
2014-02-04 0:53 ` Johannes Weiner
2014-02-12 11:11 ` Mel Gorman
2014-02-12 11:11 ` Mel Gorman
2014-02-04 0:53 ` [patch 05/10] mm: filemap: move radix tree hole searching here Johannes Weiner
2014-02-04 0:53 ` Johannes Weiner
2014-02-12 11:16 ` Mel Gorman
2014-02-12 11:16 ` Mel Gorman
2014-02-04 0:53 ` [patch 06/10] mm + fs: prepare for non-page entries in page cache radix trees Johannes Weiner
2014-02-04 0:53 ` Johannes Weiner
2014-02-04 0:53 ` [patch 07/10] mm + fs: store shadow entries in page cache Johannes Weiner
2014-02-04 0:53 ` Johannes Weiner
2014-02-04 0:53 ` [patch 08/10] mm: thrash detection-based file cache sizing Johannes Weiner
2014-02-04 0:53 ` Johannes Weiner
2014-02-04 0:53 ` [patch 09/10] lib: radix_tree: tree node interface Johannes Weiner
2014-02-04 0:53 ` Johannes Weiner
2014-02-04 0:53 ` [patch 10/10] mm: keep page cache radix tree nodes in check Johannes Weiner
2014-02-04 0:53 ` Johannes Weiner
2014-02-04 23:07 ` Andrew Morton
2014-02-04 23:07 ` Andrew Morton
2014-02-05 1:53 ` Johannes Weiner
2014-02-05 1:53 ` Johannes Weiner
2014-02-04 23:14 ` [patch 00/10] mm: thrash detection-based file cache sizing v9 Andrew Morton
2014-02-04 23:14 ` Andrew Morton
2014-02-05 2:02 ` Johannes Weiner [this message]
2014-02-05 2:02 ` Johannes Weiner
2014-02-13 3:21 ` Tetsuo Handa
2014-02-13 22:11 ` Johannes Weiner
2014-02-13 22:24 ` Andrew Morton
2014-02-14 0:29 ` Stephen Rothwell
2014-02-14 6:05 ` Tetsuo Handa
2014-02-14 15:30 ` Johannes Weiner
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20140205020222.GX6963@cmpxchg.org \
--to=hannes@cmpxchg.org \
--cc=aarcange@redhat.com \
--cc=akpm@linux-foundation.org \
--cc=andi@firstfloor.org \
--cc=bob.liu@oracle.com \
--cc=david@fromorbit.com \
--cc=gthelen@google.com \
--cc=hch@infradead.org \
--cc=hughd@google.com \
--cc=jack@suse.cz \
--cc=klamm@yandex-team.ru \
--cc=kosaki.motohiro@jp.fujitsu.com \
--cc=linux-fsdevel@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=metin@citusdata.com \
--cc=mgorman@suse.de \
--cc=minchan.kim@gmail.com \
--cc=ozgun@citusdata.com \
--cc=peterz@infradead.org \
--cc=riel@redhat.com \
--cc=rmallon@gmail.com \
--cc=semenzato@google.com \
--cc=tj@kernel.org \
--cc=vbabka@suse.cz \
--cc=walken@google.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.