From: Balbir Singh <balbir@linux.vnet.ibm.com>
To: linux-mm@kvack.org, akpm@linux-foundation.org
Cc: npiggin@kernel.dk, kvm@vger.kernel.org,
linux-kernel@vger.kernel.org, kosaki.motohiro@jp.fujitsu.com,
cl@linux.com, kamezawa.hiroyu@jp.fujitsu.com
Subject: [PATCH 0/3] Unmapped page cache control (v5)
Date: Wed, 30 Mar 2011 11:00:26 +0530 [thread overview]
Message-ID: <20110330052819.8212.1359.stgit@localhost6.localdomain6> (raw)
The following series implements page cache control,
this is a split out version of patch 1 of version 3 of the
page cache optimization patches posted earlier at
Previous posting http://lwn.net/Articles/425851/ and analysis
at http://lwn.net/Articles/419713/
Detailed Description
====================
This patch implements unmapped page cache control via preferred
page cache reclaim. The current patch hooks into kswapd and reclaims
page cache if the user has requested for unmapped page control.
This is useful in the following scenario
- In a virtualized environment with cache=writethrough, we see
double caching - (one in the host and one in the guest). As
we try to scale guests, cache usage across the system grows.
The goal of this patch is to reclaim page cache when Linux is running
as a guest and get the host to hold the page cache and manage it.
There might be temporary duplication, but in the long run, memory
in the guests would be used for mapped pages.
- The option is controlled via a boot option and the administrator
can selectively turn it on, on a need to use basis.
A lot of the code is borrowed from zone_reclaim_mode logic for
__zone_reclaim(). One might argue that the with ballooning and
KSM this feature is not very useful, but even with ballooning,
we need extra logic to balloon multiple VM machines and it is hard
to figure out the correct amount of memory to balloon. With these
patches applied, each guest has a sufficient amount of free memory
available, that can be easily seen and reclaimed by the balloon driver.
The additional memory in the guest can be reused for additional
applications or used to start additional guests/balance memory in
the host.
KSM currently does not de-duplicate host and guest page cache. The goal
of this patch is to help automatically balance unmapped page cache when
instructed to do so.
The sysctl for min_unmapped_ratio provides further control from
within the guest on the amount of unmapped pages to reclaim, a similar
max_unmapped_ratio sysctl is added and helps in the decision making
process of when reclaim should occur. This is tunable and set by
default to 16 (based on tradeoff's seen between aggressiveness in
balancing versus size of unmapped pages). Distro's and administrators
can further tweak this for desired control.
Data from the previous patchsets can be found at
https://lkml.org/lkml/2010/11/30/79
---
Balbir Singh (3):
Move zone_reclaim() outside of CONFIG_NUMA
Refactor zone_reclaim code
Provide control over unmapped pages
Documentation/kernel-parameters.txt | 8 ++
Documentation/sysctl/vm.txt | 19 +++++
include/linux/mmzone.h | 11 +++
include/linux/swap.h | 25 ++++++-
init/Kconfig | 12 +++
kernel/sysctl.c | 29 ++++++--
mm/page_alloc.c | 35 +++++++++-
mm/vmscan.c | 123 +++++++++++++++++++++++++++++++----
8 files changed, 229 insertions(+), 33 deletions(-)
--
Three Cheers,
Balbir
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Fight unfair telecom internet charges in Canada: sign http://stopthemeter.ca/
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
next reply other threads:[~2011-03-30 5:30 UTC|newest]
Thread overview: 32+ messages / expand[flat|nested] mbox.gz Atom feed top
2011-03-30 5:30 Balbir Singh [this message]
2011-03-30 5:31 ` [PATCH 1/3] Move zone_reclaim() outside of CONFIG_NUMA (v5) Balbir Singh
2011-03-30 5:31 ` [PATCH 2/3] Refactor zone_reclaim code (v5) Balbir Singh
2011-03-30 5:32 ` [PATCH 3/3] Provide control over unmapped pages (v5) Balbir Singh
2011-03-30 23:35 ` Andrew Morton
2011-03-31 5:52 ` Balbir Singh
2011-03-30 23:36 ` [PATCH 0/3] Unmapped page cache control (v5) Andrew Morton
2011-03-31 5:27 ` Balbir Singh
2011-03-31 5:32 ` Andrew Morton
2011-04-01 17:31 ` Balbir Singh
2011-03-31 5:40 ` KOSAKI Motohiro
2011-03-31 8:28 ` Balbir Singh
2011-04-01 7:56 ` KOSAKI Motohiro
2011-04-01 13:12 ` Balbir Singh
2011-04-01 13:21 ` KOSAKI Motohiro
2011-04-01 18:04 ` Balbir Singh
2011-04-03 9:39 ` KOSAKI Motohiro
2011-03-31 20:13 ` Christoph Lameter
2011-04-01 13:17 ` KOSAKI Motohiro
2011-04-01 14:50 ` Christoph Lameter
2011-04-03 9:44 ` KOSAKI Motohiro
2011-04-03 18:45 ` Christoph Lameter
2011-04-01 23:10 ` Satoru Moriya
2011-04-02 1:10 ` Dave Chinner
2011-04-03 9:32 ` KOSAKI Motohiro
2011-04-04 0:19 ` Dave Chinner
2011-04-04 12:05 ` KOSAKI Motohiro
2011-04-03 18:41 ` Christoph Lameter
2011-03-31 21:40 ` Dave Chinner
2011-04-01 3:08 ` Balbir Singh
2011-04-01 5:31 ` Dave Chinner
2011-04-01 3:18 ` KOSAKI Motohiro
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20110330052819.8212.1359.stgit@localhost6.localdomain6 \
--to=balbir@linux.vnet.ibm.com \
--cc=akpm@linux-foundation.org \
--cc=cl@linux.com \
--cc=kamezawa.hiroyu@jp.fujitsu.com \
--cc=kosaki.motohiro@jp.fujitsu.com \
--cc=kvm@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=npiggin@kernel.dk \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).