All of lore.kernel.org
 help / color / mirror / Atom feed
From: Greg Thelen <gthelen@google.com>
To: Andrew Morton <akpm@linux-foundation.org>
Cc: linux-kernel@vger.kernel.org, linux-mm@kvack.org,
	containers@lists.osdl.org, Andrea Righi <arighi@develer.com>,
	Balbir Singh <balbir@linux.vnet.ibm.com>,
	KAMEZAWA Hiroyuki <kamezawa.hiroyu@jp.fujitsu.com>,
	Daisuke Nishimura <nishimura@mxp.nes.nec.co.jp>,
	Greg Thelen <gthelen@google.com>
Subject: [PATCH 02/10] memcg: document cgroup dirty memory interfaces
Date: Sun,  3 Oct 2010 23:57:57 -0700	[thread overview]
Message-ID: <1286175485-30643-3-git-send-email-gthelen@google.com> (raw)
In-Reply-To: <1286175485-30643-1-git-send-email-gthelen@google.com>

Document cgroup dirty memory interfaces and statistics.

Signed-off-by: Andrea Righi <arighi@develer.com>
Signed-off-by: Greg Thelen <gthelen@google.com>
---
 Documentation/cgroups/memory.txt |   37 +++++++++++++++++++++++++++++++++++++
 1 files changed, 37 insertions(+), 0 deletions(-)

diff --git a/Documentation/cgroups/memory.txt b/Documentation/cgroups/memory.txt
index 7781857..eab65e2 100644
--- a/Documentation/cgroups/memory.txt
+++ b/Documentation/cgroups/memory.txt
@@ -385,6 +385,10 @@ mapped_file	- # of bytes of mapped file (includes tmpfs/shmem)
 pgpgin		- # of pages paged in (equivalent to # of charging events).
 pgpgout		- # of pages paged out (equivalent to # of uncharging events).
 swap		- # of bytes of swap usage
+dirty		- # of bytes that are waiting to get written back to the disk.
+writeback	- # of bytes that are actively being written back to the disk.
+nfs		- # of bytes sent to the NFS server, but not yet committed to
+		the actual storage.
 inactive_anon	- # of bytes of anonymous memory and swap cache memory on
 		LRU list.
 active_anon	- # of bytes of anonymous and swap cache memory on active
@@ -453,6 +457,39 @@ memory under it will be reclaimed.
 You can reset failcnt by writing 0 to failcnt file.
 # echo 0 > .../memory.failcnt
 
+5.5 dirty memory
+
+Control the maximum amount of dirty pages a cgroup can have at any given time.
+
+Limiting dirty memory is like fixing the max amount of dirty (hard to reclaim)
+page cache used by a cgroup.  So, in case of multiple cgroup writers, they will
+not be able to consume more than their designated share of dirty pages and will
+be forced to perform write-out if they cross that limit.
+
+The interface is equivalent to the procfs interface: /proc/sys/vm/dirty_*.  It
+is possible to configure a limit to trigger both a direct writeback or a
+background writeback performed by per-bdi flusher threads.  The root cgroup
+memory.dirty_* control files are read-only and match the contents of
+the /proc/sys/vm/dirty_* files.
+
+Per-cgroup dirty limits can be set using the following files in the cgroupfs:
+
+- memory.dirty_ratio: the amount of dirty memory (expressed as a percentage of
+  cgroup memory) at which a process generating dirty pages will itself start
+  writing out dirty data.
+
+- memory.dirty_bytes: the amount of dirty memory (expressed in bytes) in the
+  cgroup at which a process generating dirty pages will start itself writing out
+  dirty data.
+
+- memory.dirty_background_ratio: the amount of dirty memory of the cgroup
+  (expressed as a percentage of cgroup memory) at which background writeback
+  kernel threads will start writing out dirty data.
+
+- memory.dirty_background_bytes: the amount of dirty memory (expressed in bytes)
+  in the cgroup at which background writeback kernel threads will start writing
+  out dirty data.
+
 6. Hierarchy support
 
 The memory controller supports a deep hierarchy and hierarchical accounting.
-- 
1.7.1

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

WARNING: multiple messages have this Message-ID (diff)
From: Greg Thelen <gthelen@google.com>
To: Andrew Morton <akpm@linux-foundation.org>
Cc: linux-kernel@vger.kernel.org, linux-mm@kvack.org,
	containers@lists.osdl.org, Andrea Righi <arighi@develer.com>,
	Balbir Singh <balbir@linux.vnet.ibm.com>,
	KAMEZAWA Hiroyuki <kamezawa.hiroyu@jp.fujitsu.com>,
	Daisuke Nishimura <nishimura@mxp.nes.nec.co.jp>,
	Greg Thelen <gthelen@google.com>
Subject: [PATCH 02/10] memcg: document cgroup dirty memory interfaces
Date: Sun,  3 Oct 2010 23:57:57 -0700	[thread overview]
Message-ID: <1286175485-30643-3-git-send-email-gthelen@google.com> (raw)
In-Reply-To: <1286175485-30643-1-git-send-email-gthelen@google.com>

Document cgroup dirty memory interfaces and statistics.

Signed-off-by: Andrea Righi <arighi@develer.com>
Signed-off-by: Greg Thelen <gthelen@google.com>
---
 Documentation/cgroups/memory.txt |   37 +++++++++++++++++++++++++++++++++++++
 1 files changed, 37 insertions(+), 0 deletions(-)

diff --git a/Documentation/cgroups/memory.txt b/Documentation/cgroups/memory.txt
index 7781857..eab65e2 100644
--- a/Documentation/cgroups/memory.txt
+++ b/Documentation/cgroups/memory.txt
@@ -385,6 +385,10 @@ mapped_file	- # of bytes of mapped file (includes tmpfs/shmem)
 pgpgin		- # of pages paged in (equivalent to # of charging events).
 pgpgout		- # of pages paged out (equivalent to # of uncharging events).
 swap		- # of bytes of swap usage
+dirty		- # of bytes that are waiting to get written back to the disk.
+writeback	- # of bytes that are actively being written back to the disk.
+nfs		- # of bytes sent to the NFS server, but not yet committed to
+		the actual storage.
 inactive_anon	- # of bytes of anonymous memory and swap cache memory on
 		LRU list.
 active_anon	- # of bytes of anonymous and swap cache memory on active
@@ -453,6 +457,39 @@ memory under it will be reclaimed.
 You can reset failcnt by writing 0 to failcnt file.
 # echo 0 > .../memory.failcnt
 
+5.5 dirty memory
+
+Control the maximum amount of dirty pages a cgroup can have at any given time.
+
+Limiting dirty memory is like fixing the max amount of dirty (hard to reclaim)
+page cache used by a cgroup.  So, in case of multiple cgroup writers, they will
+not be able to consume more than their designated share of dirty pages and will
+be forced to perform write-out if they cross that limit.
+
+The interface is equivalent to the procfs interface: /proc/sys/vm/dirty_*.  It
+is possible to configure a limit to trigger both a direct writeback or a
+background writeback performed by per-bdi flusher threads.  The root cgroup
+memory.dirty_* control files are read-only and match the contents of
+the /proc/sys/vm/dirty_* files.
+
+Per-cgroup dirty limits can be set using the following files in the cgroupfs:
+
+- memory.dirty_ratio: the amount of dirty memory (expressed as a percentage of
+  cgroup memory) at which a process generating dirty pages will itself start
+  writing out dirty data.
+
+- memory.dirty_bytes: the amount of dirty memory (expressed in bytes) in the
+  cgroup at which a process generating dirty pages will start itself writing out
+  dirty data.
+
+- memory.dirty_background_ratio: the amount of dirty memory of the cgroup
+  (expressed as a percentage of cgroup memory) at which background writeback
+  kernel threads will start writing out dirty data.
+
+- memory.dirty_background_bytes: the amount of dirty memory (expressed in bytes)
+  in the cgroup at which background writeback kernel threads will start writing
+  out dirty data.
+
 6. Hierarchy support
 
 The memory controller supports a deep hierarchy and hierarchical accounting.
-- 
1.7.1


  parent reply	other threads:[~2010-10-04  6:57 UTC|newest]

Thread overview: 194+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2010-10-04  6:57 [PATCH 00/10] memcg: per cgroup dirty page accounting Greg Thelen
2010-10-04  6:57 ` Greg Thelen
2010-10-04  6:57 ` [PATCH 01/10] memcg: add page_cgroup flags for dirty page tracking Greg Thelen
2010-10-04  6:57   ` Greg Thelen
2010-10-05  6:20   ` KAMEZAWA Hiroyuki
2010-10-05  6:20     ` KAMEZAWA Hiroyuki
2010-10-06  0:37   ` Daisuke Nishimura
2010-10-06  0:37     ` Daisuke Nishimura
2010-10-06 11:07   ` Balbir Singh
2010-10-06 11:07     ` Balbir Singh
2010-10-04  6:57 ` Greg Thelen [this message]
2010-10-04  6:57   ` [PATCH 02/10] memcg: document cgroup dirty memory interfaces Greg Thelen
2010-10-05  6:48   ` KAMEZAWA Hiroyuki
2010-10-05  6:48     ` KAMEZAWA Hiroyuki
2010-10-06  0:49   ` Daisuke Nishimura
2010-10-06  0:49     ` Daisuke Nishimura
2010-10-06 11:12   ` Balbir Singh
2010-10-06 11:12     ` Balbir Singh
2010-10-04  6:57 ` [PATCH 03/10] memcg: create extensible page stat update routines Greg Thelen
2010-10-04  6:57   ` Greg Thelen
2010-10-04 13:48   ` Ciju Rajan K
2010-10-04 13:48     ` Ciju Rajan K
2010-10-04 15:43     ` Greg Thelen
2010-10-04 15:43       ` Greg Thelen
2010-10-04 17:35       ` Ciju Rajan K
2010-10-04 17:35         ` Ciju Rajan K
2010-10-05  6:51   ` KAMEZAWA Hiroyuki
2010-10-05  6:51     ` KAMEZAWA Hiroyuki
2010-10-05  7:10     ` Greg Thelen
2010-10-05  7:10       ` Greg Thelen
2010-10-05 15:42   ` Minchan Kim
2010-10-05 15:42     ` Minchan Kim
2010-10-05 19:59     ` Greg Thelen
2010-10-05 19:59       ` Greg Thelen
2010-10-05 23:57       ` Minchan Kim
2010-10-05 23:57         ` Minchan Kim
2010-10-06  0:48         ` Greg Thelen
2010-10-06  0:48           ` Greg Thelen
2010-10-06 16:19   ` Balbir Singh
2010-10-06 16:19     ` Balbir Singh
2010-10-04  6:57 ` [PATCH 04/10] memcg: disable local interrupts in lock_page_cgroup() Greg Thelen
2010-10-04  6:57   ` Greg Thelen
2010-10-05  6:54   ` KAMEZAWA Hiroyuki
2010-10-05  6:54     ` KAMEZAWA Hiroyuki
2010-10-05  7:18     ` Greg Thelen
2010-10-05  7:18       ` Greg Thelen
2010-10-05 16:03   ` Minchan Kim
2010-10-05 16:03     ` Minchan Kim
2010-10-05 23:26     ` Greg Thelen
2010-10-05 23:26       ` Greg Thelen
2010-10-06  0:15       ` Minchan Kim
2010-10-06  0:15         ` Minchan Kim
2010-10-07  0:35         ` KAMEZAWA Hiroyuki
2010-10-07  0:35           ` KAMEZAWA Hiroyuki
2010-10-07  1:54           ` Daisuke Nishimura
2010-10-07  1:54             ` Daisuke Nishimura
2010-10-07  2:17             ` KAMEZAWA Hiroyuki
2010-10-07  2:17               ` KAMEZAWA Hiroyuki
2010-10-07  6:21               ` [PATCH] memcg: reduce lock time at move charge (Was " KAMEZAWA Hiroyuki
2010-10-07  6:21                 ` KAMEZAWA Hiroyuki
2010-10-07  6:24                 ` [PATCH] memcg: lock-free clear page writeback " KAMEZAWA Hiroyuki
2010-10-07  6:24                   ` KAMEZAWA Hiroyuki
2010-10-07  9:05                   ` KAMEZAWA Hiroyuki
2010-10-07  9:05                     ` KAMEZAWA Hiroyuki
2010-10-07 23:35                   ` Minchan Kim
2010-10-07 23:35                     ` Minchan Kim
2010-10-08  4:41                     ` KAMEZAWA Hiroyuki
2010-10-08  4:41                       ` KAMEZAWA Hiroyuki
2010-10-08  4:41                       ` KAMEZAWA Hiroyuki
2010-10-07  7:28                 ` [PATCH] memcg: reduce lock time at move charge " Daisuke Nishimura
2010-10-07  7:28                   ` Daisuke Nishimura
2010-10-07  7:42                   ` KAMEZAWA Hiroyuki
2010-10-07  7:42                     ` KAMEZAWA Hiroyuki
2010-10-07  8:04                     ` [PATCH v2] " KAMEZAWA Hiroyuki
2010-10-07  8:04                       ` KAMEZAWA Hiroyuki
2010-10-07 23:14                       ` Andrew Morton
2010-10-07 23:14                         ` Andrew Morton
2010-10-08  1:12                         ` Daisuke Nishimura
2010-10-08  1:12                           ` Daisuke Nishimura
2010-10-08  4:37                         ` KAMEZAWA Hiroyuki
2010-10-08  4:37                           ` KAMEZAWA Hiroyuki
2010-10-08  4:55                           ` Andrew Morton
2010-10-08  4:55                             ` Andrew Morton
2010-10-08  5:12                             ` KAMEZAWA Hiroyuki
2010-10-08  5:12                               ` KAMEZAWA Hiroyuki
2010-10-08 10:41                               ` KAMEZAWA Hiroyuki
2010-10-08 10:41                                 ` KAMEZAWA Hiroyuki
2010-10-12  3:39                                 ` Balbir Singh
2010-10-12  3:39                                   ` Balbir Singh
2010-10-12  3:42                                   ` KAMEZAWA Hiroyuki
2010-10-12  3:42                                     ` KAMEZAWA Hiroyuki
2010-10-12  3:54                                     ` Balbir Singh
2010-10-12  3:54                                       ` Balbir Singh
2010-10-12  3:56                                 ` Daisuke Nishimura
2010-10-12  3:56                                   ` Daisuke Nishimura
2010-10-12  5:01                                   ` KAMEZAWA Hiroyuki
2010-10-12  5:01                                     ` KAMEZAWA Hiroyuki
2010-10-12  5:48                                   ` [PATCH v4] memcg: reduce lock time at move charge KAMEZAWA Hiroyuki
2010-10-12  5:48                                     ` KAMEZAWA Hiroyuki
2010-10-12  6:23                                     ` Daisuke Nishimura
2010-10-12  6:23                                       ` Daisuke Nishimura
2010-10-12  5:39   ` [PATCH 04/10] memcg: disable local interrupts in lock_page_cgroup() Balbir Singh
2010-10-12  5:39     ` Balbir Singh
2010-10-04  6:58 ` [PATCH 05/10] memcg: add dirty page accounting infrastructure Greg Thelen
2010-10-04  6:58   ` Greg Thelen
2010-10-05  7:22   ` KAMEZAWA Hiroyuki
2010-10-05  7:22     ` KAMEZAWA Hiroyuki
     [not found]     ` <20101005162205.3908952a.kamezawa.hiroyu-+CUm20s59erQFUHtdCDX3A@public.gmane.org>
2010-10-05  7:35       ` Greg Thelen
2010-10-05  7:35         ` Greg Thelen
2010-10-05  7:35         ` Greg Thelen
2010-10-05 16:09   ` Minchan Kim
2010-10-05 16:09     ` Minchan Kim
2010-10-05 20:06     ` Greg Thelen
2010-10-05 20:06       ` Greg Thelen
2010-10-04  6:58 ` [PATCH 06/10] memcg: add kernel calls for memcg dirty page stats Greg Thelen
2010-10-04  6:58   ` Greg Thelen
2010-10-05  6:55   ` KAMEZAWA Hiroyuki
2010-10-05  6:55     ` KAMEZAWA Hiroyuki
2010-10-04  6:58 ` [PATCH 07/10] memcg: add dirty limits to mem_cgroup Greg Thelen
2010-10-04  6:58   ` Greg Thelen
2010-10-05  7:07   ` KAMEZAWA Hiroyuki
2010-10-05  7:07     ` KAMEZAWA Hiroyuki
2010-10-05  9:43   ` Andrea Righi
2010-10-05  9:43     ` Andrea Righi
2010-10-05 19:00     ` Greg Thelen
2010-10-05 19:00       ` Greg Thelen
2010-10-07  0:13       ` KAMEZAWA Hiroyuki
2010-10-07  0:13         ` KAMEZAWA Hiroyuki
2010-10-07  0:27         ` Greg Thelen
2010-10-07  0:27           ` Greg Thelen
2010-10-07  0:48           ` KAMEZAWA Hiroyuki
2010-10-07  0:48             ` KAMEZAWA Hiroyuki
2010-10-12  0:24             ` Greg Thelen
2010-10-12  0:24               ` Greg Thelen
2010-10-12  0:55               ` KAMEZAWA Hiroyuki
2010-10-12  0:55                 ` KAMEZAWA Hiroyuki
2010-10-12  7:32                 ` Greg Thelen
2010-10-12  7:32                   ` Greg Thelen
2010-10-12  8:38                   ` KAMEZAWA Hiroyuki
2010-10-12  8:38                     ` KAMEZAWA Hiroyuki
2010-10-04  6:58 ` [PATCH 08/10] memcg: add cgroupfs interface to memcg dirty limits Greg Thelen
2010-10-04  6:58   ` Greg Thelen
2010-10-05  7:13   ` KAMEZAWA Hiroyuki
2010-10-05  7:13     ` KAMEZAWA Hiroyuki
2010-10-05  7:33     ` Greg Thelen
2010-10-05  7:33       ` Greg Thelen
2010-10-05  7:31       ` KAMEZAWA Hiroyuki
2010-10-05  7:31         ` KAMEZAWA Hiroyuki
2010-10-05  9:18       ` Andrea Righi
2010-10-05  9:18         ` Andrea Righi
2010-10-05 18:31         ` David Rientjes
2010-10-05 18:31           ` David Rientjes
2010-10-06 18:34         ` Greg Thelen
2010-10-06 18:34           ` Greg Thelen
2010-10-06 20:54           ` Andrea Righi
2010-10-06 20:54             ` Andrea Righi
2010-10-06 13:30   ` Balbir Singh
2010-10-06 13:30     ` Balbir Singh
2010-10-06 13:32     ` Balbir Singh
2010-10-06 13:32       ` Balbir Singh
2010-10-06 16:21       ` Greg Thelen
2010-10-06 16:21         ` Greg Thelen
2010-10-06 16:24         ` Balbir Singh
2010-10-06 16:24           ` Balbir Singh
2010-10-07  6:23   ` Ciju Rajan K
2010-10-07  6:23     ` Ciju Rajan K
2010-10-07 17:46     ` Greg Thelen
2010-10-07 17:46       ` Greg Thelen
2010-10-04  6:58 ` [PATCH 09/10] writeback: make determine_dirtyable_memory() static Greg Thelen
2010-10-04  6:58   ` Greg Thelen
2010-10-05  7:15   ` KAMEZAWA Hiroyuki
2010-10-05  7:15     ` KAMEZAWA Hiroyuki
2010-10-04  6:58 ` [PATCH 10/10] memcg: check memcg dirty limits in page writeback Greg Thelen
2010-10-04  6:58   ` Greg Thelen
2010-10-05  7:29   ` KAMEZAWA Hiroyuki
2010-10-05  7:29     ` KAMEZAWA Hiroyuki
2010-10-06  0:32   ` Minchan Kim
2010-10-06  0:32     ` Minchan Kim
2010-10-05  4:20 ` [PATCH 00/10] memcg: per cgroup dirty page accounting Balbir Singh
2010-10-05  4:20   ` Balbir Singh
2010-10-05  4:50 ` Balbir Singh
2010-10-05  4:50   ` Balbir Singh
2010-10-05  5:50   ` Greg Thelen
2010-10-05  5:50     ` Greg Thelen
2010-10-05  8:37     ` Ciju Rajan K
2010-10-05  8:37       ` Ciju Rajan K
2010-10-05 22:15 ` Andrea Righi
2010-10-05 22:15   ` Andrea Righi
2010-10-06  3:23 ` Balbir Singh
2010-10-06  3:23   ` Balbir Singh
2010-10-18  5:56 ` KAMEZAWA Hiroyuki
2010-10-18  5:56   ` KAMEZAWA Hiroyuki
2010-10-18 18:09   ` Greg Thelen
2010-10-18 18:09     ` Greg Thelen

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=1286175485-30643-3-git-send-email-gthelen@google.com \
    --to=gthelen@google.com \
    --cc=akpm@linux-foundation.org \
    --cc=arighi@develer.com \
    --cc=balbir@linux.vnet.ibm.com \
    --cc=containers@lists.osdl.org \
    --cc=kamezawa.hiroyu@jp.fujitsu.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=nishimura@mxp.nes.nec.co.jp \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.