All of lore.kernel.org
 help / color / mirror / Atom feed
From: Ciju Rajan K <ciju@linux.vnet.ibm.com>
To: Greg Thelen <gthelen@google.com>
Cc: balbir@linux.vnet.ibm.com,
	Andrew Morton <akpm@linux-foundation.org>,
	linux-kernel@vger.kernel.org, linux-mm@kvack.org,
	containers@lists.osdl.org, Andrea Righi <arighi@develer.com>,
	KAMEZAWA Hiroyuki <kamezawa.hiroyu@jp.fujitsu.com>,
	Daisuke Nishimura <nishimura@mxp.nes.nec.co.jp>
Subject: Re: [PATCH 00/10] memcg: per cgroup dirty page accounting
Date: Tue, 05 Oct 2010 14:07:08 +0530	[thread overview]
Message-ID: <4CAAE3B4.8000904@linux.vnet.ibm.com> (raw)
In-Reply-To: <xr93pqvpxk5z.fsf@ninji.mtv.corp.google.com>

Greg Thelen wrote:
> Balbir Singh <balbir@linux.vnet.ibm.com> writes:
>   
>> * Greg Thelen <gthelen@google.com> [2010-10-03 23:57:55]:
>>
>>     
>>> This patch set provides the ability for each cgroup to have independent dirty
>>> page limits.
>>>
>>> Limiting dirty memory is like fixing the max amount of dirty (hard to reclaim)
>>> page cache used by a cgroup.  So, in case of multiple cgroup writers, they will
>>> not be able to consume more than their designated share of dirty pages and will
>>> be forced to perform write-out if they cross that limit.
>>>
>>> These patches were developed and tested on mmotm 2010-09-28-16-13.  The patches
>>> are based on a series proposed by Andrea Righi in Mar 2010.
>>>       
>> Hi, Greg,
>>
>> I see a problem with "    memcg: add dirty page accounting infrastructure".
>>
>> The reject is
>>
>>  enum mem_cgroup_write_page_stat_item {
>>         MEMCG_NR_FILE_MAPPED, /* # of pages charged as file rss */
>> +       MEMCG_NR_FILE_DIRTY, /* # of dirty pages in page cache */
>> +       MEMCG_NR_FILE_WRITEBACK, /* # of pages under writeback */
>> +       MEMCG_NR_FILE_UNSTABLE_NFS, /* # of NFS unstable pages */
>>  };
>>
>> I don't see mem_cgroup_write_page_stat_item in memcontrol.h. Is this
>> based on top of Kame's cleanup.
>>
>> I am working off of mmotm 28 sept 2010 16:13.
>>     
>
> Balbir,
>
> All of the 10 memcg dirty limits patches should apply directly to mmotm
> 28 sept 2010 16:13 without any other patches.  Any of Kame's cleanup
> patches that are not in mmotm are not needed by this memcg dirty limit
> series.
>
> The patch you refer to, "[PATCH 05/10] memcg: add dirty page accounting
> infrastructure" depends on a change from an earlier patch in the series.
> Specifically, "[PATCH 03/10] memcg: create extensible page stat update
> routines" contains the addition of mem_cgroup_write_page_stat_item:
>
> --- a/include/linux/memcontrol.h
> +++ b/include/linux/memcontrol.h
> @@ -25,6 +25,11 @@ struct page_cgroup;
>  struct page;
>  struct mm_struct;
>
> +/* Stats that can be updated by kernel. */
> +enum mem_cgroup_write_page_stat_item {
> +     MEMCG_NR_FILE_MAPPED, /* # of pages charged as file rss */
> +};
> +
>
> Do you have trouble applying patch 5 after applying patches 1-4?
>   
I could apply all the patches cleanly on mmotm 28/09/2010. Kernel build 
also went through.
> --
> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> Please read the FAQ at  http://www.tux.org/lkml/
>
>   

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

WARNING: multiple messages have this Message-ID (diff)
From: Ciju Rajan K <ciju@linux.vnet.ibm.com>
To: Greg Thelen <gthelen@google.com>
Cc: balbir@linux.vnet.ibm.com,
	Andrew Morton <akpm@linux-foundation.org>,
	linux-kernel@vger.kernel.org, linux-mm@kvack.org,
	containers@lists.osdl.org, Andrea Righi <arighi@develer.com>,
	KAMEZAWA Hiroyuki <kamezawa.hiroyu@jp.fujitsu.com>,
	Daisuke Nishimura <nishimura@mxp.nes.nec.co.jp>
Subject: Re: [PATCH 00/10] memcg: per cgroup dirty page accounting
Date: Tue, 05 Oct 2010 14:07:08 +0530	[thread overview]
Message-ID: <4CAAE3B4.8000904@linux.vnet.ibm.com> (raw)
In-Reply-To: <xr93pqvpxk5z.fsf@ninji.mtv.corp.google.com>

Greg Thelen wrote:
> Balbir Singh <balbir@linux.vnet.ibm.com> writes:
>   
>> * Greg Thelen <gthelen@google.com> [2010-10-03 23:57:55]:
>>
>>     
>>> This patch set provides the ability for each cgroup to have independent dirty
>>> page limits.
>>>
>>> Limiting dirty memory is like fixing the max amount of dirty (hard to reclaim)
>>> page cache used by a cgroup.  So, in case of multiple cgroup writers, they will
>>> not be able to consume more than their designated share of dirty pages and will
>>> be forced to perform write-out if they cross that limit.
>>>
>>> These patches were developed and tested on mmotm 2010-09-28-16-13.  The patches
>>> are based on a series proposed by Andrea Righi in Mar 2010.
>>>       
>> Hi, Greg,
>>
>> I see a problem with "    memcg: add dirty page accounting infrastructure".
>>
>> The reject is
>>
>>  enum mem_cgroup_write_page_stat_item {
>>         MEMCG_NR_FILE_MAPPED, /* # of pages charged as file rss */
>> +       MEMCG_NR_FILE_DIRTY, /* # of dirty pages in page cache */
>> +       MEMCG_NR_FILE_WRITEBACK, /* # of pages under writeback */
>> +       MEMCG_NR_FILE_UNSTABLE_NFS, /* # of NFS unstable pages */
>>  };
>>
>> I don't see mem_cgroup_write_page_stat_item in memcontrol.h. Is this
>> based on top of Kame's cleanup.
>>
>> I am working off of mmotm 28 sept 2010 16:13.
>>     
>
> Balbir,
>
> All of the 10 memcg dirty limits patches should apply directly to mmotm
> 28 sept 2010 16:13 without any other patches.  Any of Kame's cleanup
> patches that are not in mmotm are not needed by this memcg dirty limit
> series.
>
> The patch you refer to, "[PATCH 05/10] memcg: add dirty page accounting
> infrastructure" depends on a change from an earlier patch in the series.
> Specifically, "[PATCH 03/10] memcg: create extensible page stat update
> routines" contains the addition of mem_cgroup_write_page_stat_item:
>
> --- a/include/linux/memcontrol.h
> +++ b/include/linux/memcontrol.h
> @@ -25,6 +25,11 @@ struct page_cgroup;
>  struct page;
>  struct mm_struct;
>
> +/* Stats that can be updated by kernel. */
> +enum mem_cgroup_write_page_stat_item {
> +     MEMCG_NR_FILE_MAPPED, /* # of pages charged as file rss */
> +};
> +
>
> Do you have trouble applying patch 5 after applying patches 1-4?
>   
I could apply all the patches cleanly on mmotm 28/09/2010. Kernel build 
also went through.
> --
> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> Please read the FAQ at  http://www.tux.org/lkml/
>
>   


  reply	other threads:[~2010-10-05  8:37 UTC|newest]

Thread overview: 194+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2010-10-04  6:57 [PATCH 00/10] memcg: per cgroup dirty page accounting Greg Thelen
2010-10-04  6:57 ` Greg Thelen
2010-10-04  6:57 ` [PATCH 01/10] memcg: add page_cgroup flags for dirty page tracking Greg Thelen
2010-10-04  6:57   ` Greg Thelen
2010-10-05  6:20   ` KAMEZAWA Hiroyuki
2010-10-05  6:20     ` KAMEZAWA Hiroyuki
2010-10-06  0:37   ` Daisuke Nishimura
2010-10-06  0:37     ` Daisuke Nishimura
2010-10-06 11:07   ` Balbir Singh
2010-10-06 11:07     ` Balbir Singh
2010-10-04  6:57 ` [PATCH 02/10] memcg: document cgroup dirty memory interfaces Greg Thelen
2010-10-04  6:57   ` Greg Thelen
2010-10-05  6:48   ` KAMEZAWA Hiroyuki
2010-10-05  6:48     ` KAMEZAWA Hiroyuki
2010-10-06  0:49   ` Daisuke Nishimura
2010-10-06  0:49     ` Daisuke Nishimura
2010-10-06 11:12   ` Balbir Singh
2010-10-06 11:12     ` Balbir Singh
2010-10-04  6:57 ` [PATCH 03/10] memcg: create extensible page stat update routines Greg Thelen
2010-10-04  6:57   ` Greg Thelen
2010-10-04 13:48   ` Ciju Rajan K
2010-10-04 13:48     ` Ciju Rajan K
2010-10-04 15:43     ` Greg Thelen
2010-10-04 15:43       ` Greg Thelen
2010-10-04 17:35       ` Ciju Rajan K
2010-10-04 17:35         ` Ciju Rajan K
2010-10-05  6:51   ` KAMEZAWA Hiroyuki
2010-10-05  6:51     ` KAMEZAWA Hiroyuki
2010-10-05  7:10     ` Greg Thelen
2010-10-05  7:10       ` Greg Thelen
2010-10-05 15:42   ` Minchan Kim
2010-10-05 15:42     ` Minchan Kim
2010-10-05 19:59     ` Greg Thelen
2010-10-05 19:59       ` Greg Thelen
2010-10-05 23:57       ` Minchan Kim
2010-10-05 23:57         ` Minchan Kim
2010-10-06  0:48         ` Greg Thelen
2010-10-06  0:48           ` Greg Thelen
2010-10-06 16:19   ` Balbir Singh
2010-10-06 16:19     ` Balbir Singh
2010-10-04  6:57 ` [PATCH 04/10] memcg: disable local interrupts in lock_page_cgroup() Greg Thelen
2010-10-04  6:57   ` Greg Thelen
2010-10-05  6:54   ` KAMEZAWA Hiroyuki
2010-10-05  6:54     ` KAMEZAWA Hiroyuki
2010-10-05  7:18     ` Greg Thelen
2010-10-05  7:18       ` Greg Thelen
2010-10-05 16:03   ` Minchan Kim
2010-10-05 16:03     ` Minchan Kim
2010-10-05 23:26     ` Greg Thelen
2010-10-05 23:26       ` Greg Thelen
2010-10-06  0:15       ` Minchan Kim
2010-10-06  0:15         ` Minchan Kim
2010-10-07  0:35         ` KAMEZAWA Hiroyuki
2010-10-07  0:35           ` KAMEZAWA Hiroyuki
2010-10-07  1:54           ` Daisuke Nishimura
2010-10-07  1:54             ` Daisuke Nishimura
2010-10-07  2:17             ` KAMEZAWA Hiroyuki
2010-10-07  2:17               ` KAMEZAWA Hiroyuki
2010-10-07  6:21               ` [PATCH] memcg: reduce lock time at move charge (Was " KAMEZAWA Hiroyuki
2010-10-07  6:21                 ` KAMEZAWA Hiroyuki
2010-10-07  6:24                 ` [PATCH] memcg: lock-free clear page writeback " KAMEZAWA Hiroyuki
2010-10-07  6:24                   ` KAMEZAWA Hiroyuki
2010-10-07  9:05                   ` KAMEZAWA Hiroyuki
2010-10-07  9:05                     ` KAMEZAWA Hiroyuki
2010-10-07 23:35                   ` Minchan Kim
2010-10-07 23:35                     ` Minchan Kim
2010-10-08  4:41                     ` KAMEZAWA Hiroyuki
2010-10-08  4:41                       ` KAMEZAWA Hiroyuki
2010-10-08  4:41                       ` KAMEZAWA Hiroyuki
2010-10-07  7:28                 ` [PATCH] memcg: reduce lock time at move charge " Daisuke Nishimura
2010-10-07  7:28                   ` Daisuke Nishimura
2010-10-07  7:42                   ` KAMEZAWA Hiroyuki
2010-10-07  7:42                     ` KAMEZAWA Hiroyuki
2010-10-07  8:04                     ` [PATCH v2] " KAMEZAWA Hiroyuki
2010-10-07  8:04                       ` KAMEZAWA Hiroyuki
2010-10-07 23:14                       ` Andrew Morton
2010-10-07 23:14                         ` Andrew Morton
2010-10-08  1:12                         ` Daisuke Nishimura
2010-10-08  1:12                           ` Daisuke Nishimura
2010-10-08  4:37                         ` KAMEZAWA Hiroyuki
2010-10-08  4:37                           ` KAMEZAWA Hiroyuki
2010-10-08  4:55                           ` Andrew Morton
2010-10-08  4:55                             ` Andrew Morton
2010-10-08  5:12                             ` KAMEZAWA Hiroyuki
2010-10-08  5:12                               ` KAMEZAWA Hiroyuki
2010-10-08 10:41                               ` KAMEZAWA Hiroyuki
2010-10-08 10:41                                 ` KAMEZAWA Hiroyuki
2010-10-12  3:39                                 ` Balbir Singh
2010-10-12  3:39                                   ` Balbir Singh
2010-10-12  3:42                                   ` KAMEZAWA Hiroyuki
2010-10-12  3:42                                     ` KAMEZAWA Hiroyuki
2010-10-12  3:54                                     ` Balbir Singh
2010-10-12  3:54                                       ` Balbir Singh
2010-10-12  3:56                                 ` Daisuke Nishimura
2010-10-12  3:56                                   ` Daisuke Nishimura
2010-10-12  5:01                                   ` KAMEZAWA Hiroyuki
2010-10-12  5:01                                     ` KAMEZAWA Hiroyuki
2010-10-12  5:48                                   ` [PATCH v4] memcg: reduce lock time at move charge KAMEZAWA Hiroyuki
2010-10-12  5:48                                     ` KAMEZAWA Hiroyuki
2010-10-12  6:23                                     ` Daisuke Nishimura
2010-10-12  6:23                                       ` Daisuke Nishimura
2010-10-12  5:39   ` [PATCH 04/10] memcg: disable local interrupts in lock_page_cgroup() Balbir Singh
2010-10-12  5:39     ` Balbir Singh
2010-10-04  6:58 ` [PATCH 05/10] memcg: add dirty page accounting infrastructure Greg Thelen
2010-10-04  6:58   ` Greg Thelen
2010-10-05  7:22   ` KAMEZAWA Hiroyuki
2010-10-05  7:22     ` KAMEZAWA Hiroyuki
     [not found]     ` <20101005162205.3908952a.kamezawa.hiroyu-+CUm20s59erQFUHtdCDX3A@public.gmane.org>
2010-10-05  7:35       ` Greg Thelen
2010-10-05  7:35         ` Greg Thelen
2010-10-05  7:35         ` Greg Thelen
2010-10-05 16:09   ` Minchan Kim
2010-10-05 16:09     ` Minchan Kim
2010-10-05 20:06     ` Greg Thelen
2010-10-05 20:06       ` Greg Thelen
2010-10-04  6:58 ` [PATCH 06/10] memcg: add kernel calls for memcg dirty page stats Greg Thelen
2010-10-04  6:58   ` Greg Thelen
2010-10-05  6:55   ` KAMEZAWA Hiroyuki
2010-10-05  6:55     ` KAMEZAWA Hiroyuki
2010-10-04  6:58 ` [PATCH 07/10] memcg: add dirty limits to mem_cgroup Greg Thelen
2010-10-04  6:58   ` Greg Thelen
2010-10-05  7:07   ` KAMEZAWA Hiroyuki
2010-10-05  7:07     ` KAMEZAWA Hiroyuki
2010-10-05  9:43   ` Andrea Righi
2010-10-05  9:43     ` Andrea Righi
2010-10-05 19:00     ` Greg Thelen
2010-10-05 19:00       ` Greg Thelen
2010-10-07  0:13       ` KAMEZAWA Hiroyuki
2010-10-07  0:13         ` KAMEZAWA Hiroyuki
2010-10-07  0:27         ` Greg Thelen
2010-10-07  0:27           ` Greg Thelen
2010-10-07  0:48           ` KAMEZAWA Hiroyuki
2010-10-07  0:48             ` KAMEZAWA Hiroyuki
2010-10-12  0:24             ` Greg Thelen
2010-10-12  0:24               ` Greg Thelen
2010-10-12  0:55               ` KAMEZAWA Hiroyuki
2010-10-12  0:55                 ` KAMEZAWA Hiroyuki
2010-10-12  7:32                 ` Greg Thelen
2010-10-12  7:32                   ` Greg Thelen
2010-10-12  8:38                   ` KAMEZAWA Hiroyuki
2010-10-12  8:38                     ` KAMEZAWA Hiroyuki
2010-10-04  6:58 ` [PATCH 08/10] memcg: add cgroupfs interface to memcg dirty limits Greg Thelen
2010-10-04  6:58   ` Greg Thelen
2010-10-05  7:13   ` KAMEZAWA Hiroyuki
2010-10-05  7:13     ` KAMEZAWA Hiroyuki
2010-10-05  7:33     ` Greg Thelen
2010-10-05  7:33       ` Greg Thelen
2010-10-05  7:31       ` KAMEZAWA Hiroyuki
2010-10-05  7:31         ` KAMEZAWA Hiroyuki
2010-10-05  9:18       ` Andrea Righi
2010-10-05  9:18         ` Andrea Righi
2010-10-05 18:31         ` David Rientjes
2010-10-05 18:31           ` David Rientjes
2010-10-06 18:34         ` Greg Thelen
2010-10-06 18:34           ` Greg Thelen
2010-10-06 20:54           ` Andrea Righi
2010-10-06 20:54             ` Andrea Righi
2010-10-06 13:30   ` Balbir Singh
2010-10-06 13:30     ` Balbir Singh
2010-10-06 13:32     ` Balbir Singh
2010-10-06 13:32       ` Balbir Singh
2010-10-06 16:21       ` Greg Thelen
2010-10-06 16:21         ` Greg Thelen
2010-10-06 16:24         ` Balbir Singh
2010-10-06 16:24           ` Balbir Singh
2010-10-07  6:23   ` Ciju Rajan K
2010-10-07  6:23     ` Ciju Rajan K
2010-10-07 17:46     ` Greg Thelen
2010-10-07 17:46       ` Greg Thelen
2010-10-04  6:58 ` [PATCH 09/10] writeback: make determine_dirtyable_memory() static Greg Thelen
2010-10-04  6:58   ` Greg Thelen
2010-10-05  7:15   ` KAMEZAWA Hiroyuki
2010-10-05  7:15     ` KAMEZAWA Hiroyuki
2010-10-04  6:58 ` [PATCH 10/10] memcg: check memcg dirty limits in page writeback Greg Thelen
2010-10-04  6:58   ` Greg Thelen
2010-10-05  7:29   ` KAMEZAWA Hiroyuki
2010-10-05  7:29     ` KAMEZAWA Hiroyuki
2010-10-06  0:32   ` Minchan Kim
2010-10-06  0:32     ` Minchan Kim
2010-10-05  4:20 ` [PATCH 00/10] memcg: per cgroup dirty page accounting Balbir Singh
2010-10-05  4:20   ` Balbir Singh
2010-10-05  4:50 ` Balbir Singh
2010-10-05  4:50   ` Balbir Singh
2010-10-05  5:50   ` Greg Thelen
2010-10-05  5:50     ` Greg Thelen
2010-10-05  8:37     ` Ciju Rajan K [this message]
2010-10-05  8:37       ` Ciju Rajan K
2010-10-05 22:15 ` Andrea Righi
2010-10-05 22:15   ` Andrea Righi
2010-10-06  3:23 ` Balbir Singh
2010-10-06  3:23   ` Balbir Singh
2010-10-18  5:56 ` KAMEZAWA Hiroyuki
2010-10-18  5:56   ` KAMEZAWA Hiroyuki
2010-10-18 18:09   ` Greg Thelen
2010-10-18 18:09     ` Greg Thelen

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=4CAAE3B4.8000904@linux.vnet.ibm.com \
    --to=ciju@linux.vnet.ibm.com \
    --cc=akpm@linux-foundation.org \
    --cc=arighi@develer.com \
    --cc=balbir@linux.vnet.ibm.com \
    --cc=containers@lists.osdl.org \
    --cc=gthelen@google.com \
    --cc=kamezawa.hiroyu@jp.fujitsu.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=nishimura@mxp.nes.nec.co.jp \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.