From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail190.messagelabs.com (mail190.messagelabs.com [216.82.249.51]) by kanga.kvack.org (Postfix) with ESMTP id DC1966B003D for ; Tue, 5 Jan 2010 22:49:43 -0500 (EST) Received: from d28relay05.in.ibm.com (d28relay05.in.ibm.com [9.184.220.62]) by e28smtp06.in.ibm.com (8.14.3/8.13.1) with ESMTP id o063ncdO002900 for ; Wed, 6 Jan 2010 09:19:38 +0530 Received: from d28av02.in.ibm.com (d28av02.in.ibm.com [9.184.220.64]) by d28relay05.in.ibm.com (8.13.8/8.13.8/NCO v10.0) with ESMTP id o063ncOB3731628 for ; Wed, 6 Jan 2010 09:19:38 +0530 Received: from d28av02.in.ibm.com (loopback [127.0.0.1]) by d28av02.in.ibm.com (8.14.3/8.13.1/NCO v10.0 AVout) with ESMTP id o063nb0F010798 for ; Wed, 6 Jan 2010 14:49:38 +1100 Date: Wed, 6 Jan 2010 09:19:34 +0530 From: Balbir Singh Subject: Re: [PATCH -mm] Shared Page accounting for memory cgroup (v2) Message-ID: <20100106034934.GK3059@balbir.in.ibm.com> Reply-To: balbir@linux.vnet.ibm.com References: <20100105185226.GG3059@balbir.in.ibm.com> <20100106090708.f3ec9fd8.kamezawa.hiroyu@jp.fujitsu.com> <20100106030752.GI3059@balbir.in.ibm.com> <20100106121836.40f3b3c0.kamezawa.hiroyu@jp.fujitsu.com> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline In-Reply-To: <20100106121836.40f3b3c0.kamezawa.hiroyu@jp.fujitsu.com> Sender: owner-linux-mm@kvack.org To: KAMEZAWA Hiroyuki Cc: Andrew Morton , "linux-mm@kvack.org" , "linux-kernel@vger.kernel.org" List-ID: * KAMEZAWA Hiroyuki [2010-01-06 12:18:36]: > On Wed, 6 Jan 2010 08:37:52 +0530 > Balbir Singh wrote: > > > * KAMEZAWA Hiroyuki [2010-01-06 09:07:08]: > > > > > On Wed, 6 Jan 2010 00:22:26 +0530 > > > Balbir Singh wrote: > > > > > > > Hi, All, > > > > > > > > No major changes from v1, except for the use of get_mm_rss(). > > > > Kamezawa-San felt that this can be done in user space and I responded > > > > to him with my concerns of doing it in user space. The thread > > > > can be found at http://thread.gmane.org/gmane.linux.kernel.mm/42367. > > > > > > > > If there are no major objections, can I ask for a merge into -mm. > > > > Andrew, the patches are against mmotm 10 December 2009, if there > > > > are some merge conflicts, please let me know, I can rebase after > > > > you release the next mmotm. > > > > > > > > > > The problem is that this isn't "shared" uasge but "considered to be shared" > > > usage. Okay ? > > > > > > > Could you give me your definition of "shared". From the mem cgroup > > perspective, total_rss (which is accumulated) subtracted from the > > count of pages in the LRU which are RSS and FILE_MAPPED is shared, no? > > You consider only "mapped" pages are shared page. That's wrong. > And let's think about your "total_rss - RSS+MAPPED" > > In this typical case, > fork() ---- process(A) > -> fork() --- process(B) > -> process(C) > > total_rss = rss(A) + rss(B) + rss(C) = 3 * rss(A) > Then, > > total_rss - RSS_MAPPED = 2 * rss(A). > > How we call this number ? Is this "shared usage" ? I think no. Why not? The pages in LRU is rss(A) and the total usage is 3*rss(A), shared does not imply shared outside the cgroup. Why do you say it is not shared? > If you want to do this, scan LRU and count the number of really shared pages. A page walk for large number of cases is expensive for a large memory cgroup. > It's much better than detecting "shared pages" via process and will have no > big issue if implemented in proper way. > A walk is not cheap, specifically since the list is protected by zone lru lock and there are now 5 lists. > > I understand that some of the pages that might be shared, show up > > in our LRU and accounting. These are not treated as shared by > > our cgroup, but by other cgroups. > > > > > Then I don't want to provide this misleading value as "official report" from > > > the kernel. And this can be done in userland. > > > > > > > I explained some of the issues of doing this from user space, would > > you be OK if I called them "non-private" pages? > > > > I think I explained there is no issue to do this in user-land. > You did not respond back to the last message of (I thought I convinced you) http://thread.gmane.org/gmane.linux.kernel.mm/42367 -- Balbir -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to majordomo@kvack.org. For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: email@kvack.org