All of lore.kernel.org
 help / color / mirror / Atom feed
From: Balbir Singh <balbir@linux.vnet.ibm.com>
To: KAMEZAWA Hiroyuki <kamezawa.hiroyu@jp.fujitsu.com>
Cc: Andrew Morton <akpm@linux-foundation.org>,
	hugh@veritas.com, menage@google.com, xemul@openvz.org,
	linux-kernel@vger.kernel.org, linux-mm@kvack.org,
	"nickpiggin@yahoo.com.au" <nickpiggin@yahoo.com.au>
Subject: Re: [RFC][PATCH] Remove cgroup member from struct page
Date: Mon, 01 Sep 2008 08:58:32 +0530	[thread overview]
Message-ID: <48BB6160.4070904@linux.vnet.ibm.com> (raw)
In-Reply-To: <20080901090102.46b75141.kamezawa.hiroyu@jp.fujitsu.com>

KAMEZAWA Hiroyuki wrote:
> On Sun, 31 Aug 2008 23:17:56 +0530
> Balbir Singh <balbir@linux.vnet.ibm.com> wrote:
> 
>> This is a rewrite of a patch I had written long back to remove struct page
>> (I shared the patches with Kamezawa, but never posted them anywhere else).
>> I spent the weekend, cleaning them up for 2.6.27-rc5-mmotm (29 Aug 2008).
>>
> It's just because I think there is no strong requirements for 64bit count/mapcount.
> There is no ZERO_PAGE() for ANON (by Nick Piggin. I add him to CC.)
> (shmem still use it but impact is not big.)
> 

I understand the comment, but not it's context. Are you suggesting that the
sizeof _count and _mapcount can be reduced? Hence the impact of having a member
in struct page is not all that large? I think the patch is definitely very
important for 32 bit systems.

>> I've tested the patches on an x86_64 box, I've run a simple test running
>> under the memory control group and the same test running concurrently under
>> two different groups (and creating pressure within their groups). I've also
>> compiled the patch with CGROUP_MEM_RES_CTLR turned off.
>>
>> Advantages of the patch
>>
>> 1. It removes the extra pointer in struct page
>>
>> Disadvantages
>>
>> 1. It adds an additional lock structure to struct page_cgroup
>> 2. Radix tree lookup is not an O(1) operation, once the page is known
>>    getting to the page_cgroup (pc) is a little more expensive now.
>>
>> This is an initial RFC for comments
>>
>> TODOs
>>
>> 1. Test the page migration changes
>> 2. Test the performance impact of the patch/approach
>>
>> Comments/Reviews?
>>
> plz wait until lockless page cgroup....
> 

That depends, if we can get the lockless page cgroup done quickly, I don't mind
waiting, but if it is going to take longer, I would rather push these changes
in. There should not be too much overhead in porting lockless page cgroup patch
on top of this (remove pc->lock and use pc->flags). I'll help out, so as to
avoid wastage of your effort.

> And If you don't support radix-tree-delete(), pre-allocating all at boot is better.
> 

We do use radix-tree-delete() in the code, please see below. Pre-allocating has
the disadvantage that we will pre-allocate even for kernel pages, etc.

> BTW, why pc->lock is necessary ? It increases size of struct page_cgroup and reduce 
> the advantege of your patch's to half (8bytes -> 4bytes).
> 

Yes, I've mentioned that as a disadvantage. Are you suggesting that with
lockless page cgroup we won't need pc->lock?

> Thanks,
> -Kame

-- 
	Balbir

WARNING: multiple messages have this Message-ID (diff)
From: Balbir Singh <balbir@linux.vnet.ibm.com>
To: KAMEZAWA Hiroyuki <kamezawa.hiroyu@jp.fujitsu.com>
Cc: Andrew Morton <akpm@linux-foundation.org>,
	hugh@veritas.com, menage@google.com, xemul@openvz.org,
	linux-kernel@vger.kernel.org, linux-mm@kvack.org,
	"nickpiggin@yahoo.com.au" <nickpiggin@yahoo.com.au>
Subject: Re: [RFC][PATCH] Remove cgroup member from struct page
Date: Mon, 01 Sep 2008 08:58:32 +0530	[thread overview]
Message-ID: <48BB6160.4070904@linux.vnet.ibm.com> (raw)
In-Reply-To: <20080901090102.46b75141.kamezawa.hiroyu@jp.fujitsu.com>

KAMEZAWA Hiroyuki wrote:
> On Sun, 31 Aug 2008 23:17:56 +0530
> Balbir Singh <balbir@linux.vnet.ibm.com> wrote:
> 
>> This is a rewrite of a patch I had written long back to remove struct page
>> (I shared the patches with Kamezawa, but never posted them anywhere else).
>> I spent the weekend, cleaning them up for 2.6.27-rc5-mmotm (29 Aug 2008).
>>
> It's just because I think there is no strong requirements for 64bit count/mapcount.
> There is no ZERO_PAGE() for ANON (by Nick Piggin. I add him to CC.)
> (shmem still use it but impact is not big.)
> 

I understand the comment, but not it's context. Are you suggesting that the
sizeof _count and _mapcount can be reduced? Hence the impact of having a member
in struct page is not all that large? I think the patch is definitely very
important for 32 bit systems.

>> I've tested the patches on an x86_64 box, I've run a simple test running
>> under the memory control group and the same test running concurrently under
>> two different groups (and creating pressure within their groups). I've also
>> compiled the patch with CGROUP_MEM_RES_CTLR turned off.
>>
>> Advantages of the patch
>>
>> 1. It removes the extra pointer in struct page
>>
>> Disadvantages
>>
>> 1. It adds an additional lock structure to struct page_cgroup
>> 2. Radix tree lookup is not an O(1) operation, once the page is known
>>    getting to the page_cgroup (pc) is a little more expensive now.
>>
>> This is an initial RFC for comments
>>
>> TODOs
>>
>> 1. Test the page migration changes
>> 2. Test the performance impact of the patch/approach
>>
>> Comments/Reviews?
>>
> plz wait until lockless page cgroup....
> 

That depends, if we can get the lockless page cgroup done quickly, I don't mind
waiting, but if it is going to take longer, I would rather push these changes
in. There should not be too much overhead in porting lockless page cgroup patch
on top of this (remove pc->lock and use pc->flags). I'll help out, so as to
avoid wastage of your effort.

> And If you don't support radix-tree-delete(), pre-allocating all at boot is better.
> 

We do use radix-tree-delete() in the code, please see below. Pre-allocating has
the disadvantage that we will pre-allocate even for kernel pages, etc.

> BTW, why pc->lock is necessary ? It increases size of struct page_cgroup and reduce 
> the advantege of your patch's to half (8bytes -> 4bytes).
> 

Yes, I've mentioned that as a disadvantage. Are you suggesting that with
lockless page cgroup we won't need pc->lock?

> Thanks,
> -Kame

-- 
	Balbir

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

  reply	other threads:[~2008-09-01  3:28 UTC|newest]

Thread overview: 144+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2008-08-31 17:47 [RFC][PATCH] Remove cgroup member from struct page Balbir Singh
2008-08-31 17:47 ` Balbir Singh
2008-09-01  0:01 ` KAMEZAWA Hiroyuki
2008-09-01  0:01   ` KAMEZAWA Hiroyuki
2008-09-01  3:28   ` Balbir Singh [this message]
2008-09-01  3:28     ` Balbir Singh
2008-09-01  4:03     ` KAMEZAWA Hiroyuki
2008-09-01  4:03       ` KAMEZAWA Hiroyuki
2008-09-01  5:17       ` KAMEZAWA Hiroyuki
2008-09-01  5:17         ` KAMEZAWA Hiroyuki
2008-09-01  6:16         ` Balbir Singh
2008-09-01  6:16           ` Balbir Singh
2008-09-01  6:09       ` Balbir Singh
2008-09-01  6:09         ` Balbir Singh
2008-09-01  6:24         ` KAMEZAWA Hiroyuki
2008-09-01  6:24           ` KAMEZAWA Hiroyuki
2008-09-01  6:25           ` Balbir Singh
2008-09-01  6:25             ` Balbir Singh
2008-09-01  6:59             ` KAMEZAWA Hiroyuki
2008-09-01  6:59               ` KAMEZAWA Hiroyuki
2008-09-01  6:56   ` Nick Piggin
2008-09-01  6:56     ` Nick Piggin
2008-09-01  7:17     ` Balbir Singh
2008-09-01  7:17       ` Balbir Singh
2008-09-01  7:19     ` KAMEZAWA Hiroyuki
2008-09-01  7:19       ` KAMEZAWA Hiroyuki
2008-09-01  7:43       ` Nick Piggin
2008-09-01  7:43         ` Nick Piggin
2008-09-02  9:24         ` Balbir Singh
2008-09-02  9:24           ` Balbir Singh
2008-09-02 10:02           ` KAMEZAWA Hiroyuki
2008-09-02 10:02             ` KAMEZAWA Hiroyuki
2008-09-02  9:58             ` Balbir Singh
2008-09-02  9:58               ` Balbir Singh
2008-09-02 10:07               ` KAMEZAWA Hiroyuki
2008-09-02 10:07                 ` KAMEZAWA Hiroyuki
2008-09-02 10:12                 ` Balbir Singh
2008-09-02 10:12                   ` Balbir Singh
2008-09-02 10:57                   ` KAMEZAWA Hiroyuki
2008-09-02 10:57                     ` KAMEZAWA Hiroyuki
2008-09-02 12:37                     ` Balbir Singh
2008-09-02 12:37                       ` Balbir Singh
2008-09-03  3:33                       ` KAMEZAWA Hiroyuki
2008-09-03  3:33                         ` KAMEZAWA Hiroyuki
2008-09-03  7:31                         ` Balbir Singh
2008-09-03  7:31                           ` Balbir Singh
2008-09-08 15:28                         ` Balbir Singh
2008-09-08 15:28                           ` Balbir Singh
2008-09-09  3:57                           ` KAMEZAWA Hiroyuki
2008-09-09  3:57                             ` KAMEZAWA Hiroyuki
2008-09-09  3:58                             ` Nick Piggin
2008-09-09  3:58                               ` Nick Piggin
2008-09-09  4:53                               ` KAMEZAWA Hiroyuki
2008-09-09  4:53                                 ` KAMEZAWA Hiroyuki
2008-09-09  5:00                                 ` Nick Piggin
2008-09-09  5:00                                   ` Nick Piggin
2008-09-09  5:12                                   ` KAMEZAWA Hiroyuki
2008-09-09  5:12                                     ` KAMEZAWA Hiroyuki
2008-09-09 12:24                                     ` Balbir Singh
2008-09-09 12:24                                       ` Balbir Singh
2008-09-09 12:28                                       ` Nick Piggin
2008-09-09 12:28                                         ` Nick Piggin
2008-09-09 12:30                                       ` kamezawa.hiroyu
2008-09-09 12:30                                         ` kamezawa.hiroyu
2008-09-09 12:34                                         ` Balbir Singh
2008-09-09 12:34                                           ` Balbir Singh
2008-09-10  1:20                                         ` [Approach #2] " Balbir Singh
2008-09-10  1:20                                           ` Balbir Singh
2008-09-10  1:49                                           ` KAMEZAWA Hiroyuki
2008-09-10  1:49                                             ` KAMEZAWA Hiroyuki
2008-09-10  2:11                                             ` Balbir Singh
2008-09-10  2:35                                               ` KAMEZAWA Hiroyuki
2008-09-10  2:35                                                 ` KAMEZAWA Hiroyuki
2008-09-10 20:44                                             ` Nick Piggin
2008-09-10 20:44                                               ` Nick Piggin
2008-09-10 11:03                                               ` KAMEZAWA Hiroyuki
2008-09-10 11:03                                                 ` KAMEZAWA Hiroyuki
2008-09-10 21:02                                                 ` Nick Piggin
2008-09-10 21:02                                                   ` Nick Piggin
2008-09-10 11:27                                                   ` KAMEZAWA Hiroyuki
2008-09-10 11:27                                                     ` KAMEZAWA Hiroyuki
2008-09-10 14:34                                                     ` Balbir Singh
2008-09-10 14:34                                                       ` Balbir Singh
2008-09-10 22:21                                           ` Dave Hansen
2008-09-10 22:21                                             ` Dave Hansen
2008-09-10 22:31                                             ` David Miller
2008-09-10 22:31                                               ` David Miller, Dave Hansen
2008-09-10 22:36                                             ` Balbir Singh
2008-09-10 22:36                                               ` Balbir Singh
2008-09-10 22:56                                               ` Dave Hansen
2008-09-10 22:56                                                 ` Dave Hansen
2008-09-11  1:35                                                 ` KAMEZAWA Hiroyuki
2008-09-11  1:35                                                   ` KAMEZAWA Hiroyuki
2008-09-11  1:47                                                   ` Balbir Singh
2008-09-11  1:47                                                     ` Balbir Singh
2008-09-11  1:56                                                     ` KAMEZAWA Hiroyuki
2008-09-11  1:56                                                       ` KAMEZAWA Hiroyuki
2008-09-17 23:28                                                       ` [RFC][PATCH] Remove cgroup member from struct page (v3) Balbir Singh
2008-09-17 23:28                                                         ` Balbir Singh
2008-09-18  1:40                                                         ` Andrew Morton
2008-09-18  1:40                                                           ` Andrew Morton
2008-09-18  3:57                                                           ` Balbir Singh
2008-09-18  3:57                                                             ` Balbir Singh
2008-09-18  5:00                                                             ` KAMEZAWA Hiroyuki
2008-09-18  5:00                                                               ` KAMEZAWA Hiroyuki
2008-09-18  4:26                                                           ` Hirokazu Takahashi
2008-09-18  4:26                                                             ` Hirokazu Takahashi
2008-09-18  4:50                                                             ` KAMEZAWA Hiroyuki
2008-09-18  4:50                                                               ` KAMEZAWA Hiroyuki
2008-09-18  6:13                                                               ` Hirokazu Takahashi
2008-09-18  6:13                                                                 ` Hirokazu Takahashi
2008-09-18  4:43                                                           ` KAMEZAWA Hiroyuki
2008-09-18  4:43                                                             ` KAMEZAWA Hiroyuki
2008-09-18  4:58                                                             ` Balbir Singh
2008-09-18  4:58                                                               ` Balbir Singh
2008-09-18  5:15                                                               ` KAMEZAWA Hiroyuki
2008-09-18  5:15                                                                 ` KAMEZAWA Hiroyuki
2008-09-18 11:01                                                               ` KAMEZAWA Hiroyuki
2008-09-18 11:01                                                                 ` KAMEZAWA Hiroyuki
2008-09-18 23:56                                                                 ` Balbir Singh
2008-09-18 23:56                                                                   ` Balbir Singh
2008-09-19  0:37                                                                   ` KAMEZAWA Hiroyuki
2008-09-10 22:38                                             ` [Approach #2] [RFC][PATCH] Remove cgroup member from struct page Nick Piggin
2008-09-10 22:38                                               ` Nick Piggin
2008-09-09  4:18                             ` Balbir Singh
2008-09-09  4:18                               ` Balbir Singh
2008-09-09  4:55                               ` KAMEZAWA Hiroyuki
2008-09-09  4:55                                 ` KAMEZAWA Hiroyuki
2008-09-09  7:37                               ` KAMEZAWA Hiroyuki
2008-09-09  7:37                                 ` KAMEZAWA Hiroyuki
2008-09-01  2:39 ` KAMEZAWA Hiroyuki
2008-09-01  2:39   ` KAMEZAWA Hiroyuki
2008-09-01  3:42   ` Balbir Singh
2008-09-01  3:42     ` Balbir Singh
2008-09-01  9:03 ` Pavel Emelyanov
2008-09-01  9:03   ` Pavel Emelyanov
2008-09-01  9:17   ` Balbir Singh
2008-09-01  9:17     ` Balbir Singh
2008-09-01  9:43     ` Pavel Emelyanov
2008-09-01  9:43       ` Pavel Emelyanov
2008-09-01 13:19     ` Peter Zijlstra
2008-09-01 13:19       ` Peter Zijlstra
2008-09-02  7:35       ` Balbir Singh
2008-09-02  7:35         ` Balbir Singh

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=48BB6160.4070904@linux.vnet.ibm.com \
    --to=balbir@linux.vnet.ibm.com \
    --cc=akpm@linux-foundation.org \
    --cc=hugh@veritas.com \
    --cc=kamezawa.hiroyu@jp.fujitsu.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=menage@google.com \
    --cc=nickpiggin@yahoo.com.au \
    --cc=xemul@openvz.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.