From: Kamezawa Hiroyuki <kamezawa.hiroyu@jp.fujitsu.com>
To: Sha Zhengju <handai.szj@gmail.com>
Cc: Glauber Costa <glommer@parallels.com>,
linux-mm@kvack.org, cgroups@vger.kernel.org,
Tejun Heo <tj@kernel.org>,
Andrew Morton <akpm@linux-foundation.org>,
Michal Hocko <mhocko@suse.cz>,
anton.vorontsov@linaro.org, Johannes Weiner <hannes@cmpxchg.org>,
Mel Gorman <mgorman@suse.de>
Subject: Re: [PATCH v2 2/5] memcg: provide root figures from system totals
Date: Thu, 14 Mar 2013 09:03:15 +0900 [thread overview]
Message-ID: <514113C3.2090505@jp.fujitsu.com> (raw)
In-Reply-To: <CAFj3OHUupqG-178gnTUWc787n5cJjGgGZRzXuNRVvOvYqkHvgA@mail.gmail.com>
(2013/03/13 18:59), Sha Zhengju wrote:
> On Wed, Mar 13, 2013 at 5:15 PM, Kamezawa Hiroyuki
> <kamezawa.hiroyu@jp.fujitsu.com> wrote:
>> (2013/03/13 15:58), Sha Zhengju wrote:
>>>
>>> On Wed, Mar 6, 2013 at 6:59 PM, Kamezawa Hiroyuki
>>> <kamezawa.hiroyu@jp.fujitsu.com> wrote:
>>>>
>>>> (2013/03/06 19:52), Glauber Costa wrote:
>>>>>
>>>>> On 03/06/2013 02:45 PM, Kamezawa Hiroyuki wrote:
>>>>>>
>>>>>> (2013/03/06 17:30), Glauber Costa wrote:
>>>>>>>
>>>>>>> On 03/06/2013 04:27 AM, Kamezawa Hiroyuki wrote:
>>>>>>>>
>>>>>>>> (2013/03/05 22:10), Glauber Costa wrote:
>>>>>>>>>
>>>>>>>>> + case _MEMSWAP: {
>>>>>>>>> + struct sysinfo i;
>>>>>>>>> + si_swapinfo(&i);
>>>>>>>>> +
>>>>>>>>> + return ((memcg_read_root_rss() +
>>>>>>>>> + atomic_long_read(&vm_stat[NR_FILE_PAGES])) << PAGE_SHIFT)
>>>>>>>>> +
>>>>>>>>> + i.totalswap - i.freeswap;
>>>>>>>>
>>>>>>>>
>>>>>>>> How swapcache is handled ? ...and How kmem works with this calc ?
>>>>>>>>
>>>>>>> I am ignoring kmem, because we don't account kmem for the root cgroup
>>>>>>> anyway.
>>>>>>>
>>>>>>> Setting the limit is invalid, and we don't account until the limit is
>>>>>>> set. Then it will be 0, always.
>>>>>>>
>>>>>>> For swapcache, I am hoping that totalswap - freeswap will cover
>>>>>>> everything swap related. If you think I am wrong, please enlighten me.
>>>>>>>
>>>>>>
>>>>>> i.totalswap - i.freeswap = # of used swap entries.
>>>>>>
>>>>>> SwapCache can be rss and used swap entry at the same time.
>>>>>>
>>>>>
>>>>> Well, yes, but the rss entries would be accounted for in get_mm_rss(),
>>>>> won't they ?
>>>>>
>>>>> What am I missing ?
>>>>
>>>>
>>>>
>>>> I think the correct caluculation is
>>>>
>>>> Sum of all RSS + All file caches + (i.total_swap - i.freeswap - # of
>>>> mapped SwapCache)
>>>>
>>>>
>>>> In the patch, mapped SwapCache is counted as both of rss and swap.
>>>>
>>>
>>> After a quick look, swapcache is counted as file pages and meanwhile
>>> use a swap entry at the same time(__add_to{delete_from}_swap_cache()).
>>> Even though, I think we still do not need to exclude swapcache out,
>>> because it indeed uses two copy of resource: one is swap entry, one is
>>> cache, so the usage should count both of them in.
>>>
>>> What I think it matters is that swapcache may be counted as both file
>>> pages and rss(if it's a process's anonymous page), which we need to
>>> subtract # of swapcache to avoid double-counting. But it isn't always
>>> so: a shmem/tmpfs page may use swapcache and be counted as file pages
>>> but not a rss, then we can not subtract swapcache... Is there anything
>>> I lost?
>>>
>>
>>
>> Please don't think difficult. All pages for user/caches are counted in
>> LRU. All swap-entry usage can be cauht by total_swap_pages - nr_swap_pages.
>> We just need to subtract number of swap-cache which is double counted
>> as swap-entry and a page in LRU.
>>
>> NR_ACTIVE_ANON + NR_INACTIVE_ANON + NR_ACTIVE_FILE + NR_INACTIVE_FILE
>> + NR_UNEVICTABLE + total_swap_pages - nr_swap_pages - NR_SWAP_CACHE
>>
>
> Using LRU numbers is more suitable. But forgive me, I still doubt
> whether we should subtract NR_SWAP_CACHE out because it uses both a
> swap entry and a page cache and it isn't a real double counting.
>
Used swap entry can be reclaimed if there are SwapCache on memory.
Thanks,
ーKame
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
WARNING: multiple messages have this Message-ID (diff)
From: Kamezawa Hiroyuki <kamezawa.hiroyu@jp.fujitsu.com>
To: Sha Zhengju <handai.szj@gmail.com>
Cc: Glauber Costa <glommer@parallels.com>,
linux-mm@kvack.org, cgroups@vger.kernel.org,
Tejun Heo <tj@kernel.org>,
Andrew Morton <akpm@linux-foundation.org>,
Michal Hocko <mhocko@suse.cz>,
anton.vorontsov@linaro.org, Johannes Weiner <hannes@cmpxchg.org>,
Mel Gorman <mgorman@suse.de>
Subject: Re: [PATCH v2 2/5] memcg: provide root figures from system totals
Date: Thu, 14 Mar 2013 09:03:15 +0900 [thread overview]
Message-ID: <514113C3.2090505@jp.fujitsu.com> (raw)
In-Reply-To: <CAFj3OHUupqG-178gnTUWc787n5cJjGgGZRzXuNRVvOvYqkHvgA@mail.gmail.com>
(2013/03/13 18:59), Sha Zhengju wrote:
> On Wed, Mar 13, 2013 at 5:15 PM, Kamezawa Hiroyuki
> <kamezawa.hiroyu@jp.fujitsu.com> wrote:
>> (2013/03/13 15:58), Sha Zhengju wrote:
>>>
>>> On Wed, Mar 6, 2013 at 6:59 PM, Kamezawa Hiroyuki
>>> <kamezawa.hiroyu@jp.fujitsu.com> wrote:
>>>>
>>>> (2013/03/06 19:52), Glauber Costa wrote:
>>>>>
>>>>> On 03/06/2013 02:45 PM, Kamezawa Hiroyuki wrote:
>>>>>>
>>>>>> (2013/03/06 17:30), Glauber Costa wrote:
>>>>>>>
>>>>>>> On 03/06/2013 04:27 AM, Kamezawa Hiroyuki wrote:
>>>>>>>>
>>>>>>>> (2013/03/05 22:10), Glauber Costa wrote:
>>>>>>>>>
>>>>>>>>> + case _MEMSWAP: {
>>>>>>>>> + struct sysinfo i;
>>>>>>>>> + si_swapinfo(&i);
>>>>>>>>> +
>>>>>>>>> + return ((memcg_read_root_rss() +
>>>>>>>>> + atomic_long_read(&vm_stat[NR_FILE_PAGES])) << PAGE_SHIFT)
>>>>>>>>> +
>>>>>>>>> + i.totalswap - i.freeswap;
>>>>>>>>
>>>>>>>>
>>>>>>>> How swapcache is handled ? ...and How kmem works with this calc ?
>>>>>>>>
>>>>>>> I am ignoring kmem, because we don't account kmem for the root cgroup
>>>>>>> anyway.
>>>>>>>
>>>>>>> Setting the limit is invalid, and we don't account until the limit is
>>>>>>> set. Then it will be 0, always.
>>>>>>>
>>>>>>> For swapcache, I am hoping that totalswap - freeswap will cover
>>>>>>> everything swap related. If you think I am wrong, please enlighten me.
>>>>>>>
>>>>>>
>>>>>> i.totalswap - i.freeswap = # of used swap entries.
>>>>>>
>>>>>> SwapCache can be rss and used swap entry at the same time.
>>>>>>
>>>>>
>>>>> Well, yes, but the rss entries would be accounted for in get_mm_rss(),
>>>>> won't they ?
>>>>>
>>>>> What am I missing ?
>>>>
>>>>
>>>>
>>>> I think the correct caluculation is
>>>>
>>>> Sum of all RSS + All file caches + (i.total_swap - i.freeswap - # of
>>>> mapped SwapCache)
>>>>
>>>>
>>>> In the patch, mapped SwapCache is counted as both of rss and swap.
>>>>
>>>
>>> After a quick look, swapcache is counted as file pages and meanwhile
>>> use a swap entry at the same time(__add_to{delete_from}_swap_cache()).
>>> Even though, I think we still do not need to exclude swapcache out,
>>> because it indeed uses two copy of resource: one is swap entry, one is
>>> cache, so the usage should count both of them in.
>>>
>>> What I think it matters is that swapcache may be counted as both file
>>> pages and rss(if it's a process's anonymous page), which we need to
>>> subtract # of swapcache to avoid double-counting. But it isn't always
>>> so: a shmem/tmpfs page may use swapcache and be counted as file pages
>>> but not a rss, then we can not subtract swapcache... Is there anything
>>> I lost?
>>>
>>
>>
>> Please don't think difficult. All pages for user/caches are counted in
>> LRU. All swap-entry usage can be cauht by total_swap_pages - nr_swap_pages.
>> We just need to subtract number of swap-cache which is double counted
>> as swap-entry and a page in LRU.
>>
>> NR_ACTIVE_ANON + NR_INACTIVE_ANON + NR_ACTIVE_FILE + NR_INACTIVE_FILE
>> + NR_UNEVICTABLE + total_swap_pages - nr_swap_pages - NR_SWAP_CACHE
>>
>
> Using LRU numbers is more suitable. But forgive me, I still doubt
> whether we should subtract NR_SWAP_CACHE out because it uses both a
> swap entry and a page cache and it isn't a real double counting.
>
Used swap entry can be reclaimed if there are SwapCache on memory.
Thanks,
a? 1/4 Kame
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
next prev parent reply other threads:[~2013-03-14 0:03 UTC|newest]
Thread overview: 72+ messages / expand[flat|nested] mbox.gz Atom feed top
2013-03-05 13:10 [PATCH v2 0/5] bypass root memcg charges if no memcgs are possible Glauber Costa
2013-03-05 13:10 ` Glauber Costa
[not found] ` <1362489058-3455-1-git-send-email-glommer-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-03-05 13:10 ` [PATCH v2 1/5] memcg: make nocpu_base available for non hotplug Glauber Costa
2013-03-05 13:10 ` Glauber Costa
[not found] ` <1362489058-3455-2-git-send-email-glommer-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-03-06 0:04 ` Kamezawa Hiroyuki
2013-03-06 0:04 ` Kamezawa Hiroyuki
2013-03-19 11:07 ` Michal Hocko
2013-03-05 13:10 ` [PATCH v2 2/5] memcg: provide root figures from system totals Glauber Costa
2013-03-05 13:10 ` Glauber Costa
2013-03-06 0:27 ` Kamezawa Hiroyuki
[not found] ` <51368D80.20701-+CUm20s59erQFUHtdCDX3A@public.gmane.org>
2013-03-06 8:30 ` Glauber Costa
2013-03-06 8:30 ` Glauber Costa
[not found] ` <5136FEC2.2050004-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-03-06 10:45 ` Kamezawa Hiroyuki
2013-03-06 10:45 ` Kamezawa Hiroyuki
[not found] ` <51371E4A.7090807-+CUm20s59erQFUHtdCDX3A@public.gmane.org>
2013-03-06 10:52 ` Glauber Costa
2013-03-06 10:52 ` Glauber Costa
[not found] ` <51371FEF.3020507-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-03-06 10:59 ` Kamezawa Hiroyuki
2013-03-06 10:59 ` Kamezawa Hiroyuki
[not found] ` <513721A5.6080401-+CUm20s59erQFUHtdCDX3A@public.gmane.org>
2013-03-13 6:58 ` Sha Zhengju
2013-03-13 6:58 ` Sha Zhengju
[not found] ` <CAFj3OHWm_GjLFwNEE=D69DR-YSF25AZvKTLHpyHq7aYDi12b0g-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2013-03-13 9:15 ` Kamezawa Hiroyuki
2013-03-13 9:15 ` Kamezawa Hiroyuki
2013-03-13 9:59 ` Sha Zhengju
2013-03-14 0:03 ` Kamezawa Hiroyuki [this message]
2013-03-14 0:03 ` Kamezawa Hiroyuki
2013-03-06 10:50 ` Kamezawa Hiroyuki
2013-03-06 10:50 ` Kamezawa Hiroyuki
[not found] ` <1362489058-3455-3-git-send-email-glommer-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-03-19 12:46 ` Michal Hocko
2013-03-19 12:46 ` Michal Hocko
[not found] ` <20130319124650.GE7869-2MMpYkNvuYDjFM9bn6wA6Q@public.gmane.org>
2013-03-19 12:55 ` Michal Hocko
2013-03-19 12:55 ` Michal Hocko
2013-03-20 7:03 ` Glauber Costa
[not found] ` <51495F35.9040302-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-03-20 8:03 ` Michal Hocko
2013-03-20 8:03 ` Michal Hocko
2013-03-20 8:08 ` Glauber Costa
[not found] ` <51496E71.5010707-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-03-20 8:18 ` Michal Hocko
2013-03-20 8:18 ` Michal Hocko
2013-03-20 8:34 ` Glauber Costa
2013-03-20 8:58 ` Michal Hocko
2013-03-20 9:30 ` Glauber Costa
[not found] ` <514981C3.8070304-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-03-21 6:08 ` Kamezawa Hiroyuki
2013-03-21 6:08 ` Kamezawa Hiroyuki
2013-03-20 16:40 ` Anton Vorontsov
2013-03-20 16:40 ` Anton Vorontsov
2013-03-20 7:04 ` Glauber Costa
2013-03-05 13:10 ` [PATCH v2 3/5] memcg: make it suck faster Glauber Costa
2013-03-05 13:10 ` Glauber Costa
[not found] ` <1362489058-3455-4-git-send-email-glommer-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-03-06 0:46 ` Kamezawa Hiroyuki
2013-03-06 0:46 ` Kamezawa Hiroyuki
2013-03-06 8:38 ` Glauber Costa
[not found] ` <5137007E.7030004-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-03-06 10:54 ` Kamezawa Hiroyuki
2013-03-06 10:54 ` Kamezawa Hiroyuki
2013-03-13 8:08 ` Sha Zhengju
2013-03-13 8:08 ` Sha Zhengju
[not found] ` <CAFj3OHU6f3o5GmbFyUsqtSWqHruSS4Yyodx=s=Vh8mO7GfTE8w-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2013-03-20 7:13 ` Glauber Costa
2013-03-20 7:13 ` Glauber Costa
2013-03-19 13:58 ` Michal Hocko
2013-03-19 13:58 ` Michal Hocko
2013-03-20 7:00 ` Glauber Costa
[not found] ` <51495E73.8090409-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-03-20 8:13 ` Michal Hocko
2013-03-20 8:13 ` Michal Hocko
2013-03-05 13:10 ` [PATCH v2 4/5] memcg: do not call page_cgroup_init at system_boot Glauber Costa
2013-03-05 13:10 ` Glauber Costa
[not found] ` <1362489058-3455-5-git-send-email-glommer-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-03-06 1:07 ` Kamezawa Hiroyuki
2013-03-06 1:07 ` Kamezawa Hiroyuki
[not found] ` <513696C1.3090301-+CUm20s59erQFUHtdCDX3A@public.gmane.org>
2013-03-06 8:22 ` Glauber Costa
2013-03-06 8:22 ` Glauber Costa
2013-03-19 14:06 ` Michal Hocko
2013-03-05 13:10 ` [PATCH v2 5/5] memcg: do not walk all the way to the root for memcg Glauber Costa
2013-03-05 13:10 ` Glauber Costa
[not found] ` <1362489058-3455-6-git-send-email-glommer-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-03-06 1:08 ` Kamezawa Hiroyuki
2013-03-06 1:08 ` Kamezawa Hiroyuki
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=514113C3.2090505@jp.fujitsu.com \
--to=kamezawa.hiroyu@jp.fujitsu.com \
--cc=akpm@linux-foundation.org \
--cc=anton.vorontsov@linaro.org \
--cc=cgroups@vger.kernel.org \
--cc=glommer@parallels.com \
--cc=handai.szj@gmail.com \
--cc=hannes@cmpxchg.org \
--cc=linux-mm@kvack.org \
--cc=mgorman@suse.de \
--cc=mhocko@suse.cz \
--cc=tj@kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.