cgroups.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Kamezawa Hiroyuki <kamezawa.hiroyu@jp.fujitsu.com>
To: Sha Zhengju <handai.szj@gmail.com>
Cc: Glauber Costa <glommer@parallels.com>,
	linux-mm@kvack.org, cgroups@vger.kernel.org,
	Tejun Heo <tj@kernel.org>,
	Andrew Morton <akpm@linux-foundation.org>,
	Michal Hocko <mhocko@suse.cz>,
	anton.vorontsov@linaro.org, Johannes Weiner <hannes@cmpxchg.org>,
	Mel Gorman <mgorman@suse.de>
Subject: Re: [PATCH v2 2/5] memcg: provide root figures from system totals
Date: Thu, 14 Mar 2013 09:03:15 +0900	[thread overview]
Message-ID: <514113C3.2090505@jp.fujitsu.com> (raw)
In-Reply-To: <CAFj3OHUupqG-178gnTUWc787n5cJjGgGZRzXuNRVvOvYqkHvgA@mail.gmail.com>

(2013/03/13 18:59), Sha Zhengju wrote:
> On Wed, Mar 13, 2013 at 5:15 PM, Kamezawa Hiroyuki
> <kamezawa.hiroyu@jp.fujitsu.com> wrote:
>> (2013/03/13 15:58), Sha Zhengju wrote:
>>>
>>> On Wed, Mar 6, 2013 at 6:59 PM, Kamezawa Hiroyuki
>>> <kamezawa.hiroyu@jp.fujitsu.com> wrote:
>>>>
>>>> (2013/03/06 19:52), Glauber Costa wrote:
>>>>>
>>>>> On 03/06/2013 02:45 PM, Kamezawa Hiroyuki wrote:
>>>>>>
>>>>>> (2013/03/06 17:30), Glauber Costa wrote:
>>>>>>>
>>>>>>> On 03/06/2013 04:27 AM, Kamezawa Hiroyuki wrote:
>>>>>>>>
>>>>>>>> (2013/03/05 22:10), Glauber Costa wrote:
>>>>>>>>>
>>>>>>>>> + case _MEMSWAP: {
>>>>>>>>> +         struct sysinfo i;
>>>>>>>>> +         si_swapinfo(&i);
>>>>>>>>> +
>>>>>>>>> +         return ((memcg_read_root_rss() +
>>>>>>>>> +         atomic_long_read(&vm_stat[NR_FILE_PAGES])) << PAGE_SHIFT)
>>>>>>>>> +
>>>>>>>>> +         i.totalswap - i.freeswap;
>>>>>>>>
>>>>>>>>
>>>>>>>> How swapcache is handled ? ...and How kmem works with this calc ?
>>>>>>>>
>>>>>>> I am ignoring kmem, because we don't account kmem for the root cgroup
>>>>>>> anyway.
>>>>>>>
>>>>>>> Setting the limit is invalid, and we don't account until the limit is
>>>>>>> set. Then it will be 0, always.
>>>>>>>
>>>>>>> For swapcache, I am hoping that totalswap - freeswap will cover
>>>>>>> everything swap related. If you think I am wrong, please enlighten me.
>>>>>>>
>>>>>>
>>>>>> i.totalswap - i.freeswap = # of used swap entries.
>>>>>>
>>>>>> SwapCache can be rss and used swap entry at the same time.
>>>>>>
>>>>>
>>>>> Well, yes, but the rss entries would be accounted for in get_mm_rss(),
>>>>> won't they ?
>>>>>
>>>>> What am I missing ?
>>>>
>>>>
>>>>
>>>> I think the correct caluculation is
>>>>
>>>>     Sum of all RSS + All file caches + (i.total_swap - i.freeswap - # of
>>>> mapped SwapCache)
>>>>
>>>>
>>>> In the patch, mapped SwapCache is counted as both of rss and swap.
>>>>
>>>
>>> After a quick look, swapcache is counted as file pages and meanwhile
>>> use a swap entry at the same time(__add_to{delete_from}_swap_cache()).
>>> Even though, I think we still do not need to exclude swapcache out,
>>> because it indeed uses two copy of resource: one is swap entry, one is
>>> cache, so the usage should count both of them in.
>>>
>>> What I think it matters is that swapcache may be counted as both file
>>> pages and rss(if it's a process's anonymous page), which we need to
>>> subtract # of swapcache to avoid double-counting. But it isn't always
>>> so: a shmem/tmpfs page may use swapcache and be counted as file pages
>>> but not a rss, then we can not subtract swapcache... Is there anything
>>> I lost?
>>>
>>
>>
>> Please don't think difficult. All pages for user/caches are counted in
>> LRU. All swap-entry usage can be cauht by total_swap_pages - nr_swap_pages.
>> We just need to subtract number of swap-cache which is double counted
>> as swap-entry and a page in LRU.
>>
>> NR_ACTIVE_ANON + NR_INACTIVE_ANON + NR_ACTIVE_FILE + NR_INACTIVE_FILE
>> + NR_UNEVICTABLE + total_swap_pages - nr_swap_pages - NR_SWAP_CACHE
>>
>
> Using LRU numbers is more suitable. But forgive me, I still doubt
> whether we should subtract NR_SWAP_CACHE out because it uses both a
> swap entry and a page cache and it isn't a real double counting.
>

Used swap entry can be reclaimed if there are SwapCache on memory.

Thanks,
ーKame


--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

  reply	other threads:[~2013-03-14  0:03 UTC|newest]

Thread overview: 42+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2013-03-05 13:10 [PATCH v2 0/5] bypass root memcg charges if no memcgs are possible Glauber Costa
     [not found] ` <1362489058-3455-1-git-send-email-glommer-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-03-05 13:10   ` [PATCH v2 1/5] memcg: make nocpu_base available for non hotplug Glauber Costa
     [not found]     ` <1362489058-3455-2-git-send-email-glommer-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-03-06  0:04       ` Kamezawa Hiroyuki
2013-03-19 11:07     ` Michal Hocko
2013-03-05 13:10   ` [PATCH v2 2/5] memcg: provide root figures from system totals Glauber Costa
2013-03-06  0:27     ` Kamezawa Hiroyuki
     [not found]       ` <51368D80.20701-+CUm20s59erQFUHtdCDX3A@public.gmane.org>
2013-03-06  8:30         ` Glauber Costa
     [not found]           ` <5136FEC2.2050004-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-03-06 10:45             ` Kamezawa Hiroyuki
     [not found]               ` <51371E4A.7090807-+CUm20s59erQFUHtdCDX3A@public.gmane.org>
2013-03-06 10:52                 ` Glauber Costa
     [not found]                   ` <51371FEF.3020507-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-03-06 10:59                     ` Kamezawa Hiroyuki
     [not found]                       ` <513721A5.6080401-+CUm20s59erQFUHtdCDX3A@public.gmane.org>
2013-03-13  6:58                         ` Sha Zhengju
     [not found]                           ` <CAFj3OHWm_GjLFwNEE=D69DR-YSF25AZvKTLHpyHq7aYDi12b0g-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2013-03-13  9:15                             ` Kamezawa Hiroyuki
2013-03-13  9:59                               ` Sha Zhengju
2013-03-14  0:03                                 ` Kamezawa Hiroyuki [this message]
2013-03-06 10:50             ` Kamezawa Hiroyuki
     [not found]     ` <1362489058-3455-3-git-send-email-glommer-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-03-19 12:46       ` Michal Hocko
     [not found]         ` <20130319124650.GE7869-2MMpYkNvuYDjFM9bn6wA6Q@public.gmane.org>
2013-03-19 12:55           ` Michal Hocko
2013-03-20  7:03             ` Glauber Costa
     [not found]               ` <51495F35.9040302-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-03-20  8:03                 ` Michal Hocko
2013-03-20  8:08                   ` Glauber Costa
     [not found]                     ` <51496E71.5010707-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-03-20  8:18                       ` Michal Hocko
2013-03-20  8:34                         ` Glauber Costa
2013-03-20  8:58                           ` Michal Hocko
2013-03-20  9:30                             ` Glauber Costa
     [not found]                               ` <514981C3.8070304-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-03-21  6:08                                 ` Kamezawa Hiroyuki
2013-03-20 16:40                       ` Anton Vorontsov
2013-03-20  7:04         ` Glauber Costa
2013-03-05 13:10   ` [PATCH v2 3/5] memcg: make it suck faster Glauber Costa
     [not found]     ` <1362489058-3455-4-git-send-email-glommer-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-03-06  0:46       ` Kamezawa Hiroyuki
2013-03-06  8:38         ` Glauber Costa
     [not found]           ` <5137007E.7030004-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-03-06 10:54             ` Kamezawa Hiroyuki
2013-03-13  8:08       ` Sha Zhengju
     [not found]         ` <CAFj3OHU6f3o5GmbFyUsqtSWqHruSS4Yyodx=s=Vh8mO7GfTE8w-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2013-03-20  7:13           ` Glauber Costa
2013-03-19 13:58       ` Michal Hocko
2013-03-20  7:00         ` Glauber Costa
     [not found]           ` <51495E73.8090409-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-03-20  8:13             ` Michal Hocko
2013-03-05 13:10   ` [PATCH v2 4/5] memcg: do not call page_cgroup_init at system_boot Glauber Costa
     [not found]     ` <1362489058-3455-5-git-send-email-glommer-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-03-06  1:07       ` Kamezawa Hiroyuki
     [not found]         ` <513696C1.3090301-+CUm20s59erQFUHtdCDX3A@public.gmane.org>
2013-03-06  8:22           ` Glauber Costa
2013-03-19 14:06     ` Michal Hocko
2013-03-05 13:10   ` [PATCH v2 5/5] memcg: do not walk all the way to the root for memcg Glauber Costa
     [not found]     ` <1362489058-3455-6-git-send-email-glommer-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-03-06  1:08       ` Kamezawa Hiroyuki

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=514113C3.2090505@jp.fujitsu.com \
    --to=kamezawa.hiroyu@jp.fujitsu.com \
    --cc=akpm@linux-foundation.org \
    --cc=anton.vorontsov@linaro.org \
    --cc=cgroups@vger.kernel.org \
    --cc=glommer@parallels.com \
    --cc=handai.szj@gmail.com \
    --cc=hannes@cmpxchg.org \
    --cc=linux-mm@kvack.org \
    --cc=mgorman@suse.de \
    --cc=mhocko@suse.cz \
    --cc=tj@kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).