From: Glauber Costa <glommer-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
To: Suleiman Souhlal <ssouhlal-HZy0K5TPuP5AfugRpC6u6w@public.gmane.org>
Cc: cgroups-u79uwXL29TY76Z2rM5mHXA@public.gmane.org,
suleiman-hpIqsD4AKlfQT0dZR+AlfA@public.gmane.org,
kamezawa.hiroyu-+CUm20s59erQFUHtdCDX3A@public.gmane.org,
penberg-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org,
cl-vYTEC60ixJUAvxtiuMwx3w@public.gmane.org,
yinghan-hpIqsD4AKlfQT0dZR+AlfA@public.gmane.org,
hughd-hpIqsD4AKlfQT0dZR+AlfA@public.gmane.org,
gthelen-hpIqsD4AKlfQT0dZR+AlfA@public.gmane.org,
peterz-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org,
dan.magenheimer-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org,
hannes-druUgvl0LCNAfugRpC6u6w@public.gmane.org,
mgorman-l3A5Bk7waGM@public.gmane.org,
James.Bottomley-d9PhHud1JfjCXq6kfMZ53/egYHeGw8Jk@public.gmane.org,
linux-mm-Bw31MaZKKs3YtjvyW6yDsg@public.gmane.org,
devel-GEFAQzZX7r8dnm+yROfE0A@public.gmane.org,
linux-kernel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
Subject: Re: [PATCH v2 02/13] memcg: Kernel memory accounting infrastructure.
Date: Mon, 12 Mar 2012 16:38:26 +0400 [thread overview]
Message-ID: <4F5DEE42.6050607@parallels.com> (raw)
In-Reply-To: <1331325556-16447-3-git-send-email-ssouhlal-HZy0K5TPuP5AfugRpC6u6w@public.gmane.org>
On 03/10/2012 12:39 AM, Suleiman Souhlal wrote:
> +#ifdef CONFIG_CGROUP_MEM_RES_CTLR_KMEM
> +int
> +memcg_charge_kmem(struct mem_cgroup *memcg, gfp_t gfp, long long delta)
> +{
> + struct res_counter *fail_res;
> + struct mem_cgroup *_memcg;
> + int may_oom, ret;
> +
> + may_oom = (gfp& __GFP_WAIT)&& (gfp& __GFP_FS)&&
> + !(gfp& __GFP_NORETRY);
> +
> + ret = 0;
> +
> + _memcg = memcg;
> + if (memcg&& !mem_cgroup_test_flag(memcg,
> + MEMCG_INDEPENDENT_KMEM_LIMIT)) {
> + ret = __mem_cgroup_try_charge(NULL, gfp, delta / PAGE_SIZE,
> + &_memcg, may_oom);
> + if (ret == -ENOMEM)
> + return ret;
> + }
> +
> + if (memcg&& _memcg == memcg)
> + ret = res_counter_charge(&memcg->kmem, delta,&fail_res);
> +
> + return ret;
> +}
> +
> +void
Ok.
So I've spent most of the day today trying to come up with a way not to
kill the whole performance we gain from consume_stock() by this
res_counter_charge() to kmem afterwards...
You mentioned you want to still be able to bill to memcg->kmem mostly
for debugging/display purposes. So we're surely not using all of the
res_counter infrastructure (limiting, soft limits, etc)
I was thinking: Can't we have a percpu_counter that we use for this
purpose when !kmem_independent ?
we may not even need to bloat the struct, since we can fold it into a
union with struct res_counter kmem (which is bigger than a percpu
counter anyway).
We just need to be a bit more careful not to allow kmem_independent to
change when we already have charges to any of them (but we need to do it
anyway)
WARNING: multiple messages have this Message-ID (diff)
From: Glauber Costa <glommer@parallels.com>
To: Suleiman Souhlal <ssouhlal@FreeBSD.org>
Cc: cgroups@vger.kernel.org, suleiman@google.com,
kamezawa.hiroyu@jp.fujitsu.com, penberg@kernel.org, cl@linux.com,
yinghan@google.com, hughd@google.com, gthelen@google.com,
peterz@infradead.org, dan.magenheimer@oracle.com,
hannes@cmpxchg.org, mgorman@suse.de,
James.Bottomley@HansenPartnership.com, linux-mm@kvack.org,
devel@openvz.org, linux-kernel@vger.kernel.org
Subject: Re: [PATCH v2 02/13] memcg: Kernel memory accounting infrastructure.
Date: Mon, 12 Mar 2012 16:38:26 +0400 [thread overview]
Message-ID: <4F5DEE42.6050607@parallels.com> (raw)
In-Reply-To: <1331325556-16447-3-git-send-email-ssouhlal@FreeBSD.org>
On 03/10/2012 12:39 AM, Suleiman Souhlal wrote:
> +#ifdef CONFIG_CGROUP_MEM_RES_CTLR_KMEM
> +int
> +memcg_charge_kmem(struct mem_cgroup *memcg, gfp_t gfp, long long delta)
> +{
> + struct res_counter *fail_res;
> + struct mem_cgroup *_memcg;
> + int may_oom, ret;
> +
> + may_oom = (gfp& __GFP_WAIT)&& (gfp& __GFP_FS)&&
> + !(gfp& __GFP_NORETRY);
> +
> + ret = 0;
> +
> + _memcg = memcg;
> + if (memcg&& !mem_cgroup_test_flag(memcg,
> + MEMCG_INDEPENDENT_KMEM_LIMIT)) {
> + ret = __mem_cgroup_try_charge(NULL, gfp, delta / PAGE_SIZE,
> + &_memcg, may_oom);
> + if (ret == -ENOMEM)
> + return ret;
> + }
> +
> + if (memcg&& _memcg == memcg)
> + ret = res_counter_charge(&memcg->kmem, delta,&fail_res);
> +
> + return ret;
> +}
> +
> +void
Ok.
So I've spent most of the day today trying to come up with a way not to
kill the whole performance we gain from consume_stock() by this
res_counter_charge() to kmem afterwards...
You mentioned you want to still be able to bill to memcg->kmem mostly
for debugging/display purposes. So we're surely not using all of the
res_counter infrastructure (limiting, soft limits, etc)
I was thinking: Can't we have a percpu_counter that we use for this
purpose when !kmem_independent ?
we may not even need to bloat the struct, since we can fold it into a
union with struct res_counter kmem (which is bigger than a percpu
counter anyway).
We just need to be a bit more careful not to allow kmem_independent to
change when we already have charges to any of them (but we need to do it
anyway)
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Fight unfair telecom internet charges in Canada: sign http://stopthemeter.ca/
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
WARNING: multiple messages have this Message-ID (diff)
From: Glauber Costa <glommer@parallels.com>
To: Suleiman Souhlal <ssouhlal@FreeBSD.org>
Cc: <cgroups@vger.kernel.org>, <suleiman@google.com>,
<kamezawa.hiroyu@jp.fujitsu.com>, <penberg@kernel.org>,
<cl@linux.com>, <yinghan@google.com>, <hughd@google.com>,
<gthelen@google.com>, <peterz@infradead.org>,
<dan.magenheimer@oracle.com>, <hannes@cmpxchg.org>,
<mgorman@suse.de>, <James.Bottomley@HansenPartnership.com>,
<linux-mm@kvack.org>, <devel@openvz.org>,
<linux-kernel@vger.kernel.org>
Subject: Re: [PATCH v2 02/13] memcg: Kernel memory accounting infrastructure.
Date: Mon, 12 Mar 2012 16:38:26 +0400 [thread overview]
Message-ID: <4F5DEE42.6050607@parallels.com> (raw)
In-Reply-To: <1331325556-16447-3-git-send-email-ssouhlal@FreeBSD.org>
On 03/10/2012 12:39 AM, Suleiman Souhlal wrote:
> +#ifdef CONFIG_CGROUP_MEM_RES_CTLR_KMEM
> +int
> +memcg_charge_kmem(struct mem_cgroup *memcg, gfp_t gfp, long long delta)
> +{
> + struct res_counter *fail_res;
> + struct mem_cgroup *_memcg;
> + int may_oom, ret;
> +
> + may_oom = (gfp& __GFP_WAIT)&& (gfp& __GFP_FS)&&
> + !(gfp& __GFP_NORETRY);
> +
> + ret = 0;
> +
> + _memcg = memcg;
> + if (memcg&& !mem_cgroup_test_flag(memcg,
> + MEMCG_INDEPENDENT_KMEM_LIMIT)) {
> + ret = __mem_cgroup_try_charge(NULL, gfp, delta / PAGE_SIZE,
> + &_memcg, may_oom);
> + if (ret == -ENOMEM)
> + return ret;
> + }
> +
> + if (memcg&& _memcg == memcg)
> + ret = res_counter_charge(&memcg->kmem, delta,&fail_res);
> +
> + return ret;
> +}
> +
> +void
Ok.
So I've spent most of the day today trying to come up with a way not to
kill the whole performance we gain from consume_stock() by this
res_counter_charge() to kmem afterwards...
You mentioned you want to still be able to bill to memcg->kmem mostly
for debugging/display purposes. So we're surely not using all of the
res_counter infrastructure (limiting, soft limits, etc)
I was thinking: Can't we have a percpu_counter that we use for this
purpose when !kmem_independent ?
we may not even need to bloat the struct, since we can fold it into a
union with struct res_counter kmem (which is bigger than a percpu
counter anyway).
We just need to be a bit more careful not to allow kmem_independent to
change when we already have charges to any of them (but we need to do it
anyway)
next prev parent reply other threads:[~2012-03-12 12:38 UTC|newest]
Thread overview: 105+ messages / expand[flat|nested] mbox.gz Atom feed top
2012-03-09 20:39 [PATCH v2 00/13] Memcg Kernel Memory Tracking Suleiman Souhlal
2012-03-09 20:39 ` Suleiman Souhlal
2012-03-09 20:39 ` Suleiman Souhlal
2012-03-09 20:39 ` [PATCH v2 01/13] memcg: Consolidate various flags into a single flags field Suleiman Souhlal
2012-03-09 20:39 ` Suleiman Souhlal
2012-03-11 7:50 ` Glauber Costa
2012-03-11 7:50 ` Glauber Costa
2012-03-09 20:39 ` [PATCH v2 02/13] memcg: Kernel memory accounting infrastructure Suleiman Souhlal
2012-03-09 20:39 ` Suleiman Souhlal
[not found] ` <1331325556-16447-3-git-send-email-ssouhlal-HZy0K5TPuP5AfugRpC6u6w@public.gmane.org>
2012-03-11 8:12 ` Glauber Costa
2012-03-11 8:12 ` Glauber Costa
2012-03-11 8:12 ` Glauber Costa
2012-03-13 6:24 ` KAMEZAWA Hiroyuki
2012-03-13 6:24 ` KAMEZAWA Hiroyuki
2012-03-13 10:37 ` Glauber Costa
2012-03-13 10:37 ` Glauber Costa
2012-03-13 17:00 ` Greg Thelen
2012-03-13 17:00 ` Greg Thelen
[not found] ` <xr93d38g77w5.fsf-aSPv4SP+Du0KgorLzL7FmE7CuiCeIGUxQQ4Iyu8u01E@public.gmane.org>
2012-03-13 17:31 ` Glauber Costa
2012-03-13 17:31 ` Glauber Costa
2012-03-13 17:31 ` Glauber Costa
2012-03-14 0:15 ` KAMEZAWA Hiroyuki
2012-03-14 0:15 ` KAMEZAWA Hiroyuki
2012-03-14 12:29 ` Glauber Costa
2012-03-14 12:29 ` Glauber Costa
2012-03-15 0:48 ` KAMEZAWA Hiroyuki
2012-03-15 0:48 ` KAMEZAWA Hiroyuki
[not found] ` <4F613C5B.8030304-+CUm20s59erQFUHtdCDX3A@public.gmane.org>
2012-03-15 11:07 ` Glauber Costa
2012-03-15 11:07 ` Glauber Costa
2012-03-15 11:07 ` Glauber Costa
2012-03-15 11:13 ` Peter Zijlstra
2012-03-15 11:13 ` Peter Zijlstra
2012-03-15 11:21 ` Glauber Costa
2012-03-15 11:21 ` Glauber Costa
2012-03-12 12:38 ` Glauber Costa [this message]
2012-03-12 12:38 ` Glauber Costa
2012-03-12 12:38 ` Glauber Costa
2012-03-09 20:39 ` [PATCH v2 03/13] memcg: Uncharge all kmem when deleting a cgroup Suleiman Souhlal
2012-03-09 20:39 ` Suleiman Souhlal
2012-03-11 8:19 ` Glauber Costa
2012-03-11 8:19 ` Glauber Costa
2012-03-13 23:16 ` Suleiman Souhlal
2012-03-13 23:16 ` Suleiman Souhlal
2012-03-14 11:59 ` Glauber Costa
2012-03-14 11:59 ` Glauber Costa
[not found] ` <1331325556-16447-4-git-send-email-ssouhlal-HZy0K5TPuP5AfugRpC6u6w@public.gmane.org>
2012-03-13 6:27 ` KAMEZAWA Hiroyuki
2012-03-13 6:27 ` KAMEZAWA Hiroyuki
2012-03-13 6:27 ` KAMEZAWA Hiroyuki
2012-03-09 20:39 ` [PATCH v2 04/13] memcg: Make it possible to use the stock for more than one page Suleiman Souhlal
2012-03-09 20:39 ` Suleiman Souhlal
[not found] ` <1331325556-16447-5-git-send-email-ssouhlal-HZy0K5TPuP5AfugRpC6u6w@public.gmane.org>
2012-03-11 10:49 ` Glauber Costa
2012-03-11 10:49 ` Glauber Costa
2012-03-11 10:49 ` Glauber Costa
2012-03-09 20:39 ` [PATCH v2 05/13] memcg: Reclaim when more than one page needed Suleiman Souhlal
2012-03-09 20:39 ` Suleiman Souhlal
2012-03-09 20:39 ` [PATCH v2 06/13] slab: Add kmem_cache_gfp_flags() helper function Suleiman Souhlal
2012-03-09 20:39 ` Suleiman Souhlal
2012-03-11 10:53 ` Glauber Costa
2012-03-11 10:53 ` Glauber Costa
[not found] ` <4F5C8414.5090800-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2012-03-13 23:21 ` Suleiman Souhlal
2012-03-13 23:21 ` Suleiman Souhlal
2012-03-13 23:21 ` Suleiman Souhlal
[not found] ` <CABCjUKCioWO-F7k=hVs_18B3uyL4zG3-krPFDh++YAnmejKKdg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2012-03-14 11:48 ` Glauber Costa
2012-03-14 11:48 ` Glauber Costa
2012-03-14 11:48 ` Glauber Costa
[not found] ` <4F608579.5090109-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2012-03-14 22:08 ` Suleiman Souhlal
2012-03-14 22:08 ` Suleiman Souhlal
2012-03-14 22:08 ` Suleiman Souhlal
2012-03-09 20:39 ` [PATCH v2 07/13] memcg: Slab accounting Suleiman Souhlal
2012-03-09 20:39 ` Suleiman Souhlal
[not found] ` <1331325556-16447-8-git-send-email-ssouhlal-HZy0K5TPuP5AfugRpC6u6w@public.gmane.org>
2012-03-11 10:25 ` Glauber Costa
2012-03-11 10:25 ` Glauber Costa
2012-03-11 10:25 ` Glauber Costa
2012-03-13 22:50 ` Suleiman Souhlal
2012-03-13 22:50 ` Suleiman Souhlal
2012-03-14 10:47 ` Glauber Costa
2012-03-14 10:47 ` Glauber Costa
[not found] ` <4F60775F.20709-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2012-03-14 22:04 ` Suleiman Souhlal
2012-03-14 22:04 ` Suleiman Souhlal
2012-03-14 22:04 ` Suleiman Souhlal
[not found] ` <CABCjUKCWaXTzsVaFHG57ELWV4Yk15vt=Ei8tvbsxpQKnxTmksg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2012-03-15 11:40 ` Glauber Costa
2012-03-15 11:40 ` Glauber Costa
2012-03-15 11:40 ` Glauber Costa
2012-03-09 20:39 ` [PATCH v2 08/13] memcg: Make dentry slab memory accounted in kernel memory accounting Suleiman Souhlal
2012-03-09 20:39 ` Suleiman Souhlal
2012-03-09 20:39 ` [PATCH v2 09/13] memcg: Account for kmalloc " Suleiman Souhlal
2012-03-09 20:39 ` Suleiman Souhlal
2012-03-11 12:21 ` Glauber Costa
2012-03-11 12:21 ` Glauber Costa
2012-03-09 20:39 ` [PATCH v2 10/13] memcg: Track all the memcg children of a kmem_cache Suleiman Souhlal
2012-03-09 20:39 ` Suleiman Souhlal
2012-03-09 20:39 ` [PATCH v2 11/13] memcg: Handle bypassed kernel memory charges Suleiman Souhlal
2012-03-09 20:39 ` Suleiman Souhlal
2012-03-09 20:39 ` [PATCH v2 12/13] memcg: Per-memcg memory.kmem.slabinfo file Suleiman Souhlal
2012-03-09 20:39 ` Suleiman Souhlal
2012-03-11 10:35 ` Glauber Costa
2012-03-11 10:35 ` Glauber Costa
2012-03-09 20:39 ` [PATCH v2 13/13] memcg: Document kernel memory accounting Suleiman Souhlal
2012-03-09 20:39 ` Suleiman Souhlal
[not found] ` <1331325556-16447-14-git-send-email-ssouhlal-HZy0K5TPuP5AfugRpC6u6w@public.gmane.org>
2012-03-11 10:42 ` Glauber Costa
2012-03-11 10:42 ` Glauber Costa
2012-03-11 10:42 ` Glauber Costa
[not found] ` <1331325556-16447-1-git-send-email-ssouhlal-HZy0K5TPuP5AfugRpC6u6w@public.gmane.org>
2012-03-10 6:25 ` [PATCH v2 00/13] Memcg Kernel Memory Tracking Suleiman Souhlal
2012-03-10 6:25 ` Suleiman Souhlal
2012-03-10 6:25 ` Suleiman Souhlal
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=4F5DEE42.6050607@parallels.com \
--to=glommer-bzqdu9zft3wakbo8gow8eq@public.gmane.org \
--cc=James.Bottomley-d9PhHud1JfjCXq6kfMZ53/egYHeGw8Jk@public.gmane.org \
--cc=cgroups-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
--cc=cl-vYTEC60ixJUAvxtiuMwx3w@public.gmane.org \
--cc=dan.magenheimer-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org \
--cc=devel-GEFAQzZX7r8dnm+yROfE0A@public.gmane.org \
--cc=gthelen-hpIqsD4AKlfQT0dZR+AlfA@public.gmane.org \
--cc=hannes-druUgvl0LCNAfugRpC6u6w@public.gmane.org \
--cc=hughd-hpIqsD4AKlfQT0dZR+AlfA@public.gmane.org \
--cc=kamezawa.hiroyu-+CUm20s59erQFUHtdCDX3A@public.gmane.org \
--cc=linux-kernel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
--cc=linux-mm-Bw31MaZKKs3YtjvyW6yDsg@public.gmane.org \
--cc=mgorman-l3A5Bk7waGM@public.gmane.org \
--cc=penberg-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org \
--cc=peterz-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org \
--cc=ssouhlal-HZy0K5TPuP5AfugRpC6u6w@public.gmane.org \
--cc=suleiman-hpIqsD4AKlfQT0dZR+AlfA@public.gmane.org \
--cc=yinghan-hpIqsD4AKlfQT0dZR+AlfA@public.gmane.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.