cgroups.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Glauber Costa <glommer-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
To: Christoph Lameter <cl-vYTEC60ixJUAvxtiuMwx3w@public.gmane.org>
Cc: linux-kernel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org,
	cgroups-u79uwXL29TY76Z2rM5mHXA@public.gmane.org,
	linux-mm-Bw31MaZKKs3YtjvyW6yDsg@public.gmane.org,
	kamezawa.hiroyu-+CUm20s59erQFUHtdCDX3A@public.gmane.org,
	Tejun Heo <tj-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org>,
	Li Zefan <lizefan-hv44wF8Li93QT0dZR+AlfA@public.gmane.org>,
	Greg Thelen <gthelen-hpIqsD4AKlfQT0dZR+AlfA@public.gmane.org>,
	Suleiman Souhlal
	<suleiman-hpIqsD4AKlfQT0dZR+AlfA@public.gmane.org>,
	Michal Hocko <mhocko-AlSwsSmVLrQ@public.gmane.org>,
	Johannes Weiner <hannes-druUgvl0LCNAfugRpC6u6w@public.gmane.org>,
	devel-GEFAQzZX7r8dnm+yROfE0A@public.gmane.org,
	Pekka Enberg <penberg-bbCR+/B0CizivPeTLB3BmA@public.gmane.org>
Subject: Re: [PATCH v2 04/29] slub: always get the cache from its page in kfree
Date: Fri, 11 May 2012 16:24:11 -0300	[thread overview]
Message-ID: <4FAD675B.6020709@parallels.com> (raw)
In-Reply-To: <alpine.DEB.2.00.1205111418350.386-sBS69tsa9Uj/9pzu0YdTqQ@public.gmane.org>

On 05/11/2012 04:20 PM, Christoph Lameter wrote:
> On Fri, 11 May 2012, Glauber Costa wrote:
>
>>> I see that. But there are other subsystems from slab allocators that do
>>> the same. There are also objects that may be used by multiple processes.
>>
>> This is also true for normal user pages. And then, we do what memcg does:
>> first one to touch, gets accounted. I don't think deviating from the memcg
>> behavior for user pages makes much sense here.
>>
>> A cache won't go away while it still have objects, even after the memcg is
>> removed (it is marked as dead)
>
> Ok so we will have some dead pages around that are then repatriated to
> the / set?

No, they are not repatriated. I actually wrote code for that once in my 
first series, but it was the general feeling at the time that it was too 
complicated. (and I only tried for the slub, not slab)

So instead, we just keep the cache around, until the objects go away.
It will show in slabinfo as dentry(css_id:memcgname)dead

For the record, I wrote that code because I found a nice feature, but I 
totally agree with the complicated part.

Also, in normal scenarios, dead caches are not expected to be common. 
Most of them should go away as memcg dies.

>>> Hmmm.. Would be better to have a hierachy there. /proc/slabinfo is more
>>> legacy.
>>
>> I can take a look at that then. Assuming you agree with all the rest, is
>> looking into that a pre-requisite for merging, or is something that can be
>> deferred for a phase2 ? (We still don't do shrinkers, for instance, so this is
>> sure to have a phase2)
>
> Not a prerequisite for merging but note that I intend to rework the
> allocators to extract common code so that they have the same sysfs
> interface, error reporting and failure scenarios. We can at that time
> also add support for /sys/kernel/slab to memcg. (/sys/memcg/<name>/slab/* ?)

Yes, that would be a good plan.


  parent reply	other threads:[~2012-05-11 19:24 UTC|newest]

Thread overview: 63+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2012-05-11 17:44 [PATCH v2 00/29] kmem limitation for memcg Glauber Costa
2012-05-11 17:44 ` [PATCH v2 11/29] cgroups: ability to stop res charge propagation on bounded ancestor Glauber Costa
2012-05-15  2:59   ` KAMEZAWA Hiroyuki
     [not found]     ` <4FB1C6A1.1020602-+CUm20s59erQFUHtdCDX3A@public.gmane.org>
2012-05-16  6:16       ` Glauber Costa
     [not found] ` <1336758272-24284-1-git-send-email-glommer-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2012-05-11 17:44   ` [PATCH v2 01/29] slab: dup name string Glauber Costa
2012-05-15 22:04     ` David Rientjes
     [not found]       ` <alpine.DEB.2.00.1205151502000.18595-X6Q0R45D7oAcqpCFd4KODRPsWskHk0ljAL8bYrjMMd8@public.gmane.org>
2012-05-16  6:12         ` Glauber Costa
2012-05-11 17:44   ` [PATCH v2 02/29] slub: fix slab_state for slub Glauber Costa
2012-05-11 17:51     ` Christoph Lameter
     [not found]     ` <1336758272-24284-3-git-send-email-glommer-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2012-05-15 21:55       ` David Rientjes
     [not found]         ` <alpine.DEB.2.00.1205151453460.18595-X6Q0R45D7oAcqpCFd4KODRPsWskHk0ljAL8bYrjMMd8@public.gmane.org>
2012-05-16  6:10           ` Glauber Costa
2012-05-17 10:14           ` Glauber Costa
2012-05-11 17:44   ` [PATCH v2 03/29] memcg: Always free struct memcg through schedule_work() Glauber Costa
2012-05-11 17:44   ` [PATCH v2 04/29] slub: always get the cache from its page in kfree Glauber Costa
2012-05-11 17:53     ` Christoph Lameter
     [not found]       ` <alpine.DEB.2.00.1205111251420.31049-sBS69tsa9Uj/9pzu0YdTqQ@public.gmane.org>
2012-05-11 17:57         ` Glauber Costa
2012-05-11 18:06           ` Christoph Lameter
     [not found]             ` <alpine.DEB.2.00.1205111305570.386-sBS69tsa9Uj/9pzu0YdTqQ@public.gmane.org>
2012-05-11 18:11               ` Glauber Costa
2012-05-11 18:17                 ` Christoph Lameter
     [not found]                   ` <alpine.DEB.2.00.1205111316540.386-sBS69tsa9Uj/9pzu0YdTqQ@public.gmane.org>
2012-05-11 18:20                     ` Glauber Costa
     [not found]                       ` <4FAD585A.4070007-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2012-05-11 18:32                         ` Christoph Lameter
     [not found]                           ` <alpine.DEB.2.00.1205111331010.386-sBS69tsa9Uj/9pzu0YdTqQ@public.gmane.org>
2012-05-11 18:42                             ` Glauber Costa
     [not found]                               ` <4FAD5DA2.70803-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2012-05-11 18:56                                 ` Christoph Lameter
     [not found]                                   ` <alpine.DEB.2.00.1205111354540.386-sBS69tsa9Uj/9pzu0YdTqQ@public.gmane.org>
2012-05-11 18:58                                     ` Glauber Costa
2012-05-11 19:09                                       ` Christoph Lameter
     [not found]                                         ` <alpine.DEB.2.00.1205111407280.386-sBS69tsa9Uj/9pzu0YdTqQ@public.gmane.org>
2012-05-11 19:11                                           ` Glauber Costa
2012-05-11 19:20                                             ` Christoph Lameter
     [not found]                                               ` <alpine.DEB.2.00.1205111418350.386-sBS69tsa9Uj/9pzu0YdTqQ@public.gmane.org>
2012-05-11 19:24                                                 ` Glauber Costa [this message]
2012-05-11 17:44   ` [PATCH v2 05/29] slab: rename gfpflags to allocflags Glauber Costa
2012-05-11 17:54     ` Christoph Lameter
2012-05-15 21:57     ` David Rientjes
2012-05-11 17:44   ` [PATCH v2 06/29] memcg: Make it possible to use the stock for more than one page Glauber Costa
2012-05-11 17:44   ` [PATCH v2 07/29] memcg: Reclaim when more than one page needed Glauber Costa
2012-05-11 17:44   ` [PATCH v2 08/29] slab: use obj_size field of struct kmem_cache when not debugging Glauber Costa
2012-05-11 17:44   ` [PATCH v2 09/29] memcg: change defines to an enum Glauber Costa
2012-05-11 17:44   ` [PATCH v2 10/29] res_counter: don't force return value checking in res_counter_charge_nofail Glauber Costa
2012-05-11 17:44   ` [PATCH v2 12/29] kmem slab accounting basic infrastructure Glauber Costa
2012-05-11 17:44   ` [PATCH v2 13/29] slab/slub: struct memcg_params Glauber Costa
2012-05-11 17:44   ` [PATCH v2 14/29] slub: consider a memcg parameter in kmem_create_cache Glauber Costa
2012-05-11 17:44   ` [PATCH v2 15/29] slab: pass memcg parameter to kmem_cache_create Glauber Costa
2012-05-11 17:44   ` [PATCH v2 16/29] slub: create duplicate cache Glauber Costa
2012-05-11 17:44   ` [PATCH v2 17/29] slab: " Glauber Costa
2012-05-11 17:44   ` [PATCH v2 18/29] memcg: kmem controller charge/uncharge infrastructure Glauber Costa
2012-05-15  2:57     ` KAMEZAWA Hiroyuki
2012-05-16  6:42       ` Glauber Costa
2012-05-16  8:18         ` KAMEZAWA Hiroyuki
     [not found]           ` <4FB362D4.8000800-+CUm20s59erQFUHtdCDX3A@public.gmane.org>
2012-05-16  8:25             ` Glauber Costa
     [not found]               ` <4FB36486.6060500-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2012-05-16  9:15                 ` KAMEZAWA Hiroyuki
2012-05-11 17:44   ` [PATCH v2 23/29] memcg: destroy memcg caches Glauber Costa
2012-05-11 17:44   ` [PATCH v2 24/29] memcg/slub: shrink dead caches Glauber Costa
2012-05-11 17:44   ` [PATCH v2 25/29] memcg: Track all the memcg children of a kmem_cache Glauber Costa
2012-05-11 17:44   ` [PATCH v2 26/29] memcg: Per-memcg memory.kmem.slabinfo file Glauber Costa
2012-05-11 17:44   ` [PATCH v2 28/29] slub: track all children of a kmem cache Glauber Costa
2012-05-11 17:44 ` [PATCH v2 19/29] skip memcg kmem allocations in specified code regions Glauber Costa
2012-05-15  2:46   ` KAMEZAWA Hiroyuki
     [not found]     ` <4FB1C398.1010000-+CUm20s59erQFUHtdCDX3A@public.gmane.org>
2012-05-16  6:19       ` Glauber Costa
     [not found]         ` <4FB346E3.5060507-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2012-05-16  7:55           ` KAMEZAWA Hiroyuki
2012-05-11 17:44 ` [PATCH v2 20/29] slub: charge allocation to a memcg Glauber Costa
2012-05-11 17:44 ` [PATCH v2 21/29] slab: per-memcg accounting of slab caches Glauber Costa
2012-05-11 17:44 ` [PATCH v2 22/29] memcg: disable kmem code when not in use Glauber Costa
2012-05-11 17:44 ` [PATCH v2 27/29] slub: create slabinfo file for memcg Glauber Costa
2012-05-11 17:44 ` [PATCH v2 29/29] Documentation: add documentation for slab tracker " Glauber Costa
2012-05-11 18:05 ` [PATCH v2 00/29] kmem limitation " Glauber Costa

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=4FAD675B.6020709@parallels.com \
    --to=glommer-bzqdu9zft3wakbo8gow8eq@public.gmane.org \
    --cc=cgroups-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
    --cc=cl-vYTEC60ixJUAvxtiuMwx3w@public.gmane.org \
    --cc=devel-GEFAQzZX7r8dnm+yROfE0A@public.gmane.org \
    --cc=gthelen-hpIqsD4AKlfQT0dZR+AlfA@public.gmane.org \
    --cc=hannes-druUgvl0LCNAfugRpC6u6w@public.gmane.org \
    --cc=kamezawa.hiroyu-+CUm20s59erQFUHtdCDX3A@public.gmane.org \
    --cc=linux-kernel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
    --cc=linux-mm-Bw31MaZKKs3YtjvyW6yDsg@public.gmane.org \
    --cc=lizefan-hv44wF8Li93QT0dZR+AlfA@public.gmane.org \
    --cc=mhocko-AlSwsSmVLrQ@public.gmane.org \
    --cc=penberg-bbCR+/B0CizivPeTLB3BmA@public.gmane.org \
    --cc=suleiman-hpIqsD4AKlfQT0dZR+AlfA@public.gmane.org \
    --cc=tj-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).