linux-mm.kvack.org archive mirror
 help / color / mirror / Atom feed
From: Shakeel Butt <shakeelb@google.com>
To: Jan Kara <jack@suse.cz>
Cc: Yang Shi <yang.s@alibaba-inc.com>,
	Michal Hocko <mhocko@kernel.org>,
	amir73il@gmail.com, linux-fsdevel@vger.kernel.org,
	Linux MM <linux-mm@kvack.org>,
	LKML <linux-kernel@vger.kernel.org>
Subject: Re: [PATCH v2] fs: fsnotify: account fsnotify metadata to kmemcg
Date: Fri, 19 Jan 2018 07:02:20 -0800	[thread overview]
Message-ID: <CALvZod6HJO73GUfLemuAXJfr4vZ8xMOmVQpFO3vJRog-s2T-OQ@mail.gmail.com> (raw)
In-Reply-To: <20171115093131.GA17359@quack2.suse.cz>

On Wed, Nov 15, 2017 at 1:31 AM, Jan Kara <jack@suse.cz> wrote:
> On Wed 15-11-17 01:32:16, Yang Shi wrote:
>>
>>
>> On 11/14/17 1:39 AM, Michal Hocko wrote:
>> >On Tue 14-11-17 03:10:22, Yang Shi wrote:
>> >>
>> >>
>> >>On 11/9/17 5:54 AM, Michal Hocko wrote:
>> >>>[Sorry for the late reply]
>> >>>
>> >>>On Tue 31-10-17 11:12:38, Jan Kara wrote:
>> >>>>On Tue 31-10-17 00:39:58, Yang Shi wrote:
>> >>>[...]
>> >>>>>I do agree it is not fair and not neat to account to producer rather than
>> >>>>>misbehaving consumer, but current memcg design looks not support such use
>> >>>>>case. And, the other question is do we know who is the listener if it
>> >>>>>doesn't read the events?
>> >>>>
>> >>>>So you never know who will read from the notification file descriptor but
>> >>>>you can simply account that to the process that created the notification
>> >>>>group and that is IMO the right process to account to.
>> >>>
>> >>>Yes, if the creator is de-facto owner which defines the lifetime of
>> >>>those objects then this should be a target of the charge.
>> >>>
>> >>>>I agree that current SLAB memcg accounting does not allow to account to a
>> >>>>different memcg than the one of the running process. However I *think* it
>> >>>>should be possible to add such interface. Michal?
>> >>>
>> >>>We do have memcg_kmem_charge_memcg but that would require some plumbing
>> >>>to hook it into the specific allocation path. I suspect it uses kmalloc,
>> >>>right?
>> >>
>> >>Yes.
>> >>
>> >>I took a look at the implementation and the callsites of
>> >>memcg_kmem_charge_memcg(). It looks it is called by:
>> >>
>> >>* charge kmem to memcg, but it is charged to the allocator's memcg
>> >>* allocate new slab page, charge to memcg_params.memcg
>> >>
>> >>I think this is the plumbing you mentioned, right?
>> >
>> >Maybe I have misunderstood, but you are using slab allocator. So you
>> >would need to force it to use a different charging context than current.
>>
>> Yes.
>>
>> >I haven't checked deeply but this doesn't look trivial to me.
>>
>> I agree. This is also what I explained to Jan and Amir in earlier
>> discussion.
>
> And I also agree. But the fact that it is not trivial does not mean that it
> should not be done...
>

I am currently working on directed or remote memcg charging for a
different usecase and I think that would be helpful here as well.

I have two questions though:

1) Is fsnotify_group the right structure to hold the reference to
target mem_cgroup for charging?
2) Remote charging can trigger an OOM in the target memcg. In this
usecase, I think, there should be security concerns if the events
producer can trigger OOM in the memcg of the monitor. We can either
change these allocations to use __GFP_NORETRY or some new gfp flag to
not trigger oom-killer. So, is this valid concern or am I
over-thinking?

thanks,
Shakeel

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

  reply	other threads:[~2018-01-19 15:02 UTC|newest]

Thread overview: 35+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2017-10-27 18:22 [PATCH v2] fs: fsnotify: account fsnotify metadata to kmemcg Yang Shi
2017-10-28 14:19 ` Amir Goldstein
2017-10-29  2:39   ` Matthew Wilcox
2017-10-30 12:43 ` Jan Kara
2017-10-30 16:39   ` Yang Shi
2017-10-31 10:12     ` Jan Kara
2017-10-31 16:44       ` Yang Shi
2017-11-01 15:15         ` Jan Kara
2017-11-09 13:54       ` Michal Hocko
2017-11-13 19:10         ` Yang Shi
2017-11-14  9:39           ` Michal Hocko
2017-11-14 17:32             ` Yang Shi
2017-11-15  9:31               ` Jan Kara
2018-01-19 15:02                 ` Shakeel Butt [this message]
2018-01-22 20:31                   ` Amir Goldstein
2018-01-24 10:34                     ` Jan Kara
2018-01-24 11:12                       ` Amir Goldstein
2018-01-25  1:08                         ` Shakeel Butt
2018-01-25  1:54                           ` Al Viro
2018-01-25  2:15                             ` Shakeel Butt
2018-01-25  7:51                           ` Amir Goldstein
2018-01-25 20:20                             ` Shakeel Butt
2018-01-25 20:36                               ` Amir Goldstein
2018-02-13  6:30                                 ` Amir Goldstein
2018-02-13 21:10                                   ` Shakeel Butt
2018-02-13 21:54                                     ` Amir Goldstein
2018-02-13 22:20                                       ` Shakeel Butt
2018-02-14  1:59                                         ` Shakeel Butt
2018-02-14  8:38                                           ` Amir Goldstein
2018-02-19 13:50                                             ` Jan Kara
2018-02-19 19:07                                               ` Amir Goldstein
2018-02-20 12:43                                                 ` Jan Kara
2018-02-20 19:20                                                   ` Shakeel Butt
2018-02-20 20:30                                                   ` Amir Goldstein
2018-02-14  9:00                                         ` Amir Goldstein

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=CALvZod6HJO73GUfLemuAXJfr4vZ8xMOmVQpFO3vJRog-s2T-OQ@mail.gmail.com \
    --to=shakeelb@google.com \
    --cc=amir73il@gmail.com \
    --cc=jack@suse.cz \
    --cc=linux-fsdevel@vger.kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=mhocko@kernel.org \
    --cc=yang.s@alibaba-inc.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).