All of lore.kernel.org
 help / color / mirror / Atom feed
From: ebiederm-aS9lmoZGLiVWk0Htik3J/w@public.gmane.org (Eric W. Biederman)
To: Jeff Layton <jlayton-vpEMnDpepFuMZCB2o+C8xQ@public.gmane.org>
Cc: bfields-uC3wQj2KruNg9hUCZPvPmw@public.gmane.org,
	containers-cunTk1MwBs9QetFLy7KEm3xJsTq8ys+cHZ5vskTnxNA@public.gmane.org,
	Nikolay Borisov <kernel-6AxghH7DbtA@public.gmane.org>,
	avagin-GEFAQzZX7r8dnm+yROfE0A@public.gmane.org,
	xemul-5HdwGun5lf+gSpxsJD1C4w@public.gmane.org
Subject: Re: [PATCHv3] locks: Filter /proc/locks output on proc pid ns
Date: Wed, 03 Aug 2016 16:09:42 -0500	[thread overview]
Message-ID: <87twf1ftk9.fsf@x220.int.ebiederm.org> (raw)
In-Reply-To: <1470243015.13804.7.camel-vpEMnDpepFuMZCB2o+C8xQ@public.gmane.org> (Jeff Layton's message of "Wed, 03 Aug 2016 12:50:15 -0400")

Jeff Layton <jlayton-vpEMnDpepFuMZCB2o+C8xQ@public.gmane.org> writes:

> On Wed, 2016-08-03 at 11:23 -0500, Eric W. Biederman wrote:
>> Nikolay Borisov <kernel-6AxghH7DbtA@public.gmane.org> writes:
>> 
>> > 
>> > On busy container servers reading /proc/locks shows all the locks
>> > created by all clients. This can cause large latency spikes. In my
>> > case I observed lsof taking up to 5-10 seconds while processing
>> > around
>> > 50k locks. Fix this by limiting the locks shown only to those
>> > created
>> > in the same pidns as the one the proc fs was mounted in. When
>> > reading
>> > /proc/locks from the init_pid_ns proc instance then perform no
>> > filtering
>> 
>> If we are going to do this, this should be a recrusive belonging test
>> (because pid namespaces are recursive).
>> 
>> Right now the test looks like it will filter out child pid
>> namespaces.
>> 
>> Special casing the init_pid_ns should be an optimization not
>> something
>> that is necessary for correctness. (as it appears here).
>> 
>> Eric
>> 
>> 
>
> Ok, thanks. I'm still not that namespace savvy -- so there's a
> hierarchy of pid_namespaces?

There is.

> If so, then yeah does sound better. Is there an interface that allows
> you to tell whether a pid is a descendant of a particular
> pid_namespace?

Yes.  And each pid has an array of the pid namespaces it is in so it is
a O(1) operation to see if that struct pid is in a pid namespace.

Dumb question does anyone know the difference between fl_nspid and
fl_pid off the top of your heads?  I am looking at the code and I am
confused why we have to both.  I am afraid that there was some
sloppiness when the pid namespace was implemented and this was the
result.  I remember that file locks were a rough spot during the
conversion but I don't recall the details off the top of my head.

Eric

  parent reply	other threads:[~2016-08-03 21:09 UTC|newest]

Thread overview: 62+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2016-08-02 14:42 [RFC PATCH] locks: Show only file_locks created in the same pidns as current process Nikolay Borisov
2016-08-02 14:42 ` Nikolay Borisov
2016-08-02 15:05 ` J. Bruce Fields
     [not found]   ` <20160802150521.GB11767-uC3wQj2KruNg9hUCZPvPmw@public.gmane.org>
2016-08-02 15:20     ` Nikolay Borisov
2016-08-02 15:20       ` Nikolay Borisov
     [not found]       ` <57A0BA40.5010406-6AxghH7DbtA@public.gmane.org>
2016-08-02 15:43         ` J. Bruce Fields
2016-08-02 15:43           ` J. Bruce Fields
     [not found] ` <1470148943-21835-1-git-send-email-kernel-6AxghH7DbtA@public.gmane.org>
2016-08-02 14:45   ` Nikolay Borisov
2016-08-02 14:45     ` Nikolay Borisov
2016-08-02 15:05   ` J. Bruce Fields
2016-08-02 16:00   ` Eric W. Biederman
2016-08-02 16:00     ` Eric W. Biederman
     [not found]     ` <87r3a7qhy0.fsf-JOvCrm2gF+uungPnsOpG7nhyD016LWXt@public.gmane.org>
2016-08-02 17:40       ` J. Bruce Fields
2016-08-02 17:40         ` J. Bruce Fields
     [not found]         ` <20160802174003.GD11767-uC3wQj2KruNg9hUCZPvPmw@public.gmane.org>
2016-08-02 19:09           ` Eric W. Biederman
2016-08-02 19:09             ` Eric W. Biederman
     [not found]             ` <87invjq97h.fsf-JOvCrm2gF+uungPnsOpG7nhyD016LWXt@public.gmane.org>
2016-08-02 19:44               ` J. Bruce Fields
2016-08-02 19:44                 ` J. Bruce Fields
     [not found]                 ` <20160802194437.GD15324-uC3wQj2KruNg9hUCZPvPmw@public.gmane.org>
2016-08-02 20:01                   ` Jeff Layton
2016-08-02 20:01                     ` Jeff Layton
     [not found]                     ` <1470168082.15226.14.camel-vpEMnDpepFuMZCB2o+C8xQ@public.gmane.org>
2016-08-02 20:11                       ` Nikolay Borisov
2016-08-02 20:11                         ` Nikolay Borisov
2016-08-02 20:34                       ` J. Bruce Fields
2016-08-02 20:34                         ` J. Bruce Fields
2016-08-03  7:35   ` [PATCH v2] locks: Filter /proc/locks output on proc pid ns Nikolay Borisov
2016-08-03  7:35     ` Nikolay Borisov
     [not found]     ` <1470209710-30022-1-git-send-email-kernel-6AxghH7DbtA@public.gmane.org>
2016-08-03 13:46       ` Jeff Layton
2016-08-03 13:46         ` Jeff Layton
     [not found]         ` <1470232012.18285.4.camel-vpEMnDpepFuMZCB2o+C8xQ@public.gmane.org>
2016-08-03 14:17           ` Nikolay Borisov
2016-08-03 14:17             ` Nikolay Borisov
2016-08-03 14:28             ` J. Bruce Fields
     [not found]               ` <20160803142850.GA27072-uC3wQj2KruNg9hUCZPvPmw@public.gmane.org>
2016-08-03 14:33                 ` Nikolay Borisov
2016-08-03 14:33                   ` Nikolay Borisov
     [not found]             ` <57A1FCE5.3040206-6AxghH7DbtA@public.gmane.org>
2016-08-03 14:28               ` J. Bruce Fields
2016-08-03 14:54               ` Pavel Emelyanov
2016-08-03 14:54                 ` Pavel Emelyanov
2016-08-03 15:00                 ` Nikolay Borisov
     [not found]                   ` <57A20702.3040805-6AxghH7DbtA@public.gmane.org>
2016-08-03 15:06                     ` J. Bruce Fields
2016-08-03 15:06                       ` J. Bruce Fields
     [not found]                       ` <20160803150631.GA3789-uC3wQj2KruNg9hUCZPvPmw@public.gmane.org>
2016-08-03 15:10                         ` Nikolay Borisov
2016-08-03 15:10                           ` Nikolay Borisov
     [not found]                           ` <57A2097C.7060206-6AxghH7DbtA@public.gmane.org>
2016-08-03 17:35                             ` Eric W. Biederman
2016-08-03 17:35                               ` Eric W. Biederman
     [not found]                 ` <57A205BE.3070202-5HdwGun5lf+gSpxsJD1C4w@public.gmane.org>
2016-08-03 15:00                   ` Nikolay Borisov
2016-08-03 14:54   ` [PATCHv3] " Nikolay Borisov
     [not found]     ` <1470236078-2389-1-git-send-email-kernel-6AxghH7DbtA@public.gmane.org>
2016-08-03 15:24       ` Jeff Layton
2016-08-03 16:23       ` Eric W. Biederman
     [not found]         ` <87k2fxom8a.fsf-JOvCrm2gF+uungPnsOpG7nhyD016LWXt@public.gmane.org>
2016-08-03 16:50           ` Jeff Layton
     [not found]             ` <1470243015.13804.7.camel-vpEMnDpepFuMZCB2o+C8xQ@public.gmane.org>
2016-08-03 21:09               ` Eric W. Biederman [this message]
     [not found]                 ` <87twf1ftk9.fsf-JOvCrm2gF+uungPnsOpG7nhyD016LWXt@public.gmane.org>
2016-08-03 21:26                   ` Nikolay Borisov
     [not found]                     ` <a0a58f75-0e40-c14f-d8e3-8f094e9fc62c-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
2016-08-04  4:18                       ` Eric W. Biederman
     [not found]                         ` <87eg659ngh.fsf-JOvCrm2gF+uungPnsOpG7nhyD016LWXt@public.gmane.org>
2016-08-04  5:07                           ` Eric W. Biederman
2016-08-03 17:40       ` Eric W. Biederman
2016-08-04  7:26   ` [PATCHv4] " Nikolay Borisov
     [not found]     ` <1470295588-9803-1-git-send-email-kernel-6AxghH7DbtA@public.gmane.org>
2016-08-04 11:29       ` Jeff Layton
     [not found]         ` <1470310175.22052.3.camel-vpEMnDpepFuMZCB2o+C8xQ@public.gmane.org>
2016-08-04 14:09           ` Eric W. Biederman
     [not found]             ` <874m707hhm.fsf-JOvCrm2gF+uungPnsOpG7nhyD016LWXt@public.gmane.org>
2016-08-04 14:34               ` Nikolay Borisov
2016-08-04 15:09               ` Nikolay Borisov
     [not found]                 ` <57A35AC7.7040105-6AxghH7DbtA@public.gmane.org>
2016-08-04 15:21                   ` Eric W. Biederman
2016-08-05  7:30   ` [PATCHv5] " Nikolay Borisov
     [not found]     ` <1470382204-21480-1-git-send-email-kernel-6AxghH7DbtA@public.gmane.org>
2016-08-05 10:47       ` Jeff Layton
     [not found]         ` <1470394036.8100.2.camel-vpEMnDpepFuMZCB2o+C8xQ@public.gmane.org>
2016-08-05 14:58           ` J. Bruce Fields

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=87twf1ftk9.fsf@x220.int.ebiederm.org \
    --to=ebiederm-as9lmozglivwk0htik3j/w@public.gmane.org \
    --cc=avagin-GEFAQzZX7r8dnm+yROfE0A@public.gmane.org \
    --cc=bfields-uC3wQj2KruNg9hUCZPvPmw@public.gmane.org \
    --cc=containers-cunTk1MwBs9QetFLy7KEm3xJsTq8ys+cHZ5vskTnxNA@public.gmane.org \
    --cc=jlayton-vpEMnDpepFuMZCB2o+C8xQ@public.gmane.org \
    --cc=kernel-6AxghH7DbtA@public.gmane.org \
    --cc=xemul-5HdwGun5lf+gSpxsJD1C4w@public.gmane.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.