Linux Container Development
 help / color / mirror / Atom feed
From: ebiederm-aS9lmoZGLiVWk0Htik3J/w@public.gmane.org (Eric W. Biederman)
To: Jeff Layton <jlayton-vpEMnDpepFuMZCB2o+C8xQ@public.gmane.org>
Cc: bfields-uC3wQj2KruNg9hUCZPvPmw@public.gmane.org,
	containers-cunTk1MwBs9QetFLy7KEm3xJsTq8ys+cHZ5vskTnxNA@public.gmane.org,
	Nikolay Borisov <kernel-6AxghH7DbtA@public.gmane.org>,
	avagin-GEFAQzZX7r8dnm+yROfE0A@public.gmane.org,
	xemul-5HdwGun5lf+gSpxsJD1C4w@public.gmane.org
Subject: Re: [PATCHv3] locks: Filter /proc/locks output on proc pid ns
Date: Wed, 03 Aug 2016 16:09:42 -0500	[thread overview]
Message-ID: <87twf1ftk9.fsf@x220.int.ebiederm.org> (raw)
In-Reply-To: <1470243015.13804.7.camel-vpEMnDpepFuMZCB2o+C8xQ@public.gmane.org> (Jeff Layton's message of "Wed, 03 Aug 2016 12:50:15 -0400")

Jeff Layton <jlayton-vpEMnDpepFuMZCB2o+C8xQ@public.gmane.org> writes:

> On Wed, 2016-08-03 at 11:23 -0500, Eric W. Biederman wrote:
>> Nikolay Borisov <kernel-6AxghH7DbtA@public.gmane.org> writes:
>> 
>> > 
>> > On busy container servers reading /proc/locks shows all the locks
>> > created by all clients. This can cause large latency spikes. In my
>> > case I observed lsof taking up to 5-10 seconds while processing
>> > around
>> > 50k locks. Fix this by limiting the locks shown only to those
>> > created
>> > in the same pidns as the one the proc fs was mounted in. When
>> > reading
>> > /proc/locks from the init_pid_ns proc instance then perform no
>> > filtering
>> 
>> If we are going to do this, this should be a recrusive belonging test
>> (because pid namespaces are recursive).
>> 
>> Right now the test looks like it will filter out child pid
>> namespaces.
>> 
>> Special casing the init_pid_ns should be an optimization not
>> something
>> that is necessary for correctness. (as it appears here).
>> 
>> Eric
>> 
>> 
>
> Ok, thanks. I'm still not that namespace savvy -- so there's a
> hierarchy of pid_namespaces?

There is.

> If so, then yeah does sound better. Is there an interface that allows
> you to tell whether a pid is a descendant of a particular
> pid_namespace?

Yes.  And each pid has an array of the pid namespaces it is in so it is
a O(1) operation to see if that struct pid is in a pid namespace.

Dumb question does anyone know the difference between fl_nspid and
fl_pid off the top of your heads?  I am looking at the code and I am
confused why we have to both.  I am afraid that there was some
sloppiness when the pid namespace was implemented and this was the
result.  I remember that file locks were a rough spot during the
conversion but I don't recall the details off the top of my head.

Eric

  parent reply	other threads:[~2016-08-03 21:09 UTC|newest]

Thread overview: 40+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2016-08-02 14:42 [RFC PATCH] locks: Show only file_locks created in the same pidns as current process Nikolay Borisov
     [not found] ` <20160802150521.GB11767@fieldses.org>
     [not found]   ` <20160802150521.GB11767-uC3wQj2KruNg9hUCZPvPmw@public.gmane.org>
2016-08-02 15:20     ` Nikolay Borisov
     [not found]       ` <57A0BA40.5010406-6AxghH7DbtA@public.gmane.org>
2016-08-02 15:43         ` J. Bruce Fields
     [not found] ` <1470148943-21835-1-git-send-email-kernel-6AxghH7DbtA@public.gmane.org>
2016-08-02 14:45   ` Nikolay Borisov
2016-08-02 15:05   ` J. Bruce Fields
2016-08-02 16:00   ` Eric W. Biederman
     [not found]     ` <87r3a7qhy0.fsf-JOvCrm2gF+uungPnsOpG7nhyD016LWXt@public.gmane.org>
2016-08-02 17:40       ` J. Bruce Fields
     [not found]         ` <20160802174003.GD11767-uC3wQj2KruNg9hUCZPvPmw@public.gmane.org>
2016-08-02 19:09           ` Eric W. Biederman
     [not found]             ` <87invjq97h.fsf-JOvCrm2gF+uungPnsOpG7nhyD016LWXt@public.gmane.org>
2016-08-02 19:44               ` J. Bruce Fields
     [not found]                 ` <20160802194437.GD15324-uC3wQj2KruNg9hUCZPvPmw@public.gmane.org>
2016-08-02 20:01                   ` Jeff Layton
     [not found]                     ` <1470168082.15226.14.camel-vpEMnDpepFuMZCB2o+C8xQ@public.gmane.org>
2016-08-02 20:11                       ` Nikolay Borisov
2016-08-02 20:34                       ` J. Bruce Fields
2016-08-03  7:35   ` [PATCH v2] locks: Filter /proc/locks output on proc pid ns Nikolay Borisov
     [not found]     ` <1470209710-30022-1-git-send-email-kernel-6AxghH7DbtA@public.gmane.org>
2016-08-03 13:46       ` Jeff Layton
     [not found]         ` <1470232012.18285.4.camel-vpEMnDpepFuMZCB2o+C8xQ@public.gmane.org>
2016-08-03 14:17           ` Nikolay Borisov
     [not found]             ` <57A1FCE5.3040206-6AxghH7DbtA@public.gmane.org>
2016-08-03 14:28               ` J. Bruce Fields
2016-08-03 14:54               ` Pavel Emelyanov
     [not found]                 ` <57A205BE.3070202-5HdwGun5lf+gSpxsJD1C4w@public.gmane.org>
2016-08-03 15:00                   ` Nikolay Borisov
     [not found]                 ` <57A20702.3040805@kyup.com>
     [not found]                   ` <57A20702.3040805-6AxghH7DbtA@public.gmane.org>
2016-08-03 15:06                     ` J. Bruce Fields
     [not found]                       ` <20160803150631.GA3789-uC3wQj2KruNg9hUCZPvPmw@public.gmane.org>
2016-08-03 15:10                         ` Nikolay Borisov
     [not found]                           ` <57A2097C.7060206-6AxghH7DbtA@public.gmane.org>
2016-08-03 17:35                             ` Eric W. Biederman
     [not found]             ` <20160803142850.GA27072@fieldses.org>
     [not found]               ` <20160803142850.GA27072-uC3wQj2KruNg9hUCZPvPmw@public.gmane.org>
2016-08-03 14:33                 ` Nikolay Borisov
2016-08-03 14:54   ` [PATCHv3] " Nikolay Borisov
     [not found]     ` <1470236078-2389-1-git-send-email-kernel-6AxghH7DbtA@public.gmane.org>
2016-08-03 15:24       ` Jeff Layton
2016-08-03 16:23       ` Eric W. Biederman
     [not found]         ` <87k2fxom8a.fsf-JOvCrm2gF+uungPnsOpG7nhyD016LWXt@public.gmane.org>
2016-08-03 16:50           ` Jeff Layton
     [not found]             ` <1470243015.13804.7.camel-vpEMnDpepFuMZCB2o+C8xQ@public.gmane.org>
2016-08-03 21:09               ` Eric W. Biederman [this message]
     [not found]                 ` <87twf1ftk9.fsf-JOvCrm2gF+uungPnsOpG7nhyD016LWXt@public.gmane.org>
2016-08-03 21:26                   ` Nikolay Borisov
     [not found]                     ` <a0a58f75-0e40-c14f-d8e3-8f094e9fc62c-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
2016-08-04  4:18                       ` Eric W. Biederman
     [not found]                         ` <87eg659ngh.fsf-JOvCrm2gF+uungPnsOpG7nhyD016LWXt@public.gmane.org>
2016-08-04  5:07                           ` Eric W. Biederman
2016-08-03 17:40       ` Eric W. Biederman
2016-08-04  7:26   ` [PATCHv4] " Nikolay Borisov
     [not found]     ` <1470295588-9803-1-git-send-email-kernel-6AxghH7DbtA@public.gmane.org>
2016-08-04 11:29       ` Jeff Layton
     [not found]         ` <1470310175.22052.3.camel-vpEMnDpepFuMZCB2o+C8xQ@public.gmane.org>
2016-08-04 14:09           ` Eric W. Biederman
     [not found]             ` <874m707hhm.fsf-JOvCrm2gF+uungPnsOpG7nhyD016LWXt@public.gmane.org>
2016-08-04 14:34               ` Nikolay Borisov
2016-08-04 15:09               ` Nikolay Borisov
     [not found]                 ` <57A35AC7.7040105-6AxghH7DbtA@public.gmane.org>
2016-08-04 15:21                   ` Eric W. Biederman
2016-08-05  7:30   ` [PATCHv5] " Nikolay Borisov
     [not found]     ` <1470382204-21480-1-git-send-email-kernel-6AxghH7DbtA@public.gmane.org>
2016-08-05 10:47       ` Jeff Layton
     [not found]         ` <1470394036.8100.2.camel-vpEMnDpepFuMZCB2o+C8xQ@public.gmane.org>
2016-08-05 14:58           ` J. Bruce Fields

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=87twf1ftk9.fsf@x220.int.ebiederm.org \
    --to=ebiederm-as9lmozglivwk0htik3j/w@public.gmane.org \
    --cc=avagin-GEFAQzZX7r8dnm+yROfE0A@public.gmane.org \
    --cc=bfields-uC3wQj2KruNg9hUCZPvPmw@public.gmane.org \
    --cc=containers-cunTk1MwBs9QetFLy7KEm3xJsTq8ys+cHZ5vskTnxNA@public.gmane.org \
    --cc=jlayton-vpEMnDpepFuMZCB2o+C8xQ@public.gmane.org \
    --cc=kernel-6AxghH7DbtA@public.gmane.org \
    --cc=xemul-5HdwGun5lf+gSpxsJD1C4w@public.gmane.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox