From: ebiederm-aS9lmoZGLiVWk0Htik3J/w@public.gmane.org (Eric W. Biederman)
To: Jeff Layton <jlayton-vpEMnDpepFuMZCB2o+C8xQ@public.gmane.org>
Cc: bfields-uC3wQj2KruNg9hUCZPvPmw@public.gmane.org,
containers-cunTk1MwBs9QetFLy7KEm3xJsTq8ys+cHZ5vskTnxNA@public.gmane.org,
Nikolay Borisov <kernel-6AxghH7DbtA@public.gmane.org>,
avagin-GEFAQzZX7r8dnm+yROfE0A@public.gmane.org,
xemul-5HdwGun5lf+gSpxsJD1C4w@public.gmane.org
Subject: Re: [PATCHv3] locks: Filter /proc/locks output on proc pid ns
Date: Wed, 03 Aug 2016 16:09:42 -0500 [thread overview]
Message-ID: <87twf1ftk9.fsf@x220.int.ebiederm.org> (raw)
In-Reply-To: <1470243015.13804.7.camel-vpEMnDpepFuMZCB2o+C8xQ@public.gmane.org> (Jeff Layton's message of "Wed, 03 Aug 2016 12:50:15 -0400")
Jeff Layton <jlayton-vpEMnDpepFuMZCB2o+C8xQ@public.gmane.org> writes:
> On Wed, 2016-08-03 at 11:23 -0500, Eric W. Biederman wrote:
>> Nikolay Borisov <kernel-6AxghH7DbtA@public.gmane.org> writes:
>>
>> >
>> > On busy container servers reading /proc/locks shows all the locks
>> > created by all clients. This can cause large latency spikes. In my
>> > case I observed lsof taking up to 5-10 seconds while processing
>> > around
>> > 50k locks. Fix this by limiting the locks shown only to those
>> > created
>> > in the same pidns as the one the proc fs was mounted in. When
>> > reading
>> > /proc/locks from the init_pid_ns proc instance then perform no
>> > filtering
>>
>> If we are going to do this, this should be a recrusive belonging test
>> (because pid namespaces are recursive).
>>
>> Right now the test looks like it will filter out child pid
>> namespaces.
>>
>> Special casing the init_pid_ns should be an optimization not
>> something
>> that is necessary for correctness. (as it appears here).
>>
>> Eric
>>
>>
>
> Ok, thanks. I'm still not that namespace savvy -- so there's a
> hierarchy of pid_namespaces?
There is.
> If so, then yeah does sound better. Is there an interface that allows
> you to tell whether a pid is a descendant of a particular
> pid_namespace?
Yes. And each pid has an array of the pid namespaces it is in so it is
a O(1) operation to see if that struct pid is in a pid namespace.
Dumb question does anyone know the difference between fl_nspid and
fl_pid off the top of your heads? I am looking at the code and I am
confused why we have to both. I am afraid that there was some
sloppiness when the pid namespace was implemented and this was the
result. I remember that file locks were a rough spot during the
conversion but I don't recall the details off the top of my head.
Eric
next prev parent reply other threads:[~2016-08-03 21:09 UTC|newest]
Thread overview: 40+ messages / expand[flat|nested] mbox.gz Atom feed top
2016-08-02 14:42 [RFC PATCH] locks: Show only file_locks created in the same pidns as current process Nikolay Borisov
[not found] ` <20160802150521.GB11767@fieldses.org>
[not found] ` <20160802150521.GB11767-uC3wQj2KruNg9hUCZPvPmw@public.gmane.org>
2016-08-02 15:20 ` Nikolay Borisov
[not found] ` <57A0BA40.5010406-6AxghH7DbtA@public.gmane.org>
2016-08-02 15:43 ` J. Bruce Fields
[not found] ` <1470148943-21835-1-git-send-email-kernel-6AxghH7DbtA@public.gmane.org>
2016-08-02 14:45 ` Nikolay Borisov
2016-08-02 15:05 ` J. Bruce Fields
2016-08-02 16:00 ` Eric W. Biederman
[not found] ` <87r3a7qhy0.fsf-JOvCrm2gF+uungPnsOpG7nhyD016LWXt@public.gmane.org>
2016-08-02 17:40 ` J. Bruce Fields
[not found] ` <20160802174003.GD11767-uC3wQj2KruNg9hUCZPvPmw@public.gmane.org>
2016-08-02 19:09 ` Eric W. Biederman
[not found] ` <87invjq97h.fsf-JOvCrm2gF+uungPnsOpG7nhyD016LWXt@public.gmane.org>
2016-08-02 19:44 ` J. Bruce Fields
[not found] ` <20160802194437.GD15324-uC3wQj2KruNg9hUCZPvPmw@public.gmane.org>
2016-08-02 20:01 ` Jeff Layton
[not found] ` <1470168082.15226.14.camel-vpEMnDpepFuMZCB2o+C8xQ@public.gmane.org>
2016-08-02 20:11 ` Nikolay Borisov
2016-08-02 20:34 ` J. Bruce Fields
2016-08-03 7:35 ` [PATCH v2] locks: Filter /proc/locks output on proc pid ns Nikolay Borisov
[not found] ` <1470209710-30022-1-git-send-email-kernel-6AxghH7DbtA@public.gmane.org>
2016-08-03 13:46 ` Jeff Layton
[not found] ` <1470232012.18285.4.camel-vpEMnDpepFuMZCB2o+C8xQ@public.gmane.org>
2016-08-03 14:17 ` Nikolay Borisov
[not found] ` <57A1FCE5.3040206-6AxghH7DbtA@public.gmane.org>
2016-08-03 14:28 ` J. Bruce Fields
2016-08-03 14:54 ` Pavel Emelyanov
[not found] ` <57A205BE.3070202-5HdwGun5lf+gSpxsJD1C4w@public.gmane.org>
2016-08-03 15:00 ` Nikolay Borisov
[not found] ` <57A20702.3040805@kyup.com>
[not found] ` <57A20702.3040805-6AxghH7DbtA@public.gmane.org>
2016-08-03 15:06 ` J. Bruce Fields
[not found] ` <20160803150631.GA3789-uC3wQj2KruNg9hUCZPvPmw@public.gmane.org>
2016-08-03 15:10 ` Nikolay Borisov
[not found] ` <57A2097C.7060206-6AxghH7DbtA@public.gmane.org>
2016-08-03 17:35 ` Eric W. Biederman
[not found] ` <20160803142850.GA27072@fieldses.org>
[not found] ` <20160803142850.GA27072-uC3wQj2KruNg9hUCZPvPmw@public.gmane.org>
2016-08-03 14:33 ` Nikolay Borisov
2016-08-03 14:54 ` [PATCHv3] " Nikolay Borisov
[not found] ` <1470236078-2389-1-git-send-email-kernel-6AxghH7DbtA@public.gmane.org>
2016-08-03 15:24 ` Jeff Layton
2016-08-03 16:23 ` Eric W. Biederman
[not found] ` <87k2fxom8a.fsf-JOvCrm2gF+uungPnsOpG7nhyD016LWXt@public.gmane.org>
2016-08-03 16:50 ` Jeff Layton
[not found] ` <1470243015.13804.7.camel-vpEMnDpepFuMZCB2o+C8xQ@public.gmane.org>
2016-08-03 21:09 ` Eric W. Biederman [this message]
[not found] ` <87twf1ftk9.fsf-JOvCrm2gF+uungPnsOpG7nhyD016LWXt@public.gmane.org>
2016-08-03 21:26 ` Nikolay Borisov
[not found] ` <a0a58f75-0e40-c14f-d8e3-8f094e9fc62c-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
2016-08-04 4:18 ` Eric W. Biederman
[not found] ` <87eg659ngh.fsf-JOvCrm2gF+uungPnsOpG7nhyD016LWXt@public.gmane.org>
2016-08-04 5:07 ` Eric W. Biederman
2016-08-03 17:40 ` Eric W. Biederman
2016-08-04 7:26 ` [PATCHv4] " Nikolay Borisov
[not found] ` <1470295588-9803-1-git-send-email-kernel-6AxghH7DbtA@public.gmane.org>
2016-08-04 11:29 ` Jeff Layton
[not found] ` <1470310175.22052.3.camel-vpEMnDpepFuMZCB2o+C8xQ@public.gmane.org>
2016-08-04 14:09 ` Eric W. Biederman
[not found] ` <874m707hhm.fsf-JOvCrm2gF+uungPnsOpG7nhyD016LWXt@public.gmane.org>
2016-08-04 14:34 ` Nikolay Borisov
2016-08-04 15:09 ` Nikolay Borisov
[not found] ` <57A35AC7.7040105-6AxghH7DbtA@public.gmane.org>
2016-08-04 15:21 ` Eric W. Biederman
2016-08-05 7:30 ` [PATCHv5] " Nikolay Borisov
[not found] ` <1470382204-21480-1-git-send-email-kernel-6AxghH7DbtA@public.gmane.org>
2016-08-05 10:47 ` Jeff Layton
[not found] ` <1470394036.8100.2.camel-vpEMnDpepFuMZCB2o+C8xQ@public.gmane.org>
2016-08-05 14:58 ` J. Bruce Fields
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=87twf1ftk9.fsf@x220.int.ebiederm.org \
--to=ebiederm-as9lmozglivwk0htik3j/w@public.gmane.org \
--cc=avagin-GEFAQzZX7r8dnm+yROfE0A@public.gmane.org \
--cc=bfields-uC3wQj2KruNg9hUCZPvPmw@public.gmane.org \
--cc=containers-cunTk1MwBs9QetFLy7KEm3xJsTq8ys+cHZ5vskTnxNA@public.gmane.org \
--cc=jlayton-vpEMnDpepFuMZCB2o+C8xQ@public.gmane.org \
--cc=kernel-6AxghH7DbtA@public.gmane.org \
--cc=xemul-5HdwGun5lf+gSpxsJD1C4w@public.gmane.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox