cephfs (hammer) flips directory access bits

cephfs (hammer) flips directory access bits

[CSa]

Hi,

we are using cephfs on a ceph cluster (V0.94.5, 3x MON, 1x MDS, ~50x OSD).
Recently, we observed a spontaneous (and unwanted) change in the access 
rights of newly created directories:

$ umask
0077
$ mkdir test 
$ ls -ld test
drwx------ 1 me me 0 Jan  6 14:59 test
$ touch test/foo
$ ls -ld test
drwxrwxrwx 1 me me 0 Jan  6 14:59 test
$

I kindly would like to ask for help tracking down this issue.

ciao
Christian

Re: cephfs (hammer) flips directory access bits

[Gregory Farnum]

On Thu, Jan 7, 2016 at 12:05 AM, CSa <Christian.Salzmann@fu-berlin.de> wrote:
> Hi,
>
> we are using cephfs on a ceph cluster (V0.94.5, 3x MON, 1x MDS, ~50x OSD).
> Recently, we observed a spontaneous (and unwanted) change in the access
> rights of newly created directories:
>
> $ umask
> 0077
> $ mkdir test
> $ ls -ld test
> drwx------ 1 me me 0 Jan  6 14:59 test
> $ touch test/foo
> $ ls -ld test
> drwxrwxrwx 1 me me 0 Jan  6 14:59 test
> $
>
> I kindly would like to ask for help tracking down this issue.

Huh. Which clients are you using? What changes have you made to your
ceph cluster or environment recently?

In any case, set mds debug to 20 and client debug to 20 on the node
you're testing on (if you're using ceph-fuse), run this test, post the
logs, and create a ticket in the tracker pointing at them, please.
(You can use ceph-post-file if you don't have storage space and it'll
upload to our lab.)
-Greg

Re: cephfs (hammer) flips directory access bits

[Yan, Zheng]

On Thu, Jan 7, 2016 at 4:05 PM, CSa <Christian.Salzmann@fu-berlin.de> wrote:
> Hi,
>
> we are using cephfs on a ceph cluster (V0.94.5, 3x MON, 1x MDS, ~50x OSD).
> Recently, we observed a spontaneous (and unwanted) change in the access
> rights of newly created directories:
>
> $ umask
> 0077
> $ mkdir test
> $ ls -ld test
> drwx------ 1 me me 0 Jan  6 14:59 test
> $ touch test/foo
> $ ls -ld test
> drwxrwxrwx 1 me me 0 Jan  6 14:59 test
> $

do you use kernel client? I remember an ACL related bug in old kernel
can cause this. mount cephfs with '-o noacl' option can avoid this
issue.

>
> I kindly would like to ask for help tracking down this issue.
>
> ciao
> Christian
>
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: cephfs (hammer) flips directory access bits

[Christian Salzmann]

[-- Attachment #1: Type: text/plain, Size: 759 bytes --]

On 08.01.2016 09:54, Yan, Zheng wrote:

> do you use kernel client? I remember an ACL related bug in old kernel
> can cause this. mount cephfs with '-o noacl' option can avoid this
> issue.

yes, we use the kernel client (in Debian stable) and yes, mounting with 'noacl' avoids this issue.
Good catch!

Do you eventually have a pointer to the patch fixing this bug?
I am convinced the patch could be backported to the kernel in Debian Jessie (as long as it's not too intrusive).

thank you
Christian

-- 
Christian Salzmann                     Christian.Salzmann@fu-berlin.de
IT-Dienst                              Takustraße 9, 14195 Berlin
Fachbereich Mathematik und Informatik  http://www.mi.fu-berlin.de
Freie Universität Berlin



[-- Attachment #2: S/MIME Cryptographic Signature --]
[-- Type: application/pkcs7-signature, Size: 5500 bytes --]

Re: cephfs (hammer) flips directory access bits

[Yan, Zheng]

On Wed, Jan 13, 2016 at 7:16 PM, Christian Salzmann
<Christian.Salzmann@fu-berlin.de> wrote:
> On 08.01.2016 09:54, Yan, Zheng wrote:
>
>> do you use kernel client? I remember an ACL related bug in old kernel
>> can cause this. mount cephfs with '-o noacl' option can avoid this
>> issue.
>
> yes, we use the kernel client (in Debian stable) and yes, mounting with 'noacl' avoids this issue.
> Good catch!
>
> Do you eventually have a pointer to the patch fixing this bug?
> I am convinced the patch could be backported to the kernel in Debian Jessie (as long as it's not too intrusive).
>

https://github.com/ceph/ceph-client/commit/f5f186474335ac385def69564542e6e4c6a3a8bd

Regards
Yan, Zheng