From: "J. Bruce Fields" <bfields@fieldses.org>
To: Amir Goldstein <amir73il@gmail.com>
Cc: Miklos Szeredi <miklos@szeredi.hu>,
Al Viro <viro@zeniv.linux.org.uk>,
overlayfs <linux-unionfs@vger.kernel.org>,
linux-fsdevel <linux-fsdevel@vger.kernel.org>
Subject: Re: [PATCH v2 00/20] Overlayfs inodes index
Date: Wed, 7 Jun 2017 14:59:01 -0400 [thread overview]
Message-ID: <20170607185901.GB28835@fieldses.org> (raw)
In-Reply-To: <CAOQ4uxgL5U_bH4BbRdaneCxXs7EPa7==Dcmn4zj+Ahi7=FQdKA@mail.gmail.com>
On Wed, Jun 07, 2017 at 09:36:46PM +0300, Amir Goldstein wrote:
> On Wed, Jun 7, 2017 at 8:17 PM, J. Bruce Fields <bfields@fieldses.org> wrote:
> > On Wed, Jun 07, 2017 at 10:51:04AM +0300, Amir Goldstein wrote:
> >> Miklos,
> >>
> >> This set is an independent series a top of current overlayfs-next.
> >> I yanked all the dependencies from previous postings (consistent d_ino,
> >> dir_lock, verify_lower) and included everything needed in this posting.
> >>
> >> This work introcuding the inodes index opt-in feature, which provides:
> >> - Hardlinks are not broken on copy up
> >> - Infrastructure for overlayfs NFS export
> >
> > Minor suggestion: for the lazy readers among us, a quick summary of the
> > implementation might be helpful. (Could take most of it from just
> > 05/20?)
> >
>
> Heh, for the *very* lazy reader, I'll paste the referred snip from 05/20:
> "The index dir will contain hardlinks to upper inodes, named after the
> hex representation of their origin lower inodes.
> The index dir is going to be used to prevent breaking lower hardlinks
> on copy up and to implement overlayfs NFS export."
>
> That's me being very very brief about the what and the why, but nothing
> about the how, so here goes:
>
> The challenge with exporting overlayfs handled is that an object can start
> its life as a lower inode and transition into an upper inode (copy up).
> When the object is lower, the only way to encode it is by encoding the
> underlying fs lower inode, say encode(/lower/foo)=0x0001.
> The gist of the inodes index concept is that when decoding the handle,
> we need to check if the object was copied up.
> When an object is copied up, it creates an index entry at:
> workdir/index/0001, which is a hardlink to /upper/foo,
> so we have a way to get from the lower handle to the upper inode if it
> exists.
>
> The same lower -> upper mapping also helps herding a lower hardlinks
> bundle with their upper hardlinks bundle and refer to all as a single inode
> object. Most of the gritty details are in patches {08,11,18}/20.
>
> With this series, which is aiming for v4.13, NFS export is not there yet,
> because lower directories are not yet indexed (and more).
> I do, however, have a POC of non-persistent overlay NFS export [1]
> with a detailed documentation patch about the missing bits for persistent
> handles. I tested this POC with xfstest generic/426.
>
> Hope this summary was quick enough ;-)
Yes, thanks!
>
> Cheers,
> Amir.
>
> [1] https://github.com/amir73il/linux/commits/ovl-nfs-export-wip
prev parent reply other threads:[~2017-06-07 18:59 UTC|newest]
Thread overview: 41+ messages / expand[flat|nested] mbox.gz Atom feed top
2017-06-07 7:51 [PATCH v2 00/20] Overlayfs inodes index Amir Goldstein
2017-06-07 7:51 ` [PATCH v2 01/20] vfs: introduce inode 'inuse' lock Amir Goldstein
2017-06-07 7:51 ` [PATCH v2 02/20] ovl: get exclusive ownership on upper/work dirs Amir Goldstein
2017-06-07 7:51 ` [PATCH v2 03/20] ovl: relax same fs constrain for ovl_check_origin() Amir Goldstein
2017-06-07 7:51 ` [PATCH v2 04/20] ovl: generalize ovl_create_workdir() Amir Goldstein
2017-06-07 7:51 ` [PATCH v2 05/20] ovl: introduce the inodes index dir feature Amir Goldstein
2017-06-07 7:51 ` [PATCH v2 06/20] ovl: verify upper root dir matches lower root dir Amir Goldstein
2017-06-07 7:51 ` [PATCH v2 07/20] ovl: verify index dir matches upper dir Amir Goldstein
2017-06-07 7:51 ` [PATCH v2 08/20] ovl: lookup index entry for non-dir Amir Goldstein
2017-06-08 12:11 ` Miklos Szeredi
2017-06-08 14:48 ` Amir Goldstein
2017-06-08 15:17 ` Miklos Szeredi
2017-06-08 16:09 ` Amir Goldstein
2017-06-09 8:43 ` Miklos Szeredi
2017-06-09 9:38 ` Amir Goldstein
2017-06-09 11:49 ` Miklos Szeredi
2017-06-09 13:14 ` Miklos Szeredi
2017-06-09 13:24 ` Amir Goldstein
2017-06-09 13:29 ` Miklos Szeredi
2017-06-09 22:56 ` Amir Goldstein
2017-06-07 7:51 ` [PATCH v2 09/20] ovl: move inode helpers to inode.c Amir Goldstein
2017-06-07 7:51 ` [PATCH v2 10/20] ovl: use ovl_inode_init() for initializing new inode Amir Goldstein
2017-06-07 7:51 ` [PATCH v2 11/20] ovl: hash overlay non-dir inodes by copy up origin inode Amir Goldstein
2017-06-07 7:51 ` [PATCH v2 12/20] ovl: fix nlink leak in ovl_rename() Amir Goldstein
2017-06-07 7:51 ` [PATCH v2 13/20] ovl: adjust overlay inode nlink for indexed inodes Amir Goldstein
2017-06-07 7:51 ` [PATCH v2 14/20] ovl: defer upper dir lock to tempfile link Amir Goldstein
2017-06-07 7:51 ` [PATCH v2 15/20] ovl: factor out ovl_copy_up_inode() helper Amir Goldstein
2017-06-07 7:51 ` [PATCH v2 16/20] ovl: generalize ovl_copy_up_locked() using actors Amir Goldstein
2017-06-07 7:51 ` [PATCH v2 17/20] ovl: generalize ovl_copy_up_one() " Amir Goldstein
2017-06-07 7:51 ` [PATCH v2 18/20] ovl: implement index dir copy up method Amir Goldstein
2017-06-07 7:51 ` [PATCH v2 19/20] ovl: handle race of concurrent lower hardlinks copy up Amir Goldstein
2017-06-07 7:51 ` [PATCH v2 20/20] ovl: constant inode number for hardlinks Amir Goldstein
2017-06-07 7:54 ` [PATCH v2 00/20] Overlayfs inodes index Miklos Szeredi
2017-06-07 7:58 ` Amir Goldstein
2017-06-07 14:58 ` Amir Goldstein
2017-06-08 15:00 ` [PATCH v2 21/23] ovl: use inodes index on readonly mount Amir Goldstein
2017-06-08 15:00 ` [PATCH v2 22/23] ovl: move copy up helpers to copy_up.c Amir Goldstein
2017-06-08 15:00 ` [PATCH v2 23/23] ovl: copy up on read operations on indexed lower Amir Goldstein
2017-06-07 17:17 ` [PATCH v2 00/20] Overlayfs inodes index J. Bruce Fields
2017-06-07 18:36 ` Amir Goldstein
2017-06-07 18:59 ` J. Bruce Fields [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20170607185901.GB28835@fieldses.org \
--to=bfields@fieldses.org \
--cc=amir73il@gmail.com \
--cc=linux-fsdevel@vger.kernel.org \
--cc=linux-unionfs@vger.kernel.org \
--cc=miklos@szeredi.hu \
--cc=viro@zeniv.linux.org.uk \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox