public inbox for linux-unionfs@vger.kernel.org
 help / color / mirror / Atom feed
From: Vivek Goyal <vgoyal@redhat.com>
To: Amir Goldstein <amir73il@gmail.com>
Cc: overlayfs <linux-unionfs@vger.kernel.org>,
	Miklos Szeredi <miklos@szeredi.hu>
Subject: Re: [PATCH v10 07/18] ovl: Add mechanism to create a chain of origin dentries
Date: Tue, 30 Jan 2018 15:15:52 -0500	[thread overview]
Message-ID: <20180130201552.GE7929@redhat.com> (raw)
In-Reply-To: <CAOQ4uxjX0BaDJw1eMfRhkJ4=zOD=temGkJt7s2zyAHayT-=CAA@mail.gmail.com>

On Tue, Jan 30, 2018 at 10:05:08PM +0200, Amir Goldstein wrote:
> On Tue, Jan 30, 2018 at 10:03 PM, Amir Goldstein <amir73il@gmail.com> wrote:
> > On Tue, Jan 30, 2018 at 9:33 PM, Vivek Goyal <vgoyal@redhat.com> wrote:
> >> On Tue, Jan 23, 2018 at 03:47:29PM +0200, Amir Goldstein wrote:
> >>> On Tue, Jan 23, 2018 at 3:45 PM, Vivek Goyal <vgoyal@redhat.com> wrote:
> >>> > On Mon, Jan 22, 2018 at 09:46:33PM +0200, Amir Goldstein wrote:
> >>> >> On Mon, Jan 22, 2018 at 9:34 PM, Amir Goldstein <amir73il@gmail.com> wrote:
> >>> >> > On Mon, Jan 22, 2018 at 8:39 PM, Vivek Goyal <vgoyal@redhat.com> wrote:
> >>> >> >> There is a need to support metacopy dentry in midlayer. That means there
> >>> >> >> could be a chain of metacopy dentries.
> >>> >> >>
> >>> >> >> For example, upper could be metacopy, midlayer lower could be metacopy and
> >>> >> >> lowest layer could be actual data inode. This means when we copy up actual
> >>> >> >> data, we should be able to reach to lowest data inode and copy up data from
> >>> >> >> there. And that means we should keep track of all the dentries in origin
> >>> >> >> chain which lead to data inode.
> >>> >> >>
> >>> >> >> Current ovl_check_origin() logic only looks for one origin dentry. This patch
> >>> >> >> enhances ovl_check_origin() to continue to follow origin chain and return
> >>> >> >> all the origin entries found. This is done only if caller of the function
> >>> >> >> set "follow_chain" argument.
> >>> >> >>
> >>> >> >
> >>> >> > We don't really need to keep the entire chain do we?
> >>> >> > We can follow chain but keep only the one inode that is not a metacopy inode.
> >>> >> > All the rest are useless, no?
> >>> >> > Then we don't create a new type of object - non-dir with numlower > 1.
> >>> >> >
> >>> >>
> >>> >> Seems like if you don't keep the entire chain, then no need for
> >>> >> patches 14 and 15.
> >>> >
> >>> > I will need to have atleast 2 lower dentries. One will be top most
> >>> > metadata copy and other lower most data dentry. IOW, both the ends of
> >>> > the chain need to be there.
> >>> >
> >>> >> Also with upper metacopy, you can fix upper origin xattr after
> >>> >> following to the data
> >>> >> origin and forget about middle layer metacopies forever.
> >>> >
> >>> > If upper metacopy is alreday there, then I agree that lower top most
> >>> > becomes inner node of chain and we can get rid of it.
> >>> >
> >>> >>
> >>> >> Am I missing something?
> >>> >
> >>> > I think you are missing the case when there is no upper and lower has
> >>> > a metacopy chain. In that case we need to retain two dentries. One for
> >>> > data copy up and one for metadata copy up.
> >>> >
> >>>
> >>> OK. so you can get rid of all the middle metacopies while following
> >>> the origin chain. no reason to keep those.
> >>
> >> Hi Amir,
> >>
> >> What about the case when we have upper and one middle metacopy. As of top
> >> most lower is the ORIGIN for upper. Should we retain that top most lower
> >> ORIGIN as well as lower most data. Or just retain lower most data and
> >> use that as ORIGIN.
> >>
> >
> > Not sure I follow.
> > IIUC, the longest possible chain is lowerstack size 2:
> > upper -> metadata ORIGIN -> data ORIGIN
> >
> 
> If you are wondering if we could drop the metadata ORIGIN,
> I think we need it at least for constant and persistent st_ino.

Right, I was wondering can be drop metadata ORIGIN and just live with
data ORIGIN.

My initial impression is that constant and persistent st_ino can be
achieved using just data ORIGIN alone as well. But I might be missing
some finer detail.

Vivek

  reply	other threads:[~2018-01-30 20:15 UTC|newest]

Thread overview: 33+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2018-01-22 18:39 [PATCH v10 00/18] overlayfs: Delayed copy up of data Vivek Goyal
2018-01-22 18:39 ` [PATCH v10 01/18] ovl: Do not look for OVL_XATTR_NLINK if index is not there Vivek Goyal
2018-01-22 18:39 ` [PATCH v10 02/18] ovl: disable redirect_dir and index when no xattr support Vivek Goyal
2018-01-22 18:39 ` [PATCH v10 03/18] ovl: Create origin xattr on copy up for all files Vivek Goyal
2018-01-22 18:39 ` [PATCH v10 04/18] ovl: Provide a mount option metacopy=on/off for metadata copyup Vivek Goyal
2018-01-22 18:39 ` [PATCH v10 05/18] ovl: During copy up, first copy up metadata and then data Vivek Goyal
2018-01-22 18:39 ` [PATCH v10 06/18] ovl: Move the copy up helpers to copy_up.c Vivek Goyal
2018-01-22 18:39 ` [PATCH v10 07/18] ovl: Add mechanism to create a chain of origin dentries Vivek Goyal
2018-01-22 19:34   ` Amir Goldstein
2018-01-22 19:46     ` Amir Goldstein
2018-01-23 13:45       ` Vivek Goyal
2018-01-23 13:47         ` Amir Goldstein
2018-01-23 14:13           ` Vivek Goyal
2018-01-30 19:33           ` Vivek Goyal
2018-01-30 20:03             ` Amir Goldstein
2018-01-30 20:05               ` Amir Goldstein
2018-01-30 20:15                 ` Vivek Goyal [this message]
2018-01-30 21:01                   ` Amir Goldstein
2018-01-30 20:06               ` Vivek Goyal
2018-01-23 13:40     ` Vivek Goyal
2018-01-22 18:39 ` [PATCH v10 08/18] ovl: Copy up only metadata during copy up where it makes sense Vivek Goyal
2018-01-22 18:39 ` [PATCH v10 09/18] ovl: Add helper ovl_already_copied_up() Vivek Goyal
2018-01-22 18:39 ` [PATCH v10 10/18] ovl: A new xattr OVL_XATTR_METACOPY for file on upper Vivek Goyal
2018-01-22 18:39 ` [PATCH v10 11/18] ovl: Set OVL_UPPERDATA flag during ovl_lookup() Vivek Goyal
2018-01-22 18:39 ` [PATCH v10 12/18] ovl: Setup origin chain for lower regular files Vivek Goyal
2018-01-22 18:39 ` [PATCH v10 13/18] ovl: Check metacopy attributes on a chain of origin Vivek Goyal
2018-01-22 18:40 ` [PATCH v10 14/18] ovl: Do not mark a non dir as _OVL_PATH_MERGE in ovl_path_type() Vivek Goyal
2018-01-22 18:40 ` [PATCH v10 15/18] ovl: Copy up meta inode data from lowest data inode Vivek Goyal
2018-01-22 18:40 ` [PATCH v10 16/18] ovl: Fix ovl_getattr() to get number of blocks from lower Vivek Goyal
2018-01-22 18:40 ` [PATCH v10 17/18] ovl: Do not expose metacopy only upper dentry from d_real() Vivek Goyal
2018-01-22 18:40 ` [PATCH v10 18/18] ovl: Enable metadata only feature Vivek Goyal
2018-01-24  9:05 ` [PATCH v10 00/18] overlayfs: Delayed copy up of data Miklos Szeredi
2018-01-27 16:38   ` Amir Goldstein

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20180130201552.GE7929@redhat.com \
    --to=vgoyal@redhat.com \
    --cc=amir73il@gmail.com \
    --cc=linux-unionfs@vger.kernel.org \
    --cc=miklos@szeredi.hu \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox