linux-api.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Dave Chinner <david@fromorbit.com>
To: Chris Mason <clm@fb.com>, Christoph Hellwig <hch@infradead.org>,
	"Darrick J. Wong" <darrick.wong@oracle.com>,
	P??draig Brady <P@draigBrady.com>,
	Anna Schumaker <Anna.Schumaker@netapp.com>,
	linux-nfs@vger.kernel.org, linux-btrfs@vger.kernel.org,
	linux-fsdevel@vger.kernel.org, linux-api@vger.kernel.org,
	zab@zabbo.net, viro@zeniv.linux.org.uk, mtk.manpages@gmail.com,
	andros@netapp.com
Subject: Re: [PATCH v5 9/9] btrfs: btrfs_copy_file_range() only supports reflinks
Date: Sat, 17 Oct 2015 08:44:35 +1100	[thread overview]
Message-ID: <20151016214435.GA2786@dastard> (raw)
In-Reply-To: <20151016131950.GC6874@ret.masoncoding.com>

On Fri, Oct 16, 2015 at 09:19:50AM -0400, Chris Mason wrote:
> On Fri, Oct 16, 2015 at 05:25:44AM -0700, Christoph Hellwig wrote:
> > On Fri, Oct 16, 2015 at 07:49:19AM -0400, Chris Mason wrote:
> > > > Yes, that would be my preference.  I'd also like to understand what
> > > > exactly btrfs does in fallocate.
> > > 
> > > For which part?  The answer changes based on how many references there
> > > are to a given fallocated region.
> > 
> > Both cases.  With btrfs allocating new block on every write how do you
> > avoid that ENOSPC?  Is there a unassigned block preallocation that's
> > made persistent in some way?
> 
> So:
> 
> fallocate 1g -> foo
> 
> reflink foo foo2
> 
> We've now implicitly doubled the size of the fallocate, but at reflink

No, I don't think it implies that at all. the posix_fallocate()
"future writes will succeed" guarantee only applies to foo, not to
/copies/ such as foo2. At it's core, reflink is just an optimised
file copy mechanism - the resultant copy should have the same
behaviour as a file copied by read/write. Copies done by physically
copying data do not duplicate fallocate() regions or guarantees from
the source file to the destination file.

> time btrfs doesn't account for the doubling.  It's actually much
> better in this case to just use a hole because neither foo or foo2 can
> use the preallocated space until the 1g is fully unshared.

Right - this implies unwritten extents should not be shared by
reflink, instead either skipped (i.e. leave as a hole in foo2 as you
suggest) or duplicated so that the next write to the region of foo2
will also succeed. I'd suggest that COPY_FALLOC (or whatever it'll
get called) implies the latter behaviour, the default behaviour
being the former...

> When we're doing writes, it'll check the preallocated extents for extra
> refs and force COW if any exist.  So writes into a preallocated region
> can enospc.

This really seems like an btrfs interpretation/implementation
issue, not a problem for reflink in general.

Cheers,

Dave.
-- 
Dave Chinner
david@fromorbit.com

  reply	other threads:[~2015-10-16 21:44 UTC|newest]

Thread overview: 68+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2015-09-30 17:26 [PATCH v5 0/9] VFS: In-kernel copy system call Anna Schumaker
2015-09-30 17:26 ` [PATCH v5 1/9] vfs: add copy_file_range syscall and vfs helper Anna Schumaker
2015-09-30 17:26 ` [PATCH v5 2/9] x86: add sys_copy_file_range to syscall tables Anna Schumaker
2015-09-30 17:26 ` [PATCH v5 3/9] btrfs: add .copy_file_range file operation Anna Schumaker
2015-09-30 17:26 ` [PATCH v5 5/9] vfs: Copy shouldn't forbid ranges inside the same file Anna Schumaker
2015-10-11 14:22   ` Christoph Hellwig
     [not found]     ` <20151011142233.GC31867-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
2015-10-14 17:37       ` Anna Schumaker
2015-10-14 18:25         ` Christoph Hellwig
     [not found]           ` <20151014182523.GA31225-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
2015-10-14 18:27             ` Anna Schumaker
2015-09-30 17:26 ` [PATCH v5 6/9] vfs: Copy should use file_out rather than file_in Anna Schumaker
2015-10-11 14:24   ` Christoph Hellwig
2015-09-30 17:26 ` [PATCH v5 7/9] vfs: Remove copy_file_range mountpoint checks Anna Schumaker
2015-10-11 14:23   ` Christoph Hellwig
2015-10-14 17:41     ` Anna Schumaker
     [not found]       ` <561E93C3.2090507-ZwjVKphTwtPQT0dZR+AlfA@public.gmane.org>
2015-10-14 18:25         ` Christoph Hellwig
2015-09-30 17:26 ` [PATCH v5 9/9] btrfs: btrfs_copy_file_range() only supports reflinks Anna Schumaker
     [not found]   ` <1443634014-3026-10-git-send-email-Anna.Schumaker-ZwjVKphTwtPQT0dZR+AlfA@public.gmane.org>
2015-10-11 14:29     ` Christoph Hellwig
     [not found]       ` <20151011142939.GA30905-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
2015-10-12 10:23         ` Pádraig Brady
2015-10-12 14:34           ` Christoph Hellwig
     [not found]             ` <20151012143444.GA10156-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
2015-10-12 23:41               ` Darrick J. Wong
     [not found]                 ` <20151012234106.GD11398-PTl6brltDGh4DFYR7WNSRA@public.gmane.org>
2015-10-13  7:29                   ` Christoph Hellwig
     [not found]                     ` <20151013072959.GB10794-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
2015-10-14 18:46                       ` Darrick J. Wong
2015-10-15  6:00                         ` Christoph Hellwig
     [not found]                           ` <20151015060045.GA23996-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
2015-10-16 11:49                             ` Chris Mason
     [not found]                               ` <20151016114919.GB6874-DzB2rL6jT1BHfPKRx072akEOCMrvLtNR@public.gmane.org>
2015-10-16 12:25                                 ` Christoph Hellwig
     [not found]                                   ` <20151016122544.GC5889-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
2015-10-16 13:19                                     ` Chris Mason
2015-10-16 21:44                                       ` Dave Chinner [this message]
2015-10-17 13:44                                         ` Chris Mason
     [not found]                         ` <20151014184608.GK850-PTl6brltDGh4DFYR7WNSRA@public.gmane.org>
2015-10-15  8:35                           ` Dave Chinner
     [not found] ` <1443634014-3026-1-git-send-email-Anna.Schumaker-ZwjVKphTwtPQT0dZR+AlfA@public.gmane.org>
2015-09-30 17:26   ` [PATCH v5 4/9] vfs: Copy should check len after file open mode Anna Schumaker
     [not found]     ` <1443634014-3026-5-git-send-email-Anna.Schumaker-ZwjVKphTwtPQT0dZR+AlfA@public.gmane.org>
2015-10-11 14:22       ` Christoph Hellwig
2015-09-30 17:26   ` [PATCH v5 8/9] vfs: Add vfs_copy_file_range() support for pagecache copies Anna Schumaker
2015-10-08  1:40     ` Neil Brown
2015-10-09 11:15       ` Pádraig Brady
     [not found]         ` <5617A1E9.1080509-V8g9lnOeT5ydJdNcDFJN0w@public.gmane.org>
2015-10-13 20:25           ` Anna Schumaker
     [not found]             ` <561D68B9.8030209-ZwjVKphTwtPQT0dZR+AlfA@public.gmane.org>
2015-10-14  7:41               ` Christoph Hellwig
     [not found]       ` <87vbai6sud.fsf-wvvUuzkyo1HefUI2i7LXDhCRmIWqnp/j@public.gmane.org>
2015-10-13 19:45         ` Anna Schumaker
     [not found]     ` <1443634014-3026-9-git-send-email-Anna.Schumaker-ZwjVKphTwtPQT0dZR+AlfA@public.gmane.org>
2015-10-11 14:22       ` Christoph Hellwig
     [not found]         ` <20151011142203.GA31867-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
2015-10-12 23:17           ` Darrick J. Wong
2015-10-13  3:36             ` Trond Myklebust
     [not found]               ` <CAHQdGtQoV0g1p2FYC1vFtFwh=jNq5n+AYOxAuSORVfbfhRY1Hg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2015-10-13  7:19                 ` Darrick J. Wong
2015-10-13  7:30                 ` Christoph Hellwig
     [not found]             ` <20151012231749.GC11398-PTl6brltDGh4DFYR7WNSRA@public.gmane.org>
2015-10-13  7:27               ` Christoph Hellwig
2015-11-10  6:24                 ` Darrick J. Wong
2015-10-14 17:59               ` Anna Schumaker
2015-10-14 18:08                 ` Andy Lutomirski
2015-10-14 18:27                   ` Christoph Hellwig
     [not found]                     ` <20151014182701.GC31225-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
2015-10-14 18:38                       ` Andy Lutomirski
     [not found]                         ` <CALCETrWrHs6x+aZ7c=sySRCdzwdfUQZH_DL++vLL78NXXN+7FQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2015-10-14 18:49                           ` Christoph Hellwig
2015-10-14 18:53                             ` Andy Lutomirski
     [not found]                               ` <CALCETrV2ZG=EV5KLEeOERSbDjXCyaULAn0k34msSPFWvf0Tm9w-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2015-10-14 19:14                                 ` Austin S Hemmelgarn
2015-10-14 19:39                                   ` Pádraig Brady
2015-10-15  5:56                                 ` Christoph Hellwig
2015-10-14 19:08                       ` Austin S Hemmelgarn
     [not found]                         ` <561EA83E.8080000-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
2015-10-15  6:36                           ` Christoph Hellwig
     [not found]                             ` <20151015063621.GA3025-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
2015-10-15 12:24                               ` Austin S Hemmelgarn
     [not found]                                 ` <561F9B13.7020804-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
2015-10-16  5:38                                   ` Christoph Hellwig
2015-10-16 11:46                                     ` Austin S Hemmelgarn
2015-10-16 12:02                                       ` Pádraig Brady
     [not found]                                         ` <5620E74F.50006-V8g9lnOeT5ydJdNcDFJN0w@public.gmane.org>
2015-10-16 12:24                                           ` Christoph Hellwig
     [not found]                                             ` <20151016122453.GB5889-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
2015-10-16 12:46                                               ` Austin S Hemmelgarn
     [not found]                                       ` <5620E3A1.90408-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
2015-10-16 12:21                                         ` Christoph Hellwig
2015-10-16 12:50                                           ` Austin S Hemmelgarn
2015-10-16 13:12                                             ` Christoph Hellwig
2015-10-16 14:11                                               ` Austin S Hemmelgarn
     [not found]                 ` <561E980C.9010509-ZwjVKphTwtPQT0dZR+AlfA@public.gmane.org>
2015-10-14 18:11                   ` Darrick J. Wong
2015-10-14 18:26                     ` Andy Lutomirski
2015-09-30 17:26   ` [PATCH v5 10/9] copy_file_range.2: New page documenting copy_file_range() Anna Schumaker

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20151016214435.GA2786@dastard \
    --to=david@fromorbit.com \
    --cc=Anna.Schumaker@netapp.com \
    --cc=P@draigBrady.com \
    --cc=andros@netapp.com \
    --cc=clm@fb.com \
    --cc=darrick.wong@oracle.com \
    --cc=hch@infradead.org \
    --cc=linux-api@vger.kernel.org \
    --cc=linux-btrfs@vger.kernel.org \
    --cc=linux-fsdevel@vger.kernel.org \
    --cc=linux-nfs@vger.kernel.org \
    --cc=mtk.manpages@gmail.com \
    --cc=viro@zeniv.linux.org.uk \
    --cc=zab@zabbo.net \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).