From: Anna Schumaker <Anna.Schumaker-HgOvQuBEEgTQT0dZR+AlfA@public.gmane.org>
To: linux-nfs-u79uwXL29TY76Z2rM5mHXA@public.gmane.org,
linux-btrfs-u79uwXL29TY76Z2rM5mHXA@public.gmane.org,
linux-fsdevel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org,
linux-api-u79uwXL29TY76Z2rM5mHXA@public.gmane.org,
zab-ugsP4Wv/S6ZeoWH0uzbU5w@public.gmane.org,
viro-RmSDqhL/yNMiFSDQTTA3OLVCufUGDwFn@public.gmane.org,
clm-b10kYP2dOMg@public.gmane.org,
darrick.wong-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org,
mtk.manpages-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org,
andros-HgOvQuBEEgTQT0dZR+AlfA@public.gmane.org,
hch-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org
Subject: [PATCH v5 10/9] copy_file_range.2: New page documenting copy_file_range()
Date: Wed, 30 Sep 2015 13:26:54 -0400 [thread overview]
Message-ID: <1443634014-3026-11-git-send-email-Anna.Schumaker@Netapp.com> (raw)
In-Reply-To: <1443634014-3026-1-git-send-email-Anna.Schumaker-ZwjVKphTwtPQT0dZR+AlfA@public.gmane.org>
copy_file_range() is a new system call for copying ranges of data
completely in the kernel. This gives filesystems an opportunity to
implement some kind of "copy acceleration", such as reflinks or
server-side-copy (in the case of NFS).
Signed-off-by: Anna Schumaker <Anna.Schumaker-ZwjVKphTwtPQT0dZR+AlfA@public.gmane.org>
Reviewed-by: Darrick J. Wong <darrick.wong-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
---
man2/copy_file_range.2 | 224 +++++++++++++++++++++++++++++++++++++++++++++++++
man2/splice.2 | 1 +
2 files changed, 225 insertions(+)
create mode 100644 man2/copy_file_range.2
diff --git a/man2/copy_file_range.2 b/man2/copy_file_range.2
new file mode 100644
index 0000000..23e3875
--- /dev/null
+++ b/man2/copy_file_range.2
@@ -0,0 +1,224 @@
+.\"This manpage is Copyright (C) 2015 Anna Schumaker <Anna.Schumaker-ZwjVKphTwtPQT0dZR+AlfA@public.gmane.org>
+.\"
+.\" %%%LICENSE_START(VERBATIM)
+.\" Permission is granted to make and distribute verbatim copies of this
+.\" manual provided the copyright notice and this permission notice are
+.\" preserved on all copies.
+.\"
+.\" Permission is granted to copy and distribute modified versions of
+.\" this manual under the conditions for verbatim copying, provided that
+.\" the entire resulting derived work is distributed under the terms of
+.\" a permission notice identical to this one.
+.\"
+.\" Since the Linux kernel and libraries are constantly changing, this
+.\" manual page may be incorrect or out-of-date. The author(s) assume.
+.\" no responsibility for errors or omissions, or for damages resulting.
+.\" from the use of the information contained herein. The author(s) may.
+.\" not have taken the same level of care in the production of this.
+.\" manual, which is licensed free of charge, as they might when working.
+.\" professionally.
+.\"
+.\" Formatted or processed versions of this manual, if unaccompanied by
+.\" the source, must acknowledge the copyright and authors of this work.
+.\" %%%LICENSE_END
+.\"
+.TH COPY 2 2015-09-29 "Linux" "Linux Programmer's Manual"
+.SH NAME
+copy_file_range \- Copy a range of data from one file to another
+.SH SYNOPSIS
+.nf
+.B #include <linux/copy.h>
+.B #include <sys/syscall.h>
+.B #include <unistd.h>
+
+.BI "ssize_t copy_file_range(int " fd_in ", loff_t *" off_in ", int " fd_out ",
+.BI " loff_t *" off_out ", size_t " len \
+", unsigned int " flags );
+.fi
+.SH DESCRIPTION
+The
+.BR copy_file_range ()
+system call performs an in-kernel copy between two file descriptors
+without the additional cost of transferring data from the kernel to userspace
+and then back into the kernel.
+It copies up to
+.I len
+bytes of data from file descriptor
+.I fd_in
+to file descriptor
+.IR fd_out ,
+overwriting any data that exists within the requested range of the target file.
+
+The following semantics apply for
+.IR off_in ,
+and similar statements apply to
+.IR off_out :
+.IP * 3
+If
+.I off_in
+is NULL, then bytes are read from
+.I fd_in
+starting from the current file offset, and the offset is
+adjusted by the number of bytes copied.
+.IP *
+If
+.I off_in
+is not NULL, then
+.I off_in
+must point to a buffer that specifies the starting
+offset where bytes from
+.I fd_in
+will be read. The current file offset of
+.I fd_in
+is not changed, but
+.I off_in
+is adjusted appropriately.
+.PP
+
+The
+.I flags
+argument can have one of the following flags set:
+.TP 1.9i
+.B COPY_FR_COPY
+Copy all the file data in the requested range.
+Some filesystems might be able to accelerate this copy
+to avoid unnecessary data transfers.
+.TP
+.B COPY_FR_REFLINK
+Create a lightweight "reflink", where data is not copied until
+one of the files is modified.
+.TP
+.B COPY_FR_DEDUP
+Create a reflink, but only if the contents of
+both files' byte ranges are identical.
+If ranges do not match,
+.B EILSEQ
+will be returned.
+.PP
+The default behavior
+.RI ( flags
+== 0) is to try creating a reflink,
+and if reflinking fails
+.BR copy_file_range ()
+will fall back to performing a full data copy.
+.SH RETURN VALUE
+Upon successful completion,
+.BR copy_file_range ()
+will return the number of bytes copied between files.
+This could be less than the length originally requested.
+
+On error,
+.BR copy_file_range ()
+returns \-1 and
+.I errno
+is set to indicate the error.
+.SH ERRORS
+.TP
+.B EBADF
+One or more file descriptors are not valid; or
+.I fd_in
+is not open for reading; or
+.I fd_out
+is not open for writing.
+.TP
+.B EILSEQ
+The contents of both files' byte ranges did not match.
+.TP
+.B EINVAL
+Requested range extends beyond the end of the source file; or the
+.I flags
+argument is set to an invalid value.
+.TP
+.B EIO
+A low level I/O error occurred while copying.
+.TP
+.B ENOMEM
+Out of memory.
+.TP
+.B ENOSPC
+There is not enough space on the target filesystem to complete the copy.
+.TP
+.B EOPNOTSUPP
+.B COPY_REFLINK
+or
+.B COPY_DEDUP
+was specified in
+.IR flags ,
+but the target filesystem does not support the given operation.
+.TP
+.B EXDEV
+Target filesystem doesn't support cross-filesystem copies.
+.SH VERSIONS
+The
+.BR copy_file_range ()
+system call first appeared in Linux 4.4.
+.SH CONFORMING TO
+The
+.BR copy_file_range ()
+system call is a nonstandard Linux extension.
+.SH EXAMPLE
+.nf
+#define _GNU_SOURCE
+#include <fcntl.h>
+#include <linux/copy.h>
+#include <stdio.h>
+#include <stdlib.h>
+#include <sys/stat.h>
+#include <sys/syscall.h>
+#include <unistd.h>
+
+loff_t copy_file_range(int fd_in, loff_t *off_in, int fd_out,
+ loff_t *off_out, size_t len, unsigned int flags)
+{
+ return syscall(__NR_copy_file_range, fd_in, off_in, fd_out,
+ off_out, len, flags);
+}
+
+int main(int argc, char **argv)
+{
+ int fd_in, fd_out;
+ struct stat stat;
+ loff_t len, ret;
+ char buf[2];
+
+ if (argc != 3) {
+ fprintf(stderr, "Usage: %s <source> <destination>\\n", argv[0]);
+ exit(EXIT_FAILURE);
+ }
+
+ fd_in = open(argv[1], O_RDONLY);
+ if (fd_in == \-1) {
+ perror("open (argv[1])");
+ exit(EXIT_FAILURE);
+ }
+
+ if (fstat(fd_in, &stat) == \-1) {
+ perror("fstat");
+ exit(EXIT_FAILURE);
+ }
+ len = stat.st_size;
+
+ fd_out = open(argv[2], O_CREAT|O_WRONLY|O_TRUNC, 0644);
+ if (fd_out == \-1) {
+ perror("open (argv[2])");
+ exit(EXIT_FAILURE);
+ }
+
+ do {
+ ret = copy_file_range(fd_in, NULL, fd_out, NULL,
+ len, COPY_FR_COPY);
+ if (ret == \-1) {
+ perror("copy_file_range");
+ exit(EXIT_FAILURE);
+ }
+
+ len \-= ret;
+ } while (len > 0);
+
+ close(fd_in);
+ close(fd_out);
+ exit(EXIT_SUCCESS);
+}
+.fi
+.SH SEE ALSO
+.BR splice (2)
diff --git a/man2/splice.2 b/man2/splice.2
index b9b4f42..5c162e0 100644
--- a/man2/splice.2
+++ b/man2/splice.2
@@ -238,6 +238,7 @@ only pointers are copied, not the pages of the buffer.
See
.BR tee (2).
.SH SEE ALSO
+.BR copy_file_range (2),
.BR sendfile (2),
.BR tee (2),
.BR vmsplice (2)
--
2.5.3
--
To unsubscribe from this list: send the line "unsubscribe linux-nfs" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
next prev parent reply other threads:[~2015-09-30 17:26 UTC|newest]
Thread overview: 68+ messages / expand[flat|nested] mbox.gz Atom feed top
2015-09-30 17:26 [PATCH v5 0/9] VFS: In-kernel copy system call Anna Schumaker
2015-09-30 17:26 ` [PATCH v5 1/9] vfs: add copy_file_range syscall and vfs helper Anna Schumaker
2015-09-30 17:26 ` [PATCH v5 2/9] x86: add sys_copy_file_range to syscall tables Anna Schumaker
2015-09-30 17:26 ` [PATCH v5 3/9] btrfs: add .copy_file_range file operation Anna Schumaker
[not found] ` <1443634014-3026-1-git-send-email-Anna.Schumaker-ZwjVKphTwtPQT0dZR+AlfA@public.gmane.org>
2015-09-30 17:26 ` [PATCH v5 4/9] vfs: Copy should check len after file open mode Anna Schumaker
[not found] ` <1443634014-3026-5-git-send-email-Anna.Schumaker-ZwjVKphTwtPQT0dZR+AlfA@public.gmane.org>
2015-10-11 14:22 ` Christoph Hellwig
2015-09-30 17:26 ` [PATCH v5 8/9] vfs: Add vfs_copy_file_range() support for pagecache copies Anna Schumaker
2015-10-08 1:40 ` Neil Brown
2015-10-09 11:15 ` Pádraig Brady
[not found] ` <5617A1E9.1080509-V8g9lnOeT5ydJdNcDFJN0w@public.gmane.org>
2015-10-13 20:25 ` Anna Schumaker
[not found] ` <561D68B9.8030209-ZwjVKphTwtPQT0dZR+AlfA@public.gmane.org>
2015-10-14 7:41 ` Christoph Hellwig
[not found] ` <87vbai6sud.fsf-wvvUuzkyo1HefUI2i7LXDhCRmIWqnp/j@public.gmane.org>
2015-10-13 19:45 ` Anna Schumaker
[not found] ` <1443634014-3026-9-git-send-email-Anna.Schumaker-ZwjVKphTwtPQT0dZR+AlfA@public.gmane.org>
2015-10-11 14:22 ` Christoph Hellwig
[not found] ` <20151011142203.GA31867-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
2015-10-12 23:17 ` Darrick J. Wong
2015-10-13 3:36 ` Trond Myklebust
[not found] ` <CAHQdGtQoV0g1p2FYC1vFtFwh=jNq5n+AYOxAuSORVfbfhRY1Hg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2015-10-13 7:19 ` Darrick J. Wong
2015-10-13 7:30 ` Christoph Hellwig
[not found] ` <20151012231749.GC11398-PTl6brltDGh4DFYR7WNSRA@public.gmane.org>
2015-10-13 7:27 ` Christoph Hellwig
2015-11-10 6:24 ` Darrick J. Wong
2015-10-14 17:59 ` Anna Schumaker
2015-10-14 18:08 ` Andy Lutomirski
2015-10-14 18:27 ` Christoph Hellwig
[not found] ` <20151014182701.GC31225-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
2015-10-14 18:38 ` Andy Lutomirski
[not found] ` <CALCETrWrHs6x+aZ7c=sySRCdzwdfUQZH_DL++vLL78NXXN+7FQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2015-10-14 18:49 ` Christoph Hellwig
2015-10-14 18:53 ` Andy Lutomirski
[not found] ` <CALCETrV2ZG=EV5KLEeOERSbDjXCyaULAn0k34msSPFWvf0Tm9w-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2015-10-14 19:14 ` Austin S Hemmelgarn
2015-10-14 19:39 ` Pádraig Brady
2015-10-15 5:56 ` Christoph Hellwig
2015-10-14 19:08 ` Austin S Hemmelgarn
[not found] ` <561EA83E.8080000-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
2015-10-15 6:36 ` Christoph Hellwig
[not found] ` <20151015063621.GA3025-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
2015-10-15 12:24 ` Austin S Hemmelgarn
[not found] ` <561F9B13.7020804-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
2015-10-16 5:38 ` Christoph Hellwig
2015-10-16 11:46 ` Austin S Hemmelgarn
2015-10-16 12:02 ` Pádraig Brady
[not found] ` <5620E74F.50006-V8g9lnOeT5ydJdNcDFJN0w@public.gmane.org>
2015-10-16 12:24 ` Christoph Hellwig
[not found] ` <20151016122453.GB5889-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
2015-10-16 12:46 ` Austin S Hemmelgarn
[not found] ` <5620E3A1.90408-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
2015-10-16 12:21 ` Christoph Hellwig
2015-10-16 12:50 ` Austin S Hemmelgarn
2015-10-16 13:12 ` Christoph Hellwig
2015-10-16 14:11 ` Austin S Hemmelgarn
[not found] ` <561E980C.9010509-ZwjVKphTwtPQT0dZR+AlfA@public.gmane.org>
2015-10-14 18:11 ` Darrick J. Wong
2015-10-14 18:26 ` Andy Lutomirski
2015-09-30 17:26 ` Anna Schumaker [this message]
2015-09-30 17:26 ` [PATCH v5 5/9] vfs: Copy shouldn't forbid ranges inside the same file Anna Schumaker
2015-10-11 14:22 ` Christoph Hellwig
[not found] ` <20151011142233.GC31867-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
2015-10-14 17:37 ` Anna Schumaker
2015-10-14 18:25 ` Christoph Hellwig
[not found] ` <20151014182523.GA31225-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
2015-10-14 18:27 ` Anna Schumaker
2015-09-30 17:26 ` [PATCH v5 6/9] vfs: Copy should use file_out rather than file_in Anna Schumaker
2015-10-11 14:24 ` Christoph Hellwig
2015-09-30 17:26 ` [PATCH v5 7/9] vfs: Remove copy_file_range mountpoint checks Anna Schumaker
2015-10-11 14:23 ` Christoph Hellwig
2015-10-14 17:41 ` Anna Schumaker
[not found] ` <561E93C3.2090507-ZwjVKphTwtPQT0dZR+AlfA@public.gmane.org>
2015-10-14 18:25 ` Christoph Hellwig
2015-09-30 17:26 ` [PATCH v5 9/9] btrfs: btrfs_copy_file_range() only supports reflinks Anna Schumaker
[not found] ` <1443634014-3026-10-git-send-email-Anna.Schumaker-ZwjVKphTwtPQT0dZR+AlfA@public.gmane.org>
2015-10-11 14:29 ` Christoph Hellwig
[not found] ` <20151011142939.GA30905-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
2015-10-12 10:23 ` Pádraig Brady
2015-10-12 14:34 ` Christoph Hellwig
[not found] ` <20151012143444.GA10156-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
2015-10-12 23:41 ` Darrick J. Wong
[not found] ` <20151012234106.GD11398-PTl6brltDGh4DFYR7WNSRA@public.gmane.org>
2015-10-13 7:29 ` Christoph Hellwig
[not found] ` <20151013072959.GB10794-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
2015-10-14 18:46 ` Darrick J. Wong
2015-10-15 6:00 ` Christoph Hellwig
[not found] ` <20151015060045.GA23996-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
2015-10-16 11:49 ` Chris Mason
[not found] ` <20151016114919.GB6874-DzB2rL6jT1BHfPKRx072akEOCMrvLtNR@public.gmane.org>
2015-10-16 12:25 ` Christoph Hellwig
[not found] ` <20151016122544.GC5889-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
2015-10-16 13:19 ` Chris Mason
2015-10-16 21:44 ` Dave Chinner
2015-10-17 13:44 ` Chris Mason
[not found] ` <20151014184608.GK850-PTl6brltDGh4DFYR7WNSRA@public.gmane.org>
2015-10-15 8:35 ` Dave Chinner
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1443634014-3026-11-git-send-email-Anna.Schumaker@Netapp.com \
--to=anna.schumaker-hgovqubeegtqt0dzr+alfa@public.gmane.org \
--cc=andros-HgOvQuBEEgTQT0dZR+AlfA@public.gmane.org \
--cc=clm-b10kYP2dOMg@public.gmane.org \
--cc=darrick.wong-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org \
--cc=hch-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org \
--cc=linux-api-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
--cc=linux-btrfs-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
--cc=linux-fsdevel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
--cc=linux-nfs-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
--cc=mtk.manpages-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org \
--cc=viro-RmSDqhL/yNMiFSDQTTA3OLVCufUGDwFn@public.gmane.org \
--cc=zab-ugsP4Wv/S6ZeoWH0uzbU5w@public.gmane.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).