From: Christoph Hellwig <hch-jcswGhMUV9g@public.gmane.org>
To: Dan Williams <dan.j.williams-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org>
Cc: Jan Kara <jack-AlSwsSmVLrQ@public.gmane.org>,
"linux-nvdimm-hn68Rpc1hR1g9hUCZPvPmw@public.gmane.org"
<linux-nvdimm-hn68Rpc1hR1g9hUCZPvPmw@public.gmane.org>,
Linux API <linux-api-u79uwXL29TY76Z2rM5mHXA@public.gmane.org>,
"Darrick J. Wong"
<darrick.wong-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>,
Dave Chinner <david-FqsqvQoI3Ljby3iVrkZq2A@public.gmane.org>,
"linux-kernel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org"
<linux-kernel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org>,
linux-xfs-u79uwXL29TY76Z2rM5mHXA@public.gmane.org,
Alexander Viro
<viro-RmSDqhL/yNMiFSDQTTA3OLVCufUGDwFn@public.gmane.org>,
Andy Lutomirski <luto-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org>,
linux-fsdevel
<linux-fsdevel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org>,
Christoph Hellwig <hch-jcswGhMUV9g@public.gmane.org>
Subject: Re: [PATCH v2 0/5] fs, xfs: block map immutable files for dax, dma-to-storage, and swap
Date: Fri, 11 Aug 2017 12:44:29 +0200 [thread overview]
Message-ID: <20170811104429.GA13736@lst.de> (raw)
In-Reply-To: <CAPcyv4jgKmakB0WRUjx=2eD3YJ1x+C8cgnR6tA+g4+m+0etawQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
On Sun, Aug 06, 2017 at 11:51:50AM -0700, Dan Williams wrote:
> Of course it's a useful API. An application already needs to worry
> about the block map, that's why we have fallocate, msync, fiemap
> and...
Fallocate and msync do not expose the block map in any way. Proof:
they work just fine over say nfs.
fiemap does indeed expose the block map, which is the whole point.
But it's a debug tool that we don't event have a man page for. And
it's not usable for anything else, if only for the fact that it doesn't
tell you what device your returned extents are relative to.
> > We've been through this a few times but let me repeat it: The only
> > sensible API gurantee is one that is observable and usable.
>
> I'm missing how block-map immutable files violate this observable and
> usable constraint?
What is the observable behavior of an extent map change? How can you
describe your immutable extent map behavior so that when I violate
them by e.g. moving one extent to a different place on disk you can
observe that in userspace?
> This immutable approach should also go in, it solves the same problem
> without the the latency drawback,
How is your latency going to be any different from MAP_SYNC on
a fully allocated and pre-zeroed file?
> Beyond flush from userspace it also
> can be used to solve the swapfile problems you highlighted
Which swapfile problem?
> and it
> allows safe ongoing dma to a filesystem-dax mapping beyond what we can
> already do with direct-I/O.
Please explain how this interface allows for any sort of safe userspace
DMA.
WARNING: multiple messages have this Message-ID (diff)
From: Christoph Hellwig <hch@lst.de>
To: Dan Williams <dan.j.williams@intel.com>
Cc: Jan Kara <jack@suse.cz>,
"linux-nvdimm@lists.01.org" <linux-nvdimm@lists.01.org>,
Linux API <linux-api@vger.kernel.org>,
"Darrick J. Wong" <darrick.wong@oracle.com>,
Dave Chinner <david@fromorbit.com>,
"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
linux-xfs@vger.kernel.org,
Alexander Viro <viro@zeniv.linux.org.uk>,
Andy Lutomirski <luto@kernel.org>,
linux-fsdevel <linux-fsdevel@vger.kernel.org>,
Christoph Hellwig <hch@lst.de>
Subject: Re: [PATCH v2 0/5] fs, xfs: block map immutable files for dax, dma-to-storage, and swap
Date: Fri, 11 Aug 2017 12:44:29 +0200 [thread overview]
Message-ID: <20170811104429.GA13736@lst.de> (raw)
In-Reply-To: <CAPcyv4jgKmakB0WRUjx=2eD3YJ1x+C8cgnR6tA+g4+m+0etawQ@mail.gmail.com>
On Sun, Aug 06, 2017 at 11:51:50AM -0700, Dan Williams wrote:
> Of course it's a useful API. An application already needs to worry
> about the block map, that's why we have fallocate, msync, fiemap
> and...
Fallocate and msync do not expose the block map in any way. Proof:
they work just fine over say nfs.
fiemap does indeed expose the block map, which is the whole point.
But it's a debug tool that we don't event have a man page for. And
it's not usable for anything else, if only for the fact that it doesn't
tell you what device your returned extents are relative to.
> > We've been through this a few times but let me repeat it: The only
> > sensible API gurantee is one that is observable and usable.
>
> I'm missing how block-map immutable files violate this observable and
> usable constraint?
What is the observable behavior of an extent map change? How can you
describe your immutable extent map behavior so that when I violate
them by e.g. moving one extent to a different place on disk you can
observe that in userspace?
> This immutable approach should also go in, it solves the same problem
> without the the latency drawback,
How is your latency going to be any different from MAP_SYNC on
a fully allocated and pre-zeroed file?
> Beyond flush from userspace it also
> can be used to solve the swapfile problems you highlighted
Which swapfile problem?
> and it
> allows safe ongoing dma to a filesystem-dax mapping beyond what we can
> already do with direct-I/O.
Please explain how this interface allows for any sort of safe userspace
DMA.
_______________________________________________
Linux-nvdimm mailing list
Linux-nvdimm@lists.01.org
https://lists.01.org/mailman/listinfo/linux-nvdimm
WARNING: multiple messages have this Message-ID (diff)
From: Christoph Hellwig <hch@lst.de>
To: Dan Williams <dan.j.williams@intel.com>
Cc: Christoph Hellwig <hch@lst.de>,
"Darrick J. Wong" <darrick.wong@oracle.com>,
Jan Kara <jack@suse.cz>,
"linux-nvdimm@lists.01.org" <linux-nvdimm@lists.01.org>,
Dave Chinner <david@fromorbit.com>,
"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
linux-xfs@vger.kernel.org, Jeff Moyer <jmoyer@redhat.com>,
Alexander Viro <viro@zeniv.linux.org.uk>,
Andy Lutomirski <luto@kernel.org>,
linux-fsdevel <linux-fsdevel@vger.kernel.org>,
Ross Zwisler <ross.zwisler@linux.intel.com>,
Linux API <linux-api@vger.kernel.org>
Subject: Re: [PATCH v2 0/5] fs, xfs: block map immutable files for dax, dma-to-storage, and swap
Date: Fri, 11 Aug 2017 12:44:29 +0200 [thread overview]
Message-ID: <20170811104429.GA13736@lst.de> (raw)
In-Reply-To: <CAPcyv4jgKmakB0WRUjx=2eD3YJ1x+C8cgnR6tA+g4+m+0etawQ@mail.gmail.com>
On Sun, Aug 06, 2017 at 11:51:50AM -0700, Dan Williams wrote:
> Of course it's a useful API. An application already needs to worry
> about the block map, that's why we have fallocate, msync, fiemap
> and...
Fallocate and msync do not expose the block map in any way. Proof:
they work just fine over say nfs.
fiemap does indeed expose the block map, which is the whole point.
But it's a debug tool that we don't event have a man page for. And
it's not usable for anything else, if only for the fact that it doesn't
tell you what device your returned extents are relative to.
> > We've been through this a few times but let me repeat it: The only
> > sensible API gurantee is one that is observable and usable.
>
> I'm missing how block-map immutable files violate this observable and
> usable constraint?
What is the observable behavior of an extent map change? How can you
describe your immutable extent map behavior so that when I violate
them by e.g. moving one extent to a different place on disk you can
observe that in userspace?
> This immutable approach should also go in, it solves the same problem
> without the the latency drawback,
How is your latency going to be any different from MAP_SYNC on
a fully allocated and pre-zeroed file?
> Beyond flush from userspace it also
> can be used to solve the swapfile problems you highlighted
Which swapfile problem?
> and it
> allows safe ongoing dma to a filesystem-dax mapping beyond what we can
> already do with direct-I/O.
Please explain how this interface allows for any sort of safe userspace
DMA.
next prev parent reply other threads:[~2017-08-11 10:44 UTC|newest]
Thread overview: 108+ messages / expand[flat|nested] mbox.gz Atom feed top
2017-08-04 2:28 [PATCH v2 0/5] fs, xfs: block map immutable files for dax, dma-to-storage, and swap Dan Williams
2017-08-04 2:28 ` Dan Williams
2017-08-04 2:28 ` [PATCH v2 1/5] fs, xfs: introduce S_IOMAP_IMMUTABLE Dan Williams
2017-08-04 2:28 ` Dan Williams
2017-08-04 20:00 ` Darrick J. Wong
2017-08-04 20:00 ` Darrick J. Wong
2017-08-04 20:31 ` Dan Williams
2017-08-04 20:31 ` Dan Williams
2017-08-05 9:47 ` Christoph Hellwig
2017-08-05 9:47 ` Christoph Hellwig
2017-08-07 0:25 ` Dave Chinner
2017-08-07 0:25 ` Dave Chinner
2017-08-11 10:34 ` Christoph Hellwig
2017-08-11 10:34 ` Christoph Hellwig
2017-08-04 2:28 ` [PATCH v2 2/5] fs, xfs: introduce FALLOC_FL_SEAL_BLOCK_MAP Dan Williams
2017-08-04 2:28 ` Dan Williams
2017-08-04 2:28 ` Dan Williams
2017-08-04 19:46 ` Darrick J. Wong
2017-08-04 19:46 ` Darrick J. Wong
2017-08-04 19:52 ` Dan Williams
2017-08-04 19:52 ` Dan Williams
2017-08-04 23:31 ` Dave Chinner
2017-08-04 23:31 ` Dave Chinner
2017-08-04 23:43 ` Dan Williams
2017-08-04 23:43 ` Dan Williams
2017-08-05 0:04 ` Dave Chinner
2017-08-05 0:04 ` Dave Chinner
2017-08-04 2:28 ` [PATCH v2 3/5] fs, xfs: introduce FALLOC_FL_UNSEAL_BLOCK_MAP Dan Williams
2017-08-04 2:28 ` Dan Williams
2017-08-04 20:04 ` Darrick J. Wong
2017-08-04 20:04 ` Darrick J. Wong
2017-08-04 20:36 ` Dan Williams
2017-08-04 20:36 ` Dan Williams
2017-08-04 2:28 ` [PATCH v2 4/5] xfs: introduce XFS_DIFLAG2_IOMAP_IMMUTABLE Dan Williams
2017-08-04 2:28 ` Dan Williams
2017-08-04 20:33 ` Darrick J. Wong
2017-08-04 20:33 ` Darrick J. Wong
2017-08-04 20:45 ` Dan Williams
2017-08-04 20:45 ` Dan Williams
2017-08-04 23:46 ` Dave Chinner
2017-08-04 23:46 ` Dave Chinner
2017-08-04 23:57 ` Darrick J. Wong
2017-08-04 23:57 ` Darrick J. Wong
2017-08-04 2:28 ` [PATCH v2 5/5] xfs: toggle XFS_DIFLAG2_IOMAP_IMMUTABLE in response to fallocate Dan Williams
2017-08-04 2:28 ` Dan Williams
2017-08-04 20:14 ` Darrick J. Wong
2017-08-04 20:14 ` Darrick J. Wong
2017-08-04 20:47 ` Dan Williams
2017-08-04 20:47 ` Dan Williams
2017-08-04 20:53 ` Darrick J. Wong
2017-08-04 20:53 ` Darrick J. Wong
2017-08-04 20:55 ` Dan Williams
2017-08-04 20:55 ` Dan Williams
[not found] ` <150181368442.32119.13336247800141074356.stgit-p8uTFz9XbKj2zm6wflaqv1nYeNYlB/vhral2JQCrhuEAvxtiuMwx3w@public.gmane.org>
2017-08-04 2:38 ` [PATCH v2 0/5] fs, xfs: block map immutable files for dax, dma-to-storage, and swap Dan Williams
2017-08-04 2:38 ` Dan Williams
2017-08-04 2:38 ` Dan Williams
[not found] ` <CAPcyv4ii41F-Rj9pPGc0FHwrQ=hkSF_f0niQDn5_NjU-wcL+gg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2017-08-05 9:50 ` Christoph Hellwig
2017-08-05 9:50 ` Christoph Hellwig
2017-08-05 9:50 ` Christoph Hellwig
[not found] ` <20170805095013.GC14930-jcswGhMUV9g@public.gmane.org>
2017-08-06 18:51 ` Dan Williams
2017-08-06 18:51 ` Dan Williams
2017-08-06 18:51 ` Dan Williams
[not found] ` <CAPcyv4jgKmakB0WRUjx=2eD3YJ1x+C8cgnR6tA+g4+m+0etawQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2017-08-11 10:44 ` Christoph Hellwig [this message]
2017-08-11 10:44 ` Christoph Hellwig
2017-08-11 10:44 ` Christoph Hellwig
[not found] ` <20170811104429.GA13736-jcswGhMUV9g@public.gmane.org>
2017-08-11 22:26 ` Dan Williams
2017-08-11 22:26 ` Dan Williams
2017-08-11 22:26 ` Dan Williams
2017-08-12 3:57 ` Andy Lutomirski
2017-08-12 3:57 ` Andy Lutomirski
[not found] ` <CALCETrVvMbaxobdydtsdQWHyP1VhL1fpq1qS4M3=SmR1y4x5kw-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2017-08-12 4:44 ` Dan Williams
2017-08-12 4:44 ` Dan Williams
2017-08-12 4:44 ` Dan Williams
2017-08-12 7:34 ` Christoph Hellwig
2017-08-12 7:34 ` Christoph Hellwig
2017-08-12 7:34 ` Christoph Hellwig
[not found] ` <CAPcyv4jrZ5a+zmAehZDxfP=+6BNCFAXOFWro2L7ruLkk+cY7OQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2017-08-12 7:33 ` Christoph Hellwig
2017-08-12 7:33 ` Christoph Hellwig
2017-08-12 7:33 ` Christoph Hellwig
[not found] ` <20170812073349.GA12679-jcswGhMUV9g@public.gmane.org>
2017-08-12 19:19 ` Dan Williams
2017-08-12 19:19 ` Dan Williams
2017-08-12 19:19 ` Dan Williams
2017-08-13 9:24 ` Christoph Hellwig
2017-08-13 9:24 ` Christoph Hellwig
[not found] ` <20170813092436.GB32112-jcswGhMUV9g@public.gmane.org>
2017-08-13 20:31 ` Dan Williams
2017-08-13 20:31 ` Dan Williams
2017-08-13 20:31 ` Dan Williams
[not found] ` <CAPcyv4ixTgSWG9K2Eg3XJmOvqJht81qL+Z3njoOjcXCD7XMpZw-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2017-08-14 12:40 ` Jan Kara
2017-08-14 12:40 ` Jan Kara
2017-08-14 12:40 ` Jan Kara
2017-08-14 16:14 ` Dan Williams
2017-08-14 16:14 ` Dan Williams
[not found] ` <CAPcyv4hi_Y5Qj=h_Qf4Bcyv+EWBosa2gQT+-8ro3hPY9VMshSA-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2017-08-15 8:37 ` Jan Kara
2017-08-15 8:37 ` Jan Kara
2017-08-15 8:37 ` Jan Kara
2017-08-15 23:50 ` Dan Williams
2017-08-15 23:50 ` Dan Williams
[not found] ` <CAPcyv4hFTn4Fz5o+Gm857mS-RA6WAVsf4CmwiLiK2O8w2_SamQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2017-08-16 13:57 ` Jan Kara
2017-08-16 13:57 ` Jan Kara
2017-08-16 13:57 ` Jan Kara
[not found] ` <20170814124059.GC17820-4I4JzKEfoa/jFM9bn6wA6Q@public.gmane.org>
2017-08-21 9:16 ` Peter Zijlstra
2017-08-21 9:16 ` Peter Zijlstra
2017-08-21 9:16 ` Peter Zijlstra
2017-08-14 21:46 ` Darrick J. Wong
2017-08-14 21:46 ` Darrick J. Wong
2017-08-14 21:46 ` Darrick J. Wong
2017-08-13 23:46 ` Dave Chinner
2017-08-13 23:46 ` Dave Chinner
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20170811104429.GA13736@lst.de \
--to=hch-jcswghmuv9g@public.gmane.org \
--cc=dan.j.williams-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org \
--cc=darrick.wong-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org \
--cc=david-FqsqvQoI3Ljby3iVrkZq2A@public.gmane.org \
--cc=jack-AlSwsSmVLrQ@public.gmane.org \
--cc=linux-api-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
--cc=linux-fsdevel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
--cc=linux-kernel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
--cc=linux-nvdimm-hn68Rpc1hR1g9hUCZPvPmw@public.gmane.org \
--cc=linux-xfs-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
--cc=luto-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org \
--cc=viro-RmSDqhL/yNMiFSDQTTA3OLVCufUGDwFn@public.gmane.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.