From: "Kirill A. Shutemov" <kirill@shutemov.name>
To: Dave Chinner <david@fromorbit.com>
Cc: linux-fsdevel@vger.kernel.org, linux-mm@kvack.org
Subject: Re: How can we share page cache pages for reflinked files?
Date: Thu, 10 Aug 2017 08:57:37 +0300 [thread overview]
Message-ID: <20170810055737.v6yexikxa5zxvntv@node.shutemov.name> (raw)
In-Reply-To: <20170810042849.GK21024@dastard>
On Thu, Aug 10, 2017 at 02:28:49PM +1000, Dave Chinner wrote:
> Hi folks,
>
> I've recently been looking into what is involved in sharing page
> cache pages for shared extents in a filesystem. That is, create a
> file, reflink it so there's two files but only one copy of the data
> on disk, then read both files. Right now, we get two copies of the
> data in the page cache - one in each inode mapping tree.
>
> If we scale this up to a container host which is using reflink trees
> it's shared root images, there might be hundreds of copies of the
> same data held in cache (i.e. one page per container). Given that
> the filesystem knows that the underlying data extent is shared when
> we go to read it, it's relatively easy to add mechanisms to the
> filesystem to return the same page for all attempts to read the
> from a shared extent from all inodes that share it.
>
> However, the problem I'm getting stuck on is that the page cache
> itself can't handle inserting a single page into multiple page cache
> mapping trees. i.e. The page has a single pointer to the mapping
> address space, and the mapping has a single pointer back to the
> owner inode. As such, a cached page has a 1:1 mapping to it's host
> inode and this structure seems to be assumed rather widely through
> the code.
I think to solve the problem with page->mapping we need something similar
to what we have for anon rmap[1]. In this case we would be able to keep
the same page in page cache for multiple inodes.
The long term benefit for this is that we might be able to unify a lot of
code for anon and file code paths in mm, making anon memory a special case
of file mapping.
The downside is that anon rmap is rather complicated. I have to re-read
the article everytime I deal with anon rmap to remind myself how it works.
[1] https://lwn.net/Articles/383162/
--
Kirill A. Shutemov
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
next prev parent reply other threads:[~2017-08-10 5:57 UTC|newest]
Thread overview: 16+ messages / expand[flat|nested] mbox.gz Atom feed top
2017-08-10 4:28 How can we share page cache pages for reflinked files? Dave Chinner
2017-08-10 5:57 ` Kirill A. Shutemov [this message]
2017-08-10 9:01 ` Dave Chinner
2017-08-10 13:31 ` Kirill A. Shutemov
2017-08-11 3:59 ` Dave Chinner
2017-08-11 12:57 ` Kirill A. Shutemov
2017-08-10 16:11 ` Matthew Wilcox
2017-08-10 19:17 ` Vivek Goyal
2017-08-10 21:20 ` Matthew Wilcox
2017-08-11 4:25 ` Dave Chinner
2017-08-11 17:08 ` Matthew Wilcox
2017-08-11 18:04 ` Christoph Hellwig
2017-08-14 6:48 ` Dave Chinner
2017-08-14 18:14 ` Christopher Lameter
2017-08-14 21:09 ` Kirill A. Shutemov
2017-08-15 15:11 ` Christopher Lameter
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20170810055737.v6yexikxa5zxvntv@node.shutemov.name \
--to=kirill@shutemov.name \
--cc=david@fromorbit.com \
--cc=linux-fsdevel@vger.kernel.org \
--cc=linux-mm@kvack.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).