From: Gao Xiang <xiang@kernel.org>
To: Jeffle Xu <jefflexu@linux.alibaba.com>
Cc: tianzichen@kuaishou.com, linux-erofs@lists.ozlabs.org,
fannaihao@baidu.com, willy@infradead.org,
linux-kernel@vger.kernel.org, dhowells@redhat.com,
joseph.qi@linux.alibaba.com, linux-cachefs@redhat.com,
gregkh@linuxfoundation.org, linux-fsdevel@vger.kernel.org,
luodaowen.backend@bytedance.com, gerry@linux.alibaba.com,
torvalds@linux-foundation.org
Subject: Re: [PATCH v8 16/20] erofs: implement fscache-based metadata read
Date: Thu, 7 Apr 2022 22:19:28 +0800 [thread overview]
Message-ID: <Yk7y8FuBosbtAY3l@debian> (raw)
In-Reply-To: <20220406075612.60298-17-jefflexu@linux.alibaba.com>
On Wed, Apr 06, 2022 at 03:56:08PM +0800, Jeffle Xu wrote:
> Implement the data plane of reading metadata from primary data blob
> over fscache.
>
> Signed-off-by: Jeffle Xu <jefflexu@linux.alibaba.com>
> ---
> fs/erofs/data.c | 20 ++++++++++++++++++--
> fs/erofs/fscache.c | 38 ++++++++++++++++++++++++++++++++++++++
> fs/erofs/internal.h | 9 +++++++++
> 3 files changed, 65 insertions(+), 2 deletions(-)
>
> diff --git a/fs/erofs/data.c b/fs/erofs/data.c
> index 14b64d960541..cb8fe299ad67 100644
> --- a/fs/erofs/data.c
> +++ b/fs/erofs/data.c
> @@ -31,15 +31,26 @@ void erofs_put_metabuf(struct erofs_buf *buf)
> void *erofs_bread(struct erofs_buf *buf, struct inode *inode,
> erofs_blk_t blkaddr, enum erofs_kmap_type type)
> {
> - struct address_space *const mapping = inode->i_mapping;
> erofs_off_t offset = blknr_to_addr(blkaddr);
> pgoff_t index = offset >> PAGE_SHIFT;
> struct page *page = buf->page;
>
> if (!page || page->index != index) {
> erofs_put_metabuf(buf);
> - page = read_cache_page_gfp(mapping, index,
> + if (buf->sb) {
> + struct folio *folio;
> +
> + folio = erofs_fscache_get_folio(buf->sb, index);
> + if (IS_ERR(folio))
> + page = ERR_CAST(folio);
> + else
> + page = folio_page(folio, 0);
> + } else {
> + struct address_space *const mapping = inode->i_mapping;
> +
> + page = read_cache_page_gfp(mapping, index,
> mapping_gfp_constraint(mapping, ~__GFP_FS));
> + }
> if (IS_ERR(page))
> return page;
> /* should already be PageUptodate, no need to lock page */
> @@ -63,6 +74,11 @@ void *erofs_bread(struct erofs_buf *buf, struct inode *inode,
> void *erofs_read_metabuf(struct erofs_buf *buf, struct super_block *sb,
> erofs_blk_t blkaddr, enum erofs_kmap_type type)
> {
> + if (erofs_is_fscache_mode(sb)) {
> + buf->sb = sb;
> + return erofs_bread(buf, NULL, blkaddr, type);
> + }
> +
> return erofs_bread(buf, sb->s_bdev->bd_inode, blkaddr, type);
> }
>
> diff --git a/fs/erofs/fscache.c b/fs/erofs/fscache.c
> index d38a6efc8e50..158cc273f8fb 100644
> --- a/fs/erofs/fscache.c
> +++ b/fs/erofs/fscache.c
> @@ -34,9 +34,47 @@ static int erofs_fscache_read_folios(struct fscache_cookie *cookie,
> return ret;
> }
>
> +static int erofs_fscache_meta_readpage(struct file *data, struct page *page)
> +{
> + int ret;
> + struct super_block *sb = (struct super_block *)data;
> + struct folio *folio = page_folio(page);
> + struct erofs_map_dev mdev = {
> + .m_deviceid = 0,
> + .m_pa = folio_pos(folio),
> + };
> +
> + ret = erofs_map_dev(sb, &mdev);
> + if (ret)
> + goto out;
> +
> + ret = erofs_fscache_read_folios(mdev.m_fscache->cookie,
> + folio_file_mapping(folio), folio_pos(folio),
> + folio_size(folio), mdev.m_pa);
> + if (ret)
> + goto out;
> +
> + folio_mark_uptodate(folio);
> +out:
> + folio_unlock(folio);
> + return ret;
> +}
> +
> static const struct address_space_operations erofs_fscache_meta_aops = {
> + .readpage = erofs_fscache_meta_readpage,
> };
>
> +/*
> + * Get the page cache of data blob at the index offset.
> + * Return: up to date page on success, ERR_PTR() on failure.
> + */
Unnecessary comment and even unnecessary helper.
Thanks,
Gao Xiang
> +struct folio *erofs_fscache_get_folio(struct super_block *sb, pgoff_t index)
> +{
> + struct erofs_fscache *ctx = EROFS_SB(sb)->s_fscache;
> +
> + return read_mapping_folio(ctx->inode->i_mapping, index, (void *)sb);
> +}
> +
> /*
> * Create an fscache context for data blob.
> * Return: 0 on success and allocated fscache context is assigned to @fscache,
> diff --git a/fs/erofs/internal.h b/fs/erofs/internal.h
> index 90f7d6286a4f..e186051f0640 100644
> --- a/fs/erofs/internal.h
> +++ b/fs/erofs/internal.h
> @@ -276,6 +276,7 @@ enum erofs_kmap_type {
> };
>
> struct erofs_buf {
> + struct super_block *sb;
> struct page *page;
> void *base;
> enum erofs_kmap_type kmap_type;
> @@ -639,6 +640,8 @@ int erofs_fscache_register_cookie(struct super_block *sb,
> struct erofs_fscache **fscache,
> char *name, bool need_inode);
> void erofs_fscache_unregister_cookie(struct erofs_fscache **fscache);
> +
> +struct folio *erofs_fscache_get_folio(struct super_block *sb, pgoff_t index);
> #else
> static inline int erofs_fscache_register_fs(struct super_block *sb) { return 0; }
> static inline void erofs_fscache_unregister_fs(struct super_block *sb) {}
> @@ -653,6 +656,12 @@ static inline int erofs_fscache_register_cookie(struct super_block *sb,
> static inline void erofs_fscache_unregister_cookie(struct erofs_fscache **fscache)
> {
> }
> +
> +static inline struct folio *erofs_fscache_get_folio(struct super_block *sb,
> + pgoff_t index)
> +{
> + return ERR_PTR(-EOPNOTSUPP);
> +}
> #endif
>
> #define EFSCORRUPTED EUCLEAN /* Filesystem is corrupted */
> --
> 2.27.0
>
WARNING: multiple messages have this Message-ID (diff)
From: Gao Xiang <xiang@kernel.org>
To: Jeffle Xu <jefflexu@linux.alibaba.com>
Cc: dhowells@redhat.com, linux-cachefs@redhat.com, xiang@kernel.org,
chao@kernel.org, linux-erofs@lists.ozlabs.org,
torvalds@linux-foundation.org, gregkh@linuxfoundation.org,
willy@infradead.org, linux-fsdevel@vger.kernel.org,
joseph.qi@linux.alibaba.com, bo.liu@linux.alibaba.com,
tao.peng@linux.alibaba.com, gerry@linux.alibaba.com,
eguan@linux.alibaba.com, linux-kernel@vger.kernel.org,
luodaowen.backend@bytedance.com, tianzichen@kuaishou.com,
fannaihao@baidu.com
Subject: Re: [PATCH v8 16/20] erofs: implement fscache-based metadata read
Date: Thu, 7 Apr 2022 22:19:28 +0800 [thread overview]
Message-ID: <Yk7y8FuBosbtAY3l@debian> (raw)
In-Reply-To: <20220406075612.60298-17-jefflexu@linux.alibaba.com>
On Wed, Apr 06, 2022 at 03:56:08PM +0800, Jeffle Xu wrote:
> Implement the data plane of reading metadata from primary data blob
> over fscache.
>
> Signed-off-by: Jeffle Xu <jefflexu@linux.alibaba.com>
> ---
> fs/erofs/data.c | 20 ++++++++++++++++++--
> fs/erofs/fscache.c | 38 ++++++++++++++++++++++++++++++++++++++
> fs/erofs/internal.h | 9 +++++++++
> 3 files changed, 65 insertions(+), 2 deletions(-)
>
> diff --git a/fs/erofs/data.c b/fs/erofs/data.c
> index 14b64d960541..cb8fe299ad67 100644
> --- a/fs/erofs/data.c
> +++ b/fs/erofs/data.c
> @@ -31,15 +31,26 @@ void erofs_put_metabuf(struct erofs_buf *buf)
> void *erofs_bread(struct erofs_buf *buf, struct inode *inode,
> erofs_blk_t blkaddr, enum erofs_kmap_type type)
> {
> - struct address_space *const mapping = inode->i_mapping;
> erofs_off_t offset = blknr_to_addr(blkaddr);
> pgoff_t index = offset >> PAGE_SHIFT;
> struct page *page = buf->page;
>
> if (!page || page->index != index) {
> erofs_put_metabuf(buf);
> - page = read_cache_page_gfp(mapping, index,
> + if (buf->sb) {
> + struct folio *folio;
> +
> + folio = erofs_fscache_get_folio(buf->sb, index);
> + if (IS_ERR(folio))
> + page = ERR_CAST(folio);
> + else
> + page = folio_page(folio, 0);
> + } else {
> + struct address_space *const mapping = inode->i_mapping;
> +
> + page = read_cache_page_gfp(mapping, index,
> mapping_gfp_constraint(mapping, ~__GFP_FS));
> + }
> if (IS_ERR(page))
> return page;
> /* should already be PageUptodate, no need to lock page */
> @@ -63,6 +74,11 @@ void *erofs_bread(struct erofs_buf *buf, struct inode *inode,
> void *erofs_read_metabuf(struct erofs_buf *buf, struct super_block *sb,
> erofs_blk_t blkaddr, enum erofs_kmap_type type)
> {
> + if (erofs_is_fscache_mode(sb)) {
> + buf->sb = sb;
> + return erofs_bread(buf, NULL, blkaddr, type);
> + }
> +
> return erofs_bread(buf, sb->s_bdev->bd_inode, blkaddr, type);
> }
>
> diff --git a/fs/erofs/fscache.c b/fs/erofs/fscache.c
> index d38a6efc8e50..158cc273f8fb 100644
> --- a/fs/erofs/fscache.c
> +++ b/fs/erofs/fscache.c
> @@ -34,9 +34,47 @@ static int erofs_fscache_read_folios(struct fscache_cookie *cookie,
> return ret;
> }
>
> +static int erofs_fscache_meta_readpage(struct file *data, struct page *page)
> +{
> + int ret;
> + struct super_block *sb = (struct super_block *)data;
> + struct folio *folio = page_folio(page);
> + struct erofs_map_dev mdev = {
> + .m_deviceid = 0,
> + .m_pa = folio_pos(folio),
> + };
> +
> + ret = erofs_map_dev(sb, &mdev);
> + if (ret)
> + goto out;
> +
> + ret = erofs_fscache_read_folios(mdev.m_fscache->cookie,
> + folio_file_mapping(folio), folio_pos(folio),
> + folio_size(folio), mdev.m_pa);
> + if (ret)
> + goto out;
> +
> + folio_mark_uptodate(folio);
> +out:
> + folio_unlock(folio);
> + return ret;
> +}
> +
> static const struct address_space_operations erofs_fscache_meta_aops = {
> + .readpage = erofs_fscache_meta_readpage,
> };
>
> +/*
> + * Get the page cache of data blob at the index offset.
> + * Return: up to date page on success, ERR_PTR() on failure.
> + */
Unnecessary comment and even unnecessary helper.
Thanks,
Gao Xiang
> +struct folio *erofs_fscache_get_folio(struct super_block *sb, pgoff_t index)
> +{
> + struct erofs_fscache *ctx = EROFS_SB(sb)->s_fscache;
> +
> + return read_mapping_folio(ctx->inode->i_mapping, index, (void *)sb);
> +}
> +
> /*
> * Create an fscache context for data blob.
> * Return: 0 on success and allocated fscache context is assigned to @fscache,
> diff --git a/fs/erofs/internal.h b/fs/erofs/internal.h
> index 90f7d6286a4f..e186051f0640 100644
> --- a/fs/erofs/internal.h
> +++ b/fs/erofs/internal.h
> @@ -276,6 +276,7 @@ enum erofs_kmap_type {
> };
>
> struct erofs_buf {
> + struct super_block *sb;
> struct page *page;
> void *base;
> enum erofs_kmap_type kmap_type;
> @@ -639,6 +640,8 @@ int erofs_fscache_register_cookie(struct super_block *sb,
> struct erofs_fscache **fscache,
> char *name, bool need_inode);
> void erofs_fscache_unregister_cookie(struct erofs_fscache **fscache);
> +
> +struct folio *erofs_fscache_get_folio(struct super_block *sb, pgoff_t index);
> #else
> static inline int erofs_fscache_register_fs(struct super_block *sb) { return 0; }
> static inline void erofs_fscache_unregister_fs(struct super_block *sb) {}
> @@ -653,6 +656,12 @@ static inline int erofs_fscache_register_cookie(struct super_block *sb,
> static inline void erofs_fscache_unregister_cookie(struct erofs_fscache **fscache)
> {
> }
> +
> +static inline struct folio *erofs_fscache_get_folio(struct super_block *sb,
> + pgoff_t index)
> +{
> + return ERR_PTR(-EOPNOTSUPP);
> +}
> #endif
>
> #define EFSCORRUPTED EUCLEAN /* Filesystem is corrupted */
> --
> 2.27.0
>
next prev parent reply other threads:[~2022-04-07 14:19 UTC|newest]
Thread overview: 110+ messages / expand[flat|nested] mbox.gz Atom feed top
2022-04-06 7:55 [PATCH v8 00/20] fscache, erofs: fscache-based on-demand read semantics Jeffle Xu
2022-04-06 7:55 ` [PATCH v8 00/20] fscache,erofs: " Jeffle Xu
2022-04-06 7:55 ` [PATCH v8 01/20] cachefiles: unmark inode in use in error path Jeffle Xu
2022-04-06 7:55 ` Jeffle Xu
2022-04-06 7:55 ` [PATCH v8 02/20] cachefiles: extract write routine Jeffle Xu
2022-04-06 7:55 ` Jeffle Xu
2022-04-11 12:13 ` David Howells
2022-04-11 12:13 ` David Howells
2022-04-11 12:29 ` JeffleXu
2022-04-11 12:29 ` JeffleXu
2022-04-06 7:55 ` [PATCH v8 03/20] cachefiles: notify user daemon with anon_fd when looking up cookie Jeffle Xu
2022-04-06 7:55 ` Jeffle Xu
2022-04-11 12:28 ` David Howells
2022-04-11 12:28 ` David Howells
2022-04-11 12:36 ` JeffleXu
2022-04-11 12:36 ` JeffleXu
2022-04-11 12:32 ` David Howells
2022-04-11 12:32 ` David Howells
2022-04-11 12:36 ` JeffleXu
2022-04-11 12:36 ` JeffleXu
2022-04-06 7:55 ` [PATCH v8 04/20] cachefiles: notify user daemon when withdrawing cookie Jeffle Xu
2022-04-06 7:55 ` Jeffle Xu
2022-04-11 12:35 ` David Howells
2022-04-11 12:35 ` David Howells
2022-04-11 12:48 ` JeffleXu
2022-04-11 12:48 ` JeffleXu
2022-04-11 13:42 ` David Howells
2022-04-11 13:42 ` David Howells
2022-04-12 3:35 ` JeffleXu
2022-04-12 3:35 ` JeffleXu
2022-04-06 7:55 ` [PATCH v8 05/20] cachefiles: implement on-demand read Jeffle Xu
2022-04-06 7:55 ` Jeffle Xu
2022-04-11 12:44 ` David Howells
2022-04-11 12:44 ` David Howells
2022-04-11 12:50 ` JeffleXu
2022-04-11 12:50 ` JeffleXu
2022-04-06 7:55 ` [PATCH v8 06/20] cachefiles: enable on-demand read mode Jeffle Xu
2022-04-06 7:55 ` Jeffle Xu
2022-04-06 7:55 ` [PATCH v8 07/20] cachefiles: document " Jeffle Xu
2022-04-06 7:55 ` Jeffle Xu
2022-04-11 13:38 ` David Howells
2022-04-11 13:38 ` David Howells
2022-04-12 3:17 ` JeffleXu
2022-04-12 3:17 ` JeffleXu
2022-04-06 7:56 ` [PATCH v8 08/20] erofs: make erofs_map_blocks() generally available Jeffle Xu
2022-04-06 7:56 ` Jeffle Xu
2022-04-07 2:44 ` Gao Xiang
2022-04-07 2:44 ` Gao Xiang
2022-04-06 7:56 ` [PATCH v8 09/20] erofs: add mode checking helper Jeffle Xu
2022-04-06 7:56 ` Jeffle Xu
2022-04-07 2:46 ` Gao Xiang
2022-04-07 2:46 ` Gao Xiang
2022-04-06 7:56 ` [PATCH v8 10/20] erofs: register fscache volume Jeffle Xu
2022-04-06 7:56 ` Jeffle Xu
2022-04-07 2:50 ` Gao Xiang
2022-04-07 2:50 ` Gao Xiang
2022-04-06 7:56 ` [PATCH v8 11/20] erofs: add fscache context helper functions Jeffle Xu
2022-04-06 7:56 ` Jeffle Xu
2022-04-07 3:25 ` Gao Xiang
2022-04-07 3:25 ` Gao Xiang
2022-04-06 7:56 ` [PATCH v8 12/20] erofs: add anonymous inode managing page cache for data blob Jeffle Xu
2022-04-06 7:56 ` Jeffle Xu
2022-04-07 5:31 ` Gao Xiang
2022-04-07 5:31 ` Gao Xiang
2022-04-08 2:14 ` JeffleXu
2022-04-06 7:56 ` [PATCH v8 13/20] erofs: add erofs_fscache_read_folios() helper Jeffle Xu
2022-04-06 7:56 ` Jeffle Xu
2022-04-07 14:05 ` Gao Xiang
2022-04-07 14:05 ` Gao Xiang
2022-04-06 7:56 ` [PATCH v8 14/20] erofs: register fscache context for primary data blob Jeffle Xu
2022-04-06 7:56 ` Jeffle Xu
2022-04-07 14:09 ` Gao Xiang
2022-04-07 14:09 ` Gao Xiang
2022-04-06 7:56 ` [PATCH v8 15/20] erofs: register fscache context for extra data blobs Jeffle Xu
2022-04-06 7:56 ` Jeffle Xu
2022-04-07 14:15 ` Gao Xiang
2022-04-07 14:15 ` Gao Xiang
2022-04-08 2:11 ` JeffleXu
2022-04-06 7:56 ` [PATCH v8 16/20] erofs: implement fscache-based metadata read Jeffle Xu
2022-04-06 7:56 ` Jeffle Xu
2022-04-07 14:19 ` Gao Xiang [this message]
2022-04-07 14:19 ` Gao Xiang
2022-04-06 7:56 ` [PATCH v8 17/20] erofs: implement fscache-based data read for non-inline layout Jeffle Xu
2022-04-06 7:56 ` Jeffle Xu
2022-04-07 14:24 ` Gao Xiang
2022-04-07 14:24 ` Gao Xiang
2022-04-06 7:56 ` [PATCH v8 18/20] erofs: implement fscache-based data read for inline layout Jeffle Xu
2022-04-06 7:56 ` Jeffle Xu
2022-04-07 14:31 ` Gao Xiang
2022-04-07 14:31 ` Gao Xiang
2022-04-06 7:56 ` [PATCH v8 19/20] erofs: implement fscache-based data readahead Jeffle Xu
2022-04-06 7:56 ` Jeffle Xu
2022-04-07 14:36 ` Gao Xiang
2022-04-07 14:36 ` Gao Xiang
2022-04-06 7:56 ` [PATCH v8 20/20] erofs: add 'fsid' mount option Jeffle Xu
2022-04-06 7:56 ` Jeffle Xu
2022-04-07 14:39 ` Gao Xiang
2022-04-07 14:39 ` Gao Xiang
2022-04-10 12:51 ` [PATCH v8 00/20] fscache,erofs: fscache-based on-demand read semantics Gao Xiang
2022-04-10 12:51 ` Gao Xiang
2022-04-13 12:27 ` 田子晨
2022-04-13 12:27 ` 田子晨
2022-04-14 8:10 ` Re: [PATCH v8 00/20] fscache, erofs: " Jiachen Zhang
2022-04-14 8:10 ` Re: [PATCH v8 00/20] fscache,erofs: " Jiachen Zhang
2022-04-14 9:29 ` Re: [PATCH v8 00/20] fscache, erofs: " Gao Xiang
2022-04-14 9:29 ` Re: [PATCH v8 00/20] fscache,erofs: " Gao Xiang
2022-04-11 13:43 ` [PATCH v8 00/20] fscache, erofs: " David Howells
2022-04-11 13:43 ` [PATCH v8 00/20] fscache,erofs: " David Howells
2022-04-12 3:18 ` JeffleXu
2022-04-12 3:18 ` JeffleXu
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=Yk7y8FuBosbtAY3l@debian \
--to=xiang@kernel.org \
--cc=dhowells@redhat.com \
--cc=fannaihao@baidu.com \
--cc=gerry@linux.alibaba.com \
--cc=gregkh@linuxfoundation.org \
--cc=jefflexu@linux.alibaba.com \
--cc=joseph.qi@linux.alibaba.com \
--cc=linux-cachefs@redhat.com \
--cc=linux-erofs@lists.ozlabs.org \
--cc=linux-fsdevel@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=luodaowen.backend@bytedance.com \
--cc=tianzichen@kuaishou.com \
--cc=torvalds@linux-foundation.org \
--cc=willy@infradead.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.