From: Jeff Layton <jlayton@redhat.com>
To: NeilBrown <neilb@suse.com>, "Yan, Zheng" <zyan@redhat.com>,
Sage Weil <sage@redhat.com>, Ilya Dryomov <idryomov@gmail.com>
Cc: ceph-devel@vger.kernel.org
Subject: Re: [PATCH 1/2] cephfs: ignore error from invalidate_inode_pages2_range() in direct write.
Date: Wed, 31 Aug 2016 09:47:37 -0400 [thread overview]
Message-ID: <1472651257.5795.5.camel@redhat.com> (raw)
In-Reply-To: <871t15ej9y.fsf@notabene.neil.brown.name>
On Wed, 2016-08-31 at 12:58 +1000, NeilBrown wrote:
> This call can fail if there are dirty pages. The preceding call to
> filemap_write_and_wait_range() will normally remove dirty pages, but
> as inode_lock() is not held over calls to ceph_direct_read_write(), it
> could race with non-direct writes and pages could be dirtied
> immediately after filemap_write_and_wait_range() returns
>
> If there are dirty pages, they will be removed by the subsequent call
> to truncate_inode_pages_range(), so having them here is not a problem.
>
> If the 'ret' value is left holding an error, then in the async IO case
> (aio_req is not NULL) the loop that would normally call
> ceph_osdc_start_request() will see the error in 'ret' and abort all
> requests. This doesn't seem like correct behaviour.
>
> So clear 'ret' and ignore the error (other than the dout() message).
>
> > Signed-off-by: NeilBrown <neilb@suse.com>
> ---
> fs/ceph/file.c | 8 +++++++-
> 1 file changed, 7 insertions(+), 1 deletion(-)
>
> diff --git a/fs/ceph/file.c b/fs/ceph/file.c
> index 0f5375d8e030..1ca6e29edcc9 100644
> --- a/fs/ceph/file.c
> +++ b/fs/ceph/file.c
> @@ -905,8 +905,14 @@ ceph_direct_read_write(struct kiocb *iocb, struct iov_iter *iter,
> > ret = invalidate_inode_pages2_range(inode->i_mapping,
> > pos >> PAGE_SHIFT,
> > (pos + count) >> PAGE_SHIFT);
> > - if (ret < 0)
> > + if (ret < 0) {
> > dout("invalidate_inode_pages2_range returned %d\n", ret);
> > + /*
> > + * Error is not fatal as we truncate_inode_pages_range()
> > + * below.
> > + */
> > + ret = 0;
> > + }
>
> > flags = CEPH_OSD_FLAG_ORDERSNAP |
> > CEPH_OSD_FLAG_ONDISK |
Good catch. Even better might be to just declare a int ret2 and not
clobber "ret" at all.
Clearly, mixing buffered and direct I/O is gross, but I suppose you
could hit the occasional problem here with a real workload
occasionally.
Should this go to stable? The patch seems safe enough.
Reviewed-by: Jeff Layton <jlayton@redhat.com>
next prev parent reply other threads:[~2016-08-31 13:47 UTC|newest]
Thread overview: 9+ messages / expand[flat|nested] mbox.gz Atom feed top
2016-08-31 2:56 [PATCH 0/2]: CEPHFS: allow for races between direct and buffered writes NeilBrown
2016-08-31 2:58 ` [PATCH 1/2] cephfs: ignore error from invalidate_inode_pages2_range() in direct write NeilBrown
2016-08-31 13:47 ` Jeff Layton [this message]
2016-09-01 1:01 ` NeilBrown
2016-08-31 2:59 ` [PATCH 2/2] cephfs: remove warning when ceph_releasepage() is called on dirty page NeilBrown
2016-08-31 13:48 ` Jeff Layton
2016-08-31 9:19 ` [PATCH 0/2]: CEPHFS: allow for races between direct and buffered writes Yan, Zheng
2016-09-01 1:13 ` NeilBrown
2016-09-01 14:30 ` Yan, Zheng
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1472651257.5795.5.camel@redhat.com \
--to=jlayton@redhat.com \
--cc=ceph-devel@vger.kernel.org \
--cc=idryomov@gmail.com \
--cc=neilb@suse.com \
--cc=sage@redhat.com \
--cc=zyan@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox