All of lore.kernel.org
 help / color / mirror / Atom feed
From: Dave Chinner <david@fromorbit.com>
To: Matthew Wilcox <willy@linux.intel.com>
Cc: Matthew Wilcox <matthew.r.wilcox@intel.com>,
	linux-fsdevel@vger.kernel.org, linux-mm@kvack.org,
	linux-kernel@vger.kernel.org
Subject: Re: [PATCH v10 09/21] Replace the XIP page fault handler with the DAX page fault handler
Date: Thu, 11 Sep 2014 13:09:26 +1000	[thread overview]
Message-ID: <20140911030926.GO20518@dastard> (raw)
In-Reply-To: <20140910152337.GF27730@localhost.localdomain>

On Wed, Sep 10, 2014 at 11:23:37AM -0400, Matthew Wilcox wrote:
> On Wed, Sep 03, 2014 at 05:47:24PM +1000, Dave Chinner wrote:
> > > +	error = get_block(inode, block, &bh, 0);
> > > +	if (!error && (bh.b_size < PAGE_SIZE))
> > > +		error = -EIO;
> > > +	if (error)
> > > +		goto unlock_page;
> > 
> > page fault into unwritten region, returns buffer_unwritten(bh) ==
> > true. Hence buffer_written(bh) is false, and we take this branch:
> > 
> > > +	if (!buffer_written(&bh) && !vmf->cow_page) {
> > > +		if (vmf->flags & FAULT_FLAG_WRITE) {
> > > +			error = get_block(inode, block, &bh, 1);
> > 
> > Exactly what are you expecting to happen here? We don't do
> > allocation because there are already unwritten blocks over this
> > extent, and so bh will be unchanged when returning. i.e. it will
> > still be mapping an unwritten extent.
> 
> I was expecting calling get_block() on an unwritten extent to convert it
> to a written extent.  Your suggestion below of using b_end_io() to do that
> is a better idea.
> 
> So this should be:
> 
> 	if (!buffer_mapped(&bh) && !vmf->cow_page) {
> 
> ... right?

Yes, that is the conclusion I reached as well. ;)

> > dax: add IO completion callback for page faults
> > 
> > From: Dave Chinner <dchinner@redhat.com>
> > 
> > When a page fault drops into a hole, it needs to allocate an extent.
> > Filesystems may allocate unwritten extents so that the underlying
> > contents are not exposed until data is written to the extent. In
> > that case, we need an io completion callback to run once the blocks
> > have been zeroed to indicate that it is safe for the filesystem to
> > mark those blocks written without exposing stale data in the event
> > of a crash.
> > 
> > Signed-off-by: Dave Chinner <dchinner@redhat.com>
> > ---
> >  fs/dax.c | 7 ++++++-
> >  1 file changed, 6 insertions(+), 1 deletion(-)
> > 
> > diff --git a/fs/dax.c b/fs/dax.c
> > index 96c4fed..387ca78 100644
> > --- a/fs/dax.c
> > +++ b/fs/dax.c
> > @@ -306,6 +306,7 @@ static int do_dax_fault(struct vm_area_struct *vma, struct vm_fault *vmf,
> >  	memset(&bh, 0, sizeof(bh));
> >  	block = (sector_t)vmf->pgoff << (PAGE_SHIFT - blkbits);
> >  	bh.b_size = PAGE_SIZE;
> > +	bh.b_end_io = NULL;
> 
> Given the above memset, I don't think we need to explicitly set b_end_io
> to NULL.

I missed that ;)

> >   repeat:
> >  	page = find_get_page(mapping, vmf->pgoff);
> > @@ -364,8 +365,12 @@ static int do_dax_fault(struct vm_area_struct *vma, struct vm_fault *vmf,
> >  		return VM_FAULT_LOCKED;
> >  	}
> >  
> > -	if (buffer_unwritten(&bh) || buffer_new(&bh))
> > +	if (buffer_unwritten(&bh) || buffer_new(&bh)) {
> > +		/* XXX: errors zeroing the blocks are propagated how? */
> >  		dax_clear_blocks(inode, bh.b_blocknr, bh.b_size);
> 
> That's a great question.  I think we need to segfault here.

I suspect there are other cases where we need to do similar "trigger
segv" error handling rather than ignoring errors altogether...

> 
> > +		if (bh.b_end_io)
> > +			bh.b_end_io(&bh, 1);
> > +	}
> 
> I think ext4 is going to need to set b_end_io too.  Right now, it uses the
> dio_iodone_t to convert unwritten extents to written extents, but we don't
> have (and I don't think we should have) a kiocb for page faults.

Yes, ext4 is going to need this as well. After I got XFS running
without problems, I then went back and ran xfstests on ext4 and it
failed many of the tests that do operations into unwritten regions.

> So, if it's OK with you, I'm going to fold this patch into version 11 and
> add your Reviewed-by to it.

Fold it in, I'll review the result ;)

Cheers,

Dave.
-- 
Dave Chinner
david@fromorbit.com

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

WARNING: multiple messages have this Message-ID (diff)
From: Dave Chinner <david@fromorbit.com>
To: Matthew Wilcox <willy@linux.intel.com>
Cc: Matthew Wilcox <matthew.r.wilcox@intel.com>,
	linux-fsdevel@vger.kernel.org, linux-mm@kvack.org,
	linux-kernel@vger.kernel.org
Subject: Re: [PATCH v10 09/21] Replace the XIP page fault handler with the DAX page fault handler
Date: Thu, 11 Sep 2014 13:09:26 +1000	[thread overview]
Message-ID: <20140911030926.GO20518@dastard> (raw)
In-Reply-To: <20140910152337.GF27730@localhost.localdomain>

On Wed, Sep 10, 2014 at 11:23:37AM -0400, Matthew Wilcox wrote:
> On Wed, Sep 03, 2014 at 05:47:24PM +1000, Dave Chinner wrote:
> > > +	error = get_block(inode, block, &bh, 0);
> > > +	if (!error && (bh.b_size < PAGE_SIZE))
> > > +		error = -EIO;
> > > +	if (error)
> > > +		goto unlock_page;
> > 
> > page fault into unwritten region, returns buffer_unwritten(bh) ==
> > true. Hence buffer_written(bh) is false, and we take this branch:
> > 
> > > +	if (!buffer_written(&bh) && !vmf->cow_page) {
> > > +		if (vmf->flags & FAULT_FLAG_WRITE) {
> > > +			error = get_block(inode, block, &bh, 1);
> > 
> > Exactly what are you expecting to happen here? We don't do
> > allocation because there are already unwritten blocks over this
> > extent, and so bh will be unchanged when returning. i.e. it will
> > still be mapping an unwritten extent.
> 
> I was expecting calling get_block() on an unwritten extent to convert it
> to a written extent.  Your suggestion below of using b_end_io() to do that
> is a better idea.
> 
> So this should be:
> 
> 	if (!buffer_mapped(&bh) && !vmf->cow_page) {
> 
> ... right?

Yes, that is the conclusion I reached as well. ;)

> > dax: add IO completion callback for page faults
> > 
> > From: Dave Chinner <dchinner@redhat.com>
> > 
> > When a page fault drops into a hole, it needs to allocate an extent.
> > Filesystems may allocate unwritten extents so that the underlying
> > contents are not exposed until data is written to the extent. In
> > that case, we need an io completion callback to run once the blocks
> > have been zeroed to indicate that it is safe for the filesystem to
> > mark those blocks written without exposing stale data in the event
> > of a crash.
> > 
> > Signed-off-by: Dave Chinner <dchinner@redhat.com>
> > ---
> >  fs/dax.c | 7 ++++++-
> >  1 file changed, 6 insertions(+), 1 deletion(-)
> > 
> > diff --git a/fs/dax.c b/fs/dax.c
> > index 96c4fed..387ca78 100644
> > --- a/fs/dax.c
> > +++ b/fs/dax.c
> > @@ -306,6 +306,7 @@ static int do_dax_fault(struct vm_area_struct *vma, struct vm_fault *vmf,
> >  	memset(&bh, 0, sizeof(bh));
> >  	block = (sector_t)vmf->pgoff << (PAGE_SHIFT - blkbits);
> >  	bh.b_size = PAGE_SIZE;
> > +	bh.b_end_io = NULL;
> 
> Given the above memset, I don't think we need to explicitly set b_end_io
> to NULL.

I missed that ;)

> >   repeat:
> >  	page = find_get_page(mapping, vmf->pgoff);
> > @@ -364,8 +365,12 @@ static int do_dax_fault(struct vm_area_struct *vma, struct vm_fault *vmf,
> >  		return VM_FAULT_LOCKED;
> >  	}
> >  
> > -	if (buffer_unwritten(&bh) || buffer_new(&bh))
> > +	if (buffer_unwritten(&bh) || buffer_new(&bh)) {
> > +		/* XXX: errors zeroing the blocks are propagated how? */
> >  		dax_clear_blocks(inode, bh.b_blocknr, bh.b_size);
> 
> That's a great question.  I think we need to segfault here.

I suspect there are other cases where we need to do similar "trigger
segv" error handling rather than ignoring errors altogether...

> 
> > +		if (bh.b_end_io)
> > +			bh.b_end_io(&bh, 1);
> > +	}
> 
> I think ext4 is going to need to set b_end_io too.  Right now, it uses the
> dio_iodone_t to convert unwritten extents to written extents, but we don't
> have (and I don't think we should have) a kiocb for page faults.

Yes, ext4 is going to need this as well. After I got XFS running
without problems, I then went back and ran xfstests on ext4 and it
failed many of the tests that do operations into unwritten regions.

> So, if it's OK with you, I'm going to fold this patch into version 11 and
> add your Reviewed-by to it.

Fold it in, I'll review the result ;)

Cheers,

Dave.
-- 
Dave Chinner
david@fromorbit.com

  reply	other threads:[~2014-09-11  3:09 UTC|newest]

Thread overview: 104+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2014-08-27  3:45 [PATCH v10 00/21] Support ext4 on NV-DIMMs Matthew Wilcox
2014-08-27  3:45 ` Matthew Wilcox
2014-08-27  3:45 ` [PATCH v10 01/21] axonram: Fix bug in direct_access Matthew Wilcox
2014-08-27  3:45   ` Matthew Wilcox
2014-08-27  3:45 ` [PATCH v10 02/21] Change direct_access calling convention Matthew Wilcox
2014-08-27  3:45   ` Matthew Wilcox
2014-08-27  3:45 ` [PATCH v10 03/21] Fix XIP fault vs truncate race Matthew Wilcox
2014-08-27  3:45   ` Matthew Wilcox
2014-08-27  3:45 ` [PATCH v10 04/21] Allow page fault handlers to perform the COW Matthew Wilcox
2014-08-27  3:45   ` Matthew Wilcox
2014-08-27  3:45 ` [PATCH v10 05/21] Introduce IS_DAX(inode) Matthew Wilcox
2014-08-27  3:45   ` Matthew Wilcox
2014-08-27  3:45 ` [PATCH v10 06/21] Add copy_to_iter(), copy_from_iter() and iov_iter_zero() Matthew Wilcox
2014-08-27  3:45   ` Matthew Wilcox
2014-08-27  3:45 ` [PATCH v10 07/21] Replace XIP read and write with DAX I/O Matthew Wilcox
2014-08-27  3:45   ` Matthew Wilcox
2014-09-14 14:11   ` Boaz Harrosh
2014-09-14 14:11     ` Boaz Harrosh
2014-08-27  3:45 ` [PATCH v10 08/21] Replace ext2_clear_xip_target with dax_clear_blocks Matthew Wilcox
2014-08-27  3:45   ` Matthew Wilcox
2014-08-27  3:45 ` [PATCH v10 09/21] Replace the XIP page fault handler with the DAX page fault handler Matthew Wilcox
2014-08-27  3:45   ` Matthew Wilcox
2014-09-03  7:47   ` Dave Chinner
2014-09-03  7:47     ` Dave Chinner
2014-09-10 15:23     ` Matthew Wilcox
2014-09-10 15:23       ` Matthew Wilcox
2014-09-11  3:09       ` Dave Chinner [this message]
2014-09-11  3:09         ` Dave Chinner
2014-09-24 15:43         ` Matthew Wilcox
2014-09-24 15:43           ` Matthew Wilcox
2014-09-25  1:01           ` Dave Chinner
2014-09-25  1:01             ` Dave Chinner
2014-08-27  3:45 ` [PATCH v10 10/21] Replace xip_truncate_page with dax_truncate_page Matthew Wilcox
2014-08-27  3:45   ` Matthew Wilcox
2014-08-27  3:45 ` [PATCH v10 11/21] Replace XIP documentation with DAX documentation Matthew Wilcox
2014-08-27  3:45   ` Matthew Wilcox
2014-08-27  3:45 ` [PATCH v10 12/21] Remove get_xip_mem Matthew Wilcox
2014-08-27  3:45   ` Matthew Wilcox
2014-08-27  3:45 ` [PATCH v10 13/21] ext2: Remove ext2_xip_verify_sb() Matthew Wilcox
2014-08-27  3:45   ` Matthew Wilcox
2014-08-27  3:45 ` [PATCH v10 14/21] ext2: Remove ext2_use_xip Matthew Wilcox
2014-08-27  3:45   ` Matthew Wilcox
2014-08-27  3:45 ` [PATCH v10 15/21] ext2: Remove xip.c and xip.h Matthew Wilcox
2014-08-27  3:45   ` Matthew Wilcox
2014-08-27  3:45 ` [PATCH v10 16/21] Remove CONFIG_EXT2_FS_XIP and rename CONFIG_FS_XIP to CONFIG_FS_DAX Matthew Wilcox
2014-08-27  3:45   ` Matthew Wilcox
2014-08-27  3:45 ` [PATCH v10 17/21] ext2: Remove ext2_aops_xip Matthew Wilcox
2014-08-27  3:45   ` Matthew Wilcox
2014-08-27  3:45 ` [PATCH v10 18/21] Get rid of most mentions of XIP in ext2 Matthew Wilcox
2014-08-27  3:45   ` Matthew Wilcox
2014-08-27  3:45 ` [PATCH v10 19/21] xip: Add xip_zero_page_range Matthew Wilcox
2014-08-27  3:45   ` Matthew Wilcox
2014-09-03  9:21   ` Dave Chinner
2014-09-03  9:21     ` Dave Chinner
2014-09-04 21:08     ` Matthew Wilcox
2014-09-04 21:08       ` Matthew Wilcox
2014-09-04 21:36       ` Theodore Ts'o
2014-09-04 21:36         ` Theodore Ts'o
2014-09-08 18:59         ` Matthew Wilcox
2014-09-08 18:59           ` Matthew Wilcox
2014-08-27  3:45 ` [PATCH v10 20/21] ext4: Add DAX functionality Matthew Wilcox
2014-08-27  3:45   ` Matthew Wilcox
2014-09-03 11:13   ` Dave Chinner
2014-09-03 11:13     ` Dave Chinner
2014-09-10 16:49     ` Boaz Harrosh
2014-09-10 16:49       ` Boaz Harrosh
2014-09-11  4:38       ` Dave Chinner
2014-09-11  4:38         ` Dave Chinner
2014-09-14 12:25         ` Boaz Harrosh
2014-09-14 12:25           ` Boaz Harrosh
2014-09-15  6:15           ` Dave Chinner
2014-09-15  6:15             ` Dave Chinner
2014-09-15  9:41             ` Boaz Harrosh
2014-09-15  9:41               ` Boaz Harrosh
2014-08-27  3:45 ` [PATCH v10 21/21] brd: Rename XIP to DAX Matthew Wilcox
2014-08-27  3:45   ` Matthew Wilcox
2014-08-27 20:06 ` [PATCH v10 00/21] Support ext4 on NV-DIMMs Andrew Morton
2014-08-27 20:06   ` Andrew Morton
2014-08-27 21:12   ` Matthew Wilcox
2014-08-27 21:12     ` Matthew Wilcox
2014-08-27 21:46     ` Andrew Morton
2014-08-27 21:46       ` Andrew Morton
2014-08-28  1:30       ` Andy Lutomirski
2014-08-28  1:30         ` Andy Lutomirski
2014-08-28 16:50         ` Matthew Wilcox
2014-08-28 16:50           ` Matthew Wilcox
2014-08-28 15:45       ` Matthew Wilcox
2014-08-28 15:45         ` Matthew Wilcox
2014-08-27 21:22   ` Christoph Lameter
2014-08-27 21:22     ` Christoph Lameter
2014-08-27 21:30     ` Andrew Morton
2014-08-27 21:30       ` Andrew Morton
2014-08-27 23:04       ` One Thousand Gnomes
2014-08-27 23:04         ` One Thousand Gnomes
2014-08-28  7:17       ` Dave Chinner
2014-08-28  7:17         ` Dave Chinner
2014-08-30 23:11         ` Christian Stroetmann
2014-08-30 23:11           ` Christian Stroetmann
2014-08-28  8:08 ` Boaz Harrosh
2014-08-28  8:08   ` Boaz Harrosh
2014-08-28 22:09   ` Zwisler, Ross
2014-08-28 22:09     ` Zwisler, Ross
2014-09-03 12:05 ` [PATCH 1/1] xfs: add DAX support Dave Chinner
2014-09-03 12:05   ` Dave Chinner

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20140911030926.GO20518@dastard \
    --to=david@fromorbit.com \
    --cc=linux-fsdevel@vger.kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=matthew.r.wilcox@intel.com \
    --cc=willy@linux.intel.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.