Linux XFS filesystem development
 help / color / mirror / Atom feed
* Re: Is ext4_dio_read_iter() broken? - and xfs_file_dio_aio_read()
       [not found] <969260.1584004779@warthog.procyon.org.uk>
@ 2020-03-12 10:07 ` David Howells
  2020-03-12 10:26   ` btrfs may be broken too - Re: Is ext4_dio_read_iter() broken? David Howells
  2020-03-12 10:42   ` Is ext4_dio_read_iter() broken? - and xfs_file_dio_aio_read() Christoph Hellwig
  0 siblings, 2 replies; 5+ messages in thread
From: David Howells @ 2020-03-12 10:07 UTC (permalink / raw)
  To: mbobrowski, darrick.wong
  Cc: dhowells, jack, hch, linux-ext4, linux-xfs, linux-fsdevel

David Howells <dhowells@redhat.com> wrote:

> Is ext4_dio_read_iter() broken?  It calls:
> 
> 	file_accessed(iocb->ki_filp);
> 
> at the end of the function - but surely iocb should be expected to have been
> freed when iocb->ki_complete() was called?

I think it's actually worse than that.  You also can't call
inode_unlock_shared(inode) because you no longer own a ref on the inode since
->ki_complete() is expected to call fput() on iocb->ki_filp.

Yes, you own a shared lock on it, but unless somewhere along the
fput-dput-iput chain the inode lock is taken exclusively, the inode can be
freed whilst you're still holding the lock.

Oh - and ext4_dax_read_iter() is also similarly broken.

And xfs_file_dio_aio_read() appears to be broken as it touches the inode after
calling iomap_dio_rw() to unlock it.

David


^ permalink raw reply	[flat|nested] 5+ messages in thread

* btrfs may be broken too - Re: Is ext4_dio_read_iter() broken?
  2020-03-12 10:07 ` Is ext4_dio_read_iter() broken? - and xfs_file_dio_aio_read() David Howells
@ 2020-03-12 10:26   ` David Howells
  2020-03-12 10:42   ` Is ext4_dio_read_iter() broken? - and xfs_file_dio_aio_read() Christoph Hellwig
  1 sibling, 0 replies; 5+ messages in thread
From: David Howells @ 2020-03-12 10:26 UTC (permalink / raw)
  To: clm, josef, dsterba
  Cc: dhowells, mbobrowski, darrick.wong, jack, hch, linux-ext4,
	linux-xfs, linux-btrfs, linux-fsdevel

David Howells <dhowells@redhat.com> wrote:

> > Is ext4_dio_read_iter() broken?  It calls:
> > 
> > 	file_accessed(iocb->ki_filp);
> > 
> > at the end of the function - but surely iocb should be expected to have been
> > freed when iocb->ki_complete() was called?
> 
> I think it's actually worse than that.  You also can't call
> inode_unlock_shared(inode) because you no longer own a ref on the inode since
> ->ki_complete() is expected to call fput() on iocb->ki_filp.
> 
> Yes, you own a shared lock on it, but unless somewhere along the
> fput-dput-iput chain the inode lock is taken exclusively, the inode can be
> freed whilst you're still holding the lock.
> 
> Oh - and ext4_dax_read_iter() is also similarly broken.
> 
> And xfs_file_dio_aio_read() appears to be broken as it touches the inode after
> calling iomap_dio_rw() to unlock it.

Seems btrfs_file_write_iter() is also broken:

	if (iocb->ki_flags & IOCB_DIRECT) {
		num_written = __btrfs_direct_write(iocb, from);
	} else {
		num_written = btrfs_buffered_write(iocb, from);
		if (num_written > 0)
			iocb->ki_pos = pos + num_written;
		if (clean_page)
			pagecache_isize_extended(inode, oldsize,
						i_size_read(inode));
	}

	inode_unlock(inode);

But if __btrfs_direct_write() returned -EIOCBQUEUED then inode may have been
deallocated by the point it's calling inode_unlock().  Holding the lock is not
a preventative measure that I can see.

David


^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: Is ext4_dio_read_iter() broken? - and xfs_file_dio_aio_read()
  2020-03-12 10:07 ` Is ext4_dio_read_iter() broken? - and xfs_file_dio_aio_read() David Howells
  2020-03-12 10:26   ` btrfs may be broken too - Re: Is ext4_dio_read_iter() broken? David Howells
@ 2020-03-12 10:42   ` Christoph Hellwig
  2020-03-12 10:49     ` David Howells
  1 sibling, 1 reply; 5+ messages in thread
From: Christoph Hellwig @ 2020-03-12 10:42 UTC (permalink / raw)
  To: David Howells
  Cc: mbobrowski, darrick.wong, jack, hch, linux-ext4, linux-xfs,
	linux-fsdevel

On Thu, Mar 12, 2020 at 10:07:57AM +0000, David Howells wrote:
> David Howells <dhowells@redhat.com> wrote:
> 
> > Is ext4_dio_read_iter() broken?  It calls:
> > 
> > 	file_accessed(iocb->ki_filp);
> > 
> > at the end of the function - but surely iocb should be expected to have been
> > freed when iocb->ki_complete() was called?

The iocb is refcounted and only completed when the refcount hits zero,
and an extra reference is held until the submission has completed.
Take a look at iocb_put().

> I think it's actually worse than that.  You also can't call
> inode_unlock_shared(inode) because you no longer own a ref on the inode since
> ->ki_complete() is expected to call fput() on iocb->ki_filp.

the file reference also hold an inode reference.

> 
> Yes, you own a shared lock on it, but unless somewhere along the
> fput-dput-iput chain the inode lock is taken exclusively, the inode can be
> freed whilst you're still holding the lock.
> 
> Oh - and ext4_dax_read_iter() is also similarly broken.

In addition to that DAX never executes asynchronously.

> And xfs_file_dio_aio_read() appears to be broken as it touches the inode after
> calling iomap_dio_rw() to unlock it.

Same as above.

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: Is ext4_dio_read_iter() broken? - and xfs_file_dio_aio_read()
  2020-03-12 10:42   ` Is ext4_dio_read_iter() broken? - and xfs_file_dio_aio_read() Christoph Hellwig
@ 2020-03-12 10:49     ` David Howells
  2020-03-12 10:53       ` Christoph Hellwig
  0 siblings, 1 reply; 5+ messages in thread
From: David Howells @ 2020-03-12 10:49 UTC (permalink / raw)
  To: Christoph Hellwig
  Cc: dhowells, mbobrowski, darrick.wong, jack, linux-ext4, linux-xfs,
	linux-fsdevel

Christoph Hellwig <hch@lst.de> wrote:

> > > at the end of the function - but surely iocb should be expected to have
> > > been freed when iocb->ki_complete() was called?
> 
> The iocb is refcounted and only completed when the refcount hits zero,
> and an extra reference is held until the submission has completed.
> Take a look at iocb_put().

Ah...  This is in struct aio_kiocb and not struct kiocb - that's why I missed
it.  Thanks.

David


^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: Is ext4_dio_read_iter() broken? - and xfs_file_dio_aio_read()
  2020-03-12 10:49     ` David Howells
@ 2020-03-12 10:53       ` Christoph Hellwig
  0 siblings, 0 replies; 5+ messages in thread
From: Christoph Hellwig @ 2020-03-12 10:53 UTC (permalink / raw)
  To: David Howells
  Cc: Christoph Hellwig, mbobrowski, darrick.wong, jack, linux-ext4,
	linux-xfs, linux-fsdevel

On Thu, Mar 12, 2020 at 10:49:40AM +0000, David Howells wrote:
> Christoph Hellwig <hch@lst.de> wrote:
> 
> > > > at the end of the function - but surely iocb should be expected to have
> > > > been freed when iocb->ki_complete() was called?
> > 
> > The iocb is refcounted and only completed when the refcount hits zero,
> > and an extra reference is held until the submission has completed.
> > Take a look at iocb_put().
> 
> Ah...  This is in struct aio_kiocb and not struct kiocb - that's why I missed
> it.  Thanks.

That being said we have a few other spots using ->ki_complete for
asynchronous execution, which might not be as careful.  As someone
having written one or two of those I have my doubts I got everthing
right and will audit those.

> 
> David
---end quoted text---

^ permalink raw reply	[flat|nested] 5+ messages in thread

end of thread, other threads:[~2020-03-12 10:53 UTC | newest]

Thread overview: 5+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
     [not found] <969260.1584004779@warthog.procyon.org.uk>
2020-03-12 10:07 ` Is ext4_dio_read_iter() broken? - and xfs_file_dio_aio_read() David Howells
2020-03-12 10:26   ` btrfs may be broken too - Re: Is ext4_dio_read_iter() broken? David Howells
2020-03-12 10:42   ` Is ext4_dio_read_iter() broken? - and xfs_file_dio_aio_read() Christoph Hellwig
2020-03-12 10:49     ` David Howells
2020-03-12 10:53       ` Christoph Hellwig

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox