linux-fsdevel.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Dave Kleikamp <dave.kleikamp@oracle.com>
To: linux-fsdevel@vger.kernel.org
Cc: linux-kernel@vger.kernel.org, Zach Brown <zab@zabbo.net>,
	"Maxim V. Patlasov" <mpatlasov@parallels.com>,
	Dave Kleikamp <dave.kleikamp@oracle.com>
Subject: [PATCH v3 00/22] loop: Issue O_DIRECT aio using bio_vec
Date: Mon, 22 Oct 2012 10:15:00 -0500	[thread overview]
Message-ID: <1350918922-6096-1-git-send-email-dave.kleikamp@oracle.com> (raw)

This is the current version of the patchset I presented at the LSF-MM
Summit in San Francisco in April. I apologize for letting it go so
long before re-submitting.

This patchset was begun by Zach Brown and was originally submitted for
review in October, 2009. Feedback was positive, and I have picked up
where he left off, porting his patches to the latest mainline kernel
and adding support more file systems.

This patch series adds a kernel interface to fs/aio.c so that kernel code can
issue concurrent asynchronous IO to file systems.  It adds an aio command and
file system methods which specify io memory with pages instead of userspace
addresses.

This series was written to reduce the current overhead loop imposes by
performing synchronus buffered file system IO from a kernel thread.  These
patches turn loop into a light weight layer that translates bios into iocbs.

The downside of this is that in its current implementation, performance takes
a big hit for non-synchonous I/O, since the underlying page cache is bypassed.
The tradeoff is that all writes to the loop device make it to the underlying
media, making loop-mounted file systems recoverable.

These patches apply to 3.7-rc1 and are also available at:
git://github.com/kleikamp/linux-shaggy.git loop_2012_10_18

Asias He (1):
  block_dev: add support for read_iter, write_iter

Dave Kleikamp (8):
  iov_iter: iov_iter_copy_from_user() should use non-atomic copy
  fuse: convert fuse to use iov_iter_copy_[to|from]_user
  dio: Convert direct_IO to use iov_iter
  dio: add bio_vec support to __blockdev_direct_IO()
  fs: add read_iter and write_iter to several file systems
  ext4: add support for read_iter and write_iter
  nfs: add support for read_iter, write_iter
  btrfs: add support for read_iter and write_iter

From: Zach Brown (2):
  aio: add aio support for iov_iter arguments
  loop: use aio to perform io on the underlying file

Zach Brown (11):
  iov_iter: move into its own file
  iov_iter: add copy_to_user support
  iov_iter: hide iovec details behind ops function pointers
  iov_iter: add bvec support
  iov_iter: add a shorten call
  iov_iter: let callers extract iovecs and bio_vecs
  dio: create a dio_aligned() helper function
  fs: pull iov_iter use higher up the stack
  aio: add aio_kernel_() interface
  bio: add bvec_length(), like iov_length()
  ocfs2: add support for read_iter, write_iter, and direct_IO_bvec

 Documentation/filesystems/Locking |   4 +-
 Documentation/filesystems/vfs.txt |   4 +-
 drivers/block/loop.c              | 129 +++++++++----
 fs/9p/vfs_addr.c                  |   8 +-
 fs/9p/vfs_file.c                  |   4 +
 fs/aio.c                          | 156 +++++++++++++++
 fs/block_dev.c                    |  44 ++++-
 fs/btrfs/file.c                   |  55 +++---
 fs/btrfs/inode.c                  |  61 +++---
 fs/ceph/addr.c                    |   3 +-
 fs/cifs/file.c                    |   4 +-
 fs/direct-io.c                    | 253 ++++++++++++++++--------
 fs/ext2/file.c                    |   2 +
 fs/ext2/inode.c                   |   8 +-
 fs/ext3/file.c                    |   2 +
 fs/ext3/inode.c                   |  15 +-
 fs/ext4/ext4.h                    |   3 +-
 fs/ext4/file.c                    |  49 +++--
 fs/ext4/indirect.c                |  16 +-
 fs/ext4/inode.c                   |  27 ++-
 fs/fat/file.c                     |   2 +
 fs/fat/inode.c                    |  10 +-
 fs/fuse/file.c                    |  40 ++--
 fs/gfs2/aops.c                    |   7 +-
 fs/hfs/inode.c                    |   9 +-
 fs/hfsplus/inode.c                |   8 +-
 fs/jfs/file.c                     |   2 +
 fs/jfs/inode.c                    |   7 +-
 fs/nfs/direct.c                   | 176 +++++++++++------
 fs/nfs/file.c                     |  48 +++--
 fs/nfs/internal.h                 |   2 +
 fs/nfs/nfs4file.c                 |   4 +
 fs/nilfs2/file.c                  |   2 +
 fs/nilfs2/inode.c                 |   8 +-
 fs/ocfs2/aops.c                   |   8 +-
 fs/ocfs2/file.c                   |  82 +++++---
 fs/ocfs2/ocfs2_trace.h            |   6 +-
 fs/reiserfs/file.c                |   2 +
 fs/reiserfs/inode.c               |   7 +-
 fs/udf/file.c                     |   3 +-
 fs/udf/inode.c                    |  10 +-
 fs/xfs/xfs_aops.c                 |  13 +-
 include/linux/aio.h               |  18 ++
 include/linux/bio.h               |   8 +
 include/linux/fs.h                | 135 +++++++++++--
 include/linux/nfs_fs.h            |   9 +-
 include/uapi/linux/aio_abi.h      |   2 +
 include/uapi/linux/loop.h         |   1 +
 mm/Makefile                       |   2 +-
 mm/filemap.c                      | 395 ++++++++++++++++----------------------
 mm/iov-iter.c                     | 383 ++++++++++++++++++++++++++++++++++++
 mm/page_io.c                      |   8 +-
 52 files changed, 1609 insertions(+), 655 deletions(-)
 create mode 100644 mm/iov-iter.c

-- 
1.7.12.3

             reply	other threads:[~2012-10-22 15:15 UTC|newest]

Thread overview: 29+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2012-10-22 15:15 Dave Kleikamp [this message]
2012-10-22 15:15 ` [PATCH 01/22] iov_iter: move into its own file Dave Kleikamp
2012-10-22 15:15 ` [PATCH 02/22] iov_iter: iov_iter_copy_from_user() should use non-atomic copy Dave Kleikamp
2012-10-22 15:15 ` [PATCH 03/22] iov_iter: add copy_to_user support Dave Kleikamp
     [not found] ` <1350918922-6096-1-git-send-email-dave.kleikamp-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
2012-10-22 15:15   ` [PATCH 04/22] fuse: convert fuse to use iov_iter_copy_[to|from]_user Dave Kleikamp
2012-10-22 15:15 ` [PATCH 05/22] iov_iter: hide iovec details behind ops function pointers Dave Kleikamp
2012-10-22 15:15 ` [PATCH 06/22] iov_iter: add bvec support Dave Kleikamp
2012-10-22 15:15 ` [PATCH 07/22] iov_iter: add a shorten call Dave Kleikamp
2012-10-22 15:15 ` [PATCH 08/22] iov_iter: let callers extract iovecs and bio_vecs Dave Kleikamp
2012-10-22 15:15 ` [PATCH 09/22] dio: create a dio_aligned() helper function Dave Kleikamp
2012-10-22 15:15 ` [PATCH 10/22] dio: Convert direct_IO to use iov_iter Dave Kleikamp
2012-10-22 15:15 ` [PATCH 11/22] dio: add bio_vec support to __blockdev_direct_IO() Dave Kleikamp
2012-10-22 15:15 ` [PATCH 12/22] fs: pull iov_iter use higher up the stack Dave Kleikamp
2012-10-22 15:15 ` [PATCH 13/22] aio: add aio_kernel_() interface Dave Kleikamp
2012-10-22 15:15 ` [PATCH 14/22] aio: add aio support for iov_iter arguments Dave Kleikamp
2012-10-22 15:15 ` [PATCH 15/22] bio: add bvec_length(), like iov_length() Dave Kleikamp
2012-10-22 15:15 ` [PATCH 16/22] loop: use aio to perform io on the underlying file Dave Kleikamp
2012-10-22 15:15 ` [PATCH 17/22] fs: add read_iter and write_iter to several file systems Dave Kleikamp
2012-10-22 15:15 ` [PATCH 18/22] ocfs2: add support for read_iter, write_iter, and direct_IO_bvec Dave Kleikamp
2012-10-22 15:15 ` [PATCH 19/22] ext4: add support for read_iter and write_iter Dave Kleikamp
2012-10-22 15:15 ` [PATCH 20/22] nfs: add support for read_iter, write_iter Dave Kleikamp
2012-10-22 15:21   ` Myklebust, Trond
2012-10-22 15:35     ` Dave Kleikamp
2012-10-22 15:15 ` [PATCH 21/22] btrfs: add support for read_iter and write_iter Dave Kleikamp
2012-10-22 15:15 ` [PATCH 22/22] block_dev: add support for read_iter, write_iter Dave Kleikamp
2012-10-23  0:07 ` [PATCH v3 00/22] loop: Issue O_DIRECT aio using bio_vec Dave Chinner
2012-10-23  0:53   ` Dave Kleikamp
2012-10-23  1:59     ` Dave Chinner
2012-10-23 13:04 ` Christoph Hellwig

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=1350918922-6096-1-git-send-email-dave.kleikamp@oracle.com \
    --to=dave.kleikamp@oracle.com \
    --cc=linux-fsdevel@vger.kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=mpatlasov@parallels.com \
    --cc=zab@zabbo.net \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).