linux-nfs.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Trond Myklebust <trond.myklebust@primarydata.com>
To: Weston Andros Adamson <dros@primarydata.com>
Cc: Linux NFS Mailing List <linux-nfs@vger.kernel.org>
Subject: Re: [PATCH v3 00/18] nfs: support multiple requests per page
Date: Wed, 28 May 2014 19:23:17 -0400	[thread overview]
Message-ID: <CAHQdGtQyR9bXz7-xFfM2JTiLi6R_Vaj6rfpNweEEAL+7-iCRwA@mail.gmail.com> (raw)
In-Reply-To: <1400169417-28245-1-git-send-email-dros@primarydata.com>

On Thu, May 15, 2014 at 11:56 AM, Weston Andros Adamson
<dros@primarydata.com> wrote:
> This patchset changes the read and write paths to be more flexible in dealing
> with requests that are not page aligned. Until now there was a 1:1 mapping
> of struct nfs_page (referred to as "nfs requests") to struct page, which
> limited the client to page aligned I/O in several pNFS scenarios.
>
> This patchset allows multiple requests per page, loosely following
> the approach taken with struct buffer_head (part of kernel bio interface).
>
> With this patchset the client now supports:
>  - non-page-aligned O_DIRECT I/O to DSes (instead of reverting to MDS)
>  - arbitrary pnfs layout segment boundaries
>  - arbitrary pnfs filelayout stripe sizes
>
> This patchset also includes a lot of cleanup - notably we no longer need
> a separate code path to support rsize/wsize < PAGE_SIZE.
>
> This new approach opens the door to many optimizations, such as not having to
> flush a page on a non-contiguous write, but for the time being we are focusing
> on correctness -- this patchset touches the read and write path for *all*
> versions of NFS!
>
> This has been tested against v2, v3, v4.0 and v4.1 (no pnfs) servers with
> different rsize/wsize settings, and against pynfs filelayout servers hacked to
> have non page aligned stripe sizes.
>
> I had some code review already (with changes applied) and we've been testing
> this pretty extensively for the last month+ - focusing mostly on v2, v3, v4.x
> (no pnfs).
>
> The patchset applies against Trond's testing branch, but should also include
> the fix I posted earlier today: "pnfs: fix race in filelayout commit path"
> as the race seems to be easier to hit with this patchset applied.
>
> I'm pretty sure I didn't break anything in the object and block layouts, but
> some extra attention there would be helpful.
>
> I plan on sharing some performance numbers once I'm able to run some nfsometer
> workloads.
>
> Changes in V3:
>    - rebased to Anna's newest patches, which merges pageio.c into pagelist.c

Thanks! Applied...

-- 
Trond Myklebust

Linux NFS client maintainer, PrimaryData

trond.myklebust@primarydata.com

      parent reply	other threads:[~2014-05-28 23:23 UTC|newest]

Thread overview: 25+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2014-05-15 15:56 [PATCH v3 00/18] nfs: support multiple requests per page Weston Andros Adamson
2014-05-15 15:56 ` [PATCH v3 01/18] pnfs: fix race in filelayout commit path Weston Andros Adamson
2014-05-15 15:56 ` [PATCH v3 02/18] nfs: clean up PG_* flags Weston Andros Adamson
2014-05-15 15:56 ` [PATCH v3 03/18] nfs: remove unused arg from nfs_create_request Weston Andros Adamson
2014-05-15 15:56 ` [PATCH v3 04/18] nfs: modify pg_test interface to return size_t Weston Andros Adamson
2014-05-15 15:56 ` [PATCH v3 05/18] nfs: call nfs_can_coalesce_requests for every req Weston Andros Adamson
2014-05-15 15:56 ` [PATCH v3 06/18] nfs: add support for multiple nfs reqs per page Weston Andros Adamson
2014-05-15 21:12   ` Anna Schumaker
2014-05-15 22:19     ` Weston Andros Adamson
2014-05-16 12:58       ` Anna Schumaker
2014-05-15 15:56 ` [PATCH v3 07/18] nfs: page group syncing in read path Weston Andros Adamson
2014-05-15 15:56 ` [PATCH v3 08/18] nfs: page group syncing in write path Weston Andros Adamson
2014-05-15 15:56 ` [PATCH v3 09/18] nfs: page group support in nfs_mark_uptodate Weston Andros Adamson
2014-05-15 15:56 ` [PATCH v3 10/18] pnfs: clean up filelayout_alloc_commit_info Weston Andros Adamson
2014-05-15 15:56 ` [PATCH v3 11/18] nfs: allow coalescing of subpage requests Weston Andros Adamson
2014-05-15 15:56 ` [PATCH v3 12/18] nfs: chain calls to pg_test Weston Andros Adamson
2014-05-15 15:56 ` [PATCH v3 13/18] nfs: use > 1 request to handle bsize < PAGE_SIZE Weston Andros Adamson
2014-05-15 15:56 ` [PATCH v3 14/18] nfs: remove data list from pgio header Weston Andros Adamson
2014-05-15 15:56 ` [PATCH v3 15/18] pnfs: support multiple verfs per direct req Weston Andros Adamson
2014-05-15 15:56 ` [PATCH v3 16/18] pnfs: allow non page aligned pnfs layout segments Weston Andros Adamson
2014-05-15 15:56 ` [PATCH v3 17/18] pnfs: filelayout: support non page aligned layouts Weston Andros Adamson
2014-05-15 15:56 ` [PATCH v3 18/18] nfs: support page groups in nfs_read_completion Weston Andros Adamson
2014-05-19 15:37 ` [PATCH v3 00/18] nfs: support multiple requests per page Christoph Hellwig
2014-05-19 16:20   ` Weston Andros Adamson
2014-05-28 23:23 ` Trond Myklebust [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=CAHQdGtQyR9bXz7-xFfM2JTiLi6R_Vaj6rfpNweEEAL+7-iCRwA@mail.gmail.com \
    --to=trond.myklebust@primarydata.com \
    --cc=dros@primarydata.com \
    --cc=linux-nfs@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).