From: "J. Bruce Fields" <bfields@fieldses.org>
To: Christoph Hellwig <hch@lst.de>
Cc: Jeff Layton <jlayton@primarydata.com>,
linux-nfs@vger.kernel.org, linux-fsdevel@vger.kernel.org,
xfs@oss.sgi.com
Subject: Re: [PATCH 14/18] nfsd: pNFS block layout driver
Date: Tue, 6 Jan 2015 12:16:58 -0500 [thread overview]
Message-ID: <20150106171658.GD12067@fieldses.org> (raw)
In-Reply-To: <1420561721-9150-15-git-send-email-hch@lst.de>
On Tue, Jan 06, 2015 at 05:28:37PM +0100, Christoph Hellwig wrote:
> Add a small shim between core nfsd and filesystems to translate the
> somewhat cumbersome pNFS data structures and semantics to something
> more palatable for Linux filesystems.
>
> Signed-off-by: Christoph Hellwig <hch@lst.de>
> ---
> .../filesystems/nfs/pnfs-block-server.txt | 40 +++++
> fs/nfsd/Makefile | 2 +-
> fs/nfsd/blocklayout.c | 194 +++++++++++++++++++++
> fs/nfsd/blocklayoutxdr.c | 157 +++++++++++++++++
> fs/nfsd/blocklayoutxdr.h | 62 +++++++
> fs/nfsd/nfs4layouts.c | 7 +
> fs/nfsd/pnfs.h | 1 +
> 7 files changed, 462 insertions(+), 1 deletion(-)
> create mode 100644 Documentation/filesystems/nfs/pnfs-block-server.txt
> create mode 100644 fs/nfsd/blocklayout.c
> create mode 100644 fs/nfsd/blocklayoutxdr.c
> create mode 100644 fs/nfsd/blocklayoutxdr.h
>
> diff --git a/Documentation/filesystems/nfs/pnfs-block-server.txt b/Documentation/filesystems/nfs/pnfs-block-server.txt
> new file mode 100644
> index 0000000..f45d399
> --- /dev/null
> +++ b/Documentation/filesystems/nfs/pnfs-block-server.txt
> @@ -0,0 +1,40 @@
> +pNFS block layout server user guide
> +
> +The Linux NFS server now supports the pNFS block layout extension. In this
> +case the NFS server acts as Metadata Server (MDS) for pNFS, which in addition
> +to handling all the metadata access to the NFS export also hands out layouts
> +to the clients to directly access the underlying block devices that is
s/is/are/.
> +shared with the client. Note that there are no Data Servers (DSs) in the
> +block layout flavor of pNFS.
> +
> +To use pNFS block layouts with with the Linux NFS server the exported file
> +system needs to support the pNFS block layouts (current just XFS), and the
> +file system must sit on shared storage (typically iSCSI) that is accessible
> +to the clients as well as the server. The file system needs to either sit
> +directly on the exported volume, or on a RAID 0 using the MD software RAID
> +driver with the version 1 superblock format. If the filesystem uses sits
> +on a RAID 0 device the clients will automatically stripe their I/O over
> +multiple LUNs.
> +
> +On the server pNFS block volume support is automatically if the file system
s/automatically/automatically enabled/.
So there's no server-side configuration required at all?
--b.
> +support its. On the client make sure the kernel has the CONFIG_PNFS_BLOCK
> +option enabled, the blkmapd daemon from nfs-utils is running, and the
> +file system, is mounted using the NFSv4.1 protocol version (mount -o vers=4.1).
> +
> +If the nfsd server needs to fence a non-responding client it calls
> +/sbin/nfsd-recall-failed with the first argument set to the IP address of
> +the client, and the second argument set to the device node without the /dev
> +prefix for the filesystem to be fenced. Below is an example file that show
> +how to translate the device into a serial number from SCSI EVPD 0x80:
...
WARNING: multiple messages have this Message-ID (diff)
From: "J. Bruce Fields" <bfields@fieldses.org>
To: Christoph Hellwig <hch@lst.de>
Cc: linux-fsdevel@vger.kernel.org, linux-nfs@vger.kernel.org,
Jeff Layton <jlayton@primarydata.com>,
xfs@oss.sgi.com
Subject: Re: [PATCH 14/18] nfsd: pNFS block layout driver
Date: Tue, 6 Jan 2015 12:16:58 -0500 [thread overview]
Message-ID: <20150106171658.GD12067@fieldses.org> (raw)
In-Reply-To: <1420561721-9150-15-git-send-email-hch@lst.de>
On Tue, Jan 06, 2015 at 05:28:37PM +0100, Christoph Hellwig wrote:
> Add a small shim between core nfsd and filesystems to translate the
> somewhat cumbersome pNFS data structures and semantics to something
> more palatable for Linux filesystems.
>
> Signed-off-by: Christoph Hellwig <hch@lst.de>
> ---
> .../filesystems/nfs/pnfs-block-server.txt | 40 +++++
> fs/nfsd/Makefile | 2 +-
> fs/nfsd/blocklayout.c | 194 +++++++++++++++++++++
> fs/nfsd/blocklayoutxdr.c | 157 +++++++++++++++++
> fs/nfsd/blocklayoutxdr.h | 62 +++++++
> fs/nfsd/nfs4layouts.c | 7 +
> fs/nfsd/pnfs.h | 1 +
> 7 files changed, 462 insertions(+), 1 deletion(-)
> create mode 100644 Documentation/filesystems/nfs/pnfs-block-server.txt
> create mode 100644 fs/nfsd/blocklayout.c
> create mode 100644 fs/nfsd/blocklayoutxdr.c
> create mode 100644 fs/nfsd/blocklayoutxdr.h
>
> diff --git a/Documentation/filesystems/nfs/pnfs-block-server.txt b/Documentation/filesystems/nfs/pnfs-block-server.txt
> new file mode 100644
> index 0000000..f45d399
> --- /dev/null
> +++ b/Documentation/filesystems/nfs/pnfs-block-server.txt
> @@ -0,0 +1,40 @@
> +pNFS block layout server user guide
> +
> +The Linux NFS server now supports the pNFS block layout extension. In this
> +case the NFS server acts as Metadata Server (MDS) for pNFS, which in addition
> +to handling all the metadata access to the NFS export also hands out layouts
> +to the clients to directly access the underlying block devices that is
s/is/are/.
> +shared with the client. Note that there are no Data Servers (DSs) in the
> +block layout flavor of pNFS.
> +
> +To use pNFS block layouts with with the Linux NFS server the exported file
> +system needs to support the pNFS block layouts (current just XFS), and the
> +file system must sit on shared storage (typically iSCSI) that is accessible
> +to the clients as well as the server. The file system needs to either sit
> +directly on the exported volume, or on a RAID 0 using the MD software RAID
> +driver with the version 1 superblock format. If the filesystem uses sits
> +on a RAID 0 device the clients will automatically stripe their I/O over
> +multiple LUNs.
> +
> +On the server pNFS block volume support is automatically if the file system
s/automatically/automatically enabled/.
So there's no server-side configuration required at all?
--b.
> +support its. On the client make sure the kernel has the CONFIG_PNFS_BLOCK
> +option enabled, the blkmapd daemon from nfs-utils is running, and the
> +file system, is mounted using the NFSv4.1 protocol version (mount -o vers=4.1).
> +
> +If the nfsd server needs to fence a non-responding client it calls
> +/sbin/nfsd-recall-failed with the first argument set to the IP address of
> +the client, and the second argument set to the device node without the /dev
> +prefix for the filesystem to be fenced. Below is an example file that show
> +how to translate the device into a serial number from SCSI EVPD 0x80:
...
_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs
next prev parent reply other threads:[~2015-01-06 17:17 UTC|newest]
Thread overview: 153+ messages / expand[flat|nested] mbox.gz Atom feed top
2015-01-06 16:28 a simple and scalable pNFS block layout server Christoph Hellwig
2015-01-06 16:28 ` Christoph Hellwig
2015-01-06 16:28 ` Christoph Hellwig
2015-01-06 16:28 ` [PATCH 01/18] nfs: add LAYOUT_TYPE_MAX enum value Christoph Hellwig
2015-01-06 16:28 ` Christoph Hellwig
2015-01-06 16:28 ` [PATCH 02/18] fs: add FL_LAYOUT lease type Christoph Hellwig
2015-01-06 16:28 ` Christoph Hellwig
2015-01-06 18:46 ` Jeff Layton
2015-01-06 18:46 ` Jeff Layton
2015-01-07 10:30 ` Christoph Hellwig
2015-01-07 10:30 ` Christoph Hellwig
2015-01-06 16:28 ` [PATCH 03/18] nfsd: factor out a helper to decode nfstime4 values Christoph Hellwig
2015-01-06 16:28 ` Christoph Hellwig
2015-01-09 23:02 ` Tom Haynes
2015-01-09 23:02 ` Tom Haynes
2015-01-09 23:02 ` Tom Haynes
2015-01-11 11:42 ` Christoph Hellwig
2015-01-11 11:42 ` Christoph Hellwig
2015-01-11 23:53 ` Tom Haynes
2015-01-11 23:53 ` Tom Haynes
2015-01-11 23:53 ` Tom Haynes
2015-01-06 16:28 ` [PATCH 04/18] nfsd: move nfsd_fh_match to nfsfh.h Christoph Hellwig
2015-01-06 16:28 ` Christoph Hellwig
2015-01-06 16:28 ` [PATCH 05/18] nfsd: add fh_fsid_match helper Christoph Hellwig
2015-01-06 16:28 ` Christoph Hellwig
2015-01-06 16:28 ` [PATCH 06/18] nfsd: make lookup/alloc/unhash_stid available outside nfs4state.c Christoph Hellwig
2015-01-06 16:28 ` Christoph Hellwig
2015-01-06 16:28 ` [PATCH 07/18] nfsd: make find/get/put file " Christoph Hellwig
2015-01-06 16:28 ` Christoph Hellwig
2015-01-06 16:28 ` [PATCH 08/18] nfsd: make find_any_file " Christoph Hellwig
2015-01-06 16:28 ` Christoph Hellwig
2015-01-06 16:28 ` Christoph Hellwig
2015-01-06 16:28 ` [PATCH 09/18] nfsd: implement pNFS operations Christoph Hellwig
2015-01-06 16:28 ` Christoph Hellwig
2015-01-09 0:48 ` Jeff Layton
2015-01-09 0:48 ` Jeff Layton
2015-01-09 0:48 ` Jeff Layton
2015-01-09 10:05 ` Christoph Hellwig
2015-01-09 10:05 ` Christoph Hellwig
2015-01-09 16:51 ` Jeff Layton
2015-01-09 16:51 ` Jeff Layton
2015-01-09 17:16 ` Christoph Hellwig
2015-01-09 17:16 ` Christoph Hellwig
2015-01-09 17:28 ` Jeff Layton
2015-01-09 17:28 ` Jeff Layton
2015-01-09 17:33 ` Jeff Layton
2015-01-09 17:33 ` Jeff Layton
2015-01-09 17:43 ` Trond Myklebust
2015-01-09 17:43 ` Trond Myklebust
2015-01-09 18:49 ` rfc5661 errata 3901, was: " Christoph Hellwig
2015-01-14 19:16 ` Tom Haynes
2015-01-15 16:26 ` Christoph Hellwig
2015-01-15 16:30 ` [nfsv4] " Trond Myklebust
2015-01-12 17:54 ` Tom Haynes
2015-01-12 17:54 ` Tom Haynes
2015-01-12 17:54 ` Tom Haynes
2015-01-06 16:28 ` [PATCH 10/18] nfsd: implement pNFS layout recalls Christoph Hellwig
2015-01-06 16:28 ` Christoph Hellwig
2015-01-06 16:28 ` Christoph Hellwig
2015-01-06 17:25 ` J. Bruce Fields
2015-01-06 17:25 ` J. Bruce Fields
2015-01-06 17:25 ` J. Bruce Fields
2015-01-06 17:42 ` Christoph Hellwig
2015-01-06 17:42 ` Christoph Hellwig
2015-01-06 17:59 ` Tom Haynes
2015-01-06 17:59 ` Tom Haynes
2015-01-06 17:59 ` Tom Haynes
2015-01-06 16:28 ` [PATCH 11/18] nfsd: update documentation for pNFS support Christoph Hellwig
2015-01-06 16:28 ` Christoph Hellwig
2015-01-06 16:28 ` Christoph Hellwig
2015-01-06 16:28 ` [PATCH 12/18] nfsd: add trace events Christoph Hellwig
2015-01-06 16:28 ` Christoph Hellwig
2015-01-06 16:28 ` Christoph Hellwig
2015-01-06 16:28 ` [PATCH 13/18] exportfs: add methods for block layout exports Christoph Hellwig
2015-01-06 16:28 ` Christoph Hellwig
2015-01-06 16:28 ` [PATCH 14/18] nfsd: pNFS block layout driver Christoph Hellwig
2015-01-06 16:28 ` Christoph Hellwig
2015-01-06 16:28 ` Christoph Hellwig
2015-01-06 17:16 ` J. Bruce Fields [this message]
2015-01-06 17:16 ` J. Bruce Fields
2015-01-06 17:39 ` Christoph Hellwig
2015-01-06 17:39 ` Christoph Hellwig
2015-01-06 19:39 ` J. Bruce Fields
2015-01-06 19:39 ` J. Bruce Fields
2015-01-06 19:42 ` Jeff Layton
2015-01-06 19:42 ` Jeff Layton
2015-01-06 19:42 ` Jeff Layton
2015-01-07 10:28 ` Christoph Hellwig
2015-01-07 10:28 ` Christoph Hellwig
2015-01-08 20:41 ` Jeff Layton
2015-01-08 20:41 ` Jeff Layton
2015-01-08 20:54 ` J. Bruce Fields
2015-01-08 20:54 ` J. Bruce Fields
2015-01-12 4:56 ` Tom Haynes
2015-01-12 4:56 ` Tom Haynes
2015-01-12 4:56 ` Tom Haynes
2015-01-12 12:43 ` Christoph Hellwig
2015-01-12 12:43 ` Christoph Hellwig
2015-01-12 6:14 ` Tom Haynes
2015-01-12 6:14 ` Tom Haynes
2015-01-12 12:46 ` Christoph Hellwig
2015-01-12 12:46 ` Christoph Hellwig
2015-01-06 16:28 ` [PATCH 15/18] xfs: pass a 64-bit count argument to xfs_iomap_write_unwritten Christoph Hellwig
2015-01-06 16:28 ` Christoph Hellwig
2015-01-06 16:28 ` Christoph Hellwig
2015-01-06 16:28 ` [PATCH 16/18] xfs: do not allocate blocks when converting unwritten extents Christoph Hellwig
2015-01-06 16:28 ` Christoph Hellwig
2015-01-06 16:28 ` Christoph Hellwig
2015-01-06 23:21 ` Dave Chinner
2015-01-06 23:21 ` Dave Chinner
2015-01-06 16:28 ` [PATCH 17/18] xfs: implement pnfs export operations Christoph Hellwig
2015-01-06 16:28 ` Christoph Hellwig
2015-01-06 16:28 ` Christoph Hellwig
2015-01-07 0:24 ` Dave Chinner
2015-01-07 0:24 ` Dave Chinner
2015-01-07 10:40 ` Christoph Hellwig
2015-01-07 10:40 ` Christoph Hellwig
2015-01-07 10:40 ` Christoph Hellwig
2015-01-07 21:11 ` Dave Chinner
2015-01-07 21:11 ` Dave Chinner
2015-01-07 21:11 ` Dave Chinner
2015-01-08 12:43 ` Christoph Hellwig
2015-01-08 12:43 ` Christoph Hellwig
2015-01-08 21:04 ` Dave Chinner
2015-01-08 21:04 ` Dave Chinner
2015-01-09 11:41 ` Christoph Hellwig
2015-01-09 11:41 ` Christoph Hellwig
2015-01-12 3:04 ` Dave Chinner
2015-01-12 3:04 ` Dave Chinner
2015-01-12 3:04 ` Dave Chinner
2015-01-14 10:08 ` Christoph Hellwig
2015-01-14 10:08 ` Christoph Hellwig
2015-01-14 10:08 ` Christoph Hellwig
2015-01-06 16:28 ` [PATCH 18/18] xfs: recall pNFS layouts on conflicting access Christoph Hellwig
2015-01-06 16:28 ` Christoph Hellwig
2015-01-06 23:18 ` Dave Chinner
2015-01-06 23:18 ` Dave Chinner
2015-01-06 23:18 ` Dave Chinner
2015-01-07 10:31 ` Christoph Hellwig
2015-01-07 10:31 ` Christoph Hellwig
2015-01-06 17:32 ` a simple and scalable pNFS block layout server J. Bruce Fields
2015-01-06 17:32 ` J. Bruce Fields
2015-01-06 17:56 ` Christoph Hellwig
2015-01-06 17:56 ` Christoph Hellwig
2015-01-06 18:37 ` Jeff Layton
2015-01-06 18:37 ` Jeff Layton
2015-01-06 18:37 ` Jeff Layton
2015-01-06 18:39 ` Weston Andros Adamson
2015-01-06 18:39 ` Weston Andros Adamson
2015-01-06 18:39 ` Weston Andros Adamson
2015-01-06 19:17 ` J. Bruce Fields
2015-01-06 19:17 ` J. Bruce Fields
2015-01-06 19:17 ` J. Bruce Fields
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20150106171658.GD12067@fieldses.org \
--to=bfields@fieldses.org \
--cc=hch@lst.de \
--cc=jlayton@primarydata.com \
--cc=linux-fsdevel@vger.kernel.org \
--cc=linux-nfs@vger.kernel.org \
--cc=xfs@oss.sgi.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.