From: "Goetz, Patrick G" <pgoetz@math.utexas.edu>
To: "linux-nfs@vger.kernel.org" <linux-nfs@vger.kernel.org>
Subject: Re: Can we setup pNFS with multiple DSs ?
Date: Thu, 13 Jun 2019 15:30:53 +0000 [thread overview]
Message-ID: <5e952e34-bc60-c63d-54c2-d0ae72301a86@math.utexas.edu> (raw)
In-Reply-To: <28D4997E-0B02-4979-9DE3-7E87A7FD7BA1@redhat.com>
Every so often I hunt for documentation on how to set up pNFS and can
never find anything. Can someone point me to something that I can use
to test this myself?
On 6/12/19 7:07 AM, Benjamin Coddington wrote:
> Hi Jianchao,
>
> On 12 Jun 2019, at 3:55, Jianchao Wang wrote:
>
>> Hi
>>
>> I'm trying to setup a pNFS experiment environment.
>> And this is what I have got,
>> VM-0 (DS) running a iscsi target
>> VM-1 (MS) initiator, mount a XFS on the device, and export it by
>> NFS with pnfs option
>> VM-2 (Client) initiator, but not mount, running a blkmapd
>> mount the shared directory of VM-1 by NFS
>>
>> And it semes to work well as the mountstatus
>> LAYOUTGET: 14 14 0 3472 2744 1 1381 1384
>> GETDEVICEINFO: 1 1 0 196 148 0 5 5
>> LAYOUTCOMMIT: 8 8 0 2352 1368 0 1256 1257
>>
>> The kernel version I use is 4.18.19.
>>
>> And would anyone please help to clarify following questions ?
>> 1. Can I involve multiple DSs here ?
>
> Yep, you can add a new iSCSI DS with another filesystem and keep the same
> MD. The pNFS SCSI layout has support for multi-device layouts, but I don't
> think anyone has put them through the paces.
>
> The sweet spot for pNFS SCSI is large-scale FC where the fabric allows
> nodes
> different paths through different controllers. I expect the do-it-yourself
> with iSCSI target on linux to have a bit more limited performance benefits.
>
>> 2. Is this stable enough to use in production ? How about earlier
>> version, for example 4.14 ?
>
> Test it! It would be great to have more users.
>
> It would also be great to hear about your workload and if this shows any
> improvements.
>
> Last note - with SCSI layouts, there's no need to run blkmapd. The kernel
> should have all the info it needs to find the correct SCSI devices.
>
> Ben
>>> This message is from an external sender. Learn more about why this <<
>>> matters at https://links.utexas.edu/rtyclf. <<
>
next prev parent reply other threads:[~2019-06-13 15:38 UTC|newest]
Thread overview: 6+ messages / expand[flat|nested] mbox.gz Atom feed top
2019-06-12 7:55 Can we setup pNFS with multiple DSs ? Jianchao Wang
2019-06-12 12:07 ` Benjamin Coddington
2019-06-13 7:03 ` Jianchao Wang
2019-06-13 15:30 ` Goetz, Patrick G [this message]
2019-06-14 10:06 ` Benjamin Coddington
2019-06-14 15:53 ` Goetz, Patrick G
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=5e952e34-bc60-c63d-54c2-d0ae72301a86@math.utexas.edu \
--to=pgoetz@math.utexas.edu \
--cc=linux-nfs@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).