Re: nfsv41 over AF_VSOCK (nfs-ganesha)

["J. Bruce Fields" <bfields@redhat.com>]

On Fri, Oct 16, 2015 at 05:08:17PM -0400, Matt Benjamin wrote:
> Hi devs (CC Bruce--here is a use case for vmci sockets transport)
> 
> One of Sage's possible plans for Manilla integration would use nfs over the new Linux  vmci sockets transport integration in qemu (below) to access Cephfs via an nfs-ganesha server running in the host vm.

What does "the host vm" mean, and why is this a particularly useful
configuration?

--b.

> 
> This now experimentally works.
> 
> some notes on running nfs-ganesha over AF_VSOCK:
> 
> 1. need stefan hajnoczi's patches for
> * linux kernel (and build w/vhost-vsock support
> * qemu (and build w/vhost-vsock support)
> * nfs-utils (in vm guest)
> 
> all linked from https://github.com/stefanha?tab=repositories
> 
> 2. host and vm guest kernels must include vhost-vsock
> * host kernel should load vhost-vsock.ko
> 
> 3. start a qemu(-kvm) guest (w/patched kernel) with a vhost-vsock-pci device, e.g
> 
> /opt/qemu-vsock/bin/qemu-system-x86_64    -m 2048 -usb -name vsock1     --enable-kvm     -drive file=/opt/images/vsock.qcow,if=virtio,index=0,format=qcow2     -drive file=/opt/isos/f22.iso,media=cdrom     -net nic,model=virtio,macaddr=02:36:3e:41:1b:78     -net bridge,br=br0     -parallel none     -serial mon:stdio -device vhost-vsock-pci,id=vhost-vsock-pci0,addr=4.0,guest-cid=4  -boot c
> 
> 4. nfs-gansha (in host)
> * need nfs-ganesha and its ntirpc rpc provider with vsock support
> https://github.com/linuxbox2/nfs-ganesha (vsock branch)
> https://github.com/linuxbox2/ntirpc (vsock branch)
> 
> * configure ganesha w/vsock support
> cmake -DCMAKE_INSTALL_PREFIX=/cache/nfs-vsock -DUSE_FSAL_VFS=ON -DUSE_VSOCK -DCMAKE_C_FLAGS="-O0 -g3 -gdwarf-4" ../src
> 
> in ganesha.conf, add "nfsvsock" to Protocols list in EXPORT block
> 
> 5. mount in guest w/nfs41:
> (e.g., in fstab)
> 2:// /vsock41 nfs noauto,soft,nfsvers=4.1,sec=sys,proto=vsock,clientaddr=4,rsize=1048576,wsize=1048576 0 0
> 
> If you try this, send feedback.
> 
> Thanks!
> 
> Matt
> 
> -- 
> Matt Benjamin
> Red Hat, Inc.
> 315 West Huron Street, Suite 140A
> Ann Arbor, Michigan 48103
> 
> http://www.redhat.com/en/technologies/storage
> 
> tel.  734-707-0660
> fax.  734-769-8938
> cel.  734-216-5309
>