All of lore.kernel.org
 help / color / mirror / Atom feed
* Linux NFS writes to Solaris very, very slow
@ 2004-07-23 16:20 John Roberts
  2004-07-23 16:35 ` Olaf Kirch
  2004-07-26 15:17 ` async vs. sync Bernd Schubert
  0 siblings, 2 replies; 5+ messages in thread
From: John Roberts @ 2004-07-23 16:20 UTC (permalink / raw)
  To: nfs; +Cc: john_roberts


Hi there,

I work in Hillsboro, Oregon, USA for Credence Systems Corporation (as a
software engineer) and we use the Redhat Enterprise 3 (2.4.21 kernel,
a Redhat hodgepodge with some 2.6 stuff) distribution on our
x86 PCs.

We're on a network with lots of Sun systems and a central file
server that is a Veritas cluster of twin SunFire servers running
Solaris 2.8.

What we've observed is that NFS writes from our Linux boxes to
the Solaris server (and other Solaris workstations) is _very_
slow.  Reads seem to be operating at a reasonable speed.
FTP speeds are blazing (protocol below NFS).

On a completely seperate note, Linux-to-Linux NFS file writes
only seem to be fast if we publish the serving Linux volume
as asynchronous (default setting is synchronous which is slow).

I'm curious if anyone has any ideas on what I should do regarding
the slow nature of Linux clients to Solaris servers over NFS?
I don't know if anybody has encountered this or if anyone in the
Linux kernel community is looking at it.

Any thoughts/advice would be _greatly_ appreciated.

thanks,


John Roberts
john_roberts@credence.com




-------------------------------------------------------
This SF.Net email is sponsored by BEA Weblogic Workshop
FREE Java Enterprise J2EE developer tools!
Get your free copy of BEA WebLogic Workshop 8.1 today.
http://ads.osdn.com/?ad_id=4721&alloc_id=10040&op=click
_______________________________________________
NFS maillist  -  NFS@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nfs

^ permalink raw reply	[flat|nested] 5+ messages in thread
* Re: Linux NFS writes to Solaris very, very slow
@ 2004-07-23 17:04 John Roberts
  0 siblings, 0 replies; 5+ messages in thread
From: John Roberts @ 2004-07-23 17:04 UTC (permalink / raw)
  To: nfs; +Cc: john_roberts



>On Fri, Jul 23, 2004 at 09:20:34AM -0700, John Roberts wrote:
>> What we've observed is that NFS writes from our Linux boxes to
>> the Solaris server (and other Solaris workstations) is _very_
>> slow.  Reads seem to be operating at a reasonable speed.
>> FTP speeds are blazing (protocol below NFS).
>
>What are your mount options? you should be using nfsv3; v2 is
>of course terribly slow on writes.

Our Solaris server is orfsrv2, which is mounted via
autofs and "mount" returns:

orfsrv2:/export/vol/ims/apps/xemacs/2.4.21-4.0.1.EL on /opt2/xemacs type nfs 
(rw,addr=10.4.10.154)
orfsrv2:/export/vol/engr/cobalt on /ims/cobalt type nfs (rw,tcp,addr=10.4.10.154)
orfsrv2:/export/vol/engr/viper on /ims/viper type nfs (rw,addr=10.4.10.154)

Full mount list at end of this email/post, along with /etc/fstab.

I believe that we are using nfsv3.  How can I tell?
When I use your wonderful nfsstat utility it reports only
Client nfs v3 stats (although it gives both Server nfs v2
and Server nfs v3 stats).

Our distro is Redhat Enterprise Linux 3 (2.4.21-4.0.1.EL #1).

As for the Solaris server, its running Solaris 2.8.
I would assume that's nfsv3.  If I run nfsstat on another Sun
(solaris 2.8) workstation, it reports back fileserver
statistics like:

/usr/local from orfsrv2:/export/vol/ims/apps/local/5.8
 Flags:         
vers=3,proto=tcp,sec=sys,hard,intr,link,symlink,acl,rsize=32768,wsize=32768,retra
ns=5,timeo=600
 Attr cache:    acregmin=3,acregmax=60,acdirmin=30,acdirmax=60



>> On a completely seperate note, Linux-to-Linux NFS file writes
>> only seem to be fast if we publish the serving Linux volume
>> as asynchronous (default setting is synchronous which is slow).
>
>as long as your client uses nfsv2, that is to be expected. In
>NFSv2 the (mandated) default is to use sync mode, i.e. write
>each and every blob of data to disk before acknowledging the
>RPC operation.

So are you saying nfsv3 defaults to async?



Thanks for the reply!


John Roberts
john_roberts@credence.com

--------------------------mount output----------------------------
/dev/sda3 on / type ext3 (rw)
none on /proc type proc (rw)
usbdevfs on /proc/bus/usb type usbdevfs (rw)
/dev/sda1 on /boot type ext3 (rw)
none on /dev/pts type devpts (rw,gid=5,mode=620)
/dev/sda7 on /export type ext3 (rw)
/dev/sda2 on /export/home type ext3 (rw)
none on /dev/shm type tmpfs (rw)
/dev/sda5 on /var type ext3 (rw)
automount(pid2825) on /hosts type autofs 
(rw,fd=5,pgrp=2825,minproto=2,maxproto=4)
automount(pid2807) on /csc/dept type autofs 
(rw,fd=5,pgrp=2807,minproto=2,maxproto=4)
automount(pid2777) on /csc/viewstorage type autofs 
(rw,fd=5,pgrp=2777,minproto=2,maxproto=4)
automount(pid2784) on /csc/vobs type autofs 
(rw,fd=5,pgrp=2784,minproto=2,maxproto=4)
automount(pid2786) on /csc/proj type autofs 
(rw,fd=5,pgrp=2786,minproto=2,maxproto=4)
automount(pid2782) on /csc/tools type autofs 
(rw,fd=5,pgrp=2782,minproto=2,maxproto=4)
automount(pid2890) on /home type autofs (rw,fd=5,pgrp=2890,minproto=2,maxproto=4)
automount(pid2886) on /opt2 type autofs (rw,fd=5,pgrp=2886,minproto=2,maxproto=4)
automount(pid2991) on /u type autofs (rw,fd=5,pgrp=2991,minproto=2,maxproto=4)
automount(pid2981) on /et type autofs (rw,fd=5,pgrp=2981,minproto=2,maxproto=4)
automount(pid2929) on /mfg type autofs (rw,fd=5,pgrp=2929,minproto=2,maxproto=4)
automount(pid2979) on /ims type autofs (rw,fd=5,pgrp=2979,minproto=2,maxproto=4)
automount(pid2927) on /net type autofs (rw,fd=5,pgrp=2927,minproto=2,maxproto=4)
algebra.hillsboro.credence.com:/export/home/jroberts on /u/jroberts type nfs 
(rw,nosuid,tcp,soft,addr=10.4.13.147)
algebra.hillsboro.credence.com:/export/home/jroberts on /home/jroberts type nfs 
(rw,nosuid,tcp,soft,addr=10.4.13.147)
orfsrv2:/export/vol/ims/apps/xemacs/2.4.21-4.0.1.EL on /opt2/xemacs type nfs 
(rw,addr=10.4.10.154)
orfsrv2:/export/vol/engr/cobalt on /ims/cobalt type nfs (rw,tcp,addr=10.4.10.154)
orfsrv2:/export/vol/engr/viper on /ims/viper type nfs (rw,addr=10.4.10.154)


---------------------------/etc/fstab-------------------------------------
LABEL=/                 /                       ext3    defaults        1 1
LABEL=/boot             /boot                   ext3    defaults        1 2
none                    /dev/pts                devpts  gid=5,mode=620  0 0
LABEL=/export           /export                 ext3    defaults        1 2
LABEL=/export/home      /export/home            ext3    defaults        1 2
none                    /proc                   proc    defaults        0 0
none                    /dev/shm                tmpfs   defaults        0 0
LABEL=/var              /var                    ext3    defaults        1 2
/dev/sda6               swap                    swap    defaults        0 0
/dev/cdrom              /mnt/cdrom              udf,iso9660 noauto,owner,kudzu,ro 
0 0
/dev/fd0                /mnt/floppy             auto    noauto,owner,kudzu 0 0




-------------------------------------------------------
This SF.Net email is sponsored by BEA Weblogic Workshop
FREE Java Enterprise J2EE developer tools!
Get your free copy of BEA WebLogic Workshop 8.1 today.
http://ads.osdn.com/?ad_id=4721&alloc_id=10040&op=click
_______________________________________________
NFS maillist  -  NFS@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nfs

^ permalink raw reply	[flat|nested] 5+ messages in thread
* RE: Linux NFS writes to Solaris very, very slow
@ 2004-07-23 17:50 John Roberts
  0 siblings, 0 replies; 5+ messages in thread
From: John Roberts @ 2004-07-23 17:50 UTC (permalink / raw)
  To: nfs; +Cc: cstuckless, john_roberts


>I would ensure you are using NFSv3 and TCP (as opposed to UDP) mounts.

I believe I am, but still getting poor Linux client-to-Solaris server
NFS write speed.  Read performance seems okay.


>On our solaris NFS server our automount maps have the following options:
>
>-proto=tcp,vers=3

Ditto here.  For my server volume I have:
vers=3,proto=tcp,sec=sys,hard,intr,link,symlink,acl,rsize=32768,wsize=32768,retr
ans=5,timeo=600


>And on the Linux clients I can see this is the case by doing a 'cat
>/proc/mounts':
>
>nfs rw,v3,hard,intr,tcp,lock, 0 0  (edited to remove irrelevant info)

I have similar settings, but not the same.  We also use autofs to
mount the file server for us:

  nfs rw,v3,rsize=32768,wsize=32768,hard,tcp,lock,addr=orfsrv2 0 0



Thanks for the reply!


John Roberts
john_roberts@credence.com




-------------------------------------------------------
This SF.Net email is sponsored by BEA Weblogic Workshop
FREE Java Enterprise J2EE developer tools!
Get your free copy of BEA WebLogic Workshop 8.1 today.
http://ads.osdn.com/?ad_id=4721&alloc_id=10040&op=click
_______________________________________________
NFS maillist  -  NFS@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nfs

^ permalink raw reply	[flat|nested] 5+ messages in thread
end of thread, other threads:[~2004-07-26 15:18 UTC | newest]

Thread overview: 5+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2004-07-23 16:20 Linux NFS writes to Solaris very, very slow John Roberts
2004-07-23 16:35 ` Olaf Kirch
2004-07-26 15:17 ` async vs. sync Bernd Schubert
  -- strict thread matches above, loose matches on Subject: below --
2004-07-23 17:04 Linux NFS writes to Solaris very, very slow John Roberts
2004-07-23 17:50 John Roberts

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.