NFS Performance

NFS Performance

[Gavin Woodhatch]

Hi All

I am new to the list, but have been reading the Archives.

I need to Backup about 50 GB of Data. The Data is on a NFS Mounted
Partition. A local Backup is not possible.

The Data is mainly small files (HTML Pages, Pictures etc.) But there
are also some bigger files.

The Network thruput vary's from about 1-2 MB/s to 9 -10 MB/s. It is a
100 Mbit Network (Switched), the NFS Server is connected with a 1
Gbit Link.

I am Running a 2.4.17 Kernel with Trond's 2.4.17 NFS-all Patch.


I have tried the following mount options :

-o vers=3,async,hard,intr,nolock

Varied with differnt wsize and rsize (from 4096 to 32768, and also not
specified) , also tried with the option tcp.

The Max thruput changes a bit depending on the options but the
avg. does not change a great deal. (about 80 - 120 MB/min)

The NFS Server is a Auspex NS2000.

Anyone got an Idea how to get Linux to read the small files faster, or
howto just generaly make things faster (Read) ?

Any Ideas would be most welcome.

PS Sorry for the bad spelling, my english is rather rusty...


--

Freundliche Grüsse (Kind Regards)


NetZone Ltd.
Gavin Woodhatch

******************************************************************
*  NetZone AG                                        Webhosting  *
*  http://www.netzone.ch                        info@netzone.ch  *
*  Alpenweg 12                            Tel. +41 62 724 08 08  *
*  CH-5035 Unterentfelden                 Fax. +41 62 724 08 06  *
******************************************************************


_______________________________________________
NFS maillist  -  NFS@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nfs

Re[2]: NFS Performance

[Gavin Woodhatch]

Hi Matthew

As i wrote, i have tried with the TCP Option. It did not make a big
differance.

>
> Varied with differnt wsize and rsize (from 4096 to 32768, and also not
> specified) , also tried with the option tcp.

Auspex makes high performance NAS Servers (www.auspex.com). And it
does Support NFSv3 and TCP.


Thanks very mutch for your help.

Gavin Woodhatch

NetZone Ltd.


_______________________________________________
NFS maillist  -  NFS@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nfs

RE: NFS Performance

[Lever, Charles]

what's your backup media?  your tape drive may be the
real bottleneck.

> -----Original Message-----
> From: Gavin Woodhatch [mailto:gavin.woodhatch@netzone.ch]
> Sent: Thursday, April 18, 2002 3:19 PM
> To: nfs@lists.sourceforge.net
> Subject: [NFS] NFS Performance
>=20
>=20
> Hi All
>=20
> I am new to the list, but have been reading the Archives.
>=20
> I need to Backup about 50 GB of Data. The Data is on a NFS Mounted
> Partition. A local Backup is not possible.
>=20
> The Data is mainly small files (HTML Pages, Pictures etc.) But there
> are also some bigger files.
>=20
> The Network thruput vary's from about 1-2 MB/s to 9 -10 MB/s. It is a
> 100 Mbit Network (Switched), the NFS Server is connected with a 1
> Gbit Link.
>=20
> I am Running a 2.4.17 Kernel with Trond's 2.4.17 NFS-all Patch.
>=20
>=20
> I have tried the following mount options :
>=20
> -o vers=3D3,async,hard,intr,nolock
>=20
> Varied with differnt wsize and rsize (from 4096 to 32768, and also =
not
> specified) , also tried with the option tcp.
>=20
> The Max thruput changes a bit depending on the options but the
> avg. does not change a great deal. (about 80 - 120 MB/min)
>=20
> The NFS Server is a Auspex NS2000.
>=20
> Anyone got an Idea how to get Linux to read the small files faster, =
or
> howto just generaly make things faster (Read) ?
>=20
> Any Ideas would be most welcome.
>=20
> PS Sorry for the bad spelling, my english is rather rusty...
>=20
>=20
> --
>=20
> Freundliche Gr=FCsse (Kind Regards)
>=20
>=20
> NetZone Ltd.
> Gavin Woodhatch
>=20
> ******************************************************************
> *  NetZone AG                                        Webhosting  *
> *  http://www.netzone.ch                        info@netzone.ch  *
> *  Alpenweg 12                            Tel. +41 62 724 08 08  *
> *  CH-5035 Unterentfelden                 Fax. +41 62 724 08 06  *
> ******************************************************************
>=20
>=20
> _______________________________________________
> NFS maillist  -  NFS@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/nfs
>=20

_______________________________________________
NFS maillist  -  NFS@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nfs

nfs performance

[Brasseur Valéry]

how can I measure the performance of my NFS client ?

I am using linux client with Netapp filer server.
I would like to know which is the throuput limit of the linux NFS client !

anybody got ideas ?
thanks



-------------------------------------------------------
This sf.net email is sponsored by:ThinkGeek
Welcome to geek heaven.
http://thinkgeek.com/sf
_______________________________________________
NFS maillist  -  NFS@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nfs

Re: nfs performance

[Tom McNeal]

Brasseur Valéry wrote:
> 
> how can I measure the performance of my NFS client ?
> 
> I am using linux client with Netapp filer server.
> I would like to know which is the throuput limit of the linux NFS client !
> 
> anybody got ideas ?
> thanks

I've found the best client measurement tool is IOzone, given that 
it measures varied access types (serial forward and backwards, 
random, even jumps, etc.) across various file sizes, and can put
the output into a nicely readable excel graph.  Its available at
http://www.iozone.org/

I also have IOzone packaged up in a test & measurement package that 
has a gui front end (although you still have to figure out which
of the 50+ options in IOzone you want to use).  Its at
http://sourceforge.net/projects/nfstestmatrix

Finally, take a look at the performance howto, which discusses 
various benchmarks among other things.  Its at
http://nfs.sourceforge.net/nfs-howto/performance.html

Regards -

Tom

--
------------------------------------------------------------
Tom McNeal       trmcneal@attbi.com     (650)906-0761 (cell) 
------------------------------------------------------------


-------------------------------------------------------
This sf.net email is sponsored by:ThinkGeek
Welcome to geek heaven.
http://thinkgeek.com/sf
_______________________________________________
NFS maillist  -  NFS@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nfs

Re: NFS performance

[Wu Fengguang]

Hi Yuri,

On Fri, Oct 07, 2011 at 10:45:01AM -0600, Yuri Csapo wrote:
> Hi all,
> 
> We've been battling a strange performance problem with one of our NFS
> servers. At mostly irregular intervals, our users report extremely slow
> responses. Those who are command line-challenged say that their windows
> "gray out" for a few seconds and won't let them do anything. Those who
> use the command line more report things like simple commands like cat
> taking a few seconds to "start."
> 
> On the server, the only indication we can see that anything is wrong is
> %iowait climbing above 80% while the event is happening. Running iotop
> we can see that it's the several nfsd processes that are driving IO.
> Another thing we have noticed is that when the backup process (Symantec
> NetBackup) runs, %iowait pegs at 100% for the duration.

Are there heavy writes during the time?  If so, it's likely all nfsd
processes get stuck directly on IO or indirectly on some inode mutex.

This could be improved by the "async" export option on the server side,
however at the cost of losing data in server crash events.

Thanks,
Fengguang

> I know that normally this would mean disk bottlenecks, but look at the
> specs below and you will see why I find that hard to believe. We have
> tried a ton of different monitoring tools and we are trying to fiddle
> with parameters at the NFS, tcp, and iSCSI levels to see if we can
> figure this out, so far with not a lot of luck.
> 
> The server
> ----------
> 
> . VMware virtual machine
> . 2 GB RAM, which sounds small but we rarely ever see any swapping
> . 2 cores
> . Stock CentOS 6.0 (Final)
> 
> The host
> --------
> 
> . Dell PowerEdge M610 blade
> . 2 x quad-core 2.4 GHz Xeon (L5530)
> . 48 GB RAM
> . ESXi 4
> 
> The storage
> -----------
> 
> The VM itself, as well as its system volume, reside on a group of 4
> EquaLogic ps6000 with 16 x 15K SAS disks each, on RAID50. The system
> volume (sda) is a VMware vmdk.
> 
> The data volume (sdb) is an iSCSI volume that the VM connects directly
> to, on an EquaLogic ps6510 with 48 x 3Gb/s SATA disks on RAID50.
> 
> The clients
> -----------
> 
> . About 50 clients
> . Brand new Dell Optiplexes (not sure about model)
> . 8 GB RAM
> . 2 x quad-core Intel Core i7-2600 @ 3.4 GHz
> . Ubuntu 10.04 lucid lynx LTS
> 
> The network
> -----------
> 
> . The blade has 6 NICs in 3 bonded pairs, all Gb Ethernet. One pair is
> for regular networking, one for vMotion, and one for SAN iSCSI access.
> The particular VM has two virtual (VMXNET3) NICs, one for regular
> service and one for iSCSI access. The blade links to a Cisco 3750 2
> switch stack.
> 
> . The ps6000 SAN links to the same 3750 stack through 4 bonded pairs (8
> NICs) each.
> 
> . The 3750 uplinks to a Cisco 6509.
> 
> . The 6509 downlinks to a different 3750 stack in a different building,
> through fiber, where all workstations link.
> 
> . The 6509 also links to a 3750x with 2 links of Gb Ethernet. The 3750x
> links over a 10 GB Ethernet to the ps6510 SAN.
> 
> I will appreciate any idea or insight into finding this problem.
> 
> Thanks!
> 
> Yuri
>