Poor Fedora Core 1's NFS performance and how to tune it?

Poor Fedora Core 1's NFS performance and how to tune it?

[Guolin Cheng]

Hi,

 We installed about tens of Fedora Core 1 machines, But then found that
the FC1 NFS speed is greatly slow down contrasted with our previous
Redhat 8.0.
Our FC1's nfs speed is now at 6MB/s, while original Redhat 8.0's speed
is at 10MB/s. For both operation systems I did no special NFS tunings.

Our Original environment RH8 environment is:  Redhat 8.0, 2.4.20 vanilla
kernel without "nfs over tcp" support.

Our current environment is: Fedora Core 1, 2.4.25 vanilla kernel, with
"nfs over tcp" kernel support enabled.

But it seems that the nfs performance has no directly relationship with
"nfs over tcp" in kernel configuration. The reason is:=20

I use both RH8|FC1 clients to connect to FC1 nfs server, connections set
to either "nfs over udp" or "nfs over tcp", the speed is about the same,
ranged from 6.09MB/s to 6.30MB/s.

But from original RH8 nfs clients to RH8 nfs servers, the speed is at
10MB-11MB/s, since I compiled no "nfs over tcp" support for RH8 kernel,
the nfs connection is based on UDP traffic only.

Personally I prefer "nfs over tcp" feature enabled. Since tcp traffic is
more reliable and bring less trouble to Ops, even it is a little less
efficient.=20

I tried to increase the NFS read/write size from 1024/1024, to
4096/4096, to 8192/8192, but that makes almost no difference at all.

Any suggestions/opinions on why FC1's nfs performance is downgraded? Or
I need to adjust any other parameters?=20

Thanks.
--Guolin Cheng





-------------------------------------------------------
This SF.Net email is sponsored by: IBM Linux Tutorials
Free Linux tutorial presented by Daniel Robbins, President and CEO of
GenToo technologies. Learn everything from fundamentals to system
administration.http://ads.osdn.com/?ad_id=1470&alloc_id=3638&op=click
_______________________________________________
NFS maillist  -  NFS@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nfs

RE: Poor Fedora Core 1's NFS performance and how to tune it?

[Lever, Charles]

it is not clear from your description of the problem whether
you see this problem only when using the FC1 NFS server.  that
is, RH8 | FC1 clients are always fast against an RH8 server,
but both are always slow against an FC1 server...?

did the "sync" export option default change between RH8 and FC1?
that would be an nfs-utils change, so it would have nothing to
do with the kernel version or whether TCP was in use.

> -----Original Message-----
> From: Guolin Cheng [mailto:guolin@alexa.com]=20
> Sent: Friday, April 16, 2004 6:53 PM
> To: nfs@lists.sourceforge.net
> Cc: ops
> Subject: [NFS] Poor Fedora Core 1's NFS performance and how=20
> to tune it?
>=20
>=20
> Hi,
>=20
>  We installed about tens of Fedora Core 1 machines, But then=20
> found that
> the FC1 NFS speed is greatly slow down contrasted with our previous
> Redhat 8.0.
> Our FC1's nfs speed is now at 6MB/s, while original Redhat 8.0's speed
> is at 10MB/s. For both operation systems I did no special NFS tunings.
>=20
> Our Original environment RH8 environment is:  Redhat 8.0,=20
> 2.4.20 vanilla
> kernel without "nfs over tcp" support.
>=20
> Our current environment is: Fedora Core 1, 2.4.25 vanilla kernel, with
> "nfs over tcp" kernel support enabled.
>=20
> But it seems that the nfs performance has no directly=20
> relationship with
> "nfs over tcp" in kernel configuration. The reason is:=20
>=20
> I use both RH8|FC1 clients to connect to FC1 nfs server,=20
> connections set
> to either "nfs over udp" or "nfs over tcp", the speed is=20
> about the same,
> ranged from 6.09MB/s to 6.30MB/s.
>=20
> But from original RH8 nfs clients to RH8 nfs servers, the speed is at
> 10MB-11MB/s, since I compiled no "nfs over tcp" support for=20
> RH8 kernel,
> the nfs connection is based on UDP traffic only.
>=20
> Personally I prefer "nfs over tcp" feature enabled. Since tcp=20
> traffic is
> more reliable and bring less trouble to Ops, even it is a little less
> efficient.=20
>=20
> I tried to increase the NFS read/write size from 1024/1024, to
> 4096/4096, to 8192/8192, but that makes almost no difference at all.
>=20
> Any suggestions/opinions on why FC1's nfs performance is=20
> downgraded? Or
> I need to adjust any other parameters?=20
>=20
> Thanks.
> --Guolin Cheng
>=20
>=20
>=20
>=20
>=20
> -------------------------------------------------------
> This SF.Net email is sponsored by: IBM Linux Tutorials
> Free Linux tutorial presented by Daniel Robbins, President and CEO of
> GenToo technologies. Learn everything from fundamentals to system
> administration.http://ads.osdn.com/?ad_id=1470&alloc_id638&op=3Dick
> _______________________________________________
> NFS maillist  -  NFS@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/nfs
>=20


-------------------------------------------------------
This SF.Net email is sponsored by: IBM Linux Tutorials
Free Linux tutorial presented by Daniel Robbins, President and CEO of
GenToo technologies. Learn everything from fundamentals to system
administration.http://ads.osdn.com/?ad_id=1470&alloc_id=3638&op=click
_______________________________________________
NFS maillist  -  NFS@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nfs

Re: Poor Fedora Core 1's NFS performance and how to tune it?

[Steve Dickson]

Guolin Cheng wrote:

>Hi,
>
> We installed about tens of Fedora Core 1 machines, But then found that
>the FC1 NFS speed is greatly slow down contrasted with our previous
>Redhat 8.0.
>Our FC1's nfs speed is now at 6MB/s, while original Redhat 8.0's speed
>is at 10MB/s. For both operation systems I did no special NFS tunings
>  
>
Are you seeing any rpc/tcp transmits? nfsstat will show rpc retrans and
netstat will show tcp retrans... Also any type of messages being logged
to /var/log/messages?

SteveD.


-------------------------------------------------------
This SF.Net email is sponsored by: IBM Linux Tutorials
Free Linux tutorial presented by Daniel Robbins, President and CEO of
GenToo technologies. Learn everything from fundamentals to system
administration.http://ads.osdn.com/?ad_id=1470&alloc_id=3638&op=click
_______________________________________________
NFS maillist  -  NFS@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nfs

RE: Poor Fedora Core 1's NFS performance and how to tune it?

[Guolin Cheng]

Hi, Steve,

 Thanks for your reply.

 But I've already figured out that it is not a Fedora Core 1 NFS
problem, it is tg3 driver (for Broadcom gigabit) problem. The
problematic dirver uses more CPUs cycles, and offers only 60% speed
compared to the vendor's bcm5700 driver.

My former email has more details.

Thanks.
--Guolin Cheng


-----Original Message-----
From: Steve Dickson [mailto:SteveD@redhat.com]=20
Sent: Monday, April 19, 2004 7:16 AM
To: Guolin Cheng
Cc: nfs@lists.sourceforge.net; ops
Subject: Re: [NFS] Poor Fedora Core 1's NFS performance and how to tune
it?

Guolin Cheng wrote:

>Hi,
>
> We installed about tens of Fedora Core 1 machines, But then found that
>the FC1 NFS speed is greatly slow down contrasted with our previous
>Redhat 8.0.
>Our FC1's nfs speed is now at 6MB/s, while original Redhat 8.0's speed
>is at 10MB/s. For both operation systems I did no special NFS tunings
> =20
>
Are you seeing any rpc/tcp transmits? nfsstat will show rpc retrans and
netstat will show tcp retrans... Also any type of messages being logged
to /var/log/messages?

SteveD.




-------------------------------------------------------
This SF.Net email is sponsored by: IBM Linux Tutorials
Free Linux tutorial presented by Daniel Robbins, President and CEO of
GenToo technologies. Learn everything from fundamentals to system
administration.http://ads.osdn.com/?ad_id=1470&alloc_id=3638&op=click
_______________________________________________
NFS maillist  -  NFS@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nfs