TG3 Performance Question

TG3 Performance Question

[Yan-Fa Li]

Hello

I'm trying to figure out some performance issues I have with
the tg3 driver.

I'm trying to increase the performance of an existing test app, a simple
http simulator, by improving the hardware.  My original setup
uses dual 1.1GHz PIII systems on 64bit-66MHz PCI slots and Serverworks LE
chipsets.  The new setup is on AMD MPX2 systems with a single Athlon
2000MP.

Because of packet reordering issues, I have restricted my app to using
only a single CPU using the cpu affinity APIs.

On the serverworks systems I have DL2K network cards and am able
to sustain 400-450mbits of traffic per system pair using a NAPIzed
driver and a hacked up 2.4.19 kernel.

On the new AMD system I'm using a fresh 2.4.20 with a TG3 card.
The DL2K cards I have, have a chipset level incompatibility with
the AMD chipset which I believe has been fixed in the TG3 driver
and has only been fixed in hardware for the DL2K so I am unable
to test them in the AMD box.

Basically I am only able to get around the same performance with
a 1.6GHz Athlon than I can with a single 1.1GHz PIII.  This
perplexes me since I thought originally I was CPU bound.

Is this:

a) network card issue (i.e. the tg3 isn't as a well documented/
   tuned as the dl2k yet) ?
b) a PCI chipset issue, i.e. the AMD MPX is kinda lame, I've seen
   comments from Alan Cox that this may be so, especially vs
   the server works chipset.
c) 400-450mbits is the best you'll ever get with a single gigE
   card in a 64bit/66MHz PCI slot ?

I'm assuming that the tg3 and 2.4.20 kernels are both NAPI, looking
through the source code seems to indicate they are.  With the DL2K
driver I am able to specify tx and rx interrupt mitigation values.
Is there an equivalent for the tg3 ?  I can't see any useful
parameters using modinfo -p.

Any suggestions you might have to increase the performance
would be appreciated.  Right now I thinking about trying the following,
a) getting a new rev of DL2K that works with the AMD or b) switching
motherboards to Serverworks again.

Thanks

Yan


[[HTML alternate version deleted]]

Re: TG3 Performance Question

[Ben Greear]

Yan-Fa Li wrote:
> Hello
> 
> I'm trying to figure out some performance issues I have with
> the tg3 driver.

Are you sure your tg3 NIC is 66/64 PCI?  For 66/64, try an e1000 NIC,
you should be able to get 800Mbps or better out of it on such a system.

Ben

-- 
Ben Greear <greearb@candelatech.com>       <Ben_Greear AT excite.com>
President of Candela Technologies Inc      http://www.candelatech.com
ScryMUD:  http://scry.wanfear.com     http://scry.wanfear.com/~greear

RE: TG3 Performance Question

[Yan-Fa Li]

Yes,

lspci:

00:08.0 Ethernet controller: Broadcom Corporation NetXtreme BCM5701 Gigabit
Ethernet (rev 15)
        Subsystem: 3Com Corporation 3C996B-T 1000BaseTX
        Flags: bus master, 66Mhz, medium devsel, latency 248, IRQ 10
        Memory at f8200000 (64-bit, non-prefetchable) [size=64K]
        Capabilities: [40] PCI-X non-bridge device.
        Capabilities: [48] Power Management version 2
        Capabilities: [50] Vital Product Data
        Capabilities: [58] Message Signalled Interrupts: 64bit+ Queue=0/3
Enable-

would seem to indicate that it is 66/66.  The latency is my fault, I set it
manually
to see if it would help performance.  Unfortunately I don't think the E1000
with
will with the AMD chipset, and I don't think Intel will be releasing a fix
somehow.
Do you have access to an AMD760MPX ?  I would love it if someone could
verify
this is a working combination before I go out and spend more money.

Y

-----Original Message-----
From: Ben Greear [mailto:greearb@candelatech.com] 
Sent: Tuesday, December 03, 2002 12:45 PM
To: Yan-Fa Li
Cc: netdev@oss.sgi.com
Subject: Re: TG3 Performance Question


Yan-Fa Li wrote:
> Hello
> 
> I'm trying to figure out some performance issues I have with the tg3 
> driver.

Are you sure your tg3 NIC is 66/64 PCI?  For 66/64, try an e1000 NIC, you
should be able to get 800Mbps or better out of it on such a system.

Ben

-- 
Ben Greear <greearb@candelatech.com>       <Ben_Greear AT excite.com>
President of Candela Technologies Inc      http://www.candelatech.com
ScryMUD:  http://scry.wanfear.com     http://scry.wanfear.com/~greear



[[HTML alternate version deleted]]

Re: TG3 Performance Question

[Ben Greear]

Yan-Fa Li wrote:

> to see if it would help performance.  Unfortunately I don't think the E1000
> with
> will with the AMD chipset, and I don't think Intel will be releasing a fix

The e1000 works with my dual AMD motherboard...

Ben


-- 
Ben Greear <greearb@candelatech.com>       <Ben_Greear AT excite.com>
President of Candela Technologies Inc      http://www.candelatech.com
ScryMUD:  http://scry.wanfear.com     http://scry.wanfear.com/~greear