Re: NIU - Sun Neptune 10g - Transmit timed out reset (2.6.24)

Matheos Worku
2008-05-09T22:36:15Z

Jesper Krogh wrote:

> Matheos Worku wrote:
>
>> Jesper Krogh wrote:
>>
>>> David Miller wrote:
>>>
>>>> From: Jesper Krogh <jesper@krogh.cc>
>>>> Date: Fri, 09 May 2008 20:32:53 +0200
>>>>
>>>>> When it works I doesnt seem to be able to get it pass 500MB/s.
>>>>
>>>>
>>>> With this card you really need multiple cpus and multiple threads
>>>> sending data through the card in order to fill the 10Gb pipe.
>>>>
>>>> Single connections will not fill the pipe.
>>>
>>>
>>> The server is a Sun X4600 with 8 x dual-core CPU's, setup with 64
>>> NFS-threads. The other end of the fiber goes into a switch with gigabit
>>> ports connected to 48 dual-core cpus. The test was done doing a dd on a
>>> 4.5GB file from the server to /dev/null on the clients.
>>
>>
>> Are you doing a TX or RX (with respect to the 10G if)?
>
>
> Thats a transmit.. from the NFS server to the clients.

I have observed TX throughput degradation (and increased CPU
utilization) occurs with increased # of connections, when CPU count > 4
CPUs. I don't think it is related to the driver (or HW). A while ago I
prototyped a driver which drops all UDP TX packets and the throughput
degradation (and CPU utilization increase) behavior occurred though the
driver was not doing much work. LSO/TSO seems to help with the
situation though. With LSO disabled, I have observed the issue on
several 10G nics.

Regards
Matheos

>
> Jesper