RE: rsockets and fork

Sridhar Samudrala
2012-08-14T18:18:09Z

On Tue, 2012-08-14 at 17:56 +0000, Hefty, Sean wrote:
> > Yes. it is also using rsockets.
> > The second session always hangs after sending a fixed number of bytes
> > (38469632).
> > rsend() blocks waiting for the CQ event.
>
> Can you send me the parameters that you use for testing?

This test is using Mellanox 10Gb RoCEE with MTU set to 9000

Server is started using
# ldr netserver -D

2 clients are started in 2 windows as follows.

# ldr netperf -v2 -c -C -H 192.168.0.22 -l10
MIGRATED TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 192.168.0.22 (192.168.0.22) port 0 AF_INET
Recv Send Send Utilization Service Demand
Socket Socket Message Elapsed Send Recv Send Recv
Size Size Size Time Throughput local remote local remote
bytes bytes bytes secs. 10^6bits/s % S % S us/KB us/KB

87380 65536 65536 10.00 9679.80 2.58 2.59 0.349 0.351

Alignment Offset Bytes Bytes Sends Bytes Recvs
Local Remote Local Remote Xfered Per Per
Send Recv Send Recv Send (avg) Recv (avg)
8 8 0 0 12101877760 65536.00 184660 21967.51 550899

Maximum
Segment
Size (bytes)
4096

# ldr netperf -v2 -c -C -H 192.168.0.22 -l10
MIGRATED TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 192.168.0.22 (192.168.0.22) port 0 AF_INET
Recv Send Send Utilization Service Demand
Socket Socket Message Elapsed Send Recv Send Recv
Size Size Size Time Throughput local remote local remote
bytes bytes bytes secs. 10^6bits/s % S % S us/KB us/KB

87380 65536 65536 10.00 30.69 2.27 2.78 96.892 118.616

Alignment Offset Bytes Bytes Sends Bytes Recvs
Local Remote Local Remote Xfered Per Per
Send Recv Send Recv Send (avg) Recv (avg)
8 8 0 0 38469632 65536.00 587 21360.15 1801

Maximum
Segment
Size (bytes)
4096