TSO + e1000

TSO + e1000

[Anton Blanchard]

[-- Attachment #1: Type: text/plain, Size: 1662 bytes --]


Hi,

I had another look at our TSO issues. A few things:

1. tcpdump doesnt report local TSO packets, it simply prints bad-len. I
think this is because the e1000 driver is zeroing out the IP header
length in e1000_tso:

	skb->nh.iph->tot_len = 0;

Does the card require this for TSO to operate? Ive worked around it in 
tcpdump for the time being.

2. TSO never gets reenabled after a retransmit. With long lasting
connections this hurts, we get one retransmit and its all over. Not so
important for a web server, but we have big CIFS (windows networking)
servers where connections can last days. When its working TSO gives us a
nice bump here.

3. Im getting e1000 rx fifo overruns on the receive side. Doubling the
flow control watermarks seems to help. Due to bug 2, whenever we get an
rx fifo overrun TSO gets disabled on that connection.

4. Im seeing some strange stuff during connection startup.
I have bumped win_divisor to 2 (so TSO gets enabled in a reasonable
time). There are nice big send and receive socket buffers (512k).

Id expect TSO to cut in fairly quickly. The both direction test is as Id
expect. It takes a few packets for our slow start window to grow and
then we start sending TSO packets (evidenced by the first bad-len)
packet.

Now if we do a single direction test it takes forever for TSO to kick
in. At the moment Im not sure why this is happening, tcp_current_mss
seems to grow correctly in both cases. Is there somewhere else we are
capping TSO packets?

Finally, I set divisor to 1 and you can see for both tests TSO cuts
right in. I cant explain the big difference between divisor = 1 and
divisor = 2 yet, any thoughts?

Anton

[-- Attachment #2: divisor_2_both --]
[-- Type: text/plain, Size: 3280 bytes --]

22:30:12.084166 IP 10.0.0.2.32822 > 10.0.0.1.12865: S 4036823371:4036823371(0) win 5840 <mss 1460,sackOK,timestamp 1791329 0,nop,wscale 8>
22:30:12.084438 IP 10.0.0.1.12865 > 10.0.0.2.32822: S 4047144990:4047144990(0) ack 4036823372 win 5792 <mss 1460,sackOK,timestamp 1791329 1791329,nop,wscale 8>
22:30:12.084462 IP 10.0.0.2.32822 > 10.0.0.1.12865: . ack 1 win 23 <nop,nop,timestamp 1791329 1791329>
22:30:12.084484 IP 10.0.0.2.32822 > 10.0.0.1.12865: . 1:1449(1448) ack 1 win 23 <nop,nop,timestamp 1791329 1791329>
22:30:12.084491 IP 10.0.0.2.32822 > 10.0.0.1.12865: . 1449:2897(1448) ack 1 win 23 <nop,nop,timestamp 1791329 1791329>
22:30:12.084509 IP 10.0.0.2.32822 > 10.0.0.1.12865: P 2897:4345(1448) ack 1 win 23 <nop,nop,timestamp 1791329 1791329>
22:30:12.084688 IP 10.0.0.1.12865 > 10.0.0.2.32822: . ack 1449 win 34 <nop,nop,timestamp 1791330 1791329>
22:30:12.084690 IP 10.0.0.1.12865 > 10.0.0.2.32822: . ack 2897 win 46 <nop,nop,timestamp 1791330 1791329>
22:30:12.084691 IP 10.0.0.1.12865 > 10.0.0.2.32822: . ack 4345 win 57 <nop,nop,timestamp 1791330 1791329>
22:30:12.084721 IP 10.0.0.2.32822 > 10.0.0.1.12865: . 4345:5793(1448) ack 1 win 23 <nop,nop,timestamp 1791330 1791330>
22:30:12.084726 IP 10.0.0.2.32822 > 10.0.0.1.12865: . 5793:7241(1448) ack 1 win 23 <nop,nop,timestamp 1791330 1791330>
22:30:12.084938 IP 10.0.0.1.12865 > 10.0.0.2.32822: . ack 5793 win 68 <nop,nop,timestamp 1791330 1791330>
22:30:12.084939 IP 10.0.0.1.12865 > 10.0.0.2.32822: . ack 7241 win 80 <nop,nop,timestamp 1791330 1791330>
22:30:12.084975 IP 10.0.0.2.32822 > 10.0.0.1.12865: P 7241:8677(1436) ack 1 win 23 <nop,nop,timestamp 1791330 1791330>
22:30:12.085187 IP 10.0.0.1.12865 > 10.0.0.2.32822: . ack 8677 win 91 <nop,nop,timestamp 1791330 1791330>
22:30:12.085188 IP 10.0.0.1.12865 > 10.0.0.2.32822: . 1:1449(1448) ack 8677 win 91 <nop,nop,timestamp 1791330 1791330>
22:30:12.085189 IP 10.0.0.1.12865 > 10.0.0.2.32822: . 1449:2897(1448) ack 8677 win 91 <nop,nop,timestamp 1791330 1791330>
22:30:12.085190 IP 10.0.0.1.12865 > 10.0.0.2.32822: P 2897:4345(1448) ack 8677 win 91 <nop,nop,timestamp 1791330 1791330>
22:30:12.085218 IP 10.0.0.2.32822 > 10.0.0.1.12865: . ack 1449 win 35 <nop,nop,timestamp 1791330 1791330>
22:30:12.085228 IP 10.0.0.2.32822 > 10.0.0.1.12865: . ack 2897 win 46 <nop,nop,timestamp 1791330 1791330>
22:30:12.085234 IP 10.0.0.2.32822 > 10.0.0.1.12865: . ack 4345 win 57 <nop,nop,timestamp 1791330 1791330>
22:30:12.085438 IP 10.0.0.1.12865 > 10.0.0.2.32822: . 4345:5793(1448) ack 8677 win 91 <nop,nop,timestamp 1791330 1791330>
22:30:12.085439 IP 10.0.0.1.12865 > 10.0.0.2.32822: . 5793:7241(1448) ack 8677 win 91 <nop,nop,timestamp 1791330 1791330>
22:30:12.085464 IP 10.0.0.2.32822 > 10.0.0.1.12865: . ack 5793 win 69 <nop,nop,timestamp 1791330 1791330>
22:30:12.085474 IP 10.0.0.2.32822 > 10.0.0.1.12865: . ack 7241 win 80 <nop,nop,timestamp 1791330 1791330>
22:30:12.085687 IP 10.0.0.1.12865 > 10.0.0.2.32822: P 7241:8677(1436) ack 8677 win 91 <nop,nop,timestamp 1791331 1791330>
22:30:12.085705 IP 10.0.0.2.32822 > 10.0.0.1.12865: . ack 8677 win 91 <nop,nop,timestamp 1791331 1791331>
22:30:12.087676 IP bad-len 0
22:30:12.087687 IP bad-len 0
22:30:12.087937 IP 10.0.0.1.12865 > 10.0.0.2.32822: . ack 14469 win 136 <nop,nop,timestamp 1791333 1791333>

[-- Attachment #3: divisor_2_single.wGmSv6 --]
[-- Type: text/plain, Size: 31346 bytes --]

22:30:12.096111 IP 10.0.0.2.32824 > 10.0.0.1.32823: S 4033033338:4033033338(0) win 5840 <mss 1460,sackOK,timestamp 1791341 0,nop,wscale 8>
22:30:12.096308 IP 10.0.0.1.32823 > 10.0.0.2.32824: S 4044444323:4044444323(0) ack 4033033339 win 5792 <mss 1460,sackOK,timestamp 1791341 1791341,nop,wscale 8>
22:30:12.096327 IP 10.0.0.2.32824 > 10.0.0.1.32823: . ack 1 win 23 <nop,nop,timestamp 1791341 1791341>
22:30:12.096354 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 1:1449(1448) ack 1 win 23 <nop,nop,timestamp 1791341 1791341>
22:30:12.096362 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 1449:2897(1448) ack 1 win 23 <nop,nop,timestamp 1791341 1791341>
22:30:12.096377 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 2897:4345(1448) ack 1 win 23 <nop,nop,timestamp 1791341 1791341>
22:30:12.096558 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 1449 win 34 <nop,nop,timestamp 1791341 1791341>
22:30:12.096559 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 2897 win 46 <nop,nop,timestamp 1791341 1791341>
22:30:12.096560 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 4345 win 57 <nop,nop,timestamp 1791341 1791341>
22:30:12.096664 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 4345:5793(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791341>
22:30:12.096670 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 5793:7241(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791341>
22:30:12.096685 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 7241:8689(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791341>
22:30:12.096691 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 8689:10137(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791341>
22:30:12.096706 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 10137:11585(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791341>
22:30:12.096711 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 11585:13033(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791341>
22:30:12.096934 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 5793 win 68 <nop,nop,timestamp 1791342 1791342>
22:30:12.096966 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 13033:14481(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.096970 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 14481:15929(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.096935 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 7241 win 80 <nop,nop,timestamp 1791342 1791342>
22:30:12.096984 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 15929:17377(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.096988 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 17377:18825(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.096936 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 8689 win 91 <nop,nop,timestamp 1791342 1791342>
22:30:12.097004 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 18825:20273(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097008 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 20273:21721(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.096937 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 10137 win 102 <nop,nop,timestamp 1791342 1791342>
22:30:12.097021 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 21721:23169(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097026 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 23169:24617(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.096938 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 11585 win 114 <nop,nop,timestamp 1791342 1791342>
22:30:12.097040 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 24617:26065(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097043 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 26065:27513(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.096938 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 13033 win 125 <nop,nop,timestamp 1791342 1791342>
22:30:12.097060 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 27513:28961(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097066 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 28961:30409(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097183 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 14481 win 136 <nop,nop,timestamp 1791342 1791342>
22:30:12.097216 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 30409:31857(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097221 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 31857:33305(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097184 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 15929 win 148 <nop,nop,timestamp 1791342 1791342>
22:30:12.097240 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 33305:34753(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097244 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 34753:36201(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097185 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 17377 win 159 <nop,nop,timestamp 1791342 1791342>
22:30:12.097258 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 36201:37649(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097262 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 37649:39097(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097186 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 18825 win 170 <nop,nop,timestamp 1791342 1791342>
22:30:12.097276 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 39097:40545(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097280 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 40545:41993(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097187 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 20273 win 181 <nop,nop,timestamp 1791342 1791342>
22:30:12.097293 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 41993:43441(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097297 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 43441:44889(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097187 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 21721 win 193 <nop,nop,timestamp 1791342 1791342>
22:30:12.097311 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 44889:46337(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097316 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 46337:47785(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097309 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 23169 win 204 <nop,nop,timestamp 1791342 1791342>
22:30:12.097344 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 47785:49233(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097348 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 49233:50681(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097310 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 24617 win 215 <nop,nop,timestamp 1791342 1791342>
22:30:12.097360 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 50681:52129(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097364 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 52129:53577(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097311 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 26065 win 227 <nop,nop,timestamp 1791342 1791342>
22:30:12.097375 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 53577:55025(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097378 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 55025:56473(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097311 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 27513 win 238 <nop,nop,timestamp 1791342 1791342>
22:30:12.097390 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 56473:57921(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097393 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 57921:59369(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097312 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 28961 win 249 <nop,nop,timestamp 1791342 1791342>
22:30:12.097405 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 59369:60817(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097408 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 60817:62265(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097313 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 30409 win 261 <nop,nop,timestamp 1791342 1791342>
22:30:12.097419 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 62265:63713(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097423 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 63713:65161(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097434 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 31857 win 272 <nop,nop,timestamp 1791342 1791342>
22:30:12.097477 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 65161:66609(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097482 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 66609:68057(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097435 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 33305 win 283 <nop,nop,timestamp 1791342 1791342>
22:30:12.097495 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 68057:69505(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097497 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 69505:70953(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097435 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 34753 win 295 <nop,nop,timestamp 1791342 1791342>
22:30:12.097510 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 70953:72401(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097514 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 72401:73849(1448) ack 1 win 23 <nop,nop,timestamp 1791342 1791342>
22:30:12.097436 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 36201 win 306 <nop,nop,timestamp 1791342 1791342>
22:30:12.097535 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 73849:75297(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791342>
22:30:12.097538 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 75297:76745(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791342>
22:30:12.097437 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 37649 win 317 <nop,nop,timestamp 1791342 1791342>
22:30:12.097551 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 76745:78193(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791342>
22:30:12.097555 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 78193:79641(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791342>
22:30:12.097437 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 39097 win 329 <nop,nop,timestamp 1791342 1791342>
22:30:12.097575 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 79641:81089(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791342>
22:30:12.097579 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 81089:82537(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791342>
22:30:12.097558 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 40545 win 340 <nop,nop,timestamp 1791342 1791342>
22:30:12.097614 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 82537:83985(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791342>
22:30:12.097619 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 83985:85433(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791342>
22:30:12.097559 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 41993 win 351 <nop,nop,timestamp 1791342 1791342>
22:30:12.097634 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 85433:86881(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791342>
22:30:12.097638 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 86881:88329(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791342>
22:30:12.097561 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 43441 win 362 <nop,nop,timestamp 1791342 1791342>
22:30:12.097650 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 88329:89777(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791342>
22:30:12.097654 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 89777:91225(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791342>
22:30:12.097562 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 44889 win 374 <nop,nop,timestamp 1791342 1791342>
22:30:12.097666 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 91225:92673(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791342>
22:30:12.097669 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 92673:94121(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791342>
22:30:12.097562 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 46337 win 385 <nop,nop,timestamp 1791342 1791342>
22:30:12.097683 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 94121:95569(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791342>
22:30:12.097688 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 95569:97017(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791342>
22:30:12.097563 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 47785 win 396 <nop,nop,timestamp 1791342 1791342>
22:30:12.097704 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 97017:98465(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791342>
22:30:12.097709 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 98465:99913(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791342>
22:30:12.097683 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 57921 win 476 <nop,nop,timestamp 1791343 1791342>
22:30:12.097564 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 49233 win 408 <nop,nop,timestamp 1791342 1791342>
22:30:12.097728 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 99913:101361(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097733 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 101361:102809(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097737 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 102809:104257(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097741 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 104257:105705(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097744 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 105705:107153(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097748 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 107153:108601(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097752 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 108601:110049(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097755 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 110049:111497(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097684 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 59369 win 487 <nop,nop,timestamp 1791343 1791342>
22:30:12.097565 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 50681 win 419 <nop,nop,timestamp 1791342 1791342>
22:30:12.097768 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 111497:112945(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097773 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 112945:114393(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097685 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 60817 win 498 <nop,nop,timestamp 1791343 1791342>
22:30:12.097565 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 52129 win 430 <nop,nop,timestamp 1791343 1791342>
22:30:12.097786 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 114393:115841(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097790 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 115841:117289(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097686 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 62265 win 510 <nop,nop,timestamp 1791343 1791342>
22:30:12.097586 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 53577 win 442 <nop,nop,timestamp 1791343 1791342>
22:30:12.097804 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 117289:118737(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097809 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 118737:120185(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097702 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 63713 win 521 <nop,nop,timestamp 1791343 1791342>
22:30:12.097586 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 55025 win 453 <nop,nop,timestamp 1791343 1791342>
22:30:12.097826 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 120185:121633(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097832 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 121633:123081(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097703 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 65161 win 532 <nop,nop,timestamp 1791343 1791342>
22:30:12.097587 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 56473 win 464 <nop,nop,timestamp 1791343 1791342>
22:30:12.097809 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 66609 win 543 <nop,nop,timestamp 1791343 1791342>
22:30:12.097849 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 123081:124529(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097855 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 124529:125977(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097873 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 125977:127425(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097881 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 127425:128873(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097810 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 68057 win 555 <nop,nop,timestamp 1791343 1791342>
22:30:12.097897 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 128873:130321(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097903 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 130321:131769(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097811 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 69505 win 566 <nop,nop,timestamp 1791343 1791342>
22:30:12.097915 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 131769:133217(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097919 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 133217:134665(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097812 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 70953 win 577 <nop,nop,timestamp 1791343 1791342>
22:30:12.097932 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 134665:136113(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097940 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 136113:137561(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097812 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 72401 win 589 <nop,nop,timestamp 1791343 1791342>
22:30:12.097956 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 137561:139009(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097935 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 86881 win 702 <nop,nop,timestamp 1791343 1791343>
22:30:12.097964 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 139009:140457(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097813 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 73849 win 600 <nop,nop,timestamp 1791343 1791342>
22:30:12.097986 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 140457:141905(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097992 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 141905:143353(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097996 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 143353:144801(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098000 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 144801:146249(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098004 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 146249:147697(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098008 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 147697:149145(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098011 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 149145:150593(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098014 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 150593:152041(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098018 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 152041:153489(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098026 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 153489:154937(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098031 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 154937:156385(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097936 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 88329 win 713 <nop,nop,timestamp 1791343 1791343>
22:30:12.097814 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 75297 win 611 <nop,nop,timestamp 1791343 1791343>
22:30:12.098044 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 156385:157833(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098048 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 157833:159281(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097937 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 89777 win 724 <nop,nop,timestamp 1791343 1791343>
22:30:12.097815 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 76745 win 623 <nop,nop,timestamp 1791343 1791343>
22:30:12.098064 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 159281:160729(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098058 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 102809 win 770 <nop,nop,timestamp 1791343 1791343>
22:30:12.098072 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 160729:162177(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097938 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 91225 win 736 <nop,nop,timestamp 1791343 1791343>
22:30:12.098089 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 162177:163625(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098094 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 163625:165073(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098098 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 165073:166521(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098101 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 166521:167969(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098105 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 167969:169417(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098108 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 169417:170865(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098112 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 170865:172313(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098115 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 172313:173761(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098119 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 173761:175209(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098123 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 175209:176657(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098059 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 114393 win 770 <nop,nop,timestamp 1791343 1791343>
22:30:12.097940 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 92673 win 747 <nop,nop,timestamp 1791343 1791343>
22:30:12.097816 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 78193 win 634 <nop,nop,timestamp 1791343 1791343>
22:30:12.098139 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 176657:178105(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098144 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 178105:179553(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098147 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 179553:181001(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098150 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 181001:182449(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098154 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 182449:183897(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098157 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 183897:185345(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098161 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 185345:186793(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098164 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 186793:188241(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098168 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 188241:189689(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.097941 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 94121 win 758 <nop,nop,timestamp 1791343 1791343>
22:30:12.097818 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 79641 win 645 <nop,nop,timestamp 1791343 1791343>
22:30:12.097942 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 95569 win 770 <nop,nop,timestamp 1791343 1791343>
22:30:12.097818 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 81089 win 657 <nop,nop,timestamp 1791343 1791343>
22:30:12.097943 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 97017 win 770 <nop,nop,timestamp 1791343 1791343>
22:30:12.097819 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 82537 win 668 <nop,nop,timestamp 1791343 1791343>
22:30:12.097944 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 98465 win 770 <nop,nop,timestamp 1791343 1791343>
22:30:12.097820 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 83985 win 679 <nop,nop,timestamp 1791343 1791343>
22:30:12.097837 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 85433 win 691 <nop,nop,timestamp 1791343 1791343>
22:30:12.098183 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 127425 win 770 <nop,nop,timestamp 1791343 1791343>
22:30:12.098210 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 189689:191137(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098215 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 191137:192585(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098217 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 192585:194033(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098221 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 194033:195481(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098225 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 195481:196929(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098229 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 196929:198377(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098233 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 198377:199825(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098237 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 199825:201273(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098240 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 201273:202721(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098244 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 202721:204169(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098307 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 133217 win 770 <nop,nop,timestamp 1791343 1791343>
22:30:12.098343 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 204169:205617(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098349 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 205617:207065(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098353 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 207065:208513(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098357 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 208513:209961(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098360 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 209961:211409(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098308 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 136113 win 770 <nop,nop,timestamp 1791343 1791343>
22:30:12.098372 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 211409:212857(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098378 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 212857:214305(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098381 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 214305:215753(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098309 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 139009 win 770 <nop,nop,timestamp 1791343 1791343>
22:30:12.098393 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 215753:217201(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098399 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 217201:218649(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098402 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 218649:220097(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098310 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 141905 win 770 <nop,nop,timestamp 1791343 1791343>
22:30:12.098415 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 220097:221545(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098420 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 221545:222993(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098423 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 222993:224441(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098310 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 144801 win 770 <nop,nop,timestamp 1791343 1791343>
22:30:12.098433 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 156385 win 770 <nop,nop,timestamp 1791343 1791343>
22:30:12.098486 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 224441:225889(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098493 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 225889:227337(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098497 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 227337:228785(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098511 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 228785:230233(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098516 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 230233:231681(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098520 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 231681:233129(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098524 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 233129:234577(1448) ack 1 win 23 <nop,nop,timestamp 1791343 1791343>
22:30:12.098526 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 234577:236025(1448) ack 1 win 23 <nop,nop,timestamp 1791344 1791343>
22:30:12.098530 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 236025:237473(1448) ack 1 win 23 <nop,nop,timestamp 1791344 1791343>
22:30:12.098534 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 237473:238921(1448) ack 1 win 23 <nop,nop,timestamp 1791344 1791343>
22:30:12.098538 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 238921:240369(1448) ack 1 win 23 <nop,nop,timestamp 1791344 1791343>
22:30:12.098542 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 240369:241817(1448) ack 1 win 23 <nop,nop,timestamp 1791344 1791343>
22:30:12.098558 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 167969 win 770 <nop,nop,timestamp 1791343 1791343>
22:30:12.098559 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 170865 win 770 <nop,nop,timestamp 1791343 1791343>
22:30:12.098618 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 241817:243265(1448) ack 1 win 23 <nop,nop,timestamp 1791344 1791343>
22:30:12.098624 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 243265:244713(1448) ack 1 win 23 <nop,nop,timestamp 1791344 1791343>
22:30:12.098628 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 244713:246161(1448) ack 1 win 23 <nop,nop,timestamp 1791344 1791343>
22:30:12.098630 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 246161:247609(1448) ack 1 win 23 <nop,nop,timestamp 1791344 1791343>
22:30:12.098634 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 247609:249057(1448) ack 1 win 23 <nop,nop,timestamp 1791344 1791343>
22:30:12.098639 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 249057:250505(1448) ack 1 win 23 <nop,nop,timestamp 1791344 1791343>
22:30:12.098643 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 250505:251953(1448) ack 1 win 23 <nop,nop,timestamp 1791344 1791343>
22:30:12.098647 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 251953:253401(1448) ack 1 win 23 <nop,nop,timestamp 1791344 1791343>
22:30:12.098650 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 253401:254849(1448) ack 1 win 23 <nop,nop,timestamp 1791344 1791343>
22:30:12.098662 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 254849:256297(1448) ack 1 win 23 <nop,nop,timestamp 1791344 1791343>
22:30:12.098667 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 256297:257745(1448) ack 1 win 23 <nop,nop,timestamp 1791344 1791343>
22:30:12.098670 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 257745:259193(1448) ack 1 win 23 <nop,nop,timestamp 1791344 1791343>
22:30:12.098683 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 186793 win 770 <nop,nop,timestamp 1791344 1791343>
22:30:12.098716 IP 10.0.0.2.32824 > 10.0.0.1.32823: P 259193:260641(1448) ack 1 win 23 <nop,nop,timestamp 1791344 1791344>
22:30:12.098720 IP 10.0.0.2.32824 > 10.0.0.1.32823: . 260641:262089(1448) ack 1 win 23 <nop,nop,timestamp 1791344 1791344>
22:30:12.098724 IP bad-len 0
22:30:12.098728 IP bad-len 0
22:30:12.098732 IP bad-len 0
22:30:12.098808 IP 10.0.0.1.32823 > 10.0.0.2.32824: . ack 195481 win 770 <nop,nop,timestamp 1791344 1791343>

[-- Attachment #4: divisor_1_both --]
[-- Type: text/plain, Size: 537 bytes --]

23:11:58.916027 IP 10.0.0.2.32844 > 10.0.0.1.12865: S 2407413166:2407413166(0) win 5840 <mss 1460,sackOK,timestamp 4298161 0,nop,wscale 8>
23:11:58.916302 IP 10.0.0.1.12865 > 10.0.0.2.32844: S 2406390542:2406390542(0) ack 2407413167 win 5792 <mss 1460,sackOK,timestamp 4298161 4298161,nop,wscale 8>
23:11:58.916320 IP 10.0.0.2.32844 > 10.0.0.1.12865: . ack 1 win 23 <nop,nop,timestamp 4298161 4298161>
23:11:58.916340 IP bad-len 0
23:11:58.916552 IP 10.0.0.1.12865 > 10.0.0.2.32844: . ack 1449 win 34 <nop,nop,timestamp 4298161 4298161>

[-- Attachment #5: divisor_1_single --]
[-- Type: text/plain, Size: 537 bytes --]

23:11:58.928030 IP 10.0.0.2.32846 > 10.0.0.1.32845: S 2408171237:2408171237(0) win 5840 <mss 1460,sackOK,timestamp 4298173 0,nop,wscale 8>
23:11:58.928298 IP 10.0.0.1.32845 > 10.0.0.2.32846: S 2406622866:2406622866(0) ack 2408171238 win 5792 <mss 1460,sackOK,timestamp 4298173 4298173,nop,wscale 8>
23:11:58.928315 IP 10.0.0.2.32846 > 10.0.0.1.32845: . ack 1 win 23 <nop,nop,timestamp 4298173 4298173>
23:11:58.928348 IP bad-len 0
23:11:58.928548 IP 10.0.0.1.32845 > 10.0.0.2.32846: . ack 1449 win 34 <nop,nop,timestamp 4298173 4298173>

Re: TSO + e1000

[Herbert Xu]

Anton Blanchard <anton@samba.org> wrote:
> 
> 1. tcpdump doesnt report local TSO packets, it simply prints bad-len. I
> think this is because the e1000 driver is zeroing out the IP header
> length in e1000_tso:
> 
>        skb->nh.iph->tot_len = 0;
> 
> Does the card require this for TSO to operate? Ive worked around it in 
> tcpdump for the time being.

This is a bug in e1000.  Even if it is required it isn't allowed to
modify a cloned packet.  It'll need to copy it so that other clone
users aren't affected.
 
> Now if we do a single direction test it takes forever for TSO to kick
> in. At the moment Im not sure why this is happening, tcp_current_mss
> seems to grow correctly in both cases. Is there somewhere else we are
> capping TSO packets?

What call does your application use to do the sending?

Cheers,
-- 
Visit Openswan at http://www.openswan.org/
Email: Herbert Xu ~{PmV>HI~} <herbert@gondor.apana.org.au>
Home Page: http://gondor.apana.org.au/~herbert/
PGP Key: http://gondor.apana.org.au/~herbert/pubkey.txt

Re: TSO + e1000

[Anton Blanchard]

 
> > Now if we do a single direction test it takes forever for TSO to kick
> > in. At the moment Im not sure why this is happening, tcp_current_mss
> > seems to grow correctly in both cases. Is there somewhere else we are
> > capping TSO packets?
> 
> What call does your application use to do the sending?

Just doing big writes:

send(4, " !\"#$%&\'()*+,-./0123456789:;<=>?"..., 262144, 0) = 262144

Anton

Re: TSO + e1000

[Anton Blanchard]

 
> This is a bug in e1000.  Even if it is required it isn't allowed to
> modify a cloned packet.  It'll need to copy it so that other clone
> users aren't affected.

It looks like the tg3 is doing a similar thing.

Anton

Re: TSO + e1000

[David S. Miller]

On Mon, 6 Dec 2004 15:16:56 +1100
Anton Blanchard <anton@samba.org> wrote:

> > This is a bug in e1000.  Even if it is required it isn't allowed to
> > modify a cloned packet.  It'll need to copy it so that other clone
> > users aren't affected.
> 
> It looks like the tg3 is doing a similar thing.

As does ixgb.

Most TSO drivers need to modify the IP header in
a similar way.  It has to do with how Microsoft's driver
API defines the TSO interface, which is what all the cards
implement.  They want the checksum field clear, and the
tot_len field of the IP header to be what the normal packets
will have.

Typhoon and S2IO seem to be a notable exceptions.