public inbox for linux-rdma@vger.kernel.org
 help / color / mirror / Atom feed
From: Erez Shitrit <erezsh-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
To: Markus Stockhausen <stockhausen-FhFLwxQf9jkb1SvskN2V4Q@public.gmane.org>
Cc: "linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org"
	<linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org>,
	Or Gerlitz <ogerlitz-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>
Subject: Re: AW: IPoIB GRO
Date: Mon, 04 Nov 2013 14:41:54 +0200	[thread overview]
Message-ID: <52779612.9020103@dev.mellanox.co.il> (raw)
In-Reply-To: <12EF8D94C6F8734FB2FF37B9FBEDD173585A4301-Xnr6BND5kcg29+KCeZIpYi5l6jQMEky5@public.gmane.org>

Hi Markus,

Can you please tell me what is the FW version you have on your ConnectX 
cards?

Thanks, Erez

> Hi Erez,
>
>> don't you see that behaviour in tcpdump? what kernel are you using?
> On server side we have a 3.5 on client side a 3.11 kernel each of them with
> kernel standard drivers/modules. I can see the same pattern of GRO
> aggregation on the client that you mention but only if I disable TSO for
> ib0 on the server side.
>
> The test I'm running on the client is like this. The second and third read
> run are definetly served by the NFS server side cache.
>
> sysctl -w net.ipv4.tcp_mem="4096 65536 4194304"
> sysctl -w net.ipv4.tcp_rmem="4096 65536 4194304"
> sysctl -w net.ipv4.tcp_wmem="4096 65536 4194304"
> sysctl -w net.core.rmem_max=8388608
> sysctl -w net.core.wmem_max=8388608
>
> mount -o nfsvers=3,rsize=262144,wsize=262144 10.10.30.251:/export /mnt
> echo 3 > /proc/sys/vm/drop_caches
> dd if=/mnt/xxx.iso of=/dev/null bs=1M count=5000
> echo 3 > /proc/sys/vm/drop_caches
> dd if=/mnt/xxx.iso of=/dev/null bs=1M count=5000
> echo 3 > /proc/sys/vm/drop_caches
> dd if=/mnt/xxx.iso of=/dev/null bs=1M count=5000
> umount /mnt
>
> Markus

--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

  parent reply	other threads:[~2013-11-04 12:41 UTC|newest]

Thread overview: 16+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2013-11-03 10:58 IPoIB GRO Markus Stockhausen
     [not found] ` <12EF8D94C6F8734FB2FF37B9FBEDD173585A3E3B-Xnr6BND5kcg29+KCeZIpYi5l6jQMEky5@public.gmane.org>
2013-11-04  8:12   ` AW: " Markus Stockhausen
2013-11-04  8:24   ` Erez Shitrit
     [not found]     ` <527759C6.3070009-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
2013-11-04  8:40       ` AW: " Markus Stockhausen
     [not found]         ` <12EF8D94C6F8734FB2FF37B9FBEDD173585A4301-Xnr6BND5kcg29+KCeZIpYi5l6jQMEky5@public.gmane.org>
2013-11-04 12:41           ` Erez Shitrit [this message]
     [not found]             ` <52779612.9020103-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
2013-11-04 13:21               ` AW: " Markus Stockhausen
     [not found]                 ` <12EF8D94C6F8734FB2FF37B9FBEDD173585A45CF-Xnr6BND5kcg29+KCeZIpYi5l6jQMEky5@public.gmane.org>
2013-11-04 21:17                   ` Wendy Cheng
     [not found]                     ` <CABgxfbEom7fjdshX5AaSXT3P_y=3xFwN9T3V+QXkB0bK-EfNjA-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2013-11-05  8:14                       ` Or Gerlitz
2013-11-05  8:07                   ` AW: " Or Gerlitz
     [not found]                     ` <5278A757.2070406-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>
2013-11-05  8:25                       ` AW: " Markus Stockhausen
     [not found]                         ` <12EF8D94C6F8734FB2FF37B9FBEDD173585A4B3D-Xnr6BND5kcg29+KCeZIpYi5l6jQMEky5@public.gmane.org>
2013-11-05  8:48                           ` Erez Shitrit
     [not found]                             ` <5278B0CA.9080305-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>
2013-11-05 17:24                               ` Jason Gunthorpe
     [not found]                                 ` <20131105172431.GA14706-ePGOBjL8dl3ta4EC/59zMFaTQe2KTcn/@public.gmane.org>
2013-11-05 18:08                                   ` AW: " Markus Stockhausen
     [not found]                                     ` <12EF8D94C6F8734FB2FF37B9FBEDD173585A508B-Xnr6BND5kcg29+KCeZIpYi5l6jQMEky5@public.gmane.org>
2013-11-06  7:50                                       ` Or Gerlitz
     [not found]                                         ` <5279F4DB.8040202-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>
2013-11-06  7:58                                           ` AW: " Markus Stockhausen
2013-11-05  8:49                           ` AW: AW: " Or Gerlitz

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=52779612.9020103@dev.mellanox.co.il \
    --to=erezsh-ldsdmyg8hgv8yrgs2mwiifqbs+8scbdb@public.gmane.org \
    --cc=linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
    --cc=ogerlitz-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org \
    --cc=stockhausen-FhFLwxQf9jkb1SvskN2V4Q@public.gmane.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox