All of lore.kernel.org
 help / color / mirror / Atom feed
From: Joe Landman <joe.landman@gmail.com>
To: Shehjar Tikoo <shehjart@gluster.com>
Cc: linux-nfs@vger.kernel.org
Subject: Re: Streaming perf problem on 10g
Date: Wed, 03 Nov 2010 14:33:06 -0400	[thread overview]
Message-ID: <4CD1AAE2.3020003@gmail.com> (raw)
In-Reply-To: <766909857.700951.1288807081999.JavaMail.root@mb2>

On 11/03/2010 01:58 PM, Shehjar Tikoo wrote:
> Hi All,
>
> I am running into a performance problem with 2.6.32-23 Ubuntu lucid on both client and server.
>
> The disk is an SSD performing at 1.4 - 1.6Gbps for a dd of a 6gb file in 64k blocks.
>    

If the size of this file is comparable to or smaller than the client or 
server ram, this number is meaningless.

> The network is performing fine with many Gbps of iperf throughput.
>    

GbE gets you 1 Gbps.  10GbE may get you from 3-10 Gbps, depending upon 
many things.  What are  your numbers?

> Yet, the dd write performance over the nfs mount point ranges from 96-105 Mbps for a 6gb file in 64k blocks.
>    

Sounds like you are writing over the gigabit, and not the 10GbE interface.

> I've tried changing the tcp_slot_table_entries and the wsize but there is negligible gain from these.
>
> Does it sound like a client side inefficiency?
>    

Nope.

-- 
Joseph Landman, Ph.D
Founder and CEO
Scalable Informatics Inc.
email: landman@scalableinformatics.com
web : http://scalableinformatics.com
phone: +1 734 786 8423 x121
fax : +1 866 888 3112
cell : +1 734 612 4615

  reply	other threads:[~2010-11-03 18:30 UTC|newest]

Thread overview: 5+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2010-11-03 17:58 Streaming perf problem on 10g Shehjar Tikoo
2010-11-03 18:33 ` Joe Landman [this message]
2010-11-03 18:47   ` fibreraid
2010-11-04  8:20     ` Shehjar Tikoo
2010-11-05 11:43       ` fibreraid

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=4CD1AAE2.3020003@gmail.com \
    --to=joe.landman@gmail.com \
    --cc=linux-nfs@vger.kernel.org \
    --cc=shehjart@gluster.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.