All of lore.kernel.org
 help / color / mirror / Atom feed
From: "J. Bruce Fields" <bfields@fieldses.org>
To: Peter Staubach <staubach@redhat.com>
Cc: Jason Legate <linux-nfs@proxime.net>, linux-nfs@vger.kernel.org
Subject: Re: NFS for millions of files
Date: Thu, 3 Sep 2009 14:15:35 -0400	[thread overview]
Message-ID: <20090903181535.GA10670@fieldses.org> (raw)
In-Reply-To: <4A9EBB6B.4040009@redhat.com>

On Wed, Sep 02, 2009 at 02:37:31PM -0400, Peter Staubach wrote:
> Please keep in mind that the NFS stable storage requirements are
> probably causing a significant slowdown in activities such as this.

My first thought too, but:

> Jason Legate wrote:
> > When I run our creation benchmark locally  I can get around 3000
> > files/ second in the configuration we're using now, but only around
> > 300/second over NFS.  It's mounted as this:
...
> > When I mount the same FS over localhost instead of across the lan,
> > it performs about full speed (the 3000/sec).

The localhost NFS mount would be incurring the same sync latency, so all
his latency must be due to network.  (And with those numbers I guess
he's either got lots of disk spindles, or an ssd, or (uh-oh) has the
async option set?)

--b.

  reply	other threads:[~2009-09-03 18:15 UTC|newest]

Thread overview: 13+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2009-09-02 18:08 NFS for millions of files Jason Legate
2009-09-02 18:19 ` Aaron Wiebe
2009-09-02 18:35   ` Peter Chacko
2009-09-02 19:06     ` Jason Legate
2009-09-02 19:10     ` Aaron Wiebe
2009-09-02 19:27       ` Peter Chacko
2009-09-02 19:00   ` Jason Legate
2009-09-02 18:37 ` Peter Staubach
2009-09-03 18:15   ` J. Bruce Fields [this message]
2009-09-03 18:37     ` Ric Wheeler
2009-09-03 18:54       ` Trond Myklebust
2009-09-03 19:05       ` J. Bruce Fields
2009-09-02 18:38 ` Chuck Lever

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20090903181535.GA10670@fieldses.org \
    --to=bfields@fieldses.org \
    --cc=linux-nfs@proxime.net \
    --cc=linux-nfs@vger.kernel.org \
    --cc=staubach@redhat.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.