linux-nfs.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Simon Kirby <sim@hostway.ca>
To: Judith Flo Gaya <jflo@imppc.org>
Cc: Chuck Lever <chuck.lever@oracle.com>,
	"linux-nfs@vger.kernel.org" <linux-nfs@vger.kernel.org>
Subject: Re: problem with nfs latency during high IO
Date: Wed, 16 Mar 2011 16:51:13 -0700	[thread overview]
Message-ID: <20110316235113.GG23526@hostway.ca> (raw)
In-Reply-To: <4D80A2DE.2030507@imppc.org>

On Wed, Mar 16, 2011 at 12:45:34PM +0100, Judith Flo Gaya wrote:

> I made some tests with a value of 10 for the vm_dirty_ratio and indeed  
> the ls-hang-time has decreased a lot, from 3min avg to 1.5min.
> I was wondering what is the minimum number that it is safe to use? I'm  
> sure that you have already dealt with the side-effects/collateral  
> damages of this action,  I don't want to fix a problem creating another  
> one..

For a while, we were running with this on production NFS clients:

vm/dirty_background_bytes = 1048576
vm/dirty_bytes = 2097152

which is totally crazy, but generally seemed to work for the most part,
and penalized the process creating the pages instead of totally hosing
everything else when somebody was just writing back a huge file. Without
it, we were seeing a single "dd" able to cause the load to hit 200,
simply because 200 other processes got stuck in D waiting for RPC slots
due to the slowdown. With those settings, load would stay around 3-4 and
latency was much better.

I think I removed it when trying to figure out the other flush issues,
but it seems the same problem still exists.

Simon-

  parent reply	other threads:[~2011-03-16 23:51 UTC|newest]

Thread overview: 18+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2011-03-12 12:58 problem with nfs latency during high IO Judith Flo Gaya
2011-03-15 16:24 ` Chuck Lever
2011-03-15 17:25   ` Judith Flo Gaya
2011-03-15 18:03     ` Chuck Lever
2011-03-15 18:15       ` Chuck Lever
2011-03-17  1:21         ` Harshula Jayasuriya
2011-03-15 21:33       ` Judith Flo Gaya
2011-03-15 21:28         ` Chuck Lever
2011-03-15 21:58           ` Judith Flo Gaya
2011-03-15 22:10             ` Chuck Lever
2011-03-16 11:45               ` Judith Flo Gaya
2011-03-16 13:24                 ` Chuck Lever
2011-03-16 13:42                   ` peter.staubach
2011-03-16 15:18                   ` Jim Rees
2011-03-16 15:31                     ` Jim Rees
2011-03-16 16:52                       ` Judith Flo Gaya
2011-03-16 23:51                 ` Simon Kirby [this message]
  -- strict thread matches above, loose matches on Subject: below --
2011-03-15 16:25 Judith Flo Gaya

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20110316235113.GG23526@hostway.ca \
    --to=sim@hostway.ca \
    --cc=chuck.lever@oracle.com \
    --cc=jflo@imppc.org \
    --cc=linux-nfs@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).