Linux NFS development
 help / color / mirror / Atom feed
From: "J. Bruce Fields" <bfields@fieldses.org>
To: Wendy Cheng <s.wendy.cheng@gmail.com>
Cc: Benny Halevy <bhalevy@panasas.com>,
	Frank Steiner
	<fsteiner-mail1-G0GEQqhI7DhYiKXMg8wJIg@public.gmane.org>,
	nfs@lists.sourceforge.net
Subject: Re: [NFS] Does "sync" cause the FUA bit to be set?
Date: Tue, 10 Jun 2008 15:47:12 -0400	[thread overview]
Message-ID: <20080610194712.GP20184@fieldses.org> (raw)
In-Reply-To: <484ECD58.8040100@gmail.com>

On Tue, Jun 10, 2008 at 01:52:08PM -0500, Wendy Cheng wrote:
> Benny Halevy wrote:
> > On Jun. 10, 2008, 18:44 +0300, Wendy Cheng <s.wendy.cheng@gmail.com> wrote:
> >   
> >> Frank Steiner wrote:
> >>     
> >>> With the profile ignoring the FUA bit, copying or deleting directories
> >>> of e.g. 10M with a about 1000 files is factor 5 faster than with the
> >>> profile honoring the FUA bit.
> >>>   
> >>>       
> >> FUA bit is normally combined with write-thru scsi command that bypasses 
> >> storage write cache. I would imagine it needs to well synchronize 
> >> various pieces before issuing this command. It could hurt the 
> >> performance if not done well, particularly for meta data. So your result 
> >> is not surprising.
> >>     
> >>> We export with the "sync" option. Does that option maybe set the FUA bit
> >>> for all write operations on the NFS server?
> >>>   
> >>>       
> >> It depends on how the filesystem (and its associated disk subsystem) is 
> >> implemented. The "sync" export option itself has a heavy performance 
> >> impact, regardless how FUA bit is handled. Some vendors uses specialized 
> >> HW (e.g. NVRAM) to alleviate this performance hit. If your filesystem 
> >> doesn't have this type of support, you should expect "sync" option runs 
> >> much much slower than "async". It is a choice (or balance) between cost, 
> >> performance, and data reliability.
> >>     
> >
> > Wendy, I *think* what you have in mind is the sync mount option
> > rather than the sync export flag.  The latter just tells the server
> > not to cheat and do everything asynchronously.  It should *not*
> > have a heavy performance penalty for I/O intensive writes if the
> > client is using async writes and commits.
> >
> >   
> No, I didn't get confused ... We can use Linux as an example :) .. check 
> out:
> http://marc.info/?l=linux-nfs&m=119618886105337&w=2
> 
> -- quote
> 
> The default export might have been "async", but unless the option "sync"
> in /etc/exports was being ignored I was already using "sync". Nevertheless
> I will try to change to async and test if it makes a difference.
> 
> (one day later: )
> 
> I have now tried it and the load on the NFS server is much lower and KDE
> logins seem to be reasonably fast now.

Yeah, the "async" export options is expected to improve performance on a
workload like that (with lots of directory creates/deletes).  But it
does so by violating the promises that the protocol makes to the client.

--b.

-------------------------------------------------------------------------
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://sourceforge.net/services/buy/index.php
_______________________________________________
NFS maillist  -  NFS@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nfs
_______________________________________________
Please note that nfs@lists.sourceforge.net is being discontinued.
Please subscribe to linux-nfs@vger.kernel.org instead.
    http://vger.kernel.org/vger-lists.html#linux-nfs


  reply	other threads:[~2008-06-10 19:47 UTC|newest]

Thread overview: 7+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2008-06-10 10:43 [NFS] Does "sync" cause the FUA bit to be set? Frank Steiner
     [not found] ` <484E5AC1.3020200-G0GEQqhI7DhYiKXMg8wJIg@public.gmane.org>
2008-06-10 11:53   ` Benny Halevy
2008-06-10 15:44   ` Wendy Cheng
     [not found]     ` <484EA215.5090000@panasas.com>
2008-06-10 18:52       ` Wendy Cheng
2008-06-10 19:47         ` J. Bruce Fields [this message]
     [not found]         ` <484EC317.8090801@panasas.com>
2008-06-10 22:58           ` Wendy Cheng
2008-06-16 13:06             ` Frank Steiner

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20080610194712.GP20184@fieldses.org \
    --to=bfields@fieldses.org \
    --cc=bhalevy@panasas.com \
    --cc=fsteiner-mail1-G0GEQqhI7DhYiKXMg8wJIg@public.gmane.org \
    --cc=nfs@lists.sourceforge.net \
    --cc=s.wendy.cheng@gmail.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox