All of lore.kernel.org
 help / color / mirror / Atom feed
From: Alex Zarochentsev <zam@namesys.com>
To: Valdis.Kletnieks@vt.edu
Cc: Hans Reiser <reiser@namesys.com>, David Dabbs <david@dabbs.net>,
	'ReiserFS List' <reiserfs-list@namesys.com>
Subject: Re: Was able to reproduce "cp: cannot stat file.x: Input/output error"
Date: Tue, 10 Aug 2004 13:20:22 +0400	[thread overview]
Message-ID: <20040810092022.GN9811@backtop.namesys.com> (raw)
In-Reply-To: <200408100321.i7A3LHxu027087@turing-police.cc.vt.edu>

On Mon, Aug 09, 2004 at 11:21:17PM -0400, Valdis.Kletnieks@vt.edu wrote:
> On Sat, 07 Aug 2004 00:49:43 PDT, Hans Reiser said:
> 
> > >I think I have discovered the problem - unless there was a reason mongo was
> > >issuing mount/unmount commands at the start/end of a mongo 'run' as well as
> > >before/after _each phase_.
> 
> > Probably someone wanted to separate the measurement of the phases.  It 
> > has been a while since I read mongo.....
> 
> Note that an unmount/mount pair will force a flush of all dirtied pages in the
> in-memory file cache, and *really* not return until it's really done and really
> out on disk.  In addition, sync() will force stuff to disk, but *not* invalidate
> in-cache pages - more drastic measures are needed if you want to benchmark
> with a cold cache (which is almost a must if you're doing actual filesystem
> benchmarking, as otherwise you're benching the in-core cache instead).

That was designed to have result in each phase as independent as we can.  For
example, if we have read slowdown in mongo, we will analyze only reads and,
probably, fs fragmentation, we won't deal with unmeasurable cache state before
the read phase. Known and persistent "cold cache effect" is better than unknown
hot cache one :)  And, mongo phases are designed to be long and keep the cold
cache effect at minimum.

> As an aside, although the Linux fs/buffer:do_sync() won't return until it's
> all really done, there is no mandate that the sync() syscall wait (and in fact,
> is the source of the old "type 'sync' three times, then 'halt'" - the second
> and third times you typed sync and hit return hopefully gave the I/O scheduled
> by the *first* sync time to complete.  At least one 'Unix for Dummies' book
> proved their lack of depth of understanding when they recommended:
> 
> # sync;sync;sync;halt
> 

-- 
Alex.

  parent reply	other threads:[~2004-08-10  9:20 UTC|newest]

Thread overview: 47+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2004-08-06  6:53 Was able to reproduce "cp: cannot stat file.x: Input/output error" David Dabbs
2004-08-06 15:51 ` Vladimir V. Saveliev
2004-08-06 17:10   ` Philippe Gramoullé
2004-08-06 17:39     ` Vladimir V. Saveliev
2004-08-06 19:06       ` Philippe Gramoullé
2004-08-07  4:14       ` Hans Reiser
2004-08-06 17:46     ` David Dabbs
2004-08-06 19:11       ` Philippe Gramoullé
2004-08-07  4:15       ` Hans Reiser
2004-08-07  6:46         ` David Dabbs
2004-08-07  7:49           ` Hans Reiser
2004-08-08  2:54             ` David Dabbs
2004-08-10  3:21             ` Valdis.Kletnieks
2004-08-10  8:31               ` Hans Reiser
2004-08-10 15:41                 ` Valdis.Kletnieks
2004-08-10  9:20               ` Alex Zarochentsev [this message]
2004-08-10 17:35                 ` Hans Reiser
2004-08-10 17:42                   ` David Dabbs
2004-08-10 17:46                     ` Hans Reiser
2004-08-10 18:05                   ` Alex Zarochentsev
2004-08-10 19:55                     ` Hans Reiser
2004-08-10 20:41                       ` Alex Zarochentsev
2004-08-06 17:51     ` Alex Zarochentsev
2004-08-06 19:10       ` Philippe Gramoullé
     [not found] <411944EF.7000504@namesys.com>
2004-08-10 22:05 ` David Dabbs
     [not found] <20040810205450.GU9811@backtop.namesys.com>
2004-08-10 21:06 ` David Dabbs
2004-08-10 21:06   ` Alex Zarochentsev
2004-08-10 21:19     ` David Dabbs
2004-08-11 10:03       ` Vladimir V. Saveliev
2004-08-10 21:26     ` David Dabbs
     [not found] <4115A979.5090002@namesys.com>
2004-08-08  7:07 ` David Dabbs
2004-08-08 18:08   ` Hans Reiser
2004-08-08 19:09     ` David Dabbs
2004-08-09  6:17       ` Hans Reiser
2004-08-08 21:40         ` David Dabbs
2004-08-09  0:01           ` Hans Reiser
2004-08-09  1:55             ` David Dabbs
2004-08-09 17:43               ` Hans Reiser
2004-08-09 18:32                 ` David Dabbs
2004-08-09  2:38             ` David Dabbs
2004-08-09 17:59               ` Alex Zarochentsev
2004-08-09 18:22                 ` David Dabbs
2004-08-09 18:42                   ` Alex Zarochentsev
2004-08-09 15:13     ` Nikita Danilov
2004-08-09 17:48       ` Hans Reiser
  -- strict thread matches above, loose matches on Subject: below --
2004-08-06  4:54 David Dabbs
2004-08-06  7:31 ` mjt

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20040810092022.GN9811@backtop.namesys.com \
    --to=zam@namesys.com \
    --cc=Valdis.Kletnieks@vt.edu \
    --cc=david@dabbs.net \
    --cc=reiser@namesys.com \
    --cc=reiserfs-list@namesys.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.