public inbox for linux-kernel@vger.kernel.org
 help / color / mirror / Atom feed
From: Johannes Stezenbach <js@convergence.de>
To: Peter Nelson <pnelson@andrew.cmu.edu>
Cc: Hans Reiser <reiser@namesys.com>, Jens Axboe <axboe@suse.de>,
	linux-kernel@vger.kernel.org, ext2-devel@lists.sourceforge.net,
	ext3-users@redhat.com, jfs-discussion@www-124.ibm.com,
	reiserfs-list@namesys.com, linux-xfs@oss.sgi.com
Subject: Re: Desktop Filesystem Benchmarks in 2.6.3
Date: Thu, 4 Mar 2004 00:41:04 +0100	[thread overview]
Message-ID: <20040303234104.GD1875@convergence.de> (raw)
In-Reply-To: <4044B787.7080301@andrew.cmu.edu>

Peter Nelson wrote:
> Hans Reiser wrote:
> 
> >Are you sure your benchmark is large enough to not fit into memory, 
> >particularly the first stages of it?  It looks like not.  reiser4 is 
> >much faster on tasks like untarring enough files to not fit into ram, 
> >but (despite your words) your results seem to show us as slower unless 
> >I misread them....
> 
> I'm pretty sure most of the benchmarking I am doing fits into ram, 
> particularly because my system has 1GB of it, but I see this as 
> realistic.  When I download a bunch of debs (or rpms or the kernel) I'm 
> probably going to install them directly with them still in the file 
> cache.  Same with rebuilding the kernel after working on it.

OK, that test is not very interesting for the FS gurus because it
doesn't stress the disk enough.

Anyway, I have some related questions concerning disk/fs performance:

o I see you are using and IDE disk with a large (8MB) write cache.

  My understanding is that enabling write cache is a risky
  thing for journaled file systems, so for a fair comparison you
  would have to enable the write cache for ext2 and disable it
  for all journaled file systems.

It would be nice if someone with more profound knowledge could comment
on this, but my understanding of the problem is:

- journaled filesystems can only work when they can enforce that
  journal data is written to the platters at specifc times wrt
  normal data writes
- IDE write caching makes the disk "lie" to the kernel, i.e. it says
  "I've written the data" when it was only put in the cache
- now if a *power failure* keeps the disk from writing the cache
  contents to the platter, the fs and journal are inconsistent
  (a kernel crash would not cause this problem because the disk can
  still write the cache contents to the platters)
- at next mount time the fs will read the journal from the disk
  and try to use it to bring the fs into a consistent state;
  however, since the journal on disk is not guaranteed to be up to date
  this can *fail*  (I have no idea what various fs implementations do
  to handle this; I suspect they at least refuse to mount and require
  you to manually run fsck. Or they don't notice and let you work
  with a corrupt filesystem until they blow up.)

Right?  Or is this just paranoia?

To me it looks like IDE write barrier support
(http://lwn.net/Articles/65353/) would be a way
to safely enable IDE write caches for journaled filesystems.

Has anyone done any benchmarks concerning write cache and journaling?


o And one totally different :-) question:

Has anyone benchmarked fs performance on PATA IDE disks vs.
otherwise comparable SCSI or SATA disks (I vaguely recall
having read that SATA has working TCQ, i.e. not broken by
design as with PATA)?

I have read a few times that SCSI disks perform much better
than IDE disks. The usual reason given is "SCSI disks are built for
servers, IDE for desktops". Is this all, or is it TCQ that
matters? Or is the Linux SCSI core better than the IDE core?


Johannes

  parent reply	other threads:[~2004-03-03 23:39 UTC|newest]

Thread overview: 31+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2004-03-02  4:46 Desktop Filesystem Benchmarks in 2.6.3 Peter Nelson
2004-03-02  7:23 ` Hans Reiser
2004-03-02 16:34   ` Peter Nelson
2004-03-02 22:33     ` Dax Kelson
2004-03-02 22:47       ` David Weinehall
2004-03-03  1:30         ` Andrew Ho
2004-03-03  1:41           ` David Weinehall
     [not found]             ` <20040303014115.GP19111@khan.acc.umu.se.suse.lists.linux.kernel>
2004-03-03  2:39               ` Andi Kleen
2004-03-03  7:47                 ` Christoph Hellwig
2004-03-03  8:03                   ` Hans Reiser
2004-03-03  8:16                     ` Arjan van de Ven
2004-03-03  9:35                       ` Hans Reiser
2004-03-03  6:00             ` Robin Rosenberg
2004-03-03  9:43               ` Felipe Alfaro Solana
2004-03-03  9:59                 ` Robin Rosenberg
2004-03-03 10:19                   ` Felipe Alfaro Solana
2004-03-04  9:28                     ` Kristian Köhntopp
2004-03-05  1:59                     ` Clemens Schwaighofer
2004-03-03 10:24                   ` Mike Gigante
2004-03-03 13:14                     ` Felipe Alfaro Solana
2004-03-03 14:16                       ` Hans Reiser
2004-03-03 13:42                   ` Hans Reiser
2004-03-03 10:13                 ` Olaf Frączyk
2004-03-03 13:07                   ` Felipe Alfaro Solana
2004-03-04 14:37                 ` [Jfs-discussion] " Pascal Gienger
2004-03-04 20:43                   ` Per Andreas Buer
2004-03-03  6:30       ` Hans Reiser
2004-03-03 23:41     ` Johannes Stezenbach [this message]
2004-03-05 18:46       ` Pavel Machek
2004-03-06  0:16       ` Chris Mason
  -- strict thread matches above, loose matches on Subject: below --
2004-03-02 17:11 Ray Lee

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20040303234104.GD1875@convergence.de \
    --to=js@convergence.de \
    --cc=axboe@suse.de \
    --cc=ext2-devel@lists.sourceforge.net \
    --cc=ext3-users@redhat.com \
    --cc=jfs-discussion@www-124.ibm.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-xfs@oss.sgi.com \
    --cc=pnelson@andrew.cmu.edu \
    --cc=reiser@namesys.com \
    --cc=reiserfs-list@namesys.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox