All of lore.kernel.org
 help / color / mirror / Atom feed
From: Theodore Tso <tytso@mit.edu>
To: Andreas Dilger <adilger@sun.com>
Cc: linux-ext4@vger.kernel.org
Subject: Re: ext4 unlink performance
Date: Wed, 19 Nov 2008 16:18:40 -0500	[thread overview]
Message-ID: <20081119211840.GA8021@mit.edu> (raw)
In-Reply-To: <20081119181000.GD3186@webber.adilger.int>

On Wed, Nov 19, 2008 at 12:10:01PM -0600, Andreas Dilger wrote:
> 
> That may be a side-effect of the mballoc per-CPU cache again, where
> files being written in the same subdirectory are spread apart because
> of the write thread being rescheduled to different cores.
> 

It would be good for us to get confirmation one way or another about
this theory.  Bruce, if you have multiple CPU's (or cores on your
system --- i.e., cat /proc/cpuinfo reports multiple processors), can
you try unpacking your tarball on a test ext4 filesystem using
something like:

    taskset 1 tar xjf /path/to/my/tarball.tar.bz2

The "taskset 1" will bind the tar process to only run on a single
processors.  If that significantly changes the time to do run rm -rf,
can you save a raw e2image using that workload?  That would be very
useful indeed.

Alternatively, if you don't have the taskset command handy, you can
also add maxcpus=1 to the kernel boot command-line, which will force
the system to only use one cpu.  Using taskset is much more
convenient, though.

Thanks!!

						- Ted

  reply	other threads:[~2008-11-19 21:18 UTC|newest]

Thread overview: 17+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2008-11-13 18:57 ext4 unlink performance Bruce Guenter
2008-11-13 19:10 ` Bruce Guenter
2008-11-13 20:42   ` Theodore Tso
2008-11-14  4:11     ` Bruce Guenter
2008-11-14 14:59       ` Theodore Tso
2008-11-14 15:48         ` Bruce Guenter
2008-11-14 15:54           ` Theodore Tso
2008-11-15 20:44         ` Bruce Guenter
2008-11-15 23:08           ` Eric Sandeen
2008-11-16  0:56           ` Theodore Tso
2008-11-16  3:38             ` Bruce Guenter
2008-11-17  0:43             ` Andreas Dilger
     [not found]               ` <20081119024021.GA10185@mit.edu>
2008-11-19 18:10                 ` Andreas Dilger
2008-11-19 21:18                   ` Theodore Tso [this message]
2008-11-20 22:49                     ` Bruce Guenter
2008-11-13 19:46 ` Theodore Tso
2008-11-13 20:27   ` Bruce Guenter

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20081119211840.GA8021@mit.edu \
    --to=tytso@mit.edu \
    --cc=adilger@sun.com \
    --cc=linux-ext4@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.