From: Dave Chinner <david@fromorbit.com>
To: Markus Roth <Markus.Roth@uni-konstanz.de>
Cc: xfs@oss.sgi.com
Subject: Re: Performance degeneration issues
Date: Tue, 19 Oct 2010 12:42:45 +1100 [thread overview]
Message-ID: <20101019014245.GN29677@dastard> (raw)
In-Reply-To: <2a05-4cbc6280-f8f-3364a400@207442557>
On Mon, Oct 18, 2010 at 05:07:33PM +0200, Markus Roth wrote:
> Hello,
>
> I'm running a Centos 5.4 x64 Server with Raid0 HDDs and XFS.
What's the layout of you storage? how many disks, size, etc.
How much RAM, number of CPUs in your server?
Also, what's the output of of 'xfs_info <mntpt>'?
> I did some performance tweaking according to [1] as performance
> was not good enough with std. options.
Using information from a 7 year old web page about how someone
optimised their filesystem for a specific bonnie++ workload
is not really a good place to start when it comes to real-world
optimisation.
> Extracting a tar archive with 6.1 million files (avg. Size just
> below 2KiB) is blazingly fast after the fs has been generated. But
> after some time while doing deletes/moves (need to sort those
> files by their contents) the fs performance degenerates quite
> badly (from 8k file writes/sec to about 200).
You need understand why the performance falls through the floor
first, then work out what needs optimising. It may be that your sort
algorithm has exponential complexity, or you are running out of RAM,
or something else. It may not have anything at all to do with the
filesystem.
The symptoms you describe sound like the difference between
operation in cache vs out of cache (i.e. RAM speed vs disk speed),
and if so then no amount of filesystem tweaking will fix it.
However, if you describe you system and the algorithms you are using
in more detail, we might be able to help identify the cause...
Cheers,
Dave.
--
Dave Chinner
david@fromorbit.com
_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs
next prev parent reply other threads:[~2010-10-19 1:41 UTC|newest]
Thread overview: 6+ messages / expand[flat|nested] mbox.gz Atom feed top
2010-10-18 15:07 Performance degeneration issues Markus Roth
2010-10-19 1:42 ` Dave Chinner [this message]
2010-10-19 16:43 ` Peter Grandi
-- strict thread matches above, loose matches on Subject: below --
2010-10-19 13:36 Markus Roth
2010-10-20 12:17 ` Peter Grandi
2010-10-20 14:19 Markus Roth
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20101019014245.GN29677@dastard \
--to=david@fromorbit.com \
--cc=Markus.Roth@uni-konstanz.de \
--cc=xfs@oss.sgi.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox