public inbox for linux-kernel@vger.kernel.org
 help / color / mirror / Atom feed
From: Dave Chinner <david@fromorbit.com>
To: "Theodore Ts'o" <tytso@mit.edu>, Dave Jones <davej@redhat.com>,
	Markus Trippelsdorf <markus@trippelsdorf.de>,
	Linus Torvalds <torvalds@linux-foundation.org>,
	"gnehzuil.liu" <gnehzuil.liu@gmail.com>,
	Zheng Liu <wenqing.lz@taobao.com>, Borislav Petkov <bp@alien8.de>,
	"linux-ext4@vger.kernel.org" <linux-ext4@vger.kernel.org>,
	"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>
Subject: Re: [GIT PULL] ext4 updates for 3.9
Date: Fri, 1 Mar 2013 00:18:13 +1100	[thread overview]
Message-ID: <20130228131813.GO5551@dastard> (raw)
In-Reply-To: <20130227192907.GB14253@thunk.org>

On Wed, Feb 27, 2013 at 02:29:07PM -0500, Theodore Ts'o wrote:
> On Wed, Feb 27, 2013 at 02:19:23PM -0500, Dave Jones wrote:
> > 
> > Looks like it's fixed here too.
> > 
> > How did this make it through -next without anyone hitting it ?
> 
> > Is anyone running xfstests or similar on linux-next regularly ?
> 
> I run xfstests on the ext4 tree, and I ran it on ext4 plus Linus's tip
> before I submitted a pull request.  The problem is that XFSTESTS is
> S-L-O-W if you use large partitions, so typically I use a 5GB
> partition sizes for my test runs.

This isn't the case for XFS. I typically see 1TB scratch devices
only being ~10-20% slower than 10GB scratch devices, and 10TB only
being a little slower than 1TB scratch devices. I have to use sparse
devices and --large-fs for 100TB filesystem testing, so I can't
directly compare the speeds to those that I run on physical devices.
However I can say that it isn't significantly slower than using
small scratch devices...

> So what we probably need to do is to have a separate set of tests
> using a loopback mount, and perhaps an artificially created file
> system which has a large percentage of the blocks in the middle of the
> file system busied out, to make efficient testing of these sorts of

That's exactly what the --large-fs patch set I posted months ago does
for ext4 - it uses fallocate() to fill all but 50GB of the large
filesystem without actually writing any data and runs the standard
tests in the remaining unused space.

However, last time I tested ext4 with this patchset (when I posted
the patches months ago), multi-TB preallocation on ext4 was still too
slow to make it practical for testing on devices larger than 2-3TB.
Perhaps it would make testing 1-2TB ext4 filesystems fast enough
that you could do it regularly...

Cheers,

Dave.
-- 
Dave Chinner
david@fromorbit.com

  parent reply	other threads:[~2013-02-28 13:18 UTC|newest]

Thread overview: 34+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2013-02-26 20:39 [GIT PULL] ext4 updates for 3.9 Theodore Ts'o
2013-02-27 12:47 ` Markus Trippelsdorf
2013-02-27 15:34   ` Theodore Ts'o
2013-02-27 15:44     ` Markus Trippelsdorf
2013-02-27 17:01       ` Markus Trippelsdorf
2013-02-27 17:10         ` gnehzuil.liu
2013-02-27 17:22           ` Markus Trippelsdorf
2013-02-27 17:38             ` gnehzuil.liu
2013-02-27 17:45               ` Markus Trippelsdorf
2013-02-27 17:52                 ` Linus Torvalds
2013-02-27 18:49                   ` Theodore Ts'o
2013-02-27 18:56                     ` Markus Trippelsdorf
2013-02-27 19:19                       ` Dave Jones
2013-02-27 19:27                         ` Zheng Liu
2013-02-27 19:29                         ` Theodore Ts'o
2013-02-27 20:12                           ` [GIT PULL URGENT] ext4 regression fix " Linus Torvalds
2013-02-27 20:15                             ` Theodore Ts'o
2013-02-27 20:23                               ` Linus Torvalds
2013-02-27 20:41                                 ` Borislav Petkov
2013-03-01  3:30                             ` Dave Jones
2013-03-01  4:00                               ` Theodore Ts'o
2013-03-02 19:54                                 ` Linus Torvalds
2013-03-02 23:15                                   ` Theodore Ts'o
2013-02-27 20:14                           ` Theodore Ts'o
2013-02-27 20:58                           ` [GIT PULL] ext4 updates " Dmitry Monakhov
2013-02-27 21:30                             ` Theodore Ts'o
2013-03-01 15:41                             ` Eric Sandeen
2013-02-28 13:18                           ` Dave Chinner [this message]
2013-02-27 18:57                     ` Dave Jones
2013-02-27 19:04                       ` Theodore Ts'o
2013-02-27 19:11                         ` Dave Jones
2013-02-27 19:19                           ` Theodore Ts'o
2013-02-27 18:59                     ` Zheng Liu
2013-02-27 19:06                     ` Borislav Petkov

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20130228131813.GO5551@dastard \
    --to=david@fromorbit.com \
    --cc=bp@alien8.de \
    --cc=davej@redhat.com \
    --cc=gnehzuil.liu@gmail.com \
    --cc=linux-ext4@vger.kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=markus@trippelsdorf.de \
    --cc=torvalds@linux-foundation.org \
    --cc=tytso@mit.edu \
    --cc=wenqing.lz@taobao.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox