From: Theodore Ts'o <tytso@mit.edu>
To: Zach Brown <zab@redhat.com>
Cc: Andreas Dilger <adilger@dilger.ca>,
Zheng Liu <wenqing.lz@taobao.com>,
Eric Sandeen <sandeen@redhat.com>,
Zheng Liu <gnehzuil.liu@gmail.com>,
ext4 development <linux-ext4@vger.kernel.org>
Subject: Re: [PATCH v2] ext4: dynamical adjust the length of zero-out chunk
Date: Mon, 13 Aug 2012 17:35:47 -0400 [thread overview]
Message-ID: <20120813213547.GH32484@thunk.org> (raw)
In-Reply-To: <20120813194902.GG9117@lenny.home.zabbo.net>
On Mon, Aug 13, 2012 at 12:49:02PM -0700, Zach Brown wrote:
>
> Indeed. fio to the rescue.
>
> I remember Christoph saying something about 64k somewhat recently? But,
> helpfully, I can't recall the details :).
So here are some quick fio numbers, using a modern 5400rpm 2.5" disk,
using 8192 samples doing random writes at different sizes:
4k min=0.099 , max=69.980 , avg=1.95249
8k min=0.112 , max=71.393 , avg=2.39577
16k min=0.123 , max=79.951 , avg=3.29693
32k min=0.190 , max=75.846 , avg=3.57158
64k min=0.305 , max=71.386 , avg=4.43218
128k min=0.554 , max=77.925 , avg=6.40304
256k min=1 , max=68 , avg=10.21
If we take into account that a random write into a fallocate'd file
will need to update the extent tree, this is the time that it would
take to do a 4k random write if we are also using a more aggressive
max zero-out length (plus the extent tree block update):
zerooout +
4k metadata update
(ms)
4k 3.90
8k 4.35
16k 5.25
32k 5.52
64k 6.38
128k 8.36
256k 12.16
So I can see going to 64k, but unless we're really concerned about
extent fragmentation, I don't think larger values make a whole lot of
sense, especially if we are concerned about lowering latency
variability when writing into freshly fallocate'd space. And if the
concern is extent fragmentation, we may be better off fixing our
extent tree manipulation code so we are better at merging adjacent
extent tree blocks instead.
- Ted
next prev parent reply other threads:[~2012-08-13 21:35 UTC|newest]
Thread overview: 13+ messages / expand[flat|nested] mbox.gz Atom feed top
2012-07-12 6:48 [PATCH v2] ext4: dynamical adjust the length of zero-out chunk Zheng Liu
2012-07-12 14:49 ` Eric Sandeen
2012-07-12 16:51 ` Andreas Dilger
2012-07-17 7:55 ` Zheng Liu
2012-08-13 3:22 ` Theodore Ts'o
2012-08-13 6:55 ` Zheng Liu
2012-08-13 17:32 ` Zach Brown
2012-08-13 18:40 ` Theodore Ts'o
2012-08-13 19:49 ` Zach Brown
2012-08-13 21:35 ` Theodore Ts'o [this message]
2012-08-14 15:13 ` [PATCH] ext4: make the zero-out chunk size tunable Theodore Ts'o
2012-08-14 15:15 ` [PATCH -v4] " Theodore Ts'o
2012-07-17 7:19 ` [PATCH v2] ext4: dynamical adjust the length of zero-out chunk Zheng Liu
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20120813213547.GH32484@thunk.org \
--to=tytso@mit.edu \
--cc=adilger@dilger.ca \
--cc=gnehzuil.liu@gmail.com \
--cc=linux-ext4@vger.kernel.org \
--cc=sandeen@redhat.com \
--cc=wenqing.lz@taobao.com \
--cc=zab@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).