From: Viji V Nair <viji@fedoraproject.org>
To: Toby Thain <toby@telegraphics.com.au>
Cc: reiserfs-devel@vger.kernel.org
Subject: Re: reiserfs - recommendations for small files
Date: Tue, 20 Oct 2009 00:56:49 +0530 [thread overview]
Message-ID: <84c89ac10910191226g7090dcd2m7b7550e5e2bcdcdb@mail.gmail.com> (raw)
In-Reply-To: <132F41FF-CA71-4004-9081-5246887ED708@telegraphics.com.au>
I
On Tue, Oct 20, 2009 at 12:46 AM, Toby Thain <toby@telegraphics.com.au> wrote
>
> On 17-Oct-09, at 2:11 PM, Viji V Nair wrote:
>
>> Hi,
>>
>> System : Fedora 11 x86_64
>> Current Filesystem: 150G ext4 (formatted with "-T small" option)
>> Number of files: 50 Million, 1 to 30K png images
>>
>> We are generating these files using a python programme and getting
>> very slow IO performance. While generation there are only writes, no
>> read. After generation there are heavy read and no write. These files
>> are not in a single directory, this is a pyramid structure. There are
>> total 15 pyramids and coming down from top to bottom the sub
>> directories and files are multiplied by a factor of 4
>>
>> I am looking for an alternate file system and best
>> practices/recommendation to get a better performance. What the
>> optimisation methods available in reiserfs for small files?
>
> You could benchmark this on reiser3 today (it's perfectly stable & small
> file handling is supposedly a sweet spot).
I am creating a fedora 11 kernel rpm with reiserfs3 and reiser4
support, planning to bench mark it on multiple hardware. Will update
the results.
>
> --Toby
>
>>
>> Any suggestions of the above are greatly appreciated.
>>
>> Viji
>> --
>> To unsubscribe from this list: send the line "unsubscribe reiserfs-devel"
>> in
>> the body of a message to majordomo@vger.kernel.org
>> More majordomo info at http://vger.kernel.org/majordomo-info.html
>
>
--
To unsubscribe from this list: send the line "unsubscribe reiserfs-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
next prev parent reply other threads:[~2009-10-19 19:26 UTC|newest]
Thread overview: 4+ messages / expand[flat|nested] mbox.gz Atom feed top
2009-10-17 18:11 reiserfs - recommendations for small files Viji V Nair
2009-10-19 19:16 ` Toby Thain
2009-10-19 19:26 ` Viji V Nair [this message]
2009-10-19 23:34 ` Edward Shishkin
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=84c89ac10910191226g7090dcd2m7b7550e5e2bcdcdb@mail.gmail.com \
--to=viji@fedoraproject.org \
--cc=reiserfs-devel@vger.kernel.org \
--cc=toby@telegraphics.com.au \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).