linux-btrfs.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Tomasz Chmielewski <tch@virtall.com>
To: linux-btrfs@vger.kernel.org, 1i5t5.duncan@cox.net, linuxhippy@gmail.com
Subject: Re: abysmal rm performance?
Date: Mon, 22 Jul 2013 12:22:11 +0700	[thread overview]
Message-ID: <827cf884b1a6e12db95beea6912d946b@admin.virtall.com> (raw)

> You /really/ need to read up on the btrfs wiki.
> 
> The short answer is yes, btrfs does a LOT more metadata processing
> due to the checksumming it does by default.

According to the wiki, checksumming has barely any influence, so I
guess the above advice is not really helpful?

https://btrfs.wiki.kernel.org/index.php/Mount_options

	nodatasum
	(...)
	On most modern CPUs this option does not result in any
	reasonable performance improvement.


> Then there's the whole problem that you didn't provide nearly enough
> information about your test to tell what it was actually comparing.
> What sort of raid1, btrfs/md/dm/hardware/what, and if btrfs raid1, was
> that for both data and metadata or just one of the two and what was
> the other one if they weren't both raid1?  And if you were testing
> btrfs raid1, what did you do with the ext4 test to try to make it
> comparable since ext4 doesn't have a native raid1 mode, or was it on
> a single device?

ext4: using md RAID


btrfs:

Data, RAID1: total=1.73TB, used=1.36TB
System, RAID1: total=32.00MB, used=264.00KB
System: total=4.00MB, used=0.00
Metadata, RAID1: total=79.00GB, used=70.23GB


Quite high metadata usage here.


The filesystems on ext4 and btrfs are copies; there are >30 milion 
inodes on ext4; most of the files have multiple hardlinks.


So paraphrasing my question: is there anything to improve "rm"
performance with btrfs?

"nodatacow" might help a bit, but then, it disabled the compression,
which is a major drawback.


-- 
Tomasz Chmielewski
http://wpkg.org


             reply	other threads:[~2013-07-22  5:22 UTC|newest]

Thread overview: 5+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2013-07-22  5:22 Tomasz Chmielewski [this message]
2013-07-22 10:39 ` abysmal rm performance? Duncan
  -- strict thread matches above, loose matches on Subject: below --
2013-07-20  5:37 Tomasz Chmielewski
2013-07-20 12:54 ` Duncan
2013-07-20 13:36   ` Clemens Eisserer

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=827cf884b1a6e12db95beea6912d946b@admin.virtall.com \
    --to=tch@virtall.com \
    --cc=1i5t5.duncan@cox.net \
    --cc=linux-btrfs@vger.kernel.org \
    --cc=linuxhippy@gmail.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).