From: "Arkadiusz Miśkiewicz" <arekm@maven.pl>
To: "xfs@oss.sgi.com" <xfs@oss.sgi.com>
Subject: hardlinking and deleting milions of small files
Date: Sun, 24 Jul 2016 14:38:10 +0200 [thread overview]
Message-ID: <201607241438.10035.arekm@maven.pl> (raw)
Hello.
I'm using rsnapshot to backup big servers (like 5TB fs, 25 000 000 inodes,
small files - mailboxes in form of maildirs, so each mail is a separate file).
Backup server - kernel 4.6.3, V4 xfs filesystems.
cp -al for that amount takes about 1.5 day.
rm -rf of hardlinked copy takes another 1.5 day
(and toons of ram for these operations; causing OOM until recent kernels made
reclaim better, so no more OOM)
Now the weird part - similar operations on ext4 finish in matter of hours.
Are there any possibilities for xfs to improve in these areas?
From irc #xfs from few months ago the conclusion was that xfs isn't best in
such operations.
ps. Didn't do scientific comparison (I'm just viewing backup logs of two
similar mail servers (similar hardware, similar storage size) being backed up
to single backup server onto two partitions - one with xfs and one with ext4
on it))
--
Arkadiusz Miśkiewicz, arekm / ( maven.pl | pld-linux.org )
_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs
next reply other threads:[~2016-07-24 12:38 UTC|newest]
Thread overview: 3+ messages / expand[flat|nested] mbox.gz Atom feed top
2016-07-24 12:38 Arkadiusz Miśkiewicz [this message]
2016-07-24 12:48 ` hardlinking and deleting milions of small files Carlos E. R.
2016-07-25 0:23 ` Dave Chinner
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=201607241438.10035.arekm@maven.pl \
--to=arekm@maven.pl \
--cc=xfs@oss.sgi.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox