linux-btrfs.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: "J. Hart" <jfhart085@gmail.com>
To: linux-btrfs@vger.kernel.org
Subject: Unexpected: send/receive much slower than rsync ?
Date: Tue, 11 Apr 2017 11:11:46 -0400	[thread overview]
Message-ID: <58ECF232.6010500@gmail.com> (raw)

I'm trying to update from an old snapshot of a directory to a new one 
using send/receive. It seems a great deal slower than I was expecting, 
perhaps much slower than rsync and has been running for hours. 
Everything looks ok with how I set up the snapshots, and there are no 
error messages, but I don't think it should be running this long. The 
directory structure is rather complex, so that may have something to do 
with it. It contains reflinked incremental backups of root file systems 
from a number of machines. It should not actually be very large due to 
the reflinks.

Sending the old version of the snapshot for the directory did not seem 
to take this long, and I expected the "send -p <old> <new>" to be much 
faster than that.

I tried running the "send" and "receive" with "-vv" to get more detail 
on what was happening.

I had thought that btrfs send/receive purely dealt with block/extent 
level changes.

I could be mistaken, but it seems that btrfs receive actually does a 
great deal of manipulation at the level of individual files, and rather 
less efficiently than rsync at that. I am not sure whether it is using 
system calls to do this, or actual shell commands themselves. I see 
quite a bit of what looks like file level manipulation in the verbose 
output. It is indeed very fast for simple directory trees even with very 
large files. However, it seems to be far slower than rsync with 
moderately complex directory trees, even if no large files are present.

I hope I'm overlooking something, and that this is not actually the 
case. Any ideas on this ?

J. Hart


             reply	other threads:[~2017-04-11 15:11 UTC|newest]

Thread overview: 2+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2017-04-11 15:11 J. Hart [this message]
2017-04-12  6:45 ` Unexpected: send/receive much slower than rsync ? Hermann Schwärzler

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=58ECF232.6010500@gmail.com \
    --to=jfhart085@gmail.com \
    --cc=linux-btrfs@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).