linux-btrfs.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Oliver Freyermuth <o.freyermuth@googlemail.com>
To: Qu Wenruo <quwenruo@cn.fujitsu.com>, linux-btrfs@vger.kernel.org
Subject: Re: btrfs send extremely slow (almost stuck)
Date: Sun, 4 Sep 2016 23:41:00 +0200	[thread overview]
Message-ID: <5e6e606d-e75c-b7f1-0a9f-4e36090659eb@googlemail.com> (raw)
In-Reply-To: <a7ead62b-38f5-2ed6-c24b-1960a8fc6ba8@cn.fujitsu.com>

Am 30.08.2016 um 02:48 schrieb Qu Wenruo:
> Yes.
> And more specifically, it doesn't even affect delta backup.
> 
> For shared extents caused by reflink/dedupe(out-of-band or even incoming in-band), it will be send as individual files.
> 
> For contents, they are all the same, just more space usage.

For those interested, I have now actually tested the btrfs send / btrfs receive backup for several subvolumes after applying this patch. 
The throughput is finally usable, almost hitting network / IO limits as expected - ideal so far! 
Also delta seemed fine for the subvolumes for which things worked. 

However, I now sadly get (for one of my subvolumes): 

send ioctl failed with -2: No such file or directory

at some point during the transfer, it sadly seems to be reproducible. 
I do not think it's related to this patch, but of course this makes "btrfs send" still unusable to me - 
I guess it's not ready for general use just yet. 
Is there any information I can easily extract / provide to allow the experts to fix this issue?
The kernel log shows nothing. 

Thanks a lot, 
	Oliver

  reply	other threads:[~2016-09-04 21:41 UTC|newest]

Thread overview: 19+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2016-08-28  3:38 btrfs send extremely slow (almost stuck) Oliver Freyermuth
2016-08-28  7:53 ` Duncan
2016-08-29  2:11 ` Qu Wenruo
2016-08-29  2:12   ` Qu Wenruo
2016-08-31  1:35     ` Jeff Mahoney
2016-08-31  1:54       ` Qu Wenruo
2016-08-29 10:02   ` Oliver Freyermuth
2016-08-30  0:48     ` Qu Wenruo
2016-09-04 21:41       ` Oliver Freyermuth [this message]
2016-09-05  5:21         ` Qu Wenruo
2016-09-05 21:29           ` Oliver Freyermuth
2016-09-06  2:13             ` Duncan
2016-09-06 22:24               ` Oliver Freyermuth
2016-09-06  2:46             ` Qu Wenruo
2016-09-06 21:53               ` Oliver Freyermuth
  -- strict thread matches above, loose matches on Subject: below --
2016-08-28 16:15 Oliver Freyermuth
2016-08-28 21:41 ` james harvey
2016-08-29 17:50   ` Kai Krakow
2017-04-14 15:33 J. Hart

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=5e6e606d-e75c-b7f1-0a9f-4e36090659eb@googlemail.com \
    --to=o.freyermuth@googlemail.com \
    --cc=linux-btrfs@vger.kernel.org \
    --cc=quwenruo@cn.fujitsu.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).