linux-btrfs.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Wang Shilong <wangshilong1991@gmail.com>
To: Josef Bacik <jbacik@fb.com>
Cc: <linux-btrfs@vger.kernel.org>, Wang Shilong <wangsl.fnst@cn.fujitsu.com>
Subject: Re: [PATCH] Btrfs: convert to add transaction protection for btrfs send
Date: Thu, 30 Jan 2014 17:42:47 +0800	[thread overview]
Message-ID: <EA799A56-E02C-4D2E-957A-99CE1ED9CDB4@gmail.com> (raw)
In-Reply-To: <52E94FEA.5060404@fb.com>

Hi Josef,

> 
> On 01/29/2014 10:32 AM, Wang Shilong wrote:
>> From: Wang Shilong <wangsl.fnst@cn.fujitsu.com>
>> 
>> I sent a patch to kick off transaction from btrfs send, however it gets
>> a regression that btrfs send try to search extent commit root without
>> transaction protection.
>> 
>> To fix this regression, we have two ideas:
>> 
>>  1. don't use extent commit root for sending.
>> 
>>  2. add transaction protection to use extent commit root safely.
>> 
>> Both approaches need transaction actually, however, the first approach
>> will add extent tree lock contention, so we'd better adopt the second
>> approach.
>> 
>> Luckily, now we only need transaction protection when iterating
>> extent root, the protection's *range* is smaller than before.
> So what is the problem exactly?  How does it show up and what are you doing to make it happen?  I'd really like to kill the transaction taking completely in the send path so I'd like to know what is going wrong so we can either take the extent commit semaphore and be satisfied that is ok or come up with a different solution.  Thanks,

See in find_extent_clone(), we have to walk backrefs  while we have to search extent tree!
i was thinking to kick off transaction for initial  full send, however, we need to consider ref links even
in the initial send.

It is easy to trigger problems like the following steps:

# mkfs.btrfs -f /dev/sda8
# mount /dev/sda8 /mnt
# dd if=/dev/zero of=/mnt/data bs=4k count=102400 oflag=direct
# btrfs sub snapshot -r /mnt /mnt/snap
# btrfs send /mnt/snap -f /mnt/send_file &
# btrfs sub snapshot /mnt/snap /mnt/snap_1

Feel free to correct me if i miss something here^_^(As i sometimes made some mistakes).

Thanks,
Wang
> ,
> Josef


  reply	other threads:[~2014-01-30  9:42 UTC|newest]

Thread overview: 16+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2014-01-29 15:32 [PATCH] Btrfs: convert to add transaction protection for btrfs send Wang Shilong
2014-01-29 15:32 ` Wang Shilong
2014-01-29 19:00 ` Josef Bacik
2014-01-30  9:42   ` Wang Shilong [this message]
2014-01-30 16:08     ` Josef Bacik
2014-01-30 16:20       ` Wang Shilong
2014-01-30 16:23         ` Josef Bacik
2014-01-30 16:42           ` Wang Shilong
2014-01-31 16:37             ` Wang Shilong
2014-01-31 23:40               ` Josef Bacik
2014-02-03 21:31               ` Josef Bacik
2014-02-05  8:59                 ` Wang Shilong
2014-02-05 14:04                   ` Josef Bacik
2014-02-05 17:23                     ` Wang Shilong
2014-02-05 20:47                       ` Josef Bacik
2014-02-08  3:06                         ` Wang Shilong

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=EA799A56-E02C-4D2E-957A-99CE1ED9CDB4@gmail.com \
    --to=wangshilong1991@gmail.com \
    --cc=jbacik@fb.com \
    --cc=linux-btrfs@vger.kernel.org \
    --cc=wangsl.fnst@cn.fujitsu.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).