From: Duncan <1i5t5.duncan@cox.net>
To: linux-btrfs@vger.kernel.org
Subject: Re: Are nocow files snapshot-aware
Date: Thu, 6 Feb 2014 02:38:32 +0000 (UTC) [thread overview]
Message-ID: <pan$9252f$8363907a$3eaa17a6$f558018@cox.net> (raw)
In-Reply-To: 6qbasa-fq1.ln1@hurikhan77.spdns.de
Kai Krakow posted on Wed, 05 Feb 2014 19:17:10 +0100 as excerpted:
> David Sterba <dsterba@suse.cz> schrieb:
>
>> On Tue, Feb 04, 2014 at 08:22:05PM -0500, Josef Bacik wrote:
>>> On 02/04/2014 03:52 PM, Kai Krakow wrote:
>>> >Hi!
>>> >
>>> >I'm curious... The whole snapshot thing on btrfs is based on its COW
>>> >design. But you can make individual files and directory contents
>>> >nocow by applying the C attribute on it using chattr. This is usually
>>> >recommended for database files and VM images. So far, so good...
>>> >
>>> >But what happens to such files when they are part of a snapshot? Do
>>> >they become duplicated during the snapshot? Do they become unshared
>>> >(as a whole) when written to? Or when the the parent snapshot becomes
>>> >deleted?
>>> >Or maybe the nocow attribute is just ignored after a snapshot was
>>> >taken?
>>> >
>>> When snapshotted nocow files fallback to normal cow behaviour.
>>
>> This may seem unclear to people not familiar with the actual
>> implementation, and I had to think for a second about that sentence.
>> The file will keep the NOCOW status, but any modified blocks will be
>> newly allocated on the first write (in a COW manner), then the block
>> location will not change anymore (unlike ordinary COW).
>
> Ah okay, that makes it clear. So, actually, in the snapshot the file is
> still nocow - just for the exception that blocks being written to become
> unshared and relocated. This may introduce a lot of fragmentation but it
> won't become worse when rewriting the same blocks over and over again.
That also explains the report of a NOCOW VM-image still triggering the
snapshot-aware-defrag-related pathology. It was a _heavily_ auto-
snapshotted btrfs (thousands of snapshots, something like every 30
seconds or more frequent, without thinning them down right away), and the
continuing VM writes would nearly guarantee that many of those snapshots
had unique blocks, so the effect was nearly as bad as if it wasn't NOCOW
at all!
--
Duncan - List replies preferred. No HTML msgs.
"Every nonfree program has a lord, a master --
and if you use the program, he is your master." Richard Stallman
next prev parent reply other threads:[~2014-02-06 2:39 UTC|newest]
Thread overview: 15+ messages / expand[flat|nested] mbox.gz Atom feed top
2014-02-04 20:52 Are nocow files snapshot-aware Kai Krakow
2014-02-05 1:22 ` Josef Bacik
2014-02-05 2:02 ` David Sterba
2014-02-05 18:17 ` Kai Krakow
2014-02-06 2:38 ` Duncan [this message]
2014-02-07 0:32 ` Kai Krakow
2014-02-07 1:01 ` cwillu
2014-02-07 1:28 ` Chris Murphy
2014-02-07 21:07 ` Kai Krakow
2014-02-07 21:31 ` Chris Murphy
2014-02-07 22:26 ` Kai Krakow
2014-02-08 6:34 ` Duncan
2014-02-08 8:50 ` Kai Krakow
2014-02-07 7:06 ` Duncan
2014-02-07 21:58 ` Kai Krakow
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to='pan$9252f$8363907a$3eaa17a6$f558018@cox.net' \
--to=1i5t5.duncan@cox.net \
--cc=linux-btrfs@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).