From: Christoph Anton Mitterer <calestyo@scientia.net>
To: Chris Mason <clm@fb.com>
Cc: Btrfs BTRFS <linux-btrfs@vger.kernel.org>
Subject: Re: RedHat 7.4 Release Notes: "Btrfs has been deprecated" - wut?
Date: Wed, 16 Aug 2017 15:31:48 +0200 [thread overview]
Message-ID: <1502890308.5446.5.camel@scientia.net> (raw)
In-Reply-To: <20170816131230.GA28619@clm-mbp.thefacebook.com>
[-- Attachment #1: Type: text/plain, Size: 2536 bytes --]
Just out of curiosity:
On Wed, 2017-08-16 at 09:12 -0400, Chris Mason wrote:
> Btrfs couples the crcs with COW because
this (which sounds like you want it to stay coupled that way)...
plus
> It's possible to protect against all three without COW, but all
> solutions have their own tradeoffs and this is the setup we
> chose. It's
> easy to trust and easy to debug and at scale that really helps.
... this (which sounds more you think the checksumming is so helpful,
that it would be nice in the nodatacow as well).
What does that mean now? Things will stay as they are... or it may
become a goal to get checksumming for nodatacow (while of course still
retaining the possibility to disable both, datacow AND checksumming)?
> In general, production storage environments prefer clearly defined
> errors when the storage has the wrong data. EIOs happen often, and
> you
> want to be able to quickly pitch the bad data and replicate in good
> data.
Which would also rather point towards getting clear EIOs (and thus
checksumming) in the nodatacow case.
> My real goal is to make COW fast enough that we can leave it on for
> the
> database applications too. Obviously I haven't quite finished that
> one
> yet ;)
Well the question is, even if you manage that sooner or later, will
everyone be fully satisfied by this?!
I've mentioned earlier on the list that I manage one of the many big
data/computing centres for LHC.
Our use case is typically big plain storage servers connected via some
higher level storage management system (http://dcache.org/)... with
mostly write once/read many.
So apart from some central DBs for the storage management system
itself, CoW is mostly no issue for us.
But I've talked to some friend at the local super computing centre and
they have rather general issues with CoW at their virtualisation
cluster.
Like SUSE's snapper making many snapshots leading the storage images of
VMs apparently to explode (in terms of space usage).
For some of their storage backends there simply seem to be no de-
duplication available (or other reasons that prevent it's usage).
From that I'd guess there would be still people who want the nice
features of btrfs (snapshots, checksumming, etc.), while still being
able to nodatacow in specific cases.
> But I'd rather keep the building block of all the other btrfs
> features in place than try to do crcs differently.
Mhh I see, what a pity.
Cheers,
Chris.
[-- Attachment #2: smime.p7s --]
[-- Type: application/x-pkcs7-signature, Size: 5930 bytes --]
next prev parent reply other threads:[~2017-08-16 13:31 UTC|newest]
Thread overview: 63+ messages / expand[flat|nested] mbox.gz Atom feed top
2017-08-02 8:38 RedHat 7.4 Release Notes: "Btrfs has been deprecated" - wut? Brendan Hide
2017-08-02 9:11 ` Wang Shilong
2017-08-03 19:18 ` Chris Murphy
2017-08-02 11:25 ` Austin S. Hemmelgarn
2017-08-02 12:55 ` Lutz Vieweg
2017-08-02 13:47 ` Austin S. Hemmelgarn
2017-08-02 18:44 ` Chris Mason
2017-08-02 22:12 ` Fajar A. Nugraha
2017-08-02 22:22 ` Chris Murphy
2017-08-03 9:59 ` Lutz Vieweg
2017-08-03 18:08 ` waxhead
2017-08-03 18:29 ` Christoph Anton Mitterer
2017-08-03 19:22 ` Austin S. Hemmelgarn
2017-08-03 20:45 ` Brendan Hide
2017-08-03 22:00 ` Chris Murphy
2017-08-04 11:26 ` Austin S. Hemmelgarn
2017-08-03 19:03 ` Austin S. Hemmelgarn
2017-08-04 9:48 ` Duncan
2017-08-16 18:07 ` David Sterba
2017-08-04 14:05 ` Qu Wenruo
2017-08-04 23:55 ` Wang Shilong
2017-08-07 15:27 ` Chris Murphy
2017-08-10 0:35 ` Qu Wenruo
2017-08-12 0:10 ` Christoph Anton Mitterer
2017-08-12 7:42 ` Christoph Hellwig
2017-08-12 11:51 ` Christoph Anton Mitterer
2017-08-12 12:12 ` Hugo Mills
2017-08-13 14:08 ` Goffredo Baroncelli
2017-08-14 7:08 ` Qu Wenruo
2017-08-14 14:23 ` Goffredo Baroncelli
2017-08-14 19:08 ` Chris Murphy
2017-08-14 20:27 ` Goffredo Baroncelli
2017-08-14 6:36 ` Qu Wenruo
2017-08-14 7:43 ` Paul Jones
2017-08-14 7:46 ` Qu Wenruo
2017-08-14 12:32 ` Christoph Anton Mitterer
2017-08-14 12:58 ` Qu Wenruo
2017-08-14 12:24 ` Christoph Anton Mitterer
2017-08-14 14:23 ` Austin S. Hemmelgarn
2017-08-14 15:13 ` Graham Cobb
2017-08-14 15:53 ` Austin S. Hemmelgarn
2017-08-14 16:42 ` Graham Cobb
2017-08-14 19:54 ` Christoph Anton Mitterer
2017-08-15 11:37 ` Austin S. Hemmelgarn
2017-08-15 14:41 ` Christoph Anton Mitterer
2017-08-15 15:43 ` Austin S. Hemmelgarn
2017-08-16 13:12 ` Chris Mason
2017-08-16 13:31 ` Christoph Anton Mitterer [this message]
2017-08-16 13:53 ` Austin S. Hemmelgarn
2017-08-16 14:11 ` Christoph Anton Mitterer
2017-08-16 15:07 ` Austin S. Hemmelgarn
2017-08-16 17:26 ` Peter Grandi
2017-08-16 18:19 ` David Sterba
2017-08-16 16:54 ` Peter Grandi
2017-08-16 13:56 ` Austin S. Hemmelgarn
2017-08-16 14:01 ` Qu Wenruo
2017-08-16 19:52 ` Chris Murphy
2017-08-17 6:25 ` GWB
2017-08-17 11:47 ` Austin S. Hemmelgarn
2017-08-17 19:00 ` Chris Murphy
2017-08-17 20:34 ` GWB
2017-08-16 16:44 ` Peter Grandi
2017-08-14 19:39 ` Christoph Anton Mitterer
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1502890308.5446.5.camel@scientia.net \
--to=calestyo@scientia.net \
--cc=clm@fb.com \
--cc=linux-btrfs@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.