From: "Austin S. Hemmelgarn" <ahferroin7@gmail.com>
To: Brendan Hide <brendan@swiftspirit.co.za>,
Christoph Anton Mitterer <calestyo@scientia.net>,
linux-btrfs@vger.kernel.org
Subject: Re: RedHat 7.4 Release Notes: "Btrfs has been deprecated" - wut?
Date: Fri, 4 Aug 2017 07:26:32 -0400 [thread overview]
Message-ID: <ae2377bf-9108-c0ff-4228-e73ac4b0dd2b@gmail.com> (raw)
In-Reply-To: <ce5ca6f1-19ef-3bfc-541b-90d526e29e5c@swiftspirit.co.za>
On 2017-08-03 16:45, Brendan Hide wrote:
>
>
> On 08/03/2017 09:22 PM, Austin S. Hemmelgarn wrote:
>> On 2017-08-03 14:29, Christoph Anton Mitterer wrote:
>>> On Thu, 2017-08-03 at 20:08 +0200, waxhead wrote:
>>> There are no higher-level management tools (e.g. RAID
>>> management/monitoring, etc.)...
> [snip]
>
>> As far as 'higher-level' management tools, you're using your system
>> wrong if you _need_ them. There is no need for there to be a GUI, or
>> a web interface, or a DBus interface, or any other such bloat in the
>> main management tools, they work just fine as is and are mostly on par
>> with the interfaces provided by LVM, MD, and ZFS (other than the lack
>> of machine parseable output). I'd also argue that if you can't
>> reassemble your storage stack by hand without using 'higher-level'
>> tools, you should not be using that storage stack as you don't
>> properly understand it.
>>
>> On the subject of monitoring specifically, part of the issue there is
>> kernel side, any monitoring system currently needs to be
>> polling-based, not event-based, and as a result monitoring tends to be
>> a very system specific affair based on how much overhead you're
>> willing to tolerate. The limited stuff that does exist is also trivial
>> to integrate with many pieces of existing monitoring infrastructure
>> (like Nagios or monit), and therefore the people who care about it a
>> lot (like me) are either monitoring by hand, or are just using the
>> tools with their existing infrastructure (for example, I use monit
>> already on all my systems, so I just make sure to have entries in the
>> config for that to check error counters and scrub results), so there's
>> not much in the way of incentive for the concerned parties to reinvent
>> the wheel.
>
> To counter, I think this is a big problem with btrfs, especially in
> terms of user attrition. We don't need "GUI" tools. At all. But we do
> need that btrfs is self-sufficient enough that regular users don't get
> burnt by what they would view as unexpected behaviour. We have
> currently a situation where btrfs is too demanding on inexperienced users.
>
> I feel we need better worst-case behaviours. For example, if *I* have a
> btrfs on its second-to-last-available chunk, it means I'm not
> micro-managing properly. But users shouldn't have to micro-manage in the
> first place. Btrfs (or a management tool) should just know to balance
> the least-used chunk and/or delete the lowest-priority snapshot, etc. It
> shouldn't cause my services/apps to give diskspace errors when, clearly,
> there is free space available.
That's not just an issue with BTRFS, it's an issue with the distros too.
The only one that ships any kind of scheduled regular maintenance as
far as I know is SUSE. We don't need some daemon, or even special
handling in the kernel, we just need to provide people with standard
maintenance tools, and proper advice for monitoring. I've been meaning
to write up some wrappers and a couple of cron files to handle this a
bit better, but just haven't had time. I may look at getting that done
either today or early next week.
>
> The other "high-level" aspect would be along the lines of better
> guidance and standardisation for distros on how best to configure btrfs.
> This would include guidance/best practices for things like appropriate
> subvolume mountpoints and snapshot paths, sensible schedules or logic
> (or perhaps even example tools/scripts) for balancing and scrubbing the
> filesystem.
There are currently three standards for this:
1. The snapper way, used by at least SUSE and Ubuntu, which IMO ends up
being way too complicated for not much benefit.
2. The traditional filesystem way, used by most other distros, which
doesn't use subvolumes at all.
3. The user choice way, used by stuff like Arch and Gentoo, which pretty
much says the rest of the OS could care less how the filesystems and
subvolumes are organized, as long as things work.
Overall, other than the first one, this is no different than with
regular filesystems.
>
> I don't have all the answers. But I also don't want to have to tell
> people they can't adopt it because a) they don't (or never will)
> understand it; and b) they're going to resent me for their irresponsibly
> losing their own data.
>
next prev parent reply other threads:[~2017-08-04 11:26 UTC|newest]
Thread overview: 63+ messages / expand[flat|nested] mbox.gz Atom feed top
2017-08-02 8:38 RedHat 7.4 Release Notes: "Btrfs has been deprecated" - wut? Brendan Hide
2017-08-02 9:11 ` Wang Shilong
2017-08-03 19:18 ` Chris Murphy
2017-08-02 11:25 ` Austin S. Hemmelgarn
2017-08-02 12:55 ` Lutz Vieweg
2017-08-02 13:47 ` Austin S. Hemmelgarn
2017-08-02 18:44 ` Chris Mason
2017-08-02 22:12 ` Fajar A. Nugraha
2017-08-02 22:22 ` Chris Murphy
2017-08-03 9:59 ` Lutz Vieweg
2017-08-03 18:08 ` waxhead
2017-08-03 18:29 ` Christoph Anton Mitterer
2017-08-03 19:22 ` Austin S. Hemmelgarn
2017-08-03 20:45 ` Brendan Hide
2017-08-03 22:00 ` Chris Murphy
2017-08-04 11:26 ` Austin S. Hemmelgarn [this message]
2017-08-03 19:03 ` Austin S. Hemmelgarn
2017-08-04 9:48 ` Duncan
2017-08-16 18:07 ` David Sterba
2017-08-04 14:05 ` Qu Wenruo
2017-08-04 23:55 ` Wang Shilong
2017-08-07 15:27 ` Chris Murphy
2017-08-10 0:35 ` Qu Wenruo
2017-08-12 0:10 ` Christoph Anton Mitterer
2017-08-12 7:42 ` Christoph Hellwig
2017-08-12 11:51 ` Christoph Anton Mitterer
2017-08-12 12:12 ` Hugo Mills
2017-08-13 14:08 ` Goffredo Baroncelli
2017-08-14 7:08 ` Qu Wenruo
2017-08-14 14:23 ` Goffredo Baroncelli
2017-08-14 19:08 ` Chris Murphy
2017-08-14 20:27 ` Goffredo Baroncelli
2017-08-14 6:36 ` Qu Wenruo
2017-08-14 7:43 ` Paul Jones
2017-08-14 7:46 ` Qu Wenruo
2017-08-14 12:32 ` Christoph Anton Mitterer
2017-08-14 12:58 ` Qu Wenruo
2017-08-14 12:24 ` Christoph Anton Mitterer
2017-08-14 14:23 ` Austin S. Hemmelgarn
2017-08-14 15:13 ` Graham Cobb
2017-08-14 15:53 ` Austin S. Hemmelgarn
2017-08-14 16:42 ` Graham Cobb
2017-08-14 19:54 ` Christoph Anton Mitterer
2017-08-15 11:37 ` Austin S. Hemmelgarn
2017-08-15 14:41 ` Christoph Anton Mitterer
2017-08-15 15:43 ` Austin S. Hemmelgarn
2017-08-16 13:12 ` Chris Mason
2017-08-16 13:31 ` Christoph Anton Mitterer
2017-08-16 13:53 ` Austin S. Hemmelgarn
2017-08-16 14:11 ` Christoph Anton Mitterer
2017-08-16 15:07 ` Austin S. Hemmelgarn
2017-08-16 17:26 ` Peter Grandi
2017-08-16 18:19 ` David Sterba
2017-08-16 16:54 ` Peter Grandi
2017-08-16 13:56 ` Austin S. Hemmelgarn
2017-08-16 14:01 ` Qu Wenruo
2017-08-16 19:52 ` Chris Murphy
2017-08-17 6:25 ` GWB
2017-08-17 11:47 ` Austin S. Hemmelgarn
2017-08-17 19:00 ` Chris Murphy
2017-08-17 20:34 ` GWB
2017-08-16 16:44 ` Peter Grandi
2017-08-14 19:39 ` Christoph Anton Mitterer
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=ae2377bf-9108-c0ff-4228-e73ac4b0dd2b@gmail.com \
--to=ahferroin7@gmail.com \
--cc=brendan@swiftspirit.co.za \
--cc=calestyo@scientia.net \
--cc=linux-btrfs@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.