From: Duncan <1i5t5.duncan@cox.net>
To: linux-btrfs@vger.kernel.org
Subject: Re: btrfs mounts RO, kernel oops on RW
Date: Sun, 28 May 2017 20:51:07 +0000 (UTC) [thread overview]
Message-ID: <pan$2da74$5ca79c06$4ae1fa5f$5d80e969@cox.net> (raw)
In-Reply-To: CAHPjZW5sRxns7CN8QmhB_HaQP5PGo7smFrf+q1QWHRRVnAToMA@mail.gmail.com
Bill Williamson posted on Sun, 28 May 2017 17:27:47 +1000 as excerpted:
> I'm not asking for a specific endorsement, but should I be considering
> something like the seagate ironwolf or WD red drives?
There's a (well, at least one) guy here that knows much more about that
than I do, and FWIW, my own usage is rather lower on the scale, sub-TB
and generally SSD. I just saw the trouble with the 8TB archive drives
hit the list and while as I said the worst of it is now fixed, know they
still have problems with btrfs due to its write pattern, so thought I'd
warn you, just in case.
Basically, the way these work is that to get their extreme storage
density, other than for a relatively small fast-write area (perhaps a
hundred gig or a half TB, I'm not sure), they interleaf sectors in
"zones", overlapping like tiles on a tile roof, and to write or rewrite
just a single sector means (re)writing the entire zone. So they'll
typically write to the fast-write area during the initial write, then
when the drive isn't busy satisfying incoming requests, it'll rewrite
that data into one of these zones.
So as long as you're either doing relatively slow archiving writes and
there's time in between to do the zone rewrites (think security cam
footage with motion-sensitivity so it doesn't actually write if the image
is static), these things work great, and are a great deal for the money
due to their generally lower per-TB cost.
But they'll do a lot of background rewriting from the fast write area
when the disk is otherwise idle, and if you shut down in the middle of a
rewrite, I believe it has to start that zone rewrite over.
And if the writes come in too fast or too steady and overwhelm that fast
write area, things **DRAMATICALLY** slow down, and can appear to lock up
the system at times because the zone rewrite is in progress and it can't
just drop it to satisfy a read request unless it wants to scrap the zone
rewrite and start it over later, which of course intensifies the problem
even more if the writes are already coming in faster than the drive can
rewrite the zones.
So these work best in large always-on installations with relatively slow
archive-write patterns such that very little is rewritten where the drive
has lots of otherwise inactive powered-on time to do its zone rewrites,
uninterrupted by incoming requests or power-downs. (I have a feeling
Amazon Glacier may be a major if not their primary customer...)
Within that envelope, they tend to be very good value for the money,
which makes them very tempting in general, but a lot of people simply
aren't aware of the serious limits of the targeted usage envelope, and
due to that low cost, want to use them for other things for which they're
a very poor match.
And the btrfs write pattern, along with the fact that it's still
stabilizing, not as stable and mature as for instance ext* or xfs, makes
btrfs a very poor choice for use on these drives, unless the use-case
really /does/ fall squarely within their target envelope.
--
Duncan - List replies preferred. No HTML msgs.
"Every nonfree program has a lord, a master --
and if you use the program, he is your master." Richard Stallman
next prev parent reply other threads:[~2017-05-28 20:51 UTC|newest]
Thread overview: 6+ messages / expand[flat|nested] mbox.gz Atom feed top
2017-05-28 2:46 btrfs mounts RO, kernel oops on RW Bill Williamson
2017-05-28 5:56 ` Duncan
2017-05-28 7:27 ` Bill Williamson
2017-05-28 20:51 ` Duncan [this message]
2017-05-29 8:39 ` Marat Khalili
2017-05-28 22:25 ` Chris Murphy
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to='pan$2da74$5ca79c06$4ae1fa5f$5d80e969@cox.net' \
--to=1i5t5.duncan@cox.net \
--cc=linux-btrfs@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).