linux-btrfs.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Austin S Hemmelgarn <ahferroin7@gmail.com>
To: Russell Coker <russell@coker.com.au>
Cc: Timofey Titovets <nefelim4ag@gmail.com>,
	Jim Salter <jim@jrs-s.net>,
	Rich Freeman <r-btrfs@thefreemanclan.net>,
	Gert Menke <gert@menke.ac>,
	Btrfs BTRFS <linux-btrfs@vger.kernel.org>
Subject: Re: BTRFS as image store for KVM?
Date: Fri, 2 Oct 2015 08:07:24 -0400	[thread overview]
Message-ID: <560E737C.7050206@gmail.com> (raw)
In-Reply-To: <201510021421.09558.russell@coker.com.au>

[-- Attachment #1: Type: text/plain, Size: 2456 bytes --]

On 2015-10-02 00:21, Russell Coker wrote:
> On Sat, 26 Sep 2015 12:20:41 AM Austin S Hemmelgarn wrote:
>>> FYI:
>>> Linux pagecache use LRU cache algo, and in general case it's working good
>>> enough
>>
>> I'd argue that 'general usage' should be better defined in this
>> statement.  Obviously, ZFS's ARC implementation provides better
>> performance in a significant number of common use cases for Linux,
>> otherwise people wouldn't be using it to the degree they are.
>
> No-one gets a free choice about this.  I have a number of servers running ZFS
> because I needed the data consistency features and BTRFS wasn't ready.  There
> is no choice of LRU vs ARC once you've made the BTRFS vs ZFS decision.
I'm not saying there is a free choice in this, although that is largely 
because the page-cache wasn't written in a way on Linux that allows for 
easy development of alternative caching algorithms for it. When I said 
'using it', I meant using ZFS, not just ARC. I would love to be able 
some day to be able to use ARC or even just SLRU (ARC with out the 
adaptive internal sizing bits) on Linux, as both provide better 
performance for COW workloads than plain LRU (although, somewhat 
paradoxically, for some COW workloads, an MRU algorithm is even better).
>
> ARC presumably worked better than the other Solaris caching options.  It was
> ported to Linux with zfsonlinux because that was the easy way of doing it.
Actually, I think part of that was also the fact that ZFS is a COW 
filesystem, and classical LRU caching (like the regular Linux pagecache) 
often does horribly with COW workloads (and I'm relatively convinced 
that this is a significant part of why BTRFS has such horrible 
performance compared to ZFS).
>
> Some people here have reported that ARC worked well for them on Linux.  My
> experience was that the zfsonlinux kernel modules wouldn't respect the module
> load options to reduce the size of the ARC and the default size would cause
> smaller servers to have kernel panics due to lack of RAM.  My solution to that
> problem was to get more RAM for all ZFS servers as buying RAM is cheaper for
> my clients than paying me to diagnose the problems with ZFS.
The whole ARC sizing issue with zfsonlinux is largely orthogonal to 
whether or not ARC is better for a given workload, and I think that 
there is actually some lower limit they force based on the amount of RAM 
at boot.


[-- Attachment #2: S/MIME Cryptographic Signature --]
[-- Type: application/pkcs7-signature, Size: 3019 bytes --]

  reply	other threads:[~2015-10-02 12:07 UTC|newest]

Thread overview: 45+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2015-09-15 21:34 BTRFS as image store for KVM? Gert Menke
2015-09-16  3:00 ` Chris Murphy
2015-09-16  3:57 ` Duncan
2015-09-16 11:35   ` Brendan Heading
2015-09-16 12:25     ` Austin S Hemmelgarn
2015-09-16 12:41     ` Paul Jones
2015-09-17 17:56   ` Gert Menke
2015-09-17 18:35     ` Chris Murphy
2015-09-17 21:32       ` Gert Menke
2015-09-18  2:00       ` Duncan
2015-09-18  8:32         ` Gert Menke
2015-09-23  7:28         ` Russell Coker
2015-09-18 14:13       ` Austin S Hemmelgarn
2015-09-23  7:24         ` Russell Coker
2015-09-17 18:46     ` Mike Fleetwood
2015-09-17 19:43     ` Hugo Mills
2015-09-17 21:49       ` Gert Menke
2015-09-18  2:22       ` Duncan
2015-09-18  8:59         ` Gert Menke
2015-09-17 22:41     ` Sean Greenslade
2015-09-18  7:34       ` Gert Menke
2015-09-17  4:19 ` Paul Harvey
2015-09-20  1:26 ` Jim Salter
2015-09-25 12:48   ` Rich Freeman
2015-09-25 12:56     ` Jim Salter
2015-09-25 13:04     ` Austin S Hemmelgarn
     [not found]       ` <5605483A.7040103@jrs-s.net>
2015-09-25 13:46         ` Austin S Hemmelgarn
2015-09-25 13:52       ` Jim Salter
2015-09-25 14:02         ` Timofey Titovets
2015-09-25 14:20           ` Austin S Hemmelgarn
2015-09-29 14:12             ` Gert Menke
2015-10-02  4:21             ` Russell Coker
2015-10-02 12:07               ` Austin S Hemmelgarn [this message]
2015-10-03  8:32                 ` Russell Coker
2015-10-04  2:09                   ` Duncan
2015-10-04 12:03                     ` Lionel Bouton
2015-10-04 12:21                       ` Rich Freeman
2015-10-05  8:19                         ` Duncan
2015-10-05  8:43                       ` Erkki Seppala
2015-10-05  8:51                         ` Roman Mamedov
2015-10-05 11:16                       ` Lionel Bouton
2015-10-05 11:40                         ` Rich Freeman
2015-10-05 11:54                         ` Austin S Hemmelgarn
     [not found]                       ` <RPG31r00t34oj7R01PG5Us>
2015-10-05 14:04                         ` Duncan
2015-10-05 15:59                           ` Austin S Hemmelgarn

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=560E737C.7050206@gmail.com \
    --to=ahferroin7@gmail.com \
    --cc=gert@menke.ac \
    --cc=jim@jrs-s.net \
    --cc=linux-btrfs@vger.kernel.org \
    --cc=nefelim4ag@gmail.com \
    --cc=r-btrfs@thefreemanclan.net \
    --cc=russell@coker.com.au \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).