All of lore.kernel.org
 help / color / mirror / Atom feed
From: Spelic <spelic@shiftmail.org>
To: dm-devel@redhat.com
Subject: Re: [PATCH v2] staging: writeboost: Add dm-writeboost
Date: Fri, 12 Dec 2014 23:18:23 +0100	[thread overview]
Message-ID: <548B69AF.7070403@shiftmail.org> (raw)
In-Reply-To: <548AD461.1020707@acm.org>

On 12/12/2014 12:41, Bart Van Assche wrote:
> On 12/12/14 10:35, Akira Hayakawa wrote:
>> Writeboost batches number of writes into a log (that is 512KB large) 
>> and submits to SSD
>> which maximizes the throughput and the lifetime of the SSD.
>
> Does this mean that dm-writeboost is similar to btier ? If so, this 
> makes me wonder which of these two subsystems would be the best 
> candidate for upstream inclusion. As far as I know btier doesn't split 
> bio's. The source code of btier can be downloaded from 
> http://sourceforge.net/projects/tier/.

No, Btier is a caching (tiering actually but there is little difference) 
software like bcache or dm-cache, which are are open source software 
reimplementations of things like LSI CacheCade.

OTOH dm-writeboost is an open source software reimplementation of a BBWC 
(battery backed write cache) of disk controllers.

For this reason dm-writeboost was unique in its class and no doubt it 
could be blazing fast (untested by me) if correctly implemented, orders 
of magnitude faster than caching softwares, and I was looking forward to 
see dm-writeboost into the kernel.

But me too I think that dm-writeboost really needs not to split BIOs 
(whoever thinks differently has probably never looked at perf while a 
very fast raid system was writing data), and as much as possible not 
perform memcopy, and would need to detect and skip sequential I/O 
(adding logic to still be safe on sync + power loss) and use 
writethrough for that which I think it also doesn't do. These are 
absolute requirements for high performance storage systems in the 2-20 
gigabytes per second range. If Akira doesn't see the need to not perform 
memcpy or not split BIOs or not skip sequential I/O it is most certainly 
because he hasn't tried to build a high performance storage system. 
Unfortunately I think that high performance storage systems are indeed 
the main market for writeboost, so that's why these things are needed.

Another important missing feature is  way to decommission writeboost or 
put it into writethrough mode, so to be able to snapshot the underlying 
device. This is totally needed in an industrial-grade production system.

OTOH read caching would have been useless for writeboost btw imho, and 
hence counterproductive. Layer dm-cache or bcache on top of writeboost 
if you need that.

S.

  reply	other threads:[~2014-12-12 22:18 UTC|newest]

Thread overview: 25+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2014-12-10 11:42 [PATCH v2] staging: writeboost: Add dm-writeboost Akira Hayakawa
2014-12-11 15:26 ` Mike Snitzer
2014-12-12  0:42   ` Akira Hayakawa
2014-12-12  9:12     ` [dm-devel] " Bart Van Assche
2014-12-12  9:35       ` Akira Hayakawa
2014-12-12  9:35         ` Akira Hayakawa
2014-12-12 11:41         ` Bart Van Assche
2014-12-12 22:18           ` Spelic [this message]
2014-12-13  7:08             ` Jianjian Huo
2014-12-12 14:24     ` Joe Thornber
2014-12-12 14:24       ` Joe Thornber
2014-12-12 15:09       ` Akira Hayakawa
2014-12-12 15:09         ` Akira Hayakawa
2014-12-13  6:45         ` [dm-devel] " Jianjian Huo
2014-12-13  6:45           ` Jianjian Huo
2014-12-13 14:07           ` Akira Hayakawa
2014-12-13 14:07             ` Akira Hayakawa
2014-12-14  2:12             ` Akira Hayakawa
2014-12-14  2:12               ` Akira Hayakawa
2014-12-14  2:46             ` Jianjian Huo
2014-12-14  2:46               ` Jianjian Huo
2014-12-14  3:22               ` Akira Hayakawa
2014-12-14  3:22                 ` Akira Hayakawa
2014-12-14  3:00         ` Akira Hayakawa
2014-12-14  3:00           ` Akira Hayakawa

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=548B69AF.7070403@shiftmail.org \
    --to=spelic@shiftmail.org \
    --cc=dm-devel@redhat.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.