linux-raid.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Hubert Verstraete <hubskml@free.fr>
To: Neil Brown <neilb@suse.de>, linux-raid@vger.kernel.org
Subject: internal bitmap size
Date: Tue, 26 Feb 2008 18:35:23 +0100	[thread overview]
Message-ID: <47C44DDB.3050201@free.fr> (raw)
In-Reply-To: <18219.3453.415512.450789@notabene.brown>

Hi Neil,

Neil Brown wrote:
> For now, you will have to live with a smallish bitmap, which probably
> isn't a real problem.  With 19078 bits, you will still get a
> several-thousand-fold increase it resync speed after a crash
> (i.e. hours become seconds) and to some extent, fewer bits are better
> and you have to update them less.
>
> I've haven't made any measurements to see what size bitmap is
> ideal... maybe someone should :-)

I've made some tries with a 4 250GB disks RAID-5 array and the write 
speed is really ugly with the default internal bitmap size.
Setting a bigger bitmap chunk size (16 MB for example) creates a small 
bitmap. The write speed is then almost the same as when there is no 
bitmap, which is great. And as you said, the resync is a matter of 
seconds (or minutes) instead of hours (without bitmap).
With such a setting, I've got both a nice write speed and a nice resync 
speed. That's where I would look at to find MY ideal bitmap size.

Neil, is there an issue to use the --bitmap-chunk option while using an 
internal bitmap ?
The man page does not clearly say to avoid using it and the mdadm source 
code does not prevent setting this size in the case of an internal bitmap.

Regarding my measurements, it showed that the default bitmap size is 4x 
slower than a small bitmap in v1.0 superblock. With v1.1 and v1.2 
superblocks, the default is 2x slower. We are far from the 10% slowdown 
claimed by http://linux-raid.osdl.org

I've also tried to play with the bitmap flush period (--delay option), 
but I would need to understand how it works to see if this can have an 
effect on performance.

Regards,
Hubert

      parent reply	other threads:[~2008-02-26 17:35 UTC|newest]

Thread overview: 6+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2007-11-02  9:01 Very small internal bitmap after recreate Ralf Müller
     [not found] ` <18218.60496.499724.710572@notabene.brown>
2007-11-02 10:22   ` Ralf Müller
2007-11-02 10:29     ` Ralf Müller
2007-11-02 11:43     ` Neil Brown
2007-11-02 12:46       ` Ralf Müller
2008-02-26 17:35       ` Hubert Verstraete [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=47C44DDB.3050201@free.fr \
    --to=hubskml@free.fr \
    --cc=linux-raid@vger.kernel.org \
    --cc=neilb@suse.de \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).