All of lore.kernel.org
 help / color / mirror / Atom feed
From: John Robinson <john.robinson@anonymous.org.uk>
To: Adam Goryachev <adam@websitemanagers.com.au>
Cc: "Ralf Müller" <ralf@bj-ig.de>, "Linux RAID" <linux-raid@vger.kernel.org>
Subject: Re: Howto avoid full re-sync
Date: Wed, 12 Sep 2012 14:28:42 +0100	[thread overview]
Message-ID: <50508E0A.7090309@anonymous.org.uk> (raw)
In-Reply-To: <50508582.3070501@websitemanagers.com.au>

On 12/09/2012 13:52, Adam Goryachev wrote:
> On 11/09/12 00:12, Ralf Müller wrote:
>> Besides all the stuff about fix your server, a raid is not a backup and you risk your data - simply add a write intent bitmap:
>>
>> mdadm /dev/md2 --grow --bitmap=internal
> I've added this across a number of my systems now, and it seems to work
> really well (Thank You), especially one system which has a RAID1 with an
> external USB drive + internal drive which normally take over 2 days for
> a full resync.

It may also be worth reading up on --write-mostly for your external USB 
drive, particularly if your workload tends to be single long streaming 
reads rather than lots of small parallel ones.

> Can you suggest if there is any dis-advantage to using the bitmap (maybe
> write performance will suffer), or disk space is reduced, or ....
>
> While I can see the benefits, I'm just wondering if it might be too good
> to be true, or what I am missing....
>
> Thanks again for your assistance.

Yes, write performance suffers, especially if you have a small bitmap 
chunk size, and the default is as small as possible for the array. See 
`mdadm -X /dev/sdX` on one of the components of your array for what the 
default was calculated to be for your array, and read the --bitmap-chunk 
section of `man mdadm` for a description of bitmap chunk size 
considerations. I found a bitmap chunk of 128MB (131072KB) kept write 
perfomance very near no-bitmap speeds (both MB/s and IOPS) but kept 
resync times fast (a few seconds).

I'm not sure, but you may have to remove the bitmap (--grow 
--bitmap=none) before re-adding one with a different chunk size (e.g. 
--grow --bitmap=internal --bitmap-chunk=131072).

Cheers,

John.

--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

      reply	other threads:[~2012-09-12 13:28 UTC|newest]

Thread overview: 8+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2012-09-07  4:41 Howto avoid full re-sync Adam Goryachev
2012-09-07  9:41 ` Ralf Müller
2012-09-07 12:41   ` Phil Turmel
2012-09-09 23:11   ` Adam Goryachev
2012-09-10  1:02     ` NeilBrown
2012-09-10 14:12     ` Ralf Müller
2012-09-12 12:52       ` Adam Goryachev
2012-09-12 13:28         ` John Robinson [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=50508E0A.7090309@anonymous.org.uk \
    --to=john.robinson@anonymous.org.uk \
    --cc=adam@websitemanagers.com.au \
    --cc=linux-raid@vger.kernel.org \
    --cc=ralf@bj-ig.de \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.