linux-raid.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Jakob Unterwurzacher <jakobunt@gmail.com>
To: linux-raid@vger.kernel.org
Subject: md raid6: slow resync if fs is mounted rw
Date: Tue, 25 Feb 2014 23:55:15 +0100	[thread overview]
Message-ID: <530D1F53.5070703@gmail.com> (raw)

Dear list,

I am seeing a strange performance issue on a 4 x 4TB md raid6 on kernel
3.12. Initial resync goes nice and fast at 130MB/s:

> # cat /proc/mdstat
> Personalities : [raid1] [raid6] [raid5] [raid4]
> md1 : active raid6 sda3[0] sdd3[3] sdc3[2] sdb3[1]
>       7751269376 blocks super 1.2 level 6, 512k chunk, algorithm 2 [4/4] [UUUU]
>       [=>...................]  resync =  7.5% (293925504/3875634688) finish=458.4min speed=130210K/sec
> 
> md0 : active raid1 sda2[0] sdd2[3] sdc2[2] sdb2[1]
>       29280128 blocks super 1.2 [4/4] [UUUU]
> 
> unused devices: <none>

...unless the ext4 filesystem on the array is mounted read-write!
Then, speed plummets to 1 - 7MB/s. The filesystem is empty and totally
idle; a simple "mount -o remount,ro" restores the speed to 130MB/s.

I dumped the /sys/block/md1/md tree with the filesystem mounted ro and
rw, the diff looks like this:

> # diff -u md.rw md.ro
> [...]
> --- md.rw/stripe_cache_active   2014-02-25 17:33:31.250019324 +0100
> +++ md.ro/stripe_cache_active   2014-02-25 17:33:31.250019324 +0100
> @@ -1 +1 @@
> -0
> +256
> diff -u md.rw/sync_speed md.ro/sync_speed
> --- md.rw/sync_speed    2014-02-25 17:33:31.250019324 +0100
> +++ md.ro/sync_speed    2014-02-25 17:33:31.250019324 +0100
> @@ -1 +1 @@
> -1052
> +126244

So, stripe_cache_active is zero if the fs is mounted rw. Hmm.

Interestingly, if I increase sync_speed_min to 100MB/s, I do get 100MB/s.

Any idea what is going on?

Best regards,
Jakob Unterwurzacher

             reply	other threads:[~2014-02-25 22:55 UTC|newest]

Thread overview: 4+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2014-02-25 22:55 Jakob Unterwurzacher [this message]
2014-02-25 23:38 ` md raid6: slow resync if fs is mounted rw NeilBrown
2014-02-26  2:31 ` Brad Campbell
2014-02-26  9:40   ` Jakob Unterwurzacher

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=530D1F53.5070703@gmail.com \
    --to=jakobunt@gmail.com \
    --cc=linux-raid@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).