All of lore.kernel.org
 help / color / mirror / Atom feed
From: Martin Mailand <martin@tuxadero.com>
To: ceph-devel@vger.kernel.org
Cc: Josh Durgin <josh.durgin@dreamhost.com>
Subject: Cluster sync doesn't finsh
Date: Thu, 17 Nov 2011 21:48:56 +0100	[thread overview]
Message-ID: <4EC57338.9040004@tuxadero.com> (raw)

Hi,
I am doing cluster failure test, where I shut down one OSD an wait for 
the cluster to sync. But the sync never finshed, at around 4-5% it 
stops. I stoped osd2.

2011-11-17 16:40:48.015370    pg v1333: 600 pgs: 1 active, 546 
active+clean, 53 active+clean+degraded; 113 GB data, 183 GB used, 1142 
GB / 1395 GB avail; 4200/82404 degraded (5.097%)
2011-11-17 16:40:53.109391    pg v1334: 600 pgs: 1 active, 546 
active+clean, 53 active+clean+degraded; 113 GB data, 183 GB used, 1142 
GB / 1395 GB avail; 4117/82404 degraded (4.996%)
2011-11-17 16:40:58.228525    pg v1335: 600 pgs: 1 active, 546 
active+clean, 53 active+clean+degraded; 113 GB data, 183 GB used, 1142 
GB / 1395 GB avail; 4037/82404 degraded (4.899%)
2011-11-17 16:41:03.223778    pg v1336: 600 pgs: 547 active+clean, 53 
active+clean+degraded; 113 GB data, 183 GB used, 1142 GB / 1395 GB 
avail; 4025/82404 degraded (4.884%)
2011-11-17 16:42:45.520740    pg v1337: 600 pgs: 547 active+clean, 53 
active+clean+degraded; 113 GB data, 184 GB used, 1141 GB / 1395 GB 
avail; 4025/82404 degraded (4.884%)

^C
root@m-brick-000:~# date -R
Thu, 17 Nov 2011 17:56:08 +0100
root@m-brick-000:~#

So for the last hour nothing happend, there is no load on the cluster.

The osd log, the ceph.conf, pg dump, osd dump could be found here.

http://85.214.49.87/ceph/

ceph version 0.38-181-g2e19550 
(commit:2e195500b5d3a8ab8512bcf2a219a6b7ff922c97)

-martin




             reply	other threads:[~2011-11-17 20:49 UTC|newest]

Thread overview: 7+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2011-11-17 20:48 Martin Mailand [this message]
2011-11-18 18:05 ` Cluster sync doesn't finsh Tommi Virtanen
2011-11-18 18:13   ` Gregory Farnum
2011-11-18 19:18     ` Samuel Just
2011-11-18 20:17       ` Martin Mailand
2011-11-19  1:05         ` Samuel Just
2011-12-05 12:44           ` Martin Mailand

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=4EC57338.9040004@tuxadero.com \
    --to=martin@tuxadero.com \
    --cc=ceph-devel@vger.kernel.org \
    --cc=josh.durgin@dreamhost.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.