From mboxrd@z Thu Jan 1 00:00:00 1970 From: Greg Farnum Subject: Re: pgs stuck inactive Date: Tue, 10 Apr 2012 16:40:21 -0700 Message-ID: <3154FE08568349E9B9EB0EBBCE4EDFB2@dreamhost.com> References: Mime-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Return-path: Received: from mail-ob0-f174.google.com ([209.85.214.174]:54359 "EHLO mail-ob0-f174.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1757297Ab2DJXkX (ORCPT ); Tue, 10 Apr 2012 19:40:23 -0400 Received: by obbtb18 with SMTP id tb18so446213obb.19 for ; Tue, 10 Apr 2012 16:40:23 -0700 (PDT) In-Reply-To: Content-Disposition: inline Sender: ceph-devel-owner@vger.kernel.org List-ID: To: Samuel Just , Damien Churchill Cc: ceph-devel@vger.kernel.org On Tuesday, April 10, 2012 at 4:00 PM, Samuel Just wrote: > Can you send along the osd log as well for comparison? > -Sam > > On Tue, Apr 10, 2012 at 3:03 PM, Damien Churchill wrote: > > Here are the monitor logs, they're from the monitor starts, however I > > restarted the osd shortly afterwards and left it to run for 5 or so > > minutes. > > > > http://damoxc.net/ceph/mon.node21.log.gz > > http://damoxc.net/ceph/mon.node22.log.gz > > http://damoxc.net/ceph/mon.node23.log.gz > > > > On 10 April 2012 22:49, Samuel Just wrote: > > > Nothing apparent from the backtrace. I need monitor logs from when > > > the osd is sending pg_temp requests. Can you restart the osd and post > > > the osd and all three monitor logs from when you restarted the osd? > > > You'll have to enable monitor logging on all three. > > > -Sam > > > A quick glance through these shows that all the pg_temp requests aren't actually requesting any changes from the monitor. It's either a very serious mon bug which happened a while ago (unlikely, given the restarts and ongoing map changes, etc), or an OSD bug. I think we want logs from both osd.0 and osd.3 at the same time, from what I'm seeing. :) -Greg