Re: ceph-mon not starting - AdminSocketConfigObs::init: error: AdminSocket::create_shutdown_pipe error: (38) Function not implemented

[Smart Weblications GmbH - Florian Wiessner <f.wiessner@smart-weblications.de>]

Am 05.10.2012 17:24, schrieb Sage Weil:
> On Fri, 5 Oct 2012, Joao Eduardo Luis wrote:
>> On 10/05/2012 01:24 PM, Smart Weblications GmbH - Florian Wiessner wrote:
>>> Am 04.10.2012 15:38, schrieb Smart Weblications GmbH - Florian Wiessner:
>>>> Hi,
>>>>
>>>>
>>>> i have a ceph cluster with 2 osds, 3 mons.. one of the monitors does not start
>>>> anymore:
>>>>
>>>> 2012-10-04 13:36:29.501178 7f7e123f9780 -1 asok(0x14ac000)
>>>> AdminSocketConfigObs::init: error: AdminSocket::create_shutdown_pipe error: (38)
>>>> Function not implemented
>>>> 2012-10-04 13:36:29.535018 7f7e123f9780  1 mon.2@-1(probing) e1 init fsid
>>>> 5b59811a-d235-488f-9b9b-953db7e5028b
>>>> 2012-10-04 13:36:29.541171 7f7e123f9780 -1 mon/Paxos.cc: In function 'bool
>>>> Paxos::is_consistent()' thread 7f7e123f9780 time 2012-10-04 13:36:29.536744
>>>> mon/Paxos.cc: 1031: FAILED assert(consistent || (slurping == 1))
>>
>> This assertion means the monitor was killed or failed either during
>> slurping (while catching up with the other monitors) or while performing
>> some kind of update. So it ended up in an inconsistent state.
> 
> The monitor is supposed to take note of when it is slurping and may be 
> temporarily inconsistent by writing a 'slurping' file with '1' in it in 
> the paxos subdirectory(ies), so some bug triggered this.  A simple 
> workaround is to do
> 
>   echo 1 > $mondata/osdmap/slurping
>   echo 1 > $mondata/pgmap/slurping
>   echo 1 > $mondata/monmap/slurping
>   echo 1 > $mondata/logm/slurping
>   echo 1 > $mondata/auth/slurping
> 
> and it will go through the recovery steps.  It would be helpful if you 
> could tar up a copy of the mon directory first, though, along with any 
> log files on that host, so we can try to figure out what went wrong.
> 

unfortunatelly, i deleted the logs for the monitor, as i did not see anything
special except this assertion...


i'll send mon-directory directly to Sage with a seperate mail.


-- 

Mit freundlichen Grüßen,

Florian Wiessner

Smart Weblications GmbH
Martinsberger Str. 1
D-95119 Naila

fon.: +49 9282 9638 200
fax.: +49 9282 9638 205
24/7: +49 900 144 000 00 - 0,99 EUR/Min*
http://www.smart-weblications.de

--
Sitz der Gesellschaft: Naila
Geschäftsführer: Florian Wiessner
HRB-Nr.: HRB 3840 Amtsgericht Hof
*aus dem dt. Festnetz, ggf. abweichende Preise aus dem Mobilfunknetz
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html