All of lore.kernel.org
 help / color / mirror / Atom feed
From: Noah Watkins <jayhawk@cs.ucsc.edu>
To: ceph-devel <ceph-devel@vger.kernel.org>
Subject: OSDs crashing with latest master
Date: Thu, 01 Dec 2011 20:54:47 -0800	[thread overview]
Message-ID: <4ED85A17.10303@cs.ucsc.edu> (raw)

Running a new master install on 13 nodes. Half the OSDs crashed with the 
following stack trace.

Thanks,
Noah

2011-12-01 20:31:17.974984 7f0826e07700 osd.4 11 OSD::ms_handle_reset()
2011-12-01 20:31:17.975030 7f0826e07700 osd.4 11 OSD::ms_handle_reset() 
s=0x27c86c0
2011-12-01 20:35:45.729921 7f0826e07700 osd.4 11 OSD::ms_handle_reset()
2011-12-01 20:35:45.729987 7f0826e07700 osd.4 11 OSD::ms_handle_reset() 
s=0x2097900
osd/ReplicatedPG.cc: In function 'void 
ReplicatedPG::sub_op_modify(MOSDSubOp*)', in thread '7f08234ff700'
osd/ReplicatedPG.cc: 3373: FAILED assert(0)
  ceph version 0.38-273-g813523a 
(commit:813523a6816417c75cae0d6aac6e3222c5d6c605)
  1: (ReplicatedPG::sub_op_modify(MOSDSubOp*)+0x1402) [0x4b4672]
  2: (ReplicatedPG::do_sub_op(MOSDSubOp*)+0x83) [0x4d6d13]
  3: (OSD::dequeue_op(PG*)+0x3e4) [0x541304]
  4: (ThreadPool::worker()+0xa28) [0x5bef08]
  5: (ThreadPool::WorkThread::entry()+0xd) [0x565f7d]
  6: (()+0x7971) [0x7f0832a90971]
  7: (clone()+0x6d) [0x7f083111b92d]
  ceph version 0.38-273-g813523a 
(commit:813523a6816417c75cae0d6aac6e3222c5d6c605)
  1: (ReplicatedPG::sub_op_modify(MOSDSubOp*)+0x1402) [0x4b4672]
  2: (ReplicatedPG::do_sub_op(MOSDSubOp*)+0x83) [0x4d6d13]
  3: (OSD::dequeue_op(PG*)+0x3e4) [0x541304]
  4: (ThreadPool::worker()+0xa28) [0x5bef08]
  5: (ThreadPool::WorkThread::entry()+0xd) [0x565f7d]
  6: (()+0x7971) [0x7f0832a90971]
  7: (clone()+0x6d) [0x7f083111b92d]
*** Caught signal (Aborted) **
  in thread 7f08234ff700
  ceph version 0.38-273-g813523a 
(commit:813523a6816417c75cae0d6aac6e3222c5d6c605)
  1: /usr/bin/ceph-osd() [0x6b1d14]
  2: (()+0xfb40) [0x7f0832a98b40]
  3: (gsignal()+0x35) [0x7f0831068ba5]
  4: (abort()+0x180) [0x7f083106c6b0]
  5: (__gnu_cxx::__verbose_terminate_handler()+0x11d) [0x7f083190c6bd]
  6: (()+0xb9906) [0x7f083190a906]
  7: (()+0xb9933) [0x7f083190a933]
  8: (()+0xb9a3e) [0x7f083190aa3e]
  9: (ceph::__ceph_assert_fail(char const*, char const*, int, char 
const*)+0x39f) [0x5cce4f]
  10: (ReplicatedPG::sub_op_modify(MOSDSubOp*)+0x1402) [0x4b4672]
  11: (ReplicatedPG::do_sub_op(MOSDSubOp*)+0x83) [0x4d6d13]
  12: (OSD::dequeue_op(PG*)+0x3e4) [0x541304]
  13: (ThreadPool::worker()+0xa28) [0x5bef08]
  14: (ThreadPool::WorkThread::entry()+0xd) [0x565f7d]
  15: (()+0x7971) [0x7f0832a90971]
  16: (clone()+0x6d) [0x7f083111b92d]

             reply	other threads:[~2011-12-02  4:54 UTC|newest]

Thread overview: 2+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2011-12-02  4:54 Noah Watkins [this message]
2011-12-02  5:07 ` OSDs crashing with latest master Sage Weil

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=4ED85A17.10303@cs.ucsc.edu \
    --to=jayhawk@cs.ucsc.edu \
    --cc=ceph-devel@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.