From mboxrd@z Thu Jan 1 00:00:00 1970 From: Olivier Bonvalet Subject: Re: Issue #5876 : assertion failure in rbd_img_obj_callback() Date: Tue, 25 Mar 2014 21:21:34 +0100 Message-ID: <1395778894.2076.12.camel@localhost> References: <1395736765.2823.29.camel@localhost> <53316D18.7040103@ieee.org> <53317BC2.9010700@ieee.org> <1395753516.2823.37.camel@localhost> <533184AF.9050101@ieee.org> <5331853D.40408@ieee.org> <1395767705.9967.5.camel@localhost> <5331C05D.1060008@ieee.org> <1395773582.2076.10.camel@localhost> <5331D2E8.6060002@ieee.org> Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: QUOTED-PRINTABLE Return-path: Received: from licorne.daevel.fr ([178.32.94.222]:41219 "EHLO licorne.daevel.fr" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751877AbaCYUVj (ORCPT ); Tue, 25 Mar 2014 16:21:39 -0400 In-Reply-To: Sender: ceph-devel-owner@vger.kernel.org List-ID: To: Ilya Dryomov Cc: Alex Elder , Ceph Development Le mardi 25 mars 2014 =C3=A0 22:18 +0200, Ilya Dryomov a =C3=A9crit : > On Tue, Mar 25, 2014 at 9:03 PM, Alex Elder wrote: > > On 03/25/2014 01:53 PM, Olivier Bonvalet wrote: > >> Le mardi 25 mars 2014 =C3=A0 12:43 -0500, Alex Elder a =C3=A9crit = : > >>> Please try applying this, on top of the previous patch. > >>> If you can then reproduce the problem we'll have a bunch > >>> of new information about the particular request that's > >>> leading to the failure. That might tell us what more we > >>> can do to find the root cause. Thank you. > >>> > >>> -Alex > >>> > >>> PS I hope my mailer doesn't botch the long lines. It might. > >>> > >> > >> Here the execution will continue, no more kernel panic after this > >> debugging display. Is it wanted ? > > > > > > I guess it should panic. I'm glad you mentioned this. >=20 > Just in case, if you haven't done it already: stick rbd_assert(0); > after the last printk in that if statement, so it looks like this: >=20 > if (which !=3D img_request->next_completion) { > printk("%s: bad image object request information:\n", __func_= _); > printk("obj_request %p\n", obj_request); > printk(" ->object_name <%s>\n", obj_request->object_name); > ... >=20 > printk("img_request %p\n", img_request); > printk(" ->snap 0x%016llx\n", img_request->snap_id); > ... > printk(" ->result %d\n", img_request->result); >=20 > rbd_assert(0); > } >=20 > Thanks, >=20 > Ilya >=20 Without the rbd_assert(0), I add this hang : Mar 25 21:17:58 murmillia kernel: [ 2205.255933] rbd_img_obj_callback: = bad image object request information: Mar 25 21:17:58 murmillia kernel: [ 2205.255938] obj_request ffff88025a= 2b3c48 Mar 25 21:17:58 murmillia kernel: [ 2205.255940] ->object_name Mar 25 21:17:58 murmillia kernel: [ 2205.255941] ->offset 0 Mar 25 21:17:58 murmillia kernel: [ 2205.255943] ->length 28672 Mar 25 21:17:58 murmillia kernel: [ 2205.255944] ->type 0x1 Mar 25 21:17:58 murmillia kernel: [ 2205.255945] ->flags 0x3 Mar 25 21:17:58 murmillia kernel: [ 2205.255946] ->which 1 Mar 25 21:17:58 murmillia kernel: [ 2205.255948] ->xferred 28672 Mar 25 21:17:58 murmillia kernel: [ 2205.255949] ->result 0 Mar 25 21:17:58 murmillia kernel: [ 2205.255950] img_request ffff880253= 6c4a60 Mar 25 21:17:58 murmillia kernel: [ 2205.255952] ->snap 0xffff88025= 7f85ec0 Mar 25 21:17:58 murmillia kernel: [ 2205.255953] ->offset 453402624= 0 Mar 25 21:17:58 murmillia kernel: [ 2205.255954] ->length 45056 Mar 25 21:17:58 murmillia kernel: [ 2205.255955] ->flags 0x1 Mar 25 21:17:58 murmillia kernel: [ 2205.255957] ->obj_request_coun= t 1 Mar 25 21:17:58 murmillia kernel: [ 2205.255958] ->next_completion = 2 Mar 25 21:17:58 murmillia kernel: [ 2205.255959] ->xferred 45056 Mar 25 21:17:58 murmillia kernel: [ 2205.255960] ->result 0 Mar 25 21:17:58 murmillia kernel: [ 2205.255962]=20 Mar 25 21:17:58 murmillia kernel: [ 2205.255962] Assertion failure in r= bd_img_obj_callback() at line 2162: Mar 25 21:17:58 murmillia kernel: [ 2205.255962]=20 Mar 25 21:17:58 murmillia kernel: [ 2205.255962] rbd_assert(which < im= g_request->obj_request_count); Mar 25 21:17:58 murmillia kernel: [ 2205.255962]=20 Mar 25 21:17:58 murmillia kernel: [ 2205.256141] ------------[ cut here= ]------------ Mar 25 21:17:58 murmillia kernel: [ 2205.256178] kernel BUG at drivers/= block/rbd.c:2162! -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" i= n the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html