From mboxrd@z Thu Jan 1 00:00:00 1970 From: Olivier Bonvalet Subject: Re: [ceph-users] kernel BUG at net/ceph/osd_client.c:2103 Date: Mon, 05 Aug 2013 07:22:50 +0200 Message-ID: <1375680170.16182.9.camel@localhost> References: <1375664836.16182.7.camel@localhost> <1375664968.16182.8.camel@localhost> Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: QUOTED-PRINTABLE Return-path: Received: from licorne.daevel.fr ([178.32.94.222]:60416 "EHLO licorne.daevel.fr" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1753736Ab3HEFWy convert rfc822-to-8bit (ORCPT ); Mon, 5 Aug 2013 01:22:54 -0400 In-Reply-To: Sender: ceph-devel-owner@vger.kernel.org List-ID: To: Sage Weil Cc: ceph-users@lists.ceph.com, ceph-devel Yes of course, thanks ! Le dimanche 04 ao=C3=BBt 2013 =C3=A0 20:59 -0700, Sage Weil a =C3=A9cri= t : > Hi Olivier, >=20 > This looks like http://tracker.ceph.com/issues/5760. We should be ab= le to=20 > look at this more closely this week. In the meantime, you might want= to=20 > go back to 3.9.x. If we have a patch that addresses the bug, would y= ou be=20 > able to test it? >=20 > Thanks! > sage >=20 >=20 > On Mon, 5 Aug 2013, Olivier Bonvalet wrote: > > Sorry, the "dev" list is probably a better place for that one. > >=20 > > Le lundi 05 ao?t 2013 ? 03:07 +0200, Olivier Bonvalet a ?crit : > > > Hi, > > >=20 > > > I've just upgraded a Xen Dom0 (Debian Wheezy with Xen 4.2.2) from= Linux > > > 3.9.11 to Linux 3.10.5, and now I have kernel panic after launchi= ng some > > > VM which use RBD kernel client.=20 > > >=20 > > >=20 > > > In kernel logs, I have : > > >=20 > > > Aug 5 02:51:22 murmillia kernel: [ 289.205652] kernel BUG at ne= t/ceph/osd_client.c:2103! > > > Aug 5 02:51:22 murmillia kernel: [ 289.205725] invalid opcode: = 0000 [#1] SMP=20 > > > Aug 5 02:51:22 murmillia kernel: [ 289.205908] Modules linked i= n: cbc rbd libceph libcrc32c xen_gntdev ip6table_mangle ip6t_REJECT ip6= table_filter ip6_tables xt_DSCP iptable_mangle xt_LOG xt_physdev ipt_RE= JECT xt_tcpudp iptable_filter ip_tables x_tables bridge loop coretemp g= hash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk= _helper cryptd iTCO_wdt iTCO_vendor_support gpio_ich microcode serio_ra= w sb_edac edac_core evdev lpc_ich i2c_i801 mfd_core wmi ac ioatdma shpc= hp button dm_mod hid_generic usbhid hid sg sd_mod crc_t10dif crc32c_int= el isci megaraid_sas libsas ahci libahci ehci_pci ehci_hcd libata scsi_= transport_sas igb scsi_mod i2c_algo_bit ixgbe usbcore i2c_core dca usb_= common ptp pps_core mdio > > > Aug 5 02:51:22 murmillia kernel: [ 289.210499] CPU: 2 PID: 5326= Comm: blkback.3.xvda Not tainted 3.10-dae-dom0 #1 > > > Aug 5 02:51:22 murmillia kernel: [ 289.210617] Hardware name: S= upermicro X9DRW-7TPF+/X9DRW-7TPF+, BIOS 2.0a 03/11/2013 > > > Aug 5 02:51:22 murmillia kernel: [ 289.210738] task: ffff880037= d01040 ti: ffff88003803a000 task.ti: ffff88003803a000 > > > Aug 5 02:51:22 murmillia kernel: [ 289.210858] RIP: e030:[] [] ceph_osdc_build_request+0x2bb/0x3c= 6 [libceph] > > > Aug 5 02:51:22 murmillia kernel: [ 289.211062] RSP: e02b:ffff88= 003803b9f8 EFLAGS: 00010212 > > > Aug 5 02:51:22 murmillia kernel: [ 289.211154] RAX: ffff880033a= 181c0 RBX: ffff880033a182ec RCX: 0000000000000000 > > > Aug 5 02:51:22 murmillia kernel: [ 289.211251] RDX: ffff880033a= 182af RSI: 0000000000008050 RDI: ffff880030d34888 > > > Aug 5 02:51:22 murmillia kernel: [ 289.211347] RBP: 00000000000= 02000 R08: ffff88003803ba58 R09: 0000000000000000 > > > Aug 5 02:51:22 murmillia kernel: [ 289.211444] R10: 00000000000= 00000 R11: 0000000000000000 R12: ffff880033ba3500 > > > Aug 5 02:51:22 murmillia kernel: [ 289.211541] R13: 00000000000= 00001 R14: ffff88003847aa78 R15: ffff88003847ab58 > > > Aug 5 02:51:22 murmillia kernel: [ 289.211644] FS: 00007f775da= 8c700(0000) GS:ffff88003f840000(0000) knlGS:0000000000000000 > > > Aug 5 02:51:22 murmillia kernel: [ 289.211765] CS: e033 DS: 00= 00 ES: 0000 CR0: 0000000080050033 > > > Aug 5 02:51:22 murmillia kernel: [ 289.211858] CR2: 00007fa21ee= 2c000 CR3: 000000002be14000 CR4: 0000000000042660 > > > Aug 5 02:51:22 murmillia kernel: [ 289.211956] DR0: 00000000000= 00000 DR1: 0000000000000000 DR2: 0000000000000000 > > > Aug 5 02:51:22 murmillia kernel: [ 289.212052] DR3: 00000000000= 00000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 > > > Aug 5 02:51:22 murmillia kernel: [ 289.212148] Stack: > > > Aug 5 02:51:22 murmillia kernel: [ 289.212232] 000000000000200= 0 000000243847aa78 0000000000000000 ffff880039949b40 > > > Aug 5 02:51:22 murmillia kernel: [ 289.212577] 000000000000220= 1 ffff880033811d98 ffff88003803ba80 ffff88003847aa78 > > > Aug 5 02:51:22 murmillia kernel: [ 289.212921] ffff880030f2438= 0 ffff880002a38400 0000000000002000 ffffffffa029584c > > > Aug 5 02:51:22 murmillia kernel: [ 289.213264] Call Trace: > > > Aug 5 02:51:22 murmillia kernel: [ 289.213358] [] ? rbd_osd_req_format_write+0x71/0x7c [rbd] > > > Aug 5 02:51:22 murmillia kernel: [ 289.213459] [] ? rbd_img_request_fill+0x695/0x736 [rbd] > > > Aug 5 02:51:22 murmillia kernel: [ 289.213562] [] ? arch_local_irq_restore+0x7/0x8 > > > Aug 5 02:51:22 murmillia kernel: [ 289.213667] [] ? down_read+0x9/0x19 > > > Aug 5 02:51:22 murmillia kernel: [ 289.213763] [] ? rbd_request_fn+0x191/0x22e [rbd] > > > Aug 5 02:51:22 murmillia kernel: [ 289.213864] [] ? __blk_run_queue_uncond+0x1e/0x26 > > > Aug 5 02:51:22 murmillia kernel: [ 289.213962] [] ? blk_flush_plug_list+0x1c1/0x1e4 > > > Aug 5 02:51:22 murmillia kernel: [ 289.214059] [] ? blk_finish_plug+0xb/0x2a > > > Aug 5 02:51:22 murmillia kernel: [ 289.214157] [] ? dispatch_rw_block_io+0x33e/0x3f0 > > > Aug 5 02:51:22 murmillia kernel: [ 289.214259] [] ? find_busiest_group+0x28/0x1d4 > > > Aug 5 02:51:22 murmillia kernel: [ 289.214357] [] ? load_balance+0xb9/0x5e1 > > > Aug 5 02:51:22 murmillia kernel: [ 289.214454] [] ? xen_hypercall_xen_version+0xa/0x20 > > > Aug 5 02:51:22 murmillia kernel: [ 289.214552] [] ? __do_block_io_op+0x258/0x390 > > > Aug 5 02:51:22 murmillia kernel: [ 289.214649] [] ? xen_end_context_switch+0xa/0x14 > > > Aug 5 02:51:22 murmillia kernel: [ 289.214747] [] ? __switch_to+0x13e/0x3c0 > > > Aug 5 02:51:22 murmillia kernel: [ 289.214843] [] ? xen_blkif_schedule+0x30d/0x418 > > > Aug 5 02:51:22 murmillia kernel: [ 289.214947] [] ? finish_wait+0x60/0x60 > > > Aug 5 02:51:22 murmillia kernel: [ 289.215042] [] ? xen_blkif_be_int+0x25/0x25 > > > Aug 5 02:51:22 murmillia kernel: [ 289.215138] [] ? kthread+0x7d/0x85 > > > Aug 5 02:51:22 murmillia kernel: [ 289.215232] [] ? __kthread_parkme+0x59/0x59 > > > Aug 5 02:51:22 murmillia kernel: [ 289.215332] [] ? ret_from_fork+0x7c/0xb0 > > > Aug 5 02:51:22 murmillia kernel: [ 289.215427] [] ? __kthread_parkme+0x59/0x59 > > > Aug 5 02:51:22 murmillia kernel: [ 289.215521] Code: c0 00 00 0= 0 8b 4c 24 10 66 89 48 22 49 8b 86 c0 00 00 00 8b 14 24 89 50 1e 49 8b = 44 24 48 48 89 c2 49 03 54 24 50 48 39 d3 76 02 <0f> 0b 48 29 c3 49 89 = 5c 24 50 41 89 5c 24 16 48 83 c4 28 5b 5d=20 > > > Aug 5 02:51:22 murmillia kernel: [ 289.219309] RIP [] ceph_osdc_build_request+0x2bb/0x3c6 [libceph] > > > Aug 5 02:51:22 murmillia kernel: [ 289.219492] RSP > > > Aug 5 02:51:22 murmillia kernel: [ 289.219631] ---[ end trace 3= 154df728731ac05 ]--- > > >=20 > > >=20 > > >=20 > > > _______________________________________________ > > > ceph-users mailing list > > > ceph-users@lists.ceph.com > > > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > > >=20 > >=20 > >=20 > > -- > > To unsubscribe from this list: send the line "unsubscribe ceph-deve= l" in > > the body of a message to majordomo@vger.kernel.org > > More majordomo info at http://vger.kernel.org/majordomo-info.html > >=20 > >=20 > -- > To unsubscribe from this list: send the line "unsubscribe ceph-devel"= in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html >=20 -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" i= n the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html