From: Chris Mason <chris.mason@oracle.com>
To: Jim Schutt <jaschut@sandia.gov>
Cc: dave <dave@jikos.cz>, miaox <miaox@cn.fujitsu.com>,
linux-kernel <linux-kernel@vger.kernel.org>,
linux-btrfs <linux-btrfs@vger.kernel.org>,
<ceph-devel@vger.kernel.org>
Subject: Re: 3.0-rcX BUG at fs/btrfs/ioctl.c:432 - bisected
Date: Fri, 10 Jun 2011 13:53:31 -0400 [thread overview]
Message-ID: <1307726732-sup-3404@shiny> (raw)
In-Reply-To: <4DF24F0E.4040306@sandia.gov>
Excerpts from Jim Schutt's message of 2011-06-10 13:06:22 -0400:
[ two different btrfs crashes ]
I think your two crashes in btrfs were from the uninit variables and
those should be fixed in rc2.
> When I did my bisection, my criteria for success/failure was
> "did mkcephfs succeed?". When I apply this criteria to a recent
> linus kernel (e.g. 06e86849cf4019), which includes the fix you
> mentioned (aa0467d8d2a00e), I get still a different failure mode,
> which doesn't actually reference btrfs:
>
> [ 276.364178] BUG: unable to handle kernel NULL pointer dereference at 000000000000000a
> [ 276.365127] IP: [<ffffffffa05434b1>] journal_start+0x3e/0x9c [jbd]
Looking at the resulting code in the oops, we're here in journal_start:
if (handle) {
J_ASSERT(handle->h_transaction->t_journal == journal);
handle comes from current->journal_info, and we're doing a deref on
handle->h_transaction, which is probably 0xa.
So, we're leaving crud in current->journal_info and ext3 is finding it.
Perhaps its from ceph starting a transaction but leaving it running?
The bug came with Josef's transaction performance fixes, but it is
probably a mixture of his code with the ioctls ceph is using.
[ rest of the oops below for context ]
-chris
> [ 276.365127] PGD 1e4469067 PUD 1e1658067 PMD 0
> [ 276.365127] Oops: 0000 [#1] SMP
> [ 276.365127] CPU 2
> [ 276.365127] Modules linked in: btrfs zlib_deflate lzo_compress ipt_MASQUERADE iptable_nat nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_state nf_conntrack ipt_REJECT xt_tcpudp iptable_filter ip_tables x_tables bridge stp i2c_dev i2c_core ext3 jbd scsi_transport_iscsi rds ib_ipoib rdma_ucm rdma_cm ib_ucm ib_uverbs ib_umad ib_cm iw_cm ib_addr ipv6 ib_sa dm_mirror dm_region_hash dm_log dm_multipath scsi_dh dm_mod video sbs sbshc pci_slot battery acpi_pad ac kvm sg ses sd_mod enclosure megaraid_sas ide_cd_mod cdrom ib_mthca ib_mad qla2xxx button ib_core serio_raw scsi_transport_fc scsi_tgt dcdbas ata_piix libata tpm_tis tpm i5k_amb ioatdma tpm_bios hwmon iTCO_wdt scsi_mod i5000_edac iTCO_vendor_support ehci_hcd dca edac_core uhci_hcd pcspkr rtc nfs nfs_acl auth_rpcgss fscache lockd sunrpc tg
3 bnx2 e1000 [last unloaded: freq_table]
> [ 276.365127]
> [ 276.365127] Pid: 6076, comm: cosd Not tainted 3.0.0-rc2-00196-g06e8684 #26 Dell Inc. PowerEdge 1950/0DT097
> [ 276.365127] RIP: 0010:[<ffffffffa05434b1>] [<ffffffffa05434b1>] journal_start+0x3e/0x9c [jbd]
> [ 276.365127] RSP: 0018:ffff8801e2897b28 EFLAGS: 00010286
> [ 276.365127] RAX: 000000000000000a RBX: ffff8801de8e1090 RCX: 0000000000000002
> [ 276.365127] RDX: 0000000019b2d000 RSI: 000000000000000e RDI: 000000000000000e
> [ 276.365127] RBP: ffff8801e2897b48 R08: 0000000000000003 R09: ffff8801e2897c38
> [ 276.365127] R10: ffff8801e2897ed8 R11: 0000000000000001 R12: ffff880223ff4400
> [ 276.365127] R13: ffff880218522d60 R14: 0000000000000ec6 R15: ffff88021f54d878
> [ 276.365127] FS: 00007f8ff0bbb710(0000) GS:ffff88022fc80000(0000) knlGS:0000000000000000
> [ 276.365127] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> [ 276.365127] CR2: 000000000000000a CR3: 000000021744f000 CR4: 00000000000006e0
> [ 276.365127] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> [ 276.365127] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
> [ 276.365127] Process cosd (pid: 6076, threadinfo ffff8801e2896000, task ffff880218522d60)
> [ 276.365127] Stack:
> [ 276.365127] ffff8801e2897b68 ffffea000756e788 ffff88021f54d728 ffff8801e2897c78
> [ 276.365127] ffff8801e2897b58 ffffffffa05670ce ffff8801e2897b68 ffffffffa055c72d
> [ 276.365127] ffff8801e2897be8 ffffffffa055f044 ffff8801e2897c38 0000007400000000
> [ 276.365127] Call Trace:
> [ 276.365127] [<ffffffffa05670ce>] ext3_journal_start_sb+0x4f/0x51 [ext3]
> [ 276.365127] [<ffffffffa055c72d>] ext3_journal_start+0x12/0x14 [ext3]
> [ 276.365127] [<ffffffffa055f044>] ext3_write_begin+0x93/0x1a1 [ext3]
> [ 276.365127] [<ffffffff810c6f0e>] ? __kunmap_atomic+0xe/0x10
> [ 276.365127] [<ffffffff810c75e5>] generic_perform_write+0xb1/0x172
> [ 276.365127] [<ffffffff81036a33>] ? need_resched+0x23/0x2d
> [ 276.365127] [<ffffffff810c76ea>] generic_file_buffered_write+0x44/0x6f
> [ 276.365127] [<ffffffff810c91f5>] __generic_file_aio_write+0x253/0x2a8
> [ 276.365127] [<ffffffff810c92ad>] generic_file_aio_write+0x63/0xb8
> [ 276.365127] [<ffffffff81113b26>] do_sync_write+0xc7/0x10b
> [ 276.365127] [<ffffffff81036a4b>] ? should_resched+0xe/0x2f
> [ 276.365127] [<ffffffff813b0faf>] ? _cond_resched+0xe/0x22
> [ 276.365127] [<ffffffff811986c3>] ? security_file_permission+0x2c/0x31
> [ 276.365127] [<ffffffff81113d21>] ? rw_verify_area+0xac/0xdb
> [ 276.365127] [<ffffffff81114253>] vfs_write+0xac/0xe4
> [ 276.365127] [<ffffffff8111434f>] sys_write+0x4c/0x71
> [ 276.365127] [<ffffffff813b8beb>] system_call_fastpath+0x16/0x1b
> [ 276.365127] Code: 89 fc 48 c7 c3 e2 ff ff ff 89 f7 65 4c 8b 2c 25 c0 b5 00 00 4d 85 e4 49 8b 85 48 06 00 00 74 5e 48 85 c0 74 14 48 89 c3 48 8b 00 <4c> 39 20 74 04 0f 0b eb fe ff 43 0c eb 45 e8 70 ff ff ff 48 85
> [ 276.365127] RIP [<ffffffffa05434b1>] journal_start+0x3e/0x9c [jbd]
> [ 276.365127] RSP <ffff8801e2897b28>
> [ 276.365127] CR2: 000000000000000a
> [ 276.725157] ---[ end trace 8a802dc03e3972ad ]---
>
next prev parent reply other threads:[~2011-06-10 17:53 UTC|newest]
Thread overview: 13+ messages / expand[flat|nested] mbox.gz Atom feed top
2011-06-09 21:52 3.0-rcX BUG at fs/btrfs/ioctl.c:432 - bisected Jim Schutt
2011-06-09 23:45 ` David Sterba
2011-06-10 17:06 ` Jim Schutt
2011-06-10 17:53 ` Chris Mason [this message]
2011-06-10 18:08 ` Sage Weil
2011-06-10 18:14 ` Sage Weil
2011-06-10 18:29 ` Josef Bacik
2011-06-10 18:35 ` Sage Weil
2011-06-10 18:34 ` Josef Bacik
2011-06-10 18:43 ` Sage Weil
2011-06-10 19:29 ` Jim Schutt
2011-06-10 18:54 ` Chris Mason
2011-06-10 3:18 ` Miao Xie
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1307726732-sup-3404@shiny \
--to=chris.mason@oracle.com \
--cc=ceph-devel@vger.kernel.org \
--cc=dave@jikos.cz \
--cc=jaschut@sandia.gov \
--cc=linux-btrfs@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=miaox@cn.fujitsu.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).