From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1758025Ab2FZOyk (ORCPT ); Tue, 26 Jun 2012 10:54:40 -0400 Received: from mga11.intel.com ([192.55.52.93]:43868 "EHLO mga11.intel.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1757161Ab2FZOyi (ORCPT ); Tue, 26 Jun 2012 10:54:38 -0400 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="4.71,315,1320652800"; d="scan'208";a="170207651" Date: Tue, 26 Jun 2012 22:54:32 +0800 From: Fengguang Wu To: Trond Myklebust Cc: "J. Bruce Fields" , linux-nfs@vger.kernel.org, LKML Subject: BUG: No init found on NFSROOT Message-ID: <20120626145432.GA15289@localhost> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.21 (2010-09-15) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hi Trond, It's found that this commit in linux-next leads to the below boot hang. da660bb2774ff21c7263b4061198c5abe0629cb4 is the first bad commit commit da660bb2774ff21c7263b4061198c5abe0629cb4 Author: Trond Myklebust Date: Thu Jun 21 14:53:10 2012 -0400 SUNRPC: Clean up xdr_read_pages and xdr_enter_page Move the page alignment code into a separate helper. Signed-off-by: Trond Myklebust :040000 040000 742f2939849ea8ff2e4b954316e6ea2933e7e018 6809fe8bd11b9f2459168d6e1dac92b0c5a74eef M net bisect run success The "held lock freed" message may or may not appear in the tests. However the "No init found." message reliably appears in all test runs. [ 133.909702] ========================= [ 133.910694] [ BUG: held lock freed! ] [ 133.911700] 3.5.0-rc4+ #5 Not tainted [ 133.912672] ------------------------- [ 133.912969] swapper/0/0 is freeing memory ffff88001233ce08-ffff88001233de07, with a lock still held there! [ 133.912969] (slock-AF_INET-RPC/1){+.-...}, at: [] tcp_v4_rcv+0x28b/0x6fc [ 133.912969] 3 locks held by swapper/0/0: [ 133.912969] #0: (rcu_read_lock){.+.+..}, at: [] rcu_lock_acquire+0x0/0x29 [ 133.912969] #1: (rcu_read_lock){.+.+..}, at: [] rcu_lock_acquire.constprop.14+0x0/0x30 [ 133.912969] #2: (slock-AF_INET-RPC/1){+.-...}, at: [] tcp_v4_rcv+0x28b/0x6fc [ 133.912969] [ 133.912969] stack backtrace: [ 133.912969] Pid: 0, comm: swapper/0 Not tainted 3.5.0-rc4+ #5 [ 133.912969] Call Trace: [ 133.912969] [] debug_check_no_locks_freed+0x109/0x14b [ 133.912969] [] kmem_cache_free+0x2e/0xa7 [ 133.912969] [] __kfree_skb+0x7f/0x83 [ 133.912969] [] tcp_ack+0x45d/0xc6a [ 133.912969] [] ? local_clock+0x3b/0x52 [ 133.912969] [] tcp_rcv_state_process+0x15a/0x7c6 [ 133.912969] [] tcp_v4_do_rcv+0x341/0x390 [ 133.912969] [] tcp_v4_rcv+0x678/0x6fc [ 133.912969] [] ip_local_deliver_finish+0x165/0x1e4 [ 133.912969] [] ip_local_deliver+0x53/0x84 [ 133.912969] [] ? local_clock+0x19/0x52 [ 133.912969] [] ip_rcv_finish+0x32f/0x367 [ 133.912969] [] ip_rcv+0x210/0x269 [ 133.912969] [] ? rcu_lock_acquire+0x27/0x29 [ 133.912969] [] ? softnet_seq_show+0x68/0x68 [ 133.912969] [] __netif_receive_skb+0x3cd/0x464 [ 133.912969] [] netif_receive_skb+0x65/0x9c [ 133.912969] [] ? __napi_gro_receive+0xf2/0xff [ 133.912969] [] napi_skb_finish+0x26/0x58 [ 133.912969] [] ? local_clock+0x19/0x52 [ 133.912969] [] napi_gro_receive+0x2f/0x34 [ 133.912969] [] e1000_receive_skb+0x57/0x60 [ 133.912969] [] e1000_clean_rx_irq+0x2f2/0x387 [ 133.912969] [] e1000_clean+0x541/0x695 [ 133.912969] [] ? kvm_clock_read+0x2e/0x36 [ 133.912969] [] ? net_rx_action+0x1b3/0x1f8 [ 133.912969] [] net_rx_action+0xb3/0x1f8 [ 133.912969] [] ? __do_softirq+0x76/0x1e8 [ 133.912969] [] __do_softirq+0xe0/0x1e8 [ 133.912969] [] ? time_hardirqs_off+0x26/0x2a [ 133.912969] [] call_softirq+0x1c/0x30 [ 133.912969] [] do_softirq+0x4a/0xa2 [ 133.912969] [] irq_exit+0x51/0xbc [ 133.912969] [] do_IRQ+0x8e/0xa5 [ 133.912969] [] common_interrupt+0x6f/0x6f [ 133.912969] [] ? native_safe_halt+0x6/0x8 [ 133.912969] [] ? trace_hardirqs_on+0xd/0xf [ 133.912969] [] default_idle+0x53/0x90 [ 133.912969] [] cpu_idle+0xcc/0x123 [ 133.912969] [] rest_init+0xd1/0xda [ 133.912969] [] ? csum_partial_copy_generic+0x16c/0x16c [ 133.912969] [] start_kernel+0x3da/0x3e7 [ 133.912969] [] ? repair_env_string+0x5a/0x5a [ 133.912969] [] x86_64_start_reservations+0xb1/0xb5 [ 133.912969] [] x86_64_start_kernel+0xfe/0x10b [ 134.024230] VFS: Mounted root (nfs filesystem) on device 0:14. [ 134.025782] debug: unmapping init [mem 0xffffffff84437000-0xffffffff8480efff] [ 134.027686] Write protecting the kernel read-only data: 49152k [ 134.029956] debug: unmapping init [mem 0xffff880002eb0000-0xffff880002ffffff] [ 134.031745] debug: unmapping init [mem 0xffff880003e95000-0xffff880003ffffff] [ 134.059408] request_module: runaway loop modprobe binfmt-0000 [ 134.062946] kworker/u:0 (2781) used greatest stack depth: 3432 bytes left [ 134.069553] Kernel panic - not syncing: No init found. Try passing init= option to kernel. See Linux Documentation/init.txt for guidance. [ 134.072742] Pid: 1, comm: swapper/0 Not tainted 3.5.0-rc4+ #5 [ 134.074200] Call Trace: [ 134.074971] [] panic+0xbd/0x1d0 [ 134.076237] [] init_post+0xc8/0xc8 [ 134.077636] [] kernel_init+0x1c5/0x1c5 [ 134.078979] [] ? do_early_param+0x8c/0x8c [ 134.080408] [] kernel_thread_helper+0x4/0x10 [ 134.082038] [] ? retint_restore_args+0x13/0x13 [ 134.083514] [] ? start_kernel+0x3e7/0x3e7 [ 134.084997] [] ? gs_change+0x13/0x13 Thanks, Fengguang