Greetings, I got the below dmesg and the first bad commit is https://github.com/alexshi/power-scheduling.git single-balance commit 98564060e5c360908d93f61a78ccbef4a082d3c2 Author: Alex Shi AuthorDate: Tue Feb 18 21:01:54 2014 +0800 Commit: Alex Shi CommitDate: Tue Feb 18 21:33:06 2014 +0800 sched/balance: add balance_interval to tuning top level balance frequency Since central balance stains less cpu cache as current balance, we can set the balance interval more short. Signed-off-by: Alex Shi [ 1.180022] softirq: huh, entered softirq 7 SCHED 4107f776 with preempt_count 00000100, exited with 00000101? [ 1.183355] softirq: huh, entered softirq 7 SCHED 4107f776 with preempt_count 00000100, exited with 00000101? [ 1.186691] softirq: huh, entered softirq 7 SCHED 4107f776 with preempt_count 00000100, exited with 00000101? [ 1.187437] BUG: MAX_LOCK_DEPTH too low! [ 1.187731] turning off the locking correctness validator. [ 1.188138] Please attach the output of /proc/lock_stat to the bug report [ 1.188643] depth: 48 max: 48! [ 1.188881] 48 locks held by swapper/0/1: [ 1.189194] #0: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.189827] #1: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #2: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #3: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #4: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #5: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #6: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #7: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #8: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #9: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #10: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #11: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #12: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #13: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #14: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #15: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #16: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #17: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #18: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #19: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #20: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #21: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #22: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #23: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #24: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #25: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #26: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #27: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #28: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #29: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #30: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #31: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #32: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #33: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #34: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #35: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #36: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #37: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #38: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #39: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #40: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #41: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #42: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #43: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #44: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #45: (rcu_read_lock){.+.+..}, at: [<4107d10c>] rcu_read_lock+0x0/0x28 [ 1.190010] #46: (&rq->lock){-.-.-.}, at: [<4158e188>] __schedule+0x7e/0x5ce [ 1.190010] #47: ((null)){.-.-..}, at: [<4158e243>] __schedule+0x139/0x5ce git bisect start d5471974ffc0bd5cbf7213231e4d6276007cab37 6d0abeca3242a88cab8232e4acd7e2bf088f3bc2 -- git bisect good 52732e61f8895e45c10f3b1977b1252a58a2b64e # 01:08 23+ 6 Merge 'drdb/for-3.15-p2' into devel-hourly-2014021821 git bisect good 9737c3be3ccc4aac6ab919b897dcf68c4a2b4f33 # 01:13 23+ 7 Merge 'arm-perf/misc-patches' into devel-hourly-2014021821 git bisect good 0e1ba5d0198d3d1cd947287661fc9ac30164e666 # 01:16 23+ 0 Merge 'regulator/topic/tps6507x' into devel-hourly-2014021821 git bisect good b8e87ddb72da627fd03aeb02b77c07065e13427c # 01:20 23+ 11 Merge 'iio/fixes-togreg' into devel-hourly-2014021821 git bisect good 6648c2574f90963cb0bc2421f00f173e9fdc8cc0 # 01:24 23+ 3 Merge 'arm-perf/pci/bios32' into devel-hourly-2014021821 git bisect bad 037d40fe91c5721054a8d1a61cd926dbdb75f968 # 01:28 0- 1 Merge 'alexshi/single-balance' into devel-hourly-2014021821 git bisect good 4a5d7c9f371d437e80369739bc7c38743f0d87c3 # 01:32 23+ 3 sched: rename update_*_cpu_load git bisect good 480c3ba7685296b8da892020d408223e7abdc70b # 01:35 23+ 9 sched: remove un-used functions git bisect good 0e32dab5df39cfb1be9a937d67c877404b964324 # 01:37 23+ 11 sched/balance: rebuild ovutil tree after task moving git bisect bad 98564060e5c360908d93f61a78ccbef4a082d3c2 # 01:38 0- 6 sched/balance: add balance_interval to tuning top level balance frequency git bisect good 34c6c7844fd7ac6b7636614534d83c1099ab6fc7 # 01:42 23+ 3 sched/balance: add llc balance interval # first bad commit: [98564060e5c360908d93f61a78ccbef4a082d3c2] sched/balance: add balance_interval to tuning top level balance frequency git bisect good 34c6c7844fd7ac6b7636614534d83c1099ab6fc7 # 01:45 69+ 20 sched/balance: add llc balance interval git bisect bad d5471974ffc0bd5cbf7213231e4d6276007cab37 # 01:45 0- 19 0day head guard for 'devel-hourly-2014021821' git bisect good 7a455ad6947d320cdf0234d07c4e4575b018cc11 # 01:50 69+ 14 Revert "sched/balance: add balance_interval to tuning top level balance frequency" git bisect good 60f76eab19e3903e810bdc3ec846c158efcd2e21 # 01:55 69+ 22 Merge tag 'dma-buf-for-3.14' of git://git.kernel.org/pub/scm/linux/kernel/git/sumits/dma-buf git bisect good 02d56d4d19b8aa889c856287729d89c805ee42ec # 01:59 69+ 11 Add linux-next specific files for 20140218 Thanks, Fengguang