Hi Christoph, It looks the rebased tree still has bug: git://git.kernel.org/pub/scm/linux/kernel/git/christoph/percpu.git percpu commit 83cb3ef954b801e929c239122c136f6ec05100a7 Author: Christoph Lameter AuthorDate: Tue Jul 29 16:09:51 2014 -0500 Commit: Christoph Lameter CommitDate: Tue Aug 5 10:19:47 2014 -0500 scheduler: Replace __get_cpu_var with this_cpu_ptr Convert all uses of __get_cpu_var for address calculation to use this_cpu_ptr instead. Cc: Peter Zijlstra Acked-by: Ingo Molnar Signed-off-by: Christoph Lameter The below __early_ioremap() warning looks like an independent noise. +---------------------------------------------------------+------------+------------+------------+ | | 9ce830d799 | 83cb3ef954 | 940896b397 | +---------------------------------------------------------+------------+------------+------------+ | boot_successes | 62 | 6 | 0 | | boot_failures | 282 | 80 | 11 | | WARNING:CPU:PID:at_mm/early_ioremap.c:__early_ioremap() | 247 | 51 | | | backtrace:acpi_initialize_tables | 247 | 51 | | | backtrace:acpi_table_init | 247 | 51 | | | backtrace:acpi_boot_table_init | 247 | 51 | | | BUG:kernel_boot_hang | 46 | | | | BUG:unable_to_handle_kernel_paging_request | 0 | 77 | 11 | | Oops | 0 | 77 | 11 | | EIP_is_at_memcpy | 0 | 77 | 11 | | Kernel_panic-not_syncing:Fatal_exception | 0 | 77 | 11 | | backtrace:__alloc_workqueue_key | 0 | 73 | 11 | | backtrace:usermodehelper_init | 0 | 73 | 11 | | backtrace:kernel_init_freeable | 0 | 73 | 11 | | backtrace:kthreadd | 0 | 3 | | | backtrace:schedule | 0 | 4 | | +---------------------------------------------------------+------------+------------+------------+ [ 0.322000] --------------------------------- [ 0.323061] smpboot: Total of 2 processors activated (10773.94 BogoMIPS) [ 0.323061] smpboot: Total of 2 processors activated (10773.94 BogoMIPS) [ 0.325759] BUG: unable to handle kernel [ 0.325759] BUG: unable to handle kernel paging requestpaging request at 10c0a000 at 10c0a000 [ 0.327329] IP: [ 0.327329] IP: [] memcpy+0xf/0x20 [] memcpy+0xf/0x20 [ 0.328444] *pde = 00000000 [ 0.328444] *pde = 00000000 [ 0.329163] Oops: 0002 [#1] [ 0.329163] Oops: 0002 [#1] PREEMPT PREEMPT SMP SMP [ 0.330000] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 3.16.0-00003-g83cb3ef #6 [ 0.330000] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 3.16.0-00003-g83cb3ef #6 [ 0.330000] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 0.330000] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 0.330000] task: d205d330 ti: d205e000 task.ti: d205e000 [ 0.330000] task: d205d330 ti: d205e000 task.ti: d205e000 [ 0.330000] EIP: 0060:[] EFLAGS: 00010002 CPU: 0 [ 0.330000] EIP: 0060:[] EFLAGS: 00010002 CPU: 0 [ 0.330000] EIP is at memcpy+0xf/0x20 [ 0.330000] EIP is at memcpy+0xf/0x20 [ 0.330000] EAX: 10c0a000 EBX: 00000004 ECX: 00000001 EDX: c188d680 [ 0.330000] EAX: 10c0a000 EBX: 00000004 ECX: 00000001 EDX: c188d680 [ 0.330000] ESI: c188d680 EDI: 10c0a000 EBP: d205fc90 ESP: d205fc84 [ 0.330000] ESI: c188d680 EDI: 10c0a000 EBP: d205fc90 ESP: d205fc84 [ 0.330000] DS: 007b ES: 007b FS: 00d8 GS: 00e0 SS: 0068 [ 0.330000] DS: 007b ES: 007b FS: 00d8 GS: 00e0 SS: 0068 [ 0.330000] CR0: 8005003b CR2: 10c0a000 CR3: 0191c000 CR4: 00000690 [ 0.330000] CR0: 8005003b CR2: 10c0a000 CR3: 0191c000 CR4: 00000690 [ 0.330000] Stack: [ 0.330000] Stack: [ 0.330000] 10c0a000 [ 0.330000] 10c0a000 d2041c80 d2041c80 d205fd1c d205fd1c d205fd28 d205fd28 c1062ddf c1062ddf 00000001 00000001 00000000 00000000 10c0a000 10c0a000 [ 0.330000] 00000000 [ 0.330000] 00000000 d2041c80 d2041c80 00000001 00000001 d2041c80 d2041c80 00000000 00000000 d251d3c0 d251d3c0 d205fcc4 d205fcc4 c10298ae c10298ae [ 0.330000] d205fccc [ 0.330000] d205fccc c10089d8 c10089d8 d205fd00 d205fd00 c105b016 c105b016 d251d3c0 d251d3c0 d204a140 d204a140 136a70e4 136a70e4 d2041c80 d2041c80 [ 0.330000] Call Trace: [ 0.330000] Call Trace: [ 0.330000] [] load_balance+0x9f/0x7d0 [ 0.330000] [] load_balance+0x9f/0x7d0 [ 0.330000] [] ? kvm_clock_read+0x1e/0x40 [ 0.330000] [] ? kvm_clock_read+0x1e/0x40 [ 0.330000] [] ? sched_clock+0x8/0x10 [ 0.330000] [] ? sched_clock+0x8/0x10 [ 0.330000] [] ? sched_clock_local+0x46/0x150 [ 0.330000] [] ? sched_clock_local+0x46/0x150 [ 0.330000] [] pick_next_task_fair+0x5b4/0xa00 [ 0.330000] [] pick_next_task_fair+0x5b4/0xa00 [ 0.330000] [] ? pick_next_task_fair+0x3d0/0xa00 [ 0.330000] [] ? pick_next_task_fair+0x3d0/0xa00 [ 0.330000] [] __schedule+0xb9/0x630 [ 0.330000] [] __schedule+0xb9/0x630 [ 0.330000] [] ? finish_task_switch+0x32/0xd0 [ 0.330000] [] ? finish_task_switch+0x32/0xd0 [ 0.330000] [] ? __lock_acquire.isra.29+0x361/0x980 [ 0.330000] [] ? __lock_acquire.isra.29+0x361/0x980 [ 0.330000] [] schedule+0x10/0x20 [ 0.330000] [] schedule+0x10/0x20 [ 0.330000] [] schedule_timeout+0x115/0x160 [ 0.330000] [] schedule_timeout+0x115/0x160 [ 0.330000] [] ? wait_for_completion_killable+0x93/0x130 [ 0.330000] [] ? wait_for_completion_killable+0x93/0x130 [ 0.330000] [] wait_for_completion_killable+0x9a/0x130 [ 0.330000] [] wait_for_completion_killable+0x9a/0x130 [ 0.330000] [] ? wake_up_state+0x10/0x10 [ 0.330000] [] ? wake_up_state+0x10/0x10 [ 0.330000] [] ? put_pwq_unlocked+0x30/0x30 [ 0.330000] [] ? put_pwq_unlocked+0x30/0x30 [ 0.330000] [] kthread_create_on_node+0xf0/0x170 [ 0.330000] [] kthread_create_on_node+0xf0/0x170 [ 0.330000] [] __alloc_workqueue_key+0x2a1/0x3d0 [ 0.330000] [] __alloc_workqueue_key+0x2a1/0x3d0 [ 0.330000] [] ? put_pwq_unlocked+0x30/0x30 [ 0.330000] [] ? put_pwq_unlocked+0x30/0x30 [ 0.330000] [] ? alloc_cpumask_var_node+0x3b/0x70 [ 0.330000] [] ? alloc_cpumask_var_node+0x3b/0x70 [ 0.330000] [] usermodehelper_init+0x3a/0x47 [ 0.330000] [] usermodehelper_init+0x3a/0x47 [ 0.330000] [] kernel_init_freeable+0x11f/0x21e [ 0.330000] [] kernel_init_freeable+0x11f/0x21e [ 0.330000] [] ? kernel_init+0xb/0xe0 [ 0.330000] [] ? kernel_init+0xb/0xe0 [ 0.330000] [] kernel_init+0xb/0xe0 [ 0.330000] [] kernel_init+0xb/0xe0 [ 0.330000] [] ret_from_kernel_thread+0x21/0x30 [ 0.330000] [] ret_from_kernel_thread+0x21/0x30 [ 0.330000] [] ? rest_init+0xc0/0xc0 [ 0.330000] [] ? rest_init+0xc0/0xc0 [ 0.330000] Code: [ 0.330000] Code: 54 54 2b 2b 43 43 50 50 88 88 43 43 4e 4e 5b 5b 5d 5d c3 c3 66 66 90 90 e8 e8 7b 7b fc fc ff ff ff ff eb eb eb eb 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 55 55 89 89 e5 e5 57 57 89 89 c7 c7 56 56 89 89 d6 d6 53 53 89 89 cb cb c1 c1 e9 e9 02 02 a5 a5 89 89 d9 d9 83 83 e1 e1 03 03 74 74 02 02 f3 f3 a4 a4 5b 5b 5e 5e 5f 5f 5d 5d c3 c3 90 90 55 55 89 89 e5 e5 57 57 [ 0.330000] EIP: [] [ 0.330000] EIP: [] memcpy+0xf/0x20memcpy+0xf/0x20 SS:ESP 0068:d205fc84 SS:ESP 0068:d205fc84 [ 0.330000] CR2: 0000000010c0a000 [ 0.330000] CR2: 0000000010c0a000 [ 0.330000] ---[ end trace 0030a3693b3a3ac2 ]--- [ 0.330000] ---[ end trace 0030a3693b3a3ac2 ]--- git bisect start 940896b39797959c05a5814eff4104a77bf7fe4e 19583ca584d6f574384e17fe7613dfaeadcdc4a6 -- git bisect bad acc0a5b4f9bc3a72399412a7088bb4fe835eda89 # 03:24 0- 8 Merge 'radeon-alex/drm-next-3.17' into devel-roam-i386-201408060008 git bisect good dfcac1e8cfdfa77bf25760aec4523996ed876e98 # 03:28 86+ 56 Merge 'amirv/for-linux-rdma' into devel-roam-i386-201408060008 git bisect bad b25a3730fd9af21d85bfc80cf9b276294bf5d880 # 03:28 0- 10 Merge 'christoph-percpu/percpu' into devel-roam-i386-201408060008 git bisect bad 49ddbbbd1e723acdce288ec6fa380790a935be33 # 03:28 0- 31 x86: Replace __get_cpu_var uses git bisect bad 16ba029a539f471677dc772ec978cef0286506c4 # 03:44 0- 18 drivers/clocksource: Replace __get_cpu_var used for address calculation git bisect bad d0de0521977fcb8890127fce127f65422128f96d # 03:51 0- 9 block: Replace __this_cpu_ptr with raw_cpu_ptr git bisect good 9ce830d7992b3c1cad4e283e8b7a29bb35013f50 # 03:59 86+ 65 time: Replace __get_cpu_var uses git bisect bad 83cb3ef954b801e929c239122c136f6ec05100a7 # 04:13 0- 56 scheduler: Replace __get_cpu_var with this_cpu_ptr # first bad commit: [83cb3ef954b801e929c239122c136f6ec05100a7] scheduler: Replace __get_cpu_var with this_cpu_ptr git bisect good 9ce830d7992b3c1cad4e283e8b7a29bb35013f50 # 04:23 258+ 282 time: Replace __get_cpu_var uses git bisect bad 940896b39797959c05a5814eff4104a77bf7fe4e # 04:23 0- 11 0day head guard for 'devel-roam-i386-201408060008' git bisect good c489d98c8c81a898cfed6bec193cca2006f956aa # 05:00 258+ 23 Merge branch 'for-linus' of git://ftp.arm.linux.org.uk/~rmk/linux-arm git bisect good 913b188a45d13edbcddfa15bd420a580fd7a1f25 # 05:56 258+ 139 Add linux-next specific files for 20140805 This script may reproduce the error. ---------------------------------------------------------------------------- #!/bin/bash kernel=$1 kvm=( qemu-system-x86_64 -cpu kvm64 -enable-kvm -kernel $kernel -m 320 -smp 2 -net nic,vlan=1,model=e1000 -net user,vlan=1 -boot order=nc -no-reboot -watchdog i6300esb -rtc base=localtime -serial stdio -display none -monitor null ) append=( hung_task_panic=1 earlyprintk=ttyS0,115200 debug apic=debug sysrq_always_enabled rcupdate.rcu_cpu_stall_timeout=100 panic=10 softlockup_panic=1 nmi_watchdog=panic load_ramdisk=2 prompt_ramdisk=0 console=ttyS0,115200 console=tty0 vga=normal root=/dev/ram0 rw drbd.minor_count=8 ) "${kvm[@]}" --append "${append[*]}" ---------------------------------------------------------------------------- Thanks, Fengguang _______________________________________________ LKP mailing list LKP(a)linux.intel.com