* [linus:master] [x86/mm/tlb/trace] 8b62e64e6d: BUG:soft_lockup-CPU##stuck_for#s![kworker##:#]
@ 2026-03-12 8:02 kernel test robot
0 siblings, 0 replies; only message in thread
From: kernel test robot @ 2026-03-12 8:02 UTC (permalink / raw)
To: Tal Zussman
Cc: oe-lkp, lkp, linux-kernel, Ingo Molnar, Steven Rostedt,
David Hildenbrand, Rik van Riel, linux-arch, linux-mm,
oliver.sang
Hello,
we don't have enough knowledge to connect the issue with changes in 8b62e64e6d,
however, even after rebuilding kernel and rerun both 8b62e64e6d and its parent
up to 500 times, we still observe 8b62e64e6d show various issues especially
softlockup related, while parent keeps clean. so we still make out this report
FYI.
=========================================================================================
tbox_group/testcase/rootfs/kconfig/compiler/runtime/scale_type:
vm-snb-i386/rcuscale/debian-11.1-i386-20220923.cgz/i386-randconfig-003-20260227/gcc-14/300s/rcu
043507144ae13d3b 8b62e64e6d30fa047b3aefb1a36
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:500 7% 33:500 dmesg.BUG:soft_lockup-CPU##stuck_for#s![kworker##:#]
:500 0% 1:500 dmesg.BUG:soft_lockup-CPU##stuck_for#s![kworker:#:#]
:500 16% 78:500 dmesg.BUG:soft_lockup-CPU##stuck_for#s![swapper:#]
:500 0% 2:500 dmesg.EIP:_raw_spin_unlock_irqrestore
:500 8% 41:500 dmesg.EIP:console_emit_next_record
:500 0% 2:500 dmesg.EIP:finish_task_switch
:500 1% 3:500 dmesg.EIP:ktime_get_coarse_real_ts64_mg
:500 5% 25:500 dmesg.EIP:lock_acquire
:500 4% 22:500 dmesg.EIP:lock_release
:500 0% 1:500 dmesg.EIP:queue_delayed_work_on
:500 0% 2:500 dmesg.EIP:queue_work_on
:500 3% 14:500 dmesg.EIP:timekeeping_notify
:500 22% 112:500 dmesg.Kernel_panic-not_syncing:softlockup:hung_tasks
kernel test robot noticed "BUG:soft_lockup-CPU##stuck_for#s![kworker##:#]" on:
commit: 8b62e64e6d30fa047b3aefb1a36e1f80c8acb3d2 ("x86/mm/tlb/trace: Export the TLB_REMOTE_WRONG_CPU enum in <trace/events/tlb.h>")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
[test failed on linus/master 1954c4f012206147c34acda8da04f827aa7d3ee3]
[test failed on linux-next/master a0ae2a256046c0c5d3778d1a194ff2e171f16e5f]
in testcase: rcuscale
version:
with following parameters:
runtime: 300s
scale_type: rcu
config: i386-randconfig-003-20260227
compiler: gcc-14
test machine: qemu-system-i386 -enable-kvm -cpu SandyBridge -smp 2 -m 4G
(please refer to attached dmesg/kmsg for entire log/backtrace)
If you fix the issue in a separate patch/commit (i.e. not just a new version of
the same patch/commit), kindly add following tags
| Reported-by: kernel test robot <oliver.sang@intel.com>
| Closes: https://lore.kernel.org/oe-lkp/202603121500.b3c3a3d8-lkp@intel.com
[ 676.809255][ C0] watchdog: BUG: soft lockup - CPU#0 stuck for 626s! [kworker/u4:1:18]
[ 676.809255][ C0] CPU#0 Utilization every 96000ms during lockup:
[ 676.809255][ C0] #1: 27% system, 0% softirq, 0% hardirq, 0% idle
[ 676.809255][ C0] #2: 28% system, 0% softirq, 0% hardirq, 0% idle
[ 676.809255][ C0] #3: 29% system, 0% softirq, 0% hardirq, 0% idle
[ 676.809255][ C0] #4: 25% system, 0% softirq, 0% hardirq, 0% idle
[ 676.809255][ C0] #5: 29% system, 0% softirq, 0% hardirq, 0% idle
[ 676.809255][ C0] Modules linked in:
[ 676.809255][ C0] irq event stamp: 776
[ 676.809255][ C0] hardirqs last enabled at (775): irqentry_exit (kernel/entry/common.c:229)
[ 676.809255][ C0] hardirqs last disabled at (776): sysvec_apic_timer_interrupt (arch/x86/kernel/apic/apic.c:1056)
[ 676.809255][ C0] softirqs last enabled at (288): handle_softirqs (kernel/softirq.c:469 (discriminator 1) kernel/softirq.c:650 (discriminator 1))
[ 676.809255][ C0] softirqs last disabled at (279): __do_softirq (kernel/softirq.c:657)
[ 676.809255][ C0] CPU: 0 UID: 0 PID: 18 Comm: kworker/u4:1 Tainted: G T 6.18.0-12697-g8b62e64e6d30 #1 VOLUNTARY 80d8d0334b0142a6d2ede86c263b0b8ef70fa3ec
[ 676.809255][ C0] Tainted: [T]=RANDSTRUCT
[ 676.809255][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.3-debian-1.16.3-2 04/01/2014
[ 676.809255][ C0] Workqueue: eval_map_wq tracer_init_tracefs_work_func
[ 676.809255][ C0] EIP: lock_release (kernel/locking/lockdep.c:5893)
[ 676.809255][ C0] Code: 44 89 da 89 f0 e8 b5 fc ff ff b8 ff ff ff ff 0f c1 05 e8 8c 7e 44 48 75 56 9c 58 f6 c4 02 75 3f 81 e7 00 02 00 00 74 01 fb 5b <5e> 5f 5d c3 90 ff 05 10 80 64 44 a1 dc 5d e9 44 85 c0 74 0c 8b 40
All code
========
0: 44 89 da mov %r11d,%edx
3: 89 f0 mov %esi,%eax
5: e8 b5 fc ff ff call 0xfffffffffffffcbf
a: b8 ff ff ff ff mov $0xffffffff,%eax
f: 0f c1 05 e8 8c 7e 44 xadd %eax,0x447e8ce8(%rip) # 0x447e8cfe
16: 48 75 56 rex.W jne 0x6f
19: 9c pushf
1a: 58 pop %rax
1b: f6 c4 02 test $0x2,%ah
1e: 75 3f jne 0x5f
20: 81 e7 00 02 00 00 and $0x200,%edi
26: 74 01 je 0x29
28: fb sti
29: 5b pop %rbx
2a:* 5e pop %rsi <-- trapping instruction
2b: 5f pop %rdi
2c: 5d pop %rbp
2d: c3 ret
2e: 90 nop
2f: ff 05 10 80 64 44 incl 0x44648010(%rip) # 0x44648045
35: a1 dc 5d e9 44 85 c0 movabs 0xc74c08544e95ddc,%eax
3c: 74 0c
3e: 8b .byte 0x8b
3f: 40 rex
Code starting with the faulting instruction
===========================================
0: 5e pop %rsi
1: 5f pop %rdi
2: 5d pop %rbp
3: c3 ret
4: 90 nop
5: ff 05 10 80 64 44 incl 0x44648010(%rip) # 0x4464801b
b: a1 dc 5d e9 44 85 c0 movabs 0xc74c08544e95ddc,%eax
12: 74 0c
14: 8b .byte 0x8b
15: 40 rex
[ 676.809255][ C0] EAX: 00000047 EBX: 460083c0 ECX: 4651ede0 EDX: aadc23cd
[ 676.809255][ C0] ESI: 460083d0 EDI: 00000200 EBP: 46513db4 ESP: 46513dac
[ 676.809255][ C0] DS: 007b ES: 007b FS: 0000 GS: 0000 SS: 0068 EFLAGS: 00000206
[ 676.809255][ C0] CR0: 80050033 CR2: ffd99000 CR3: 05284000 CR4: 00040690
[ 676.809255][ C0] Call Trace:
[ 676.809255][ C0] ? _raw_spin_unlock (include/linux/spinlock_api_smp.h:142 kernel/locking/spinlock.c:186)
[ 676.809255][ C0] ? dput (fs/dcache.c:362)
[ 676.809255][ C0] ? dput (fs/dcache.c:929)
[ 676.809255][ C0] ? put_fs_context (fs/fs_context.c:516)
[ 676.809255][ C0] ? vfs_kern_mount (include/linux/err.h:78 (discriminator 2) fs/namespace.c:6045 (discriminator 2))
[ 676.809255][ C0] ? vfs_kern_mount (fs/namespace.c:1225)
[ 676.809255][ C0] ? simple_pin_fs (fs/libfs.c:1109)
[ 676.809255][ C0] ? tracefs_start_creating (fs/tracefs/inode.c:554)
[ 676.809255][ C0] ? tracefs_create_file (fs/tracefs/inode.c:645)
[ 676.809255][ C0] ? lock_acquire (include/trace/events/lock.h:24 (discriminator 5) include/trace/events/lock.h:24 (discriminator 5) kernel/locking/lockdep.c:5831 (discriminator 5))
[ 676.809255][ C0] ? process_one_work (kernel/workqueue.c:3233)
[ 676.809255][ C0] ? trace_create_file (kernel/trace/trace.c:9589)
[ 676.809255][ C0] ? local_clock (arch/x86/include/asm/preempt.h:85 (discriminator 15) kernel/sched/clock.c:319 (discriminator 15))
[ 676.809255][ C0] ? trace_create_file (kernel/trace/trace.c:9589)
[ 676.809255][ C0] ? event_trace_init (include/linux/mutex.h:253 kernel/trace/trace_events.c:4469 kernel/trace/trace_events.c:4630)
[ 676.809255][ C0] ? tracer_init_tracefs_work_func (kernel/trace/trace.c:10923)
[ 676.809255][ C0] ? process_one_work (arch/x86/include/asm/jump_label.h:37 include/trace/events/workqueue.h:110 kernel/workqueue.c:3262)
[ 676.809255][ C0] ? worker_thread (kernel/workqueue.c:3334 (discriminator 2) kernel/workqueue.c:3421 (discriminator 2))
[ 676.809255][ C0] ? kthread (kernel/kthread.c:463)
[ 676.809255][ C0] ? rescuer_thread (kernel/workqueue.c:3367)
[ 676.809255][ C0] ? kthread_complete_and_exit (kernel/kthread.c:412)
[ 676.809255][ C0] ? ret_from_fork (arch/x86/kernel/process.c:164)
[ 676.809255][ C0] ? kthread_complete_and_exit (kernel/kthread.c:412)
[ 676.809255][ C0] ? ret_from_fork_asm (arch/x86/entry/entry_32.S:737)
[ 676.809255][ C0] ? entry_INT80_32 (arch/x86/entry/entry_32.S:942)
[ 676.809255][ C0] Kernel panic - not syncing: softlockup: hung tasks
[ 676.809255][ C0] CPU: 0 UID: 0 PID: 18 Comm: kworker/u4:1 Tainted: G L T 6.18.0-12697-g8b62e64e6d30 #1 VOLUNTARY 80d8d0334b0142a6d2ede86c263b0b8ef70fa3ec
[ 676.809255][ C0] Tainted: [L]=SOFTLOCKUP, [T]=RANDSTRUCT
[ 676.809255][ C0] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.3-debian-1.16.3-2 04/01/2014
[ 676.809255][ C0] Workqueue: eval_map_wq tracer_init_tracefs_work_func
[ 676.809255][ C0] Call Trace:
[ 676.809255][ C0] ? show_stack (arch/x86/kernel/dumpstack.c:338)
[ 676.809255][ C0] ? dump_stack_lvl (lib/dump_stack.c:122)
[ 676.809255][ C0] ? dump_stack (lib/dump_stack.c:130)
[ 676.809255][ C0] ? vpanic (kernel/panic.c:487)
[ 676.809255][ C0] ? panic (kernel/panic.c:365 kernel/panic.c:362)
[ 676.809255][ C0] ? watchdog_timer_fn.cold (kernel/watchdog.c:869)
[ 676.809255][ C0] ? softlockup_fn (kernel/watchdog.c:774)
[ 676.809255][ C0] ? __run_hrtimer+0xea/0x300
[ 676.809255][ C0] ? __hrtimer_run_queues+0x9d/0x100
[ 676.809255][ C0] ? hrtimer_run_queues (kernel/time/hrtimer.c:1999)
[ 676.809255][ C0] ? update_process_times (kernel/time/timer.c:2455 (discriminator 3) kernel/time/timer.c:2473 (discriminator 3))
[ 676.809255][ C0] ? tick_periodic+0x3b/0x140
[ 676.809255][ C0] ? tick_handle_periodic (kernel/time/tick-common.c:130)
[ 676.809255][ C0] ? vmware_sched_clock (arch/x86/kernel/apic/apic.c:1056)
[ 676.809255][ C0] ? __sysvec_apic_timer_interrupt (arch/x86/include/asm/trace/irq_vectors.h:40 (discriminator 4) arch/x86/include/asm/trace/irq_vectors.h:40 (discriminator 4) arch/x86/kernel/apic/apic.c:1063 (discriminator 4))
[ 676.809255][ C0] ? sysvec_apic_timer_interrupt (arch/x86/kernel/apic/apic.c:1056 (discriminator 2) arch/x86/kernel/apic/apic.c:1056 (discriminator 2))
[ 676.809255][ C0] ? handle_exception (arch/x86/entry/entry_32.S:1048)
[ 676.809255][ C0] ? dl_server_apply_params (kernel/sched/deadline.c:120 (discriminator 7) kernel/sched/deadline.c:1876 (discriminator 7))
[ 676.809255][ C0] ? __filename_parentat (fs/namei.c:2820 (discriminator 2))
[ 676.809255][ C0] ? vmware_sched_clock (arch/x86/kernel/apic/apic.c:1056)
[ 676.809255][ C0] ? lock_release (kernel/locking/lockdep.c:5893)
[ 676.809255][ C0] ? __filename_parentat (fs/namei.c:2820 (discriminator 2))
[ 676.809255][ C0] ? vmware_sched_clock (arch/x86/kernel/apic/apic.c:1056)
[ 676.809255][ C0] ? lock_release (kernel/locking/lockdep.c:5893)
[ 676.809255][ C0] ? _raw_spin_unlock (include/linux/spinlock_api_smp.h:142 kernel/locking/spinlock.c:186)
[ 676.809255][ C0] ? dput (fs/dcache.c:362)
[ 676.809255][ C0] ? dput (fs/dcache.c:929)
[ 676.809255][ C0] ? put_fs_context (fs/fs_context.c:516)
[ 676.809255][ C0] ? vfs_kern_mount (include/linux/err.h:78 (discriminator 2) fs/namespace.c:6045 (discriminator 2))
[ 676.809255][ C0] ? vfs_kern_mount (fs/namespace.c:1225)
[ 676.809255][ C0] ? simple_pin_fs (fs/libfs.c:1109)
[ 676.809255][ C0] ? tracefs_start_creating (fs/tracefs/inode.c:554)
[ 676.809255][ C0] ? tracefs_create_file (fs/tracefs/inode.c:645)
[ 676.809255][ C0] ? lock_acquire (include/trace/events/lock.h:24 (discriminator 5) include/trace/events/lock.h:24 (discriminator 5) kernel/locking/lockdep.c:5831 (discriminator 5))
[ 676.809255][ C0] ? process_one_work (kernel/workqueue.c:3233)
[ 676.809255][ C0] ? trace_create_file (kernel/trace/trace.c:9589)
[ 676.809255][ C0] ? local_clock (arch/x86/include/asm/preempt.h:85 (discriminator 15) kernel/sched/clock.c:319 (discriminator 15))
[ 676.809255][ C0] ? trace_create_file (kernel/trace/trace.c:9589)
[ 676.809255][ C0] ? event_trace_init (include/linux/mutex.h:253 kernel/trace/trace_events.c:4469 kernel/trace/trace_events.c:4630)
[ 676.809255][ C0] ? tracer_init_tracefs_work_func (kernel/trace/trace.c:10923)
[ 676.809255][ C0] ? process_one_work (arch/x86/include/asm/jump_label.h:37 include/trace/events/workqueue.h:110 kernel/workqueue.c:3262)
[ 676.809255][ C0] ? worker_thread (kernel/workqueue.c:3334 (discriminator 2) kernel/workqueue.c:3421 (discriminator 2))
[ 676.809255][ C0] ? kthread (kernel/kthread.c:463)
[ 676.809255][ C0] ? rescuer_thread (kernel/workqueue.c:3367)
[ 676.809255][ C0] ? kthread_complete_and_exit (kernel/kthread.c:412)
[ 676.809255][ C0] ? ret_from_fork (arch/x86/kernel/process.c:164)
[ 676.809255][ C0] ? kthread_complete_and_exit (kernel/kthread.c:412)
[ 676.809255][ C0] ? ret_from_fork_asm (arch/x86/entry/entry_32.S:737)
[ 676.809255][ C0] ? entry_INT80_32 (arch/x86/entry/entry_32.S:942)
The kernel config and materials to reproduce are available at:
https://download.01.org/0day-ci/archive/20260312/202603121500.b3c3a3d8-lkp@intel.com
--
0-DAY CI Kernel Test Service
https://github.com/intel/lkp-tests/wiki
^ permalink raw reply [flat|nested] only message in thread
only message in thread, other threads:[~2026-03-12 8:02 UTC | newest]
Thread overview: (only message) (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2026-03-12 8:02 [linus:master] [x86/mm/tlb/trace] 8b62e64e6d: BUG:soft_lockup-CPU##stuck_for#s![kworker##:#] kernel test robot
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox