[164362.087760][T615746] run fstests xfs/598 at 2026-01-17 23:32:19
[164362.249183][T3695722] MODE SENSE: unimplemented page/subpage: 0x0a/0x05
[164362.683408][T3644020] MODE SENSE: unimplemented page/subpage: 0x0a/0x05
[164363.177458][T3712338] MODE SENSE: unimplemented page/subpage: 0x0a/0x05
[164363.238180][T3623436] MODE SENSE: unimplemented page/subpage: 0x0a/0x05
[164365.560575][T3731123] XFS (sde): Mounting V5 Filesystem 370e9d06-7cd7-4409-a646-8df1281ad340
[164365.590219][T3731123] XFS (sde): Ending clean mount
[164366.806697][T3712338] MODE SENSE: unimplemented page/subpage: 0x0a/0x05
[164367.434544][T3731222] XFS (sdf): Mounting V5 Filesystem 0f2f1dc1-26a3-4727-b406-02fd47068ba0
[164367.460312][T3731222] XFS (sdf): Ending clean mount
[164367.933481][T3731257] XFS (sdf): Unmounting Filesystem 0f2f1dc1-26a3-4727-b406-02fd47068ba0
[164368.522780][T3641638] MODE SENSE: unimplemented page/subpage: 0x0a/0x05
[164368.807146][T3731285] XFS (sdf): Mounting V5 Filesystem 1e2f895f-6082-4205-b1c5-1be269eed299
[164368.832462][T3731285] XFS (sdf): Ending clean mount
[164371.724834][T3731467] XFS (sdf): Unmounting Filesystem 1e2f895f-6082-4205-b1c5-1be269eed299
[164382.615394][T3644020] MODE SENSE: unimplemented page/subpage: 0x0a/0x05
[164383.675161][T3731484] XFS (sdf): Mounting V5 Filesystem 1e2f895f-6082-4205-b1c5-1be269eed299
[164383.864407][T3731484] XFS (sdf): Ending clean mount
[164384.706147][T3731546] TARGET_CORE[loopback]: Expected Transfer Length: 0 does not match SCSI CDB Length: 512 for SAM Opcode: 0x8f
[164386.423013][T3731676] XFS (sdf): Unmounting Filesystem 1e2f895f-6082-4205-b1c5-1be269eed299
[164386.653848][T3642378] MODE SENSE: unimplemented page/subpage: 0x0a/0x05
[164387.355073][T3731890] XFS (sdf): Mounting V5 Filesystem 1e2f895f-6082-4205-b1c5-1be269eed299
[164387.382939][T3731890] XFS (sdf): Ending clean mount
[164387.443458][T3731900] XFS (sdf): Unmounting Filesystem 1e2f895f-6082-4205-b1c5-1be269eed299
[164396.179956][T3642378] MODE SENSE: unimplemented page/subpage: 0x0a/0x05
[164397.268929][T3731912] XFS (sdf): Mounting V5 Filesystem 1e2f895f-6082-4205-b1c5-1be269eed299
[164397.475222][T3731912] XFS (sdf): Ending clean mount
[164398.292849][T3731974] TARGET_CORE[loopback]: Expected Transfer Length: 0 does not match SCSI CDB Length: 512 for SAM Opcode: 0x8f
[164399.987980][T3732104] XFS (sdf): Unmounting Filesystem 1e2f895f-6082-4205-b1c5-1be269eed299
[164400.223661][T3718281] MODE SENSE: unimplemented page/subpage: 0x0a/0x05
[164465.805668][ C7] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[164465.807458][ C7] rcu: 5-...0: (1 GPs behind) idle=9184/1/0x4000000000000000 softirq=12412680/12412680 fqs=7111
[164465.811931][ C7] rcu: (detected by 7, t=65008 jiffies, g=63951405, q=3734 ncpus=16)
[164465.813731][ C7] Sending NMI from CPU 7 to CPUs 5:
[164465.813769][ C5] NMI backtrace for cpu 5
[164465.813779][ C5] CPU: 5 UID: 0 PID: 0 Comm: swapper/5 Not tainted 6.19.0-rc1-kts-xfs-zoned-fixes-gec6aea2a5+ #1 PREEMPT(lazy)
[164465.813786][ C5] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.17.0-5.fc42 04/01/2014
[164465.813789][ C5] RIP: 0010:mm_get_cid+0x171/0x2c0
[164465.813800][ C5] Code: d0 a4 48 b8 00 00 00 00 00 fc ff df 83 e5 07 48 c1 eb 03 83 c5 03 48 01 c3 49 c7 c4 8c ba 91 a3 41 83 e4 07 41 83 c4 03 f3 90 <48> 8b 04 24 0f b6 00 41 38 c4 7c 08 84 c0 0f 85 f2 00 00 00 8b 35
[164465.813804][ C5] RSP: 0018:ffff88810115fcf8 EFLAGS: 00000046
[164465.813809][ C5] RAX: 0000000000000010 RBX: fffffbfff49a1c1c RCX: 0000000000000010
[164465.813813][ C5] RDX: 0000000000000010 RSI: dffffc0000000000 RDI: ffff888128a4d510
[164465.813815][ C5] RBP: 0000000000000003 R08: 0000000040000002 R09: 000000000000000e
[164465.813818][ C5] R10: ffff888128a4ca80 R11: ffff888565575654 R12: 0000000000000007
[164465.813821][ C5] R13: ffff888128a4d500 R14: 0000000000000010 R15: 0000000000000010
[164465.813824][ C5] FS: 0000000000000000(0000) GS:ffff888c67339000(0000) knlGS:0000000000000000
[164465.813827][ C5] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[164465.813830][ C5] CR2: 00007f7661c41820 CR3: 000000013d927004 CR4: 0000000000772ef0
[164465.813836][ C5] PKRU: 55555554
[164465.813838][ C5] Call Trace:
[164465.813841][ C5]
[164465.813847][ C5] mm_cid_switch_to+0xa6d/0x1300
[164465.813853][ C5] ? switch_mm_irqs_off+0x6fe/0x970
[164465.813860][ C5] __schedule+0x6b5/0x12a0
[164465.813868][ C5] ? __pfx___schedule+0x10/0x10
[164465.813874][ C5] ? tick_nohz_stop_idle+0x206/0x330
[164465.813880][ C5] ? lockdep_hardirqs_on_prepare.part.0+0x9b/0x140
[164465.813887][ C5] schedule_idle+0x59/0x90
[164465.813892][ C5] do_idle+0x10e/0x190
[164465.813898][ C5] cpu_startup_entry+0x53/0x70
[164465.813903][ C5] start_secondary+0x220/0x2e0
[164465.813910][ C5] ? __pfx_start_secondary+0x10/0x10
[164465.813918][ C5] common_startup_64+0x13e/0x141
[164465.813930][ C5]
[164465.814770][ C7] rcu: rcu_preempt kthread starved for 32507 jiffies! g63951405 f0x0 RCU_GP_DOING_FQS(6) ->state=0x0 ->cpu=12
[164465.861005][ C7] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
[164465.863304][ C7] rcu: RCU grace-period kthread stack dump:
[164465.864533][ C7] task:rcu_preempt state:R running task stack:0 pid:16 tgid:16 ppid:2 task_flags:0x208040 flags:0x00080000
[164465.867474][ C7] Call Trace:
[164465.868274][ C7]
[164465.868930][ C7] ? do_raw_spin_lock+0x1d9/0x270
[164465.870096][ C7] ? __pfx_do_raw_spin_lock+0x10/0x10
[164465.871337][ C7] ? lock_acquire+0xf6/0x130
[164465.872474][ C7] ? raw_spin_rq_lock_nested+0x24/0x170
[164465.873734][ C7] ? _raw_spin_rq_lock_irqsave+0x41/0x50
[164465.874911][ C7] ? resched_cpu+0x62/0xf0
[164465.875856][ C7] ? force_qs_rnp+0x67d/0xaa0
[164465.876839][ C7] ? __pfx_rcu_watching_snap_recheck+0x10/0x10
[164465.878084][ C7] ? rcu_gp_fqs_loop+0x948/0x11b0
[164465.879123][ C7] ? rcu_gp_init+0xb0f/0x14a0
[164465.880101][ C7] ? __pfx_rcu_gp_fqs_loop+0x10/0x10
[164465.881199][ C7] ? _raw_spin_unlock_irq+0x28/0x50
[164465.882245][ C7] ? rcu_gp_cleanup+0x824/0xf40
[164465.883218][ C7] ? __pfx_rcu_gp_init+0x10/0x10
[164465.884313][ C7] ? __pfx_rcu_gp_cleanup+0x10/0x10
[164465.885399][ C7] ? lockdep_hardirqs_on_prepare.part.0+0x9b/0x140
[164465.886816][ C7] ? rcu_gp_kthread+0x4f2/0x660
[164465.887868][ C7] ? lock_acquire+0xf6/0x130
[164465.888768][ C7] ? __pfx_rcu_gp_kthread+0x10/0x10
[164465.889732][ C7] ? lockdep_hardirqs_on_prepare.part.0+0x9b/0x140
[164465.890918][ C7] ? __pfx_rcu_gp_kthread+0x10/0x10
[164465.891888][ C7] ? __kthread_parkme+0xb3/0x1f0
[164465.892807][ C7] ? __pfx_rcu_gp_kthread+0x10/0x10
[164465.893771][ C7] ? kthread+0x3a4/0x760
[164465.894583][ C7] ? __pfx_kthread+0x10/0x10
[164465.895451][ C7] ? __lock_release.isra.0+0x59/0x170
[164465.896432][ C7] ? __pfx_kthread+0x10/0x10
[164465.897287][ C7] ? ret_from_fork+0x50e/0x670
[164465.898192][ C7] ? __pfx_ret_from_fork+0x10/0x10
[164465.899205][ C7] ? __switch_to+0x42c/0xd70
[164465.900087][ C7] ? __pfx_kthread+0x10/0x10
[164465.900919][ C7] ? ret_from_fork_asm+0x1a/0x30
[164465.901777][ C7]
[164465.902303][ C7] rcu: Stack dump where RCU GP kthread last ran:
[164465.903374][ C7] Sending NMI from CPU 7 to CPUs 12:
[164465.904302][ C12] NMI backtrace for cpu 12
[164465.904310][ C12] CPU: 12 UID: 0 PID: 16 Comm: rcu_preempt Not tainted 6.19.0-rc1-kts-xfs-zoned-fixes-gec6aea2a5+ #1 PREEMPT(lazy)
[164465.904316][ C12] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.17.0-5.fc42 04/01/2014
[164465.904319][ C12] RIP: 0010:__pv_queued_spin_lock_slowpath+0x232/0xdc0
[164465.904328][ C12] Code: 44 8b 2b c6 44 24 60 00 66 45 85 ed 74 1e 41 81 fd ff ff 00 00 0f 86 5e 02 00 00 41 81 e5 00 ff 00 00 0f 85 51 02 00 00 f3 90 b5 48 89 df be 01 00 00 00 e8 9f 96 bc fd be 01 00 00 00 48 8d
[164465.904332][ C12] RSP: 0018:ffff8881010c7948 EFLAGS: 00000046
[164465.904337][ C12] RAX: 0000000000000000 RBX: ffff888c0d0c5440 RCX: 0000000000000001
[164465.904341][ C12] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff888c0d0c5440
[164465.904343][ C12] RBP: 0000000000000003 R08: ffffffffa28edce6 R09: ffffed1181a18a88
[164465.904346][ C12] R10: ffffed1181a18a89 R11: 0000000000000001 R12: ffffed1181a18a88
[164465.904349][ C12] R13: 0000000000000000 R14: ffff888c0d446408 R15: ffff888c0d446400
[164465.904351][ C12] FS: 0000000000000000(0000) GS:ffff888c676b9000(0000) knlGS:0000000000000000
[164465.904354][ C12] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[164465.904357][ C12] CR2: 00007f7657ff6cb8 CR3: 0000000108544001 CR4: 0000000000772ef0
[164465.904363][ C12] PKRU: 55555554
[164465.904365][ C12] Call Trace:
[164465.904368][ C12]
[164465.904372][ C12] ? lock_release.part.0+0x1c/0x50
[164465.904378][ C12] ? __virt_addr_valid+0x1d1/0x3f0
[164465.904383][ C12] ? __pfx___pv_queued_spin_lock_slowpath+0x10/0x10
[164465.904389][ C12] ? __lock_acquire+0x55d/0xbd0
[164465.904398][ C12] do_raw_spin_lock+0x1d9/0x270
[164465.904404][ C12] ? __pfx_do_raw_spin_lock+0x10/0x10
[164465.904409][ C12] ? lock_acquire+0xf6/0x130
[164465.904415][ C12] raw_spin_rq_lock_nested+0x24/0x170
[164465.904427][ C12] _raw_spin_rq_lock_irqsave+0x41/0x50
[164465.904431][ C12] resched_cpu+0x62/0xf0
[164465.904436][ C12] force_qs_rnp+0x67d/0xaa0
[164465.904442][ C12] ? __pfx_rcu_watching_snap_recheck+0x10/0x10
[164465.904451][ C12] rcu_gp_fqs_loop+0x948/0x11b0
[164465.904456][ C12] ? rcu_gp_init+0xb0f/0x14a0
[164465.904463][ C12] ? __pfx_rcu_gp_fqs_loop+0x10/0x10
[164465.904467][ C12] ? _raw_spin_unlock_irq+0x28/0x50
[164465.904470][ C12] ? rcu_gp_cleanup+0x824/0xf40
[164465.904476][ C12] ? __pfx_rcu_gp_init+0x10/0x10
[164465.904482][ C12] ? __pfx_rcu_gp_cleanup+0x10/0x10
[164465.904487][ C12] ? lockdep_hardirqs_on_prepare.part.0+0x9b/0x140
[164465.904494][ C12] rcu_gp_kthread+0x4f2/0x660
[164465.904499][ C12] ? lock_acquire+0xf6/0x130
[164465.904504][ C12] ? __pfx_rcu_gp_kthread+0x10/0x10
[164465.904508][ C12] ? lockdep_hardirqs_on_prepare.part.0+0x9b/0x140
[164465.904514][ C12] ? __pfx_rcu_gp_kthread+0x10/0x10
[164465.904518][ C12] ? __kthread_parkme+0xb3/0x1f0
[164465.904524][ C12] ? __pfx_rcu_gp_kthread+0x10/0x10
[164465.904529][ C12] kthread+0x3a4/0x760
[164465.904534][ C12] ? __pfx_kthread+0x10/0x10
[164465.904539][ C12] ? __lock_release.isra.0+0x59/0x170
[164465.904545][ C12] ? __pfx_kthread+0x10/0x10
[164465.904549][ C12] ret_from_fork+0x50e/0x670
[164465.904555][ C12] ? __pfx_ret_from_fork+0x10/0x10
[164465.904560][ C12] ? __switch_to+0x42c/0xd70
[164465.904565][ C12] ? __pfx_kthread+0x10/0x10
[164465.904570][ C12] ret_from_fork_asm+0x1a/0x30
[164465.904582][ C12]
[164515.495757][ C0] BUG: workqueue lockup - pool cpus=0-15 flags=0x4 nice=0 stuck for 85s!
[164515.499167][ C0] Showing busy workqueues and worker pools:
[164515.501301][ C0] workqueue events_unbound: flags=0x2
[164515.502579][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=2 refcnt=3
[164515.502605][ C0] pending: toggle_allocation_gate, flush_memcg_stats_dwork
[164515.505814][ C0] workqueue events_unbound: flags=0x2
[164515.507059][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164515.507082][ C0] pending: crng_reseed
[164515.507123][ C0] workqueue kvfree_rcu_reclaim: flags=0xa
[164515.511082][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164515.511104][ C0] pending: kfree_rcu_monitor
[164515.511147][ C0] workqueue writeback: flags=0x4a
[164515.515016][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=4 refcnt=5
[164515.515036][ C0] in-flight: 3727760:wb_workfn
[164515.515061][ C0] pending: 3*wb_workfn
[164515.515160][ C0] workqueue ipv6_addrconf: flags=0x6000a
[164515.520291][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=19
[164515.520313][ C0] pending: addrconf_verify_work
[164515.520330][ C0] inactive: addrconf_verify_work
[164515.520367][ C0] workqueue xfs-blockgc/sdc3: flags=0xe
[164515.525585][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164515.525606][ C0] pending: xfs_blockgc_worker [xfs]
[164515.529856][ C0] workqueue xfs-sync/sdc3: flags=0x104
[164515.531106][ C0] pwq 62: cpus=15 node=0 flags=0x0 nice=0 active=1 refcnt=2
[164515.531128][ C0] in-flight: 3623436:xfs_log_worker [xfs]
[164515.535620][ C0] workqueue xfs-cil/sdc3: flags=0xe
[164515.536860][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164515.536883][ C0] pending: xlog_cil_push_work [xfs]
[164515.541202][ C0] workqueue xfs-sync/sde: flags=0x104
[164515.542517][ C0] pwq 58: cpus=14 node=0 flags=0x0 nice=0 active=1 refcnt=2
[164515.542542][ C0] in-flight: 3732215:xfs_log_worker [xfs]
[164515.547065][ C0] workqueue xfs-cil/sde: flags=0xe
[164515.548270][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164515.548293][ C0] pending: xlog_cil_push_work [xfs]
[164515.552585][ C0] pool 58: cpus=14 node=0 flags=0x0 nice=0 hung=0s workers=3 idle: 3644020 3712377
[164515.552626][ C0] pool 62: cpus=15 node=0 flags=0x0 nice=0 hung=0s workers=3 idle: 3727348 3706576
[164515.556810][ C0] pool 64: cpus=0-15 flags=0x4 nice=0 hung=85s workers=7 idle: 3667344 3645384 3691158 3661385 3578714 3713463
[164545.704750][ C0] BUG: workqueue lockup - pool cpus=0-15 flags=0x4 nice=0 stuck for 116s!
[164545.706787][ C0] Showing busy workqueues and worker pools:
[164545.708108][ C0] workqueue events_unbound: flags=0x2
[164545.709311][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=2 refcnt=3
[164545.709335][ C0] pending: toggle_allocation_gate, flush_memcg_stats_dwork
[164545.709382][ C0] workqueue events_unbound: flags=0x2
[164545.713977][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164545.713999][ C0] pending: crng_reseed
[164545.714039][ C0] workqueue kvfree_rcu_reclaim: flags=0xa
[164545.717969][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164545.717989][ C0] pending: kfree_rcu_monitor
[164545.718033][ C0] workqueue writeback: flags=0x4a
[164545.721826][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=4 refcnt=5
[164545.721846][ C0] in-flight: 3727760:wb_workfn
[164545.721869][ C0] pending: 3*wb_workfn
[164545.721965][ C0] workqueue ipv6_addrconf: flags=0x6000a
[164545.727049][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=20
[164545.727070][ C0] pending: addrconf_verify_work
[164545.727088][ C0] inactive: 2*addrconf_verify_work
[164545.727127][ C0] workqueue xfs-blockgc/sdc3: flags=0xe
[164545.732387][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164545.732407][ C0] pending: xfs_blockgc_worker [xfs]
[164545.736691][ C0] workqueue xfs-sync/sdc3: flags=0x104
[164545.737969][ C0] pwq 62: cpus=15 node=0 flags=0x0 nice=0 active=1 refcnt=2
[164545.737992][ C0] in-flight: 3623436:xfs_log_worker [xfs]
[164545.742479][ C0] workqueue xfs-cil/sdc3: flags=0xe
[164545.743637][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164545.743660][ C0] pending: xlog_cil_push_work [xfs]
[164545.748058][ C0] workqueue xfs-sync/sde: flags=0x104
[164545.749333][ C0] pwq 58: cpus=14 node=0 flags=0x0 nice=0 active=1 refcnt=2
[164545.749356][ C0] in-flight: 3732215:xfs_log_worker [xfs]
[164545.753841][ C0] workqueue xfs-cil/sde: flags=0xe
[164545.754986][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164545.755007][ C0] pending: xlog_cil_push_work [xfs]
[164545.759288][ C0] pool 58: cpus=14 node=0 flags=0x0 nice=0 hung=0s workers=3 idle: 3644020 3712377
[164545.759329][ C0] pool 62: cpus=15 node=0 flags=0x0 nice=0 hung=0s workers=3 idle: 3727348 3706576
[164545.759360][ C0] pool 64: cpus=0-15 flags=0x4 nice=0 hung=116s workers=7 idle: 3667344 3645384 3691158 3661385 3578714 3713463
[164575.912713][ C0] BUG: workqueue lockup - pool cpus=0-15 flags=0x4 nice=0 stuck for 146s!
[164575.913601][ C0] Showing busy workqueues and worker pools:
[164575.914149][ C0] workqueue events: flags=0x100
[164575.914633][ C0] pwq 42: cpus=10 node=0 flags=0x0 nice=0 active=2 refcnt=3
[164575.914645][ C0] in-flight: 3712027:netstamp_clear
[164575.914658][ C0] pending: psi_avgs_work
[164575.914674][ C0] workqueue events_unbound: flags=0x2
[164575.916842][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=2 refcnt=3
[164575.916852][ C0] pending: toggle_allocation_gate, flush_memcg_stats_dwork
[164575.916876][ C0] workqueue events_unbound: flags=0x2
[164575.918789][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164575.918798][ C0] pending: crng_reseed
[164575.918825][ C0] workqueue kvfree_rcu_reclaim: flags=0xa
[164575.920408][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164575.920417][ C0] pending: kfree_rcu_monitor
[164575.920448][ C0] workqueue writeback: flags=0x4a
[164575.922038][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=4 refcnt=5
[164575.922045][ C0] in-flight: 3727760:wb_workfn
[164575.922056][ C0] pending: 3*wb_workfn
[164575.922136][ C0] workqueue ipv6_addrconf: flags=0x6000a
[164575.924319][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=20
[164575.924329][ C0] pending: addrconf_verify_work
[164575.924337][ C0] inactive: 2*addrconf_verify_work
[164575.924365][ C0] workqueue xfs-blockgc/sdc3: flags=0xe
[164575.926540][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164575.926549][ C0] pending: xfs_blockgc_worker [xfs]
[164575.928422][ C0] workqueue xfs-sync/sdc3: flags=0x104
[164575.928914][ C0] pwq 62: cpus=15 node=0 flags=0x0 nice=0 active=1 refcnt=2
[164575.928925][ C0] in-flight: 3623436:xfs_log_worker [xfs]
[164575.929561][ C0] workqueue xfs-cil/sdc3: flags=0xe
[164575.931266][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164575.931277][ C0] pending: xlog_cil_push_work [xfs]
[164575.933154][ C0] workqueue xfs-sync/sde: flags=0x104
[164575.933653][ C0] pwq 58: cpus=14 node=0 flags=0x0 nice=0 active=1 refcnt=2
[164575.933664][ C0] in-flight: 3732215:xfs_log_worker [xfs]
[164575.935527][ C0] workqueue xfs-cil/sde: flags=0xe
[164575.935989][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164575.936000][ C0] pending: xlog_cil_push_work [xfs]
[164575.936652][ C0] pool 42: cpus=10 node=0 flags=0x0 nice=0 hung=13s workers=3 idle: 3726993 3662394
[164575.938713][ C0] pool 58: cpus=14 node=0 flags=0x0 nice=0 hung=0s workers=3 idle: 3644020 3712377
[164575.938731][ C0] pool 62: cpus=15 node=0 flags=0x0 nice=0 hung=0s workers=3 idle: 3727348 3706576
[164575.938746][ C0] pool 64: cpus=0-15 flags=0x4 nice=0 hung=146s workers=7 idle: 3667344 3645384 3691158 3661385 3578714 3713463
[164582.111906][ C10] watchdog: BUG: soft lockup - CPU#10 stuck for 23s! [kworker/10:3:3712027]
[164582.111915][ C10] CPU#10 Utilization every 4000ms during lockup:
[164582.111918][ C10] #1: 100% system, 0% softirq, 2% hardirq, 0% idle
[164582.111922][ C10] #2: 100% system, 0% softirq, 1% hardirq, 0% idle
[164582.111925][ C10] #3: 100% system, 0% softirq, 2% hardirq, 0% idle
[164582.111928][ C10] #4: 100% system, 0% softirq, 1% hardirq, 0% idle
[164582.111931][ C10] #5: 100% system, 0% softirq, 1% hardirq, 0% idle
[164582.111935][ C10] Modules linked in: iscsi_target_mod tcm_loop target_core_pscsi target_core_file target_core_iblock btrfs xor raid6_pq dm_flakey target_core_user target_core_mod rfkill nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nf_tables qrtr sunrpc intel_rapl_msr intel_rapl_common intel_uncore_frequency_common skx_edac_common nfit libnvdimm kvm_intel iTCO_wdt intel_pmc_bxt ppdev iTCO_vendor_support kvm irqbypass i2c_i801 parport_pc rapl i2c_smbus parport lpc_ich joydev fuse loop dm_multipath nfnetlink zram vsock_loopback lz4hc_compress lz4_compress vmw_vsock_virtio_transport_common zstd_compress vmw_vsock_vmci_transport vmw_vmci vsock xfs bochs drm_client_lib drm_shmem_helper drm_kms_helper virtio_net sym53c8xx net_failover ghash_clmulni_intel drm failover scsi_transport_spi serio_raw scsi_dh_rdac scsi_dh_emc scsi_dh_alua i2c_dev qemu_fw_cfg [last unloaded: scsi_debug]
[164582.112045][ C10] irq event stamp: 220528
[164582.112047][ C10] hardirqs last enabled at (220527): [] asm_sysvec_apic_timer_interrupt+0x1a/0x20
[164582.112057][ C10] hardirqs last disabled at (220528): [] sysvec_apic_timer_interrupt+0xe/0x90
[164582.112062][ C10] softirqs last enabled at (220404): [] handle_softirqs+0x522/0x7b0
[164582.112068][ C10] softirqs last disabled at (220399): [] __irq_exit_rcu+0x181/0x1d0
[164582.112075][ C10] CPU: 10 UID: 0 PID: 3712027 Comm: kworker/10:3 Not tainted 6.19.0-rc1-kts-xfs-zoned-fixes-gec6aea2a5+ #1 PREEMPT(lazy)
[164582.112081][ C10] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.17.0-5.fc42 04/01/2014
[164582.112084][ C10] Workqueue: events netstamp_clear
[164582.112090][ C10] RIP: 0010:smp_call_function_many_cond+0x888/0x1070
[164582.112096][ C10] Code: 08 84 c9 0f 85 6e 05 00 00 8b 43 08 a8 01 74 2e 48 89 f1 49 89 f6 48 c1 e9 03 41 83 e6 07 4c 01 f9 41 83 c6 03 f3 90 0f b6 01 <41> 38 c6 7c 08 84 c0 0f 85 db 04 00 00 8b 43 08 a8 01 75 e7 83 c2
[164582.112100][ C10] RSP: 0018:ffff888485a1f990 EFLAGS: 00000202
[164582.112104][ C10] RAX: 0000000000000000 RBX: ffffe8ffff082980 RCX: fffff91fffe10531
[164582.112107][ C10] RDX: 0000000000000005 RSI: ffffe8ffff082988 RDI: ffffffffa390b188
[164582.112109][ C10] RBP: ffffed1181a68d59 R08: ffff8881014fcd60 R09: 0000000000000000
[164582.112112][ C10] R10: 1ffff1102029f9ac R11: 0000000000000000 R12: ffff888c0d346ac0
[164582.112115][ C10] R13: ffffed1181a68d58 R14: 0000000000000003 R15: dffffc0000000000
[164582.112117][ C10] FS: 0000000000000000(0000) GS:ffff888c675b9000(0000) knlGS:0000000000000000
[164582.112121][ C10] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[164582.112123][ C10] CR2: 00007fb20918fa10 CR3: 00000007db69c004 CR4: 0000000000772ef0
[164582.112129][ C10] PKRU: 55555554
[164582.112131][ C10] Call Trace:
[164582.112134][ C10]
[164582.112140][ C10] ? __pfx_do_sync_core+0x10/0x10
[164582.112147][ C10] ? __text_poke+0x371/0x870
[164582.112157][ C10] ? __pfx_smp_call_function_many_cond+0x10/0x10
[164582.112160][ C10] ? __pfx___text_poke+0x10/0x10
[164582.112166][ C10] ? __pfx___might_resched+0x10/0x10
[164582.112175][ C10] on_each_cpu_cond_mask+0x24/0x40
[164582.112179][ C10] smp_text_poke_batch_finish+0x45c/0xd20
[164582.112184][ C10] ? tpacket_rcv+0xe19/0x3f40
[164582.112192][ C10] ? __pfx_smp_text_poke_batch_finish+0x10/0x10
[164582.112197][ C10] ? __jump_label_patch+0x25f/0x320
[164582.112207][ C10] ? arch_jump_label_transform_queue+0xa8/0x110
[164582.112218][ C10] arch_jump_label_transform_apply+0x1c/0x30
[164582.112224][ C10] static_key_enable_cpuslocked+0x16c/0x230
[164582.112230][ C10] static_key_enable+0x1f/0x30
[164582.112235][ C10] process_one_work+0x86b/0x1490
[164582.112251][ C10] ? __pfx_process_one_work+0x10/0x10
[164582.112256][ C10] ? lock_acquire.part.0+0xb8/0x230
[164582.112265][ C10] ? lock_is_held_type+0x9a/0x110
[164582.112272][ C10] ? assign_work+0x156/0x390
[164582.112280][ C10] worker_thread+0x5f2/0xfd0
[164582.112289][ C10] ? __pfx_worker_thread+0x10/0x10
[164582.112293][ C10] ? __kthread_parkme+0xb3/0x1f0
[164582.112302][ C10] ? __pfx_worker_thread+0x10/0x10
[164582.112306][ C10] kthread+0x3a4/0x760
[164582.112313][ C10] ? __pfx_kthread+0x10/0x10
[164582.112318][ C10] ? __lock_release.isra.0+0x59/0x170
[164582.112332][ C10] ? __pfx_kthread+0x10/0x10
[164582.112339][ C10] ret_from_fork+0x50e/0x670
[164582.112346][ C10] ? __pfx_ret_from_fork+0x10/0x10
[164582.112352][ C10] ? __switch_to+0x42c/0xd70
[164582.112359][ C10] ? __pfx_kthread+0x10/0x10
[164582.112365][ C10] ret_from_fork_asm+0x1a/0x30
[164582.112384][ C10]
[164606.120729][ C0] BUG: workqueue lockup - pool cpus=0-15 flags=0x4 nice=0 stuck for 176s!
[164606.121633][ C0] Showing busy workqueues and worker pools:
[164606.122170][ C0] workqueue events: flags=0x100
[164606.122663][ C0] pwq 42: cpus=10 node=0 flags=0x0 nice=0 active=2 refcnt=3
[164606.122674][ C0] in-flight: 3712027:netstamp_clear
[164606.122687][ C0] pending: psi_avgs_work
[164606.124344][ C0] workqueue events_unbound: flags=0x2
[164606.124838][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=2 refcnt=3
[164606.124848][ C0] pending: toggle_allocation_gate, flush_memcg_stats_dwork
[164606.124873][ C0] workqueue events_unbound: flags=0x2
[164606.126746][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164606.126755][ C0] pending: idle_cull_fn
[164606.126763][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164606.126770][ C0] pending: idle_cull_fn
[164606.126776][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164606.126783][ C0] pending: idle_cull_fn
[164606.126789][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164606.126796][ C0] pending: idle_cull_fn
[164606.126802][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164606.126809][ C0] pending: crng_reseed
[164606.126822][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164606.126829][ C0] pending: idle_cull_fn
[164606.126849][ C0] workqueue kvfree_rcu_reclaim: flags=0xa
[164606.133969][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164606.133978][ C0] pending: kfree_rcu_monitor
[164606.134010][ C0] workqueue writeback: flags=0x4a
[164606.135631][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=4 refcnt=5
[164606.135639][ C0] in-flight: 3727760:wb_workfn
[164606.135650][ C0] pending: 3*wb_workfn
[164606.137282][ C0] workqueue ipv6_addrconf: flags=0x6000a
[164606.137809][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=20
[164606.137819][ C0] pending: addrconf_verify_work
[164606.137827][ C0] inactive: 2*addrconf_verify_work
[164606.137852][ C0] workqueue xfs-blockgc/sdc3: flags=0xe
[164606.140035][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164606.140044][ C0] pending: xfs_blockgc_worker [xfs]
[164606.141941][ C0] workqueue xfs-sync/sdc3: flags=0x104
[164606.142486][ C0] pwq 62: cpus=15 node=0 flags=0x0 nice=0 active=1 refcnt=2
[164606.142496][ C0] in-flight: 3623436:xfs_log_worker [xfs]
[164606.144430][ C0] workqueue xfs-cil/sdc3: flags=0xe
[164606.144918][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164606.144928][ C0] pending: xlog_cil_push_work [xfs]
[164606.145650][ C0] workqueue xfs-sync/sde: flags=0x104
[164606.147518][ C0] pwq 58: cpus=14 node=0 flags=0x0 nice=0 active=1 refcnt=2
[164606.147549][ C0] in-flight: 3732215:xfs_log_worker [xfs]
[164606.150780][ C0] workqueue xfs-cil/sde: flags=0xe
[164606.151502][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164606.151519][ C0] pending: xlog_cil_push_work [xfs]
[164606.154116][ C0] pool 42: cpus=10 node=0 flags=0x0 nice=0 hung=43s workers=3 idle: 3726993 3662394
[164606.154153][ C0] pool 58: cpus=14 node=0 flags=0x0 nice=0 hung=0s workers=3 idle: 3644020 3712377
[164606.154174][ C0] pool 62: cpus=15 node=0 flags=0x0 nice=0 hung=0s workers=3 idle: 3727348 3706576
[164606.154193][ C0] pool 64: cpus=0-15 flags=0x4 nice=0 hung=176s workers=7 idle: 3667344 3645384 3691158 3661385 3578714 3713463
[164610.111910][ C10] watchdog: BUG: soft lockup - CPU#10 stuck for 49s! [kworker/10:3:3712027]
[164610.111916][ C10] CPU#10 Utilization every 4000ms during lockup:
[164610.111919][ C10] #1: 100% system, 0% softirq, 2% hardirq, 0% idle
[164610.111923][ C10] #2: 100% system, 0% softirq, 1% hardirq, 0% idle
[164610.111926][ C10] #3: 100% system, 0% softirq, 1% hardirq, 0% idle
[164610.111929][ C10] #4: 100% system, 0% softirq, 2% hardirq, 0% idle
[164610.111932][ C10] #5: 100% system, 0% softirq, 1% hardirq, 0% idle
[164610.111934][ C10] Modules linked in: iscsi_target_mod tcm_loop target_core_pscsi target_core_file target_core_iblock btrfs xor raid6_pq dm_flakey target_core_user target_core_mod rfkill nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nf_tables qrtr sunrpc intel_rapl_msr intel_rapl_common intel_uncore_frequency_common skx_edac_common nfit libnvdimm kvm_intel iTCO_wdt intel_pmc_bxt ppdev iTCO_vendor_support kvm irqbypass i2c_i801 parport_pc rapl i2c_smbus parport lpc_ich joydev fuse loop dm_multipath nfnetlink zram vsock_loopback lz4hc_compress lz4_compress vmw_vsock_virtio_transport_common zstd_compress vmw_vsock_vmci_transport vmw_vmci vsock xfs bochs drm_client_lib drm_shmem_helper drm_kms_helper virtio_net sym53c8xx net_failover ghash_clmulni_intel drm failover scsi_transport_spi serio_raw scsi_dh_rdac scsi_dh_emc scsi_dh_alua i2c_dev qemu_fw_cfg [last unloaded: scsi_debug]
[164610.112037][ C10] irq event stamp: 279272
[164610.112039][ C10] hardirqs last enabled at (279271): [] asm_sysvec_apic_timer_interrupt+0x1a/0x20
[164610.112049][ C10] hardirqs last disabled at (279272): [] sysvec_apic_timer_interrupt+0xe/0x90
[164610.112055][ C10] softirqs last enabled at (279170): [] handle_softirqs+0x522/0x7b0
[164610.112060][ C10] softirqs last disabled at (279165): [] __irq_exit_rcu+0x181/0x1d0
[164610.112068][ C10] CPU: 10 UID: 0 PID: 3712027 Comm: kworker/10:3 Tainted: G L 6.19.0-rc1-kts-xfs-zoned-fixes-gec6aea2a5+ #1 PREEMPT(lazy)
[164610.112075][ C10] Tainted: [L]=SOFTLOCKUP
[164610.112077][ C10] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.17.0-5.fc42 04/01/2014
[164610.112080][ C10] Workqueue: events netstamp_clear
[164610.112087][ C10] RIP: 0010:smp_call_function_many_cond+0x888/0x1070
[164610.112092][ C10] Code: 08 84 c9 0f 85 6e 05 00 00 8b 43 08 a8 01 74 2e 48 89 f1 49 89 f6 48 c1 e9 03 41 83 e6 07 4c 01 f9 41 83 c6 03 f3 90 0f b6 01 <41> 38 c6 7c 08 84 c0 0f 85 db 04 00 00 8b 43 08 a8 01 75 e7 83 c2
[164610.112097][ C10] RSP: 0018:ffff888485a1f990 EFLAGS: 00000202
[164610.112100][ C10] RAX: 0000000000000000 RBX: ffffe8ffff082980 RCX: fffff91fffe10531
[164610.112104][ C10] RDX: 0000000000000005 RSI: ffffe8ffff082988 RDI: ffffffffa390b188
[164610.112106][ C10] RBP: ffffed1181a68d59 R08: ffff8881014fcd60 R09: 0000000000000000
[164610.112109][ C10] R10: 1ffff1102029f9ac R11: 0000000000000000 R12: ffff888c0d346ac0
[164610.112112][ C10] R13: ffffed1181a68d58 R14: 0000000000000003 R15: dffffc0000000000
[164610.112114][ C10] FS: 0000000000000000(0000) GS:ffff888c675b9000(0000) knlGS:0000000000000000
[164610.112118][ C10] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[164610.112120][ C10] CR2: 00007fb20918fa10 CR3: 00000007db69c004 CR4: 0000000000772ef0
[164610.112126][ C10] PKRU: 55555554
[164610.112128][ C10] Call Trace:
[164610.112131][ C10]
[164610.112137][ C10] ? __pfx_do_sync_core+0x10/0x10
[164610.112144][ C10] ? __text_poke+0x371/0x870
[164610.112154][ C10] ? __pfx_smp_call_function_many_cond+0x10/0x10
[164610.112158][ C10] ? __pfx___text_poke+0x10/0x10
[164610.112164][ C10] ? __pfx___might_resched+0x10/0x10
[164610.112173][ C10] on_each_cpu_cond_mask+0x24/0x40
[164610.112177][ C10] smp_text_poke_batch_finish+0x45c/0xd20
[164610.112181][ C10] ? tpacket_rcv+0xe19/0x3f40
[164610.112190][ C10] ? __pfx_smp_text_poke_batch_finish+0x10/0x10
[164610.112195][ C10] ? __jump_label_patch+0x25f/0x320
[164610.112205][ C10] ? arch_jump_label_transform_queue+0xa8/0x110
[164610.112216][ C10] arch_jump_label_transform_apply+0x1c/0x30
[164610.112221][ C10] static_key_enable_cpuslocked+0x16c/0x230
[164610.112228][ C10] static_key_enable+0x1f/0x30
[164610.112232][ C10] process_one_work+0x86b/0x1490
[164610.112248][ C10] ? __pfx_process_one_work+0x10/0x10
[164610.112253][ C10] ? lock_acquire.part.0+0xb8/0x230
[164610.112262][ C10] ? lock_is_held_type+0x9a/0x110
[164610.112270][ C10] ? assign_work+0x156/0x390
[164610.112277][ C10] worker_thread+0x5f2/0xfd0
[164610.112286][ C10] ? __pfx_worker_thread+0x10/0x10
[164610.112291][ C10] ? __kthread_parkme+0xb3/0x1f0
[164610.112299][ C10] ? __pfx_worker_thread+0x10/0x10
[164610.112303][ C10] kthread+0x3a4/0x760
[164610.112310][ C10] ? __pfx_kthread+0x10/0x10
[164610.112315][ C10] ? __lock_release.isra.0+0x59/0x170
[164610.112323][ C10] ? __pfx_kthread+0x10/0x10
[164610.112329][ C10] ret_from_fork+0x50e/0x670
[164610.112335][ C10] ? __pfx_ret_from_fork+0x10/0x10
[164610.112342][ C10] ? __switch_to+0x42c/0xd70
[164610.112349][ C10] ? __pfx_kthread+0x10/0x10
[164610.112355][ C10] ret_from_fork_asm+0x1a/0x30
[164610.112374][ C10]
[164636.327795][ C0] BUG: workqueue lockup - pool cpus=0-15 flags=0x4 nice=0 stuck for 206s!
[164636.329851][ C0] Showing busy workqueues and worker pools:
[164636.331184][ C0] workqueue events: flags=0x100
[164636.332312][ C0] pwq 42: cpus=10 node=0 flags=0x0 nice=0 active=2 refcnt=3
[164636.332338][ C0] in-flight: 3712027:netstamp_clear
[164636.332363][ C0] pending: psi_avgs_work
[164636.332390][ C0] workqueue events_unbound: flags=0x2
[164636.337543][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=2 refcnt=3
[164636.337567][ C0] pending: toggle_allocation_gate, flush_memcg_stats_dwork
[164636.337611][ C0] workqueue events_unbound: flags=0x2
[164636.342083][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164636.342107][ C0] pending: idle_cull_fn
[164636.342125][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=2 refcnt=3
[164636.342141][ C0] pending: 2*idle_cull_fn
[164636.342155][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164636.342170][ C0] pending: idle_cull_fn
[164636.342182][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164636.342197][ C0] pending: idle_cull_fn
[164636.342209][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164636.342223][ C0] pending: crng_reseed
[164636.342243][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164636.342258][ C0] pending: idle_cull_fn
[164636.342285][ C0] workqueue kvfree_rcu_reclaim: flags=0xa
[164636.359392][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164636.359414][ C0] pending: kfree_rcu_monitor
[164636.359479][ C0] workqueue writeback: flags=0x4a
[164636.363221][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=4 refcnt=5
[164636.363241][ C0] in-flight: 3727760:wb_workfn
[164636.363265][ C0] pending: 3*wb_workfn
[164636.363365][ C0] workqueue ipv6_addrconf: flags=0x6000a
[164636.368365][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=20
[164636.368387][ C0] pending: addrconf_verify_work
[164636.368404][ C0] inactive: 2*addrconf_verify_work
[164636.368459][ C0] workqueue xfs-blockgc/sdc3: flags=0xe
[164636.374143][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164636.374164][ C0] pending: xfs_blockgc_worker [xfs]
[164636.378468][ C0] workqueue xfs-sync/sdc3: flags=0x104
[164636.379684][ C0] pwq 62: cpus=15 node=0 flags=0x0 nice=0 active=1 refcnt=2
[164636.379718][ C0] in-flight: 3623436:xfs_log_worker [xfs]
[164636.384175][ C0] workqueue xfs-cil/sdc3: flags=0xe
[164636.385389][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164636.385411][ C0] pending: xlog_cil_push_work [xfs]
[164636.389691][ C0] workqueue xfs-sync/sde: flags=0x104
[164636.390947][ C0] pwq 58: cpus=14 node=0 flags=0x0 nice=0 active=1 refcnt=2
[164636.390970][ C0] in-flight: 3732215:xfs_log_worker [xfs]
[164636.395191][ C0] workqueue xfs-cil/sde: flags=0xe
[164636.396274][ C0] pwq 64: cpus=0-15 flags=0x4 nice=0 active=1 refcnt=2
[164636.396295][ C0] pending: xlog_cil_push_work [xfs]
[164636.400174][ C0] pool 42: cpus=10 node=0 flags=0x0 nice=0 hung=73s workers=3 idle: 3726993 3662394
[164636.400223][ C0] pool 58: cpus=14 node=0 flags=0x0 nice=0 hung=0s workers=3 idle: 3644020 3712377
[164636.400253][ C0] pool 62: cpus=15 node=0 flags=0x0 nice=0 hung=0s workers=3 idle: 3727348 3706576
[164636.400280][ C0] pool 64: cpus=0-15 flags=0x4 nice=0 hung=206s workers=7 idle: 3667344 3645384 3691158 3661385 3578714 3713463
[164638.111923][ C10] watchdog: BUG: soft lockup - CPU#10 stuck for 75s! [kworker/10:3:3712027]
[164638.111929][ C10] CPU#10 Utilization every 4000ms during lockup:
[164638.111932][ C10] #1: 100% system, 0% softirq, 1% hardirq, 0% idle
[164638.111936][ C10] #2: 100% system, 0% softirq, 1% hardirq, 0% idle
[164638.111939][ C10] #3: 100% system, 0% softirq, 1% hardirq, 0% idle
[164638.111941][ C10] #4: 100% system, 0% softirq, 1% hardirq, 0% idle
[164638.111944][ C10] #5: 100% system, 0% softirq, 1% hardirq, 0% idle
[164638.111947][ C10] Modules linked in: iscsi_target_mod tcm_loop target_core_pscsi target_core_file target_core_iblock btrfs xor raid6_pq dm_flakey target_core_user target_core_mod rfkill nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nf_tables qrtr sunrpc intel_rapl_msr intel_rapl_common intel_uncore_frequency_common skx_edac_common nfit libnvdimm kvm_intel iTCO_wdt intel_pmc_bxt ppdev iTCO_vendor_support kvm irqbypass i2c_i801 parport_pc rapl i2c_smbus parport lpc_ich joydev fuse loop dm_multipath nfnetlink zram vsock_loopback lz4hc_compress lz4_compress vmw_vsock_virtio_transport_common zstd_compress vmw_vsock_vmci_transport vmw_vmci vsock xfs bochs drm_client_lib drm_shmem_helper drm_kms_helper virtio_net sym53c8xx net_failover ghash_clmulni_intel drm failover scsi_transport_spi serio_raw scsi_dh_rdac scsi_dh_emc scsi_dh_alua i2c_dev qemu_fw_cfg [last unloaded: scsi_debug]
[164638.112050][ C10] irq event stamp: 338004
[164638.112052][ C10] hardirqs last enabled at (338003): [] asm_sysvec_apic_timer_interrupt+0x1a/0x20
[164638.112061][ C10] hardirqs last disabled at (338004): [] sysvec_apic_timer_interrupt+0xe/0x90
[164638.112066][ C10] softirqs last enabled at (337902): [] handle_softirqs+0x522/0x7b0
[164638.112071][ C10] softirqs last disabled at (337897): [] __irq_exit_rcu+0x181/0x1d0
[164638.112079][ C10] CPU: 10 UID: 0 PID: 3712027 Comm: kworker/10:3 Tainted: G L 6.19.0-rc1-kts-xfs-zoned-fixes-gec6aea2a5+ #1 PREEMPT(lazy)
[164638.112086][ C10] Tainted: [L]=SOFTLOCKUP
[164638.112088][ C10] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.17.0-5.fc42 04/01/2014
[164638.112091][ C10] Workqueue: events netstamp_clear
[164638.112097][ C10] RIP: 0010:smp_call_function_many_cond+0x885/0x1070
[164638.112103][ C10] Code: 38 c8 7c 08 84 c9 0f 85 6e 05 00 00 8b 43 08 a8 01 74 2e 48 89 f1 49 89 f6 48 c1 e9 03 41 83 e6 07 4c 01 f9 41 83 c6 03 f3 90 <0f> b6 01 41 38 c6 7c 08 84 c0 0f 85 db 04 00 00 8b 43 08 a8 01 75
[164638.112107][ C10] RSP: 0018:ffff888485a1f990 EFLAGS: 00000202
[164638.112111][ C10] RAX: 0000000000000011 RBX: ffffe8ffff082980 RCX: fffff91fffe10531
[164638.112114][ C10] RDX: 0000000000000005 RSI: ffffe8ffff082988 RDI: ffffffffa390b188
[164638.112117][ C10] RBP: ffffed1181a68d59 R08: ffff8881014fcd60 R09: 0000000000000000
[164638.112119][ C10] R10: 1ffff1102029f9ac R11: 0000000000000000 R12: ffff888c0d346ac0
[164638.112122][ C10] R13: ffffed1181a68d58 R14: 0000000000000003 R15: dffffc0000000000
[164638.112125][ C10] FS: 0000000000000000(0000) GS:ffff888c675b9000(0000) knlGS:0000000000000000
[164638.112128][ C10] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[164638.112131][ C10] CR2: 00007fb20918fa10 CR3: 00000007db69c004 CR4: 0000000000772ef0
[164638.112136][ C10] PKRU: 55555554
[164638.112138][ C10] Call Trace:
[164638.112140][ C10]
[164638.112147][ C10] ? __pfx_do_sync_core+0x10/0x10
[164638.112155][ C10] ? __text_poke+0x371/0x870
[164638.112164][ C10] ? __pfx_smp_call_function_many_cond+0x10/0x10
[164638.112168][ C10] ? __pfx___text_poke+0x10/0x10
[164638.112174][ C10] ? __pfx___might_resched+0x10/0x10
[164638.112183][ C10] on_each_cpu_cond_mask+0x24/0x40
[164638.112187][ C10] smp_text_poke_batch_finish+0x45c/0xd20
[164638.112191][ C10] ? tpacket_rcv+0xe19/0x3f40
[164638.112200][ C10] ? __pfx_smp_text_poke_batch_finish+0x10/0x10
[164638.112204][ C10] ? __jump_label_patch+0x25f/0x320
[164638.112214][ C10] ? arch_jump_label_transform_queue+0xa8/0x110
[164638.112226][ C10] arch_jump_label_transform_apply+0x1c/0x30
[164638.112231][ C10] static_key_enable_cpuslocked+0x16c/0x230
[164638.112237][ C10] static_key_enable+0x1f/0x30
[164638.112242][ C10] process_one_work+0x86b/0x1490
[164638.112258][ C10] ? __pfx_process_one_work+0x10/0x10
[164638.112262][ C10] ? lock_acquire.part.0+0xb8/0x230
[164638.112272][ C10] ? lock_is_held_type+0x9a/0x110
[164638.112279][ C10] ? assign_work+0x156/0x390
[164638.112287][ C10] worker_thread+0x5f2/0xfd0
[164638.112296][ C10] ? __pfx_worker_thread+0x10/0x10
[164638.112300][ C10] ? __kthread_parkme+0xb3/0x1f0
[164638.112309][ C10] ? __pfx_worker_thread+0x10/0x10
[164638.112313][ C10] kthread+0x3a4/0x760
[164638.112319][ C10] ? __pfx_kthread+0x10/0x10
[164638.112325][ C10] ? __lock_release.isra.0+0x59/0x170
[164638.112332][ C10] ? __pfx_kthread+0x10/0x10
[164638.112338][ C10] ret_from_fork+0x50e/0x670
[164638.112345][ C10] ? __pfx_ret_from_fork+0x10/0x10
[164638.112352][ C10] ? __switch_to+0x42c/0xd70
[164638.112359][ C10] ? __pfx_kthread+0x10/0x10
[164638.112364][ C10] ret_from_fork_asm+0x1a/0x30
[164638.112384][ C10]
[164658.343906][ T118] INFO: task journal-offline:3732216 blocked for more than 122 seconds.
[164658.346054][ T118] Tainted: G L 6.19.0-rc1-kts-xfs-zoned-fixes-gec6aea2a5+ #1
[164658.348445][ T118] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[164658.350963][ T118] task:journal-offline state:D stack:0 pid:3732216 tgid:634 ppid:1 task_flags:0x400040 flags:0x00080000
[164658.353753][ T118] Call Trace:
[164658.354591][ T118]
[164658.355381][ T118] __schedule+0x841/0x12a0
[164658.356569][ T118] ? __pfx___schedule+0x10/0x10
[164658.357790][ T118] ? find_held_lock+0x2b/0x80
[164658.358994][ T118] ? __lock_release.isra.0+0x59/0x170
[164658.360361][ T118] ? lock_acquire+0xf6/0x130
[164658.361569][ T118] schedule+0xd1/0x250
[164658.362594][ T118] io_schedule+0x8c/0x100
[164658.363641][ T118] blk_mq_get_tag+0x496/0xb00
[164658.364796][ T118] ? __pfx_blk_mq_get_tag+0x10/0x10
[164658.366069][ T118] ? __pfx_autoremove_wake_function+0x10/0x10
[164658.367635][ T118] ? lock_release.part.0+0x1c/0x50
[164658.368893][ T118] ? bfq_limit_depth+0x22e/0x950
[164658.370085][ T118] __blk_mq_alloc_requests+0x293/0xcf0
[164658.371505][ T118] blk_mq_submit_bio+0x8f3/0x2490
[164658.372817][ T118] ? __pfx_blk_mq_submit_bio+0x10/0x10
[164658.374168][ T118] __submit_bio+0x362/0x700
[164658.375301][ T118] ? __pfx___submit_bio+0x10/0x10
[164658.376545][ T118] ? __pfx_blk_cgroup_bio_start+0x10/0x10
[164658.377948][ T118] ? submit_bio_noacct_nocheck+0x3cc/0x5a0
[164658.379367][ T118] submit_bio_noacct_nocheck+0x3cc/0x5a0
[164658.380687][ T118] ? __pfx_submit_bio_noacct_nocheck+0x10/0x10
[164658.382155][ T118] ? submit_bio_noacct+0x248/0xf60
[164658.383483][ T118] iomap_ioend_writeback_submit+0xfa/0x180
[164658.384918][ T118] iomap_add_to_ioend+0x44f/0x1110
[164658.386189][ T118] xfs_writeback_range+0x5d/0x90 [xfs]
[164658.389042][ T118] iomap_writeback_folio+0x721/0xfe0
[164658.390393][ T118] ? __pfx_iomap_writeback_folio+0x10/0x10
[164658.391860][ T118] iomap_writepages+0x119/0x270
[164658.393058][ T118] ? __pfx_iomap_writepages+0x10/0x10
[164658.394472][ T118] ? __lock_release.isra.0+0x59/0x170
[164658.395824][ T118] ? lock_acquire+0xf6/0x130
[164658.397005][ T118] xfs_vm_writepages+0x1a2/0x2c0 [xfs]
[164658.399688][ T118] ? __pfx_xfs_vm_writepages+0x10/0x10 [xfs]
[164658.402533][ T118] ? lock_acquire.part.0+0xb8/0x230
[164658.403707][ T118] do_writepages+0x21e/0x560
[164658.404931][ T118] ? __pfx_do_writepages+0x10/0x10
[164658.406162][ T118] ? lock_release.part.0+0x1c/0x50
[164658.407573][ T118] ? _raw_spin_unlock+0x23/0x40
[164658.408855][ T118] ? wbc_attach_and_unlock_inode.part.0+0x388/0x730
[164658.410318][ T118] filemap_writeback+0x1c4/0x280
[164658.411478][ T118] ? __pfx_filemap_writeback+0x10/0x10
[164658.412858][ T118] ? lock_acquire.part.0+0xb8/0x230
[164658.414038][ T118] ? __fget_files+0x31/0x2f0
[164658.415077][ T118] file_write_and_wait_range+0x97/0x150
[164658.416407][ T118] xfs_file_fsync+0x121/0x800 [xfs]
[164658.419063][ T118] ? __pfx_xfs_file_fsync+0x10/0x10 [xfs]
[164658.421845][ T118] do_fsync+0x3b/0x80
[164658.422770][ T118] ? syscall_trace_enter+0x8e/0x2b0
[164658.423943][ T118] __x64_sys_fsync+0x35/0x50
[164658.425031][ T118] do_syscall_64+0x98/0x5c0
[164658.426076][ T118] ? lock_acquire.part.0+0xb8/0x230
[164658.427274][ T118] ? find_held_lock+0x2b/0x80
[164658.428439][ T118] ? __lock_release.isra.0+0x59/0x170
[164658.429775][ T118] ? lock_acquire+0xf6/0x130
[164658.430969][ T118] ? lockdep_hardirqs_on_prepare.part.0+0x9b/0x140
[164658.432670][ T118] ? trace_hardirqs_on+0x18/0x140
[164658.433928][ T118] ? _raw_spin_unlock_irq+0x28/0x50
[164658.435111][ T118] ? __x64_sys_rt_sigprocmask+0x241/0x400
[164658.436482][ T118] ? __pfx___x64_sys_rt_sigprocmask+0x10/0x10
[164658.437867][ T118] ? switch_fpu_return+0x111/0x240
[164658.439032][ T118] ? trace_hardirqs_on_prepare+0x101/0x140
[164658.440333][ T118] ? do_syscall_64+0x16d/0x5c0
[164658.441425][ T118] ? __switch_to+0x42c/0xd70
[164658.442509][ T118] ? clear_bhb_loop+0x50/0xa0
[164658.443602][ T118] ? clear_bhb_loop+0x50/0xa0
[164658.444683][ T118] entry_SYSCALL_64_after_hwframe+0x76/0x7e
[164658.446017][ T118] RIP: 0033:0x7fb20a689422
[164658.447014][ T118] RSP: 002b:00007fb2031fe958 EFLAGS: 00000246 ORIG_RAX: 000000000000004a
[164658.448865][ T118] RAX: ffffffffffffffda RBX: 000055a0fe937de0 RCX: 00007fb20a689422
[164658.450641][ T118] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000018
[164658.452542][ T118] RBP: 00007fb2031fe980 R08: 0000000000000000 R09: 0000000000000000
[164658.454549][ T118] R10: 0000000000000000 R11: 0000000000000246 R12: 00007fb20abb6294
[164658.456308][ T118] R13: 00007ffd5e7997b0 R14: 00007fb2031ffcdc R15: 00007ffd5e7998b7
[164658.458113][ T118]
[164658.458960][ T118] INFO: task kworker/15:2:3623436 blocked for more than 122 seconds.
[164658.460754][ T118] Tainted: G L 6.19.0-rc1-kts-xfs-zoned-fixes-gec6aea2a5+ #1
[164658.462842][ T118] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[164658.464578][ T118] task:kworker/15:2 state:D stack:0 pid:3623436 tgid:3623436 ppid:2 task_flags:0x4208060 flags:0x00080000
[164658.467029][ T118] Workqueue: xfs-sync/sdc3 xfs_log_worker [xfs]
[164658.469625][ T118] Call Trace:
[164658.470298][ T118]
[164658.470954][ T118] __schedule+0x841/0x12a0
[164658.471923][ T118] ? __pfx___schedule+0x10/0x10
[164658.472939][ T118] ? find_held_lock+0x2b/0x80
[164658.473931][ T118] ? __lock_release.isra.0+0x59/0x170
[164658.475065][ T118] schedule+0xd1/0x250
[164658.475993][ T118] schedule_timeout+0x17b/0x260
[164658.477066][ T118] ? __pfx_schedule_timeout+0x10/0x10
[164658.478239][ T118] ? mark_held_locks+0x40/0x70
[164658.479298][ T118] ? lockdep_hardirqs_on_prepare.part.0+0x9b/0x140
[164658.480583][ T118] wait_for_completion+0x173/0x3c0
[164658.481619][ T118] ? __pfx_wait_for_completion+0x10/0x10
[164658.482695][ T118] ? lockdep_hardirqs_on_prepare.part.0+0x9b/0x140
[164658.483957][ T118] ? flush_workqueue_prep_pwqs+0x337/0x460
[164658.485043][ T118] __flush_workqueue+0x36d/0x1090
[164658.486005][ T118] ? __pfx_try_to_wake_up+0x10/0x10
[164658.486984][ T118] ? find_held_lock+0x2b/0x80
[164658.487911][ T118] ? find_held_lock+0x2b/0x80
[164658.488821][ T118] ? __pfx___flush_workqueue+0x10/0x10
[164658.489898][ T118] ? find_held_lock+0x2b/0x80
[164658.490769][ T118] xlog_cil_push_now.isra.0+0x4c/0x1a0 [xfs]
[164658.492891][ T118] xlog_cil_force_seq+0x17b/0x800 [xfs]
[164658.494979][ T118] ? __pfx_xlog_cil_force_seq+0x10/0x10 [xfs]
[164658.497115][ T118] ? lock_acquire.part.0+0xb8/0x230
[164658.498021][ T118] ? find_held_lock+0x2b/0x80
[164658.498859][ T118] ? __lock_release.isra.0+0x59/0x170
[164658.499784][ T118] ? lock_acquire+0xf6/0x130
[164658.500525][ T118] ? xfs_log_worker+0x8a/0x2e0 [xfs]
[164658.502408][ T118] xfs_log_force+0x20d/0xa70 [xfs]
[164658.504233][ T118] xfs_log_worker+0x8a/0x2e0 [xfs]
[164658.506107][ T118] process_one_work+0x86b/0x1490
[164658.506931][ T118] ? __pfx_process_one_work+0x10/0x10
[164658.507782][ T118] ? lock_acquire.part.0+0xb8/0x230
[164658.508587][ T118] ? lock_is_held_type+0x9a/0x110
[164658.509409][ T118] ? assign_work+0x156/0x390
[164658.510143][ T118] worker_thread+0x5f2/0xfd0
[164658.510909][ T118] ? __pfx_worker_thread+0x10/0x10
[164658.511699][ T118] ? __kthread_parkme+0xb3/0x1f0
[164658.512485][ T118] ? __pfx_worker_thread+0x10/0x10
[164658.513230][ T118] kthread+0x3a4/0x760
[164658.513913][ T118] ? __pfx_kthread+0x10/0x10
[164658.514617][ T118] ? __lock_release.isra.0+0x59/0x170
[164658.515486][ T118] ? __pfx_kthread+0x10/0x10
[164658.516227][ T118] ret_from_fork+0x50e/0x670
[164658.517031][ T118] ? __pfx_ret_from_fork+0x10/0x10
[164658.517876][ T118] ? __switch_to+0x42c/0xd70
[164658.518578][ T118] ? __pfx_kthread+0x10/0x10
[164658.519259][ T118] ret_from_fork_asm+0x1a/0x30
[164658.520054][ T118]
[164658.520576][ T118] INFO: task kworker/u64:2:3727760 blocked for more than 123 seconds.
[164658.521795][ T118] Tainted: G L 6.19.0-rc1-kts-xfs-zoned-fixes-gec6aea2a5+ #1
[164658.523099][ T118] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[164658.524242][ T118] task:kworker/u64:2 state:D stack:0 pid:3727760 tgid:3727760 ppid:2 task_flags:0x4208060 flags:0x00080000
[164658.525916][ T118] Workqueue: writeback wb_workfn (flush-8:32)
[164658.526787][ T118] Call Trace:
[164658.527218][ T118]
[164658.527668][ T118] __schedule+0x841/0x12a0
[164658.528268][ T118] ? __pfx___schedule+0x10/0x10
[164658.528984][ T118] ? find_held_lock+0x2b/0x80
[164658.529628][ T118] ? __lock_release.isra.0+0x59/0x170
[164658.530373][ T118] ? lock_acquire+0xf6/0x130
[164658.531030][ T118] schedule+0xd1/0x250
[164658.531588][ T118] io_schedule+0x8c/0x100
[164658.532178][ T118] blk_mq_get_tag+0x496/0xb00
[164658.532847][ T118] ? __pfx_blk_mq_get_tag+0x10/0x10
[164658.533511][ T118] ? __pfx_autoremove_wake_function+0x10/0x10
[164658.534270][ T118] ? lock_release.part.0+0x1c/0x50
[164658.534968][ T118] ? bfq_limit_depth+0x22e/0x950
[164658.535621][ T118] __blk_mq_alloc_requests+0x293/0xcf0
[164658.536304][ T118] blk_mq_submit_bio+0x8f3/0x2490
[164658.536955][ T118] ? __pfx_blk_mq_submit_bio+0x10/0x10
[164658.537681][ T118] __submit_bio+0x362/0x700
[164658.538270][ T118] ? __pfx___submit_bio+0x10/0x10
[164658.538941][ T118] ? __pfx_page_vma_mkclean_one.constprop.0+0x10/0x10
[164658.539811][ T118] ? __pfx_blk_cgroup_bio_start+0x10/0x10
[164658.540527][ T118] ? submit_bio_noacct_nocheck+0x3cc/0x5a0
[164658.541256][ T118] submit_bio_noacct_nocheck+0x3cc/0x5a0
[164658.542019][ T118] ? __pfx_submit_bio_noacct_nocheck+0x10/0x10
[164658.542873][ T118] ? submit_bio_noacct+0x248/0xf60
[164658.543580][ T118] iomap_ioend_writeback_submit+0xfa/0x180
[164658.544373][ T118] iomap_add_to_ioend+0x44f/0x1110
[164658.545030][ T118] xfs_writeback_range+0x5d/0x90 [xfs]
[164658.546504][ T118] iomap_writeback_folio+0x721/0xfe0
[164658.547189][ T118] ? __pfx_iomap_writeback_folio+0x10/0x10
[164658.547975][ T118] iomap_writepages+0x119/0x270
[164658.548590][ T118] ? __pfx_iomap_writepages+0x10/0x10
[164658.549244][ T118] ? __lock_release.isra.0+0x59/0x170
[164658.549960][ T118] ? lock_acquire+0xf6/0x130
[164658.550508][ T118] xfs_vm_writepages+0x1a2/0x2c0 [xfs]
[164658.551923][ T118] ? __pfx_xfs_vm_writepages+0x10/0x10 [xfs]
[164658.553335][ T118] ? __lock_release.isra.0+0x59/0x170
[164658.553960][ T118] ? lock_acquire+0xf6/0x130
[164658.554509][ T118] do_writepages+0x21e/0x560
[164658.555045][ T118] ? __pfx_do_writepages+0x10/0x10
[164658.555676][ T118] __writeback_single_inode+0x119/0xc70
[164658.556316][ T118] ? __pfx___writeback_single_inode+0x10/0x10
[164658.557013][ T118] ? lock_release.part.0+0x1c/0x50
[164658.557590][ T118] ? _raw_spin_unlock+0x23/0x40
[164658.558102][ T118] ? wbc_attach_and_unlock_inode.part.0+0x388/0x730
[164658.558831][ T118] writeback_sb_inodes+0x67a/0x10a0
[164658.559399][ T118] ? __pfx_writeback_sb_inodes+0x10/0x10
[164658.560000][ T118] ? __pfx_do_raw_spin_lock+0x10/0x10
[164658.560606][ T118] ? do_raw_spin_lock+0x128/0x270
[164658.561183][ T118] __writeback_inodes_wb+0xf2/0x270
[164658.561788][ T118] ? __pfx___writeback_inodes_wb+0x10/0x10
[164658.562440][ T118] ? queue_io+0x2ab/0x4a0
[164658.562921][ T118] wb_writeback+0x5af/0x7d0
[164658.563423][ T118] ? __pfx_wb_writeback+0x10/0x10
[164658.563982][ T118] ? get_nr_dirty_inodes+0xd8/0x1d0
[164658.564602][ T118] ? lockdep_hardirqs_on_prepare.part.0+0x9b/0x140
[164658.565373][ T118] wb_do_writeback+0x51c/0x7b0
[164658.565923][ T118] ? __pfx_wb_do_writeback+0x10/0x10
[164658.566527][ T118] ? lock_acquire.part.0+0xb8/0x230
[164658.567094][ T118] ? process_one_work+0x7e7/0x1490
[164658.567675][ T118] wb_workfn+0x9f/0x3d0
[164658.568137][ T118] process_one_work+0x86b/0x1490
[164658.568702][ T118] ? __pfx_process_one_work+0x10/0x10
[164658.569254][ T118] ? lock_acquire.part.0+0xb8/0x230
[164658.569829][ T118] ? lock_is_held_type+0x9a/0x110
[164658.570342][ T118] ? assign_work+0x156/0x390
[164658.570827][ T118] worker_thread+0x5f2/0xfd0
[164658.571271][ T118] ? __pfx_worker_thread+0x10/0x10
[164658.571824][ T118] ? __kthread_parkme+0xb3/0x1f0
[164658.572295][ T118] ? __pfx_worker_thread+0x10/0x10
[164658.572836][ T118] kthread+0x3a4/0x760
[164658.573227][ T118] ? __pfx_kthread+0x10/0x10
[164658.573699][ T118] ? __lock_release.isra.0+0x59/0x170
[164658.574223][ T118] ? __pfx_kthread+0x10/0x10
[164658.574741][ T118] ret_from_fork+0x50e/0x670
[164658.575177][ T118] ? __pfx_ret_from_fork+0x10/0x10
[164658.575746][ T118] ? __switch_to+0x42c/0xd70
[164658.576205][ T118] ? __pfx_kthread+0x10/0x10
[164658.576694][ T118] ret_from_fork_asm+0x1a/0x30
[164658.577208][ T118]
[164658.577574][ T118] INFO: task kworker/14:0:3732215 blocked for more than 123 seconds.
[164658.578379][ T118] Tainted: G L 6.19.0-rc1-kts-xfs-zoned-fixes-gec6aea2a5+ #1
[164658.579301][ T118] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[164658.580169][ T118] task:kworker/14:0 state:D stack:0 pid:3732215 tgid:3732215 ppid:2 task_flags:0x4208060 flags:0x00080000
[164658.581410][ T118] Workqueue: xfs-sync/sde xfs_log_worker [xfs]
[164658.582684][ T118] Call Trace:
[164658.583023][ T118]
[164658.583341][ T118] __schedule+0x841/0x12a0
[164658.583798][ T118] ? __pfx___schedule+0x10/0x10
[164658.584241][ T118] ? find_held_lock+0x2b/0x80
[164658.584772][ T118] ? __lock_release.isra.0+0x59/0x170
[164658.585266][ T118] schedule+0xd1/0x250
[164658.585690][ T118] schedule_timeout+0x17b/0x260
[164658.586187][ T118] ? __pfx_schedule_timeout+0x10/0x10
[164658.586805][ T118] ? mark_held_locks+0x40/0x70
[164658.587255][ T118] ? lockdep_hardirqs_on_prepare.part.0+0x9b/0x140
[164658.587934][ T118] wait_for_completion+0x173/0x3c0
[164658.588442][ T118] ? __pfx_wait_for_completion+0x10/0x10
[164658.588992][ T118] ? lockdep_hardirqs_on_prepare.part.0+0x9b/0x140
[164658.589662][ T118] ? flush_workqueue_prep_pwqs+0x337/0x460
[164658.590237][ T118] __flush_workqueue+0x36d/0x1090
[164658.590802][ T118] ? __pfx_try_to_wake_up+0x10/0x10
[164658.591275][ T118] ? lock_acquire.part.0+0xb8/0x230
[164658.591821][ T118] ? find_held_lock+0x2b/0x80
[164658.592274][ T118] ? find_held_lock+0x2b/0x80
[164658.592793][ T118] ? __pfx___flush_workqueue+0x10/0x10
[164658.593303][ T118] ? find_held_lock+0x2b/0x80
[164658.593792][ T118] xlog_cil_push_now.isra.0+0x4c/0x1a0 [xfs]
[164658.594996][ T118] xlog_cil_force_seq+0x17b/0x800 [xfs]
[164658.596170][ T118] ? __pfx_xlog_cil_force_seq+0x10/0x10 [xfs]
[164658.597416][ T118] ? mark_held_locks+0x40/0x70
[164658.597909][ T118] ? lockdep_hardirqs_on_prepare.part.0+0x9b/0x140
[164658.598545][ T118] ? trace_hardirqs_on+0x18/0x140
[164658.599033][ T118] ? kasan_quarantine_put+0xf5/0x240
[164658.599580][ T118] xfs_log_force_seq+0x1c1/0x5b0 [xfs]
[164658.600832][ T118] __xfs_trans_commit+0x818/0xba0 [xfs]
[164658.602000][ T118] ? __pfx___xfs_trans_commit+0x10/0x10 [xfs]
[164658.603202][ T118] ? lockdep_hardirqs_on_prepare.part.0+0x9b/0x140
[164658.603877][ T118] xfs_trans_commit+0xbf/0x180 [xfs]
[164658.605032][ T118] ? xfs_sb_to_disk+0x7f5/0x1fe0 [xfs]
[164658.606175][ T118] ? __pfx_xfs_trans_commit+0x10/0x10 [xfs]
[164658.607405][ T118] ? xfs_trans_dirty_buf+0x126/0x1b0 [xfs]
[164658.608644][ T118] xfs_sync_sb+0xee/0x110 [xfs]
[164658.609803][ T118] ? __pfx_xfs_sync_sb+0x10/0x10 [xfs]
[164658.610957][ T118] ? lock_release.part.0+0x1c/0x50
[164658.611531][ T118] ? _raw_spin_unlock+0x23/0x40
[164658.612040][ T118] ? xfs_log_need_covered.isra.0+0xbc/0x180 [xfs]
[164658.613370][ T118] xfs_log_worker+0x23d/0x2e0 [xfs]
[164658.614564][ T118] process_one_work+0x86b/0x1490
[164658.615059][ T118] ? __pfx_process_one_work+0x10/0x10
[164658.615610][ T118] ? lock_acquire.part.0+0xb8/0x230
[164658.616130][ T118] ? lock_is_held_type+0x9a/0x110
[164658.616640][ T118] ? assign_work+0x156/0x390
[164658.617094][ T118] worker_thread+0x5f2/0xfd0
[164658.617589][ T118] ? __pfx_worker_thread+0x10/0x10
[164658.618099][ T118] ? __kthread_parkme+0xb3/0x1f0
[164658.618593][ T118] ? __pfx_worker_thread+0x10/0x10
[164658.619108][ T118] kthread+0x3a4/0x760
[164658.619530][ T118] ? __pfx_kthread+0x10/0x10
[164658.619977][ T118] ? __lock_release.isra.0+0x59/0x170
[164658.620518][ T118] ? __pfx_kthread+0x10/0x10
[164658.620980][ T118] ret_from_fork+0x50e/0x670
[164658.621444][ T118] ? __pfx_ret_from_fork+0x10/0x10
[164658.621971][ T118] ? __switch_to+0x42c/0xd70
[164658.622479][ T118] ? __pfx_kthread+0x10/0x10
[164658.622967][ T118] ret_from_fork_asm+0x1a/0x30
[164658.623521][ T118]
[164658.623879][ T118]
[164658.623879][ T118] Showing all locks held in the system:
[164658.624683][ T118] 1 lock held by rcu_preempt/16:
[164658.625187][ T118] 1 lock held by khungtaskd/118:
[164658.625704][ T118] #0: ffffffffa3f2fc20 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[164658.626879][ T118] 2 locks held by kworker/15:2/3623436:
[164658.627447][ T118] #0: ffff88812d1a9148 ((wq_completion)xfs-sync/sdc3){+.+.}-{0:0}, at: process_one_work+0xef8/0x1490
[164658.628547][ T118] #1: ffff88840be1fca8 ((work_completion)(&(&log->l_work)->work)){+.+.}-{0:0}, at: process_one_work+0x7e7/0x1490
[164658.629704][ T118] 5 locks held by kworker/10:3/3712027:
[164658.630234][ T118] 3 locks held by kworker/u64:2/3727760:
[164658.630817][ T118] #0: ffff888102625148 ((wq_completion)writeback){+.+.}-{0:0}, at: process_one_work+0xef8/0x1490
[164658.631852][ T118] #1: ffff8886b4b57ca8 ((work_completion)(&(&wb->dwork)->work)){+.+.}-{0:0}, at: process_one_work+0x7e7/0x1490
[164658.633052][ T118] #2: ffff88814fd480e0 (&type->s_umount_key#58){++++}-{4:4}, at: super_trylock_shared+0x1e/0xb0
[164658.634106][ T118] 1 lock held by xfs_repair/3732109:
[164658.634650][ T118] 2 locks held by kworker/14:0/3732215:
[164658.635179][ T118] #0: ffff88864dda8948 ((wq_completion)xfs-sync/sde){+.+.}-{0:0}, at: process_one_work+0xef8/0x1490
[164658.636235][ T118] #1: ffff88814109fca8 ((work_completion)(&(&log->l_work)->work)){+.+.}-{0:0}, at: process_one_work+0x7e7/0x1490
[164658.637428][ T118]
[164658.637669][ T118] =============================================
[164658.637669][ T118]
[164660.955748][ C7] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[164660.957272][ C7] rcu: 5-...0: (1 GPs behind) idle=9184/1/0x4000000000000000 softirq=12412680/12412680 fqs=7111
[164660.959517][ C7] rcu: (detected by 7, t=260155 jiffies, g=63951405, q=7286 ncpus=16)
[164660.961273][ C7] Sending NMI from CPU 7 to CPUs 5:
[164660.961298][ C5] NMI backtrace for cpu 5
[164660.961306][ C5] CPU: 5 UID: 0 PID: 0 Comm: swapper/5 Tainted: G L 6.19.0-rc1-kts-xfs-zoned-fixes-gec6aea2a5+ #1 PREEMPT(lazy)
[164660.961313][ C5] Tainted: [L]=SOFTLOCKUP
[164660.961315][ C5] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.17.0-5.fc42 04/01/2014
[164660.961318][ C5] RIP: 0010:_find_first_zero_bit+0x36/0x90
[164660.961327][ C5] Code: 48 be 00 00 00 00 00 fc ff df 48 83 ec 18 31 c9 eb 0d 48 83 c1 40 48 83 c7 08 48 39 c1 73 25 48 89 fa 48 c1 ea 03 80 3c 32 00 <75> 26 48 8b 17 48 83 f2 ff 74 dd f3 48 0f bc d2 48 01 d1 48 39 c8
[164660.961331][ C5] RSP: 0018:ffff88810115fcd8 EFLAGS: 00000046
[164660.961335][ C5] RAX: 0000000000000010 RBX: fffffbfff49a1c1c RCX: 0000000000000000
[164660.961339][ C5] RDX: 1ffff11025149aa2 RSI: dffffc0000000000 RDI: ffff888128a4d510
[164660.961342][ C5] RBP: 0000000000000003 R08: 0000000040000002 R09: 000000000000000e
[164660.961344][ C5] R10: ffff888128a4ca80 R11: ffff888565575654 R12: 0000000000000007
[164660.961347][ C5] R13: ffff888128a4d500 R14: 0000000000000010 R15: 0000000000000010
[164660.961350][ C5] FS: 0000000000000000(0000) GS:ffff888c67339000(0000) knlGS:0000000000000000
[164660.961353][ C5] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[164660.961356][ C5] CR2: 00007f7661c41820 CR3: 000000013d927004 CR4: 0000000000772ef0
[164660.961361][ C5] PKRU: 55555554
[164660.961363][ C5] Call Trace:
[164660.961366][ C5]
[164660.961370][ C5] ? __lock_release.isra.0+0x59/0x170
[164660.961376][ C5] mm_get_cid+0x1b9/0x2c0
[164660.961384][ C5] mm_cid_switch_to+0xa6d/0x1300
[164660.961389][ C5] ? switch_mm_irqs_off+0x6fe/0x970
[164660.961396][ C5] __schedule+0x6b5/0x12a0
[164660.961402][ C5] ? __pfx___schedule+0x10/0x10
[164660.961408][ C5] ? tick_nohz_stop_idle+0x206/0x330
[164660.961413][ C5] ? lockdep_hardirqs_on_prepare.part.0+0x9b/0x140
[164660.961420][ C5] schedule_idle+0x59/0x90
[164660.961424][ C5] do_idle+0x10e/0x190
[164660.961430][ C5] cpu_startup_entry+0x53/0x70
[164660.961435][ C5] start_secondary+0x220/0x2e0
[164660.961442][ C5] ? __pfx_start_secondary+0x10/0x10
[164660.961449][ C5] common_startup_64+0x13e/0x141
[164660.961468][ C5]
[164660.962296][ C7] rcu: rcu_preempt kthread starved for 227654 jiffies! g63951405 f0x2 RCU_GP_DOING_FQS(6) ->state=0x0 ->cpu=12
[164661.011699][ C7] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
[164661.013967][ C7] rcu: RCU grace-period kthread stack dump:
[164661.015518][ C7] task:rcu_preempt state:R running task stack:0 pid:16 tgid:16 ppid:2 task_flags:0x208040 flags:0x00080000
[164661.018657][ C7] Call Trace:
[164661.019421][ C7]
[164661.020105][ C7] ? do_raw_spin_lock+0x1d9/0x270
[164661.021265][ C7] ? __pfx_do_raw_spin_lock+0x10/0x10
[164661.022469][ C7] ? lock_acquire+0xf6/0x130
[164661.023489][ C7] ? raw_spin_rq_lock_nested+0x24/0x170
[164661.024662][ C7] ? _raw_spin_rq_lock_irqsave+0x41/0x50
[164661.025827][ C7] ? resched_cpu+0x62/0xf0
[164661.026727][ C7] ? force_qs_rnp+0x67d/0xaa0
[164661.027673][ C7] ? __pfx_rcu_watching_snap_recheck+0x10/0x10
[164661.028951][ C7] ? rcu_gp_fqs_loop+0x948/0x11b0
[164661.029991][ C7] ? rcu_gp_init+0xb0f/0x14a0
[164661.030928][ C7] ? __pfx_rcu_gp_fqs_loop+0x10/0x10
[164661.031979][ C7] ? _raw_spin_unlock_irq+0x28/0x50
[164661.032977][ C7] ? rcu_gp_cleanup+0x824/0xf40
[164661.033966][ C7] ? __pfx_rcu_gp_init+0x10/0x10
[164661.034967][ C7] ? __pfx_rcu_gp_cleanup+0x10/0x10
[164661.036012][ C7] ? lockdep_hardirqs_on_prepare.part.0+0x9b/0x140
[164661.037272][ C7] ? rcu_gp_kthread+0x4f2/0x660
[164661.038235][ C7] ? lock_acquire+0xf6/0x130
[164661.039172][ C7] ? __pfx_rcu_gp_kthread+0x10/0x10
[164661.040218][ C7] ? lockdep_hardirqs_on_prepare.part.0+0x9b/0x140
[164661.041520][ C7] ? __pfx_rcu_gp_kthread+0x10/0x10
[164661.042476][ C7] ? __kthread_parkme+0xb3/0x1f0
[164661.043407][ C7] ? __pfx_rcu_gp_kthread+0x10/0x10
[164661.044376][ C7] ? kthread+0x3a4/0x760
[164661.045149][ C7] ? __pfx_kthread+0x10/0x10
[164661.045999][ C7] ? __lock_release.isra.0+0x59/0x170
[164661.046995][ C7] ? __pfx_kthread+0x10/0x10
[164661.047867][ C7] ? ret_from_fork+0x50e/0x670
[164661.048752][ C7] ? __pfx_ret_from_fork+0x10/0x10
[164661.049697][ C7] ? __switch_to+0x42c/0xd70
[164661.050567][ C7] ? __pfx_kthread+0x10/0x10
[164661.051365][ C7] ? ret_from_fork_asm+0x1a/0x30
[164661.052181][ C7]
[164661.052729][ C7] rcu: Stack dump where RCU GP kthread last ran:
[164661.053767][ C7] Sending NMI from CPU 7 to CPUs 12:
[164661.054646][ C12] NMI backtrace for cpu 12
[164661.054655][ C12] CPU: 12 UID: 0 PID: 16 Comm: rcu_preempt Tainted: G L 6.19.0-rc1-kts-xfs-zoned-fixes-gec6aea2a5+ #1 PREEMPT(lazy)
[164661.054662][ C12] Tainted: [L]=SOFTLOCKUP
[164661.054664][ C12] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.17.0-5.fc42 04/01/2014
[164661.054667][ C12] RIP: 0010:__pv_queued_spin_lock_slowpath+0x232/0xdc0
[164661.054674][ C12] Code: 44 8b 2b c6 44 24 60 00 66 45 85 ed 74 1e 41 81 fd ff ff 00 00 0f 86 5e 02 00 00 41 81 e5 00 ff 00 00 0f 85 51 02 00 00 f3 90 b5 48 89 df be 01 00 00 00 e8 9f 96 bc fd be 01 00 00 00 48 8d
[164661.054678][ C12] RSP: 0018:ffff8881010c7948 EFLAGS: 00000046
[164661.054683][ C12] RAX: 0000000000000000 RBX: ffff888c0d0c5440 RCX: 0000000000000001
[164661.054686][ C12] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff888c0d0c5440
[164661.054689][ C12] RBP: 0000000000000003 R08: ffffffffa28edce6 R09: ffffed1181a18a88
[164661.054692][ C12] R10: ffffed1181a18a89 R11: 0000000000000001 R12: ffffed1181a18a88
[164661.054694][ C12] R13: 0000000000000000 R14: ffff888c0d446408 R15: ffff888c0d446400
[164661.054697][ C12] FS: 0000000000000000(0000) GS:ffff888c676b9000(0000) knlGS:0000000000000000
[164661.054700][ C12] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[164661.054703][ C12] CR2: 00007f7657ff6cb8 CR3: 0000000108544001 CR4: 0000000000772ef0
[164661.054708][ C12] PKRU: 55555554
[164661.054710][ C12] Call Trace:
[164661.054713][ C12]
[164661.054718][ C12] ? lock_release.part.0+0x1c/0x50
[164661.054725][ C12] ? __virt_addr_valid+0x1d1/0x3f0
[164661.054731][ C12] ? __pfx___pv_queued_spin_lock_slowpath+0x10/0x10
[164661.054736][ C12] ? __lock_acquire+0x55d/0xbd0
[164661.054745][ C12] do_raw_spin_lock+0x1d9/0x270
[164661.054754][ C12] ? __pfx_do_raw_spin_lock+0x10/0x10
[164661.054761][ C12] ? lock_acquire+0xf6/0x130
[164661.054768][ C12] raw_spin_rq_lock_nested+0x24/0x170
[164661.054774][ C12] _raw_spin_rq_lock_irqsave+0x41/0x50
[164661.054778][ C12] resched_cpu+0x62/0xf0
[164661.054783][ C12] force_qs_rnp+0x67d/0xaa0
[164661.054789][ C12] ? __pfx_rcu_watching_snap_recheck+0x10/0x10
[164661.054799][ C12] rcu_gp_fqs_loop+0x948/0x11b0
[164661.054804][ C12] ? rcu_gp_init+0xb0f/0x14a0
[164661.054810][ C12] ? __pfx_rcu_gp_fqs_loop+0x10/0x10
[164661.054814][ C12] ? _raw_spin_unlock_irq+0x28/0x50
[164661.054818][ C12] ? rcu_gp_cleanup+0x824/0xf40
[164661.054823][ C12] ? __pfx_rcu_gp_init+0x10/0x10
[164661.054829][ C12] ? __pfx_rcu_gp_cleanup+0x10/0x10
[164661.054835][ C12] ? lockdep_hardirqs_on_prepare.part.0+0x9b/0x140
[164661.054841][ C12] rcu_gp_kthread+0x4f2/0x660
[164661.054847][ C12] ? lock_acquire+0xf6/0x130
[164661.054851][ C12] ? __pfx_rcu_gp_kthread+0x10/0x10
[164661.054856][ C12] ? lockdep_hardirqs_on_prepare.part.0+0x9b/0x140
[164661.054861][ C12] ? __pfx_rcu_gp_kthread+0x10/0x10
[164661.054866][ C12] ? __kthread_parkme+0xb3/0x1f0
[164661.054872][ C12] ? __pfx_rcu_gp_kthread+0x10/0x10
[164661.054876][ C12] kthread+0x3a4/0x760
[164661.054882][ C12] ? __pfx_kthread+0x10/0x10
[164661.054886][ C12] ? __lock_release.isra.0+0x59/0x170
[164661.054892][ C12] ? __pfx_kthread+0x10/0x10
[164661.054896][ C12] ret_from_fork+0x50e/0x670
[164661.054902][ C12] ? __pfx_ret_from_fork+0x10/0x10
[164661.054907][ C12] ? __switch_to+0x42c/0xd70
[164661.054911][ C12] ? __pfx_kthread+0x10/0x10
[164661.054916][ C12] ret_from_fork_asm+0x1a/0x30
[164661.054928][ C12]
[164686.111947][ C10] watchdog: BUG: soft lockup - CPU#10 stuck for 119s! [kworker/10:3:3712027]
[164686.111955][ C10] CPU#10 Utilization every 4000ms during lockup:
[164686.111958][ C10] #1: 100% system, 0% softirq, 1% hardirq, 0% idle
[164686.111961][ C10] #2: 100% system, 0% softirq, 1% hardirq, 0% idle
[164686.111964][ C10] #3: 100% system, 0% softirq, 1% hardirq, 0% idle
[164686.111967][ C10] #4: 100% system, 0% softirq, 1% hardirq, 0% idle
[164686.111970][ C10] #5: 100% system, 0% softirq, 1% hardirq, 0% idle
[164686.111972][ C10] Modules linked in: iscsi_target_mod tcm_loop target_core_pscsi target_core_file target_core_iblock btrfs xor raid6_pq dm_flakey target_core_user target_core_mod rfkill nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nf_tables qrtr sunrpc intel_rapl_msr intel_rapl_common intel_uncore_frequency_common skx_edac_common nfit libnvdimm kvm_intel iTCO_wdt intel_pmc_bxt ppdev iTCO_vendor_support kvm irqbypass i2c_i801 parport_pc rapl i2c_smbus parport lpc_ich joydev fuse loop dm_multipath nfnetlink zram vsock_loopback lz4hc_compress lz4_compress vmw_vsock_virtio_transport_common zstd_compress vmw_vsock_vmci_transport vmw_vmci vsock xfs bochs drm_client_lib drm_shmem_helper drm_kms_helper virtio_net sym53c8xx net_failover ghash_clmulni_intel drm failover scsi_transport_spi serio_raw scsi_dh_rdac scsi_dh_emc scsi_dh_alua i2c_dev qemu_fw_cfg [last unloaded: scsi_debug]
[164686.112076][ C10] irq event stamp: 438740
[164686.112078][ C10] hardirqs last enabled at (438739): [] asm_sysvec_apic_timer_interrupt+0x1a/0x20
[164686.112087][ C10] hardirqs last disabled at (438740): [] sysvec_apic_timer_interrupt+0xe/0x90
[164686.112093][ C10] softirqs last enabled at (438704): [] handle_softirqs+0x522/0x7b0
[164686.112099][ C10] softirqs last disabled at (438699): [] __irq_exit_rcu+0x181/0x1d0
[164686.112106][ C10] CPU: 10 UID: 0 PID: 3712027 Comm: kworker/10:3 Tainted: G L 6.19.0-rc1-kts-xfs-zoned-fixes-gec6aea2a5+ #1 PREEMPT(lazy)
[164686.112113][ C10] Tainted: [L]=SOFTLOCKUP
[164686.112115][ C10] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.17.0-5.fc42 04/01/2014
[164686.112118][ C10] Workqueue: events netstamp_clear
[164686.112125][ C10] RIP: 0010:smp_call_function_many_cond+0x885/0x1070
[164686.112130][ C10] Code: 38 c8 7c 08 84 c9 0f 85 6e 05 00 00 8b 43 08 a8 01 74 2e 48 89 f1 49 89 f6 48 c1 e9 03 41 83 e6 07 4c 01 f9 41 83 c6 03 f3 90 <0f> b6 01 41 38 c6 7c 08 84 c0 0f 85 db 04 00 00 8b 43 08 a8 01 75
[164686.112134][ C10] RSP: 0018:ffff888485a1f990 EFLAGS: 00000202
[164686.112138][ C10] RAX: 0000000000000011 RBX: ffffe8ffff082980 RCX: fffff91fffe10531
[164686.112141][ C10] RDX: 0000000000000005 RSI: ffffe8ffff082988 RDI: ffffffffa390b188
[164686.112144][ C10] RBP: ffffed1181a68d59 R08: ffff8881014fcd60 R09: 0000000000000000
[164686.112147][ C10] R10: 1ffff1102029f9ac R11: 0000000000000000 R12: ffff888c0d346ac0
[164686.112149][ C10] R13: ffffed1181a68d58 R14: 0000000000000003 R15: dffffc0000000000
[164686.112152][ C10] FS: 0000000000000000(0000) GS:ffff888c675b9000(0000) knlGS:0000000000000000
[164686.112155][ C10] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[164686.112158][ C10] CR2: 00007fb20918fa10 CR3: 00000007db69c004 CR4: 0000000000772ef0
[164686.112164][ C10] PKRU: 55555554
[164686.112166][ C10] Call Trace:
[164686.112168][ C10]
[164686.112175][ C10] ? __pfx_do_sync_core+0x10/0x10
[164686.112182][ C10] ? __text_poke+0x371/0x870
[164686.112192][ C10] ? __pfx_smp_call_function_many_cond+0x10/0x10
[164686.112196][ C10] ? __pfx___text_poke+0x10/0x10
[164686.112202][ C10] ? __pfx___might_resched+0x10/0x10
[164686.112211][ C10] on_each_cpu_cond_mask+0x24/0x40
[164686.112215][ C10] smp_text_poke_batch_finish+0x45c/0xd20
[164686.112220][ C10] ? tpacket_rcv+0xe19/0x3f40
[164686.112228][ C10] ? __pfx_smp_text_poke_batch_finish+0x10/0x10
[164686.112232][ C10] ? __jump_label_patch+0x25f/0x320
[164686.112243][ C10] ? arch_jump_label_transform_queue+0xa8/0x110
[164686.112254][ C10] arch_jump_label_transform_apply+0x1c/0x30
[164686.112259][ C10] static_key_enable_cpuslocked+0x16c/0x230
[164686.112266][ C10] static_key_enable+0x1f/0x30
[164686.112270][ C10] process_one_work+0x86b/0x1490
[164686.112286][ C10] ? __pfx_process_one_work+0x10/0x10
[164686.112291][ C10] ? lock_acquire.part.0+0xb8/0x230
[164686.112300][ C10] ? lock_is_held_type+0x9a/0x110
[164686.112307][ C10] ? assign_work+0x156/0x390
[164686.112315][ C10] worker_thread+0x5f2/0xfd0
[164686.112324][ C10] ? __pfx_worker_thread+0x10/0x10
[164686.112329][ C10] ? __kthread_parkme+0xb3/0x1f0
[164686.112337][ C10] ? __pfx_worker_thread+0x10/0x10
[164686.112342][ C10] kthread+0x3a4/0x760
[164686.112348][ C10] ? __pfx_kthread+0x10/0x10
[164686.112353][ C10] ? __lock_release.isra.0+0x59/0x170
[164686.112361][ C10] ? __pfx_kthread+0x10/0x10
[164686.112367][ C10] ret_from_fork+0x50e/0x670
[164686.112374][ C10] ? __pfx_ret_from_fork+0x10/0x10
[164686.112381][ C10] ? __switch_to+0x42c/0xd70
[164686.112388][ C10] ? __pfx_kthread+0x10/0x10
[164686.112394][ C10] ret_from_fork_asm+0x1a/0x30
[164686.112413][ C10]