linux-kernel.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
* lockup and kernel panic in linux-next-202505{09,12} when compiled with clang
@ 2025-05-13  8:00 Bert Karwatzki
  0 siblings, 0 replies; 22+ messages in thread
From: Bert Karwatzki @ 2025-05-13  8:00 UTC (permalink / raw)
  To: linux-kernel; +Cc: Bert Karwatzki, linux-next, Johannes Berg, llvm-bugs

For testing purposes I compiled linux-next-20250509 with clang from debian sid
(the whole system is debian sid running on an MSI Alpha 15 Laptop):

$ clang --version
Debian clang version 19.1.7 (3)
Target: x86_64-pc-linux-gnu
Thread model: posix
InstalledDir: /usr/lib/llvm-19/bin

This fails to boot and I tried to bisect this between v6.15-rc5 and next-20250509.
During this bisection the behaviour of the bad commits was different from next-20250509:
The system boots to the GUI (xfce from debian sid) but soon after that locks up,
somtimes with flashing capslock indicating a kernel panic. The logs showed no
traces of errors. Unfortunately this bisection was inconclusive (i. e. it ended
in a commit which I don't even compile)
 As next-20250512 was released by that time I tested it with clang and the error is
present there, too. During the bisection from v6.15-rc6 to next-20250512 I was
finally able to get an error message (here there was a lockup without kernel panic,
there are most likely more than one bug):

2025-05-12T22:29:47.022594+02:00 lisa kernel: [  T313] Emergency Sync complete
2025-05-12T22:29:50.077596+02:00 lisa kernel: [  T245] sysrq: Emergency Sync
2025-05-12T22:29:50.182586+02:00 lisa kernel: [  T313] Emergency Sync complete
2025-05-12T22:29:52.686659+02:00 lisa kernel: [    C6] watchdog: CPU6: Watchdog detected hard LOCKUP on cpu 6
2025-05-12T22:29:52.686678+02:00 lisa kernel: [    C6] Modules linked in: ccm snd_seq_dummy snd_hrtimer snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq snd_seq_device rfcomm bnep nls_ascii nls_cp437 vfat fat snd_ctl_led snd_hda_codec_realtek snd_hda_scodec_component snd_hda_codec_generic snd_hda_codec_hdmi snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_acp3x_pdm_dma snd_soc_dmic snd_acp3x_rn btusb snd_soc_core snd_hwdep btbcm snd_hda_core uvcvideo btintel btrtl snd_pcm_oss videobuf2_vmalloc btmtk videobuf2_memops uvc videobuf2_v4l2 snd_mixer_oss bluetooth videodev snd_pcm snd_rn_pci_acp3x snd_acp_config snd_soc_acpi videobuf2_common snd_timer msi_wmi ecdh_generic ecc mc sparse_keymap wmi_bmof snd edac_mce_amd snd_pci_acp3x soundcore k10temp ccp battery ac button joydev hid_sensor_gyro_3d hid_sensor_als hid_sensor_accel_3d hid_sensor_magn_3d hid_sensor_prox hid_sensor_trigger hid_sensor_iio_common industrialio_triggered_buffer kfifo_buf amd_pmc industrialio evdev mt7921e mt7921_common mt792x_lib mt76_connac_lib mt76 mac80211 libarc4 cfg80211 rfkill msr
2025-05-12T22:29:52.686683+02:00 lisa kernel: [    C6]  fuse nvme_fabrics efi_pstore configfs efivarfs autofs4 ext4 mbcache jbd2 amdgpu usbhid drm_panel_backlight_quirks cec drm_buddy drm_suballoc_helper drm_exec i2c_algo_bit drm_display_helper xhci_pci gpu_sched xhci_hcd hid_sensor_hub hid_multitouch drm_ttm_helper mfd_core hid_generic ttm usbcore i2c_hid_acpi drm_client_lib psmouse nvme amd_sfh i2c_hid drm_kms_helper nvme_core hid serio_raw r8169 usb_common i2c_piix4 amdxcp crc16 i2c_smbus i2c_designware_platform i2c_designware_core
2025-05-12T22:29:52.686686+02:00 lisa kernel: [    C6] CPU: 6 UID: 0 PID: 640 Comm: napi/phy0-0 Not tainted 6.15.0-rc2-bisect-00574-gfe80b0e53d36 #901 PREEMPT_{RT,(full)} 
2025-05-12T22:29:52.686688+02:00 lisa kernel: [    C6] Hardware name: Micro-Star International Co., Ltd. Alpha 15 B5EEK/MS-158L, BIOS E158LAMS.10F 11/11/2024
2025-05-12T22:29:52.686690+02:00 lisa kernel: [    C6] RIP: 0010:queued_spin_lock_slowpath+0x134/0x1c0
2025-05-12T22:29:52.686693+02:00 lisa kernel: [    C6] Code: 03 c1 e6 04 83 e0 fc 49 c7 c0 f8 ff ff ff 49 8b 84 40 50 7a 7d be 48 89 94 06 c0 ed 05 bf 83 7a 08 00 75 08 f3 90 83 7a 08 00 <74> f8 48 8b 32 48 85 f6 74 09 0f 0d 0e eb 0a 31 f6 eb 06 31 f6 eb
2025-05-12T22:29:52.686695+02:00 lisa kernel: [    C6] RSP: 0018:ffffd3bdc1e579a0 EFLAGS: 00000046
2025-05-12T22:29:52.686697+02:00 lisa kernel: [    C6] RAX: 0000000000325790 RBX: 0000000000000282 RCX: 00000000001c0000
2025-05-12T22:29:52.686699+02:00 lisa kernel: [    C6] RDX: ffff8c456e7a2dc0 RSI: 0000000000000010 RDI: ffff8c37bc453fa8
2025-05-12T22:29:52.686701+02:00 lisa kernel: [    C6] RBP: ffff8c36e040c700 R08: fffffffffffffff8 R09: 0000000000000001
2025-05-12T22:29:52.686704+02:00 lisa kernel: [    C6] R10: 0000000000000001 R11: ffffffffbdfe74f0 R12: ffff8c37bc453f90
2025-05-12T22:29:52.686706+02:00 lisa kernel: [    C6] R13: ffff8c36c4492480 R14: ffff8c37bc453fa8 R15: ffff8c37bc453fa8
2025-05-12T22:29:52.686708+02:00 lisa kernel: [    C6] FS:  0000000000000000(0000) GS:ffff8c45af744000(0000) knlGS:0000000000000000
2025-05-12T22:29:52.686711+02:00 lisa kernel: [    C6] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
2025-05-12T22:29:52.686713+02:00 lisa kernel: [    C6] CR2: 00007f92c65a9000 CR3: 00000002a9720000 CR4: 0000000000750ef0
2025-05-12T22:29:52.686716+02:00 lisa kernel: [    C6] PKRU: 55555554
2025-05-12T22:29:52.686718+02:00 lisa kernel: [    C6] Call Trace:
2025-05-12T22:29:52.686720+02:00 lisa kernel: [    C6]  <TASK>
2025-05-12T22:29:52.686723+02:00 lisa kernel: [    C6]  _raw_spin_lock_irqsave+0x57/0x60
2025-05-12T22:29:52.686725+02:00 lisa kernel: [    C6]  rt_spin_lock+0x73/0xa0
2025-05-12T22:29:52.686727+02:00 lisa kernel: [    C6]  sock_queue_err_skb+0xdc/0x140
2025-05-12T22:29:52.686729+02:00 lisa kernel: [    C6]  skb_complete_wifi_ack+0xa9/0x120
2025-05-12T22:29:52.686732+02:00 lisa kernel: [    C6]  ieee80211_report_used_skb+0x541/0x6e0 [mac80211]
2025-05-12T22:29:52.686734+02:00 lisa kernel: [    C6]  ieee80211_tx_status_ext+0x3b9/0x820 [mac80211]
2025-05-12T22:29:52.686736+02:00 lisa kernel: [    C6]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:29:52.686738+02:00 lisa kernel: [    C6]  ? rt_spin_lock+0x3d/0xa0
2025-05-12T22:29:52.686741+02:00 lisa kernel: [    C6]  ? mt76_tx_status_unlock+0x38/0x230 [mt76]
2025-05-12T22:29:52.686743+02:00 lisa kernel: [    C6]  mt76_tx_status_unlock+0x1e0/0x230 [mt76]
2025-05-12T22:29:52.686746+02:00 lisa kernel: [    C6]  __mt76_tx_complete_skb+0x13b/0x2e0 [mt76]
2025-05-12T22:29:52.686748+02:00 lisa kernel: [    C6]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:29:52.686750+02:00 lisa kernel: [    C6]  ? rt_spin_unlock+0x12/0x40
2025-05-12T22:29:52.686753+02:00 lisa kernel: [    C6]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:29:52.686755+02:00 lisa kernel: [    C6]  mt76_connac2_txwi_free+0x127/0x150 [mt76_connac_lib]
2025-05-12T22:29:52.686757+02:00 lisa kernel: [    C6]  mt7921_mac_tx_free+0x112/0x260 [mt7921_common]
2025-05-12T22:29:52.686760+02:00 lisa kernel: [    C6]  mt7921_rx_check+0x33/0xe0 [mt7921_common]
2025-05-12T22:29:52.686762+02:00 lisa kernel: [    C6]  mt76_dma_rx_poll+0x322/0x660 [mt76]
2025-05-12T22:29:52.686764+02:00 lisa kernel: [    C6]  ? mt792x_poll_rx+0x2a/0x120 [mt792x_lib]
2025-05-12T22:29:52.686766+02:00 lisa kernel: [    C6]  mt792x_poll_rx+0x71/0x120 [mt792x_lib]
2025-05-12T22:29:52.686768+02:00 lisa kernel: [    C6]  __napi_poll+0x2a/0x170
2025-05-12T22:29:52.686770+02:00 lisa kernel: [    C6]  ? napi_threaded_poll_loop+0x32/0x1b0
2025-05-12T22:29:52.686773+02:00 lisa kernel: [    C6]  napi_threaded_poll_loop+0xe4/0x1b0
2025-05-12T22:29:52.686775+02:00 lisa kernel: [    C6]  ? napi_threaded_poll_loop+0x32/0x1b0
2025-05-12T22:29:52.686777+02:00 lisa kernel: [    C6]  ? ttwu_do_activate+0xa9/0x1a0
2025-05-12T22:29:52.686779+02:00 lisa kernel: [    C6]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:29:52.686782+02:00 lisa kernel: [    C6]  napi_threaded_poll+0x57/0x80
2025-05-12T22:29:52.686784+02:00 lisa kernel: [    C6]  ? __pfx_napi_threaded_poll+0x10/0x10
2025-05-12T22:29:52.686787+02:00 lisa kernel: [    C6]  kthread+0x25c/0x280
2025-05-12T22:29:52.686789+02:00 lisa kernel: [    C6]  ? __pfx_kthread+0x10/0x10
2025-05-12T22:29:52.686792+02:00 lisa kernel: [    C6]  ret_from_fork+0x35/0x40
2025-05-12T22:29:52.686794+02:00 lisa kernel: [    C6]  ? __pfx_kthread+0x10/0x10
2025-05-12T22:29:52.686797+02:00 lisa kernel: [    C6]  ret_from_fork_asm+0x1a/0x30
2025-05-12T22:29:52.686799+02:00 lisa kernel: [    C6]  </TASK>
2025-05-12T22:29:52.686801+02:00 lisa kernel: [  T245] sysrq: Emergency Sync
2025-05-12T22:29:52.809595+02:00 lisa kernel: [  T313] Emergency Sync complete
2025-05-12T22:29:54.118600+02:00 lisa kernel: [  T245] sysrq: Emergency Sync
2025-05-12T22:29:54.162590+02:00 lisa kernel: [  T313] Emergency Sync complete
2025-05-12T22:30:00.545794+02:00 lisa kernel: [   C10] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
2025-05-12T22:30:00.545812+02:00 lisa kernel: [   C10] rcu: 	6-...!: (1 GPs behind) idle=01fc/1/0x4000000000000000 softirq=0/0 fqs=112 rcuc=21006 jiffies(starved)
2025-05-12T22:30:00.545816+02:00 lisa kernel: [   C10] rcu: 	(detected by 10, t=21002 jiffies, g=104869, q=258868 ncpus=16)
2025-05-12T22:30:00.545819+02:00 lisa kernel: [   C10] Sending NMI from CPU 10 to CPUs 6:
2025-05-12T22:30:00.545822+02:00 lisa kernel: [    C6] NMI backtrace for cpu 6
2025-05-12T22:30:00.545824+02:00 lisa kernel: [    C6] CPU: 6 UID: 0 PID: 640 Comm: napi/phy0-0 Not tainted 6.15.0-rc2-bisect-00574-gfe80b0e53d36 #901 PREEMPT_{RT,(full)} 
2025-05-12T22:30:00.545827+02:00 lisa kernel: [    C6] Hardware name: Micro-Star International Co., Ltd. Alpha 15 B5EEK/MS-158L, BIOS E158LAMS.10F 11/11/2024
2025-05-12T22:30:00.545829+02:00 lisa kernel: [    C6] RIP: 0010:queued_spin_lock_slowpath+0x134/0x1c0
2025-05-12T22:30:00.545832+02:00 lisa kernel: [    C6] Code: 03 c1 e6 04 83 e0 fc 49 c7 c0 f8 ff ff ff 49 8b 84 40 50 7a 7d be 48 89 94 06 c0 ed 05 bf 83 7a 08 00 75 08 f3 90 83 7a 08 00 <74> f8 48 8b 32 48 85 f6 74 09 0f 0d 0e eb 0a 31 f6 eb 06 31 f6 eb
2025-05-12T22:30:00.545835+02:00 lisa kernel: [    C6] RSP: 0018:ffffd3bdc1e579a0 EFLAGS: 00000046
2025-05-12T22:30:00.545838+02:00 lisa kernel: [    C6] RAX: 0000000000325790 RBX: 0000000000000282 RCX: 00000000001c0000
2025-05-12T22:30:00.545840+02:00 lisa kernel: [    C6] RDX: ffff8c456e7a2dc0 RSI: 0000000000000010 RDI: ffff8c37bc453fa8
2025-05-12T22:30:00.545842+02:00 lisa kernel: [    C6] RBP: ffff8c36e040c700 R08: fffffffffffffff8 R09: 0000000000000001
2025-05-12T22:30:00.545845+02:00 lisa kernel: [    C6] R10: 0000000000000001 R11: ffffffffbdfe74f0 R12: ffff8c37bc453f90
2025-05-12T22:30:00.545847+02:00 lisa kernel: [    C6] R13: ffff8c36c4492480 R14: ffff8c37bc453fa8 R15: ffff8c37bc453fa8
2025-05-12T22:30:00.545849+02:00 lisa kernel: [    C6] FS:  0000000000000000(0000) GS:ffff8c45af744000(0000) knlGS:0000000000000000
2025-05-12T22:30:00.545851+02:00 lisa kernel: [    C6] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
2025-05-12T22:30:00.545854+02:00 lisa kernel: [    C6] CR2: 00007f92c65a9000 CR3: 00000002a9720000 CR4: 0000000000750ef0
2025-05-12T22:30:00.545856+02:00 lisa kernel: [    C6] PKRU: 55555554
2025-05-12T22:30:00.545858+02:00 lisa kernel: [    C6] Call Trace:
2025-05-12T22:30:00.545859+02:00 lisa kernel: [    C6]  <TASK>
2025-05-12T22:30:00.545861+02:00 lisa kernel: [    C6]  _raw_spin_lock_irqsave+0x57/0x60
2025-05-12T22:30:00.545864+02:00 lisa kernel: [    C6]  rt_spin_lock+0x73/0xa0
2025-05-12T22:30:00.545866+02:00 lisa kernel: [    C6]  sock_queue_err_skb+0xdc/0x140
2025-05-12T22:30:00.545869+02:00 lisa kernel: [    C6]  skb_complete_wifi_ack+0xa9/0x120
2025-05-12T22:30:00.545871+02:00 lisa kernel: [    C6]  ieee80211_report_used_skb+0x541/0x6e0 [mac80211]
2025-05-12T22:30:00.545873+02:00 lisa kernel: [    C6]  ieee80211_tx_status_ext+0x3b9/0x820 [mac80211]
2025-05-12T22:30:00.545876+02:00 lisa kernel: [    C6]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:30:00.545878+02:00 lisa kernel: [    C6]  ? rt_spin_lock+0x3d/0xa0
2025-05-12T22:30:00.545880+02:00 lisa kernel: [    C6]  ? mt76_tx_status_unlock+0x38/0x230 [mt76]
2025-05-12T22:30:00.545883+02:00 lisa kernel: [    C6]  mt76_tx_status_unlock+0x1e0/0x230 [mt76]
2025-05-12T22:30:00.545884+02:00 lisa kernel: [    C6]  __mt76_tx_complete_skb+0x13b/0x2e0 [mt76]
2025-05-12T22:30:00.545887+02:00 lisa kernel: [    C6]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:30:00.545889+02:00 lisa kernel: [    C6]  ? rt_spin_unlock+0x12/0x40
2025-05-12T22:30:00.545891+02:00 lisa kernel: [    C6]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:30:00.545894+02:00 lisa kernel: [    C6]  mt76_connac2_txwi_free+0x127/0x150 [mt76_connac_lib]
2025-05-12T22:30:00.545896+02:00 lisa kernel: [    C6]  mt7921_mac_tx_free+0x112/0x260 [mt7921_common]
2025-05-12T22:30:00.545897+02:00 lisa kernel: [    C6]  mt7921_rx_check+0x33/0xe0 [mt7921_common]
2025-05-12T22:30:00.545900+02:00 lisa kernel: [    C6]  mt76_dma_rx_poll+0x322/0x660 [mt76]
2025-05-12T22:30:00.545902+02:00 lisa kernel: [    C6]  ? mt792x_poll_rx+0x2a/0x120 [mt792x_lib]
2025-05-12T22:30:00.545905+02:00 lisa kernel: [    C6]  mt792x_poll_rx+0x71/0x120 [mt792x_lib]
2025-05-12T22:30:00.545908+02:00 lisa kernel: [    C6]  __napi_poll+0x2a/0x170
2025-05-12T22:30:00.545910+02:00 lisa kernel: [    C6]  ? napi_threaded_poll_loop+0x32/0x1b0
2025-05-12T22:30:00.545913+02:00 lisa kernel: [    C6]  napi_threaded_poll_loop+0xe4/0x1b0
2025-05-12T22:30:00.545916+02:00 lisa kernel: [    C6]  ? napi_threaded_poll_loop+0x32/0x1b0
2025-05-12T22:30:00.545918+02:00 lisa kernel: [    C6]  ? ttwu_do_activate+0xa9/0x1a0
2025-05-12T22:30:00.545920+02:00 lisa kernel: [    C6]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:30:00.545923+02:00 lisa kernel: [    C6]  napi_threaded_poll+0x57/0x80
2025-05-12T22:30:00.545926+02:00 lisa kernel: [    C6]  ? __pfx_napi_threaded_poll+0x10/0x10
2025-05-12T22:30:00.545928+02:00 lisa kernel: [    C6]  kthread+0x25c/0x280
2025-05-12T22:30:00.545931+02:00 lisa kernel: [    C6]  ? __pfx_kthread+0x10/0x10
2025-05-12T22:30:00.545933+02:00 lisa kernel: [    C6]  ret_from_fork+0x35/0x40
2025-05-12T22:30:00.545935+02:00 lisa kernel: [    C6]  ? __pfx_kthread+0x10/0x10
2025-05-12T22:30:00.545938+02:00 lisa kernel: [    C6]  ret_from_fork_asm+0x1a/0x30
2025-05-12T22:30:00.545940+02:00 lisa kernel: [    C6]  </TASK>
2025-05-12T22:30:00.545943+02:00 lisa kernel: [   C10] rcu: rcu_preempt kthread starved for 20543 jiffies! g104869 f0x2 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=6
2025-05-12T22:30:00.545945+02:00 lisa kernel: [   C10] rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
2025-05-12T22:30:00.545947+02:00 lisa kernel: [   C10] rcu: RCU grace-period kthread stack dump:
2025-05-12T22:30:00.545950+02:00 lisa kernel: [   C10] task:rcu_preempt     state:R  running task     stack:0     pid:17    tgid:17    ppid:2      task_flags:0x208040 flags:0x00004000
2025-05-12T22:30:00.545952+02:00 lisa kernel: [   C10] Call Trace:
2025-05-12T22:30:00.545955+02:00 lisa kernel: [   C10]  <TASK>
2025-05-12T22:30:00.545958+02:00 lisa kernel: [   C10]  __schedule+0x4fe/0x1280
2025-05-12T22:30:00.545967+02:00 lisa kernel: [   C10]  ? schedule+0x5f/0xd0
2025-05-12T22:30:00.545969+02:00 lisa kernel: [   C10]  schedule+0x5f/0xd0
2025-05-12T22:30:00.545971+02:00 lisa kernel: [   C10]  schedule_timeout+0x76/0xf0
2025-05-12T22:30:00.545973+02:00 lisa kernel: [   C10]  ? __pfx_process_timeout+0x10/0x10
2025-05-12T22:30:00.545975+02:00 lisa kernel: [   C10]  rcu_gp_fqs_loop+0x195/0x740
2025-05-12T22:30:00.545978+02:00 lisa kernel: [   C10]  ? __pfx_rcu_watching_snap_recheck+0x10/0x10
2025-05-12T22:30:00.545980+02:00 lisa kernel: [   C10]  rcu_gp_kthread+0x21/0x180
2025-05-12T22:30:00.545982+02:00 lisa kernel: [   C10]  ? __pfx_rcu_gp_kthread+0x10/0x10
2025-05-12T22:30:00.545983+02:00 lisa kernel: [   C10]  kthread+0x25c/0x280
2025-05-12T22:30:00.545986+02:00 lisa kernel: [   C10]  ? __pfx_kthread+0x10/0x10
2025-05-12T22:30:00.545988+02:00 lisa kernel: [   C10]  ret_from_fork+0x35/0x40
2025-05-12T22:30:00.545990+02:00 lisa kernel: [   C10]  ? __pfx_kthread+0x10/0x10
2025-05-12T22:30:00.545993+02:00 lisa kernel: [   C10]  ret_from_fork_asm+0x1a/0x30
2025-05-12T22:30:00.545995+02:00 lisa kernel: [   C10]  </TASK>
2025-05-12T22:30:00.545997+02:00 lisa kernel: [  T245] sysrq: Emergency Sync
2025-05-12T22:30:00.699599+02:00 lisa kernel: [  T313] Emergency Sync complete
2025-05-12T22:30:01.349584+02:00 lisa kernel: [  T245] sysrq: Emergency Sync
2025-05-12T22:30:01.381591+02:00 lisa kernel: [  T313] Emergency Sync complete
2025-05-12T22:30:02.469588+02:00 lisa kernel: [  T245] sysrq: Emergency Sync
2025-05-12T22:30:02.508591+02:00 lisa kernel: [  T313] Emergency Sync complete
2025-05-12T22:30:02.858596+02:00 lisa kernel: [  T245] sysrq: Emergency Sync
2025-05-12T22:30:02.866591+02:00 lisa kernel: [  T313] Emergency Sync complete
2025-05-12T22:30:03.051589+02:00 lisa kernel: [  T245] sysrq: Emergency Sync
2025-05-12T22:30:03.059588+02:00 lisa kernel: [  T313] Emergency Sync complete
2025-05-12T22:30:03.264674+02:00 lisa kernel: [   C11] watchdog: BUG: soft lockup - CPU#11 stuck for 27s! [cc1:37564]
2025-05-12T22:30:03.264693+02:00 lisa kernel: [   C11] Modules linked in: ccm snd_seq_dummy snd_hrtimer snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq snd_seq_device rfcomm bnep nls_ascii nls_cp437 vfat fat snd_ctl_led snd_hda_codec_realtek snd_hda_scodec_component snd_hda_codec_generic snd_hda_codec_hdmi snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_acp3x_pdm_dma snd_soc_dmic snd_acp3x_rn btusb snd_soc_core snd_hwdep btbcm snd_hda_core uvcvideo btintel btrtl snd_pcm_oss videobuf2_vmalloc btmtk videobuf2_memops uvc videobuf2_v4l2 snd_mixer_oss bluetooth videodev snd_pcm snd_rn_pci_acp3x snd_acp_config snd_soc_acpi videobuf2_common snd_timer msi_wmi ecdh_generic ecc mc sparse_keymap wmi_bmof snd edac_mce_amd snd_pci_acp3x soundcore k10temp ccp battery ac button joydev hid_sensor_gyro_3d hid_sensor_als hid_sensor_accel_3d hid_sensor_magn_3d hid_sensor_prox hid_sensor_trigger hid_sensor_iio_common industrialio_triggered_buffer kfifo_buf amd_pmc industrialio evdev mt7921e mt7921_common mt792x_lib mt76_connac_lib mt76 mac80211 libarc4 cfg80211 rfkill msr
2025-05-12T22:30:03.264697+02:00 lisa kernel: [   C11]  fuse nvme_fabrics efi_pstore configfs efivarfs autofs4 ext4 mbcache jbd2 amdgpu usbhid drm_panel_backlight_quirks cec drm_buddy drm_suballoc_helper drm_exec i2c_algo_bit drm_display_helper xhci_pci gpu_sched xhci_hcd hid_sensor_hub hid_multitouch drm_ttm_helper mfd_core hid_generic ttm usbcore i2c_hid_acpi drm_client_lib psmouse nvme amd_sfh i2c_hid drm_kms_helper nvme_core hid serio_raw r8169 usb_common i2c_piix4 amdxcp crc16 i2c_smbus i2c_designware_platform i2c_designware_core
2025-05-12T22:30:03.264699+02:00 lisa kernel: [   C11] CPU: 11 UID: 1000 PID: 37564 Comm: cc1 Not tainted 6.15.0-rc2-bisect-00574-gfe80b0e53d36 #901 PREEMPT_{RT,(full)} 
2025-05-12T22:30:03.264702+02:00 lisa kernel: [   C11] Hardware name: Micro-Star International Co., Ltd. Alpha 15 B5EEK/MS-158L, BIOS E158LAMS.10F 11/11/2024
2025-05-12T22:30:03.264704+02:00 lisa kernel: [   C11] RIP: 0010:smp_call_function_many_cond+0x303/0x350
2025-05-12T22:30:03.264707+02:00 lisa kernel: [   C11] Code: bc c8 f7 c1 f0 ff ff ff 75 28 48 8b 03 89 ca 83 e2 0f 48 8b 14 d5 50 7a 7d be f7 44 02 08 01 00 00 00 74 bd f3 90 8b 74 10 08 <40> f6 c6 01 75 f4 eb af 65 48 8b 05 8d 02 6d 01 48 3b 44 24 38 75
2025-05-12T22:30:03.264709+02:00 lisa kernel: [   C11] RSP: 0018:ffffd3bde215fc40 EFLAGS: 00000202
2025-05-12T22:30:03.264711+02:00 lisa kernel: [   C11] RAX: ffffffffbf063f60 RBX: ffff8c456e8e31c0 RCX: 0000000000000006
2025-05-12T22:30:03.264713+02:00 lisa kernel: [   C11] RDX: ffff8c45af744000 RSI: 0000000000000011 RDI: ffff8c37d053f200
2025-05-12T22:30:03.264716+02:00 lisa kernel: [   C11] RBP: 0000000000000003 R08: 0000000000000000 R09: ffffffffffffffff
2025-05-12T22:30:03.264718+02:00 lisa kernel: [   C11] R10: ffff8c45af884000 R11: ffffffffbd886fc0 R12: 0000000000000000
2025-05-12T22:30:03.264720+02:00 lisa kernel: [   C11] R13: 0000000000000001 R14: 0000000000000202 R15: 0000000000000006
2025-05-12T22:30:03.264722+02:00 lisa kernel: [   C11] FS:  0000000000000000(0000) GS:ffff8c45af884000(0000) knlGS:0000000000000000
2025-05-12T22:30:03.264725+02:00 lisa kernel: [   C11] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
2025-05-12T22:30:03.264727+02:00 lisa kernel: [   C11] CR2: 00007f92caf17280 CR3: 0000000b6083c000 CR4: 0000000000750ef0
2025-05-12T22:30:03.264729+02:00 lisa kernel: [   C11] PKRU: 55555554
2025-05-12T22:30:03.264731+02:00 lisa kernel: [   C11] Call Trace:
2025-05-12T22:30:03.264733+02:00 lisa kernel: [   C11]  <TASK>
2025-05-12T22:30:03.264736+02:00 lisa kernel: [   C11]  ? __pfx_flush_tlb_func+0x10/0x10
2025-05-12T22:30:03.264738+02:00 lisa kernel: [   C11]  on_each_cpu_cond_mask+0x1c/0x40
2025-05-12T22:30:03.264740+02:00 lisa kernel: [   C11]  flush_tlb_mm_range+0x3f2/0x640
2025-05-12T22:30:03.264742+02:00 lisa kernel: [   C11]  tlb_flush_mmu+0x79/0x1b0
2025-05-12T22:30:03.264744+02:00 lisa kernel: [   C11]  tlb_finish_mmu+0x3f/0x80
2025-05-12T22:30:03.264747+02:00 lisa kernel: [   C11]  exit_mmap+0x1cc/0x2d0
2025-05-12T22:30:03.264749+02:00 lisa kernel: [   C11]  __mmput+0x26/0xe0
2025-05-12T22:30:03.264752+02:00 lisa kernel: [   C11]  exit_mm+0x94/0xc0
2025-05-12T22:30:03.264754+02:00 lisa kernel: [   C11]  do_exit+0x1f0/0x860
2025-05-12T22:30:03.264756+02:00 lisa kernel: [   C11]  ? rt_spin_lock+0x3d/0xa0
2025-05-12T22:30:03.264758+02:00 lisa kernel: [   C11]  do_group_exit+0x96/0xa0
2025-05-12T22:30:03.264760+02:00 lisa kernel: [   C11]  __x64_sys_exit_group+0x12/0x20
2025-05-12T22:30:03.264762+02:00 lisa kernel: [   C11]  x64_sys_call+0x21ba/0x21c0
2025-05-12T22:30:03.264764+02:00 lisa kernel: [   C11]  do_syscall_64+0x6c/0xfa0
2025-05-12T22:30:03.264766+02:00 lisa kernel: [   C11]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:30:03.264768+02:00 lisa kernel: [   C11]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:30:03.264770+02:00 lisa kernel: [   C11]  entry_SYSCALL_64_after_hwframe+0x76/0x7e
2025-05-12T22:30:03.264773+02:00 lisa kernel: [   C11] RIP: 0033:0x7f92caf17295
2025-05-12T22:30:03.264775+02:00 lisa kernel: [   C11] Code: Unable to access opcode bytes at 0x7f92caf1726b.
2025-05-12T22:30:03.264777+02:00 lisa kernel: [   C11] RSP: 002b:00007ffd998f6ec8 EFLAGS: 00000206 ORIG_RAX: 00000000000000e7
2025-05-12T22:30:03.264780+02:00 lisa kernel: [   C11] RAX: ffffffffffffffda RBX: 00007f92cb022fe8 RCX: 00007f92caf17295
2025-05-12T22:30:03.264782+02:00 lisa kernel: [   C11] RDX: 00000000000000e7 RSI: fffffffffffffbf8 RDI: 0000000000000000
2025-05-12T22:30:03.264784+02:00 lisa kernel: [   C11] RBP: 0000000000000000 R08: 00007ffd998f6e58 R09: 0000000000000000
2025-05-12T22:30:03.264786+02:00 lisa kernel: [   C11] R10: 00007ffd998f6cf0 R11: 0000000000000206 R12: 00007f92cb021680
2025-05-12T22:30:03.264789+02:00 lisa kernel: [   C11] R13: 00007f92cb5bac80 R14: 0000000000000040 R15: 00007f92cb023000
2025-05-12T22:30:03.264791+02:00 lisa kernel: [   C11]  </TASK>
2025-05-12T22:30:03.264793+02:00 lisa kernel: [   C13] watchdog: BUG: soft lockup - CPU#13 stuck for 26s! [cc1:37695]
2025-05-12T22:30:03.264796+02:00 lisa kernel: [   C13] Modules linked in: ccm snd_seq_dummy snd_hrtimer snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq snd_seq_device rfcomm bnep nls_ascii nls_cp437 vfat fat snd_ctl_led snd_hda_codec_realtek snd_hda_scodec_component snd_hda_codec_generic snd_hda_codec_hdmi snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_acp3x_pdm_dma snd_soc_dmic snd_acp3x_rn btusb snd_soc_core snd_hwdep btbcm snd_hda_core uvcvideo btintel btrtl snd_pcm_oss videobuf2_vmalloc btmtk videobuf2_memops uvc videobuf2_v4l2 snd_mixer_oss bluetooth videodev snd_pcm snd_rn_pci_acp3x snd_acp_config snd_soc_acpi videobuf2_common snd_timer msi_wmi ecdh_generic ecc mc sparse_keymap wmi_bmof snd edac_mce_amd snd_pci_acp3x soundcore k10temp ccp battery ac button joydev hid_sensor_gyro_3d hid_sensor_als hid_sensor_accel_3d hid_sensor_magn_3d hid_sensor_prox hid_sensor_trigger hid_sensor_iio_common industrialio_triggered_buffer kfifo_buf amd_pmc industrialio evdev mt7921e mt7921_common mt792x_lib mt76_connac_lib mt76 mac80211 libarc4 cfg80211 rfkill msr
2025-05-12T22:30:03.264799+02:00 lisa kernel: [   C13]  fuse nvme_fabrics efi_pstore configfs efivarfs autofs4 ext4 mbcache jbd2 amdgpu usbhid drm_panel_backlight_quirks cec drm_buddy drm_suballoc_helper drm_exec i2c_algo_bit drm_display_helper xhci_pci gpu_sched xhci_hcd hid_sensor_hub hid_multitouch drm_ttm_helper mfd_core hid_generic ttm usbcore i2c_hid_acpi drm_client_lib psmouse nvme amd_sfh i2c_hid drm_kms_helper nvme_core hid serio_raw r8169 usb_common i2c_piix4 amdxcp crc16 i2c_smbus i2c_designware_platform i2c_designware_core
2025-05-12T22:30:03.264801+02:00 lisa kernel: [   C13] CPU: 13 UID: 1000 PID: 37695 Comm: cc1 Tainted: G             L      6.15.0-rc2-bisect-00574-gfe80b0e53d36 #901 PREEMPT_{RT,(full)} 
2025-05-12T22:30:03.264804+02:00 lisa kernel: [   C13] Tainted: [L]=SOFTLOCKUP
2025-05-12T22:30:03.264806+02:00 lisa kernel: [   C13] Hardware name: Micro-Star International Co., Ltd. Alpha 15 B5EEK/MS-158L, BIOS E158LAMS.10F 11/11/2024
2025-05-12T22:30:03.264808+02:00 lisa kernel: [   C13] RIP: 0010:smp_call_function_many_cond+0x303/0x350
2025-05-12T22:30:03.264810+02:00 lisa kernel: [   C13] Code: bc c8 f7 c1 f0 ff ff ff 75 28 48 8b 03 89 ca 83 e2 0f 48 8b 14 d5 50 7a 7d be f7 44 02 08 01 00 00 00 74 bd f3 90 8b 74 10 08 <40> f6 c6 01 75 f4 eb af 65 48 8b 05 8d 02 6d 01 48 3b 44 24 38 75
2025-05-12T22:30:03.264813+02:00 lisa kernel: [   C13] RSP: 0018:ffffd3bde25bfc40 EFLAGS: 00000202
2025-05-12T22:30:03.264815+02:00 lisa kernel: [   C13] RAX: ffffffffbf063f80 RBX: ffff8c456e9631c0 RCX: 0000000000000006
2025-05-12T22:30:03.264817+02:00 lisa kernel: [   C13] RDX: ffff8c45af744000 RSI: 0000000000000011 RDI: ffff8c456e961240
2025-05-12T22:30:03.264820+02:00 lisa kernel: [   C13] RBP: 0000000000000003 R08: 0000000000000000 R09: ffffffffffffffff
2025-05-12T22:30:03.264821+02:00 lisa kernel: [   C13] R10: ffff8c45af904000 R11: ffffffffbd886fc0 R12: 0000000000000000
2025-05-12T22:30:03.264824+02:00 lisa kernel: [   C13] R13: 0000000000000000 R14: 0000000000000202 R15: 0000000000000006
2025-05-12T22:30:03.264826+02:00 lisa kernel: [   C13] FS:  0000000000000000(0000) GS:ffff8c45af904000(0000) knlGS:0000000000000000
2025-05-12T22:30:03.264828+02:00 lisa kernel: [   C13] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
2025-05-12T22:30:03.264831+02:00 lisa kernel: [   C13] CR2: 000055c7f7753008 CR3: 0000000b6083c000 CR4: 0000000000750ef0
2025-05-12T22:30:03.264833+02:00 lisa kernel: [   C13] PKRU: 55555554
2025-05-12T22:30:03.264835+02:00 lisa kernel: [   C13] Call Trace:
2025-05-12T22:30:03.264837+02:00 lisa kernel: [   C13]  <TASK>
2025-05-12T22:30:03.264840+02:00 lisa kernel: [   C13]  ? __pfx_flush_tlb_func+0x10/0x10
2025-05-12T22:30:03.264881+02:00 lisa kernel: [   C13]  on_each_cpu_cond_mask+0x1c/0x40
2025-05-12T22:30:03.264883+02:00 lisa kernel: [   C13]  flush_tlb_mm_range+0x3f2/0x640
2025-05-12T22:30:03.264885+02:00 lisa kernel: [   C13]  tlb_flush_mmu+0x79/0x1b0
2025-05-12T22:30:03.264888+02:00 lisa kernel: [   C13]  tlb_finish_mmu+0x3f/0x80
2025-05-12T22:30:03.264890+02:00 lisa kernel: [   C13]  exit_mmap+0x1cc/0x2d0
2025-05-12T22:30:03.264893+02:00 lisa kernel: [   C13]  __mmput+0x26/0xe0
2025-05-12T22:30:03.264896+02:00 lisa kernel: [   C13]  exit_mm+0x94/0xc0
2025-05-12T22:30:03.264898+02:00 lisa kernel: [   C13]  do_exit+0x1f0/0x860
2025-05-12T22:30:03.264901+02:00 lisa kernel: [   C13]  ? rt_spin_lock+0x3d/0xa0
2025-05-12T22:30:03.264902+02:00 lisa kernel: [   C13]  do_group_exit+0x96/0xa0
2025-05-12T22:30:03.264905+02:00 lisa kernel: [   C13]  __x64_sys_exit_group+0x12/0x20
2025-05-12T22:30:03.264907+02:00 lisa kernel: [   C13]  x64_sys_call+0x21ba/0x21c0
2025-05-12T22:30:03.264909+02:00 lisa kernel: [   C13]  do_syscall_64+0x6c/0xfa0
2025-05-12T22:30:03.264912+02:00 lisa kernel: [   C13]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:30:03.264914+02:00 lisa kernel: [   C13]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:30:03.264916+02:00 lisa kernel: [   C13]  entry_SYSCALL_64_after_hwframe+0x76/0x7e
2025-05-12T22:30:03.264918+02:00 lisa kernel: [   C13] RIP: 0033:0x7fd02e538295
2025-05-12T22:30:03.264920+02:00 lisa kernel: [   C13] Code: Unable to access opcode bytes at 0x7fd02e53826b.
2025-05-12T22:30:03.264922+02:00 lisa kernel: [   C13] RSP: 002b:00007ffd3420ef28 EFLAGS: 00000206 ORIG_RAX: 00000000000000e7
2025-05-12T22:30:03.264925+02:00 lisa kernel: [   C13] RAX: ffffffffffffffda RBX: 00007fd02e643fe8 RCX: 00007fd02e538295
2025-05-12T22:30:03.264927+02:00 lisa kernel: [   C13] RDX: 00000000000000e7 RSI: fffffffffffffbf8 RDI: 0000000000000000
2025-05-12T22:30:03.264929+02:00 lisa kernel: [   C13] RBP: 0000000000000000 R08: 00007ffd3420eeb8 R09: 0000000000000000
2025-05-12T22:30:03.264932+02:00 lisa kernel: [   C13] R10: 00007ffd3420ed50 R11: 0000000000000206 R12: 00007fd02e642680
2025-05-12T22:30:03.264934+02:00 lisa kernel: [   C13] R13: 00007fd02ebdbc80 R14: 0000000000000040 R15: 00007fd02e644000
2025-05-12T22:30:03.264937+02:00 lisa kernel: [   C13]  </TASK>
2025-05-12T22:30:03.264939+02:00 lisa kernel: [  T245] sysrq: Emergency Sync
2025-05-12T22:30:03.290583+02:00 lisa kernel: [  T313] Emergency Sync complete
2025-05-12T22:30:04.306586+02:00 lisa kernel: [  T245] sysrq: Emergency Sync
2025-05-12T22:30:04.334586+02:00 lisa kernel: [  T313] Emergency Sync complete
2025-05-12T22:30:05.136589+02:00 lisa kernel: [  T245] sysrq: Emergency Sync
2025-05-12T22:30:05.164583+02:00 lisa kernel: [  T313] Emergency Sync complete
2025-05-12T22:31:54.793635+02:00 lisa kernel: [    C3] watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [xfsettingsd:1693]
2025-05-12T22:31:54.793649+02:00 lisa kernel: [    C3] Modules linked in: ccm snd_seq_dummy snd_hrtimer snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq snd_seq_device rfcomm bnep nls_ascii nls_cp437 vfat fat snd_ctl_led snd_hda_codec_realtek snd_hda_scodec_component snd_hda_codec_generic snd_hda_codec_hdmi snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_acp3x_pdm_dma snd_soc_dmic snd_acp3x_rn btusb snd_soc_core snd_hwdep btbcm snd_hda_core uvcvideo btintel btrtl snd_pcm_oss videobuf2_vmalloc btmtk videobuf2_memops uvc videobuf2_v4l2 snd_mixer_oss bluetooth videodev snd_pcm snd_rn_pci_acp3x snd_acp_config snd_soc_acpi videobuf2_common snd_timer msi_wmi ecdh_generic ecc mc sparse_keymap wmi_bmof snd edac_mce_amd snd_pci_acp3x soundcore k10temp ccp battery ac button joydev hid_sensor_gyro_3d hid_sensor_als hid_sensor_accel_3d hid_sensor_magn_3d hid_sensor_prox hid_sensor_trigger hid_sensor_iio_common industrialio_triggered_buffer kfifo_buf amd_pmc industrialio evdev mt7921e mt7921_common mt792x_lib mt76_connac_lib mt76 mac80211 libarc4 cfg80211 rfkill msr
2025-05-12T22:31:54.793652+02:00 lisa kernel: [    C3]  fuse nvme_fabrics efi_pstore configfs efivarfs autofs4 ext4 mbcache jbd2 amdgpu usbhid drm_panel_backlight_quirks cec drm_buddy drm_suballoc_helper drm_exec i2c_algo_bit drm_display_helper xhci_pci gpu_sched xhci_hcd hid_sensor_hub hid_multitouch drm_ttm_helper mfd_core hid_generic ttm usbcore i2c_hid_acpi drm_client_lib psmouse nvme amd_sfh i2c_hid drm_kms_helper nvme_core hid serio_raw r8169 usb_common i2c_piix4 amdxcp crc16 i2c_smbus i2c_designware_platform i2c_designware_core
2025-05-12T22:31:54.793655+02:00 lisa kernel: [    C3] CPU: 3 UID: 1000 PID: 1693 Comm: xfsettingsd Tainted: G             L      6.15.0-rc2-bisect-00574-gfe80b0e53d36 #901 PREEMPT_{RT,(full)} 
2025-05-12T22:31:54.793657+02:00 lisa kernel: [    C3] Tainted: [L]=SOFTLOCKUP
2025-05-12T22:31:54.793659+02:00 lisa kernel: [    C3] Hardware name: Micro-Star International Co., Ltd. Alpha 15 B5EEK/MS-158L, BIOS E158LAMS.10F 11/11/2024
2025-05-12T22:31:54.793661+02:00 lisa kernel: [    C3] RIP: 0010:smp_call_function_many_cond+0x303/0x350
2025-05-12T22:31:54.793662+02:00 lisa kernel: [    C3] Code: bc c8 f7 c1 f0 ff ff ff 75 28 48 8b 03 89 ca 83 e2 0f 48 8b 14 d5 50 7a 7d be f7 44 02 08 01 00 00 00 74 bd f3 90 8b 74 10 08 <40> f6 c6 01 75 f4 eb af 65 48 8b 05 8d 02 6d 01 48 3b 44 24 38 75
2025-05-12T22:31:54.793664+02:00 lisa kernel: [    C3] RSP: 0018:ffffd3bdc65cfc28 EFLAGS: 00000202
2025-05-12T22:31:54.793665+02:00 lisa kernel: [    C3] RAX: ffffffffbf063ee0 RBX: ffff8c456e6e31c0 RCX: 0000000000000006
2025-05-12T22:31:54.793667+02:00 lisa kernel: [    C3] RDX: ffff8c45af744000 RSI: 0000000000000011 RDI: ffff8c456e6e1240
2025-05-12T22:31:54.793669+02:00 lisa kernel: [    C3] RBP: 0000000000000003 R08: ffffffffffffffff R09: ffffffffffffffff
2025-05-12T22:31:54.793671+02:00 lisa kernel: [    C3] R10: ffff8c45af684000 R11: ffffffffbd886fc0 R12: 0000000000000000
2025-05-12T22:31:54.793673+02:00 lisa kernel: [    C3] R13: 000000000000000e R14: 0000000000000202 R15: 0000000000000000
2025-05-12T22:31:54.793674+02:00 lisa kernel: [    C3] FS:  00007f0621c91b00(0000) GS:ffff8c45af684000(0000) knlGS:0000000000000000
2025-05-12T22:31:54.793676+02:00 lisa kernel: [    C3] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
2025-05-12T22:31:54.793678+02:00 lisa kernel: [    C3] CR2: 00000cbd4746a300 CR3: 0000000301556000 CR4: 0000000000750ef0
2025-05-12T22:31:54.793679+02:00 lisa kernel: [    C3] PKRU: 55555554
2025-05-12T22:31:54.793681+02:00 lisa kernel: [    C3] Call Trace:
2025-05-12T22:31:54.793683+02:00 lisa kernel: [    C3]  <TASK>
2025-05-12T22:31:54.793684+02:00 lisa kernel: [    C3]  ? __pfx_flush_tlb_func+0x10/0x10
2025-05-12T22:31:54.793686+02:00 lisa kernel: [    C3]  on_each_cpu_cond_mask+0x1c/0x40
2025-05-12T22:31:54.793688+02:00 lisa kernel: [    C3]  flush_tlb_mm_range+0x3f2/0x640
2025-05-12T22:31:54.793690+02:00 lisa kernel: [    C3]  copy_mm+0x6d2/0x890
2025-05-12T22:31:54.793691+02:00 lisa kernel: [    C3]  copy_process+0x6b5/0xf90
2025-05-12T22:31:54.793693+02:00 lisa kernel: [    C3]  kernel_clone+0x94/0x2e0
2025-05-12T22:31:54.793695+02:00 lisa kernel: [    C3]  ? rt_spin_lock+0x3d/0xa0
2025-05-12T22:31:54.793696+02:00 lisa kernel: [    C3]  __x64_sys_clone+0xc3/0xf0
2025-05-12T22:31:54.793698+02:00 lisa kernel: [    C3]  do_syscall_64+0x6c/0xfa0
2025-05-12T22:31:54.793700+02:00 lisa kernel: [    C3]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.793701+02:00 lisa kernel: [    C3]  entry_SYSCALL_64_after_hwframe+0x76/0x7e
2025-05-12T22:31:54.793703+02:00 lisa kernel: [    C3] RIP: 0033:0x7f0622ca4202
2025-05-12T22:31:54.793705+02:00 lisa kernel: [    C3] Code: 89 e7 e8 71 3b f6 ff 45 31 c0 31 d2 31 f6 64 48 8b 04 25 10 00 00 00 bf 11 00 20 01 4c 8d 90 d0 02 00 00 b8 38 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 5e 89 c5 85 c0 75 31 64 48 8b 04 25 10 00 00
2025-05-12T22:31:54.793706+02:00 lisa kernel: [    C3] RSP: 002b:00007ffd091cb4d0 EFLAGS: 00000246 ORIG_RAX: 0000000000000038
2025-05-12T22:31:54.793708+02:00 lisa kernel: [    C3] RAX: ffffffffffffffda RBX: 00007ffd091cb4d0 RCX: 00007f0622ca4202
2025-05-12T22:31:54.793710+02:00 lisa kernel: [    C3] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000001200011
2025-05-12T22:31:54.793712+02:00 lisa kernel: [    C3] RBP: 00007ffd091cba20 R08: 0000000000000000 R09: 0000000000000000
2025-05-12T22:31:54.793713+02:00 lisa kernel: [    C3] R10: 00007f0621c91dd0 R11: 0000000000000246 R12: 00007ffd091cb500
2025-05-12T22:31:54.793715+02:00 lisa kernel: [    C3] R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000000
2025-05-12T22:31:54.793716+02:00 lisa kernel: [    C3]  </TASK>
2025-05-12T22:31:54.793718+02:00 lisa kernel: [   C12] watchdog: BUG: soft lockup - CPU#12 stuck for 22s! [Xorg:1388]
2025-05-12T22:31:54.793720+02:00 lisa kernel: [   C12] Modules linked in: ccm snd_seq_dummy snd_hrtimer snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq snd_seq_device rfcomm bnep nls_ascii nls_cp437 vfat fat snd_ctl_led snd_hda_codec_realtek snd_hda_scodec_component snd_hda_codec_generic snd_hda_codec_hdmi snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_acp3x_pdm_dma snd_soc_dmic snd_acp3x_rn btusb snd_soc_core snd_hwdep btbcm snd_hda_core uvcvideo btintel btrtl snd_pcm_oss videobuf2_vmalloc btmtk videobuf2_memops uvc videobuf2_v4l2 snd_mixer_oss bluetooth videodev snd_pcm snd_rn_pci_acp3x snd_acp_config snd_soc_acpi videobuf2_common snd_timer msi_wmi ecdh_generic ecc mc sparse_keymap wmi_bmof snd edac_mce_amd snd_pci_acp3x soundcore k10temp ccp battery ac button joydev hid_sensor_gyro_3d hid_sensor_als hid_sensor_accel_3d hid_sensor_magn_3d hid_sensor_prox hid_sensor_trigger hid_sensor_iio_common industrialio_triggered_buffer kfifo_buf amd_pmc industrialio evdev mt7921e mt7921_common mt792x_lib mt76_connac_lib mt76 mac80211 libarc4 cfg80211 rfkill msr
2025-05-12T22:31:54.793722+02:00 lisa kernel: [   C12]  fuse nvme_fabrics efi_pstore configfs efivarfs autofs4 ext4 mbcache jbd2 amdgpu usbhid drm_panel_backlight_quirks cec drm_buddy drm_suballoc_helper drm_exec i2c_algo_bit drm_display_helper xhci_pci gpu_sched xhci_hcd hid_sensor_hub hid_multitouch drm_ttm_helper mfd_core hid_generic ttm usbcore i2c_hid_acpi drm_client_lib psmouse nvme amd_sfh i2c_hid drm_kms_helper nvme_core hid serio_raw r8169 usb_common i2c_piix4 amdxcp crc16 i2c_smbus i2c_designware_platform i2c_designware_core
2025-05-12T22:31:54.793724+02:00 lisa kernel: [   C12] CPU: 12 UID: 1000 PID: 1388 Comm: Xorg Tainted: G             L      6.15.0-rc2-bisect-00574-gfe80b0e53d36 #901 PREEMPT_{RT,(full)} 
2025-05-12T22:31:54.793726+02:00 lisa kernel: [   C12] Tainted: [L]=SOFTLOCKUP
2025-05-12T22:31:54.793727+02:00 lisa kernel: [   C12] Hardware name: Micro-Star International Co., Ltd. Alpha 15 B5EEK/MS-158L, BIOS E158LAMS.10F 11/11/2024
2025-05-12T22:31:54.793729+02:00 lisa kernel: [   C12] RIP: 0010:smp_call_function_many_cond+0x303/0x350
2025-05-12T22:31:54.793731+02:00 lisa kernel: [   C12] Code: bc c8 f7 c1 f0 ff ff ff 75 28 48 8b 03 89 ca 83 e2 0f 48 8b 14 d5 50 7a 7d be f7 44 02 08 01 00 00 00 74 bd f3 90 8b 74 10 08 <40> f6 c6 01 75 f4 eb af 65 48 8b 05 8d 02 6d 01 48 3b 44 24 38 75
2025-05-12T22:31:54.793733+02:00 lisa kernel: [   C12] RSP: 0018:ffffd3bdc4c07b28 EFLAGS: 00000202
2025-05-12T22:31:54.793735+02:00 lisa kernel: [   C12] RAX: ffffffffbf063e80 RBX: ffff8c456e9231c0 RCX: 0000000000000006
2025-05-12T22:31:54.793736+02:00 lisa kernel: [   C12] RDX: ffff8c45af744000 RSI: 0000000000000011 RDI: ffff8c456e921240
2025-05-12T22:31:54.793738+02:00 lisa kernel: [   C12] RBP: 0000000000000003 R08: 0000000000000000 R09: 0000000000200000
2025-05-12T22:31:54.793740+02:00 lisa kernel: [   C12] R10: ffff8c45af8c4000 R11: ffffffffbd886fc0 R12: 0000000000000000
2025-05-12T22:31:54.793741+02:00 lisa kernel: [   C12] R13: 0000000000000000 R14: 0000000000000202 R15: 0000000000000006
2025-05-12T22:31:54.793743+02:00 lisa kernel: [   C12] FS:  00007f460cbc8b00(0000) GS:ffff8c45af8c4000(0000) knlGS:0000000000000000
2025-05-12T22:31:54.793745+02:00 lisa kernel: [   C12] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
2025-05-12T22:31:54.793746+02:00 lisa kernel: [   C12] CR2: 00007f474c7a8009 CR3: 0000000108ffa000 CR4: 0000000000750ef0
2025-05-12T22:31:54.793748+02:00 lisa kernel: [   C12] PKRU: 55555554
2025-05-12T22:31:54.793750+02:00 lisa kernel: [   C12] Call Trace:
2025-05-12T22:31:54.793751+02:00 lisa kernel: [   C12]  <TASK>
2025-05-12T22:31:54.793753+02:00 lisa kernel: [   C12]  ? __pfx_flush_tlb_func+0x10/0x10
2025-05-12T22:31:54.793755+02:00 lisa kernel: [   C12]  on_each_cpu_cond_mask+0x1c/0x40
2025-05-12T22:31:54.793757+02:00 lisa kernel: [   C12]  flush_tlb_mm_range+0x3f2/0x640
2025-05-12T22:31:54.793824+02:00 lisa kernel: [   C12]  tlb_flush_mmu+0x79/0x1b0
2025-05-12T22:31:54.793826+02:00 lisa kernel: [   C12]  tlb_finish_mmu+0x3f/0x80
2025-05-12T22:31:54.793828+02:00 lisa kernel: [   C12]  vms_clear_ptes+0x118/0x150
2025-05-12T22:31:54.793830+02:00 lisa kernel: [   C12]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.793831+02:00 lisa kernel: [   C12]  ? mas_store_gfp+0xe0/0x190
2025-05-12T22:31:54.793833+02:00 lisa kernel: [   C12]  vms_complete_munmap_vmas+0x78/0x1b0
2025-05-12T22:31:54.793835+02:00 lisa kernel: [   C12]  do_vmi_align_munmap+0x251/0x290
2025-05-12T22:31:54.793837+02:00 lisa kernel: [   C12]  ? __pfx_amdgpu_gem_va_ioctl+0x10/0x10 [amdgpu]
2025-05-12T22:31:54.793838+02:00 lisa kernel: [   C12]  do_vmi_munmap+0xd6/0x100
2025-05-12T22:31:54.793839+02:00 lisa kernel: [   C12]  __vm_munmap+0xcc/0x130
2025-05-12T22:31:54.793841+02:00 lisa kernel: [   C12]  __x64_sys_munmap+0x16/0x20
2025-05-12T22:31:54.793843+02:00 lisa kernel: [   C12]  do_syscall_64+0x6c/0xfa0
2025-05-12T22:31:54.793845+02:00 lisa kernel: [   C12]  ? __irq_exit_rcu+0x6d/0xf0
2025-05-12T22:31:54.793846+02:00 lisa kernel: [   C12]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.793848+02:00 lisa kernel: [   C12]  entry_SYSCALL_64_after_hwframe+0x76/0x7e
2025-05-12T22:31:54.793849+02:00 lisa kernel: [   C12] RIP: 0033:0x7f460cf4a6d7
2025-05-12T22:31:54.793851+02:00 lisa kernel: [   C12] Code: 73 01 c3 48 8b 0d 21 97 0d 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 b8 0b 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d f1 96 0d 00 f7 d8 64 89 01 48
2025-05-12T22:31:54.793853+02:00 lisa kernel: [   C12] RSP: 002b:00007fff32a17e88 EFLAGS: 00000246 ORIG_RAX: 000000000000000b
2025-05-12T22:31:54.793855+02:00 lisa kernel: [   C12] RAX: ffffffffffffffda RBX: 000055a7ad46a260 RCX: 00007f460cf4a6d7
2025-05-12T22:31:54.793856+02:00 lisa kernel: [   C12] RDX: 0000000000000001 RSI: 0000000000200000 RDI: 00007f45a7e00000
2025-05-12T22:31:54.793858+02:00 lisa kernel: [   C12] RBP: 000055a7abb0e240 R08: 0000000000000030 R09: 0000000000000000
2025-05-12T22:31:54.793860+02:00 lisa kernel: [   C12] R10: 0000000000000001 R11: 0000000000000246 R12: 000055a7ad46a280
2025-05-12T22:31:54.793862+02:00 lisa kernel: [   C12] R13: 000055a7ad51b630 R14: 000055a7ad210a80 R15: 000055a7abb1a530
2025-05-12T22:31:54.793863+02:00 lisa kernel: [   C12]  </TASK>
2025-05-12T22:31:54.793865+02:00 lisa kernel: [   C10] watchdog: BUG: soft lockup - CPU#10 stuck for 45s! [Isolated Web Co:2298]
2025-05-12T22:31:54.793867+02:00 lisa kernel: [   C10] Modules linked in: ccm snd_seq_dummy snd_hrtimer snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq snd_seq_device rfcomm bnep nls_ascii nls_cp437 vfat fat snd_ctl_led snd_hda_codec_realtek snd_hda_scodec_component snd_hda_codec_generic snd_hda_codec_hdmi snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_acp3x_pdm_dma snd_soc_dmic snd_acp3x_rn btusb snd_soc_core snd_hwdep btbcm snd_hda_core uvcvideo btintel btrtl snd_pcm_oss videobuf2_vmalloc btmtk videobuf2_memops uvc videobuf2_v4l2 snd_mixer_oss bluetooth videodev snd_pcm snd_rn_pci_acp3x snd_acp_config snd_soc_acpi videobuf2_common snd_timer msi_wmi ecdh_generic ecc mc sparse_keymap wmi_bmof snd edac_mce_amd snd_pci_acp3x soundcore k10temp ccp battery ac button joydev hid_sensor_gyro_3d hid_sensor_als hid_sensor_accel_3d hid_sensor_magn_3d hid_sensor_prox hid_sensor_trigger hid_sensor_iio_common industrialio_triggered_buffer kfifo_buf amd_pmc industrialio evdev mt7921e mt7921_common mt792x_lib mt76_connac_lib mt76 mac80211 libarc4 cfg80211 rfkill msr
2025-05-12T22:31:54.793868+02:00 lisa kernel: [   C10]  fuse nvme_fabrics efi_pstore configfs efivarfs autofs4 ext4 mbcache jbd2 amdgpu usbhid drm_panel_backlight_quirks cec drm_buddy drm_suballoc_helper drm_exec i2c_algo_bit drm_display_helper xhci_pci gpu_sched xhci_hcd hid_sensor_hub hid_multitouch drm_ttm_helper mfd_core hid_generic ttm usbcore i2c_hid_acpi drm_client_lib psmouse nvme amd_sfh i2c_hid drm_kms_helper nvme_core hid serio_raw r8169 usb_common i2c_piix4 amdxcp crc16 i2c_smbus i2c_designware_platform i2c_designware_core
2025-05-12T22:31:54.793870+02:00 lisa kernel: [   C10] CPU: 10 UID: 1000 PID: 2298 Comm: Isolated Web Co Tainted: G             L      6.15.0-rc2-bisect-00574-gfe80b0e53d36 #901 PREEMPT_{RT,(full)} 
2025-05-12T22:31:54.793872+02:00 lisa kernel: [   C10] Tainted: [L]=SOFTLOCKUP
2025-05-12T22:31:54.793874+02:00 lisa kernel: [   C10] Hardware name: Micro-Star International Co., Ltd. Alpha 15 B5EEK/MS-158L, BIOS E158LAMS.10F 11/11/2024
2025-05-12T22:31:54.793875+02:00 lisa kernel: [   C10] RIP: 0010:smp_call_function_many_cond+0x2ff/0x350
2025-05-12T22:31:54.793877+02:00 lisa kernel: [   C10] Code: 35 f3 48 0f bc c8 f7 c1 f0 ff ff ff 75 28 48 8b 03 89 ca 83 e2 0f 48 8b 14 d5 50 7a 7d be f7 44 02 08 01 00 00 00 74 bd f3 90 <8b> 74 10 08 40 f6 c6 01 75 f4 eb af 65 48 8b 05 8d 02 6d 01 48 3b
2025-05-12T22:31:54.793879+02:00 lisa kernel: [   C10] RSP: 0018:ffffd3bdc16af9c8 EFLAGS: 00000202
2025-05-12T22:31:54.793880+02:00 lisa kernel: [   C10] RAX: ffffffffbf063e60 RBX: ffff8c456e8a31c0 RCX: 0000000000000006
2025-05-12T22:31:54.793882+02:00 lisa kernel: [   C10] RDX: ffff8c45af744000 RSI: 0000000000000011 RDI: ffff8c456e8a1240
2025-05-12T22:31:54.793884+02:00 lisa kernel: [   C10] RBP: 0000000000000003 R08: ffffffffffffffff R09: ffffffffffffffff
2025-05-12T22:31:54.793885+02:00 lisa kernel: [   C10] R10: ffff8c45af844000 R11: ffffffffbd886fc0 R12: 0000000000000000
2025-05-12T22:31:54.793887+02:00 lisa kernel: [   C10] R13: 0000000000000001 R14: 0000000000000202 R15: 0000000000000006
2025-05-12T22:31:54.793889+02:00 lisa kernel: [   C10] FS:  00007fd4b176dbc0(0000) GS:ffff8c45af844000(0000) knlGS:0000000000000000
2025-05-12T22:31:54.793891+02:00 lisa kernel: [   C10] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
2025-05-12T22:31:54.793893+02:00 lisa kernel: [   C10] CR2: 00007fd48a9dcfe0 CR3: 000000021b420000 CR4: 0000000000750ef0
2025-05-12T22:31:54.793894+02:00 lisa kernel: [   C10] PKRU: 55555554
2025-05-12T22:31:54.793896+02:00 lisa kernel: [   C10] Call Trace:
2025-05-12T22:31:54.793898+02:00 lisa kernel: [   C10]  <TASK>
2025-05-12T22:31:54.793899+02:00 lisa kernel: [   C10]  ? __pfx_flush_tlb_func+0x10/0x10
2025-05-12T22:31:54.793901+02:00 lisa kernel: [   C10]  on_each_cpu_cond_mask+0x1c/0x40
2025-05-12T22:31:54.793902+02:00 lisa kernel: [   C10]  flush_tlb_mm_range+0x3f2/0x640
2025-05-12T22:31:54.793904+02:00 lisa kernel: [   C10]  tlb_flush_mmu+0x79/0x1b0
2025-05-12T22:31:54.793906+02:00 lisa kernel: [   C10]  tlb_finish_mmu+0x3f/0x80
2025-05-12T22:31:54.793908+02:00 lisa kernel: [   C10]  vms_clear_ptes+0x118/0x150
2025-05-12T22:31:54.793909+02:00 lisa kernel: [   C10]  ? vms_gather_munmap_vmas+0x210/0x2a0
2025-05-12T22:31:54.793911+02:00 lisa kernel: [   C10]  mmap_region+0x4ae/0xc50
2025-05-12T22:31:54.793913+02:00 lisa kernel: [   C10]  do_mmap+0x4ab/0x5e0
2025-05-12T22:31:54.793914+02:00 lisa kernel: [   C10]  vm_mmap_pgoff+0xe6/0x190
2025-05-12T22:31:54.793916+02:00 lisa kernel: [   C10]  do_syscall_64+0x6c/0xfa0
2025-05-12T22:31:54.793918+02:00 lisa kernel: [   C10]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.793919+02:00 lisa kernel: [   C10]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.793921+02:00 lisa kernel: [   C10]  entry_SYSCALL_64_after_hwframe+0x76/0x7e
2025-05-12T22:31:54.793923+02:00 lisa kernel: [   C10] RIP: 0033:0x7fd4b18c2779
2025-05-12T22:31:54.793924+02:00 lisa kernel: [   C10] Code: ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4f 86 0d 00 f7 d8 64 89 01 48
2025-05-12T22:31:54.793926+02:00 lisa kernel: [   C10] RSP: 002b:00007fff990a2298 EFLAGS: 00000246 ORIG_RAX: 0000000000000009
2025-05-12T22:31:54.793928+02:00 lisa kernel: [   C10] RAX: ffffffffffffffda RBX: 0000000000500000 RCX: 00007fd4b18c2779
2025-05-12T22:31:54.793929+02:00 lisa kernel: [   C10] RDX: 0000000000000000 RSI: 0000000000500000 RDI: 00007fd48f600000
2025-05-12T22:31:54.793931+02:00 lisa kernel: [   C10] RBP: 00007fd4b1602100 R08: 00000000ffffffff R09: 0000000000000000
2025-05-12T22:31:54.793933+02:00 lisa kernel: [   C10] R10: 0000000000000032 R11: 0000000000000246 R12: 00007fd48f600000
2025-05-12T22:31:54.793934+02:00 lisa kernel: [   C10] R13: 00007fd48a99e000 R14: 0000000000500000 R15: 00007fd48f600000
2025-05-12T22:31:54.793936+02:00 lisa kernel: [   C10]  </TASK>
2025-05-12T22:31:54.793938+02:00 lisa kernel: [   C11] watchdog: BUG: soft lockup - CPU#11 stuck for 53s! [cc1:37564]
2025-05-12T22:31:54.793940+02:00 lisa kernel: [   C11] Modules linked in: ccm snd_seq_dummy snd_hrtimer snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq snd_seq_device rfcomm bnep nls_ascii nls_cp437 vfat fat snd_ctl_led snd_hda_codec_realtek snd_hda_scodec_component snd_hda_codec_generic snd_hda_codec_hdmi snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_acp3x_pdm_dma snd_soc_dmic snd_acp3x_rn btusb snd_soc_core snd_hwdep btbcm snd_hda_core uvcvideo btintel btrtl snd_pcm_oss videobuf2_vmalloc btmtk videobuf2_memops uvc videobuf2_v4l2 snd_mixer_oss bluetooth videodev snd_pcm snd_rn_pci_acp3x snd_acp_config snd_soc_acpi videobuf2_common snd_timer msi_wmi ecdh_generic ecc mc sparse_keymap wmi_bmof snd edac_mce_amd snd_pci_acp3x soundcore k10temp ccp battery ac button joydev hid_sensor_gyro_3d hid_sensor_als hid_sensor_accel_3d hid_sensor_magn_3d hid_sensor_prox hid_sensor_trigger hid_sensor_iio_common industrialio_triggered_buffer kfifo_buf amd_pmc industrialio evdev mt7921e mt7921_common mt792x_lib mt76_connac_lib mt76 mac80211 libarc4 cfg80211 rfkill msr
2025-05-12T22:31:54.794016+02:00 lisa kernel: [   C11]  fuse nvme_fabrics efi_pstore configfs efivarfs autofs4 ext4 mbcache jbd2 amdgpu usbhid drm_panel_backlight_quirks cec drm_buddy drm_suballoc_helper drm_exec i2c_algo_bit drm_display_helper xhci_pci gpu_sched xhci_hcd hid_sensor_hub hid_multitouch drm_ttm_helper mfd_core hid_generic ttm usbcore i2c_hid_acpi drm_client_lib psmouse nvme amd_sfh i2c_hid drm_kms_helper nvme_core hid serio_raw r8169 usb_common i2c_piix4 amdxcp crc16 i2c_smbus i2c_designware_platform i2c_designware_core
2025-05-12T22:31:54.794018+02:00 lisa kernel: [   C11] CPU: 11 UID: 1000 PID: 37564 Comm: cc1 Tainted: G             L      6.15.0-rc2-bisect-00574-gfe80b0e53d36 #901 PREEMPT_{RT,(full)} 
2025-05-12T22:31:54.794019+02:00 lisa kernel: [   C11] Tainted: [L]=SOFTLOCKUP
2025-05-12T22:31:54.794021+02:00 lisa kernel: [   C11] Hardware name: Micro-Star International Co., Ltd. Alpha 15 B5EEK/MS-158L, BIOS E158LAMS.10F 11/11/2024
2025-05-12T22:31:54.794023+02:00 lisa kernel: [   C11] RIP: 0010:smp_call_function_many_cond+0x303/0x350
2025-05-12T22:31:54.794024+02:00 lisa kernel: [   C11] Code: bc c8 f7 c1 f0 ff ff ff 75 28 48 8b 03 89 ca 83 e2 0f 48 8b 14 d5 50 7a 7d be f7 44 02 08 01 00 00 00 74 bd f3 90 8b 74 10 08 <40> f6 c6 01 75 f4 eb af 65 48 8b 05 8d 02 6d 01 48 3b 44 24 38 75
2025-05-12T22:31:54.794026+02:00 lisa kernel: [   C11] RSP: 0018:ffffd3bde215fc40 EFLAGS: 00000202
2025-05-12T22:31:54.794028+02:00 lisa kernel: [   C11] RAX: ffffffffbf063f60 RBX: ffff8c456e8e31c0 RCX: 0000000000000006
2025-05-12T22:31:54.794029+02:00 lisa kernel: [   C11] RDX: ffff8c45af744000 RSI: 0000000000000011 RDI: ffff8c37d053f200
2025-05-12T22:31:54.794031+02:00 lisa kernel: [   C11] RBP: 0000000000000003 R08: 0000000000000000 R09: ffffffffffffffff
2025-05-12T22:31:54.794033+02:00 lisa kernel: [   C11] R10: ffff8c45af884000 R11: ffffffffbd886fc0 R12: 0000000000000000
2025-05-12T22:31:54.794035+02:00 lisa kernel: [   C11] R13: 0000000000000001 R14: 0000000000000202 R15: 0000000000000006
2025-05-12T22:31:54.794036+02:00 lisa kernel: [   C11] FS:  0000000000000000(0000) GS:ffff8c45af884000(0000) knlGS:0000000000000000
2025-05-12T22:31:54.794038+02:00 lisa kernel: [   C11] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
2025-05-12T22:31:54.794040+02:00 lisa kernel: [   C11] CR2: 00007f92caf17280 CR3: 0000000b6083c000 CR4: 0000000000750ef0
2025-05-12T22:31:54.794041+02:00 lisa kernel: [   C11] PKRU: 55555554
2025-05-12T22:31:54.794043+02:00 lisa kernel: [   C11] Call Trace:
2025-05-12T22:31:54.794045+02:00 lisa kernel: [   C11]  <TASK>
2025-05-12T22:31:54.794046+02:00 lisa kernel: [   C11]  ? __pfx_flush_tlb_func+0x10/0x10
2025-05-12T22:31:54.794048+02:00 lisa kernel: [   C11]  on_each_cpu_cond_mask+0x1c/0x40
2025-05-12T22:31:54.794050+02:00 lisa kernel: [   C11]  flush_tlb_mm_range+0x3f2/0x640
2025-05-12T22:31:54.794051+02:00 lisa kernel: [   C11]  tlb_flush_mmu+0x79/0x1b0
2025-05-12T22:31:54.794053+02:00 lisa kernel: [   C11]  tlb_finish_mmu+0x3f/0x80
2025-05-12T22:31:54.794055+02:00 lisa kernel: [   C11]  exit_mmap+0x1cc/0x2d0
2025-05-12T22:31:54.794057+02:00 lisa kernel: [   C11]  __mmput+0x26/0xe0
2025-05-12T22:31:54.794058+02:00 lisa kernel: [   C11]  exit_mm+0x94/0xc0
2025-05-12T22:31:54.794060+02:00 lisa kernel: [   C11]  do_exit+0x1f0/0x860
2025-05-12T22:31:54.794061+02:00 lisa kernel: [   C11]  ? rt_spin_lock+0x3d/0xa0
2025-05-12T22:31:54.794063+02:00 lisa kernel: [   C11]  do_group_exit+0x96/0xa0
2025-05-12T22:31:54.794065+02:00 lisa kernel: [   C11]  __x64_sys_exit_group+0x12/0x20
2025-05-12T22:31:54.794067+02:00 lisa kernel: [   C11]  x64_sys_call+0x21ba/0x21c0
2025-05-12T22:31:54.794068+02:00 lisa kernel: [   C11]  do_syscall_64+0x6c/0xfa0
2025-05-12T22:31:54.794070+02:00 lisa kernel: [   C11]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.794072+02:00 lisa kernel: [   C11]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.794073+02:00 lisa kernel: [   C11]  entry_SYSCALL_64_after_hwframe+0x76/0x7e
2025-05-12T22:31:54.794075+02:00 lisa kernel: [   C11] RIP: 0033:0x7f92caf17295
2025-05-12T22:31:54.794077+02:00 lisa kernel: [   C11] Code: Unable to access opcode bytes at 0x7f92caf1726b.
2025-05-12T22:31:54.794078+02:00 lisa kernel: [   C11] RSP: 002b:00007ffd998f6ec8 EFLAGS: 00000206 ORIG_RAX: 00000000000000e7
2025-05-12T22:31:54.794080+02:00 lisa kernel: [   C11] RAX: ffffffffffffffda RBX: 00007f92cb022fe8 RCX: 00007f92caf17295
2025-05-12T22:31:54.794082+02:00 lisa kernel: [   C11] RDX: 00000000000000e7 RSI: fffffffffffffbf8 RDI: 0000000000000000
2025-05-12T22:31:54.794083+02:00 lisa kernel: [   C11] RBP: 0000000000000000 R08: 00007ffd998f6e58 R09: 0000000000000000
2025-05-12T22:31:54.794085+02:00 lisa kernel: [   C11] R10: 00007ffd998f6cf0 R11: 0000000000000206 R12: 00007f92cb021680
2025-05-12T22:31:54.794087+02:00 lisa kernel: [   C11] R13: 00007f92cb5bac80 R14: 0000000000000040 R15: 00007f92cb023000
2025-05-12T22:31:54.794089+02:00 lisa kernel: [   C11]  </TASK>
2025-05-12T22:31:54.794090+02:00 lisa kernel: [   C13] watchdog: BUG: soft lockup - CPU#13 stuck for 52s! [cc1:37695]
2025-05-12T22:31:54.794092+02:00 lisa kernel: [   C13] Modules linked in: ccm snd_seq_dummy snd_hrtimer snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq snd_seq_device rfcomm bnep nls_ascii nls_cp437 vfat fat snd_ctl_led snd_hda_codec_realtek snd_hda_scodec_component snd_hda_codec_generic snd_hda_codec_hdmi snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_acp3x_pdm_dma snd_soc_dmic snd_acp3x_rn btusb snd_soc_core snd_hwdep btbcm snd_hda_core uvcvideo btintel btrtl snd_pcm_oss videobuf2_vmalloc btmtk videobuf2_memops uvc videobuf2_v4l2 snd_mixer_oss bluetooth videodev snd_pcm snd_rn_pci_acp3x snd_acp_config snd_soc_acpi videobuf2_common snd_timer msi_wmi ecdh_generic ecc mc sparse_keymap wmi_bmof snd edac_mce_amd snd_pci_acp3x soundcore k10temp ccp battery ac button joydev hid_sensor_gyro_3d hid_sensor_als hid_sensor_accel_3d hid_sensor_magn_3d hid_sensor_prox hid_sensor_trigger hid_sensor_iio_common industrialio_triggered_buffer kfifo_buf amd_pmc industrialio evdev mt7921e mt7921_common mt792x_lib mt76_connac_lib mt76 mac80211 libarc4 cfg80211 rfkill msr
2025-05-12T22:31:54.794094+02:00 lisa kernel: [   C13]  fuse nvme_fabrics efi_pstore configfs efivarfs autofs4 ext4 mbcache jbd2 amdgpu usbhid drm_panel_backlight_quirks cec drm_buddy drm_suballoc_helper drm_exec i2c_algo_bit drm_display_helper xhci_pci gpu_sched xhci_hcd hid_sensor_hub hid_multitouch drm_ttm_helper mfd_core hid_generic ttm usbcore i2c_hid_acpi drm_client_lib psmouse nvme amd_sfh i2c_hid drm_kms_helper nvme_core hid serio_raw r8169 usb_common i2c_piix4 amdxcp crc16 i2c_smbus i2c_designware_platform i2c_designware_core
2025-05-12T22:31:54.794096+02:00 lisa kernel: [   C13] CPU: 13 UID: 1000 PID: 37695 Comm: cc1 Tainted: G             L      6.15.0-rc2-bisect-00574-gfe80b0e53d36 #901 PREEMPT_{RT,(full)} 
2025-05-12T22:31:54.794097+02:00 lisa kernel: [   C13] Tainted: [L]=SOFTLOCKUP
2025-05-12T22:31:54.794099+02:00 lisa kernel: [   C13] Hardware name: Micro-Star International Co., Ltd. Alpha 15 B5EEK/MS-158L, BIOS E158LAMS.10F 11/11/2024
2025-05-12T22:31:54.794101+02:00 lisa kernel: [   C13] RIP: 0010:smp_call_function_many_cond+0x303/0x350
2025-05-12T22:31:54.794102+02:00 lisa kernel: [   C13] Code: bc c8 f7 c1 f0 ff ff ff 75 28 48 8b 03 89 ca 83 e2 0f 48 8b 14 d5 50 7a 7d be f7 44 02 08 01 00 00 00 74 bd f3 90 8b 74 10 08 <40> f6 c6 01 75 f4 eb af 65 48 8b 05 8d 02 6d 01 48 3b 44 24 38 75
2025-05-12T22:31:54.794104+02:00 lisa kernel: [   C13] RSP: 0018:ffffd3bde25bfc40 EFLAGS: 00000202
2025-05-12T22:31:54.794106+02:00 lisa kernel: [   C13] RAX: ffffffffbf063f80 RBX: ffff8c456e9631c0 RCX: 0000000000000006
2025-05-12T22:31:54.794108+02:00 lisa kernel: [   C13] RDX: ffff8c45af744000 RSI: 0000000000000011 RDI: ffff8c456e961240
2025-05-12T22:31:54.794109+02:00 lisa kernel: [   C13] RBP: 0000000000000003 R08: 0000000000000000 R09: ffffffffffffffff
2025-05-12T22:31:54.794111+02:00 lisa kernel: [   C13] R10: ffff8c45af904000 R11: ffffffffbd886fc0 R12: 0000000000000000
2025-05-12T22:31:54.794113+02:00 lisa kernel: [   C13] R13: 0000000000000000 R14: 0000000000000202 R15: 0000000000000006
2025-05-12T22:31:54.794114+02:00 lisa kernel: [   C13] FS:  0000000000000000(0000) GS:ffff8c45af904000(0000) knlGS:0000000000000000
2025-05-12T22:31:54.794116+02:00 lisa kernel: [   C13] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
2025-05-12T22:31:54.794117+02:00 lisa kernel: [   C13] CR2: 000055c7f7753008 CR3: 0000000b6083c000 CR4: 0000000000750ef0
2025-05-12T22:31:54.794119+02:00 lisa kernel: [   C13] PKRU: 55555554
2025-05-12T22:31:54.794121+02:00 lisa kernel: [   C13] Call Trace:
2025-05-12T22:31:54.794122+02:00 lisa kernel: [   C13]  <TASK>
2025-05-12T22:31:54.794124+02:00 lisa kernel: [   C13]  ? __pfx_flush_tlb_func+0x10/0x10
2025-05-12T22:31:54.794126+02:00 lisa kernel: [   C13]  on_each_cpu_cond_mask+0x1c/0x40
2025-05-12T22:31:54.794128+02:00 lisa kernel: [   C13]  flush_tlb_mm_range+0x3f2/0x640
2025-05-12T22:31:54.794129+02:00 lisa kernel: [   C13]  tlb_flush_mmu+0x79/0x1b0
2025-05-12T22:31:54.794131+02:00 lisa kernel: [   C13]  tlb_finish_mmu+0x3f/0x80
2025-05-12T22:31:54.794132+02:00 lisa kernel: [   C13]  exit_mmap+0x1cc/0x2d0
2025-05-12T22:31:54.794134+02:00 lisa kernel: [   C13]  __mmput+0x26/0xe0
2025-05-12T22:31:54.794136+02:00 lisa kernel: [   C13]  exit_mm+0x94/0xc0
2025-05-12T22:31:54.794138+02:00 lisa kernel: [   C13]  do_exit+0x1f0/0x860
2025-05-12T22:31:54.794139+02:00 lisa kernel: [   C13]  ? rt_spin_lock+0x3d/0xa0
2025-05-12T22:31:54.794141+02:00 lisa kernel: [   C13]  do_group_exit+0x96/0xa0
2025-05-12T22:31:54.794143+02:00 lisa kernel: [   C13]  __x64_sys_exit_group+0x12/0x20
2025-05-12T22:31:54.794144+02:00 lisa kernel: [   C13]  x64_sys_call+0x21ba/0x21c0
2025-05-12T22:31:54.794146+02:00 lisa kernel: [   C13]  do_syscall_64+0x6c/0xfa0
2025-05-12T22:31:54.794148+02:00 lisa kernel: [   C13]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.794149+02:00 lisa kernel: [   C13]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.794151+02:00 lisa kernel: [   C13]  entry_SYSCALL_64_after_hwframe+0x76/0x7e
2025-05-12T22:31:54.794152+02:00 lisa kernel: [   C13] RIP: 0033:0x7fd02e538295
2025-05-12T22:31:54.794154+02:00 lisa kernel: [   C13] Code: Unable to access opcode bytes at 0x7fd02e53826b.
2025-05-12T22:31:54.794156+02:00 lisa kernel: [   C13] RSP: 002b:00007ffd3420ef28 EFLAGS: 00000206 ORIG_RAX: 00000000000000e7
2025-05-12T22:31:54.794213+02:00 lisa kernel: [   C13] RAX: ffffffffffffffda RBX: 00007fd02e643fe8 RCX: 00007fd02e538295
2025-05-12T22:31:54.794215+02:00 lisa kernel: [   C13] RDX: 00000000000000e7 RSI: fffffffffffffbf8 RDI: 0000000000000000
2025-05-12T22:31:54.794217+02:00 lisa kernel: [   C13] RBP: 0000000000000000 R08: 00007ffd3420eeb8 R09: 0000000000000000
2025-05-12T22:31:54.794218+02:00 lisa kernel: [   C13] R10: 00007ffd3420ed50 R11: 0000000000000206 R12: 00007fd02e642680
2025-05-12T22:31:54.794220+02:00 lisa kernel: [   C13] R13: 00007fd02ebdbc80 R14: 0000000000000040 R15: 00007fd02e644000
2025-05-12T22:31:54.794222+02:00 lisa kernel: [   C13]  </TASK>
2025-05-12T22:31:54.794224+02:00 lisa kernel: [    C3] watchdog: BUG: soft lockup - CPU#3 stuck for 48s! [xfsettingsd:1693]
2025-05-12T22:31:54.794225+02:00 lisa kernel: [    C3] Modules linked in: ccm snd_seq_dummy snd_hrtimer snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq snd_seq_device rfcomm bnep nls_ascii nls_cp437 vfat fat snd_ctl_led snd_hda_codec_realtek snd_hda_scodec_component snd_hda_codec_generic snd_hda_codec_hdmi snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_acp3x_pdm_dma snd_soc_dmic snd_acp3x_rn btusb snd_soc_core snd_hwdep btbcm snd_hda_core uvcvideo btintel btrtl snd_pcm_oss videobuf2_vmalloc btmtk videobuf2_memops uvc videobuf2_v4l2 snd_mixer_oss bluetooth videodev snd_pcm snd_rn_pci_acp3x snd_acp_config snd_soc_acpi videobuf2_common snd_timer msi_wmi ecdh_generic ecc mc sparse_keymap wmi_bmof snd edac_mce_amd snd_pci_acp3x soundcore k10temp ccp battery ac button joydev hid_sensor_gyro_3d hid_sensor_als hid_sensor_accel_3d hid_sensor_magn_3d hid_sensor_prox hid_sensor_trigger hid_sensor_iio_common industrialio_triggered_buffer kfifo_buf amd_pmc industrialio evdev mt7921e mt7921_common mt792x_lib mt76_connac_lib mt76 mac80211 libarc4 cfg80211 rfkill msr
2025-05-12T22:31:54.794227+02:00 lisa kernel: [    C3]  fuse nvme_fabrics efi_pstore configfs efivarfs autofs4 ext4 mbcache jbd2 amdgpu usbhid drm_panel_backlight_quirks cec drm_buddy drm_suballoc_helper drm_exec i2c_algo_bit drm_display_helper xhci_pci gpu_sched xhci_hcd hid_sensor_hub hid_multitouch drm_ttm_helper mfd_core hid_generic ttm usbcore i2c_hid_acpi drm_client_lib psmouse nvme amd_sfh i2c_hid drm_kms_helper nvme_core hid serio_raw r8169 usb_common i2c_piix4 amdxcp crc16 i2c_smbus i2c_designware_platform i2c_designware_core
2025-05-12T22:31:54.794229+02:00 lisa kernel: [    C3] CPU: 3 UID: 1000 PID: 1693 Comm: xfsettingsd Tainted: G             L      6.15.0-rc2-bisect-00574-gfe80b0e53d36 #901 PREEMPT_{RT,(full)} 
2025-05-12T22:31:54.794230+02:00 lisa kernel: [    C3] Tainted: [L]=SOFTLOCKUP
2025-05-12T22:31:54.794232+02:00 lisa kernel: [    C3] Hardware name: Micro-Star International Co., Ltd. Alpha 15 B5EEK/MS-158L, BIOS E158LAMS.10F 11/11/2024
2025-05-12T22:31:54.794234+02:00 lisa kernel: [    C3] RIP: 0010:smp_call_function_many_cond+0x303/0x350
2025-05-12T22:31:54.794243+02:00 lisa kernel: [    C3] Code: bc c8 f7 c1 f0 ff ff ff 75 28 48 8b 03 89 ca 83 e2 0f 48 8b 14 d5 50 7a 7d be f7 44 02 08 01 00 00 00 74 bd f3 90 8b 74 10 08 <40> f6 c6 01 75 f4 eb af 65 48 8b 05 8d 02 6d 01 48 3b 44 24 38 75
2025-05-12T22:31:54.794245+02:00 lisa kernel: [    C3] RSP: 0018:ffffd3bdc65cfc28 EFLAGS: 00000202
2025-05-12T22:31:54.794247+02:00 lisa kernel: [    C3] RAX: ffffffffbf063ee0 RBX: ffff8c456e6e31c0 RCX: 0000000000000006
2025-05-12T22:31:54.794248+02:00 lisa kernel: [    C3] RDX: ffff8c45af744000 RSI: 0000000000000011 RDI: ffff8c456e6e1240
2025-05-12T22:31:54.794250+02:00 lisa kernel: [    C3] RBP: 0000000000000003 R08: ffffffffffffffff R09: ffffffffffffffff
2025-05-12T22:31:54.794251+02:00 lisa kernel: [    C3] R10: ffff8c45af684000 R11: ffffffffbd886fc0 R12: 0000000000000000
2025-05-12T22:31:54.794256+02:00 lisa kernel: [    C3] R13: 000000000000000e R14: 0000000000000202 R15: 0000000000000000
2025-05-12T22:31:54.794258+02:00 lisa kernel: [    C3] FS:  00007f0621c91b00(0000) GS:ffff8c45af684000(0000) knlGS:0000000000000000
2025-05-12T22:31:54.794260+02:00 lisa kernel: [    C3] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
2025-05-12T22:31:54.794261+02:00 lisa kernel: [    C3] CR2: 00000cbd4746a300 CR3: 0000000301556000 CR4: 0000000000750ef0
2025-05-12T22:31:54.794263+02:00 lisa kernel: [    C3] PKRU: 55555554
2025-05-12T22:31:54.794265+02:00 lisa kernel: [    C3] Call Trace:
2025-05-12T22:31:54.794268+02:00 lisa kernel: [    C3]  <TASK>
2025-05-12T22:31:54.794270+02:00 lisa kernel: [    C3]  ? __pfx_flush_tlb_func+0x10/0x10
2025-05-12T22:31:54.794272+02:00 lisa kernel: [    C3]  on_each_cpu_cond_mask+0x1c/0x40
2025-05-12T22:31:54.794274+02:00 lisa kernel: [    C3]  flush_tlb_mm_range+0x3f2/0x640
2025-05-12T22:31:54.794275+02:00 lisa kernel: [    C3]  copy_mm+0x6d2/0x890
2025-05-12T22:31:54.794277+02:00 lisa kernel: [    C3]  copy_process+0x6b5/0xf90
2025-05-12T22:31:54.794278+02:00 lisa kernel: [    C3]  kernel_clone+0x94/0x2e0
2025-05-12T22:31:54.794283+02:00 lisa kernel: [    C3]  ? rt_spin_lock+0x3d/0xa0
2025-05-12T22:31:54.794284+02:00 lisa kernel: [    C3]  __x64_sys_clone+0xc3/0xf0
2025-05-12T22:31:54.794286+02:00 lisa kernel: [    C3]  do_syscall_64+0x6c/0xfa0
2025-05-12T22:31:54.794287+02:00 lisa kernel: [    C3]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.794289+02:00 lisa kernel: [    C3]  entry_SYSCALL_64_after_hwframe+0x76/0x7e
2025-05-12T22:31:54.794291+02:00 lisa kernel: [    C3] RIP: 0033:0x7f0622ca4202
2025-05-12T22:31:54.794299+02:00 lisa kernel: [    C3] Code: 89 e7 e8 71 3b f6 ff 45 31 c0 31 d2 31 f6 64 48 8b 04 25 10 00 00 00 bf 11 00 20 01 4c 8d 90 d0 02 00 00 b8 38 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 5e 89 c5 85 c0 75 31 64 48 8b 04 25 10 00 00
2025-05-12T22:31:54.794301+02:00 lisa kernel: [    C3] RSP: 002b:00007ffd091cb4d0 EFLAGS: 00000246 ORIG_RAX: 0000000000000038
2025-05-12T22:31:54.794303+02:00 lisa kernel: [    C3] RAX: ffffffffffffffda RBX: 00007ffd091cb4d0 RCX: 00007f0622ca4202
2025-05-12T22:31:54.794305+02:00 lisa kernel: [    C3] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000001200011
2025-05-12T22:31:54.794306+02:00 lisa kernel: [    C3] RBP: 00007ffd091cba20 R08: 0000000000000000 R09: 0000000000000000
2025-05-12T22:31:54.794308+02:00 lisa kernel: [    C3] R10: 00007f0621c91dd0 R11: 0000000000000246 R12: 00007ffd091cb500
2025-05-12T22:31:54.794314+02:00 lisa kernel: [    C3] R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000000
2025-05-12T22:31:54.794316+02:00 lisa kernel: [    C3]  </TASK>
2025-05-12T22:31:54.794317+02:00 lisa kernel: [   C12] watchdog: BUG: soft lockup - CPU#12 stuck for 49s! [Xorg:1388]
2025-05-12T22:31:54.794319+02:00 lisa kernel: [   C12] Modules linked in: ccm snd_seq_dummy snd_hrtimer snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq snd_seq_device rfcomm bnep nls_ascii nls_cp437 vfat fat snd_ctl_led snd_hda_codec_realtek snd_hda_scodec_component snd_hda_codec_generic snd_hda_codec_hdmi snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_acp3x_pdm_dma snd_soc_dmic snd_acp3x_rn btusb snd_soc_core snd_hwdep btbcm snd_hda_core uvcvideo btintel btrtl snd_pcm_oss videobuf2_vmalloc btmtk videobuf2_memops uvc videobuf2_v4l2 snd_mixer_oss bluetooth videodev snd_pcm snd_rn_pci_acp3x snd_acp_config snd_soc_acpi videobuf2_common snd_timer msi_wmi ecdh_generic ecc mc sparse_keymap wmi_bmof snd edac_mce_amd snd_pci_acp3x soundcore k10temp ccp battery ac button joydev hid_sensor_gyro_3d hid_sensor_als hid_sensor_accel_3d hid_sensor_magn_3d hid_sensor_prox hid_sensor_trigger hid_sensor_iio_common industrialio_triggered_buffer kfifo_buf amd_pmc industrialio evdev mt7921e mt7921_common mt792x_lib mt76_connac_lib mt76 mac80211 libarc4 cfg80211 rfkill msr
2025-05-12T22:31:54.794321+02:00 lisa kernel: [   C12]  fuse nvme_fabrics efi_pstore configfs efivarfs autofs4 ext4 mbcache jbd2 amdgpu usbhid drm_panel_backlight_quirks cec drm_buddy drm_suballoc_helper drm_exec i2c_algo_bit drm_display_helper xhci_pci gpu_sched xhci_hcd hid_sensor_hub hid_multitouch drm_ttm_helper mfd_core hid_generic ttm usbcore i2c_hid_acpi drm_client_lib psmouse nvme amd_sfh i2c_hid drm_kms_helper nvme_core hid serio_raw r8169 usb_common i2c_piix4 amdxcp crc16 i2c_smbus i2c_designware_platform i2c_designware_core
2025-05-12T22:31:54.794326+02:00 lisa kernel: [   C12] CPU: 12 UID: 1000 PID: 1388 Comm: Xorg Tainted: G             L      6.15.0-rc2-bisect-00574-gfe80b0e53d36 #901 PREEMPT_{RT,(full)} 
2025-05-12T22:31:54.794328+02:00 lisa kernel: [   C12] Tainted: [L]=SOFTLOCKUP
2025-05-12T22:31:54.794329+02:00 lisa kernel: [   C12] Hardware name: Micro-Star International Co., Ltd. Alpha 15 B5EEK/MS-158L, BIOS E158LAMS.10F 11/11/2024
2025-05-12T22:31:54.794331+02:00 lisa kernel: [   C12] RIP: 0010:smp_call_function_many_cond+0x303/0x350
2025-05-12T22:31:54.794333+02:00 lisa kernel: [   C12] Code: bc c8 f7 c1 f0 ff ff ff 75 28 48 8b 03 89 ca 83 e2 0f 48 8b 14 d5 50 7a 7d be f7 44 02 08 01 00 00 00 74 bd f3 90 8b 74 10 08 <40> f6 c6 01 75 f4 eb af 65 48 8b 05 8d 02 6d 01 48 3b 44 24 38 75
2025-05-12T22:31:54.794338+02:00 lisa kernel: [   C12] RSP: 0018:ffffd3bdc4c07b28 EFLAGS: 00000202
2025-05-12T22:31:54.794340+02:00 lisa kernel: [   C12] RAX: ffffffffbf063e80 RBX: ffff8c456e9231c0 RCX: 0000000000000006
2025-05-12T22:31:54.794342+02:00 lisa kernel: [   C12] RDX: ffff8c45af744000 RSI: 0000000000000011 RDI: ffff8c456e921240
2025-05-12T22:31:54.794343+02:00 lisa kernel: [   C12] RBP: 0000000000000003 R08: 0000000000000000 R09: 0000000000200000
2025-05-12T22:31:54.794345+02:00 lisa kernel: [   C12] R10: ffff8c45af8c4000 R11: ffffffffbd886fc0 R12: 0000000000000000
2025-05-12T22:31:54.794347+02:00 lisa kernel: [   C12] R13: 0000000000000000 R14: 0000000000000202 R15: 0000000000000006
2025-05-12T22:31:54.794421+02:00 lisa kernel: [   C12] FS:  00007f460cbc8b00(0000) GS:ffff8c45af8c4000(0000) knlGS:0000000000000000
2025-05-12T22:31:54.794423+02:00 lisa kernel: [   C12] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
2025-05-12T22:31:54.794425+02:00 lisa kernel: [   C12] CR2: 00007f474c7a8009 CR3: 0000000108ffa000 CR4: 0000000000750ef0
2025-05-12T22:31:54.794426+02:00 lisa kernel: [   C12] PKRU: 55555554
2025-05-12T22:31:54.794428+02:00 lisa kernel: [   C12] Call Trace:
2025-05-12T22:31:54.794430+02:00 lisa kernel: [   C12]  <TASK>
2025-05-12T22:31:54.794435+02:00 lisa kernel: [   C12]  ? __pfx_flush_tlb_func+0x10/0x10
2025-05-12T22:31:54.794437+02:00 lisa kernel: [   C12]  on_each_cpu_cond_mask+0x1c/0x40
2025-05-12T22:31:54.794438+02:00 lisa kernel: [   C12]  flush_tlb_mm_range+0x3f2/0x640
2025-05-12T22:31:54.794440+02:00 lisa kernel: [   C12]  tlb_flush_mmu+0x79/0x1b0
2025-05-12T22:31:54.794442+02:00 lisa kernel: [   C12]  tlb_finish_mmu+0x3f/0x80
2025-05-12T22:31:54.794443+02:00 lisa kernel: [   C12]  vms_clear_ptes+0x118/0x150
2025-05-12T22:31:54.794445+02:00 lisa kernel: [   C12]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.794451+02:00 lisa kernel: [   C12]  ? mas_store_gfp+0xe0/0x190
2025-05-12T22:31:54.794452+02:00 lisa kernel: [   C12]  vms_complete_munmap_vmas+0x78/0x1b0
2025-05-12T22:31:54.794454+02:00 lisa kernel: [   C12]  do_vmi_align_munmap+0x251/0x290
2025-05-12T22:31:54.794456+02:00 lisa kernel: [   C12]  ? __pfx_amdgpu_gem_va_ioctl+0x10/0x10 [amdgpu]
2025-05-12T22:31:54.794458+02:00 lisa kernel: [   C12]  do_vmi_munmap+0xd6/0x100
2025-05-12T22:31:54.794459+02:00 lisa kernel: [   C12]  __vm_munmap+0xcc/0x130
2025-05-12T22:31:54.794465+02:00 lisa kernel: [   C12]  __x64_sys_munmap+0x16/0x20
2025-05-12T22:31:54.794467+02:00 lisa kernel: [   C12]  do_syscall_64+0x6c/0xfa0
2025-05-12T22:31:54.794469+02:00 lisa kernel: [   C12]  ? __irq_exit_rcu+0x6d/0xf0
2025-05-12T22:31:54.794470+02:00 lisa kernel: [   C12]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.794472+02:00 lisa kernel: [   C12]  entry_SYSCALL_64_after_hwframe+0x76/0x7e
2025-05-12T22:31:54.794473+02:00 lisa kernel: [   C12] RIP: 0033:0x7f460cf4a6d7
2025-05-12T22:31:54.794475+02:00 lisa kernel: [   C12] Code: 73 01 c3 48 8b 0d 21 97 0d 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 b8 0b 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d f1 96 0d 00 f7 d8 64 89 01 48
2025-05-12T22:31:54.794481+02:00 lisa kernel: [   C12] RSP: 002b:00007fff32a17e88 EFLAGS: 00000246 ORIG_RAX: 000000000000000b
2025-05-12T22:31:54.794482+02:00 lisa kernel: [   C12] RAX: ffffffffffffffda RBX: 000055a7ad46a260 RCX: 00007f460cf4a6d7
2025-05-12T22:31:54.794484+02:00 lisa kernel: [   C12] RDX: 0000000000000001 RSI: 0000000000200000 RDI: 00007f45a7e00000
2025-05-12T22:31:54.794486+02:00 lisa kernel: [   C12] RBP: 000055a7abb0e240 R08: 0000000000000030 R09: 0000000000000000
2025-05-12T22:31:54.794487+02:00 lisa kernel: [   C12] R10: 0000000000000001 R11: 0000000000000246 R12: 000055a7ad46a280
2025-05-12T22:31:54.794489+02:00 lisa kernel: [   C12] R13: 000055a7ad51b630 R14: 000055a7ad210a80 R15: 000055a7abb1a530
2025-05-12T22:31:54.794495+02:00 lisa kernel: [   C12]  </TASK>
2025-05-12T22:31:54.794497+02:00 lisa kernel: [   C10] watchdog: BUG: soft lockup - CPU#10 stuck for 71s! [Isolated Web Co:2298]
2025-05-12T22:31:54.794499+02:00 lisa kernel: [   C10] Modules linked in: ccm snd_seq_dummy snd_hrtimer snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq snd_seq_device rfcomm bnep nls_ascii nls_cp437 vfat fat snd_ctl_led snd_hda_codec_realtek snd_hda_scodec_component snd_hda_codec_generic snd_hda_codec_hdmi snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_acp3x_pdm_dma snd_soc_dmic snd_acp3x_rn btusb snd_soc_core snd_hwdep btbcm snd_hda_core uvcvideo btintel btrtl snd_pcm_oss videobuf2_vmalloc btmtk videobuf2_memops uvc videobuf2_v4l2 snd_mixer_oss bluetooth videodev snd_pcm snd_rn_pci_acp3x snd_acp_config snd_soc_acpi videobuf2_common snd_timer msi_wmi ecdh_generic ecc mc sparse_keymap wmi_bmof snd edac_mce_amd snd_pci_acp3x soundcore k10temp ccp battery ac button joydev hid_sensor_gyro_3d hid_sensor_als hid_sensor_accel_3d hid_sensor_magn_3d hid_sensor_prox hid_sensor_trigger hid_sensor_iio_common industrialio_triggered_buffer kfifo_buf amd_pmc industrialio evdev mt7921e mt7921_common mt792x_lib mt76_connac_lib mt76 mac80211 libarc4 cfg80211 rfkill msr
2025-05-12T22:31:54.794501+02:00 lisa kernel: [   C10]  fuse nvme_fabrics efi_pstore configfs efivarfs autofs4 ext4 mbcache jbd2 amdgpu usbhid drm_panel_backlight_quirks cec drm_buddy drm_suballoc_helper drm_exec i2c_algo_bit drm_display_helper xhci_pci gpu_sched xhci_hcd hid_sensor_hub hid_multitouch drm_ttm_helper mfd_core hid_generic ttm usbcore i2c_hid_acpi drm_client_lib psmouse nvme amd_sfh i2c_hid drm_kms_helper nvme_core hid serio_raw r8169 usb_common i2c_piix4 amdxcp crc16 i2c_smbus i2c_designware_platform i2c_designware_core
2025-05-12T22:31:54.794506+02:00 lisa kernel: [   C10] CPU: 10 UID: 1000 PID: 2298 Comm: Isolated Web Co Tainted: G             L      6.15.0-rc2-bisect-00574-gfe80b0e53d36 #901 PREEMPT_{RT,(full)} 
2025-05-12T22:31:54.794507+02:00 lisa kernel: [   C10] Tainted: [L]=SOFTLOCKUP
2025-05-12T22:31:54.794509+02:00 lisa kernel: [   C10] Hardware name: Micro-Star International Co., Ltd. Alpha 15 B5EEK/MS-158L, BIOS E158LAMS.10F 11/11/2024
2025-05-12T22:31:54.794511+02:00 lisa kernel: [   C10] RIP: 0010:smp_call_function_many_cond+0x303/0x350
2025-05-12T22:31:54.794512+02:00 lisa kernel: [   C10] Code: bc c8 f7 c1 f0 ff ff ff 75 28 48 8b 03 89 ca 83 e2 0f 48 8b 14 d5 50 7a 7d be f7 44 02 08 01 00 00 00 74 bd f3 90 8b 74 10 08 <40> f6 c6 01 75 f4 eb af 65 48 8b 05 8d 02 6d 01 48 3b 44 24 38 75
2025-05-12T22:31:54.794518+02:00 lisa kernel: [   C10] RSP: 0018:ffffd3bdc16af9c8 EFLAGS: 00000202
2025-05-12T22:31:54.794520+02:00 lisa kernel: [   C10] RAX: ffffffffbf063e60 RBX: ffff8c456e8a31c0 RCX: 0000000000000006
2025-05-12T22:31:54.794522+02:00 lisa kernel: [   C10] RDX: ffff8c45af744000 RSI: 0000000000000011 RDI: ffff8c456e8a1240
2025-05-12T22:31:54.794523+02:00 lisa kernel: [   C10] RBP: 0000000000000003 R08: ffffffffffffffff R09: ffffffffffffffff
2025-05-12T22:31:54.794525+02:00 lisa kernel: [   C10] R10: ffff8c45af844000 R11: ffffffffbd886fc0 R12: 0000000000000000
2025-05-12T22:31:54.794526+02:00 lisa kernel: [   C10] R13: 0000000000000001 R14: 0000000000000202 R15: 0000000000000006
2025-05-12T22:31:54.794528+02:00 lisa kernel: [   C10] FS:  00007fd4b176dbc0(0000) GS:ffff8c45af844000(0000) knlGS:0000000000000000
2025-05-12T22:31:54.794534+02:00 lisa kernel: [   C10] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
2025-05-12T22:31:54.794535+02:00 lisa kernel: [   C10] CR2: 00007fd48a9dcfe0 CR3: 000000021b420000 CR4: 0000000000750ef0
2025-05-12T22:31:54.794537+02:00 lisa kernel: [   C10] PKRU: 55555554
2025-05-12T22:31:54.794539+02:00 lisa kernel: [   C10] Call Trace:
2025-05-12T22:31:54.794549+02:00 lisa kernel: [   C10]  <TASK>
2025-05-12T22:31:54.794552+02:00 lisa kernel: [   C10]  ? __pfx_flush_tlb_func+0x10/0x10
2025-05-12T22:31:54.794558+02:00 lisa kernel: [   C10]  on_each_cpu_cond_mask+0x1c/0x40
2025-05-12T22:31:54.794560+02:00 lisa kernel: [   C10]  flush_tlb_mm_range+0x3f2/0x640
2025-05-12T22:31:54.794562+02:00 lisa kernel: [   C10]  tlb_flush_mmu+0x79/0x1b0
2025-05-12T22:31:54.794563+02:00 lisa kernel: [   C10]  tlb_finish_mmu+0x3f/0x80
2025-05-12T22:31:54.794565+02:00 lisa kernel: [   C10]  vms_clear_ptes+0x118/0x150
2025-05-12T22:31:54.794566+02:00 lisa kernel: [   C10]  ? vms_gather_munmap_vmas+0x210/0x2a0
2025-05-12T22:31:54.794572+02:00 lisa kernel: [   C10]  mmap_region+0x4ae/0xc50
2025-05-12T22:31:54.794573+02:00 lisa kernel: [   C10]  do_mmap+0x4ab/0x5e0
2025-05-12T22:31:54.794575+02:00 lisa kernel: [   C10]  vm_mmap_pgoff+0xe6/0x190
2025-05-12T22:31:54.794577+02:00 lisa kernel: [   C10]  do_syscall_64+0x6c/0xfa0
2025-05-12T22:31:54.794579+02:00 lisa kernel: [   C10]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.794580+02:00 lisa kernel: [   C10]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.794582+02:00 lisa kernel: [   C10]  entry_SYSCALL_64_after_hwframe+0x76/0x7e
2025-05-12T22:31:54.794587+02:00 lisa kernel: [   C10] RIP: 0033:0x7fd4b18c2779
2025-05-12T22:31:54.794589+02:00 lisa kernel: [   C10] Code: ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4f 86 0d 00 f7 d8 64 89 01 48
2025-05-12T22:31:54.794591+02:00 lisa kernel: [   C10] RSP: 002b:00007fff990a2298 EFLAGS: 00000246 ORIG_RAX: 0000000000000009
2025-05-12T22:31:54.794592+02:00 lisa kernel: [   C10] RAX: ffffffffffffffda RBX: 0000000000500000 RCX: 00007fd4b18c2779
2025-05-12T22:31:54.794594+02:00 lisa kernel: [   C10] RDX: 0000000000000000 RSI: 0000000000500000 RDI: 00007fd48f600000
2025-05-12T22:31:54.794596+02:00 lisa kernel: [   C10] RBP: 00007fd4b1602100 R08: 00000000ffffffff R09: 0000000000000000
2025-05-12T22:31:54.794601+02:00 lisa kernel: [   C10] R10: 0000000000000032 R11: 0000000000000246 R12: 00007fd48f600000
2025-05-12T22:31:54.794603+02:00 lisa kernel: [   C10] R13: 00007fd48a99e000 R14: 0000000000500000 R15: 00007fd48f600000
2025-05-12T22:31:54.794604+02:00 lisa kernel: [   C10]  </TASK>
2025-05-12T22:31:54.794606+02:00 lisa kernel: [   C11] watchdog: BUG: soft lockup - CPU#11 stuck for 79s! [cc1:37564]
2025-05-12T22:31:54.794670+02:00 lisa kernel: [   C11] Modules linked in: ccm snd_seq_dummy snd_hrtimer snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq snd_seq_device rfcomm bnep nls_ascii nls_cp437 vfat fat snd_ctl_led snd_hda_codec_realtek snd_hda_scodec_component snd_hda_codec_generic snd_hda_codec_hdmi snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_acp3x_pdm_dma snd_soc_dmic snd_acp3x_rn btusb snd_soc_core snd_hwdep btbcm snd_hda_core uvcvideo btintel btrtl snd_pcm_oss videobuf2_vmalloc btmtk videobuf2_memops uvc videobuf2_v4l2 snd_mixer_oss bluetooth videodev snd_pcm snd_rn_pci_acp3x snd_acp_config snd_soc_acpi videobuf2_common snd_timer msi_wmi ecdh_generic ecc mc sparse_keymap wmi_bmof snd edac_mce_amd snd_pci_acp3x soundcore k10temp ccp battery ac button joydev hid_sensor_gyro_3d hid_sensor_als hid_sensor_accel_3d hid_sensor_magn_3d hid_sensor_prox hid_sensor_trigger hid_sensor_iio_common industrialio_triggered_buffer kfifo_buf amd_pmc industrialio evdev mt7921e mt7921_common mt792x_lib mt76_connac_lib mt76 mac80211 libarc4 cfg80211 rfkill msr
2025-05-12T22:31:54.794675+02:00 lisa kernel: [   C11]  fuse nvme_fabrics efi_pstore configfs efivarfs autofs4 ext4 mbcache jbd2 amdgpu usbhid drm_panel_backlight_quirks cec drm_buddy drm_suballoc_helper drm_exec i2c_algo_bit drm_display_helper xhci_pci gpu_sched xhci_hcd hid_sensor_hub hid_multitouch drm_ttm_helper mfd_core hid_generic ttm usbcore i2c_hid_acpi drm_client_lib psmouse nvme amd_sfh i2c_hid drm_kms_helper nvme_core hid serio_raw r8169 usb_common i2c_piix4 amdxcp crc16 i2c_smbus i2c_designware_platform i2c_designware_core
2025-05-12T22:31:54.794677+02:00 lisa kernel: [   C11] CPU: 11 UID: 1000 PID: 37564 Comm: cc1 Tainted: G             L      6.15.0-rc2-bisect-00574-gfe80b0e53d36 #901 PREEMPT_{RT,(full)} 
2025-05-12T22:31:54.794679+02:00 lisa kernel: [   C11] Tainted: [L]=SOFTLOCKUP
2025-05-12T22:31:54.794680+02:00 lisa kernel: [   C11] Hardware name: Micro-Star International Co., Ltd. Alpha 15 B5EEK/MS-158L, BIOS E158LAMS.10F 11/11/2024
2025-05-12T22:31:54.794682+02:00 lisa kernel: [   C11] RIP: 0010:smp_call_function_many_cond+0x303/0x350
2025-05-12T22:31:54.794687+02:00 lisa kernel: [   C11] Code: bc c8 f7 c1 f0 ff ff ff 75 28 48 8b 03 89 ca 83 e2 0f 48 8b 14 d5 50 7a 7d be f7 44 02 08 01 00 00 00 74 bd f3 90 8b 74 10 08 <40> f6 c6 01 75 f4 eb af 65 48 8b 05 8d 02 6d 01 48 3b 44 24 38 75
2025-05-12T22:31:54.794689+02:00 lisa kernel: [   C11] RSP: 0018:ffffd3bde215fc40 EFLAGS: 00000202
2025-05-12T22:31:54.794691+02:00 lisa kernel: [   C11] RAX: ffffffffbf063f60 RBX: ffff8c456e8e31c0 RCX: 0000000000000006
2025-05-12T22:31:54.794693+02:00 lisa kernel: [   C11] RDX: ffff8c45af744000 RSI: 0000000000000011 RDI: ffff8c37d053f200
2025-05-12T22:31:54.794694+02:00 lisa kernel: [   C11] RBP: 0000000000000003 R08: 0000000000000000 R09: ffffffffffffffff
2025-05-12T22:31:54.794696+02:00 lisa kernel: [   C11] R10: ffff8c45af884000 R11: ffffffffbd886fc0 R12: 0000000000000000
2025-05-12T22:31:54.794701+02:00 lisa kernel: [   C11] R13: 0000000000000001 R14: 0000000000000202 R15: 0000000000000006
2025-05-12T22:31:54.794703+02:00 lisa kernel: [   C11] FS:  0000000000000000(0000) GS:ffff8c45af884000(0000) knlGS:0000000000000000
2025-05-12T22:31:54.794705+02:00 lisa kernel: [   C11] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
2025-05-12T22:31:54.794706+02:00 lisa kernel: [   C11] CR2: 00007f92caf17280 CR3: 0000000b6083c000 CR4: 0000000000750ef0
2025-05-12T22:31:54.794708+02:00 lisa kernel: [   C11] PKRU: 55555554
2025-05-12T22:31:54.794710+02:00 lisa kernel: [   C11] Call Trace:
2025-05-12T22:31:54.794715+02:00 lisa kernel: [   C11]  <TASK>
2025-05-12T22:31:54.794717+02:00 lisa kernel: [   C11]  ? __pfx_flush_tlb_func+0x10/0x10
2025-05-12T22:31:54.794719+02:00 lisa kernel: [   C11]  on_each_cpu_cond_mask+0x1c/0x40
2025-05-12T22:31:54.794720+02:00 lisa kernel: [   C11]  flush_tlb_mm_range+0x3f2/0x640
2025-05-12T22:31:54.794722+02:00 lisa kernel: [   C11]  tlb_flush_mmu+0x79/0x1b0
2025-05-12T22:31:54.794724+02:00 lisa kernel: [   C11]  tlb_finish_mmu+0x3f/0x80
2025-05-12T22:31:54.794725+02:00 lisa kernel: [   C11]  exit_mmap+0x1cc/0x2d0
2025-05-12T22:31:54.794731+02:00 lisa kernel: [   C11]  __mmput+0x26/0xe0
2025-05-12T22:31:54.794732+02:00 lisa kernel: [   C11]  exit_mm+0x94/0xc0
2025-05-12T22:31:54.794734+02:00 lisa kernel: [   C11]  do_exit+0x1f0/0x860
2025-05-12T22:31:54.794736+02:00 lisa kernel: [   C11]  ? rt_spin_lock+0x3d/0xa0
2025-05-12T22:31:54.794737+02:00 lisa kernel: [   C11]  do_group_exit+0x96/0xa0
2025-05-12T22:31:54.794739+02:00 lisa kernel: [   C11]  __x64_sys_exit_group+0x12/0x20
2025-05-12T22:31:54.794744+02:00 lisa kernel: [   C11]  x64_sys_call+0x21ba/0x21c0
2025-05-12T22:31:54.794746+02:00 lisa kernel: [   C11]  do_syscall_64+0x6c/0xfa0
2025-05-12T22:31:54.794748+02:00 lisa kernel: [   C11]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.794750+02:00 lisa kernel: [   C11]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.794751+02:00 lisa kernel: [   C11]  entry_SYSCALL_64_after_hwframe+0x76/0x7e
2025-05-12T22:31:54.794753+02:00 lisa kernel: [   C11] RIP: 0033:0x7f92caf17295
2025-05-12T22:31:54.794758+02:00 lisa kernel: [   C11] Code: Unable to access opcode bytes at 0x7f92caf1726b.
2025-05-12T22:31:54.794763+02:00 lisa kernel: [   C11] RSP: 002b:00007ffd998f6ec8 EFLAGS: 00000206 ORIG_RAX: 00000000000000e7
2025-05-12T22:31:54.794765+02:00 lisa kernel: [   C11] RAX: ffffffffffffffda RBX: 00007f92cb022fe8 RCX: 00007f92caf17295
2025-05-12T22:31:54.794767+02:00 lisa kernel: [   C11] RDX: 00000000000000e7 RSI: fffffffffffffbf8 RDI: 0000000000000000
2025-05-12T22:31:54.794768+02:00 lisa kernel: [   C11] RBP: 0000000000000000 R08: 00007ffd998f6e58 R09: 0000000000000000
2025-05-12T22:31:54.794770+02:00 lisa kernel: [   C11] R10: 00007ffd998f6cf0 R11: 0000000000000206 R12: 00007f92cb021680
2025-05-12T22:31:54.794771+02:00 lisa kernel: [   C11] R13: 00007f92cb5bac80 R14: 0000000000000040 R15: 00007f92cb023000
2025-05-12T22:31:54.794778+02:00 lisa kernel: [   C11]  </TASK>
2025-05-12T22:31:54.794780+02:00 lisa kernel: [   C13] watchdog: BUG: soft lockup - CPU#13 stuck for 78s! [cc1:37695]
2025-05-12T22:31:54.794781+02:00 lisa kernel: [   C13] Modules linked in: ccm snd_seq_dummy snd_hrtimer snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq snd_seq_device rfcomm bnep nls_ascii nls_cp437 vfat fat snd_ctl_led snd_hda_codec_realtek snd_hda_scodec_component snd_hda_codec_generic snd_hda_codec_hdmi snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_acp3x_pdm_dma snd_soc_dmic snd_acp3x_rn btusb snd_soc_core snd_hwdep btbcm snd_hda_core uvcvideo btintel btrtl snd_pcm_oss videobuf2_vmalloc btmtk videobuf2_memops uvc videobuf2_v4l2 snd_mixer_oss bluetooth videodev snd_pcm snd_rn_pci_acp3x snd_acp_config snd_soc_acpi videobuf2_common snd_timer msi_wmi ecdh_generic ecc mc sparse_keymap wmi_bmof snd edac_mce_amd snd_pci_acp3x soundcore k10temp ccp battery ac button joydev hid_sensor_gyro_3d hid_sensor_als hid_sensor_accel_3d hid_sensor_magn_3d hid_sensor_prox hid_sensor_trigger hid_sensor_iio_common industrialio_triggered_buffer kfifo_buf amd_pmc industrialio evdev mt7921e mt7921_common mt792x_lib mt76_connac_lib mt76 mac80211 libarc4 cfg80211 rfkill msr
2025-05-12T22:31:54.794783+02:00 lisa kernel: [   C13]  fuse nvme_fabrics efi_pstore configfs efivarfs autofs4 ext4 mbcache jbd2 amdgpu usbhid drm_panel_backlight_quirks cec drm_buddy drm_suballoc_helper drm_exec i2c_algo_bit drm_display_helper xhci_pci gpu_sched xhci_hcd hid_sensor_hub hid_multitouch drm_ttm_helper mfd_core hid_generic ttm usbcore i2c_hid_acpi drm_client_lib psmouse nvme amd_sfh i2c_hid drm_kms_helper nvme_core hid serio_raw r8169 usb_common i2c_piix4 amdxcp crc16 i2c_smbus i2c_designware_platform i2c_designware_core
2025-05-12T22:31:54.794792+02:00 lisa kernel: [   C13] CPU: 13 UID: 1000 PID: 37695 Comm: cc1 Tainted: G             L      6.15.0-rc2-bisect-00574-gfe80b0e53d36 #901 PREEMPT_{RT,(full)} 
2025-05-12T22:31:54.794793+02:00 lisa kernel: [   C13] Tainted: [L]=SOFTLOCKUP
2025-05-12T22:31:54.794795+02:00 lisa kernel: [   C13] Hardware name: Micro-Star International Co., Ltd. Alpha 15 B5EEK/MS-158L, BIOS E158LAMS.10F 11/11/2024
2025-05-12T22:31:54.794797+02:00 lisa kernel: [   C13] RIP: 0010:smp_call_function_many_cond+0x303/0x350
2025-05-12T22:31:54.794799+02:00 lisa kernel: [   C13] Code: bc c8 f7 c1 f0 ff ff ff 75 28 48 8b 03 89 ca 83 e2 0f 48 8b 14 d5 50 7a 7d be f7 44 02 08 01 00 00 00 74 bd f3 90 8b 74 10 08 <40> f6 c6 01 75 f4 eb af 65 48 8b 05 8d 02 6d 01 48 3b 44 24 38 75
2025-05-12T22:31:54.794804+02:00 lisa kernel: [   C13] RSP: 0018:ffffd3bde25bfc40 EFLAGS: 00000202
2025-05-12T22:31:54.794806+02:00 lisa kernel: [   C13] RAX: ffffffffbf063f80 RBX: ffff8c456e9631c0 RCX: 0000000000000006
2025-05-12T22:31:54.794808+02:00 lisa kernel: [   C13] RDX: ffff8c45af744000 RSI: 0000000000000011 RDI: ffff8c456e961240
2025-05-12T22:31:54.794810+02:00 lisa kernel: [   C13] RBP: 0000000000000003 R08: 0000000000000000 R09: ffffffffffffffff
2025-05-12T22:31:54.794811+02:00 lisa kernel: [   C13] R10: ffff8c45af904000 R11: ffffffffbd886fc0 R12: 0000000000000000
2025-05-12T22:31:54.794813+02:00 lisa kernel: [   C13] R13: 0000000000000000 R14: 0000000000000202 R15: 0000000000000006
2025-05-12T22:31:54.794814+02:00 lisa kernel: [   C13] FS:  0000000000000000(0000) GS:ffff8c45af904000(0000) knlGS:0000000000000000
2025-05-12T22:31:54.794820+02:00 lisa kernel: [   C13] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
2025-05-12T22:31:54.794822+02:00 lisa kernel: [   C13] CR2: 000055c7f7753008 CR3: 0000000b6083c000 CR4: 0000000000750ef0
2025-05-12T22:31:54.794823+02:00 lisa kernel: [   C13] PKRU: 55555554
2025-05-12T22:31:54.794825+02:00 lisa kernel: [   C13] Call Trace:
2025-05-12T22:31:54.794826+02:00 lisa kernel: [   C13]  <TASK>
2025-05-12T22:31:54.794828+02:00 lisa kernel: [   C13]  ? __pfx_flush_tlb_func+0x10/0x10
2025-05-12T22:31:54.794834+02:00 lisa kernel: [   C13]  on_each_cpu_cond_mask+0x1c/0x40
2025-05-12T22:31:54.794924+02:00 lisa kernel: [   C13]  flush_tlb_mm_range+0x3f2/0x640
2025-05-12T22:31:54.794926+02:00 lisa kernel: [   C13]  tlb_flush_mmu+0x79/0x1b0
2025-05-12T22:31:54.794928+02:00 lisa kernel: [   C13]  tlb_finish_mmu+0x3f/0x80
2025-05-12T22:31:54.794930+02:00 lisa kernel: [   C13]  exit_mmap+0x1cc/0x2d0
2025-05-12T22:31:54.794931+02:00 lisa kernel: [   C13]  __mmput+0x26/0xe0
2025-05-12T22:31:54.794933+02:00 lisa kernel: [   C13]  exit_mm+0x94/0xc0
2025-05-12T22:31:54.794939+02:00 lisa kernel: [   C13]  do_exit+0x1f0/0x860
2025-05-12T22:31:54.794941+02:00 lisa kernel: [   C13]  ? rt_spin_lock+0x3d/0xa0
2025-05-12T22:31:54.794943+02:00 lisa kernel: [   C13]  do_group_exit+0x96/0xa0
2025-05-12T22:31:54.794944+02:00 lisa kernel: [   C13]  __x64_sys_exit_group+0x12/0x20
2025-05-12T22:31:54.794946+02:00 lisa kernel: [   C13]  x64_sys_call+0x21ba/0x21c0
2025-05-12T22:31:54.794948+02:00 lisa kernel: [   C13]  do_syscall_64+0x6c/0xfa0
2025-05-12T22:31:54.794953+02:00 lisa kernel: [   C13]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.794955+02:00 lisa kernel: [   C13]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.794956+02:00 lisa kernel: [   C13]  entry_SYSCALL_64_after_hwframe+0x76/0x7e
2025-05-12T22:31:54.794958+02:00 lisa kernel: [   C13] RIP: 0033:0x7fd02e538295
2025-05-12T22:31:54.794959+02:00 lisa kernel: [   C13] Code: Unable to access opcode bytes at 0x7fd02e53826b.
2025-05-12T22:31:54.794961+02:00 lisa kernel: [   C13] RSP: 002b:00007ffd3420ef28 EFLAGS: 00000206 ORIG_RAX: 00000000000000e7
2025-05-12T22:31:54.794967+02:00 lisa kernel: [   C13] RAX: ffffffffffffffda RBX: 00007fd02e643fe8 RCX: 00007fd02e538295
2025-05-12T22:31:54.794969+02:00 lisa kernel: [   C13] RDX: 00000000000000e7 RSI: fffffffffffffbf8 RDI: 0000000000000000
2025-05-12T22:31:54.794970+02:00 lisa kernel: [   C13] RBP: 0000000000000000 R08: 00007ffd3420eeb8 R09: 0000000000000000
2025-05-12T22:31:54.794972+02:00 lisa kernel: [   C13] R10: 00007ffd3420ed50 R11: 0000000000000206 R12: 00007fd02e642680
2025-05-12T22:31:54.794974+02:00 lisa kernel: [   C13] R13: 00007fd02ebdbc80 R14: 0000000000000040 R15: 00007fd02e644000
2025-05-12T22:31:54.794975+02:00 lisa kernel: [   C13]  </TASK>
2025-05-12T22:31:54.794977+02:00 lisa kernel: [   C12] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
2025-05-12T22:31:54.794982+02:00 lisa kernel: [   C12] rcu: 	6-...!: (1 GPs behind) idle=01fc/1/0x4000000000000000 softirq=0/0 fqs=112 rcuc=84012 jiffies(starved)
2025-05-12T22:31:54.794984+02:00 lisa kernel: [   C12] rcu: 	(detected by 12, t=84008 jiffies, g=104869, q=872446 ncpus=16)
2025-05-12T22:31:54.794986+02:00 lisa kernel: [   C12] Sending NMI from CPU 12 to CPUs 6:
2025-05-12T22:31:54.794987+02:00 lisa kernel: [    C6] NMI backtrace for cpu 6
2025-05-12T22:31:54.794989+02:00 lisa kernel: [    C6] CPU: 6 UID: 0 PID: 640 Comm: napi/phy0-0 Tainted: G             L      6.15.0-rc2-bisect-00574-gfe80b0e53d36 #901 PREEMPT_{RT,(full)} 
2025-05-12T22:31:54.794990+02:00 lisa kernel: [    C6] Tainted: [L]=SOFTLOCKUP
2025-05-12T22:31:54.794996+02:00 lisa kernel: [    C6] Hardware name: Micro-Star International Co., Ltd. Alpha 15 B5EEK/MS-158L, BIOS E158LAMS.10F 11/11/2024
2025-05-12T22:31:54.794998+02:00 lisa kernel: [    C6] RIP: 0010:queued_spin_lock_slowpath+0x134/0x1c0
2025-05-12T22:31:54.795000+02:00 lisa kernel: [    C6] Code: 03 c1 e6 04 83 e0 fc 49 c7 c0 f8 ff ff ff 49 8b 84 40 50 7a 7d be 48 89 94 06 c0 ed 05 bf 83 7a 08 00 75 08 f3 90 83 7a 08 00 <74> f8 48 8b 32 48 85 f6 74 09 0f 0d 0e eb 0a 31 f6 eb 06 31 f6 eb
2025-05-12T22:31:54.795001+02:00 lisa kernel: [    C6] RSP: 0018:ffffd3bdc1e579a0 EFLAGS: 00000046
2025-05-12T22:31:54.795003+02:00 lisa kernel: [    C6] RAX: 0000000000325790 RBX: 0000000000000282 RCX: 00000000001c0000
2025-05-12T22:31:54.795004+02:00 lisa kernel: [    C6] RDX: ffff8c456e7a2dc0 RSI: 0000000000000010 RDI: ffff8c37bc453fa8
2025-05-12T22:31:54.795010+02:00 lisa kernel: [    C6] RBP: ffff8c36e040c700 R08: fffffffffffffff8 R09: 0000000000000001
2025-05-12T22:31:54.795012+02:00 lisa kernel: [    C6] R10: 0000000000000001 R11: ffffffffbdfe74f0 R12: ffff8c37bc453f90
2025-05-12T22:31:54.795013+02:00 lisa kernel: [    C6] R13: ffff8c36c4492480 R14: ffff8c37bc453fa8 R15: ffff8c37bc453fa8
2025-05-12T22:31:54.795015+02:00 lisa kernel: [    C6] FS:  0000000000000000(0000) GS:ffff8c45af744000(0000) knlGS:0000000000000000
2025-05-12T22:31:54.795016+02:00 lisa kernel: [    C6] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
2025-05-12T22:31:54.795018+02:00 lisa kernel: [    C6] CR2: 00007f92c65a9000 CR3: 00000002a9720000 CR4: 0000000000750ef0
2025-05-12T22:31:54.795023+02:00 lisa kernel: [    C6] PKRU: 55555554
2025-05-12T22:31:54.795025+02:00 lisa kernel: [    C6] Call Trace:
2025-05-12T22:31:54.795027+02:00 lisa kernel: [    C6]  <TASK>
2025-05-12T22:31:54.795029+02:00 lisa kernel: [    C6]  _raw_spin_lock_irqsave+0x57/0x60
2025-05-12T22:31:54.795030+02:00 lisa kernel: [    C6]  rt_spin_lock+0x73/0xa0
2025-05-12T22:31:54.795032+02:00 lisa kernel: [    C6]  sock_queue_err_skb+0xdc/0x140
2025-05-12T22:31:54.795037+02:00 lisa kernel: [    C6]  skb_complete_wifi_ack+0xa9/0x120
2025-05-12T22:31:54.795039+02:00 lisa kernel: [    C6]  ieee80211_report_used_skb+0x541/0x6e0 [mac80211]
2025-05-12T22:31:54.795041+02:00 lisa kernel: [    C6]  ieee80211_tx_status_ext+0x3b9/0x820 [mac80211]
2025-05-12T22:31:54.795042+02:00 lisa kernel: [    C6]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.795044+02:00 lisa kernel: [    C6]  ? rt_spin_lock+0x3d/0xa0
2025-05-12T22:31:54.795046+02:00 lisa kernel: [    C6]  ? mt76_tx_status_unlock+0x38/0x230 [mt76]
2025-05-12T22:31:54.795047+02:00 lisa kernel: [    C6]  mt76_tx_status_unlock+0x1e0/0x230 [mt76]
2025-05-12T22:31:54.795053+02:00 lisa kernel: [    C6]  __mt76_tx_complete_skb+0x13b/0x2e0 [mt76]
2025-05-12T22:31:54.795054+02:00 lisa kernel: [    C6]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.795056+02:00 lisa kernel: [    C6]  ? rt_spin_unlock+0x12/0x40
2025-05-12T22:31:54.795058+02:00 lisa kernel: [    C6]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.795060+02:00 lisa kernel: [    C6]  mt76_connac2_txwi_free+0x127/0x150 [mt76_connac_lib]
2025-05-12T22:31:54.795061+02:00 lisa kernel: [    C6]  mt7921_mac_tx_free+0x112/0x260 [mt7921_common]
2025-05-12T22:31:54.795067+02:00 lisa kernel: [    C6]  mt7921_rx_check+0x33/0xe0 [mt7921_common]
2025-05-12T22:31:54.795069+02:00 lisa kernel: [    C6]  mt76_dma_rx_poll+0x322/0x660 [mt76]
2025-05-12T22:31:54.795071+02:00 lisa kernel: [    C6]  ? mt792x_poll_rx+0x2a/0x120 [mt792x_lib]
2025-05-12T22:31:54.795072+02:00 lisa kernel: [    C6]  mt792x_poll_rx+0x71/0x120 [mt792x_lib]
2025-05-12T22:31:54.795074+02:00 lisa kernel: [    C6]  __napi_poll+0x2a/0x170
2025-05-12T22:31:54.795075+02:00 lisa kernel: [    C6]  ? napi_threaded_poll_loop+0x32/0x1b0
2025-05-12T22:31:54.795077+02:00 lisa kernel: [    C6]  napi_threaded_poll_loop+0xe4/0x1b0
2025-05-12T22:31:54.795083+02:00 lisa kernel: [    C6]  ? napi_threaded_poll_loop+0x32/0x1b0
2025-05-12T22:31:54.795084+02:00 lisa kernel: [    C6]  ? ttwu_do_activate+0xa9/0x1a0
2025-05-12T22:31:54.795086+02:00 lisa kernel: [    C6]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.795087+02:00 lisa kernel: [    C6]  napi_threaded_poll+0x57/0x80
2025-05-12T22:31:54.795089+02:00 lisa kernel: [    C6]  ? __pfx_napi_threaded_poll+0x10/0x10
2025-05-12T22:31:54.795091+02:00 lisa kernel: [    C6]  kthread+0x25c/0x280
2025-05-12T22:31:54.795096+02:00 lisa kernel: [    C6]  ? __pfx_kthread+0x10/0x10
2025-05-12T22:31:54.795098+02:00 lisa kernel: [    C6]  ret_from_fork+0x35/0x40
2025-05-12T22:31:54.795099+02:00 lisa kernel: [    C6]  ? __pfx_kthread+0x10/0x10
2025-05-12T22:31:54.795101+02:00 lisa kernel: [    C6]  ret_from_fork_asm+0x1a/0x30
2025-05-12T22:31:54.795103+02:00 lisa kernel: [    C6]  </TASK>
2025-05-12T22:31:54.795105+02:00 lisa kernel: [   C12] rcu: rcu_preempt kthread starved for 83549 jiffies! g104869 f0x2 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=6
2025-05-12T22:31:54.795110+02:00 lisa kernel: [   C12] rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
2025-05-12T22:31:54.795112+02:00 lisa kernel: [   C12] rcu: RCU grace-period kthread stack dump:
2025-05-12T22:31:54.795113+02:00 lisa kernel: [   C12] task:rcu_preempt     state:R  running task     stack:0     pid:17    tgid:17    ppid:2      task_flags:0x208040 flags:0x00004000
2025-05-12T22:31:54.795115+02:00 lisa kernel: [   C12] Call Trace:
2025-05-12T22:31:54.795117+02:00 lisa kernel: [   C12]  <TASK>
2025-05-12T22:31:54.795118+02:00 lisa kernel: [   C12]  __schedule+0x4fe/0x1280
2025-05-12T22:31:54.795124+02:00 lisa kernel: [   C12]  ? schedule+0x5f/0xd0
2025-05-12T22:31:54.795125+02:00 lisa kernel: [   C12]  schedule+0x5f/0xd0
2025-05-12T22:31:54.795127+02:00 lisa kernel: [   C12]  schedule_timeout+0x76/0xf0
2025-05-12T22:31:54.795129+02:00 lisa kernel: [   C12]  ? __pfx_process_timeout+0x10/0x10
2025-05-12T22:31:54.795131+02:00 lisa kernel: [   C12]  rcu_gp_fqs_loop+0x195/0x740
2025-05-12T22:31:54.795132+02:00 lisa kernel: [   C12]  ? __pfx_rcu_watching_snap_recheck+0x10/0x10
2025-05-12T22:31:54.795134+02:00 lisa kernel: [   C12]  rcu_gp_kthread+0x21/0x180
2025-05-12T22:31:54.795139+02:00 lisa kernel: [   C12]  ? __pfx_rcu_gp_kthread+0x10/0x10
2025-05-12T22:31:54.795141+02:00 lisa kernel: [   C12]  kthread+0x25c/0x280
2025-05-12T22:31:54.795142+02:00 lisa kernel: [   C12]  ? __pfx_kthread+0x10/0x10
2025-05-12T22:31:54.795144+02:00 lisa kernel: [   C12]  ret_from_fork+0x35/0x40
2025-05-12T22:31:54.795146+02:00 lisa kernel: [   C12]  ? __pfx_kthread+0x10/0x10
2025-05-12T22:31:54.795147+02:00 lisa kernel: [   C12]  ret_from_fork_asm+0x1a/0x30
2025-05-12T22:31:54.795153+02:00 lisa kernel: [   C12]  </TASK>
2025-05-12T22:31:54.795154+02:00 lisa kernel: [    C3] watchdog: BUG: soft lockup - CPU#3 stuck for 74s! [xfsettingsd:1693]
2025-05-12T22:31:54.795156+02:00 lisa kernel: [    C3] Modules linked in: ccm snd_seq_dummy snd_hrtimer snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq snd_seq_device rfcomm bnep nls_ascii nls_cp437 vfat fat snd_ctl_led snd_hda_codec_realtek snd_hda_scodec_component snd_hda_codec_generic snd_hda_codec_hdmi snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_acp3x_pdm_dma snd_soc_dmic snd_acp3x_rn btusb snd_soc_core snd_hwdep btbcm snd_hda_core uvcvideo btintel btrtl snd_pcm_oss videobuf2_vmalloc btmtk videobuf2_memops uvc videobuf2_v4l2 snd_mixer_oss bluetooth videodev snd_pcm snd_rn_pci_acp3x snd_acp_config snd_soc_acpi videobuf2_common snd_timer msi_wmi ecdh_generic ecc mc sparse_keymap wmi_bmof snd edac_mce_amd snd_pci_acp3x soundcore k10temp ccp battery ac button joydev hid_sensor_gyro_3d hid_sensor_als hid_sensor_accel_3d hid_sensor_magn_3d hid_sensor_prox hid_sensor_trigger hid_sensor_iio_common industrialio_triggered_buffer kfifo_buf amd_pmc industrialio evdev mt7921e mt7921_common mt792x_lib mt76_connac_lib mt76 mac80211 libarc4 cfg80211 rfkill msr
2025-05-12T22:31:54.795225+02:00 lisa kernel: [    C3]  fuse nvme_fabrics efi_pstore configfs efivarfs autofs4 ext4 mbcache jbd2 amdgpu usbhid drm_panel_backlight_quirks cec drm_buddy drm_suballoc_helper drm_exec i2c_algo_bit drm_display_helper xhci_pci gpu_sched xhci_hcd hid_sensor_hub hid_multitouch drm_ttm_helper mfd_core hid_generic ttm usbcore i2c_hid_acpi drm_client_lib psmouse nvme amd_sfh i2c_hid drm_kms_helper nvme_core hid serio_raw r8169 usb_common i2c_piix4 amdxcp crc16 i2c_smbus i2c_designware_platform i2c_designware_core
2025-05-12T22:31:54.795231+02:00 lisa kernel: [    C3] CPU: 3 UID: 1000 PID: 1693 Comm: xfsettingsd Tainted: G             L      6.15.0-rc2-bisect-00574-gfe80b0e53d36 #901 PREEMPT_{RT,(full)} 
2025-05-12T22:31:54.795233+02:00 lisa kernel: [    C3] Tainted: [L]=SOFTLOCKUP
2025-05-12T22:31:54.795235+02:00 lisa kernel: [    C3] Hardware name: Micro-Star International Co., Ltd. Alpha 15 B5EEK/MS-158L, BIOS E158LAMS.10F 11/11/2024
2025-05-12T22:31:54.795237+02:00 lisa kernel: [    C3] RIP: 0010:smp_call_function_many_cond+0x303/0x350
2025-05-12T22:31:54.795238+02:00 lisa kernel: [    C3] Code: bc c8 f7 c1 f0 ff ff ff 75 28 48 8b 03 89 ca 83 e2 0f 48 8b 14 d5 50 7a 7d be f7 44 02 08 01 00 00 00 74 bd f3 90 8b 74 10 08 <40> f6 c6 01 75 f4 eb af 65 48 8b 05 8d 02 6d 01 48 3b 44 24 38 75
2025-05-12T22:31:54.795240+02:00 lisa kernel: [    C3] RSP: 0018:ffffd3bdc65cfc28 EFLAGS: 00000202
2025-05-12T22:31:54.795245+02:00 lisa kernel: [    C3] RAX: ffffffffbf063ee0 RBX: ffff8c456e6e31c0 RCX: 0000000000000006
2025-05-12T22:31:54.795247+02:00 lisa kernel: [    C3] RDX: ffff8c45af744000 RSI: 0000000000000011 RDI: ffff8c456e6e1240
2025-05-12T22:31:54.795249+02:00 lisa kernel: [    C3] RBP: 0000000000000003 R08: ffffffffffffffff R09: ffffffffffffffff
2025-05-12T22:31:54.795251+02:00 lisa kernel: [    C3] R10: ffff8c45af684000 R11: ffffffffbd886fc0 R12: 0000000000000000
2025-05-12T22:31:54.795252+02:00 lisa kernel: [    C3] R13: 000000000000000e R14: 0000000000000202 R15: 0000000000000000
2025-05-12T22:31:54.795254+02:00 lisa kernel: [    C3] FS:  00007f0621c91b00(0000) GS:ffff8c45af684000(0000) knlGS:0000000000000000
2025-05-12T22:31:54.795259+02:00 lisa kernel: [    C3] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
2025-05-12T22:31:54.795261+02:00 lisa kernel: [    C3] CR2: 00000cbd4746a300 CR3: 0000000301556000 CR4: 0000000000750ef0
2025-05-12T22:31:54.795262+02:00 lisa kernel: [    C3] PKRU: 55555554
2025-05-12T22:31:54.795264+02:00 lisa kernel: [    C3] Call Trace:
2025-05-12T22:31:54.795266+02:00 lisa kernel: [    C3]  <TASK>
2025-05-12T22:31:54.795267+02:00 lisa kernel: [    C3]  ? __pfx_flush_tlb_func+0x10/0x10
2025-05-12T22:31:54.795273+02:00 lisa kernel: [    C3]  on_each_cpu_cond_mask+0x1c/0x40
2025-05-12T22:31:54.795275+02:00 lisa kernel: [    C3]  flush_tlb_mm_range+0x3f2/0x640
2025-05-12T22:31:54.795276+02:00 lisa kernel: [    C3]  copy_mm+0x6d2/0x890
2025-05-12T22:31:54.795278+02:00 lisa kernel: [    C3]  copy_process+0x6b5/0xf90
2025-05-12T22:31:54.795280+02:00 lisa kernel: [    C3]  kernel_clone+0x94/0x2e0
2025-05-12T22:31:54.795282+02:00 lisa kernel: [    C3]  ? rt_spin_lock+0x3d/0xa0
2025-05-12T22:31:54.795283+02:00 lisa kernel: [    C3]  __x64_sys_clone+0xc3/0xf0
2025-05-12T22:31:54.795288+02:00 lisa kernel: [    C3]  do_syscall_64+0x6c/0xfa0
2025-05-12T22:31:54.795290+02:00 lisa kernel: [    C3]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.795292+02:00 lisa kernel: [    C3]  entry_SYSCALL_64_after_hwframe+0x76/0x7e
2025-05-12T22:31:54.795293+02:00 lisa kernel: [    C3] RIP: 0033:0x7f0622ca4202
2025-05-12T22:31:54.795295+02:00 lisa kernel: [    C3] Code: 89 e7 e8 71 3b f6 ff 45 31 c0 31 d2 31 f6 64 48 8b 04 25 10 00 00 00 bf 11 00 20 01 4c 8d 90 d0 02 00 00 b8 38 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 5e 89 c5 85 c0 75 31 64 48 8b 04 25 10 00 00
2025-05-12T22:31:54.795297+02:00 lisa kernel: [    C3] RSP: 002b:00007ffd091cb4d0 EFLAGS: 00000246 ORIG_RAX: 0000000000000038
2025-05-12T22:31:54.795302+02:00 lisa kernel: [    C3] RAX: ffffffffffffffda RBX: 00007ffd091cb4d0 RCX: 00007f0622ca4202
2025-05-12T22:31:54.795304+02:00 lisa kernel: [    C3] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000001200011
2025-05-12T22:31:54.795306+02:00 lisa kernel: [    C3] RBP: 00007ffd091cba20 R08: 0000000000000000 R09: 0000000000000000
2025-05-12T22:31:54.795307+02:00 lisa kernel: [    C3] R10: 00007f0621c91dd0 R11: 0000000000000246 R12: 00007ffd091cb500
2025-05-12T22:31:54.795309+02:00 lisa kernel: [    C3] R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000000
2025-05-12T22:31:54.795311+02:00 lisa kernel: [    C3]  </TASK>
2025-05-12T22:31:54.795316+02:00 lisa kernel: [   C10] watchdog: BUG: soft lockup - CPU#10 stuck for 97s! [Isolated Web Co:2298]
2025-05-12T22:31:54.795318+02:00 lisa kernel: [   C10] Modules linked in: ccm snd_seq_dummy snd_hrtimer snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq snd_seq_device rfcomm bnep nls_ascii nls_cp437 vfat fat snd_ctl_led snd_hda_codec_realtek snd_hda_scodec_component snd_hda_codec_generic snd_hda_codec_hdmi snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_acp3x_pdm_dma snd_soc_dmic snd_acp3x_rn btusb snd_soc_core snd_hwdep btbcm snd_hda_core uvcvideo btintel btrtl snd_pcm_oss videobuf2_vmalloc btmtk videobuf2_memops uvc videobuf2_v4l2 snd_mixer_oss bluetooth videodev snd_pcm snd_rn_pci_acp3x snd_acp_config snd_soc_acpi videobuf2_common snd_timer msi_wmi ecdh_generic ecc mc sparse_keymap wmi_bmof snd edac_mce_amd snd_pci_acp3x soundcore k10temp ccp battery ac button joydev hid_sensor_gyro_3d hid_sensor_als hid_sensor_accel_3d hid_sensor_magn_3d hid_sensor_prox hid_sensor_trigger hid_sensor_iio_common industrialio_triggered_buffer kfifo_buf amd_pmc industrialio evdev mt7921e mt7921_common mt792x_lib mt76_connac_lib mt76 mac80211 libarc4 cfg80211 rfkill msr
2025-05-12T22:31:54.795320+02:00 lisa kernel: [   C10]  fuse nvme_fabrics efi_pstore configfs efivarfs autofs4 ext4 mbcache jbd2 amdgpu usbhid drm_panel_backlight_quirks cec drm_buddy drm_suballoc_helper drm_exec i2c_algo_bit drm_display_helper xhci_pci gpu_sched xhci_hcd hid_sensor_hub hid_multitouch drm_ttm_helper mfd_core hid_generic ttm usbcore i2c_hid_acpi drm_client_lib psmouse nvme amd_sfh i2c_hid drm_kms_helper nvme_core hid serio_raw r8169 usb_common i2c_piix4 amdxcp crc16 i2c_smbus i2c_designware_platform i2c_designware_core
2025-05-12T22:31:54.795322+02:00 lisa kernel: [   C10] CPU: 10 UID: 1000 PID: 2298 Comm: Isolated Web Co Tainted: G             L      6.15.0-rc2-bisect-00574-gfe80b0e53d36 #901 PREEMPT_{RT,(full)} 
2025-05-12T22:31:54.795327+02:00 lisa kernel: [   C10] Tainted: [L]=SOFTLOCKUP
2025-05-12T22:31:54.795329+02:00 lisa kernel: [   C10] Hardware name: Micro-Star International Co., Ltd. Alpha 15 B5EEK/MS-158L, BIOS E158LAMS.10F 11/11/2024
2025-05-12T22:31:54.795331+02:00 lisa kernel: [   C10] RIP: 0010:smp_call_function_many_cond+0x303/0x350
2025-05-12T22:31:54.795332+02:00 lisa kernel: [   C10] Code: bc c8 f7 c1 f0 ff ff ff 75 28 48 8b 03 89 ca 83 e2 0f 48 8b 14 d5 50 7a 7d be f7 44 02 08 01 00 00 00 74 bd f3 90 8b 74 10 08 <40> f6 c6 01 75 f4 eb af 65 48 8b 05 8d 02 6d 01 48 3b 44 24 38 75
2025-05-12T22:31:54.795334+02:00 lisa kernel: [   C10] RSP: 0018:ffffd3bdc16af9c8 EFLAGS: 00000202
2025-05-12T22:31:54.795336+02:00 lisa kernel: [   C10] RAX: ffffffffbf063e60 RBX: ffff8c456e8a31c0 RCX: 0000000000000006
2025-05-12T22:31:54.795341+02:00 lisa kernel: [   C10] RDX: ffff8c45af744000 RSI: 0000000000000011 RDI: ffff8c456e8a1240
2025-05-12T22:31:54.795343+02:00 lisa kernel: [   C10] RBP: 0000000000000003 R08: ffffffffffffffff R09: ffffffffffffffff
2025-05-12T22:31:54.795344+02:00 lisa kernel: [   C10] R10: ffff8c45af844000 R11: ffffffffbd886fc0 R12: 0000000000000000
2025-05-12T22:31:54.795346+02:00 lisa kernel: [   C10] R13: 0000000000000001 R14: 0000000000000202 R15: 0000000000000006
2025-05-12T22:31:54.795348+02:00 lisa kernel: [   C10] FS:  00007fd4b176dbc0(0000) GS:ffff8c45af844000(0000) knlGS:0000000000000000
2025-05-12T22:31:54.795349+02:00 lisa kernel: [   C10] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
2025-05-12T22:31:54.795354+02:00 lisa kernel: [   C10] CR2: 00007fd48a9dcfe0 CR3: 000000021b420000 CR4: 0000000000750ef0
2025-05-12T22:31:54.795356+02:00 lisa kernel: [   C10] PKRU: 55555554
2025-05-12T22:31:54.795358+02:00 lisa kernel: [   C10] Call Trace:
2025-05-12T22:31:54.795360+02:00 lisa kernel: [   C10]  <TASK>
2025-05-12T22:31:54.795361+02:00 lisa kernel: [   C10]  ? __pfx_flush_tlb_func+0x10/0x10
2025-05-12T22:31:54.795363+02:00 lisa kernel: [   C10]  on_each_cpu_cond_mask+0x1c/0x40
2025-05-12T22:31:54.795365+02:00 lisa kernel: [   C10]  flush_tlb_mm_range+0x3f2/0x640
2025-05-12T22:31:54.795370+02:00 lisa kernel: [   C10]  tlb_flush_mmu+0x79/0x1b0
2025-05-12T22:31:54.795372+02:00 lisa kernel: [   C10]  tlb_finish_mmu+0x3f/0x80
2025-05-12T22:31:54.795373+02:00 lisa kernel: [   C10]  vms_clear_ptes+0x118/0x150
2025-05-12T22:31:54.795375+02:00 lisa kernel: [   C10]  ? vms_gather_munmap_vmas+0x210/0x2a0
2025-05-12T22:31:54.795377+02:00 lisa kernel: [   C10]  mmap_region+0x4ae/0xc50
2025-05-12T22:31:54.795378+02:00 lisa kernel: [   C10]  do_mmap+0x4ab/0x5e0
2025-05-12T22:31:54.795386+02:00 lisa kernel: [   C10]  vm_mmap_pgoff+0xe6/0x190
2025-05-12T22:31:54.795388+02:00 lisa kernel: [   C10]  do_syscall_64+0x6c/0xfa0
2025-05-12T22:31:54.795390+02:00 lisa kernel: [   C10]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.795392+02:00 lisa kernel: [   C10]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.795393+02:00 lisa kernel: [   C10]  entry_SYSCALL_64_after_hwframe+0x76/0x7e
2025-05-12T22:31:54.795395+02:00 lisa kernel: [   C10] RIP: 0033:0x7fd4b18c2779
2025-05-12T22:31:54.795400+02:00 lisa kernel: [   C10] Code: ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4f 86 0d 00 f7 d8 64 89 01 48
2025-05-12T22:31:54.795402+02:00 lisa kernel: [   C10] RSP: 002b:00007fff990a2298 EFLAGS: 00000246 ORIG_RAX: 0000000000000009
2025-05-12T22:31:54.795404+02:00 lisa kernel: [   C10] RAX: ffffffffffffffda RBX: 0000000000500000 RCX: 00007fd4b18c2779
2025-05-12T22:31:54.795463+02:00 lisa kernel: [   C10] RDX: 0000000000000000 RSI: 0000000000500000 RDI: 00007fd48f600000
2025-05-12T22:31:54.795465+02:00 lisa kernel: [   C10] RBP: 00007fd4b1602100 R08: 00000000ffffffff R09: 0000000000000000
2025-05-12T22:31:54.795467+02:00 lisa kernel: [   C10] R10: 0000000000000032 R11: 0000000000000246 R12: 00007fd48f600000
2025-05-12T22:31:54.795470+02:00 lisa kernel: [   C10] R13: 00007fd48a99e000 R14: 0000000000500000 R15: 00007fd48f600000
2025-05-12T22:31:54.795474+02:00 lisa kernel: [   C10]  </TASK>
2025-05-12T22:31:54.795476+02:00 lisa kernel: [   C12] watchdog: BUG: soft lockup - CPU#12 stuck for 86s! [Xorg:1388]
2025-05-12T22:31:54.795478+02:00 lisa kernel: [   C12] Modules linked in: ccm snd_seq_dummy snd_hrtimer snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq snd_seq_device rfcomm bnep nls_ascii nls_cp437 vfat fat snd_ctl_led snd_hda_codec_realtek snd_hda_scodec_component snd_hda_codec_generic snd_hda_codec_hdmi snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_acp3x_pdm_dma snd_soc_dmic snd_acp3x_rn btusb snd_soc_core snd_hwdep btbcm snd_hda_core uvcvideo btintel btrtl snd_pcm_oss videobuf2_vmalloc btmtk videobuf2_memops uvc videobuf2_v4l2 snd_mixer_oss bluetooth videodev snd_pcm snd_rn_pci_acp3x snd_acp_config snd_soc_acpi videobuf2_common snd_timer msi_wmi ecdh_generic ecc mc sparse_keymap wmi_bmof snd edac_mce_amd snd_pci_acp3x soundcore k10temp ccp battery ac button joydev hid_sensor_gyro_3d hid_sensor_als hid_sensor_accel_3d hid_sensor_magn_3d hid_sensor_prox hid_sensor_trigger hid_sensor_iio_common industrialio_triggered_buffer kfifo_buf amd_pmc industrialio evdev mt7921e mt7921_common mt792x_lib mt76_connac_lib mt76 mac80211 libarc4 cfg80211 rfkill msr
2025-05-12T22:31:54.795479+02:00 lisa kernel: [   C12]  fuse nvme_fabrics efi_pstore configfs efivarfs autofs4 ext4 mbcache jbd2 amdgpu usbhid drm_panel_backlight_quirks cec drm_buddy drm_suballoc_helper drm_exec i2c_algo_bit drm_display_helper xhci_pci gpu_sched xhci_hcd hid_sensor_hub hid_multitouch drm_ttm_helper mfd_core hid_generic ttm usbcore i2c_hid_acpi drm_client_lib psmouse nvme amd_sfh i2c_hid drm_kms_helper nvme_core hid serio_raw r8169 usb_common i2c_piix4 amdxcp crc16 i2c_smbus i2c_designware_platform i2c_designware_core
2025-05-12T22:31:54.795485+02:00 lisa kernel: [   C12] CPU: 12 UID: 1000 PID: 1388 Comm: Xorg Tainted: G             L      6.15.0-rc2-bisect-00574-gfe80b0e53d36 #901 PREEMPT_{RT,(full)} 
2025-05-12T22:31:54.795487+02:00 lisa kernel: [   C12] Tainted: [L]=SOFTLOCKUP
2025-05-12T22:31:54.795489+02:00 lisa kernel: [   C12] Hardware name: Micro-Star International Co., Ltd. Alpha 15 B5EEK/MS-158L, BIOS E158LAMS.10F 11/11/2024
2025-05-12T22:31:54.795490+02:00 lisa kernel: [   C12] RIP: 0010:smp_call_function_many_cond+0x303/0x350
2025-05-12T22:31:54.795492+02:00 lisa kernel: [   C12] Code: bc c8 f7 c1 f0 ff ff ff 75 28 48 8b 03 89 ca 83 e2 0f 48 8b 14 d5 50 7a 7d be f7 44 02 08 01 00 00 00 74 bd f3 90 8b 74 10 08 <40> f6 c6 01 75 f4 eb af 65 48 8b 05 8d 02 6d 01 48 3b 44 24 38 75
2025-05-12T22:31:54.795498+02:00 lisa kernel: [   C12] RSP: 0018:ffffd3bdc4c07b28 EFLAGS: 00000202
2025-05-12T22:31:54.795499+02:00 lisa kernel: [   C12] RAX: ffffffffbf063e80 RBX: ffff8c456e9231c0 RCX: 0000000000000006
2025-05-12T22:31:54.795501+02:00 lisa kernel: [   C12] RDX: ffff8c45af744000 RSI: 0000000000000011 RDI: ffff8c456e921240
2025-05-12T22:31:54.795503+02:00 lisa kernel: [   C12] RBP: 0000000000000003 R08: 0000000000000000 R09: 0000000000200000
2025-05-12T22:31:54.795504+02:00 lisa kernel: [   C12] R10: ffff8c45af8c4000 R11: ffffffffbd886fc0 R12: 0000000000000000
2025-05-12T22:31:54.795506+02:00 lisa kernel: [   C12] R13: 0000000000000000 R14: 0000000000000202 R15: 0000000000000006
2025-05-12T22:31:54.795511+02:00 lisa kernel: [   C12] FS:  00007f460cbc8b00(0000) GS:ffff8c45af8c4000(0000) knlGS:0000000000000000
2025-05-12T22:31:54.795513+02:00 lisa kernel: [   C12] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
2025-05-12T22:31:54.795515+02:00 lisa kernel: [   C12] CR2: 00007f474c7a8009 CR3: 0000000108ffa000 CR4: 0000000000750ef0
2025-05-12T22:31:54.795516+02:00 lisa kernel: [   C12] PKRU: 55555554
2025-05-12T22:31:54.795518+02:00 lisa kernel: [   C12] Call Trace:
2025-05-12T22:31:54.795520+02:00 lisa kernel: [   C12]  <TASK>
2025-05-12T22:31:54.795521+02:00 lisa kernel: [   C12]  ? __pfx_flush_tlb_func+0x10/0x10
2025-05-12T22:31:54.795527+02:00 lisa kernel: [   C12]  on_each_cpu_cond_mask+0x1c/0x40
2025-05-12T22:31:54.795528+02:00 lisa kernel: [   C12]  flush_tlb_mm_range+0x3f2/0x640
2025-05-12T22:31:54.795530+02:00 lisa kernel: [   C12]  tlb_flush_mmu+0x79/0x1b0
2025-05-12T22:31:54.795532+02:00 lisa kernel: [   C12]  tlb_finish_mmu+0x3f/0x80
2025-05-12T22:31:54.795534+02:00 lisa kernel: [   C12]  vms_clear_ptes+0x118/0x150
2025-05-12T22:31:54.795535+02:00 lisa kernel: [   C12]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.795547+02:00 lisa kernel: [   C12]  ? mas_store_gfp+0xe0/0x190
2025-05-12T22:31:54.795550+02:00 lisa kernel: [   C12]  vms_complete_munmap_vmas+0x78/0x1b0
2025-05-12T22:31:54.795552+02:00 lisa kernel: [   C12]  do_vmi_align_munmap+0x251/0x290
2025-05-12T22:31:54.795553+02:00 lisa kernel: [   C12]  ? __pfx_amdgpu_gem_va_ioctl+0x10/0x10 [amdgpu]
2025-05-12T22:31:54.795555+02:00 lisa kernel: [   C12]  do_vmi_munmap+0xd6/0x100
2025-05-12T22:31:54.795557+02:00 lisa kernel: [   C12]  __vm_munmap+0xcc/0x130
2025-05-12T22:31:54.795559+02:00 lisa kernel: [   C12]  __x64_sys_munmap+0x16/0x20
2025-05-12T22:31:54.795564+02:00 lisa kernel: [   C12]  do_syscall_64+0x6c/0xfa0
2025-05-12T22:31:54.795566+02:00 lisa kernel: [   C12]  ? __irq_exit_rcu+0x6d/0xf0
2025-05-12T22:31:54.795568+02:00 lisa kernel: [   C12]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.795569+02:00 lisa kernel: [   C12]  entry_SYSCALL_64_after_hwframe+0x76/0x7e
2025-05-12T22:31:54.795571+02:00 lisa kernel: [   C12] RIP: 0033:0x7f460cf4a6d7
2025-05-12T22:31:54.795573+02:00 lisa kernel: [   C12] Code: 73 01 c3 48 8b 0d 21 97 0d 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 b8 0b 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d f1 96 0d 00 f7 d8 64 89 01 48
2025-05-12T22:31:54.795578+02:00 lisa kernel: [   C12] RSP: 002b:00007fff32a17e88 EFLAGS: 00000246 ORIG_RAX: 000000000000000b
2025-05-12T22:31:54.795580+02:00 lisa kernel: [   C12] RAX: ffffffffffffffda RBX: 000055a7ad46a260 RCX: 00007f460cf4a6d7
2025-05-12T22:31:54.795582+02:00 lisa kernel: [   C12] RDX: 0000000000000001 RSI: 0000000000200000 RDI: 00007f45a7e00000
2025-05-12T22:31:54.795583+02:00 lisa kernel: [   C12] RBP: 000055a7abb0e240 R08: 0000000000000030 R09: 0000000000000000
2025-05-12T22:31:54.795585+02:00 lisa kernel: [   C12] R10: 0000000000000001 R11: 0000000000000246 R12: 000055a7ad46a280
2025-05-12T22:31:54.795587+02:00 lisa kernel: [   C12] R13: 000055a7ad51b630 R14: 000055a7ad210a80 R15: 000055a7abb1a530
2025-05-12T22:31:54.795592+02:00 lisa kernel: [   C12]  </TASK>
2025-05-12T22:31:54.795594+02:00 lisa kernel: [   C11] watchdog: BUG: soft lockup - CPU#11 stuck for 105s! [cc1:37564]
2025-05-12T22:31:54.795595+02:00 lisa kernel: [   C11] Modules linked in: ccm snd_seq_dummy snd_hrtimer snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq snd_seq_device rfcomm bnep nls_ascii nls_cp437 vfat fat snd_ctl_led snd_hda_codec_realtek snd_hda_scodec_component snd_hda_codec_generic snd_hda_codec_hdmi snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_acp3x_pdm_dma snd_soc_dmic snd_acp3x_rn btusb snd_soc_core snd_hwdep btbcm snd_hda_core uvcvideo btintel btrtl snd_pcm_oss videobuf2_vmalloc btmtk videobuf2_memops uvc videobuf2_v4l2 snd_mixer_oss bluetooth videodev snd_pcm snd_rn_pci_acp3x snd_acp_config snd_soc_acpi videobuf2_common snd_timer msi_wmi ecdh_generic ecc mc sparse_keymap wmi_bmof snd edac_mce_amd snd_pci_acp3x soundcore k10temp ccp battery ac button joydev hid_sensor_gyro_3d hid_sensor_als hid_sensor_accel_3d hid_sensor_magn_3d hid_sensor_prox hid_sensor_trigger hid_sensor_iio_common industrialio_triggered_buffer kfifo_buf amd_pmc industrialio evdev mt7921e mt7921_common mt792x_lib mt76_connac_lib mt76 mac80211 libarc4 cfg80211 rfkill msr
2025-05-12T22:31:54.795597+02:00 lisa kernel: [   C11]  fuse nvme_fabrics efi_pstore configfs efivarfs autofs4 ext4 mbcache jbd2 amdgpu usbhid drm_panel_backlight_quirks cec drm_buddy drm_suballoc_helper drm_exec i2c_algo_bit drm_display_helper xhci_pci gpu_sched xhci_hcd hid_sensor_hub hid_multitouch drm_ttm_helper mfd_core hid_generic ttm usbcore i2c_hid_acpi drm_client_lib psmouse nvme amd_sfh i2c_hid drm_kms_helper nvme_core hid serio_raw r8169 usb_common i2c_piix4 amdxcp crc16 i2c_smbus i2c_designware_platform i2c_designware_core
2025-05-12T22:31:54.795602+02:00 lisa kernel: [   C11] CPU: 11 UID: 1000 PID: 37564 Comm: cc1 Tainted: G             L      6.15.0-rc2-bisect-00574-gfe80b0e53d36 #901 PREEMPT_{RT,(full)} 
2025-05-12T22:31:54.795604+02:00 lisa kernel: [   C11] Tainted: [L]=SOFTLOCKUP
2025-05-12T22:31:54.795606+02:00 lisa kernel: [   C11] Hardware name: Micro-Star International Co., Ltd. Alpha 15 B5EEK/MS-158L, BIOS E158LAMS.10F 11/11/2024
2025-05-12T22:31:54.795608+02:00 lisa kernel: [   C11] RIP: 0010:smp_call_function_many_cond+0x2ff/0x350
2025-05-12T22:31:54.795609+02:00 lisa kernel: [   C11] Code: 35 f3 48 0f bc c8 f7 c1 f0 ff ff ff 75 28 48 8b 03 89 ca 83 e2 0f 48 8b 14 d5 50 7a 7d be f7 44 02 08 01 00 00 00 74 bd f3 90 <8b> 74 10 08 40 f6 c6 01 75 f4 eb af 65 48 8b 05 8d 02 6d 01 48 3b
2025-05-12T22:31:54.795611+02:00 lisa kernel: [   C11] RSP: 0018:ffffd3bde215fc40 EFLAGS: 00000202
2025-05-12T22:31:54.795617+02:00 lisa kernel: [   C11] RAX: ffffffffbf063f60 RBX: ffff8c456e8e31c0 RCX: 0000000000000006
2025-05-12T22:31:54.795618+02:00 lisa kernel: [   C11] RDX: ffff8c45af744000 RSI: 0000000000000011 RDI: ffff8c37d053f200
2025-05-12T22:31:54.795694+02:00 lisa kernel: [   C11] RBP: 0000000000000003 R08: 0000000000000000 R09: ffffffffffffffff
2025-05-12T22:31:54.795695+02:00 lisa kernel: [   C11] R10: ffff8c45af884000 R11: ffffffffbd886fc0 R12: 0000000000000000
2025-05-12T22:31:54.795697+02:00 lisa kernel: [   C11] R13: 0000000000000001 R14: 0000000000000202 R15: 0000000000000006
2025-05-12T22:31:54.795699+02:00 lisa kernel: [   C11] FS:  0000000000000000(0000) GS:ffff8c45af884000(0000) knlGS:0000000000000000
2025-05-12T22:31:54.795705+02:00 lisa kernel: [   C11] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
2025-05-12T22:31:54.795707+02:00 lisa kernel: [   C11] CR2: 00007f92caf17280 CR3: 0000000b6083c000 CR4: 0000000000750ef0
2025-05-12T22:31:54.795708+02:00 lisa kernel: [   C11] PKRU: 55555554
2025-05-12T22:31:54.795710+02:00 lisa kernel: [   C11] Call Trace:
2025-05-12T22:31:54.795712+02:00 lisa kernel: [   C11]  <TASK>
2025-05-12T22:31:54.795714+02:00 lisa kernel: [   C11]  ? __pfx_flush_tlb_func+0x10/0x10
2025-05-12T22:31:54.795717+02:00 lisa kernel: [   C11]  on_each_cpu_cond_mask+0x1c/0x40
2025-05-12T22:31:54.795721+02:00 lisa kernel: [   C11]  flush_tlb_mm_range+0x3f2/0x640
2025-05-12T22:31:54.795723+02:00 lisa kernel: [   C11]  tlb_flush_mmu+0x79/0x1b0
2025-05-12T22:31:54.795725+02:00 lisa kernel: [   C11]  tlb_finish_mmu+0x3f/0x80
2025-05-12T22:31:54.795726+02:00 lisa kernel: [   C11]  exit_mmap+0x1cc/0x2d0
2025-05-12T22:31:54.795728+02:00 lisa kernel: [   C11]  __mmput+0x26/0xe0
2025-05-12T22:31:54.795730+02:00 lisa kernel: [   C11]  exit_mm+0x94/0xc0
2025-05-12T22:31:54.795735+02:00 lisa kernel: [   C11]  do_exit+0x1f0/0x860
2025-05-12T22:31:54.795737+02:00 lisa kernel: [   C11]  ? rt_spin_lock+0x3d/0xa0
2025-05-12T22:31:54.795739+02:00 lisa kernel: [   C11]  do_group_exit+0x96/0xa0
2025-05-12T22:31:54.795740+02:00 lisa kernel: [   C11]  __x64_sys_exit_group+0x12/0x20
2025-05-12T22:31:54.795742+02:00 lisa kernel: [   C11]  x64_sys_call+0x21ba/0x21c0
2025-05-12T22:31:54.795743+02:00 lisa kernel: [   C11]  do_syscall_64+0x6c/0xfa0
2025-05-12T22:31:54.795749+02:00 lisa kernel: [   C11]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.795750+02:00 lisa kernel: [   C11]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.795752+02:00 lisa kernel: [   C11]  entry_SYSCALL_64_after_hwframe+0x76/0x7e
2025-05-12T22:31:54.795754+02:00 lisa kernel: [   C11] RIP: 0033:0x7f92caf17295
2025-05-12T22:31:54.795756+02:00 lisa kernel: [   C11] Code: Unable to access opcode bytes at 0x7f92caf1726b.
2025-05-12T22:31:54.795757+02:00 lisa kernel: [   C11] RSP: 002b:00007ffd998f6ec8 EFLAGS: 00000206 ORIG_RAX: 00000000000000e7
2025-05-12T22:31:54.795759+02:00 lisa kernel: [   C11] RAX: ffffffffffffffda RBX: 00007f92cb022fe8 RCX: 00007f92caf17295
2025-05-12T22:31:54.795765+02:00 lisa kernel: [   C11] RDX: 00000000000000e7 RSI: fffffffffffffbf8 RDI: 0000000000000000
2025-05-12T22:31:54.795767+02:00 lisa kernel: [   C11] RBP: 0000000000000000 R08: 00007ffd998f6e58 R09: 0000000000000000
2025-05-12T22:31:54.795769+02:00 lisa kernel: [   C11] R10: 00007ffd998f6cf0 R11: 0000000000000206 R12: 00007f92cb021680
2025-05-12T22:31:54.795770+02:00 lisa kernel: [   C11] R13: 00007f92cb5bac80 R14: 0000000000000040 R15: 00007f92cb023000
2025-05-12T22:31:54.795772+02:00 lisa kernel: [   C11]  </TASK>
2025-05-12T22:31:54.795774+02:00 lisa kernel: [   C13] watchdog: BUG: soft lockup - CPU#13 stuck for 104s! [cc1:37695]
2025-05-12T22:31:54.795779+02:00 lisa kernel: [   C13] Modules linked in: ccm snd_seq_dummy snd_hrtimer snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq snd_seq_device rfcomm bnep nls_ascii nls_cp437 vfat fat snd_ctl_led snd_hda_codec_realtek snd_hda_scodec_component snd_hda_codec_generic snd_hda_codec_hdmi snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_acp3x_pdm_dma snd_soc_dmic snd_acp3x_rn btusb snd_soc_core snd_hwdep btbcm snd_hda_core uvcvideo btintel btrtl snd_pcm_oss videobuf2_vmalloc btmtk videobuf2_memops uvc videobuf2_v4l2 snd_mixer_oss bluetooth videodev snd_pcm snd_rn_pci_acp3x snd_acp_config snd_soc_acpi videobuf2_common snd_timer msi_wmi ecdh_generic ecc mc sparse_keymap wmi_bmof snd edac_mce_amd snd_pci_acp3x soundcore k10temp ccp battery ac button joydev hid_sensor_gyro_3d hid_sensor_als hid_sensor_accel_3d hid_sensor_magn_3d hid_sensor_prox hid_sensor_trigger hid_sensor_iio_common industrialio_triggered_buffer kfifo_buf amd_pmc industrialio evdev mt7921e mt7921_common mt792x_lib mt76_connac_lib mt76 mac80211 libarc4 cfg80211 rfkill msr
2025-05-12T22:31:54.795781+02:00 lisa kernel: [   C13]  fuse nvme_fabrics efi_pstore configfs efivarfs autofs4 ext4 mbcache jbd2 amdgpu usbhid drm_panel_backlight_quirks cec drm_buddy drm_suballoc_helper drm_exec i2c_algo_bit drm_display_helper xhci_pci gpu_sched xhci_hcd hid_sensor_hub hid_multitouch drm_ttm_helper mfd_core hid_generic ttm usbcore i2c_hid_acpi drm_client_lib psmouse nvme amd_sfh i2c_hid drm_kms_helper nvme_core hid serio_raw r8169 usb_common i2c_piix4 amdxcp crc16 i2c_smbus i2c_designware_platform i2c_designware_core
2025-05-12T22:31:54.795783+02:00 lisa kernel: [   C13] CPU: 13 UID: 1000 PID: 37695 Comm: cc1 Tainted: G             L      6.15.0-rc2-bisect-00574-gfe80b0e53d36 #901 PREEMPT_{RT,(full)} 
2025-05-12T22:31:54.795785+02:00 lisa kernel: [   C13] Tainted: [L]=SOFTLOCKUP
2025-05-12T22:31:54.795790+02:00 lisa kernel: [   C13] Hardware name: Micro-Star International Co., Ltd. Alpha 15 B5EEK/MS-158L, BIOS E158LAMS.10F 11/11/2024
2025-05-12T22:31:54.795792+02:00 lisa kernel: [   C13] RIP: 0010:smp_call_function_many_cond+0x303/0x350
2025-05-12T22:31:54.795794+02:00 lisa kernel: [   C13] Code: bc c8 f7 c1 f0 ff ff ff 75 28 48 8b 03 89 ca 83 e2 0f 48 8b 14 d5 50 7a 7d be f7 44 02 08 01 00 00 00 74 bd f3 90 8b 74 10 08 <40> f6 c6 01 75 f4 eb af 65 48 8b 05 8d 02 6d 01 48 3b 44 24 38 75
2025-05-12T22:31:54.795795+02:00 lisa kernel: [   C13] RSP: 0018:ffffd3bde25bfc40 EFLAGS: 00000202
2025-05-12T22:31:54.795797+02:00 lisa kernel: [   C13] RAX: ffffffffbf063f80 RBX: ffff8c456e9631c0 RCX: 0000000000000006
2025-05-12T22:31:54.795799+02:00 lisa kernel: [   C13] RDX: ffff8c45af744000 RSI: 0000000000000011 RDI: ffff8c456e961240
2025-05-12T22:31:54.795804+02:00 lisa kernel: [   C13] RBP: 0000000000000003 R08: 0000000000000000 R09: ffffffffffffffff
2025-05-12T22:31:54.795806+02:00 lisa kernel: [   C13] R10: ffff8c45af904000 R11: ffffffffbd886fc0 R12: 0000000000000000
2025-05-12T22:31:54.795808+02:00 lisa kernel: [   C13] R13: 0000000000000000 R14: 0000000000000202 R15: 0000000000000006
2025-05-12T22:31:54.795809+02:00 lisa kernel: [   C13] FS:  0000000000000000(0000) GS:ffff8c45af904000(0000) knlGS:0000000000000000
2025-05-12T22:31:54.795811+02:00 lisa kernel: [   C13] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
2025-05-12T22:31:54.795813+02:00 lisa kernel: [   C13] CR2: 000055c7f7753008 CR3: 0000000b6083c000 CR4: 0000000000750ef0
2025-05-12T22:31:54.795818+02:00 lisa kernel: [   C13] PKRU: 55555554
2025-05-12T22:31:54.795819+02:00 lisa kernel: [   C13] Call Trace:
2025-05-12T22:31:54.795821+02:00 lisa kernel: [   C13]  <TASK>
2025-05-12T22:31:54.795823+02:00 lisa kernel: [   C13]  ? __pfx_flush_tlb_func+0x10/0x10
2025-05-12T22:31:54.795825+02:00 lisa kernel: [   C13]  on_each_cpu_cond_mask+0x1c/0x40
2025-05-12T22:31:54.795827+02:00 lisa kernel: [   C13]  flush_tlb_mm_range+0x3f2/0x640
2025-05-12T22:31:54.795832+02:00 lisa kernel: [   C13]  tlb_flush_mmu+0x79/0x1b0
2025-05-12T22:31:54.795834+02:00 lisa kernel: [   C13]  tlb_finish_mmu+0x3f/0x80
2025-05-12T22:31:54.795836+02:00 lisa kernel: [   C13]  exit_mmap+0x1cc/0x2d0
2025-05-12T22:31:54.795838+02:00 lisa kernel: [   C13]  __mmput+0x26/0xe0
2025-05-12T22:31:54.795839+02:00 lisa kernel: [   C13]  exit_mm+0x94/0xc0
2025-05-12T22:31:54.795841+02:00 lisa kernel: [   C13]  do_exit+0x1f0/0x860
2025-05-12T22:31:54.795842+02:00 lisa kernel: [   C13]  ? rt_spin_lock+0x3d/0xa0
2025-05-12T22:31:54.795848+02:00 lisa kernel: [   C13]  do_group_exit+0x96/0xa0
2025-05-12T22:31:54.795849+02:00 lisa kernel: [   C13]  __x64_sys_exit_group+0x12/0x20
2025-05-12T22:31:54.795851+02:00 lisa kernel: [   C13]  x64_sys_call+0x21ba/0x21c0
2025-05-12T22:31:54.795853+02:00 lisa kernel: [   C13]  do_syscall_64+0x6c/0xfa0
2025-05-12T22:31:54.795854+02:00 lisa kernel: [   C13]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.795856+02:00 lisa kernel: [   C13]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.795861+02:00 lisa kernel: [   C13]  entry_SYSCALL_64_after_hwframe+0x76/0x7e
2025-05-12T22:31:54.795863+02:00 lisa kernel: [   C13] RIP: 0033:0x7fd02e538295
2025-05-12T22:31:54.795865+02:00 lisa kernel: [   C13] Code: Unable to access opcode bytes at 0x7fd02e53826b.
2025-05-12T22:31:54.795866+02:00 lisa kernel: [   C13] RSP: 002b:00007ffd3420ef28 EFLAGS: 00000206 ORIG_RAX: 00000000000000e7
2025-05-12T22:31:54.795868+02:00 lisa kernel: [   C13] RAX: ffffffffffffffda RBX: 00007fd02e643fe8 RCX: 00007fd02e538295
2025-05-12T22:31:54.795870+02:00 lisa kernel: [   C13] RDX: 00000000000000e7 RSI: fffffffffffffbf8 RDI: 0000000000000000
2025-05-12T22:31:54.795871+02:00 lisa kernel: [   C13] RBP: 0000000000000000 R08: 00007ffd3420eeb8 R09: 0000000000000000
2025-05-12T22:31:54.795876+02:00 lisa kernel: [   C13] R10: 00007ffd3420ed50 R11: 0000000000000206 R12: 00007fd02e642680
2025-05-12T22:31:54.795878+02:00 lisa kernel: [   C13] R13: 00007fd02ebdbc80 R14: 0000000000000040 R15: 00007fd02e644000
2025-05-12T22:31:54.795880+02:00 lisa kernel: [   C13]  </TASK>
2025-05-12T22:31:54.795881+02:00 lisa kernel: [    C3] watchdog: BUG: soft lockup - CPU#3 stuck for 100s! [xfsettingsd:1693]
2025-05-12T22:31:54.795942+02:00 lisa kernel: [    C3] Modules linked in: ccm snd_seq_dummy snd_hrtimer snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq snd_seq_device rfcomm bnep nls_ascii nls_cp437 vfat fat snd_ctl_led snd_hda_codec_realtek snd_hda_scodec_component snd_hda_codec_generic snd_hda_codec_hdmi snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_acp3x_pdm_dma snd_soc_dmic snd_acp3x_rn btusb snd_soc_core snd_hwdep btbcm snd_hda_core uvcvideo btintel btrtl snd_pcm_oss videobuf2_vmalloc btmtk videobuf2_memops uvc videobuf2_v4l2 snd_mixer_oss bluetooth videodev snd_pcm snd_rn_pci_acp3x snd_acp_config snd_soc_acpi videobuf2_common snd_timer msi_wmi ecdh_generic ecc mc sparse_keymap wmi_bmof snd edac_mce_amd snd_pci_acp3x soundcore k10temp ccp battery ac button joydev hid_sensor_gyro_3d hid_sensor_als hid_sensor_accel_3d hid_sensor_magn_3d hid_sensor_prox hid_sensor_trigger hid_sensor_iio_common industrialio_triggered_buffer kfifo_buf amd_pmc industrialio evdev mt7921e mt7921_common mt792x_lib mt76_connac_lib mt76 mac80211 libarc4 cfg80211 rfkill msr
2025-05-12T22:31:54.795947+02:00 lisa kernel: [    C3]  fuse nvme_fabrics efi_pstore configfs efivarfs autofs4 ext4 mbcache jbd2 amdgpu usbhid drm_panel_backlight_quirks cec drm_buddy drm_suballoc_helper drm_exec i2c_algo_bit drm_display_helper xhci_pci gpu_sched xhci_hcd hid_sensor_hub hid_multitouch drm_ttm_helper mfd_core hid_generic ttm usbcore i2c_hid_acpi drm_client_lib psmouse nvme amd_sfh i2c_hid drm_kms_helper nvme_core hid serio_raw r8169 usb_common i2c_piix4 amdxcp crc16 i2c_smbus i2c_designware_platform i2c_designware_core
2025-05-12T22:31:54.795949+02:00 lisa kernel: [    C3] CPU: 3 UID: 1000 PID: 1693 Comm: xfsettingsd Tainted: G             L      6.15.0-rc2-bisect-00574-gfe80b0e53d36 #901 PREEMPT_{RT,(full)} 
2025-05-12T22:31:54.795950+02:00 lisa kernel: [    C3] Tainted: [L]=SOFTLOCKUP
2025-05-12T22:31:54.795952+02:00 lisa kernel: [    C3] Hardware name: Micro-Star International Co., Ltd. Alpha 15 B5EEK/MS-158L, BIOS E158LAMS.10F 11/11/2024
2025-05-12T22:31:54.795954+02:00 lisa kernel: [    C3] RIP: 0010:smp_call_function_many_cond+0x303/0x350
2025-05-12T22:31:54.795959+02:00 lisa kernel: [    C3] Code: bc c8 f7 c1 f0 ff ff ff 75 28 48 8b 03 89 ca 83 e2 0f 48 8b 14 d5 50 7a 7d be f7 44 02 08 01 00 00 00 74 bd f3 90 8b 74 10 08 <40> f6 c6 01 75 f4 eb af 65 48 8b 05 8d 02 6d 01 48 3b 44 24 38 75
2025-05-12T22:31:54.795961+02:00 lisa kernel: [    C3] RSP: 0018:ffffd3bdc65cfc28 EFLAGS: 00000202
2025-05-12T22:31:54.795962+02:00 lisa kernel: [    C3] RAX: ffffffffbf063ee0 RBX: ffff8c456e6e31c0 RCX: 0000000000000006
2025-05-12T22:31:54.795964+02:00 lisa kernel: [    C3] RDX: ffff8c45af744000 RSI: 0000000000000011 RDI: ffff8c456e6e1240
2025-05-12T22:31:54.795966+02:00 lisa kernel: [    C3] RBP: 0000000000000003 R08: ffffffffffffffff R09: ffffffffffffffff
2025-05-12T22:31:54.795967+02:00 lisa kernel: [    C3] R10: ffff8c45af684000 R11: ffffffffbd886fc0 R12: 0000000000000000
2025-05-12T22:31:54.795973+02:00 lisa kernel: [    C3] R13: 000000000000000e R14: 0000000000000202 R15: 0000000000000000
2025-05-12T22:31:54.795975+02:00 lisa kernel: [    C3] FS:  00007f0621c91b00(0000) GS:ffff8c45af684000(0000) knlGS:0000000000000000
2025-05-12T22:31:54.795977+02:00 lisa kernel: [    C3] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
2025-05-12T22:31:54.795979+02:00 lisa kernel: [    C3] CR2: 00000cbd4746a300 CR3: 0000000301556000 CR4: 0000000000750ef0
2025-05-12T22:31:54.795980+02:00 lisa kernel: [    C3] PKRU: 55555554
2025-05-12T22:31:54.795982+02:00 lisa kernel: [    C3] Call Trace:
2025-05-12T22:31:54.795987+02:00 lisa kernel: [    C3]  <TASK>
2025-05-12T22:31:54.795989+02:00 lisa kernel: [    C3]  ? __pfx_flush_tlb_func+0x10/0x10
2025-05-12T22:31:54.795991+02:00 lisa kernel: [    C3]  on_each_cpu_cond_mask+0x1c/0x40
2025-05-12T22:31:54.795992+02:00 lisa kernel: [    C3]  flush_tlb_mm_range+0x3f2/0x640
2025-05-12T22:31:54.795994+02:00 lisa kernel: [    C3]  copy_mm+0x6d2/0x890
2025-05-12T22:31:54.795995+02:00 lisa kernel: [    C3]  copy_process+0x6b5/0xf90
2025-05-12T22:31:54.796000+02:00 lisa kernel: [    C3]  kernel_clone+0x94/0x2e0
2025-05-12T22:31:54.796002+02:00 lisa kernel: [    C3]  ? rt_spin_lock+0x3d/0xa0
2025-05-12T22:31:54.796004+02:00 lisa kernel: [    C3]  __x64_sys_clone+0xc3/0xf0
2025-05-12T22:31:54.796006+02:00 lisa kernel: [    C3]  do_syscall_64+0x6c/0xfa0
2025-05-12T22:31:54.796007+02:00 lisa kernel: [    C3]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.796009+02:00 lisa kernel: [    C3]  entry_SYSCALL_64_after_hwframe+0x76/0x7e
2025-05-12T22:31:54.796011+02:00 lisa kernel: [    C3] RIP: 0033:0x7f0622ca4202
2025-05-12T22:31:54.796019+02:00 lisa kernel: [    C3] Code: 89 e7 e8 71 3b f6 ff 45 31 c0 31 d2 31 f6 64 48 8b 04 25 10 00 00 00 bf 11 00 20 01 4c 8d 90 d0 02 00 00 b8 38 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 5e 89 c5 85 c0 75 31 64 48 8b 04 25 10 00 00
2025-05-12T22:31:54.796021+02:00 lisa kernel: [    C3] RSP: 002b:00007ffd091cb4d0 EFLAGS: 00000246 ORIG_RAX: 0000000000000038
2025-05-12T22:31:54.796022+02:00 lisa kernel: [    C3] RAX: ffffffffffffffda RBX: 00007ffd091cb4d0 RCX: 00007f0622ca4202
2025-05-12T22:31:54.796024+02:00 lisa kernel: [    C3] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000001200011
2025-05-12T22:31:54.796025+02:00 lisa kernel: [    C3] RBP: 00007ffd091cba20 R08: 0000000000000000 R09: 0000000000000000
2025-05-12T22:31:54.796027+02:00 lisa kernel: [    C3] R10: 00007f0621c91dd0 R11: 0000000000000246 R12: 00007ffd091cb500
2025-05-12T22:31:54.796032+02:00 lisa kernel: [    C3] R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000000
2025-05-12T22:31:54.796034+02:00 lisa kernel: [    C3]  </TASK>
2025-05-12T22:31:54.796036+02:00 lisa kernel: [   C10] watchdog: BUG: soft lockup - CPU#10 stuck for 123s! [Isolated Web Co:2298]
2025-05-12T22:31:54.796038+02:00 lisa kernel: [   C10] Modules linked in: ccm snd_seq_dummy snd_hrtimer snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq snd_seq_device rfcomm bnep nls_ascii nls_cp437 vfat fat snd_ctl_led snd_hda_codec_realtek snd_hda_scodec_component snd_hda_codec_generic snd_hda_codec_hdmi snd_hda_intel snd_intel_dspcfg snd_hda_codec snd_acp3x_pdm_dma snd_soc_dmic snd_acp3x_rn btusb snd_soc_core snd_hwdep btbcm snd_hda_core uvcvideo btintel btrtl snd_pcm_oss videobuf2_vmalloc btmtk videobuf2_memops uvc videobuf2_v4l2 snd_mixer_oss bluetooth videodev snd_pcm snd_rn_pci_acp3x snd_acp_config snd_soc_acpi videobuf2_common snd_timer msi_wmi ecdh_generic ecc mc sparse_keymap wmi_bmof snd edac_mce_amd snd_pci_acp3x soundcore k10temp ccp battery ac button joydev hid_sensor_gyro_3d hid_sensor_als hid_sensor_accel_3d hid_sensor_magn_3d hid_sensor_prox hid_sensor_trigger hid_sensor_iio_common industrialio_triggered_buffer kfifo_buf amd_pmc industrialio evdev mt7921e mt7921_common mt792x_lib mt76_connac_lib mt76 mac80211 libarc4 cfg80211 rfkill msr
2025-05-12T22:31:54.796039+02:00 lisa kernel: [   C10]  fuse nvme_fabrics efi_pstore configfs efivarfs autofs4 ext4 mbcache jbd2 amdgpu usbhid drm_panel_backlight_quirks cec drm_buddy drm_suballoc_helper drm_exec i2c_algo_bit drm_display_helper xhci_pci gpu_sched xhci_hcd hid_sensor_hub hid_multitouch drm_ttm_helper mfd_core hid_generic ttm usbcore i2c_hid_acpi drm_client_lib psmouse nvme amd_sfh i2c_hid drm_kms_helper nvme_core hid serio_raw r8169 usb_common i2c_piix4 amdxcp crc16 i2c_smbus i2c_designware_platform i2c_designware_core
2025-05-12T22:31:54.796045+02:00 lisa kernel: [   C10] CPU: 10 UID: 1000 PID: 2298 Comm: Isolated Web Co Tainted: G             L      6.15.0-rc2-bisect-00574-gfe80b0e53d36 #901 PREEMPT_{RT,(full)} 
2025-05-12T22:31:54.796046+02:00 lisa kernel: [   C10] Tainted: [L]=SOFTLOCKUP
2025-05-12T22:31:54.796048+02:00 lisa kernel: [   C10] Hardware name: Micro-Star International Co., Ltd. Alpha 15 B5EEK/MS-158L, BIOS E158LAMS.10F 11/11/2024
2025-05-12T22:31:54.796049+02:00 lisa kernel: [   C10] RIP: 0010:smp_call_function_many_cond+0x303/0x350
2025-05-12T22:31:54.796051+02:00 lisa kernel: [   C10] Code: bc c8 f7 c1 f0 ff ff ff 75 28 48 8b 03 89 ca 83 e2 0f 48 8b 14 d5 50 7a 7d be f7 44 02 08 01 00 00 00 74 bd f3 90 8b 74 10 08 <40> f6 c6 01 75 f4 eb af 65 48 8b 05 8d 02 6d 01 48 3b 44 24 38 75
2025-05-12T22:31:54.796056+02:00 lisa kernel: [   C10] RSP: 0018:ffffd3bdc16af9c8 EFLAGS: 00000202
2025-05-12T22:31:54.796058+02:00 lisa kernel: [   C10] RAX: ffffffffbf063e60 RBX: ffff8c456e8a31c0 RCX: 0000000000000006
2025-05-12T22:31:54.796060+02:00 lisa kernel: [   C10] RDX: ffff8c45af744000 RSI: 0000000000000011 RDI: ffff8c456e8a1240
2025-05-12T22:31:54.796062+02:00 lisa kernel: [   C10] RBP: 0000000000000003 R08: ffffffffffffffff R09: ffffffffffffffff
2025-05-12T22:31:54.796063+02:00 lisa kernel: [   C10] R10: ffff8c45af844000 R11: ffffffffbd886fc0 R12: 0000000000000000
2025-05-12T22:31:54.796065+02:00 lisa kernel: [   C10] R13: 0000000000000001 R14: 0000000000000202 R15: 0000000000000006
2025-05-12T22:31:54.796070+02:00 lisa kernel: [   C10] FS:  00007fd4b176dbc0(0000) GS:ffff8c45af844000(0000) knlGS:0000000000000000
2025-05-12T22:31:54.796072+02:00 lisa kernel: [   C10] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
2025-05-12T22:31:54.796074+02:00 lisa kernel: [   C10] CR2: 00007fd48a9dcfe0 CR3: 000000021b420000 CR4: 0000000000750ef0
2025-05-12T22:31:54.796076+02:00 lisa kernel: [   C10] PKRU: 55555554
2025-05-12T22:31:54.796077+02:00 lisa kernel: [   C10] Call Trace:
2025-05-12T22:31:54.796079+02:00 lisa kernel: [   C10]  <TASK>
2025-05-12T22:31:54.796084+02:00 lisa kernel: [   C10]  ? __pfx_flush_tlb_func+0x10/0x10
2025-05-12T22:31:54.796086+02:00 lisa kernel: [   C10]  on_each_cpu_cond_mask+0x1c/0x40
2025-05-12T22:31:54.796087+02:00 lisa kernel: [   C10]  flush_tlb_mm_range+0x3f2/0x640
2025-05-12T22:31:54.796089+02:00 lisa kernel: [   C10]  tlb_flush_mmu+0x79/0x1b0
2025-05-12T22:31:54.796110+02:00 lisa kernel: [   C10]  tlb_finish_mmu+0x3f/0x80
2025-05-12T22:31:54.796111+02:00 lisa kernel: [   C10]  vms_clear_ptes+0x118/0x150
2025-05-12T22:31:54.796113+02:00 lisa kernel: [   C10]  ? vms_gather_munmap_vmas+0x210/0x2a0
2025-05-12T22:31:54.796118+02:00 lisa kernel: [   C10]  mmap_region+0x4ae/0xc50
2025-05-12T22:31:54.796119+02:00 lisa kernel: [   C10]  do_mmap+0x4ab/0x5e0
2025-05-12T22:31:54.796121+02:00 lisa kernel: [   C10]  vm_mmap_pgoff+0xe6/0x190
2025-05-12T22:31:54.796123+02:00 lisa kernel: [   C10]  do_syscall_64+0x6c/0xfa0
2025-05-12T22:31:54.796125+02:00 lisa kernel: [   C10]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.796127+02:00 lisa kernel: [   C10]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-12T22:31:54.796131+02:00 lisa kernel: [   C10]  entry_SYSCALL_64_after_hwframe+0x76/0x7e
2025-05-12T22:31:54.796133+02:00 lisa kernel: [   C10] RIP: 0033:0x7fd4b18c2779
2025-05-12T22:31:54.796135+02:00 lisa kernel: [   C10] Code: ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 4f 86 0d 00 f7 d8 64 89 01 48
2025-05-12T22:31:54.796137+02:00 lisa kernel: [   C10] RSP: 002b:00007fff990a2298 EFLAGS: 00000246 ORIG_RAX: 0000000000000009
2025-05-12T22:31:54.796139+02:00 lisa kernel: [   C10] RAX: ffffffffffffffda RBX: 0000000000500000 RCX: 00007fd4b18c2779
2025-05-12T22:31:54.796140+02:00 lisa kernel: [   C10] RDX: 0000000000000000 RSI: 0000000000500000 RDI: 00007fd48f600000
2025-05-12T22:31:54.796146+02:00 lisa kernel: [   C10] RBP: 00007fd4b1602100 R08: 00000000ffffffff R09: 0000000000000000
2025-05-12T22:31:54.796148+02:00 lisa kernel: [   C10] R10: 0000000000000032 R11: 0000000000000246 R12: 00007fd48f600000
2025-05-12T22:31:54.796149+02:00 lisa kernel: [   C10] R13: 00007fd48a99e000 R14: 0000000000500000 R15: 00007fd48f600000
2025-05-12T22:31:54.796151+02:00 lisa kernel: [   C10]  </TASK>
2025-05-12T22:31:54.796153+02:00 lisa kernel: [  T245] sysrq: Emergency Sync

The bisection proved to be difficult as well and left me with a list of commits
which I "bisected" by hand:

6fcc4294e85f wifi: mwifiex: drop unnecessary initialization BAD
7d902365171c wifi: mwifiex: use adapter as context pointer for mwifiex_hs_activated_event()
bf55d51f080e wifi: mwifiex: deduplicate code in mwifiex_cmd_tx_rate_cfg()
39df75eb38fa wifi: mac80211: Replace __get_unaligned_cpu32 in mesh_pathtbl.c
1237c5632fe3 bcma: use new GPIO line value setter callbacks
487637698808 Revert "mac80211: Dynamically set CoDel parameters per station"
996c15bd30a9 wifi: cfg80211/mac80211: remove more 5/10 MHz code
7438843df8cf wifi: iwlwifi: mvm: Avoid -Wflex-array-member-not-at-end warning
17328a5b6a8f wifi: mac80211: Avoid -Wflex-array-member-not-at-end warnings BAD (fixed by reverting 76a853f86c97)
98fd01b4173d dt-bindings: wireless: qcom,wcnss: Use wireless-controller.yaml
c301db25dd69 dt-bindings: wireless: silabs,wfx: Use wireless-controller.yaml
3c3606793f7e dt-bindings: wireless: bcm4329-fmac: Use wireless-controller.yaml schema
c7e35b3b007f dt-bindings: net: Add generic wireless controller
dede36400714 dt-bindings: net: Add network-class schema for mac-address properties
5632a5052bb6 wifi: iwlwifi: fw: api: Absolute rudimentary typo fixes in the file power.h
2b801487ac3b wifi: iwlwifi: Add missing MODULE_FIRMWARE for Qu-c0-jf-b0
9991739ed3ee (HEAD) wifi: iwlwifi: mvm: Remove duplicated include in iwl-utils.c
76a853f86c97 wifi: free SKBTX_WIFI_STATUS skb tx_flags flag BAD (reverting this does not fix next-20250512)

So 76a853f86c97 ("wifi: free SKBTX_WIFI_STATUS skb tx_flags flag BAD") is the first
bad commmit and reverting it fixes things in commit 17328a5b6a8f, but this as not
the whole story as this reversion does NOT fix next-20250512.
 
I'll now start a bisection where I revert 76a853f86c97 where possible in
order to find the remaining bugs.



Bert Karwatzki

^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: lockup and kernel panic in linux-next-202505{09,12} when compiled with clang
@ 2025-05-13 10:19 Bert Karwatzki
  0 siblings, 0 replies; 22+ messages in thread
From: Bert Karwatzki @ 2025-05-13 10:19 UTC (permalink / raw)
  To: linux-kernel; +Cc: Bert Karwatzki, linux-next, Johannes Berg

> 
> I'll now start a bisection where I revert 76a853f86c97 where possible in
> order to find the remaining bugs.
>

This bisect is under way
git bisect start
# Status: warte auf guten und schlechten Commit
# bad: [edef457004774e598fc4c1b7d1d4f0bcd9d0bb30] Add linux-next specific files for 20250512
git bisect bad edef457004774e598fc4c1b7d1d4f0bcd9d0bb30
# Status: warte auf gute(n) Commit(s), schlechter Commit bekannt
# good: [82f2b0b97b36ee3fcddf0f0780a9a0825d52fec3] Linux 6.15-rc6
git bisect good 82f2b0b97b36ee3fcddf0f0780a9a0825d52fec3
# good: [359e9e09fd7696427625f6c0d8b7f64f408fe8c5] Merge branch 'spi-nor/next' of git://git.kernel.org/pub/scm/linux/kernel/git/mtd/linux.git
git bisect good 359e9e09fd7696427625f6c0d8b7f64f408fe8c5
# good: [fbbd1ba0e9a92ba0d28414c752689a1fe7c45572] Merge branch 'for-next' of git://git.kernel.org/pub/scm/linux/kernel/git/krzk/linux-dt.git
git bisect good fbbd1ba0e9a92ba0d28414c752689a1fe7c45572
# bad: [88ab40966878885e1fa546dbdcf4953874def09f] Merge branch 'usb-next' of git://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git
git bisect bad 88ab40966878885e1fa546dbdcf4953874def09f
# bad: [1d31dc07d285413b70b8dddb479a99f7dd9022c0] Merge branch 'master' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip.git
git bisect bad 1d31dc07d285413b70b8dddb479a99f7dd9022c0
# bad: [6e716555ccbf8a4b5e0fd3441fd7f13415248ed2] Merge branch into tip/master: 'irq/core'
git bisect bad 6e716555ccbf8a4b5e0fd3441fd7f13415248ed2
# good: [37084fbae2154f3d7674c98d33553e8997b19fda] Merge branch 'x86/boot' into x86/merge, to ease integration testing
git bisect good 37084fbae2154f3d7674c98d33553e8997b19fda
# good: [11d6189057fa754ac7d2132ca0d24b87595b36e4] Merge branch into tip/master: 'core/entry'
git bisect good 11d6189057fa754ac7d2132ca0d24b87595b36e4

but I get a compile error at commit 
aefc11550ebd ("genirq: Remove unused remove_percpu_irq()")

kernel/irq/manage.c:2565:3: error: cannot jump from this goto statement to its label
 2565 |                 goto err_irq_setup;
      |                 ^
kernel/irq/manage.c:2567:2: note: jump bypasses initialization of variable with __attribute__((cleanup))
 2567 |         guard(raw_spinlock_irqsave)(&desc->lock);
      |         ^
./include/linux/cleanup.h:319:15: note: expanded from macro 'guard'
  319 |         CLASS(_name, __UNIQUE_ID(guard))
      |                      ^
./include/linux/compiler.h:166:29: note: expanded from macro '__UNIQUE_ID'
  166 | #define __UNIQUE_ID(prefix) __PASTE(__PASTE(__UNIQUE_ID_, prefix), __COUNTER__)
      |                             ^
././include/linux/compiler_types.h:84:22: note: expanded from macro '__PASTE'
   84 | #define __PASTE(a,b) ___PASTE(a,b)
      |                      ^
././include/linux/compiler_types.h:83:23: note: expanded from macro '___PASTE'
   83 | #define ___PASTE(a,b) a##b
      |                       ^
<scratch space>:35:1: note: expanded from here
   35 | __UNIQUE_ID_guard578
      | ^
kernel/irq/manage.c:2561:3: error: cannot jump from this goto statement to its label
 2561 |                 goto err_out;
      |                 ^
kernel/irq/manage.c:2567:2: note: jump bypasses initialization of variable with __attribute__((cleanup))
 2567 |         guard(raw_spinlock_irqsave)(&desc->lock);
      |         ^
./include/linux/cleanup.h:319:15: note: expanded from macro 'guard'
  319 |         CLASS(_name, __UNIQUE_ID(guard))
      |                      ^
./include/linux/compiler.h:166:29: note: expanded from macro '__UNIQUE_ID'
  166 | #define __UNIQUE_ID(prefix) __PASTE(__PASTE(__UNIQUE_ID_, prefix), __COUNTER__)
      |                             ^
././include/linux/compiler_types.h:84:22:  CC      kernel/seccomp.o
 note: expanded from macro '__PASTE'
   84 | #define __PASTE(a,b) ___PASTE(a,b)
      |                      ^
././include/linux/compiler_types.h:83:23: note: expanded from macro '___PASTE'
   83 | #define ___PASTE(a,b) a##b
      |                       ^
<scratch space>:35:1: note: expanded from here
   35 | __UNIQUE_ID_guard578
      | ^
2 errors generated.
make[7]: *** [scripts/Makefile.build:203: kernel/irq/manage.o] Fehler 1
make[6]: *** [scripts/Makefile.build:461: kernel/irq] Fehler 2


Bert Karwatzki

^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: lockup and kernel panic in linux-next-202505{09,12} when compiled with clang
@ 2025-05-13 16:48 Bert Karwatzki
  2025-05-13 22:33 ` Thomas Gleixner
  0 siblings, 1 reply; 22+ messages in thread
From: Bert Karwatzki @ 2025-05-13 16:48 UTC (permalink / raw)
  To: linux-kernel
  Cc: Bert Karwatzki, linux-next, llvm, Johannes Berg, Thomas Gleixner

> 
> I'll now start a bisection where I revert 76a853f86c97 where possible in
> order to find the remaining bugs.
>

The second bisection (from v6.15-rc6 to next-20250512) is finished now:

This commit leads to lockups and kernel panics after
watching ~5-10min of a youtube video while compiling a kernel,
reverting it in next-20250512 is possible:
76a853f86c97 ("wifi: free SKBTX_WIFI_STATUS skb tx_flags flag")
This commit leads to the boot failure, reverting leads to the
compile error it is supposed to fix:
97f4b999e0c8 ("genirq: Use scoped_guard() to shut clang up")

So are these kernel bugs or a clang bugs?

Bert Karwatzki


^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: lockup and kernel panic in linux-next-202505{09,12} when compiled with clang
@ 2025-05-13 22:15 Bert Karwatzki
  0 siblings, 0 replies; 22+ messages in thread
From: Bert Karwatzki @ 2025-05-13 22:15 UTC (permalink / raw)
  To: linux-kernel
  Cc: Bert Karwatzki, linux-next, llvm, Johannes Berg, Thomas Gleixner

commit 97f4b999e0c8 ("genirq: Use scoped_guard() to shut clang up") may me have been
a false lead, I reverted the following commit in next-20250512 and the boot failure
is still there.

73e2e0671c90 (HEAD -> clang_panic) Revert "genirq/manage: Convert to lock guards"
ff2e5dfa1c21 Revert "genirq/manage: Rework irq_update_affinity_desc()"
f2be1d787117 Revert "genirq/manage: Rework __irq_apply_affinity_hint()"
bc2493e2bdef Revert "genirq/manage: Rework irq_set_vcpu_affinity()"
8c1736260f99 Revert "genirq/manage: Rework __disable_irq_nosync()"
dd529a9bc52d Revert "genirq/manage: Rework enable_irq()"
75316d9120cf Revert "genirq/manage: Rework irq_set_irq_wake()"
544ff63947f5 Revert "genirq/manage: Rework can_request_irq()"
198028713b99 Revert "genirq/manage: Rework irq_set_parent()"
70a3f6953491 Revert "genirq/manage: Rework enable_percpu_irq()"
bcb28ca2603d Revert "genirq/manage: Rework irq_percpu_is_enabled()"
5858d87ac7e3 Revert "genirq/manage: Rework disable_percpu_irq()"
1a1f97a3dde0 Revert "genirq/manage: Rework prepare_percpu_nmi()"
e249ccf0dde0 Revert "genirq/manage: Rework teardown_percpu_nmi()"
9be3639bdde9 Revert "genirq: Remove irq_[get|put]_desc*()"
942b93a1ee9c Revert "genirq/manage: Rework irq_get_irqchip_state()"
8f731e7b7475 Revert "genirq/manage: Rework irq_set_irqchip_state()"
5bb621187696 Revert "genirq: Use scoped_guard() to shut clang up"
6539255c6012 Revert "wifi: free SKBTX_WIFI_STATUS skb tx_flags flag"
edef45700477 (tag: next-20250512, origin/master, origin/HEAD, master) Add linux-next specific files for 20250512


Bert Karwatzki


^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: lockup and kernel panic in linux-next-202505{09,12} when compiled with clang
  2025-05-13 16:48 lockup and kernel panic in linux-next-202505{09,12} when compiled with clang Bert Karwatzki
@ 2025-05-13 22:33 ` Thomas Gleixner
  2025-05-14  0:11   ` Bert Karwatzki
  0 siblings, 1 reply; 22+ messages in thread
From: Thomas Gleixner @ 2025-05-13 22:33 UTC (permalink / raw)
  To: Bert Karwatzki, linux-kernel
  Cc: Bert Karwatzki, linux-next, llvm, Johannes Berg

On Tue, May 13 2025 at 18:48, Bert Karwatzki wrote:
>> 
>> I'll now start a bisection where I revert 76a853f86c97 where possible in
>> order to find the remaining bugs.
>
> The second bisection (from v6.15-rc6 to next-20250512) is finished now:
>
> This commit leads to lockups and kernel panics after
> watching ~5-10min of a youtube video while compiling a kernel,
> reverting it in next-20250512 is possible:
> 76a853f86c97 ("wifi: free SKBTX_WIFI_STATUS skb tx_flags flag")
> This commit leads to the boot failure, reverting leads to the
> compile error it is supposed to fix:
> 97f4b999e0c8 ("genirq: Use scoped_guard() to shut clang up")

I really have a hard time to understand what you are trying to explain
here. 'This commit leads..' is so unspecified that I can't make any
sense of it.

Also please make sure that you have commit b5fcb6898202 ("genirq: Ensure
flags in lock guard is consistently initialized") in your tree when
re-testing. That's fixing another subtle (AFAICT clang only) problem in
the guard conversion. If it's not in next yet, you can just merge

   git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip.git irq/core

into next or wait for the next next integration.

Thanks

        tglx





^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: lockup and kernel panic in linux-next-202505{09,12} when compiled with clang
  2025-05-13 22:33 ` Thomas Gleixner
@ 2025-05-14  0:11   ` Bert Karwatzki
  2025-05-14  9:32     ` Bert Karwatzki
  0 siblings, 1 reply; 22+ messages in thread
From: Bert Karwatzki @ 2025-05-14  0:11 UTC (permalink / raw)
  To: Thomas Gleixner, linux-kernel; +Cc: linux-next, llvm, Johannes Berg, spasswolf

Am Mittwoch, dem 14.05.2025 um 00:33 +0200 schrieb Thomas Gleixner:
> On Tue, May 13 2025 at 18:48, Bert Karwatzki wrote:
> > > 
> > > I'll now start a bisection where I revert 76a853f86c97 where possible in
> > > order to find the remaining bugs.
> > 
> > The second bisection (from v6.15-rc6 to next-20250512) is finished now:
> > 
> > This commit leads to lockups and kernel panics after
> > watching ~5-10min of a youtube video while compiling a kernel,
> > reverting it in next-20250512 is possible:
> > 76a853f86c97 ("wifi: free SKBTX_WIFI_STATUS skb tx_flags flag")
> > This commit leads to the boot failure, reverting leads to the
> > compile error it is supposed to fix:
> > 97f4b999e0c8 ("genirq: Use scoped_guard() to shut clang up")
> 
> I really have a hard time to understand what you are trying to explain
> here. 'This commit leads..' is so unspecified that I can't make any
> sense of it.
> 
> Also please make sure that you have commit b5fcb6898202 ("genirq: Ensure
> flags in lock guard is consistently initialized") in your tree when
> re-testing. That's fixing another subtle (AFAICT clang only) problem in
> the guard conversion. If it's not in next yet, you can just merge
> 
>    git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip.git irq/core
> 
> into next or wait for the next next integration.
> 
> Thanks
> 
>         tglx


I merged git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip.git irq/core into
next-20250513 and this fixes the boot failure but the system still locks up
after a few minutes (with flashing capslock). To solve this I need to revert 
76a853f86c97 ("wifi: free SKBTX_WIFI_STATUS skb tx_flags flag")

Also commit 97f4b999e0c8 did not actually cause the boot failure that was a
bisection error.

Bert Karwatzki

^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: lockup and kernel panic in linux-next-202505{09,12} when compiled with clang
  2025-05-14  0:11   ` Bert Karwatzki
@ 2025-05-14  9:32     ` Bert Karwatzki
  2025-05-14 10:23       ` Johannes Berg
  0 siblings, 1 reply; 22+ messages in thread
From: Bert Karwatzki @ 2025-05-14  9:32 UTC (permalink / raw)
  To: linux-kernel; +Cc: linux-next, llvm, Johannes Berg, spasswolf, Thomas Gleixner

Am Mittwoch, dem 14.05.2025 um 02:11 +0200 schrieb Bert Karwatzki:
> Am Mittwoch, dem 14.05.2025 um 00:33 +0200 schrieb Thomas Gleixner:
> > On Tue, May 13 2025 at 18:48, Bert Karwatzki wrote:
> > > > 
> > > > I'll now start a bisection where I revert 76a853f86c97 where possible in
> > > > order to find the remaining bugs.
> > > 
> > > The second bisection (from v6.15-rc6 to next-20250512) is finished now:
> > > 
> > > This commit leads to lockups and kernel panics after
> > > watching ~5-10min of a youtube video while compiling a kernel,
> > > reverting it in next-20250512 is possible:
> > > 76a853f86c97 ("wifi: free SKBTX_WIFI_STATUS skb tx_flags flag")
> > > This commit leads to the boot failure, reverting leads to the
> > > compile error it is supposed to fix:
> > > 97f4b999e0c8 ("genirq: Use scoped_guard() to shut clang up")
> > 
> > I really have a hard time to understand what you are trying to explain
> > here. 'This commit leads..' is so unspecified that I can't make any
> > sense of it.
> > 
> > Also please make sure that you have commit b5fcb6898202 ("genirq: Ensure
> > flags in lock guard is consistently initialized") in your tree when
> > re-testing. That's fixing another subtle (AFAICT clang only) problem in
> > the guard conversion. If it's not in next yet, you can just merge
> > 
> >    git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip.git irq/core
> > 
> > into next or wait for the next next integration.
> > 
> > Thanks
> > 
> >         tglx
> 
> 
> I merged git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip.git irq/core into
> next-20250513 and this fixes the boot failure but the system still locks up
> after a few minutes (with flashing capslock). To solve this I need to revert 
> 76a853f86c97 ("wifi: free SKBTX_WIFI_STATUS skb tx_flags flag")
> 
> Also commit 97f4b999e0c8 did not actually cause the boot failure that was a
> bisection error.
> 
> Bert Karwatzki

To investigate the problem with commit 76a853f86c97 ("wifi: free
SKBTX_WIFI_STATUS skb tx_flags flag") I used next-20250513 with irq/core merged
to fix the boot issue and the reverted commit 76a853f86c97. 

$ git log --oneline
bb3ff0e21a16 Revert "wifi: free SKBTX_WIFI_STATUS skb tx_flags flag"
28d1f7734aa3 Merge branch 'irq/core' into clang_panic
aa94665adc28 (tag: next-20250513, origin/master, origin/HEAD, master) Add linux-
next specific files for 20250513

Then I reapplied commit 76a853f86c97 hunk by hunk and found the one hunk that
causes the problem:

diff --git a/net/mac80211/tx.c b/net/mac80211/tx.c
index 3e751dd3ae7b..63df21228029 100644
--- a/net/mac80211/tx.c
+++ b/net/mac80211/tx.c
@@ -4648,8 +4648,7 @@ static void ieee80211_8023_xmit(struct
ieee80211_sub_if_data *sdata,
                        memcpy(IEEE80211_SKB_CB(seg), info, sizeof(*info));
        }
 
-       if (unlikely(skb->sk &&
-                    skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS)) {
+       if (unlikely(skb->sk && sock_flag(skb->sk, SOCK_WIFI_STATUS))) {
                info->status_data = ieee80211_store_ack_skb(local, skb,
                                                            &info->flags, NULL);
                if (info->status_data)

This is enough to cause a kernel panic when compiled with clang (clang-19.1.7
from debian sid). Compiling the same kernel with gcc (gcc-14.2.0 from debian
sid) shows no problem.

The wifi card used is
04:00.0 Network controller [0280]: MEDIATEK Corp. MT7921K (RZ608) Wi-Fi 6E 80MHz
[14c3:0608]

Bert Karwatzki

^ permalink raw reply related	[flat|nested] 22+ messages in thread

* Re: lockup and kernel panic in linux-next-202505{09,12} when compiled with clang
  2025-05-14  9:32     ` Bert Karwatzki
@ 2025-05-14 10:23       ` Johannes Berg
  2025-05-14 13:46         ` Bert Karwatzki
  0 siblings, 1 reply; 22+ messages in thread
From: Johannes Berg @ 2025-05-14 10:23 UTC (permalink / raw)
  To: Bert Karwatzki, linux-kernel@vger.kernel.org
  Cc: linux-next@vger.kernel.org, llvm@lists.linux.dev, Thomas Gleixner,
	linux-wireless

+ linux-wireless

On Wed, 2025-05-14 at 09:32 +0000, Bert Karwatzki wrote:

> Then I reapplied commit 76a853f86c97 hunk by hunk and found the one hunk that
> causes the problem:
> 
> diff --git a/net/mac80211/tx.c b/net/mac80211/tx.c
> index 3e751dd3ae7b..63df21228029 100644
> --- a/net/mac80211/tx.c
> +++ b/net/mac80211/tx.c
> @@ -4648,8 +4648,7 @@ static void ieee80211_8023_xmit(struct
> ieee80211_sub_if_data *sdata,
>                         memcpy(IEEE80211_SKB_CB(seg), info, sizeof(*info));
>         }
> 
> -       if (unlikely(skb->sk &&
> -                    skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS)) {
> +       if (unlikely(skb->sk && sock_flag(skb->sk, SOCK_WIFI_STATUS))) {
>                 info->status_data = ieee80211_store_ack_skb(local, skb,
>                                                             &info->flags, NULL);
>                 if (info->status_data)

I think it crashed later on the status, but this inserts the skb into
the IDR so the status can pick it up to return the status and afaict
_that's_ where it crashed.

Still I don't really know what could go wrong? The (copied) skb should
still have been keeping the socket alive.

> This is enough to cause a kernel panic when compiled with clang (clang-19.1.7
> from debian sid). Compiling the same kernel with gcc (gcc-14.2.0 from debian
> sid) shows no problem.

Right, even stranger. But I can't even say you should look at this place
(which inserts) or the other (which takes it out again and crashed) to
compare the code :-/


johannes

^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: lockup and kernel panic in linux-next-202505{09,12} when compiled with clang
  2025-05-14 10:23       ` Johannes Berg
@ 2025-05-14 13:46         ` Bert Karwatzki
  2025-05-14 17:49           ` Johannes Berg
  2025-05-14 18:56           ` Johannes Berg
  0 siblings, 2 replies; 22+ messages in thread
From: Bert Karwatzki @ 2025-05-14 13:46 UTC (permalink / raw)
  To: Johannes Berg, linux-kernel@vger.kernel.org
  Cc: linux-next@vger.kernel.org, llvm@lists.linux.dev, Thomas Gleixner,
	linux-wireless, spasswolf

Am Mittwoch, dem 14.05.2025 um 12:23 +0200 schrieb Johannes Berg:
> + linux-wireless
> 
> On Wed, 2025-05-14 at 09:32 +0000, Bert Karwatzki wrote:
> 
> > Then I reapplied commit 76a853f86c97 hunk by hunk and found the one hunk that
> > causes the problem:
> > 
> > diff --git a/net/mac80211/tx.c b/net/mac80211/tx.c
> > index 3e751dd3ae7b..63df21228029 100644
> > --- a/net/mac80211/tx.c
> > +++ b/net/mac80211/tx.c
> > @@ -4648,8 +4648,7 @@ static void ieee80211_8023_xmit(struct
> > ieee80211_sub_if_data *sdata,
> >                         memcpy(IEEE80211_SKB_CB(seg), info, sizeof(*info));
> >         }
> > 
> > -       if (unlikely(skb->sk &&
> > -                    skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS)) {
> > +       if (unlikely(skb->sk && sock_flag(skb->sk, SOCK_WIFI_STATUS))) {
> >                 info->status_data = ieee80211_store_ack_skb(local, skb,
> >                                                             &info->flags, NULL);
> >                 if (info->status_data)
> 
> I think it crashed later on the status, but this inserts the skb into
> the IDR so the status can pick it up to return the status and afaict
> _that's_ where it crashed.
> 
> Still I don't really know what could go wrong? The (copied) skb should
> still have been keeping the socket alive.
> 
> > This is enough to cause a kernel panic when compiled with clang (clang-19.1.7
> > from debian sid). Compiling the same kernel with gcc (gcc-14.2.0 from debian
> > sid) shows no problem.
> 
> Right, even stranger. But I can't even say you should look at this place
> (which inserts) or the other (which takes it out again and crashed) to
> compare the code :-/
> 
> 
> johannes

I've split off the problematic piece of code into an noinline function to simplify the disassembly:

diff --git a/net/mac80211/tx.c b/net/mac80211/tx.c
index 20de6e6b0929..075e012d9992 100644
--- a/net/mac80211/tx.c
+++ b/net/mac80211/tx.c
@@ -4582,7 +4582,19 @@ static bool ieee80211_tx_8023(struct ieee80211_sub_if_data *sdata,
 	return ret;
 }
 
-static noinline void ieee80211_8023_xmit(struct ieee80211_sub_if_data *sdata,
+static noinline void ieee80211_8023_xmit_clang_debug_helper(struct sk_buff *skb,
+							    struct ieee80211_local *local,
+							    struct ieee80211_tx_info *info)
+{
+	if (unlikely(skb->sk && sock_flag(skb->sk, SOCK_WIFI_STATUS))) {
+		info->status_data = ieee80211_store_ack_skb(local, skb,
+							    &info->flags, NULL);
+		if (info->status_data)
+			info->status_data_idr = 1;
+	}
+}
+
+static void ieee80211_8023_xmit(struct ieee80211_sub_if_data *sdata,
 				struct net_device *dev, struct sta_info *sta,
 				struct ieee80211_key *key, struct sk_buff *skb)
 {
@@ -4648,12 +4660,7 @@ static noinline void ieee80211_8023_xmit(struct ieee80211_sub_if_data *sdata,
 			memcpy(IEEE80211_SKB_CB(seg), info, sizeof(*info));
 	}
 
-	if (unlikely(skb->sk && sock_flag(skb->sk, SOCK_WIFI_STATUS))) {
-		info->status_data = ieee80211_store_ack_skb(local, skb,
-							    &info->flags, NULL);
-		if (info->status_data)
-			info->status_data_idr = 1;
-	}
+	ieee80211_8023_xmit_clang_debug_helper(skb, local, info);
 
 	dev_sw_netstats_tx_add(dev, skbs, len);
 	sta->deflink.tx_stats.packets[queue] += skbs;

This shows the the behaviour as the old code, i.e. kernel panic when compiled with clang(-19.1.7), no problem when
compiled with gcc(-14.2.0).

When compiled with clang the disassembly of the function is (from objdump -d)

000000000000a260 <ieee80211_8023_xmit_clang_debug_helper>:
    a260:	48 8b 47 18          	mov    0x18(%rdi),%rax
    a264:	48 85 c0             	test   %rax,%rax
    a267:	74 0c                	je     a275 <ieee80211_8023_xmit_clang_debug_helper+0x15>
    a269:	53                   	push   %rbx
    a26a:	48 f7 40 60 00 00 08 	testq  $0x80000,0x60(%rax)
    a271:	00 
    a272:	75 07                	jne    a27b <ieee80211_8023_xmit_clang_debug_helper+0x1b>
    a274:	5b                   	pop    %rbx
    a275:	2e e9 00 00 00 00    	cs jmp a27b <ieee80211_8023_xmit_clang_debug_helper+0x1b>
    a27b:	48 89 f8             	mov    %rdi,%rax
    a27e:	48 89 f7             	mov    %rsi,%rdi
    a281:	48 89 c6             	mov    %rax,%rsi
    a284:	48 89 d3             	mov    %rdx,%rbx
    a287:	31 c9                	xor    %ecx,%ecx
    a289:	e8 02 ff ff ff       	call   a190 <ieee80211_store_ack_skb>
    a28e:	25 ff 1f 00 00       	and    $0x1fff,%eax
    a293:	89 c2                	mov    %eax,%edx
    a295:	b9 0f 00 fe ff       	mov    $0xfffe000f,%ecx
    a29a:	23 4b 04             	and    0x4(%rbx),%ecx
    a29d:	c1 e2 04             	shl    $0x4,%edx
    a2a0:	09 d1                	or     %edx,%ecx
    a2a2:	89 4b 04             	mov    %ecx,0x4(%rbx)
    a2a5:	85 c0                	test   %eax,%eax
    a2a7:	74 cb                	je     a274 <ieee80211_8023_xmit_clang_debug_helper+0x14>
    a2a9:	83 c9 08             	or     $0x8,%ecx
    a2ac:	89 4b 04             	mov    %ecx,0x4(%rbx)
    a2af:	eb c3                	jmp    a274 <ieee80211_8023_xmit_clang_debug_helper+0x14>
    a2b1:	66 66 66 66 66 66 2e 	data16 data16 data16 data16 data16 cs nopw 0x0(%rax,%rax,1)
    a2b8:	0f 1f 84 00 00 00 00 
    a2bf:	00 

When compiled with gcc the disassembly is

00000000000010e0 <ieee80211_8023_xmit_clang_debug_helper>:
    10e0:	48 8b 4f 18          	mov    0x18(%rdi),%rcx
    10e4:	48 89 f8             	mov    %rdi,%rax
    10e7:	48 85 c9             	test   %rcx,%rcx
    10ea:	75 05                	jne    10f1 <ieee80211_8023_xmit_clang_debug_helper+0x11>
    10ec:	e9 00 00 00 00       	jmp    10f1 <ieee80211_8023_xmit_clang_debug_helper+0x11>
    10f1:	48 8b 49 60          	mov    0x60(%rcx),%rcx
    10f5:	f7 c1 00 00 08 00    	test   $0x80000,%ecx
    10fb:	74 ef                	je     10ec <ieee80211_8023_xmit_clang_debug_helper+0xc>
    10fd:	48 83 ec 08          	sub    $0x8,%rsp
    1101:	48 89 f7             	mov    %rsi,%rdi
    1104:	31 c9                	xor    %ecx,%ecx
    1106:	48 89 c6             	mov    %rax,%rsi
    1109:	48 89 14 24          	mov    %rdx,(%rsp)
    110d:	e8 ce f8 ff ff       	call   9e0 <ieee80211_store_ack_skb>
    1112:	48 8b 14 24          	mov    (%rsp),%rdx
    1116:	89 c1                	mov    %eax,%ecx
    1118:	8b 42 04             	mov    0x4(%rdx),%eax
    111b:	81 e1 ff 1f 00 00    	and    $0x1fff,%ecx
    1121:	c1 e1 04             	shl    $0x4,%ecx
    1124:	25 0f 00 fe ff       	and    $0xfffe000f,%eax
    1129:	09 c8                	or     %ecx,%eax
    112b:	89 42 04             	mov    %eax,0x4(%rdx)
    112e:	a9 f0 ff 01 00       	test   $0x1fff0,%eax
    1133:	74 04                	je     1139 <ieee80211_8023_xmit_clang_debug_helper+0x59>
    1135:	80 4a 04 08          	orb    $0x8,0x4(%rdx)
    1139:	48 83 c4 08          	add    $0x8,%rsp
    113d:	e9 00 00 00 00       	jmp    1142 <ieee80211_8023_xmit_clang_debug_helper+0x62>
    1142:	66 66 2e 0f 1f 84 00 	data16 cs nopw 0x0(%rax,%rax,1)
    1149:	00 00 00 00 
    114d:	0f 1f 00             	nopl   (%rax)
    1150:	90                   	nop
    1151:	90                   	nop
    1152:	90                   	nop
    1153:	90                   	nop
    1154:	90                   	nop
    1155:	90                   	nop
    1156:	90                   	nop
    1157:	90                   	nop
    1158:	90                   	nop
    1159:	90                   	nop
    115a:	90                   	nop
    115b:	90                   	nop
    115c:	90                   	nop
    115d:	90                   	nop
    115e:	90                   	nop
    115f:	90                   	nop


I've not yet taken a closer look, but perhaps the error is obvious
for some one else.

Bert Karwatzki


^ permalink raw reply related	[flat|nested] 22+ messages in thread

* Re: lockup and kernel panic in linux-next-202505{09,12} when compiled with clang
  2025-05-14 13:46         ` Bert Karwatzki
@ 2025-05-14 17:49           ` Johannes Berg
  2025-05-14 18:56           ` Johannes Berg
  1 sibling, 0 replies; 22+ messages in thread
From: Johannes Berg @ 2025-05-14 17:49 UTC (permalink / raw)
  To: Bert Karwatzki, linux-kernel@vger.kernel.org
  Cc: linux-next@vger.kernel.org, llvm@lists.linux.dev, Thomas Gleixner,
	linux-wireless

On Wed, 2025-05-14 at 15:46 +0200, Bert Karwatzki wrote:
> 
> When compiled with clang the disassembly of the function is (from objdump -d)

Can you show with relocations ("objdump -dr" I think)? The jumps with
four 00 bytes don't really make sense if there aren't relocations for
them.

johannes

^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: lockup and kernel panic in linux-next-202505{09,12} when compiled with clang
  2025-05-14 13:46         ` Bert Karwatzki
  2025-05-14 17:49           ` Johannes Berg
@ 2025-05-14 18:56           ` Johannes Berg
  2025-05-14 22:27             ` Bert Karwatzki
  1 sibling, 1 reply; 22+ messages in thread
From: Johannes Berg @ 2025-05-14 18:56 UTC (permalink / raw)
  To: Bert Karwatzki, linux-kernel@vger.kernel.org
  Cc: linux-next@vger.kernel.org, llvm@lists.linux.dev, Thomas Gleixner,
	linux-wireless

> 
> I've split off the problematic piece of code into an noinline function to simplify the disassembly:
> 

Oh and also, does it even still crash with that? :)

Still I feel it's possibly some kind of weird side-effect and not
strictly a compiler issue? But I don't see anything so far.

johannes

^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: lockup and kernel panic in linux-next-202505{09,12} when compiled with clang
  2025-05-14 18:56           ` Johannes Berg
@ 2025-05-14 22:27             ` Bert Karwatzki
  2025-05-15  6:30               ` Johannes Berg
  0 siblings, 1 reply; 22+ messages in thread
From: Bert Karwatzki @ 2025-05-14 22:27 UTC (permalink / raw)
  To: Johannes Berg, linux-kernel@vger.kernel.org
  Cc: linux-next@vger.kernel.org, llvm@lists.linux.dev, Thomas Gleixner,
	linux-wireless, spasswolf

Am Mittwoch, dem 14.05.2025 um 20:56 +0200 schrieb Johannes Berg:
> > 
> > I've split off the problematic piece of code into an noinline function to simplify the disassembly:
> > 
> 
> Oh and also, does it even still crash with that? :)

Yes, it still crashes when compiled with clang.

> 
> Still I feel it's possibly some kind of weird side-effect and not
> strictly a compiler issue? But I don't see anything so far.
> 
> johannes

The problem only occur with PREEMPT_RT=y and clang,I was able to capture the
panic message via netconsole:

 [  267.339591][  T575] BUG: unable to handle page fault for address:
ffffffff51e080b0
 [  267.339598][  T575] #PF: supervisor write access in kernel mode
 [  267.339602][  T575] #PF: error_code(0x0002) - not-present page
 [  267.339606][  T575] PGD f1cc3c067 P4D f1cc3c067 PUD 0 
 [  267.339613][  T575] Oops: Oops: 0002 [#1] SMP NOPTI
 [  267.339622][  T575] CPU: 0 UID: 0 PID: 575 Comm: napi/phy0-0 Not tainted
6.15.0-rc6-next-20250513-llvm-00009-gec34cd07a425 #968 PREEMPT_{RT,(full)} 
 [  267.339629][  T575] Hardware name: Micro-Star International Co., Ltd. Alpha
15 B5EEK/MS-158L, BIOS E158LAMS.10F 11/11/2024
 [  267.339632][  T575] RIP: 0010:queued_spin_lock_slowpath+0x120/0x1c0
66 a9 83 7a 08 00 75 08 f3 90 83 7a 08 00 74 f8
 [  267.339659][  T575] RSP: 0018:ffffcc5a81edf998 EFLAGS: 00010002
 [  267.339664][  T575] RAX: ffffffffa87a5ee0 RBX: 0000000000000286 RCX:
0000000000040000
 [  267.339668][  T575] RDX: ffff8b6d2e6231c0 RSI: 0000000000000010 RDI:
ffff8b5e8855cda8
 [  267.339671][  T575] RBP: ffff8b5e852ff300 R08: fffffffffffffff8 R09:
0000000000000001
R11: ffffffffa87f07f0 R12: ffff8b5e8855cd90
 [  267.339677][  T575] R13: ffff8b5ec1bd2480 R14: ffff8b5e8855cda8 R15:
ffff8b5e8855cda8
 [  267.339681][  T575] FS:  0000000000000000(0000) GS:ffff8b6d84fc1000(0000)
knlGS:0000000000000000
 [  267.339684][  T575] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
 [  267.339687][  T575] CR2: ffffffff51e080b0 CR3: 0000000f1cc3a000 CR4:
0000000000750ef0
 [  267.339690][  T575] PKRU: 55555554
 [  267.339692][  T575] Call Trace:
 [  267.339701][  T575]  <TASK>
 [  267.339705][  T575]  _raw_spin_lock_irqsave+0x57/0x60
 [  267.339714][  T575]  rt_spin_lock+0x73/0xa0
 [  267.339720][  T575]  sock_queue_err_skb+0xdc/0x140
 [  267.339727][  T575]  skb_complete_wifi_ack+0xa9/0x120
 [  267.339737][  T575]  ieee80211_report_used_skb+0x541/0x6e0 [mac80211]
 [  267.339799][  T575]  ? srso_alias_return_thunk+0x5/0xfbef5
 [  267.339804][  T575]  ? start_dl_timer+0xcf/0x110
 [  267.339814][  T575]  ieee80211_tx_status_ext+0x3b3/0x870 [mac80211]
 [  267.339851][  T575]  ? raw_spin_rq_lock_nested+0x15/0x80
 [  267.339862][  T575]  ? srso_alias_return_thunk+0x5/0xfbef5
 [  267.339866][  T575]  ? rt_spin_lock+0x3d/0xa0
 [  267.339873][  T575]  ? mt76_tx_status_unlock+0x38/0x230 [mt76]
 [  267.339886][  T575]  mt76_tx_status_unlock+0x1e0/0x230 [mt76]
 [  267.339901][  T575]  __mt76_tx_complete_skb+0x13b/0x2e0 [mt76]
 [  267.339912][  T575]  ? srso_alias_return_thunk+0x5/0xfbef5
 [  267.339915][  T575]  ? rt_spin_unlock+0x12/0x40
 [  267.339918][  T575]  ? srso_alias_return_thunk+0x5/0xfbef5
 [  267.339924][  T575]  mt76_connac2_txwi_free+0x127/0x150 [mt76_connac_lib]
 [  267.339938][  T575]  mt7921_mac_tx_free+0x112/0x260 [mt7921_common]
 [  267.339950][  T575]  mt7921_rx_check+0x33/0xe0 [mt7921_common]
 [  267.339957][  T575]  mt76_dma_rx_poll+0x322/0x660 [mt76]
 [  267.339970][  T575]  ? mt792x_poll_rx+0x2a/0x120 [mt792x_lib]
 [  267.339982][  T575]  mt792x_poll_rx+0x71/0x120 [mt792x_lib]
 [  267.339989][  T575]  __napi_poll+0x2a/0x170
 [  267.339994][  T575]  ? napi_threaded_poll_loop+0x32/0x1b0
 [  267.339998][  T575]  napi_threaded_poll_loop+0xe4/0x1b0
 [  267.340001][  T575]  ? napi_threaded_poll_loop+0x32/0x1b0
 [  267.340007][  T575]  napi_threaded_poll+0x57/0x80
 [  267.340011][  T575]  ? __pfx_napi_threaded_poll+0x10/0x10
 [  267.340014][  T575]  kthread+0x25c/0x280
 [  267.340020][  T575]  ? __pfx_kthread+0x10/0x10
 [  267.340025][  T575]  ret_from_fork+0xc4/0x1b0
 [  267.340030][  T575]  ? __pfx_kthread+0x10/0x10
 [  267.340034][  T575]  ret_from_fork_asm+0x1a/0x30
 [  267.340043][  T575]  </TASK>
 [  267.340045][  T575] Modules linked in: netconsole ccm snd_seq_dummy
snd_hrtimer snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq snd_seq_device
rfcomm bnep nls_ascii nls_cp437 vfat fat snd_ctl_led snd_hda_codec_realtek
snd_hda_scodec_component snd_hda_codec_generic snd_hda_codec_hdmi btusb btbcm
btintel snd_hda_intel btrtl btmtk snd_intel_dspcfg snd_hda_codec snd_soc_dmic
snd_acp3x_pdm_dma snd_acp3x_rn uvcvideo bluetooth snd_soc_core snd_hwdep
videobuf2_vmalloc videobuf2_memops uvc snd_hda_core videobuf2_v4l2 snd_pcm_oss
videodev snd_mixer_oss snd_pcm snd_rn_pci_acp3x videobuf2_common snd_acp_config
snd_soc_acpi msi_wmi ecdh_generic ecc mc wmi_bmof sparse_keymap snd_timer
edac_mce_amd snd k10temp ccp snd_pci_acp3x soundcore battery ac button joydev
hid_sensor_gyro_3d hid_sensor_magn_3d hid_sensor_als hid_sensor_prox
hid_sensor_accel_3d hid_sensor_trigger hid_sensor_iio_common amd_pmc
industrialio_triggered_buffer kfifo_buf evdev industrialio mt7921e mt7921_common
mt792x_lib mt76_
libarc4 cfg80211
 [  267.340161][  T575]  rfkill msr fuse nvme_fabrics efi_pstore configfs
efivarfs autofs4 ext4 mbcache jbd2 amdgpu usbhid drm_panel_backlight_quirks cec
drm_buddy drm_suballoc_helper drm_exec i2c_algo_bit drm_display_helper xhci_pci
gpu_sched drm_ttm_helper xhci_hcd hid_sensor_hub ttm hid_multitouch mfd_core
hid_generic psmouse i2c_hid_acpi drm_client_lib nvme amd_sfh usbcore i2c_hid
drm_kms_helper hid serio_raw nvme_core r8169 i2c_piix4 i2c_smbus usb_common
amdxcp crc16 i2c_designware_platform i2c_designware_core
 [  267.340214][  T575] CR2: ffffffff51e080b0
 [  267.340219][  T575] ---[ end trace 0000000000000000 ]---
 [  267.536499][  T575] RIP: 0010:queued_spin_lock_slowpath+0x120/0x1c0
66 a9 83 7a 08 00 75 08 f3 90 83 7a 08 00 74 f8
 [  267.536514][  T575] RSP: 0018:ffffcc5a81edf998 EFLAGS: 00010002
 [  267.536518][  T575] RAX: ffffffffa87a5ee0 RBX: 0000000000000286 RCX:
0000000000040000
 [  267.536521][  T575] RDX: ffff8b6d2e6231c0 RSI: 0000000000000010 RDI:
ffff8b5e8855cda8
 [  267.536523][  T575] RBP: ffff8b5e852ff300 R08: fffffffffffffff8 R09:
0000000000000001
R11: ffffffffa87f07f0 R12: ffff8b5e8855cd90
 [  267.536526][  T575] R13: ffff8b5ec1bd2480 R14: ffff8b5e8855cda8 R15:
ffff8b5e8855cda8
 [  267.536528][  T575] FS:  0000000000000000(0000) GS:ffff8b6d84fc1000(0000)
knlGS:0000000000000000
 [  267.536530][  T575] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
 [  267.536532][  T575] CR2: ffffffff51e080b0 CR3: 0000000f1cc3a000 CR4:
0000000000750ef0
 [  267.536534][  T575] PKRU: 55555554
 [  267.536536][  T575] Kernel panic - not syncing: Fatal exception in interrupt
 [  267.536948][  T575] Kernel Offset: 0x26e00000 from 0xffffffff81000000
(relocation range: 0xffffffff80000000-0xffffffffbfffffff)
 [  267.735256][  T575] ---[ end Kernel panic - not syncing: Fatal exception in
interrupt ]---

Another try showed a different error (non-canonical address!)

[  115.685734][  T579] Oops: general protection fault, probably for non-
canonical address 0x9d504b8ce3373: 0000 [#1] SMP NOPTI
 [  115.685742][  T579] CPU: 13 UID: 0 PID: 579 Comm: napi/phy0-0 Not tainted
6.15.0-rc6-next-20250513-llvm-00009-gec34cd07a425 #970 PREEMPT_{RT,(full)} 
 [  115.685747][  T579] Hardware name: Micro-Star International Co., Ltd. Alpha
15 B5EEK/MS-158L, BIOS E158LAMS.10F 11/11/2024
 [  115.685749][  T579] RIP: 0010:queued_spin_lock_slowpath+0x120/0x1c0
86 b9 83 7a 08 00 75 08 f3 90 83 7a 08 00 74 f8
 [  115.685758][  T579] RSP: 0018:ffffd0c244fc3998 EFLAGS: 00010006
 [  115.685761][  T579] RAX: 0009d504ff4811a3 RBX: 0000000000000286 RCX:
0000000000380000
 [  115.685764][  T579] RDX: ffff8e13ee9631c0 RSI: 0000000000000010 RDI:
ffff8e08c29126a8
 [  115.685765][  T579] RBP: ffff8e055300d400 R08: fffffffffffffff8 R09:
0000000000000001
R11: ffffffffb89f07f0 R12: ffff8e08c2912690
 [  115.685769][  T579] R13: ffff8e056a2f2480 R14: ffff8e08c29126a8 R15:
ffff8e08c29126a8
 [  115.685771][  T579] FS:  0000000000000000(0000) GS:ffff8e1435101000(0000)
knlGS:0000000000000000
 [  115.685773][  T579] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
 [  115.685776][  T579] CR2: 00007f56b8d28000 CR3: 0000000163d15000 CR4:
0000000000750ef0
 [  115.685778][  T579] PKRU: 55555554
 [  115.685779][  T579] Call Trace:
 [  115.685782][  T579]  <TASK>
 [  115.685784][  T579]  _raw_spin_lock_irqsave+0x57/0x60
 [  115.685790][  T579]  rt_spin_lock+0x73/0xa0
 [  115.685795][  T579]  sock_queue_err_skb+0xdc/0x140
 [  115.685801][  T579]  skb_complete_wifi_ack+0xa9/0x120
 [  115.685809][  T579]  ieee80211_report_used_skb+0x541/0x6e0 [mac80211]
 [  115.685858][  T579]  ? srso_alias_return_thunk+0x5/0xfbef5
 [  115.685862][  T579]  ? wake_up_q+0x4e/0xe0
 [  115.685867][  T579]  ? srso_alias_return_thunk+0x5/0xfbef5
 [  115.685872][  T579]  ieee80211_tx_status_ext+0x3b3/0x870 [mac80211]
 [  115.685902][  T579]  ? srso_alias_return_thunk+0x5/0xfbef5
 [  115.685905][  T579]  ? rt_spin_lock+0x3d/0xa0
 [  115.685910][  T579]  ? mt76_tx_status_unlock+0x38/0x230 [mt76]
 [  115.685920][  T579]  mt76_tx_status_unlock+0x1e0/0x230 [mt76]
 [  115.685932][  T579]  __mt76_tx_complete_skb+0x13b/0x2e0 [mt76]
 [  115.685942][  T579]  ? srso_alias_return_thunk+0x5/0xfbef5
 [  115.685945][  T579]  ? rt_spin_unlock+0x12/0x40
 [  115.685947][  T579]  ? srso_alias_return_thunk+0x5/0xfbef5
 [  115.685954][  T579]  mt76_connac2_txwi_free+0x127/0x150 [mt76_connac_lib]
 [  115.685964][  T579]  mt7921_mac_tx_free+0x112/0x260 [mt7921_common]
 [  115.685975][  T579]  mt7921_rx_check+0x33/0xe0 [mt7921_common]
 [  115.685982][  T579]  mt76_dma_rx_poll+0x322/0x660 [mt76]
 [  115.685993][  T579]  ? mt792x_poll_rx+0x2a/0x120 [mt792x_lib]
 [  115.686001][  T579]  mt792x_poll_rx+0x71/0x120 [mt792x_lib]
 [  115.686009][  T579]  __napi_poll+0x2a/0x170
 [  115.686013][  T579]  ? napi_threaded_poll_loop+0x32/0x1b0
 [  115.686017][  T579]  napi_threaded_poll_loop+0xe4/0x1b0
 [  115.686020][  T579]  ? napi_threaded_poll_loop+0x32/0x1b0
 [  115.686026][  T579]  napi_threaded_poll+0x57/0x80
 [  115.686029][  T579]  ? __pfx_napi_threaded_poll+0x10/0x10
 [  115.686032][  T579]  kthread+0x25c/0x280
 [  115.686038][  T579]  ? __pfx_kthread+0x10/0x10
 [  115.686043][  T579]  ret_from_fork+0xc4/0x1b0
 [  115.686047][  T579]  ? __pfx_kthread+0x10/0x10
 [  115.686051][  T579]  ret_from_fork_asm+0x1a/0x30
 [  115.686058][  T579]  </TASK>
 [  115.686060][  T579] Modules linked in: ccm netconsole snd_seq_dummy
snd_hrtimer snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq snd_seq_device
rfcomm bnep nls_ascii nls_cp437 vfat fat snd_ctl_led snd_hda_codec_realtek
snd_hda_scodec_component snd_hda_codec_generic snd_hda_codec_hdmi snd_hda_intel
btusb snd_intel_dspcfg btbcm snd_hda_codec btintel btrtl uvcvideo
snd_acp3x_pdm_dma btmtk snd_soc_dmic snd_hwdep snd_acp3x_rn snd_soc_core
snd_hda_core videobuf2_vmalloc videobuf2_memops uvc bluetooth snd_pcm_oss
videobuf2_v4l2 snd_mixer_oss videodev snd_pcm snd_rn_pci_acp3x snd_acp_config
videobuf2_common snd_timer msi_wmi snd_soc_acpi ecdh_generic ecc mc wmi_bmof
sparse_keymap edac_mce_amd snd ccp soundcore k10temp snd_pci_acp3x battery ac
button joydev hid_sensor_prox hid_sensor_accel_3d hid_sensor_gyro_3d
hid_sensor_als hid_sensor_magn_3d hid_sensor_trigger hid_sensor_iio_common
amd_pmc industrialio_triggered_buffer kfifo_buf evdev industrialio mt7921e
mt7921_common mt792x_lib mt76_
libarc4 cfg80211
 [  115.686166][  T579]  rfkill msr fuse nvme_fabrics configfs efi_pstore
efivarfs autofs4 ext4 mbcache jbd2 amdgpu usbhid drm_panel_backlight_quirks cec
drm_buddy drm_suballoc_helper drm_exec i2c_algo_bit drm_display_helper xhci_pci
gpu_sched hid_sensor_hub xhci_hcd psmouse drm_ttm_helper mfd_core hid_multitouch
hid_generic ttm i2c_hid_acpi serio_raw usbcore drm_client_lib nvme amd_sfh
i2c_hid hid drm_kms_helper nvme_core r8169 i2c_piix4 amdxcp usb_common crc16
i2c_smbus i2c_designware_platform i2c_designware_core
 [  115.686236][  T579] ---[ end trace 0000000000000000 ]---
 [  115.782274][  T579] RIP: 0010:queued_spin_lock_slowpath+0x120/0x1c0
86 b9 83 7a 08 00 75 08 f3 90 83 7a 08 00 74 f8
 [  115.782274][  T579] RSP: 0018:ffffd0c244fc3998 EFLAGS: 00010006
 [  115.782274][  T579] RAX: 0009d504ff4811a3 RBX: 0000000000000286 RCX:
0000000000380000
 [  115.782274][  T579] RDX: ffff8e13ee9631c0 RSI: 0000000000000010 RDI:
ffff8e08c29126a8
 [  115.846760][  T579] RBP: ffff8e055300d400 R08: fffffffffffffff8 R09:
0000000000000001
R11: ffffffffb89f07f0 R12: ffff8e08c2912690
 [  115.846760][  T579] R13: ffff8e056a2f2480 R14: ffff8e08c29126a8 R15:
ffff8e08c29126a8
 [  115.846765][  T579] FS:  0000000000000000(0000) GS:ffff8e1435101000(0000)
knlGS:0000000000000000
 [  115.846765][  T579] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
 [  115.846770][  T579] CR2: 00007f56b8d28000 CR3: 000000018d63a000 CR4:
0000000000750ef0
 [  115.846770][  T579] PKRU: 55555554
 [  115.846773][  T579] Kernel panic - not syncing: Fatal exception in interrupt
 [  115.846773][  T579] Kernel Offset: 0x37000000 from 0xffffffff81000000
(relocation range: 0xffffffff80000000-0xffffffffbfffffff)
 [  115.685734][  T579] Oops: general protection fault, probably for non-
canonical address 0x9d504b8ce3373: 0000 [#1] SMP NOPTI
 [  115.685742][  T579] CPU: 13 UID: 0 PID: 579 Comm: napi/phy0-0 Not tainted
6.15.0-rc6-next-20250513-llvm-00009-gec34cd07a425 #970 PREEMPT_{RT,(full)} 
 [  115.685747][  T579] Hardware name: Micro-Star International Co., Ltd. Alpha
15 B5EEK/MS-158L, BIOS E158LAMS.10F 11/11/2024
 [  115.685749][  T579] RIP: 0010:queued_spin_lock_slowpath+0x120/0x1c0
86 b9 83 7a 08 00 75 08 f3 90 83 7a 08 00 74 f8
 [  115.685758][  T579] RSP: 0018:ffffd0c244fc3998 EFLAGS: 00010006
 [  115.685761][  T579] RAX: 0009d504ff4811a3 RBX: 0000000000000286 RCX:
0000000000380000
 [  115.685764][  T579] RDX: ffff8e13ee9631c0 RSI: 0000000000000010 RDI:
ffff8e08c29126a8
 [  115.685765][  T579] RBP: ffff8e055300d400 R08: fffffffffffffff8 R09:
0000000000000001
R11: ffffffffb89f07f0 R12: ffff8e08c2912690
 [  115.685769][  T579] R13: ffff8e056a2f2480 R14: ffff8e08c29126a8 R15:
ffff8e08c29126a8
 [  115.685771][  T579] FS:  0000000000000000(0000) GS:ffff8e1435101000(0000)
knlGS:0000000000000000
 [  115.685773][  T579] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
 [  115.685776][  T579] CR2: 00007f56b8d28000 CR3: 0000000163d15000 CR4:
0000000000750ef0
 [  115.685778][  T579] PKRU: 55555554
 [  115.685779][  T579] Call Trace:
 [  115.685782][  T579]  <TASK>
 [  115.685784][  T579]  _raw_spin_lock_irqsave+0x57/0x60
 [  115.685790][  T579]  rt_spin_lock+0x73/0xa0
 [  115.685795][  T579]  sock_queue_err_skb+0xdc/0x140
 [  115.685801][  T579]  skb_complete_wifi_ack+0xa9/0x120
 [  115.685809][  T579]  ieee80211_report_used_skb+0x541/0x6e0 [mac80211]
 [  115.685858][  T579]  ? srso_alias_return_thunk+0x5/0xfbef5
 [  115.685862][  T579]  ? wake_up_q+0x4e/0xe0
 [  115.685867][  T579]  ? srso_alias_return_thunk+0x5/0xfbef5
 [  115.685872][  T579]  ieee80211_tx_status_ext+0x3b3/0x870 [mac80211]
 [  115.685902][  T579]  ? srso_alias_return_thunk+0x5/0xfbef5
 [  115.685905][  T579]  ? rt_spin_lock+0x3d/0xa0
 [  115.685910][  T579]  ? mt76_tx_status_unlock+0x38/0x230 [mt76]
 [  115.685920][  T579]  mt76_tx_status_unlock+0x1e0/0x230 [mt76]
 [  115.685932][  T579]  __mt76_tx_complete_skb+0x13b/0x2e0 [mt76]
 [  115.685942][  T579]  ? srso_alias_return_thunk+0x5/0xfbef5
 [  115.685945][  T579]  ? rt_spin_unlock+0x12/0x40
 [  115.685947][  T579]  ? srso_alias_return_thunk+0x5/0xfbef5
 [  115.685954][  T579]  mt76_connac2_txwi_free+0x127/0x150 [mt76_connac_lib]
 [  115.685964][  T579]  mt7921_mac_tx_free+0x112/0x260 [mt7921_common]
 [  115.685975][  T579]  mt7921_rx_check+0x33/0xe0 [mt7921_common]
 [  115.685982][  T579]  mt76_dma_rx_poll+0x322/0x660 [mt76]
 [  115.685993][  T579]  ? mt792x_poll_rx+0x2a/0x120 [mt792x_lib]
 [  115.686001][  T579]  mt792x_poll_rx+0x71/0x120 [mt792x_lib]
 [  115.686009][  T579]  __napi_poll+0x2a/0x170
 [  115.686013][  T579]  ? napi_threaded_poll_loop+0x32/0x1b0
 [  115.686017][  T579]  napi_threaded_poll_loop+0xe4/0x1b0
 [  115.686020][  T579]  ? napi_threaded_poll_loop+0x32/0x1b0
 [  115.686026][  T579]  napi_threaded_poll+0x57/0x80
 [  115.686029][  T579]  ? __pfx_napi_threaded_poll+0x10/0x10
 [  115.686032][  T579]  kthread+0x25c/0x280
 [  115.686038][  T579]  ? __pfx_kthread+0x10/0x10
 [  115.686043][  T579]  ret_from_fork+0xc4/0x1b0
 [  115.686047][  T579]  ? __pfx_kthread+0x10/0x10
 [  115.686051][  T579]  ret_from_fork_asm+0x1a/0x30
 [  115.686058][  T579]  </TASK>
 [  115.686060][  T579] Modules linked in: ccm netconsole snd_seq_dummy
snd_hrtimer snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq snd_seq_device
rfcomm bnep nls_ascii nls_cp437 vfat fat snd_ctl_led snd_hda_codec_realtek
snd_hda_scodec_component snd_hda_codec_generic snd_hda_codec_hdmi snd_hda_intel
btusb snd_intel_dspcfg btbcm snd_hda_codec btintel btrtl uvcvideo
snd_acp3x_pdm_dma btmtk snd_soc_dmic snd_hwdep snd_acp3x_rn snd_soc_core
snd_hda_core videobuf2_vmalloc videobuf2_memops uvc bluetooth snd_pcm_oss
videobuf2_v4l2 snd_mixer_oss videodev snd_pcm snd_rn_pci_acp3x snd_acp_config
videobuf2_common snd_timer msi_wmi snd_soc_acpi ecdh_generic ecc mc wmi_bmof
sparse_keymap edac_mce_amd snd ccp soundcore k10temp snd_pci_acp3x battery ac
button joydev hid_sensor_prox hid_sensor_accel_3d hid_sensor_gyro_3d
hid_sensor_als hid_sensor_magn_3d hid_sensor_trigger hid_sensor_iio_common
amd_pmc industrialio_triggered_buffer kfifo_buf evdev industrialio mt7921e
mt7921_common mt792x_lib mt76_
libarc4 cfg80211
 [  115.686166][  T579]  rfkill msr fuse nvme_fabrics configfs efi_pstore
efivarfs autofs4 ext4 mbcache jbd2 amdgpu usbhid drm_panel_backlight_quirks cec
drm_buddy drm_suballoc_helper drm_exec i2c_algo_bit drm_display_helper xhci_pci
gpu_sched hid_sensor_hub xhci_hcd psmouse drm_ttm_helper mfd_core hid_multitouch
hid_generic ttm i2c_hid_acpi serio_raw usbcore drm_client_lib nvme amd_sfh
i2c_hid hid drm_kms_helper nvme_core r8169 i2c_piix4 amdxcp usb_common crc16
i2c_smbus i2c_designware_platform i2c_designware_core
 [  115.686236][  T579] ---[ end trace 0000000000000000 ]---
 [  115.782274][  T579] RIP: 0010:queued_spin_lock_slowpath+0x120/0x1c0
86 b9 83 7a 08 00 75 08 f3 90 83 7a 08 00 74 f8
 [  115.782274][  T579] RSP: 0018:ffffd0c244fc3998 EFLAGS: 00010006
 [  115.782274][  T579] RAX: 0009d504ff4811a3 RBX: 0000000000000286 RCX:
0000000000380000
 [  115.782274][  T579] RDX: ffff8e13ee9631c0 RSI: 0000000000000010 RDI:
ffff8e08c29126a8
 [  115.846760][  T579] RBP: ffff8e055300d400 R08: fffffffffffffff8 R09:
0000000000000001
R11: ffffffffb89f07f0 R12: ffff8e08c2912690
 [  115.846760][  T579] R13: ffff8e056a2f2480 R14: ffff8e08c29126a8 R15:
ffff8e08c29126a8
 [  115.846765][  T579] FS:  0000000000000000(0000) GS:ffff8e1435101000(0000)
knlGS:0000000000000000
 [  115.846765][  T579] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
 [  115.846770][  T579] CR2: 00007f56b8d28000 CR3: 000000018d63a000 CR4:
0000000000750ef0
 [  115.846770][  T579] PKRU: 55555554
 [  115.846773][  T579] Kernel panic - not syncing: Fatal exception in interrupt
 [  115.846773][  T579] Kernel Offset: 0x37000000 from 0xffffffff81000000
(relocation range: 0xffffffff80000000-0xffffffffbfffffff)
 [  115.846773][  T579] ---[ end Kernel panic - not syncing: Fatal exception in
interrupt ]---


Bert Karwatzki

^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: lockup and kernel panic in linux-next-202505{09,12} when compiled with clang
  2025-05-14 22:27             ` Bert Karwatzki
@ 2025-05-15  6:30               ` Johannes Berg
  2025-05-15  9:10                 ` Bert Karwatzki
  0 siblings, 1 reply; 22+ messages in thread
From: Johannes Berg @ 2025-05-15  6:30 UTC (permalink / raw)
  To: Bert Karwatzki, linux-kernel@vger.kernel.org
  Cc: linux-next@vger.kernel.org, llvm@lists.linux.dev, Thomas Gleixner,
	linux-wireless

On Thu, 2025-05-15 at 00:27 +0200, Bert Karwatzki wrote:
> Am Mittwoch, dem 14.05.2025 um 20:56 +0200 schrieb Johannes Berg:
> > > 
> > > I've split off the problematic piece of code into an noinline function to simplify the disassembly:
> > > 
> > 
> > Oh and also, does it even still crash with that? :)
> 
> Yes, it still crashes when compiled with clang.

OK, just checking. :)

FWIW, I'm not convinced at all that the code you were looking at is
really the problem. The crash (see below) is happening on the status
side. Of course it cannot crash on the status side if on the TX side we
never enter anything into the IDR data structure, and never tag the SKB
to look up in the IDR and therefore never try to create the status
report on the status side.

Basically what happens is this:

- on TX, if we have a socket requesting status, create a copy of the
  SKB, put it into the IDR, and put the IDR index into the original
  skb->cb
- then transmit the original skb, of course
- on TX status report from the driver, see if the skb->cb is tagged with
  the IDR value, if so, report the copy of the SKB back to the socket
  with the status information

(The reason we need to make a copy is that the SKB could be encrypted or
otherwise modified in flight, and we don't want to undo that, rather
keeping a copy for the report.)

>  [  267.339591][  T575] BUG: unable to handle page fault for address: ffffffff51e080b0
>  [  267.339598][  T575] #PF: supervisor write access in kernel mode
>  [  267.339602][  T575] #PF: error_code(0x0002) - not-present page
>  [  267.339606][  T575] PGD f1cc3c067 P4D f1cc3c067 PUD 0 
>  [  267.339613][  T575] Oops: Oops: 0002 [#1] SMP NOPTI
>  [  267.339622][  T575] CPU: 0 UID: 0 PID: 575 Comm: napi/phy0-0 Not tainted
> 6.15.0-rc6-next-20250513-llvm-00009-gec34cd07a425 #968 PREEMPT_{RT,(full)} 
>  [  267.339629][  T575] Hardware name: Micro-Star International Co., Ltd. Alpha
> 15 B5EEK/MS-158L, BIOS E158LAMS.10F 11/11/2024
>  [  267.339632][  T575] RIP: 0010:queued_spin_lock_slowpath+0x120/0x1c0
...
> [  267.339692][  T575] Call Trace:
>  [  267.339701][  T575]  <TASK>
>  [  267.339705][  T575]  _raw_spin_lock_irqsave+0x57/0x60
>  [  267.339714][  T575]  rt_spin_lock+0x73/0xa0
>  [  267.339720][  T575]  sock_queue_err_skb+0xdc/0x140
>  [  267.339727][  T575]  skb_complete_wifi_ack+0xa9/0x120
>  [  267.339737][  T575]  ieee80211_report_used_skb+0x541/0x6e0 [mac80211]
>  [  267.339799][  T575]  ? srso_alias_return_thunk+0x5/0xfbef5
>  [  267.339804][  T575]  ? start_dl_timer+0xcf/0x110
>  [  267.339814][  T575]  ieee80211_tx_status_ext+0x3b3/0x870 [mac80211]
>  [  267.339851][  T575]  ? raw_spin_rq_lock_nested+0x15/0x80
>  [  267.339862][  T575]  ? srso_alias_return_thunk+0x5/0xfbef5
>  [  267.339866][  T575]  ? rt_spin_lock+0x3d/0xa0
>  [  267.339873][  T575]  ? mt76_tx_status_unlock+0x38/0x230 [mt76]
>  [  267.339886][  T575]  mt76_tx_status_unlock+0x1e0/0x230 [mt76]

Yeah so that's the crash on the status report as explained above, it
kind of looks almost like the skb->sk was freed and somehow invalid now?
But I don't see a general issue here (will keep digging), and how come
it only shows up with clang?

Since it reproduces pretty reliably, maybe you could do with KASAN?

Also could be interesting - what userspace are you running with wifi?
What tool is even setting up the wifi status? If you don't really know
maybe just put WARN_ON(1) into net/core/sock.s where SO_WIFI_STATUS is
written (sk_setsockopt).

johannes

^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: lockup and kernel panic in linux-next-202505{09,12} when compiled with clang
  2025-05-15  6:30               ` Johannes Berg
@ 2025-05-15  9:10                 ` Bert Karwatzki
  2025-05-16 18:19                   ` Bert Karwatzki
  0 siblings, 1 reply; 22+ messages in thread
From: Bert Karwatzki @ 2025-05-15  9:10 UTC (permalink / raw)
  To: Johannes Berg, linux-kernel@vger.kernel.org
  Cc: linux-next@vger.kernel.org, llvm@lists.linux.dev, Thomas Gleixner,
	linux-wireless, spasswolf

Am Donnerstag, dem 15.05.2025 um 08:30 +0200 schrieb Johannes Berg:
> On Thu, 2025-05-15 at 00:27 +0200, Bert Karwatzki wrote:
> > Am Mittwoch, dem 14.05.2025 um 20:56 +0200 schrieb Johannes Berg:
> > > > 
> > > > I've split off the problematic piece of code into an noinline function to simplify the disassembly:
> > > > 
> > > 
> > > Oh and also, does it even still crash with that? :)
> > 
> > Yes, it still crashes when compiled with clang.
> 
> OK, just checking. :)

To be more precise I need clang AND PREEMPT_RT=y to get a crash.

> 
> FWIW, I'm not convinced at all that the code you were looking at is
> really the problem. The crash (see below) is happening on the status
> side. Of course it cannot crash on the status side if on the TX side we
> never enter anything into the IDR data structure, and never tag the SKB
> to look up in the IDR and therefore never try to create the status
> report on the status side.

After looking at the backtrace I'm also no longer conviced that piece of code is
the problem.

> 
> Basically what happens is this:
> 
> - on TX, if we have a socket requesting status, create a copy of the
>   SKB, put it into the IDR, and put the IDR index into the original
>   skb->cb
> - then transmit the original skb, of course
> - on TX status report from the driver, see if the skb->cb is tagged with
>   the IDR value, if so, report the copy of the SKB back to the socket
>   with the status information
> 
> (The reason we need to make a copy is that the SKB could be encrypted or
> otherwise modified in flight, and we don't want to undo that, rather
> keeping a copy for the report.)
> 
> >  [  267.339591][  T575] BUG: unable to handle page fault for address: ffffffff51e080b0
> >  [  267.339598][  T575] #PF: supervisor write access in kernel mode
> >  [  267.339602][  T575] #PF: error_code(0x0002) - not-present page
> >  [  267.339606][  T575] PGD f1cc3c067 P4D f1cc3c067 PUD 0 
> >  [  267.339613][  T575] Oops: Oops: 0002 [#1] SMP NOPTI
> >  [  267.339622][  T575] CPU: 0 UID: 0 PID: 575 Comm: napi/phy0-0 Not tainted
> > 6.15.0-rc6-next-20250513-llvm-00009-gec34cd07a425 #968 PREEMPT_{RT,(full)} 
> >  [  267.339629][  T575] Hardware name: Micro-Star International Co., Ltd. Alpha
> > 15 B5EEK/MS-158L, BIOS E158LAMS.10F 11/11/2024
> >  [  267.339632][  T575] RIP: 0010:queued_spin_lock_slowpath+0x120/0x1c0
> ...
> > [  267.339692][  T575] Call Trace:
> >  [  267.339701][  T575]  <TASK>
> >  [  267.339705][  T575]  _raw_spin_lock_irqsave+0x57/0x60
> >  [  267.339714][  T575]  rt_spin_lock+0x73/0xa0
> >  [  267.339720][  T575]  sock_queue_err_skb+0xdc/0x140
> >  [  267.339727][  T575]  skb_complete_wifi_ack+0xa9/0x120
> >  [  267.339737][  T575]  ieee80211_report_used_skb+0x541/0x6e0 [mac80211]
> >  [  267.339799][  T575]  ? srso_alias_return_thunk+0x5/0xfbef5
> >  [  267.339804][  T575]  ? start_dl_timer+0xcf/0x110
> >  [  267.339814][  T575]  ieee80211_tx_status_ext+0x3b3/0x870 [mac80211]
> >  [  267.339851][  T575]  ? raw_spin_rq_lock_nested+0x15/0x80
> >  [  267.339862][  T575]  ? srso_alias_return_thunk+0x5/0xfbef5
> >  [  267.339866][  T575]  ? rt_spin_lock+0x3d/0xa0
> >  [  267.339873][  T575]  ? mt76_tx_status_unlock+0x38/0x230 [mt76]
> >  [  267.339886][  T575]  mt76_tx_status_unlock+0x1e0/0x230 [mt76]
> 
> Yeah so that's the crash on the status report as explained above, it
> kind of looks almost like the skb->sk was freed and somehow invalid now?
> But I don't see a general issue here (will keep digging), and how come
> it only shows up with clang?
> 
> Since it reproduces pretty reliably, maybe you could do with KASAN?
> 

I'm currently doing a testrun with KASAN enabled, test is running ~1h so far
(without KASAN the max time to a crash was about 10min), so KASAN is probably
killing the bug (there are no messages from KASAN in dmesg).

> Also could be interesting - what userspace are you running with wifi?
> What tool is even setting up the wifi status? If you don't really know
> maybe just put WARN_ON(1) into net/core/sock.s where SO_WIFI_STATUS is
> written (sk_setsockopt).
>
> johannes

For the recording these backtraces I disabled wifi just after booting (it
usually takes ~5s to connect here) with network manager (nmcli)(from debian sid
(last updated on 20250511, before I encountered this bug))
$ nmcli radio wifi off
then I set up the netconsole and reenabled wifi and waited for the crash
$ nmcli radio wifi on

Bert Karwatzki


^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: lockup and kernel panic in linux-next-202505{09,12} when compiled with clang
  2025-05-15  9:10                 ` Bert Karwatzki
@ 2025-05-16 18:19                   ` Bert Karwatzki
  2025-05-17 11:34                     ` Bert Karwatzki
  0 siblings, 1 reply; 22+ messages in thread
From: Bert Karwatzki @ 2025-05-16 18:19 UTC (permalink / raw)
  To: Johannes Berg, linux-kernel@vger.kernel.org
  Cc: linux-next@vger.kernel.org, llvm@lists.linux.dev, Thomas Gleixner,
	linux-wireless, spasswolf


I've added a debugging statement:

diff --git a/net/mac80211/tx.c b/net/mac80211/tx.c
index 3bd5ee0995fe..853493eca4f5 100644
--- a/net/mac80211/tx.c
+++ b/net/mac80211/tx.c
@@ -4586,7 +4586,11 @@ static noinline void ieee80211_8023_xmit_clang_debug_helper(struct sk_buff *skb,
                                                            struct ieee80211_local *local,
                                                            struct ieee80211_tx_info *info)
 {
-       if (unlikely(skb->sk && sock_flag(skb->sk, SOCK_WIFI_STATUS))) {
+       if (unlikely(skb->sk && ((skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) ||
+                               sock_flag(skb->sk, SOCK_WIFI_STATUS)))) {
+               if ((skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) ^ sock_flag(skb->sk, SOCK_WIFI_STATUS))
+                       printk(KERN_INFO "%s: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = %u sock_flag(skb->sk,
SOCK_WIFI_STATUS) = %u\n",
+                                       __func__, (skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS), sock_flag(skb->sk,
SOCK_WIFI_STATUS));
                info->status_data = ieee80211_store_ack_skb(local, skb,
                                                            &info->flags, NULL);
                if (info->status_data)

This gives the following logoutput (and a lockup), indicating that sock_flag(skb->sk, SOCK_WIFI_STATUS) and
(skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) are actually NOT equivalent (when compiled with clang and
PREEMPT_RT=y)

2025-05-16T20:09:58.818563+02:00 lisa kernel: [  T581] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags
& SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
2025-05-16T20:10:19.829599+02:00 lisa kernel: [    C2] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
2025-05-16T20:10:19.829607+02:00 lisa kernel: [    C2] rcu: 	4-...!: (1 GPs behind) idle=1ddc/1/0x4000000000000000
softirq=0/0 fqs=72 rcuc=21002 jiffies(starved)
2025-05-16T20:10:19.829609+02:00 lisa kernel: [    C2] rcu: 	14-...!: (1 GPs behind) idle=4cbc/1/0x4000000000000000
softirq=0/0 fqs=72 rcuc=21013 jiffies(starved)
2025-05-16T20:10:19.829611+02:00 lisa kernel: [    C2] rcu: 	Tasks blocked on level-0 rcu_node (CPUs 0-15): P581
2025-05-16T20:10:19.829613+02:00 lisa kernel: [    C2] rcu: 	(detected by 2, t=21002 jiffies, g=7525, q=973
ncpus=16)
2025-05-16T20:10:19.829615+02:00 lisa kernel: [    C2] Sending NMI from CPU 2 to CPUs 4:
2025-05-16T20:10:19.829616+02:00 lisa kernel: [    C4] NMI backtrace for cpu 4
2025-05-16T20:10:19.829618+02:00 lisa kernel: [    C4] CPU: 4 UID: 0 PID: 581 Comm: napi/phy0-0 Not tainted 6.15.0-rc6-
next-20250513-llvm-00011-gf9a7992d47e7 #978 PREEMPT_{RT,(full)} 
2025-05-16T20:10:19.829620+02:00 lisa kernel: [    C4] Hardware name: Micro-Star International Co., Ltd. Alpha 15
B5EEK/MS-158L, BIOS E158LAMS.10F 11/11/2024
2025-05-16T20:10:19.829622+02:00 lisa kernel: [    C4] RIP: 0010:rtlock_slowlock_locked+0xaed/0xc70
2025-05-16T20:10:19.829623+02:00 lisa kernel: [    C4] Code: 59 61 6a ff 49 c7 07 01 00 00 00 4d 89 7f 08 65 ff 0d b7 bd
c1 00 74 4f 4d 85 ed 0f 84 76 ff ff ff e8 77 28 71 ff 48 8b 43 18 <48> 83 e0 fe 49 39 c5 75 2a 41 83 7d 34 00 0f 84 54
ff ff ff 41 8b
2025-05-16T20:10:19.829625+02:00 lisa kernel: [    C4] RSP: 0018:ffffcc0dc1ef7b00 EFLAGS: 00000246

2025-05-16T20:10:19.829627+02:00 lisa kernel: [    C4] RAX: ffff89e9c52f8001 RBX: ffff89e9e17a2e10 RCX: ffff89e9c52f8001
2025-05-16T20:10:19.829629+02:00 lisa kernel: [    C4] RDX: ffffcc0dc1ef7b38 RSI: ffff89e9c52fd000 RDI: ffffcc0dc1ef7bf0
2025-05-16T20:10:19.829631+02:00 lisa kernel: [    C4] RBP: ffff89e9c52fd820 R08: ffffffffffffeb42 R09: 0000000000000002
2025-05-16T20:10:19.829632+02:00 lisa kernel: [    C4] R10: 00000000000000e4 R11: 00000000000005fe R12: ffffcc0dc1ef7b38
2025-05-16T20:10:19.829634+02:00 lisa kernel: [    C4] R13: ffff89e9c52f8000 R14: ffff89e9c52fd000 R15: ffffcc0dc1ef7bf0
2025-05-16T20:10:19.829636+02:00 lisa kernel: [    C4] FS:  0000000000000000(0000) GS:ffff89f8986c1000(0000)
knlGS:0000000000000000
2025-05-16T20:10:19.829637+02:00 lisa kernel: [    C4] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
2025-05-16T20:10:19.829638+02:00 lisa kernel: [    C4] CR2: 00007f9ea92e2000 CR3: 00000007e5a3a000 CR4: 0000000000750ef0
2025-05-16T20:10:19.829640+02:00 lisa kernel: [    C4] PKRU: 55555554
2025-05-16T20:10:19.829642+02:00 lisa kernel: [    C4] Call Trace:
2025-05-16T20:10:19.829643+02:00 lisa kernel: [    C4]  <TASK>
2025-05-16T20:10:19.829644+02:00 lisa kernel: [    C4]  ? rt_spin_unlock+0x12/0x40
2025-05-16T20:10:19.829646+02:00 lisa kernel: [    C4]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-16T20:10:19.829648+02:00 lisa kernel: [    C4]  rt_spin_lock+0x81/0xa0
2025-05-16T20:10:19.829649+02:00 lisa kernel: [    C4]  mt76_rx_complete+0x49/0x2e0 [mt76]
2025-05-16T20:10:19.829651+02:00 lisa kernel: [    C4]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-16T20:10:19.829653+02:00 lisa kernel: [    C4]  mt76_rx_poll_complete+0x4a4/0x4d0 [mt76]
2025-05-16T20:10:19.829654+02:00 lisa kernel: [    C4]  ? mt76_dma_rx_poll+0xf6/0x660 [mt76]
2025-05-16T20:10:19.829656+02:00 lisa kernel: [    C4]  mt76_dma_rx_poll+0x147/0x660 [mt76]
2025-05-16T20:10:19.829657+02:00 lisa kernel: [    C4]  ? mt792x_poll_rx+0x2a/0x120 [mt792x_lib]
2025-05-16T20:10:19.829658+02:00 lisa kernel: [    C4]  mt792x_poll_rx+0x71/0x120 [mt792x_lib]
2025-05-16T20:10:19.829660+02:00 lisa kernel: [    C4]  __napi_poll+0x2a/0x170
2025-05-16T20:10:19.829662+02:00 lisa kernel: [    C4]  ? napi_threaded_poll_loop+0x32/0x1b0
2025-05-16T20:10:19.829663+02:00 lisa kernel: [    C4]  napi_threaded_poll_loop+0xe4/0x1b0
2025-05-16T20:10:19.829678+02:00 lisa kernel: [    C4]  ? napi_threaded_poll_loop+0x32/0x1b0
2025-05-16T20:10:19.829679+02:00 lisa kernel: [    C4]  ? asm_sysvec_apic_timer_interrupt+0x1a/0x20
2025-05-16T20:10:19.829680+02:00 lisa kernel: [    C4]  napi_threaded_poll+0x57/0x80
2025-05-16T20:10:19.829682+02:00 lisa kernel: [    C4]  ? __pfx_napi_threaded_poll+0x10/0x10
2025-05-16T20:10:19.829683+02:00 lisa kernel: [    C4]  kthread+0x25c/0x280
2025-05-16T20:10:19.829685+02:00 lisa kernel: [    C4]  ? __pfx_kthread+0x10/0x10
2025-05-16T20:10:19.829696+02:00 lisa kernel: [    C4]  ret_from_fork+0xc4/0x1b0
2025-05-16T20:10:19.829698+02:00 lisa kernel: [    C4]  ? __pfx_kthread+0x10/0x10
2025-05-16T20:10:19.829699+02:00 lisa kernel: [    C4]  ret_from_fork_asm+0x1a/0x30
2025-05-16T20:10:19.829701+02:00 lisa kernel: [    C4]  </TASK>
2025-05-16T20:10:19.829702+02:00 lisa kernel: [    C2] Sending NMI from CPU 2 to CPUs 14:
2025-05-16T20:10:19.829704+02:00 lisa kernel: [   C14] NMI backtrace for cpu 14
2025-05-16T20:10:19.829705+02:00 lisa kernel: [   C14] CPU: 14 UID: 0 PID: 585 Comm: napi/phy0-0 Not tainted 6.15.0-rc6-
next-20250513-llvm-00011-gf9a7992d47e7 #978 PREEMPT_{RT,(full)} 
2025-05-16T20:10:19.829707+02:00 lisa kernel: [   C14] Hardware name: Micro-Star International Co., Ltd. Alpha 15
B5EEK/MS-158L, BIOS E158LAMS.10F 11/11/2024
2025-05-16T20:10:19.829708+02:00 lisa kernel: [   C14] RIP: 0010:queued_spin_lock_slowpath+0x134/0x1c0
2025-05-16T20:10:19.829710+02:00 lisa kernel: [   C14] Code: 03 c1 e6 04 83 e0 fc 49 c7 c0 f8 ff ff ff 49 8b 84 40 a0 fa
98 95 48 89 94 06 c0 21 06 96 83 7a 08 00 75 08 f3 90 83 7a 08 00 <74> f8 48 8b 32 48 85 f6 74 09 0f 0d 0e eb 0a 31 f6
eb 06 31 f6 eb
2025-05-16T20:10:19.829714+02:00 lisa kernel: [   C14] RSP: 0018:ffffcc0dc201f998 EFLAGS: 00000046
2025-05-16T20:10:19.829715+02:00 lisa kernel: [   C14] RAX: 0000000000000000 RBX: 0000000000000286 RCX: 00000000003c0000
2025-05-16T20:10:19.829717+02:00 lisa kernel: [   C14] RDX: ffff89f82e9a31c0 RSI: 0000000000000010 RDI: ffff89ea89ad79a8
2025-05-16T20:10:19.829718+02:00 lisa kernel: [   C14] RBP: ffff89ea05e8e000 R08: fffffffffffffff8 R09: 0000000000000001
2025-05-16T20:10:19.829720+02:00 lisa kernel: [   C14] R10: 0000000000000001 R11: ffffffff951f07f0 R12: ffff89ea89ad7990
2025-05-16T20:10:19.829722+02:00 lisa kernel: [   C14] R13: ffff89e9e17a2480 R14: ffff89ea89ad79a8 R15: ffff89ea89ad79a8
2025-05-16T20:10:19.829723+02:00 lisa kernel: [   C14] FS:  0000000000000000(0000) GS:ffff89f898941000(0000)
knlGS:0000000000000000
2025-05-16T20:10:19.829735+02:00 lisa kernel: [   C14] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
2025-05-16T20:10:19.829737+02:00 lisa kernel: [   C14] CR2: 00007f522c1f7000 CR3: 00000007e5a3a000 CR4: 0000000000750ef0
2025-05-16T20:10:19.829738+02:00 lisa kernel: [   C14] PKRU: 55555554
2025-05-16T20:10:19.829740+02:00 lisa kernel: [   C14] Call Trace:
2025-05-16T20:10:19.829741+02:00 lisa kernel: [   C14]  <TASK>
2025-05-16T20:10:19.829743+02:00 lisa kernel: [   C14]  _raw_spin_lock_irqsave+0x57/0x60
2025-05-16T20:10:19.829744+02:00 lisa kernel: [   C14]  rt_spin_lock+0x73/0xa0
2025-05-16T20:10:19.829745+02:00 lisa kernel: [   C14]  sock_queue_err_skb+0xdc/0x140
2025-05-16T20:10:19.829773+02:00 lisa kernel: [   C14]  skb_complete_wifi_ack+0xa9/0x120
2025-05-16T20:10:19.829775+02:00 lisa kernel: [   C14]  ieee80211_report_used_skb+0x541/0x6e0 [mac80211]
2025-05-16T20:10:19.829786+02:00 lisa kernel: [   C14]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-16T20:10:19.829816+02:00 lisa kernel: [   C14]  ? __schedule+0x506/0x1280
2025-05-16T20:10:19.829822+02:00 lisa kernel: [   C14]  ? preempt_schedule_irq+0x42/0x80
2025-05-16T20:10:19.829823+02:00 lisa kernel: [   C14]  ieee80211_tx_status_ext+0x3b3/0x870 [mac80211]
2025-05-16T20:10:19.829824+02:00 lisa kernel: [   C14]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-16T20:10:19.829826+02:00 lisa kernel: [   C14]  ? rt_spin_lock+0x3d/0xa0
2025-05-16T20:10:19.829828+02:00 lisa kernel: [   C14]  ? mt76_tx_status_unlock+0x38/0x230 [mt76]
2025-05-16T20:10:19.829829+02:00 lisa kernel: [   C14]  mt76_tx_status_unlock+0x1e0/0x230 [mt76]
2025-05-16T20:10:19.829830+02:00 lisa kernel: [   C14]  __mt76_tx_complete_skb+0x13b/0x2e0 [mt76]
2025-05-16T20:10:19.829832+02:00 lisa kernel: [   C14]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-16T20:10:19.829833+02:00 lisa kernel: [   C14]  ? rt_spin_unlock+0x12/0x40
2025-05-16T20:10:19.829834+02:00 lisa kernel: [   C14]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-16T20:10:19.829836+02:00 lisa kernel: [   C14]  mt76_connac2_txwi_free+0x127/0x150 [mt76_connac_lib]
2025-05-16T20:10:19.829838+02:00 lisa kernel: [   C14]  mt7921_mac_tx_free+0x112/0x260 [mt7921_common]
2025-05-16T20:10:19.829839+02:00 lisa kernel: [   C14]  mt7921_rx_check+0x33/0xe0 [mt7921_common]
2025-05-16T20:10:19.829841+02:00 lisa kernel: [   C14]  mt76_dma_rx_poll+0x322/0x660 [mt76]
2025-05-16T20:10:19.829842+02:00 lisa kernel: [   C14]  ? mt792x_poll_rx+0x2a/0x120 [mt792x_lib]
2025-05-16T20:10:19.829843+02:00 lisa kernel: [   C14]  mt792x_poll_rx+0x71/0x120 [mt792x_lib]
2025-05-16T20:10:19.829845+02:00 lisa kernel: [   C14]  __napi_poll+0x2a/0x170
2025-05-16T20:10:19.829846+02:00 lisa kernel: [   C14]  ? napi_threaded_poll_loop+0x32/0x1b0
2025-05-16T20:10:19.829848+02:00 lisa kernel: [   C14]  napi_threaded_poll_loop+0xe4/0x1b0
2025-05-16T20:10:19.829849+02:00 lisa kernel: [   C14]  ? napi_threaded_poll_loop+0x32/0x1b0
2025-05-16T20:10:19.829851+02:00 lisa kernel: [   C14]  ? ttwu_do_activate+0xa9/0x1a0
2025-05-16T20:10:19.829863+02:00 lisa kernel: [   C14]  ? srso_alias_return_thunk+0x5/0xfbef5
2025-05-16T20:10:19.829864+02:00 lisa kernel: [   C14]  napi_threaded_poll+0x57/0x80
2025-05-16T20:10:19.829866+02:00 lisa kernel: [   C14]  ? __pfx_napi_threaded_poll+0x10/0x10
2025-05-16T20:10:19.829867+02:00 lisa kernel: [   C14]  kthread+0x25c/0x280
2025-05-16T20:10:19.829868+02:00 lisa kernel: [   C14]  ? __pfx_kthread+0x10/0x10
2025-05-16T20:10:19.829871+02:00 lisa kernel: [   C14]  ret_from_fork+0xc4/0x1b0
2025-05-16T20:10:19.829873+02:00 lisa kernel: [   C14]  ? __pfx_kthread+0x10/0x10
2025-05-16T20:10:19.829874+02:00 lisa kernel: [   C14]  ret_from_fork_asm+0x1a/0x30
2025-05-16T20:10:19.829875+02:00 lisa kernel: [   C14]  </TASK>


Bert Karwatzki

^ permalink raw reply related	[flat|nested] 22+ messages in thread

* Re: lockup and kernel panic in linux-next-202505{09,12} when compiled with clang
  2025-05-16 18:19                   ` Bert Karwatzki
@ 2025-05-17 11:34                     ` Bert Karwatzki
  2025-05-17 19:49                       ` Bert Karwatzki
  0 siblings, 1 reply; 22+ messages in thread
From: Bert Karwatzki @ 2025-05-17 11:34 UTC (permalink / raw)
  To: Johannes Berg, linux-kernel@vger.kernel.org
  Cc: linux-next@vger.kernel.org, llvm@lists.linux.dev, Thomas Gleixner,
	linux-wireless, spasswolf

Am Freitag, dem 16.05.2025 um 20:19 +0200 schrieb Bert Karwatzki:
> I've added a debugging statement:
> 
> diff --git a/net/mac80211/tx.c b/net/mac80211/tx.c
> index 3bd5ee0995fe..853493eca4f5 100644
> --- a/net/mac80211/tx.c
> +++ b/net/mac80211/tx.c
> @@ -4586,7 +4586,11 @@ static noinline void ieee80211_8023_xmit_clang_debug_helper(struct sk_buff *skb,
>                                                             struct ieee80211_local *local,
>                                                             struct ieee80211_tx_info *info)
>  {
> -       if (unlikely(skb->sk && sock_flag(skb->sk, SOCK_WIFI_STATUS))) {
> +       if (unlikely(skb->sk && ((skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) ||
> +                               sock_flag(skb->sk, SOCK_WIFI_STATUS)))) {
> +               if ((skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) ^ sock_flag(skb->sk, SOCK_WIFI_STATUS))
> +                       printk(KERN_INFO "%s: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = %u sock_flag(skb->sk,
> SOCK_WIFI_STATUS) = %u\n",
> +                                       __func__, (skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS), sock_flag(skb->sk,
> SOCK_WIFI_STATUS));
>                 info->status_data = ieee80211_store_ack_skb(local, skb,
>                                                             &info->flags, NULL);
>                 if (info->status_data)
> 
> This gives the following logoutput (and a lockup), indicating that sock_flag(skb->sk, SOCK_WIFI_STATUS) and
> (skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) are actually NOT equivalent (when compiled with clang and
> PREEMPT_RT=y)

I've added more debugging output:

diff --git a/include/net/sock.h b/include/net/sock.h
index e223102337c7..e13560b5b7a8 100644
--- a/include/net/sock.h
+++ b/include/net/sock.h
@@ -2735,8 +2735,10 @@ static inline void _sock_tx_timestamp(struct sock *sk,
 				*tskey = atomic_inc_return(&sk->sk_tskey) - 1;
 		}
 	}
-	if (unlikely(sock_flag(sk, SOCK_WIFI_STATUS)))
+	if (unlikely(sock_flag(sk, SOCK_WIFI_STATUS))) {
+		printk(KERN_INFO "%s: setting SKBTX_WIFI_STATUS for sk = %px\n", __func__, sk);
 		*tx_flags |= SKBTX_WIFI_STATUS;
+	}
 }
 
 static inline void sock_tx_timestamp(struct sock *sk,
diff --git a/net/core/sock.c b/net/core/sock.c
index e02a78538e3e..f6589ad5ba36 100644
--- a/net/core/sock.c
+++ b/net/core/sock.c
@@ -1548,6 +1548,7 @@ int sk_setsockopt(struct sock *sk, int level, int optname,
 		break;
 
 	case SO_WIFI_STATUS:
+		printk(KERN_INFO "%s: setting SOCK_WIFI_STATUS to %u for sk = %px\n", __func__, valbool, sk);
 		sock_valbool_flag(sk, SOCK_WIFI_STATUS, valbool);
 		break;
 
diff --git a/net/mac80211/tx.c b/net/mac80211/tx.c
index 853493eca4f5..eee2f80949c6 100644
--- a/net/mac80211/tx.c
+++ b/net/mac80211/tx.c
@@ -4588,9 +4588,12 @@ static noinline void ieee80211_8023_xmit_clang_debug_helper(struct sk_buff *skb,
 {
 	if (unlikely(skb->sk && ((skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) ||
 				sock_flag(skb->sk, SOCK_WIFI_STATUS)))) {
-		if ((skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) ^ sock_flag(skb->sk, SOCK_WIFI_STATUS))
+		if ((skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) ^ sock_flag(skb->sk, SOCK_WIFI_STATUS)) {
 			printk(KERN_INFO "%s: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = %u sock_flag(skb->sk, SOCK_WIFI_STATUS) = %u\n",
 					__func__, (skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS), sock_flag(skb->sk, SOCK_WIFI_STATUS));
+			printk(KERN_INFO "%s: skb->sk = %px skb->sk->sk_flags = 0x%lx\n", __func__, skb->sk, skb->sk->sk_flags);
+			return; // This should make this case non-fatal.
+		}
 		info->status_data = ieee80211_store_ack_skb(local, skb,
 							    &info->flags, NULL);
 		if (info->status_data)



This gives after ~15min uptime

[  189.337797] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
[  189.337803] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1b798c4e00 skb->sk->sk_flags = 0xffffffffb4efe640
[  191.325256] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
[  191.325259] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1b798c5a00 skb->sk->sk_flags = 0xffffffffb4efe640
[  257.591831] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
[  257.591844] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1baf3bca00 skb->sk->sk_flags = 0xffffffffb4efe640
[  301.786963] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
[  301.786967] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1c1bc40100 skb->sk->sk_flags = 0xffffffffb4efe640
[  302.780881] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
[  302.780884] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1a44cf6000 skb->sk->sk_flags = 0xffffffffb4efe640
[  482.792298] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
[  482.792304] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1da0f4de00 skb->sk->sk_flags = 0xffffffffb4efe640
[  482.806144] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
[  482.806148] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1da0f4c500 skb->sk->sk_flags = 0xffffffffb4efe640
[  482.817280] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
[  482.817284] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1da0f4df00 skb->sk->sk_flags = 0xffffffffb4efe640
[  552.327291] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
[  552.327295] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1da0f4de00 skb->sk->sk_flags = 0xffffffffb4efe640
[  916.971599] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
[  916.971607] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1a62834000 skb->sk->sk_flags = 0xffffffffb4efe640

The printk()s in sk_set_sockopt() and _sock_tx_timestamp() are not called at all so the flag 
SOCK_WIFI_STATUS is actually nevers set! What is printed when printing skb->sk->sk_flags looks
suspiciously like a pointer, and as sk_flags is actually a member of a union in struct sock_common
it seems clang is using sk_flags for one of the other union members here

struct sock_common {
[...]
	union {
		unsigned long	skc_flags;
		struct sock	*skc_listener; /* request_sock */
		struct inet_timewait_death_row *skc_tw_dr; /* inet_timewait_sock */
	};
[...]
}

Bert Karwatzki

^ permalink raw reply related	[flat|nested] 22+ messages in thread

* Re: lockup and kernel panic in linux-next-202505{09,12} when compiled with clang
  2025-05-17 11:34                     ` Bert Karwatzki
@ 2025-05-17 19:49                       ` Bert Karwatzki
  2025-05-18  1:30                         ` Jason Xing
  0 siblings, 1 reply; 22+ messages in thread
From: Bert Karwatzki @ 2025-05-17 19:49 UTC (permalink / raw)
  To: Johannes Berg, linux-kernel@vger.kernel.org
  Cc: linux-next@vger.kernel.org, llvm@lists.linux.dev, Thomas Gleixner,
	linux-wireless, Jason Xing, spasswolf

Am Samstag, dem 17.05.2025 um 13:34 +0200 schrieb Bert Karwatzki:
> Am Freitag, dem 16.05.2025 um 20:19 +0200 schrieb Bert Karwatzki:
> > I've added a debugging statement:
> > 
> > diff --git a/net/mac80211/tx.c b/net/mac80211/tx.c
> > index 3bd5ee0995fe..853493eca4f5 100644
> > --- a/net/mac80211/tx.c
> > +++ b/net/mac80211/tx.c
> > @@ -4586,7 +4586,11 @@ static noinline void ieee80211_8023_xmit_clang_debug_helper(struct sk_buff *skb,
> >                                                             struct ieee80211_local *local,
> >                                                             struct ieee80211_tx_info *info)
> >  {
> > -       if (unlikely(skb->sk && sock_flag(skb->sk, SOCK_WIFI_STATUS))) {
> > +       if (unlikely(skb->sk && ((skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) ||
> > +                               sock_flag(skb->sk, SOCK_WIFI_STATUS)))) {
> > +               if ((skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) ^ sock_flag(skb->sk, SOCK_WIFI_STATUS))
> > +                       printk(KERN_INFO "%s: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = %u sock_flag(skb->sk,
> > SOCK_WIFI_STATUS) = %u\n",
> > +                                       __func__, (skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS), sock_flag(skb->sk,
> > SOCK_WIFI_STATUS));
> >                 info->status_data = ieee80211_store_ack_skb(local, skb,
> >                                                             &info->flags, NULL);
> >                 if (info->status_data)
> > 
> > This gives the following logoutput (and a lockup), indicating that sock_flag(skb->sk, SOCK_WIFI_STATUS) and
> > (skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) are actually NOT equivalent (when compiled with clang and
> > PREEMPT_RT=y)
> 
> I've added more debugging output:
> 
> diff --git a/include/net/sock.h b/include/net/sock.h
> index e223102337c7..e13560b5b7a8 100644
> --- a/include/net/sock.h
> +++ b/include/net/sock.h
> @@ -2735,8 +2735,10 @@ static inline void _sock_tx_timestamp(struct sock *sk,
>  				*tskey = atomic_inc_return(&sk->sk_tskey) - 1;
>  		}
>  	}
> -	if (unlikely(sock_flag(sk, SOCK_WIFI_STATUS)))
> +	if (unlikely(sock_flag(sk, SOCK_WIFI_STATUS))) {
> +		printk(KERN_INFO "%s: setting SKBTX_WIFI_STATUS for sk = %px\n", __func__, sk);
>  		*tx_flags |= SKBTX_WIFI_STATUS;
> +	}
>  }
>  
>  static inline void sock_tx_timestamp(struct sock *sk,
> diff --git a/net/core/sock.c b/net/core/sock.c
> index e02a78538e3e..f6589ad5ba36 100644
> --- a/net/core/sock.c
> +++ b/net/core/sock.c
> @@ -1548,6 +1548,7 @@ int sk_setsockopt(struct sock *sk, int level, int optname,
>  		break;
>  
>  	case SO_WIFI_STATUS:
> +		printk(KERN_INFO "%s: setting SOCK_WIFI_STATUS to %u for sk = %px\n", __func__, valbool, sk);
>  		sock_valbool_flag(sk, SOCK_WIFI_STATUS, valbool);
>  		break;
>  
> diff --git a/net/mac80211/tx.c b/net/mac80211/tx.c
> index 853493eca4f5..eee2f80949c6 100644
> --- a/net/mac80211/tx.c
> +++ b/net/mac80211/tx.c
> @@ -4588,9 +4588,12 @@ static noinline void ieee80211_8023_xmit_clang_debug_helper(struct sk_buff *skb,
>  {
>  	if (unlikely(skb->sk && ((skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) ||
>  				sock_flag(skb->sk, SOCK_WIFI_STATUS)))) {
> -		if ((skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) ^ sock_flag(skb->sk, SOCK_WIFI_STATUS))
> +		if ((skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) ^ sock_flag(skb->sk, SOCK_WIFI_STATUS)) {
>  			printk(KERN_INFO "%s: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = %u sock_flag(skb->sk, SOCK_WIFI_STATUS) = %u\n",
>  					__func__, (skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS), sock_flag(skb->sk, SOCK_WIFI_STATUS));
> +			printk(KERN_INFO "%s: skb->sk = %px skb->sk->sk_flags = 0x%lx\n", __func__, skb->sk, skb->sk->sk_flags);
> +			return; // This should make this case non-fatal.
> +		}
>  		info->status_data = ieee80211_store_ack_skb(local, skb,
>  							    &info->flags, NULL);
>  		if (info->status_data)
> 
> 
> 
> This gives after ~15min uptime
> 
> [  189.337797] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
> [  189.337803] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1b798c4e00 skb->sk->sk_flags = 0xffffffffb4efe640
> [  191.325256] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
> [  191.325259] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1b798c5a00 skb->sk->sk_flags = 0xffffffffb4efe640
> [  257.591831] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
> [  257.591844] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1baf3bca00 skb->sk->sk_flags = 0xffffffffb4efe640
> [  301.786963] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
> [  301.786967] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1c1bc40100 skb->sk->sk_flags = 0xffffffffb4efe640
> [  302.780881] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
> [  302.780884] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1a44cf6000 skb->sk->sk_flags = 0xffffffffb4efe640
> [  482.792298] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
> [  482.792304] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1da0f4de00 skb->sk->sk_flags = 0xffffffffb4efe640
> [  482.806144] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
> [  482.806148] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1da0f4c500 skb->sk->sk_flags = 0xffffffffb4efe640
> [  482.817280] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
> [  482.817284] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1da0f4df00 skb->sk->sk_flags = 0xffffffffb4efe640
> [  552.327291] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
> [  552.327295] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1da0f4de00 skb->sk->sk_flags = 0xffffffffb4efe640
> [  916.971599] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
> [  916.971607] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1a62834000 skb->sk->sk_flags = 0xffffffffb4efe640
> 
> The printk()s in sk_set_sockopt() and _sock_tx_timestamp() are not called at all so the flag 
> SOCK_WIFI_STATUS is actually nevers set! What is printed when printing skb->sk->sk_flags looks
> suspiciously like a pointer, and as sk_flags is actually a member of a union in struct sock_common
> it seems clang is using sk_flags for one of the other union members here
> 
> struct sock_common {
> [...]
> 	union {
> 		unsigned long	skc_flags;
> 		struct sock	*skc_listener; /* request_sock */
> 		struct inet_timewait_death_row *skc_tw_dr; /* inet_timewait_sock */
> 	};
> [...]
> }
> 
> Bert Karwatzki

I added even more debugging output and found out why commit 76a853f86c97 (" wifi: free 
SKBTX_WIFI_STATUS skb tx_flags flag") does not work.

diff --git a/include/net/sock.h b/include/net/sock.h
index e13560b5b7a8..6e1291d2e5a1 100644
--- a/include/net/sock.h
+++ b/include/net/sock.h
@@ -2738,6 +2738,8 @@ static inline void _sock_tx_timestamp(struct sock *sk,
 	if (unlikely(sock_flag(sk, SOCK_WIFI_STATUS))) {
 		printk(KERN_INFO "%s: setting SKBTX_WIFI_STATUS for sk = %px\n", __func__, sk);
 		*tx_flags |= SKBTX_WIFI_STATUS;
+	} else {
+		printk(KERN_INFO "%s: NOT setting SKBTX_WIFI_STATUS for sk = %px\n", __func__, sk);
 	}
 }
 
diff --git a/net/ipv4/inet_connection_sock.c b/net/ipv4/inet_connection_sock.c
index 20915895bdaa..4913b09c0617 100644
--- a/net/ipv4/inet_connection_sock.c
+++ b/net/ipv4/inet_connection_sock.c
@@ -912,6 +912,7 @@ reqsk_alloc_noprof(const struct request_sock_ops *ops, struct sock *sk_listener,
 			return NULL;
 		}
 		req->rsk_listener = sk_listener;
+		printk(KERN_INFO "%s: sk_listener = %px\n", __func__, sk_listener);
 	}
 	req->rsk_ops = ops;
 	req_to_sk(req)->sk_prot = sk_listener->sk_prot;
@@ -986,6 +987,7 @@ static struct request_sock *inet_reqsk_clone(struct request_sock *req,
 	nreq_sk->sk_incoming_cpu = req_sk->sk_incoming_cpu;
 
 	nreq->rsk_listener = sk;
+	printk(KERN_INFO "%s: rsk_listener =%px\n", __func__, sk);
 
 	/* We need not acquire fastopenq->lock
 	 * because the child socket is locked in inet_csk_listen_stop().
diff --git a/net/ipv4/inet_timewait_sock.c b/net/ipv4/inet_timewait_sock.c
index 67efe9501581..1a3108ec7503 100644
--- a/net/ipv4/inet_timewait_sock.c
+++ b/net/ipv4/inet_timewait_sock.c
@@ -190,6 +190,7 @@ struct inet_timewait_sock *inet_twsk_alloc(const struct sock *sk,
 		const struct inet_sock *inet = inet_sk(sk);
 
 		tw->tw_dr	    = dr;
+		printk(KERN_INFO "%s: sk = %px tw_dr = %px\n", __func__, sk, dr);
 		/* Give us an identity. */
 		tw->tw_daddr	    = inet->inet_daddr;
 		tw->tw_rcv_saddr    = inet->inet_rcv_saddr;
diff --git a/net/mac80211/tx.c b/net/mac80211/tx.c
index eee2f80949c6..227b86427e06 100644
--- a/net/mac80211/tx.c
+++ b/net/mac80211/tx.c
@@ -4586,6 +4586,8 @@ static noinline void ieee80211_8023_xmit_clang_debug_helper(struct sk_buff *skb,
 							    struct ieee80211_local *local,
 							    struct ieee80211_tx_info *info)
 {
+	if (skb->sk)
+		printk(KERN_INFO "%s: skb->sk = %px skb->sk->sk_flags = 0x%lx\n", __func__, skb->sk, skb->sk->sk_flags);
 	if (unlikely(skb->sk && ((skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) ||
 				sock_flag(skb->sk, SOCK_WIFI_STATUS)))) {
 		if ((skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) ^ sock_flag(skb->sk, SOCK_WIFI_STATUS)) {


This monitor the value of skb->sk->sk_flags not only in the error case but in all cases, and also monitors
the places where the other members of the sk_flags union are set. The error occurs when at the start
of ieee80211_8023_xmit_clang_debug_helper() sk_flags is not actually the skc_flags member of the union
but insted is skc_tw_dr which is only interpreted is flags.
 So why does it work with gcc but fail with clang? sock_flag(skb->sk, SOCK_WIFI_STATUS) test bit 19 of 
skb->sk->sk_flags 

Here are the important snippets of debug output:

clang:
[  T575] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8f1bebba4300 skb->sk->sk_flags = 0xffffffffa16fe640

Here test_bit(0xffffffffa16fe640, SOCK_WIFI_STATUS) is 1.

gcc:
[  T600] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8d3506bec700 skb->sk->sk_flags = 0xffffffff93d40100
Here test_bit(0xffffffff93d40100, SOCK_WIFI_STATUS) is 0.

So that this works with gcc just seems like luck. I've not yet test why it works with clang when PREEMPT_RT is not
enabled but my guess is that in that case we have a tw_dr pointer which fails the test_bit().

Bert Karwatzki








^ permalink raw reply related	[flat|nested] 22+ messages in thread

* Re: lockup and kernel panic in linux-next-202505{09,12} when compiled with clang
  2025-05-17 19:49                       ` Bert Karwatzki
@ 2025-05-18  1:30                         ` Jason Xing
  2025-05-18 12:12                           ` Bert Karwatzki
  0 siblings, 1 reply; 22+ messages in thread
From: Jason Xing @ 2025-05-18  1:30 UTC (permalink / raw)
  To: Bert Karwatzki
  Cc: Johannes Berg, linux-kernel@vger.kernel.org,
	linux-next@vger.kernel.org, llvm@lists.linux.dev, Thomas Gleixner,
	linux-wireless

Hi Bert,

Thanks for your report and analysis!

On Sun, May 18, 2025 at 3:49 AM Bert Karwatzki <spasswolf@web.de> wrote:
>
> Am Samstag, dem 17.05.2025 um 13:34 +0200 schrieb Bert Karwatzki:
> > Am Freitag, dem 16.05.2025 um 20:19 +0200 schrieb Bert Karwatzki:
> > > I've added a debugging statement:
> > >
> > > diff --git a/net/mac80211/tx.c b/net/mac80211/tx.c
> > > index 3bd5ee0995fe..853493eca4f5 100644
> > > --- a/net/mac80211/tx.c
> > > +++ b/net/mac80211/tx.c
> > > @@ -4586,7 +4586,11 @@ static noinline void ieee80211_8023_xmit_clang_debug_helper(struct sk_buff *skb,

What is the caller of it? It's the function that you customized?

> > >                                                             struct ieee80211_local *local,
> > >                                                             struct ieee80211_tx_info *info)
> > >  {
> > > -       if (unlikely(skb->sk && sock_flag(skb->sk, SOCK_WIFI_STATUS))) {
> > > +       if (unlikely(skb->sk && ((skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) ||
> > > +                               sock_flag(skb->sk, SOCK_WIFI_STATUS)))) {
> > > +               if ((skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) ^ sock_flag(skb->sk, SOCK_WIFI_STATUS))
> > > +                       printk(KERN_INFO "%s: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = %u sock_flag(skb->sk,
> > > SOCK_WIFI_STATUS) = %u\n",
> > > +                                       __func__, (skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS), sock_flag(skb->sk,
> > > SOCK_WIFI_STATUS));
> > >                 info->status_data = ieee80211_store_ack_skb(local, skb,
> > >                                                             &info->flags, NULL);
> > >                 if (info->status_data)
> > >
> > > This gives the following logoutput (and a lockup), indicating that sock_flag(skb->sk, SOCK_WIFI_STATUS) and
> > > (skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) are actually NOT equivalent (when compiled with clang and
> > > PREEMPT_RT=y)

Moving skc_flags out of the union can solve the issue, right? Simple
modification looks like this:
diff --git a/include/net/sock.h b/include/net/sock.h
index 3e15d7105ad2..5810c7b80507 100644
--- a/include/net/sock.h
+++ b/include/net/sock.h
@@ -189,13 +189,13 @@ struct sock_common {

        atomic64_t              skc_cookie;

+       unsigned long   skc_flags;
        /* following fields are padding to force
         * offset(struct sock, sk_refcnt) == 128 on 64bit arches
         * assuming IPV6 is enabled. We use this padding differently
         * for different kind of 'sockets'
         */
        union {
-               unsigned long   skc_flags;
                struct sock     *skc_listener; /* request_sock */
                struct inet_timewait_death_row *skc_tw_dr; /*
inet_timewait_sock */
        };

Can you give it a try?

> >
> > I've added more debugging output:
> >
> > diff --git a/include/net/sock.h b/include/net/sock.h
> > index e223102337c7..e13560b5b7a8 100644
> > --- a/include/net/sock.h
> > +++ b/include/net/sock.h
> > @@ -2735,8 +2735,10 @@ static inline void _sock_tx_timestamp(struct sock *sk,
> >                               *tskey = atomic_inc_return(&sk->sk_tskey) - 1;
> >               }
> >       }
> > -     if (unlikely(sock_flag(sk, SOCK_WIFI_STATUS)))
> > +     if (unlikely(sock_flag(sk, SOCK_WIFI_STATUS))) {
> > +             printk(KERN_INFO "%s: setting SKBTX_WIFI_STATUS for sk = %px\n", __func__, sk);
> >               *tx_flags |= SKBTX_WIFI_STATUS;
> > +     }
> >  }
> >
> >  static inline void sock_tx_timestamp(struct sock *sk,
> > diff --git a/net/core/sock.c b/net/core/sock.c
> > index e02a78538e3e..f6589ad5ba36 100644
> > --- a/net/core/sock.c
> > +++ b/net/core/sock.c
> > @@ -1548,6 +1548,7 @@ int sk_setsockopt(struct sock *sk, int level, int optname,
> >               break;
> >
> >       case SO_WIFI_STATUS:
> > +             printk(KERN_INFO "%s: setting SOCK_WIFI_STATUS to %u for sk = %px\n", __func__, valbool, sk);
> >               sock_valbool_flag(sk, SOCK_WIFI_STATUS, valbool);
> >               break;
> >
> > diff --git a/net/mac80211/tx.c b/net/mac80211/tx.c
> > index 853493eca4f5..eee2f80949c6 100644
> > --- a/net/mac80211/tx.c
> > +++ b/net/mac80211/tx.c
> > @@ -4588,9 +4588,12 @@ static noinline void ieee80211_8023_xmit_clang_debug_helper(struct sk_buff *skb,
> >  {
> >       if (unlikely(skb->sk && ((skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) ||
> >                               sock_flag(skb->sk, SOCK_WIFI_STATUS)))) {
> > -             if ((skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) ^ sock_flag(skb->sk, SOCK_WIFI_STATUS))
> > +             if ((skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) ^ sock_flag(skb->sk, SOCK_WIFI_STATUS)) {
> >                       printk(KERN_INFO "%s: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = %u sock_flag(skb->sk, SOCK_WIFI_STATUS) = %u\n",
> >                                       __func__, (skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS), sock_flag(skb->sk, SOCK_WIFI_STATUS));
> > +                     printk(KERN_INFO "%s: skb->sk = %px skb->sk->sk_flags = 0x%lx\n", __func__, skb->sk, skb->sk->sk_flags);
> > +                     return; // This should make this case non-fatal.
> > +             }
> >               info->status_data = ieee80211_store_ack_skb(local, skb,
> >                                                           &info->flags, NULL);
> >               if (info->status_data)
> >
> >
> >
> > This gives after ~15min uptime
> >
> > [  189.337797] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
> > [  189.337803] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1b798c4e00 skb->sk->sk_flags = 0xffffffffb4efe640
> > [  191.325256] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
> > [  191.325259] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1b798c5a00 skb->sk->sk_flags = 0xffffffffb4efe640
> > [  257.591831] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
> > [  257.591844] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1baf3bca00 skb->sk->sk_flags = 0xffffffffb4efe640
> > [  301.786963] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
> > [  301.786967] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1c1bc40100 skb->sk->sk_flags = 0xffffffffb4efe640
> > [  302.780881] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
> > [  302.780884] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1a44cf6000 skb->sk->sk_flags = 0xffffffffb4efe640
> > [  482.792298] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
> > [  482.792304] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1da0f4de00 skb->sk->sk_flags = 0xffffffffb4efe640
> > [  482.806144] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
> > [  482.806148] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1da0f4c500 skb->sk->sk_flags = 0xffffffffb4efe640
> > [  482.817280] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
> > [  482.817284] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1da0f4df00 skb->sk->sk_flags = 0xffffffffb4efe640
> > [  552.327291] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
> > [  552.327295] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1da0f4de00 skb->sk->sk_flags = 0xffffffffb4efe640
> > [  916.971599] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
> > [  916.971607] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1a62834000 skb->sk->sk_flags = 0xffffffffb4efe640
> >
> > The printk()s in sk_set_sockopt() and _sock_tx_timestamp() are not called at all so the flag
> > SOCK_WIFI_STATUS is actually nevers set! What is printed when printing skb->sk->sk_flags looks
> > suspiciously like a pointer, and as sk_flags is actually a member of a union in struct sock_common
> > it seems clang is using sk_flags for one of the other union members here
> >
> > struct sock_common {
> > [...]
> >       union {
> >               unsigned long   skc_flags;
> >               struct sock     *skc_listener; /* request_sock */
> >               struct inet_timewait_death_row *skc_tw_dr; /* inet_timewait_sock */
> >       };
> > [...]
> > }
> >
> > Bert Karwatzki
>
> I added even more debugging output and found out why commit 76a853f86c97 (" wifi: free
> SKBTX_WIFI_STATUS skb tx_flags flag") does not work.
>
> diff --git a/include/net/sock.h b/include/net/sock.h
> index e13560b5b7a8..6e1291d2e5a1 100644
> --- a/include/net/sock.h
> +++ b/include/net/sock.h
> @@ -2738,6 +2738,8 @@ static inline void _sock_tx_timestamp(struct sock *sk,
>         if (unlikely(sock_flag(sk, SOCK_WIFI_STATUS))) {
>                 printk(KERN_INFO "%s: setting SKBTX_WIFI_STATUS for sk = %px\n", __func__, sk);
>                 *tx_flags |= SKBTX_WIFI_STATUS;
> +       } else {
> +               printk(KERN_INFO "%s: NOT setting SKBTX_WIFI_STATUS for sk = %px\n", __func__, sk);
>         }
>  }
>
> diff --git a/net/ipv4/inet_connection_sock.c b/net/ipv4/inet_connection_sock.c
> index 20915895bdaa..4913b09c0617 100644
> --- a/net/ipv4/inet_connection_sock.c
> +++ b/net/ipv4/inet_connection_sock.c
> @@ -912,6 +912,7 @@ reqsk_alloc_noprof(const struct request_sock_ops *ops, struct sock *sk_listener,
>                         return NULL;
>                 }
>                 req->rsk_listener = sk_listener;
> +               printk(KERN_INFO "%s: sk_listener = %px\n", __func__, sk_listener);
>         }
>         req->rsk_ops = ops;
>         req_to_sk(req)->sk_prot = sk_listener->sk_prot;
> @@ -986,6 +987,7 @@ static struct request_sock *inet_reqsk_clone(struct request_sock *req,
>         nreq_sk->sk_incoming_cpu = req_sk->sk_incoming_cpu;
>
>         nreq->rsk_listener = sk;
> +       printk(KERN_INFO "%s: rsk_listener =%px\n", __func__, sk);
>
>         /* We need not acquire fastopenq->lock
>          * because the child socket is locked in inet_csk_listen_stop().
> diff --git a/net/ipv4/inet_timewait_sock.c b/net/ipv4/inet_timewait_sock.c
> index 67efe9501581..1a3108ec7503 100644
> --- a/net/ipv4/inet_timewait_sock.c
> +++ b/net/ipv4/inet_timewait_sock.c
> @@ -190,6 +190,7 @@ struct inet_timewait_sock *inet_twsk_alloc(const struct sock *sk,
>                 const struct inet_sock *inet = inet_sk(sk);
>
>                 tw->tw_dr           = dr;
> +               printk(KERN_INFO "%s: sk = %px tw_dr = %px\n", __func__, sk, dr);
>                 /* Give us an identity. */
>                 tw->tw_daddr        = inet->inet_daddr;
>                 tw->tw_rcv_saddr    = inet->inet_rcv_saddr;
> diff --git a/net/mac80211/tx.c b/net/mac80211/tx.c
> index eee2f80949c6..227b86427e06 100644
> --- a/net/mac80211/tx.c
> +++ b/net/mac80211/tx.c
> @@ -4586,6 +4586,8 @@ static noinline void ieee80211_8023_xmit_clang_debug_helper(struct sk_buff *skb,
>                                                             struct ieee80211_local *local,
>                                                             struct ieee80211_tx_info *info)
>  {
> +       if (skb->sk)
> +               printk(KERN_INFO "%s: skb->sk = %px skb->sk->sk_flags = 0x%lx\n", __func__, skb->sk, skb->sk->sk_flags);
>         if (unlikely(skb->sk && ((skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) ||
>                                 sock_flag(skb->sk, SOCK_WIFI_STATUS)))) {
>                 if ((skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) ^ sock_flag(skb->sk, SOCK_WIFI_STATUS)) {
>
>
> This monitor the value of skb->sk->sk_flags not only in the error case but in all cases, and also monitors
> the places where the other members of the sk_flags union are set. The error occurs when at the start
> of ieee80211_8023_xmit_clang_debug_helper() sk_flags is not actually the skc_flags member of the union
> but insted is skc_tw_dr which is only interpreted is flags.
>  So why does it work with gcc but fail with clang? sock_flag(skb->sk, SOCK_WIFI_STATUS) test bit 19 of
> skb->sk->sk_flags

Could you say more about this? I don't follow it. Why does the gcc
test just miss the crash issue? Is there anything (like call trace)
different between them?

My worry is that all the callers calling sock_flag might have such
potential risk...

Thanks,
Jason

>
> Here are the important snippets of debug output:
>
> clang:
> [  T575] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8f1bebba4300 skb->sk->sk_flags = 0xffffffffa16fe640
>
> Here test_bit(0xffffffffa16fe640, SOCK_WIFI_STATUS) is 1.
>
> gcc:
> [  T600] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8d3506bec700 skb->sk->sk_flags = 0xffffffff93d40100
> Here test_bit(0xffffffff93d40100, SOCK_WIFI_STATUS) is 0.
>
> So that this works with gcc just seems like luck. I've not yet test why it works with clang when PREEMPT_RT is not
> enabled but my guess is that in that case we have a tw_dr pointer which fails the test_bit().
>
> Bert Karwatzki
>
>
>
>
>
>
>

^ permalink raw reply related	[flat|nested] 22+ messages in thread

* Re: lockup and kernel panic in linux-next-202505{09,12} when compiled with clang
  2025-05-18  1:30                         ` Jason Xing
@ 2025-05-18 12:12                           ` Bert Karwatzki
  2025-05-18 12:43                             ` Bert Karwatzki
  0 siblings, 1 reply; 22+ messages in thread
From: Bert Karwatzki @ 2025-05-18 12:12 UTC (permalink / raw)
  To: Jason Xing
  Cc: Johannes Berg, linux-kernel@vger.kernel.org,
	linux-next@vger.kernel.org, llvm@lists.linux.dev, Thomas Gleixner,
	linux-wireless, spasswolf

Am Sonntag, dem 18.05.2025 um 09:30 +0800 schrieb Jason Xing:
> Hi Bert,
> 
> Thanks for your report and analysis!
> 
> On Sun, May 18, 2025 at 3:49 AM Bert Karwatzki <spasswolf@web.de> wrote:
> > 
> > Am Samstag, dem 17.05.2025 um 13:34 +0200 schrieb Bert Karwatzki:
> > > Am Freitag, dem 16.05.2025 um 20:19 +0200 schrieb Bert Karwatzki:
> > > > I've added a debugging statement:
> > > > 
> > > > diff --git a/net/mac80211/tx.c b/net/mac80211/tx.c
> > > > index 3bd5ee0995fe..853493eca4f5 100644
> > > > --- a/net/mac80211/tx.c
> > > > +++ b/net/mac80211/tx.c
> > > > @@ -4586,7 +4586,11 @@ static noinline void ieee80211_8023_xmit_clang_debug_helper(struct sk_buff *skb,
> 
> What is the caller of it? It's the function that you customized?

The only caller of ieee80211_8023_xmit_clang_debug_helper() is
ieee80211_8023_xmit(). I did this because I thought clang might
have been producing incorrect code at the time, but it turned
out clang did nothing wrong.

> 
> > > >                                                             struct ieee80211_local *local,
> > > >                                                             struct ieee80211_tx_info *info)
> > > >  {
> > > > -       if (unlikely(skb->sk && sock_flag(skb->sk, SOCK_WIFI_STATUS))) {
> > > > +       if (unlikely(skb->sk && ((skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) ||
> > > > +                               sock_flag(skb->sk, SOCK_WIFI_STATUS)))) {
> > > > +               if ((skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) ^ sock_flag(skb->sk, SOCK_WIFI_STATUS))
> > > > +                       printk(KERN_INFO "%s: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = %u sock_flag(skb->sk,
> > > > SOCK_WIFI_STATUS) = %u\n",
> > > > +                                       __func__, (skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS), sock_flag(skb->sk,
> > > > SOCK_WIFI_STATUS));
> > > >                 info->status_data = ieee80211_store_ack_skb(local, skb,
> > > >                                                             &info->flags, NULL);
> > > >                 if (info->status_data)
> > > > 
> > > > This gives the following logoutput (and a lockup), indicating that sock_flag(skb->sk, SOCK_WIFI_STATUS) and
> > > > (skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) are actually NOT equivalent (when compiled with clang and
> > > > PREEMPT_RT=y)
> 
> Moving skc_flags out of the union can solve the issue, right? Simple
> modification looks like this:
> diff --git a/include/net/sock.h b/include/net/sock.h
> index 3e15d7105ad2..5810c7b80507 100644
> --- a/include/net/sock.h
> +++ b/include/net/sock.h
> @@ -189,13 +189,13 @@ struct sock_common {
> 
>         atomic64_t              skc_cookie;
> 
> +       unsigned long   skc_flags;
>         /* following fields are padding to force
>          * offset(struct sock, sk_refcnt) == 128 on 64bit arches
>          * assuming IPV6 is enabled. We use this padding differently
>          * for different kind of 'sockets'
>          */
>         union {
> -               unsigned long   skc_flags;
>                 struct sock     *skc_listener; /* request_sock */
>                 struct inet_timewait_death_row *skc_tw_dr; /*
> inet_timewait_sock */
>         };
> 
> Can you give it a try?

I thought this would work, but applying this patch on both on next-20250513 and 
next-20250516 gives the usual kernel panic (captured via netconsole) or the lockup
(which I'm not repeating here ~1000 lines).


[  199.627464][  T580] Oops: general protection fault, probably for non-canonical address 0xff510aa8ab572985: 0000 [#1] SMP NOPTI
[  199.627475][  T580] CPU: 8 UID: 0 PID: 580 Comm: napi/phy0-0 Not tainted 6.15.0-rc6-next-20250513-llvm-00005-gdd968010bbfa #993 PREEMPT_{RT,(full)} 
[  199.627481][  T580] Hardware name: Micro-Star International Co., Ltd. Alpha 15 B5EEK/MS-158L, BIOS E158LAMS.10F 11/11/2024
[  199.627484][  T580] RIP: 0010:queued_spin_lock_slowpath+0x120/0x1c0
[  199.627494][  T580] Code: c8 c1 e8 10 66 87 47 02 66 85 c0 74 40 0f b7 c0 89 c6 83 e6 03 c1 e6 04 83 e0 fc 49 c7 c0 f8 ff ff ff 49 8b 84 40 a0 fa 98 ab <48>
89 94 06 c0 21 06 ac 83 7a 08 00 75 08 f3 90 83 7a 08 00 74 f8
[  199.627497][  T580] RSP: 0018:ffffd0c301e77998 EFLAGS: 00010006
[  199.627501][  T580] RAX: ff510aa8ff5107b5 RBX: 0000000000000286 RCX: 0000000000240000
[  199.627503][  T580] RDX: ffff8a716e8231c0 RSI: 0000000000000010 RDI: ffff8a64c7ed35f8
[  199.627505][  T580] RBP: ffff8a62c8751200 R08: fffffffffffffff8 R09: 0000000000000001
[  199.627507][  T580] R10: 0000000000000001 R11: ffffffffab1f0820 R12: ffff8a64c7ed35e0
[  199.627509][  T580] R13: ffff8a62cbaf2480 R14: ffff8a64c7ed35f8 R15: ffff8a64c7ed35f8
[  199.627511][  T580] FS:  0000000000000000(0000) GS:ffff8a71c27c1000(0000) knlGS:0000000000000000
[  199.627513][  T580] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  199.627515][  T580] CR2: 00007fbadcaec0b0 CR3: 00000007fc23a000 CR4: 0000000000750ef0
[  199.627518][  T580] PKRU: 55555554
[  199.627519][  T580] Call Trace:
[  199.627522][  T580]  <TASK>
[  199.627525][  T580]  _raw_spin_lock_irqsave+0x57/0x60
[  199.627531][  T580]  rt_spin_lock+0x73/0xa0
[  199.627536][  T580]  sock_queue_err_skb+0xdc/0x140
[  199.627542][  T580]  skb_complete_wifi_ack+0xa9/0x120
[  199.627551][  T580]  ieee80211_report_used_skb+0x541/0x6e0 [mac80211]
[  199.627598][  T580]  ? srso_alias_return_thunk+0x5/0xfbef5
[  199.627604][  T580]  ? srso_alias_return_thunk+0x5/0xfbef5
[  199.627608][  T580]  ieee80211_tx_status_ext+0x3b3/0x870 [mac80211]
[  199.627636][  T580]  ? srso_alias_return_thunk+0x5/0xfbef5
[  199.627638][  T580]  ? rt_spin_lock+0x3d/0xa0
[  199.627646][  T580]  ? mt76_tx_status_unlock+0x38/0x230 [mt76]
[  199.627657][  T580]  mt76_tx_status_unlock+0x1e0/0x230 [mt76]
[  199.627668][  T580]  __mt76_tx_complete_skb+0x13b/0x2e0 [mt76]
[  199.627676][  T580]  ? srso_alias_return_thunk+0x5/0xfbef5
[  199.627679][  T580]  ? rt_spin_unlock+0x12/0x40
[  199.627682][  T580]  ? srso_alias_return_thunk+0x5/0xfbef5
[  199.627688][  T580]  mt76_connac2_txwi_free+0x127/0x150 [mt76_connac_lib]
[  199.627698][  T580]  mt7921_mac_tx_free+0x112/0x260 [mt7921_common]
[  199.627708][  T580]  mt7921_rx_check+0x33/0xe0 [mt7921_common]
[  199.627715][  T580]  mt76_dma_rx_poll+0x322/0x660 [mt76]
[  199.627725][  T580]  ? mt792x_poll_rx+0x2a/0x120 [mt792x_lib]
[  199.627732][  T580]  mt792x_poll_rx+0x71/0x120 [mt792x_lib]
[  199.627739][  T580]  __napi_poll+0x2a/0x170
[  199.627743][  T580]  ? napi_threaded_poll_loop+0x32/0x1b0
[  199.627746][  T580]  napi_threaded_poll_loop+0xe4/0x1b0
[  199.627749][  T580]  ? napi_threaded_poll_loop+0x32/0x1b0
[  199.627751][  T580]  ? asm_sysvec_apic_timer_interrupt+0x1a/0x20
[  199.627757][  T580]  napi_threaded_poll+0x57/0x80
[  199.627760][  T580]  ? __pfx_napi_threaded_poll+0x10/0x10
[  199.627763][  T580]  kthread+0x25c/0x280
[  199.627769][  T580]  ? __pfx_kthread+0x10/0x10
[  199.627773][  T580]  ret_from_fork+0xc4/0x1b0
[  199.627777][  T580]  ? __pfx_kthread+0x10/0x10
[  199.627781][  T580]  ret_from_fork_asm+0x1a/0x30
[  199.627788][  T580]  </TASK>
[  199.627789][  T580] Modules linked in: sd_mod scsi_mod scsi_common netconsole ccm snd_seq_dummy snd_hrtimer snd_seq_midi snd_rawmidi snd_seq_midi_event
snd_seq snd_seq_device rfcomm bnep nls_ascii nls_cp437 vfat fat snd_ctl_led snd_hda_codec_realtek snd_hda_scodec_component snd_hda_codec_generic
snd_hda_codec_hdmi btusb btbcm btintel btrtl snd_hda_intel btmtk snd_intel_dspcfg snd_hda_codec snd_soc_dmic snd_acp3x_rn snd_acp3x_pdm_dma snd_hwdep bluetooth
snd_hda_core snd_soc_core uvcvideo videobuf2_vmalloc videobuf2_memops snd_pcm_oss uvc videobuf2_v4l2 snd_mixer_oss videodev snd_pcm snd_rn_pci_acp3x
snd_acp_config videobuf2_common snd_timer snd_soc_acpi msi_wmi ecdh_generic ecc sparse_keymap mc wmi_bmof edac_mce_amd snd k10temp snd_pci_acp3x ccp soundcore
battery ac button joydev hid_sensor_accel_3d hid_sensor_magn_3d hid_sensor_prox hid_sensor_als hid_sensor_gyro_3d hid_sensor_trigger hid_sensor_iio_common
industrialio_triggered_buffer kfifo_buf amd_pmc evdev industrialio mt7921e mt
May 18 13:22:44 7921_common mt792x_lib mt76_connac_lib mt76
[  199.627877][  T580]  mac80211 libarc4 cfg80211 rfkill msr fuse nvme_fabrics efi_pstore configfs efivarfs autofs4 ext4 mbcache jbd2 amdgpu usbhid
drm_panel_backlight_quirks cec drm_buddy drm_suballoc_helper drm_exec i2c_algo_bit drm_display_helper gpu_sched drm_ttm_helper hid_sensor_hub ttm xhci_pci
hid_multitouch mfd_core hid_generic xhci_hcd i2c_hid_acpi drm_client_lib usbcore psmouse amd_sfh i2c_hid drm_kms_helper nvme hid serio_raw nvme_core amdxcp
r8169 i2c_piix4 crc16 usb_common i2c_smbus i2c_designware_platform i2c_designware_core
[  199.627931][  T580] ---[ end trace 0000000000000000 ]---
[  199.781799][  T580] RIP: 0010:queued_spin_lock_slowpath+0x120/0x1c0
[  199.781799][  T580] Code: c8 c1 e8 10 66 87 47 02 66 85 c0 74 40 0f b7 c0 89 c6 83 e6 03 c1 e6 04 83 e0 fc 49 c7 c0 f8 ff ff ff 49 8b 84 40 a0 fa 98 ab <48>
89 94 06 c0 21 06 ac 83 7a 08 00 75 08 f3 90 83 7a 08 00 74 f8
[  199.781799][  T580] RSP: 0018:ffffd0c301e77998 EFLAGS: 00010006
[  199.781799][  T580] RAX: ff510aa8ff5107b5 RBX: 0000000000000286 RCX: 0000000000240000
[  199.781799][  T580] RDX: ffff8a716e8231c0 RSI: 0000000000000010 RDI: ffff8a64c7ed35f8
[  199.781799][  T580] RBP: ffff8a62c8751200 R08: fffffffffffffff8 R09: 0000000000000001
[  199.781799][  T580] R10: 0000000000000001 R11: ffffffffab1f0820 R12: ffff8a64c7ed35e0
[  199.781799][  T580] R13: ffff8a62cbaf2480 R14: ffff8a64c7ed35f8 R15: ffff8a64c7ed35f8
[  199.781799][  T580] FS:  0000000000000000(0000) GS:ffff8a71c27c1000(0000) knlGS:0000000000000000
[  199.781799][  T580] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  199.781799][  T580] CR2: 00007fbadcaec0b0 CR3: 00000007fc23a000 CR4: 0000000000750ef0
[  199.781799][  T580] PKRU: 55555554
[  199.781799][  T580] Kernel panic - not syncing: Fatal exception in interrupt
[  199.788541][  T580] Kernel Offset: 0x29800000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff)
[  199.788541][  T580] ---[ end Kernel panic - not syncing: Fatal exception in interrupt ]---

I even tried this version of your patch, to keep the offset of skc_refcnt at 128,
but it doesn't  work, either.

commit fca84c5cde713be480544a64ed6680afc3319670
Author: Bert Karwatzki <spasswolf@web.de>
Date:   Sun May 18 13:32:36 2025 +0200

    include: net: sock: move skc_flags out of the union
    
    Signed-off-by: Bert Karwatzki <spasswolf@web.de>

diff --git a/include/net/sock.h b/include/net/sock.h
index 3e15d7105ad2..e73929a4da6e 100644
--- a/include/net/sock.h
+++ b/include/net/sock.h
@@ -195,7 +195,6 @@ struct sock_common {
 	 * for different kind of 'sockets'
 	 */
 	union {
-		unsigned long	skc_flags;
 		struct sock	*skc_listener; /* request_sock */
 		struct inet_timewait_death_row *skc_tw_dr; /* inet_timewait_sock */
 	};
@@ -221,6 +220,9 @@ struct sock_common {
 	};
 
 	refcount_t		skc_refcnt;
+
+	/* place skc_flags here to keep offset(struct sock, sk_refcnt) == 128 */
+	unsigned long	skc_flags;
 	/* private: */
 	int                     skc_dontcopy_end[0];
 	union {

> > > 
> > > I've added more debugging output:
> > > 
> > > diff --git a/include/net/sock.h b/include/net/sock.h
> > > index e223102337c7..e13560b5b7a8 100644
> > > --- a/include/net/sock.h
> > > +++ b/include/net/sock.h
> > > @@ -2735,8 +2735,10 @@ static inline void _sock_tx_timestamp(struct sock *sk,
> > >                               *tskey = atomic_inc_return(&sk->sk_tskey) - 1;
> > >               }
> > >       }
> > > -     if (unlikely(sock_flag(sk, SOCK_WIFI_STATUS)))
> > > +     if (unlikely(sock_flag(sk, SOCK_WIFI_STATUS))) {
> > > +             printk(KERN_INFO "%s: setting SKBTX_WIFI_STATUS for sk = %px\n", __func__, sk);
> > >               *tx_flags |= SKBTX_WIFI_STATUS;
> > > +     }
> > >  }
> > > 
> > >  static inline void sock_tx_timestamp(struct sock *sk,
> > > diff --git a/net/core/sock.c b/net/core/sock.c
> > > index e02a78538e3e..f6589ad5ba36 100644
> > > --- a/net/core/sock.c
> > > +++ b/net/core/sock.c
> > > @@ -1548,6 +1548,7 @@ int sk_setsockopt(struct sock *sk, int level, int optname,
> > >               break;
> > > 
> > >       case SO_WIFI_STATUS:
> > > +             printk(KERN_INFO "%s: setting SOCK_WIFI_STATUS to %u for sk = %px\n", __func__, valbool, sk);
> > >               sock_valbool_flag(sk, SOCK_WIFI_STATUS, valbool);
> > >               break;
> > > 
> > > diff --git a/net/mac80211/tx.c b/net/mac80211/tx.c
> > > index 853493eca4f5..eee2f80949c6 100644
> > > --- a/net/mac80211/tx.c
> > > +++ b/net/mac80211/tx.c
> > > @@ -4588,9 +4588,12 @@ static noinline void ieee80211_8023_xmit_clang_debug_helper(struct sk_buff *skb,
> > >  {
> > >       if (unlikely(skb->sk && ((skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) ||
> > >                               sock_flag(skb->sk, SOCK_WIFI_STATUS)))) {
> > > -             if ((skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) ^ sock_flag(skb->sk, SOCK_WIFI_STATUS))
> > > +             if ((skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) ^ sock_flag(skb->sk, SOCK_WIFI_STATUS)) {
> > >                       printk(KERN_INFO "%s: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = %u sock_flag(skb->sk, SOCK_WIFI_STATUS) = %u\n",
> > >                                       __func__, (skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS), sock_flag(skb->sk, SOCK_WIFI_STATUS));
> > > +                     printk(KERN_INFO "%s: skb->sk = %px skb->sk->sk_flags = 0x%lx\n", __func__, skb->sk, skb->sk->sk_flags);
> > > +                     return; // This should make this case non-fatal.
> > > +             }
> > >               info->status_data = ieee80211_store_ack_skb(local, skb,
> > >                                                           &info->flags, NULL);
> > >               if (info->status_data)
> > > 
> > > 
> > > 
> > > This gives after ~15min uptime
> > > 
> > > [  189.337797] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
> > > [  189.337803] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1b798c4e00 skb->sk->sk_flags = 0xffffffffb4efe640
> > > [  191.325256] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
> > > [  191.325259] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1b798c5a00 skb->sk->sk_flags = 0xffffffffb4efe640
> > > [  257.591831] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
> > > [  257.591844] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1baf3bca00 skb->sk->sk_flags = 0xffffffffb4efe640
> > > [  301.786963] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
> > > [  301.786967] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1c1bc40100 skb->sk->sk_flags = 0xffffffffb4efe640
> > > [  302.780881] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
> > > [  302.780884] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1a44cf6000 skb->sk->sk_flags = 0xffffffffb4efe640
> > > [  482.792298] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
> > > [  482.792304] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1da0f4de00 skb->sk->sk_flags = 0xffffffffb4efe640
> > > [  482.806144] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
> > > [  482.806148] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1da0f4c500 skb->sk->sk_flags = 0xffffffffb4efe640
> > > [  482.817280] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
> > > [  482.817284] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1da0f4df00 skb->sk->sk_flags = 0xffffffffb4efe640
> > > [  552.327291] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
> > > [  552.327295] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1da0f4de00 skb->sk->sk_flags = 0xffffffffb4efe640
> > > [  916.971599] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS = 0 sock_flag(skb->sk, SOCK_WIFI_STATUS) = 1
> > > [  916.971607] [    T576] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8c1a62834000 skb->sk->sk_flags = 0xffffffffb4efe640
> > > 
> > > The printk()s in sk_set_sockopt() and _sock_tx_timestamp() are not called at all so the flag
> > > SOCK_WIFI_STATUS is actually nevers set! What is printed when printing skb->sk->sk_flags looks
> > > suspiciously like a pointer, and as sk_flags is actually a member of a union in struct sock_common
> > > it seems clang is using sk_flags for one of the other union members here
> > > 
> > > struct sock_common {
> > > [...]
> > >       union {
> > >               unsigned long   skc_flags;
> > >               struct sock     *skc_listener; /* request_sock */
> > >               struct inet_timewait_death_row *skc_tw_dr; /* inet_timewait_sock */
> > >       };
> > > [...]
> > > }
> > > 
> > > Bert Karwatzki
> > 
> > I added even more debugging output and found out why commit 76a853f86c97 (" wifi: free
> > SKBTX_WIFI_STATUS skb tx_flags flag") does not work.
> > 
> > diff --git a/include/net/sock.h b/include/net/sock.h
> > index e13560b5b7a8..6e1291d2e5a1 100644
> > --- a/include/net/sock.h
> > +++ b/include/net/sock.h
> > @@ -2738,6 +2738,8 @@ static inline void _sock_tx_timestamp(struct sock *sk,
> >         if (unlikely(sock_flag(sk, SOCK_WIFI_STATUS))) {
> >                 printk(KERN_INFO "%s: setting SKBTX_WIFI_STATUS for sk = %px\n", __func__, sk);
> >                 *tx_flags |= SKBTX_WIFI_STATUS;
> > +       } else {
> > +               printk(KERN_INFO "%s: NOT setting SKBTX_WIFI_STATUS for sk = %px\n", __func__, sk);
> >         }
> >  }
> > 
> > diff --git a/net/ipv4/inet_connection_sock.c b/net/ipv4/inet_connection_sock.c
> > index 20915895bdaa..4913b09c0617 100644
> > --- a/net/ipv4/inet_connection_sock.c
> > +++ b/net/ipv4/inet_connection_sock.c
> > @@ -912,6 +912,7 @@ reqsk_alloc_noprof(const struct request_sock_ops *ops, struct sock *sk_listener,
> >                         return NULL;
> >                 }
> >                 req->rsk_listener = sk_listener;
> > +               printk(KERN_INFO "%s: sk_listener = %px\n", __func__, sk_listener);
> >         }
> >         req->rsk_ops = ops;
> >         req_to_sk(req)->sk_prot = sk_listener->sk_prot;
> > @@ -986,6 +987,7 @@ static struct request_sock *inet_reqsk_clone(struct request_sock *req,
> >         nreq_sk->sk_incoming_cpu = req_sk->sk_incoming_cpu;
> > 
> >         nreq->rsk_listener = sk;
> > +       printk(KERN_INFO "%s: rsk_listener =%px\n", __func__, sk);
> > 
> >         /* We need not acquire fastopenq->lock
> >          * because the child socket is locked in inet_csk_listen_stop().
> > diff --git a/net/ipv4/inet_timewait_sock.c b/net/ipv4/inet_timewait_sock.c
> > index 67efe9501581..1a3108ec7503 100644
> > --- a/net/ipv4/inet_timewait_sock.c
> > +++ b/net/ipv4/inet_timewait_sock.c
> > @@ -190,6 +190,7 @@ struct inet_timewait_sock *inet_twsk_alloc(const struct sock *sk,
> >                 const struct inet_sock *inet = inet_sk(sk);
> > 
> >                 tw->tw_dr           = dr;
> > +               printk(KERN_INFO "%s: sk = %px tw_dr = %px\n", __func__, sk, dr);
> >                 /* Give us an identity. */
> >                 tw->tw_daddr        = inet->inet_daddr;
> >                 tw->tw_rcv_saddr    = inet->inet_rcv_saddr;
> > diff --git a/net/mac80211/tx.c b/net/mac80211/tx.c
> > index eee2f80949c6..227b86427e06 100644
> > --- a/net/mac80211/tx.c
> > +++ b/net/mac80211/tx.c
> > @@ -4586,6 +4586,8 @@ static noinline void ieee80211_8023_xmit_clang_debug_helper(struct sk_buff *skb,
> >                                                             struct ieee80211_local *local,
> >                                                             struct ieee80211_tx_info *info)
> >  {
> > +       if (skb->sk)
> > +               printk(KERN_INFO "%s: skb->sk = %px skb->sk->sk_flags = 0x%lx\n", __func__, skb->sk, skb->sk->sk_flags);
> >         if (unlikely(skb->sk && ((skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) ||
> >                                 sock_flag(skb->sk, SOCK_WIFI_STATUS)))) {
> >                 if ((skb_shinfo(skb)->tx_flags & SKBTX_WIFI_STATUS) ^ sock_flag(skb->sk, SOCK_WIFI_STATUS)) {
> > 
> > 
> > This monitor the value of skb->sk->sk_flags not only in the error case but in all cases, and also monitors
> > the places where the other members of the sk_flags union are set. The error occurs when at the start
> > of ieee80211_8023_xmit_clang_debug_helper() sk_flags is not actually the skc_flags member of the union
> > but insted is skc_tw_dr which is only interpreted is flags.
> >  So why does it work with gcc but fail with clang? sock_flag(skb->sk, SOCK_WIFI_STATUS) test bit 19 of
> > skb->sk->sk_flags
> 
> Could you say more about this? I don't follow it. Why does the gcc
> test just miss the crash issue? Is there anything (like call trace)
> different between them?
> 

I think it is just pointer lottery, the pointer in the gcc version has bit
19 not set while the pointer in the clang version has bit 19 set. Why this is
always the case, I don't know, there is KASLR active after all.
 By the way, the pointer value that is incorrectly used as sk_flags set
in inet_twsk_alloc() (called by tcp_time_wait()):


struct inet_timewait_sock *inet_twsk_alloc(const struct sock *sk,
					   struct inet_timewait_death_row *dr,
					   const int state)
{
	struct inet_timewait_sock *tw;

	if (refcount_read(&dr->tw_refcount) - 1 >=
	    READ_ONCE(dr->sysctl_max_tw_buckets))
		return NULL;

	tw = kmem_cache_alloc(sk->sk_prot_creator->twsk_prot->twsk_slab,
			      GFP_ATOMIC);
	if (tw) {
		const struct inet_sock *inet = inet_sk(sk);

		tw->tw_dr	    = dr; // This is incorrectly use as sk_flags!xXX


> My worry is that all the callers calling sock_flag might have such
> potential risk...
> 
> Thanks,
> Jason

I'd worry that, too. How can callers of sock_flag() know which part of the union is
active? At least for debugging purposes one could add a bool to struct sock_common
which is false by default and gets set to true when the pointer members of the union are
set, e.g. in inet_twsk_alloc():


struct inet_timewait_sock *inet_twsk_alloc(const struct sock *sk,
					   struct inet_timewait_death_row *dr,
					   const int state)
{
	struct inet_timewait_sock *tw;

	if (refcount_read(&dr->tw_refcount) - 1 >=
	    READ_ONCE(dr->sysctl_max_tw_buckets))
		return NULL;

	tw = kmem_cache_alloc(sk->sk_prot_creator->twsk_prot->twsk_slab,
			      GFP_ATOMIC);
	if (tw) {
		const struct inet_sock *inet = inet_sk(sk);

		tw->tw_dr	    = dr;
                tw->is_pointer = true;

> 


Bert Karwatzki

^ permalink raw reply related	[flat|nested] 22+ messages in thread

* Re: lockup and kernel panic in linux-next-202505{09,12} when compiled with clang
  2025-05-18 12:12                           ` Bert Karwatzki
@ 2025-05-18 12:43                             ` Bert Karwatzki
  2025-05-18 14:15                               ` Bert Karwatzki
  0 siblings, 1 reply; 22+ messages in thread
From: Bert Karwatzki @ 2025-05-18 12:43 UTC (permalink / raw)
  To: Jason Xing
  Cc: Johannes Berg, linux-kernel@vger.kernel.org,
	linux-next@vger.kernel.org, llvm@lists.linux.dev, Thomas Gleixner,
	linux-wireless, spasswolf

Am Sonntag, dem 18.05.2025 um 14:12 +0200 schrieb Bert Karwatzki:
> > > > 
> 
> I even tried this version of your patch, to keep the offset of skc_refcnt at 128,
> but it doesn't  work, either.
> 
> commit fca84c5cde713be480544a64ed6680afc3319670
> Author: Bert Karwatzki <spasswolf@web.de>
> Date:   Sun May 18 13:32:36 2025 +0200
> 
>     include: net: sock: move skc_flags out of the union
>     
>     Signed-off-by: Bert Karwatzki <spasswolf@web.de>
> 
> diff --git a/include/net/sock.h b/include/net/sock.h
> index 3e15d7105ad2..e73929a4da6e 100644
> --- a/include/net/sock.h
> +++ b/include/net/sock.h
> @@ -195,7 +195,6 @@ struct sock_common {
>  	 * for different kind of 'sockets'
>  	 */
>  	union {
> -		unsigned long	skc_flags;
>  		struct sock	*skc_listener; /* request_sock */
>  		struct inet_timewait_death_row *skc_tw_dr; /* inet_timewait_sock */
>  	};
> @@ -221,6 +220,9 @@ struct sock_common {
>  	};
>  
>  	refcount_t		skc_refcnt;
> +
> +	/* place skc_flags here to keep offset(struct sock, sk_refcnt) == 128 */
> +	unsigned long	skc_flags;
>  	/* private: */
>  	int                     skc_dontcopy_end[0];
>  	union {
> 

In the patch above I accidently put skc_flags in the part of struct sock_common
which does not get copied, but putting it below skc_dontcopy_end[0] does not work,
either:

diff --git a/include/net/sock.h b/include/net/sock.h
index 3e15d7105ad2..6d69753a205a 100644
--- a/include/net/sock.h
+++ b/include/net/sock.h
@@ -195,7 +195,6 @@ struct sock_common {
         * for different kind of 'sockets'
         */
        union {
-               unsigned long   skc_flags;
                struct sock     *skc_listener; /* request_sock */
                struct inet_timewait_death_row *skc_tw_dr; /* inet_timewait_sock */
        };
@@ -221,8 +220,12 @@ struct sock_common {
        };
 
        refcount_t              skc_refcnt;
+
        /* private: */
        int                     skc_dontcopy_end[0];
+       /* place skc_flags here to keep offset(struct sock, sk_refcnt) == 128 
+        * Also place it below skc_dontcopy_end[0] */
+       unsigned long   skc_flags;
        union {
                u32             skc_rxhash;
                u32             skc_window_clamp;

This locks up as usual.

Bert Karwatzki

^ permalink raw reply related	[flat|nested] 22+ messages in thread

* Re: lockup and kernel panic in linux-next-202505{09,12} when compiled with clang
  2025-05-18 12:43                             ` Bert Karwatzki
@ 2025-05-18 14:15                               ` Bert Karwatzki
  2025-05-18 14:41                                 ` Bert Karwatzki
  0 siblings, 1 reply; 22+ messages in thread
From: Bert Karwatzki @ 2025-05-18 14:15 UTC (permalink / raw)
  To: Jason Xing
  Cc: Johannes Berg, linux-kernel@vger.kernel.org,
	linux-next@vger.kernel.org, llvm@lists.linux.dev, Thomas Gleixner,
	linux-wireless, spasswolf

Am Sonntag, dem 18.05.2025 um 14:43 +0200 schrieb Bert Karwatzki:
> Am Sonntag, dem 18.05.2025 um 14:12 +0200 schrieb Bert Karwatzki:
> > > > > 
> > 
> > I even tried this version of your patch, to keep the offset of skc_refcnt at 128,
> > but it doesn't  work, either.
> > 
> > commit fca84c5cde713be480544a64ed6680afc3319670
> > Author: Bert Karwatzki <spasswolf@web.de>
> > Date:   Sun May 18 13:32:36 2025 +0200
> > 
> >     include: net: sock: move skc_flags out of the union
> >     
> >     Signed-off-by: Bert Karwatzki <spasswolf@web.de>
> > 
> > diff --git a/include/net/sock.h b/include/net/sock.h
> > index 3e15d7105ad2..e73929a4da6e 100644
> > --- a/include/net/sock.h
> > +++ b/include/net/sock.h
> > @@ -195,7 +195,6 @@ struct sock_common {
> >  	 * for different kind of 'sockets'
> >  	 */
> >  	union {
> > -		unsigned long	skc_flags;
> >  		struct sock	*skc_listener; /* request_sock */
> >  		struct inet_timewait_death_row *skc_tw_dr; /* inet_timewait_sock */
> >  	};
> > @@ -221,6 +220,9 @@ struct sock_common {
> >  	};
> >  
> >  	refcount_t		skc_refcnt;
> > +
> > +	/* place skc_flags here to keep offset(struct sock, sk_refcnt) == 128 */
> > +	unsigned long	skc_flags;
> >  	/* private: */
> >  	int                     skc_dontcopy_end[0];
> >  	union {
> > 
> 
> In the patch above I accidently put skc_flags in the part of struct sock_common
> which does not get copied, but putting it below skc_dontcopy_end[0] does not work,
> either:
> 
> diff --git a/include/net/sock.h b/include/net/sock.h
> index 3e15d7105ad2..6d69753a205a 100644
> --- a/include/net/sock.h
> +++ b/include/net/sock.h
> @@ -195,7 +195,6 @@ struct sock_common {
>          * for different kind of 'sockets'
>          */
>         union {
> -               unsigned long   skc_flags;
>                 struct sock     *skc_listener; /* request_sock */
>                 struct inet_timewait_death_row *skc_tw_dr; /* inet_timewait_sock */
>         };
> @@ -221,8 +220,12 @@ struct sock_common {
>         };
>  
>         refcount_t              skc_refcnt;
> +
>         /* private: */
>         int                     skc_dontcopy_end[0];
> +       /* place skc_flags here to keep offset(struct sock, sk_refcnt) == 128 
> +        * Also place it below skc_dontcopy_end[0] */
> +       unsigned long   skc_flags;
>         union {
>                 u32             skc_rxhash;
>                 u32             skc_window_clamp;
> 
> This locks up as usual.
> 
> Bert Karwatzki

So I did some more monitoring and found that even though skc_flags is removed from the union
it can take strange values, e.g.:

Here the value is not even a pointer (perhaps unitialized memory?):
[  T572] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff88fc2abf4cc0 skb->sk->sk_flags = 0xa00f7fe57b16f7e1
These could be pointers, but as pointers would only be aligned to a 2-byte boundary ...
[  T572] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff88fbd0bd3210 skb->sk->sk_flags = 0xffffc0f1c62dcc4e
[  T572] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff88fbd0bd3210 skb->sk->sk_flags = 0xffffc0f1c62dcc4e

Bert Karwatzki


^ permalink raw reply	[flat|nested] 22+ messages in thread

* Re: lockup and kernel panic in linux-next-202505{09,12} when compiled with clang
  2025-05-18 14:15                               ` Bert Karwatzki
@ 2025-05-18 14:41                                 ` Bert Karwatzki
  0 siblings, 0 replies; 22+ messages in thread
From: Bert Karwatzki @ 2025-05-18 14:41 UTC (permalink / raw)
  To: Jason Xing
  Cc: Johannes Berg, linux-kernel@vger.kernel.org,
	linux-next@vger.kernel.org, llvm@lists.linux.dev, Thomas Gleixner,
	linux-wireless, spasswolf

Am Sonntag, dem 18.05.2025 um 16:15 +0200 schrieb Bert Karwatzki:
> Am Sonntag, dem 18.05.2025 um 14:43 +0200 schrieb Bert Karwatzki:
> > Am Sonntag, dem 18.05.2025 um 14:12 +0200 schrieb Bert Karwatzki:
> > > > > > 
> > > 
> > > I even tried this version of your patch, to keep the offset of skc_refcnt at 128,
> > > but it doesn't  work, either.
> > > 
> > > commit fca84c5cde713be480544a64ed6680afc3319670
> > > Author: Bert Karwatzki <spasswolf@web.de>
> > > Date:   Sun May 18 13:32:36 2025 +0200
> > > 
> > >     include: net: sock: move skc_flags out of the union
> > >     
> > >     Signed-off-by: Bert Karwatzki <spasswolf@web.de>
> > > 
> > > diff --git a/include/net/sock.h b/include/net/sock.h
> > > index 3e15d7105ad2..e73929a4da6e 100644
> > > --- a/include/net/sock.h
> > > +++ b/include/net/sock.h
> > > @@ -195,7 +195,6 @@ struct sock_common {
> > >  	 * for different kind of 'sockets'
> > >  	 */
> > >  	union {
> > > -		unsigned long	skc_flags;
> > >  		struct sock	*skc_listener; /* request_sock */
> > >  		struct inet_timewait_death_row *skc_tw_dr; /* inet_timewait_sock */
> > >  	};
> > > @@ -221,6 +220,9 @@ struct sock_common {
> > >  	};
> > >  
> > >  	refcount_t		skc_refcnt;
> > > +
> > > +	/* place skc_flags here to keep offset(struct sock, sk_refcnt) == 128 */
> > > +	unsigned long	skc_flags;
> > >  	/* private: */
> > >  	int                     skc_dontcopy_end[0];
> > >  	union {
> > > 
> > 
> > In the patch above I accidently put skc_flags in the part of struct sock_common
> > which does not get copied, but putting it below skc_dontcopy_end[0] does not work,
> > either:
> > 
> > diff --git a/include/net/sock.h b/include/net/sock.h
> > index 3e15d7105ad2..6d69753a205a 100644
> > --- a/include/net/sock.h
> > +++ b/include/net/sock.h
> > @@ -195,7 +195,6 @@ struct sock_common {
> >          * for different kind of 'sockets'
> >          */
> >         union {
> > -               unsigned long   skc_flags;
> >                 struct sock     *skc_listener; /* request_sock */
> >                 struct inet_timewait_death_row *skc_tw_dr; /* inet_timewait_sock */
> >         };
> > @@ -221,8 +220,12 @@ struct sock_common {
> >         };
> >  
> >         refcount_t              skc_refcnt;
> > +
> >         /* private: */
> >         int                     skc_dontcopy_end[0];
> > +       /* place skc_flags here to keep offset(struct sock, sk_refcnt) == 128 
> > +        * Also place it below skc_dontcopy_end[0] */
> > +       unsigned long   skc_flags;
> >         union {
> >                 u32             skc_rxhash;
> >                 u32             skc_window_clamp;
> > 
> > This locks up as usual.
> > 
> > Bert Karwatzki
> 
> So I did some more monitoring and found that even though skc_flags is removed from the union
> it can take strange values, e.g.:
> 
> Here the value is not even a pointer (perhaps unitialized memory?):
> [  T572] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff88fc2abf4cc0 skb->sk->sk_flags = 0xa00f7fe57b16f7e1
> These could be pointers, but as pointers would only be aligned to a 2-byte boundary ...
> [  T572] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff88fbd0bd3210 skb->sk->sk_flags = 0xffffc0f1c62dcc4e
> [  T572] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff88fbd0bd3210 skb->sk->sk_flags = 0xffffc0f1c62dcc4e
> 
> Bert Karwatzki

I tried to set sk_flags to 0 in sk_prot_alloc() like this:

commit 269f21266477e74321e32e0b022dda8e98785589 (HEAD -> clang_panic)
Author: Bert Karwatzki <spasswolf@web.de>
Date:   Sun May 18 16:28:39 2025 +0200

    net: core: sock: set initial sk_flags to 0 in sk_prot_alloc()
    
    Signed-off-by: Bert Karwatzki <spasswolf@web.de>

diff --git a/net/core/sock.c b/net/core/sock.c
index f6589ad5ba36..acaa39ad18be 100644
--- a/net/core/sock.c
+++ b/net/core/sock.c
@@ -2216,6 +2216,7 @@ static struct sock *sk_prot_alloc(struct proto *prot, gfp_t priority,
                        goto out_free_sec;
        }
 
+       sk->sk_flags = 0;
        return sk;
 
 out_free_sec:

But that didn't work:
[   13.832282] [    T579] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8962805faee0 skb->sk->sk_flags = 0x4472000044f00000
[...]
[  124.165094] [    T579] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff896280760550 skb->sk->sk_flags = 0x726f2e65746f7571
[...]
[  185.138202] [    T579] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8960c78b7a90 skb->sk->sk_flags = 0x8000000000000025
[...]
[  290.623998] [    T579] ieee80211_8023_xmit_clang_debug_helper: skb->sk = ffff8961936b7870 skb->sk->sk_flags = 0xffff8961936b78f0

Bert Karwatzki

^ permalink raw reply related	[flat|nested] 22+ messages in thread

end of thread, other threads:[~2025-05-18 14:42 UTC | newest]

Thread overview: 22+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2025-05-13 16:48 lockup and kernel panic in linux-next-202505{09,12} when compiled with clang Bert Karwatzki
2025-05-13 22:33 ` Thomas Gleixner
2025-05-14  0:11   ` Bert Karwatzki
2025-05-14  9:32     ` Bert Karwatzki
2025-05-14 10:23       ` Johannes Berg
2025-05-14 13:46         ` Bert Karwatzki
2025-05-14 17:49           ` Johannes Berg
2025-05-14 18:56           ` Johannes Berg
2025-05-14 22:27             ` Bert Karwatzki
2025-05-15  6:30               ` Johannes Berg
2025-05-15  9:10                 ` Bert Karwatzki
2025-05-16 18:19                   ` Bert Karwatzki
2025-05-17 11:34                     ` Bert Karwatzki
2025-05-17 19:49                       ` Bert Karwatzki
2025-05-18  1:30                         ` Jason Xing
2025-05-18 12:12                           ` Bert Karwatzki
2025-05-18 12:43                             ` Bert Karwatzki
2025-05-18 14:15                               ` Bert Karwatzki
2025-05-18 14:41                                 ` Bert Karwatzki
  -- strict thread matches above, loose matches on Subject: below --
2025-05-13 22:15 Bert Karwatzki
2025-05-13 10:19 Bert Karwatzki
2025-05-13  8:00 Bert Karwatzki

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).