[Bug 220224] New: Kernel 6.15 causes crash (general protection fault) due to amd_sfh module

[Bug 220224] New: Kernel 6.15 causes crash (general protection fault) due to amd_sfh module

[bugzilla-daemon]

https://bugzilla.kernel.org/show_bug.cgi?id=220224

            Bug ID: 220224
           Summary: Kernel 6.15 causes crash (general protection fault)
                    due to amd_sfh module
           Product: Drivers
           Version: 2.5
          Hardware: AMD
                OS: Linux
            Status: NEW
          Severity: blocking
          Priority: P3
         Component: Platform_x86
          Assignee: drivers_platform_x86@kernel-bugs.osdl.org
          Reporter: g.molinaro@linuxmail.org
        Regression: No

Created attachment 308234
  --> https://bugzilla.kernel.org/attachment.cgi?id=308234&action=edit
dmesg from successful boot (with module blacklisted)

On my MSI Alpha 15 B5EEK laptop (AMD Ryzen 7 5800H), the system fails to boot
on Linux 6.15 due to a general protection fault linked to the amd_sfh (Sensor
Fusion Hub) module.

The error occurs early in the boot process, and results in a kernel panic.
Booting with the amd_sfh module blacklisted resolves the issue. Additionally,
the latest LTS kernel (6.1.x) works fine with the module enabled.

System is running Arch Linux with linux-cachyos kernel 6.15.2-2.

No critical side effects are observed when the module is blacklisted — the
system appears stable and fully functional.

**Reproducible:** Always  
**Workaround:** Blacklist `amd_sfh` and rebuild initramfs


Hardware:

    Laptop: MSI Alpha 15 B5EEK

    CPU: AMD Ryzen 7 5800H with Radeon Graphics

    BIOS: E158LAMS.10B (05/18/2023)

Steps to Reproduce:

    Boot system with Linux 6.15 kernel

    Observe crash (kernel panic from general protection fault in amd_sfh)

    Boot with amd_sfh blacklisted — issue no longer occurs

-- 
You may reply to this email to add a comment.

You are receiving this mail because:
You are watching the assignee of the bug.

[Bug 220224] Kernel 6.15 causes crash (general protection fault) due to amd_sfh module

[bugzilla-daemon]

https://bugzilla.kernel.org/show_bug.cgi?id=220224

--- Comment #1 from g.molinaro@linuxmail.org ---
Created attachment 308235
  --> https://bugzilla.kernel.org/attachment.cgi?id=308235&action=edit
Picture of the Kernel Painic

-- 
You may reply to this email to add a comment.

You are receiving this mail because:
You are watching the assignee of the bug.

[Bug 220224] Kernel 6.15 causes crash (general protection fault) due to amd_sfh module

[bugzilla-daemon]

https://bugzilla.kernel.org/show_bug.cgi?id=220224

--- Comment #2 from g.molinaro@linuxmail.org ---
Created attachment 308236
  --> https://bugzilla.kernel.org/attachment.cgi?id=308236&action=edit
output of lspci -nn

-- 
You may reply to this email to add a comment.

You are receiving this mail because:
You are watching the assignee of the bug.

[Bug 220224] Kernel 6.15 causes crash (general protection fault) due to amd_sfh module

[bugzilla-daemon]

https://bugzilla.kernel.org/show_bug.cgi?id=220224

--- Comment #3 from g.molinaro@linuxmail.org ---
Created attachment 308237
  --> https://bugzilla.kernel.org/attachment.cgi?id=308237&action=edit
output of uname -a

-- 
You may reply to this email to add a comment.

You are receiving this mail because:
You are watching the assignee of the bug.

[Bug 220224] Kernel 6.15 causes crash (general protection fault) due to amd_sfh module

[bugzilla-daemon]

https://bugzilla.kernel.org/show_bug.cgi?id=220224

--- Comment #4 from g.molinaro@linuxmail.org ---
### Downstream Tracking

This issue is also being tracked by the CachyOS kernel maintainers here:
https://github.com/CachyOS/linux-cachyos/issues/483

-- 
You may reply to this email to add a comment.

You are receiving this mail because:
You are watching the assignee of the bug.

[Bug 220224] Kernel 6.15 causes crash (general protection fault) due to amd_sfh module

[bugzilla-daemon]

https://bugzilla.kernel.org/show_bug.cgi?id=220224

--- Comment #5 from g.molinaro@linuxmail.org ---
### Errata Corrige
The LTS kernel version in the description should be 6.12.33, I forgot to updade
the boiler plate...

The system also worked fine with every 6.14.x kernel.

-- 
You may reply to this email to add a comment.

You are receiving this mail because:
You are watching the assignee of the bug.

[Bug 220224] Kernel 6.15 causes crash (general protection fault) due to amd_sfh module

[bugzilla-daemon]

https://bugzilla.kernel.org/show_bug.cgi?id=220224

Mario Limonciello (AMD) (mario.limonciello@amd.com) changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |mario.limonciello@amd.com

--- Comment #6 from Mario Limonciello (AMD) (mario.limonciello@amd.com) ---
There's a very small list of commits from amd-sfh in 6.15.  Can you bisect?

$ git log --oneline v6.14..v6.15 drivers/hid/amd-sfh-hid
f32e8c809549 HID: amd_sfh: Avoid clearing reports for SRA sensor
0cc2effbc8f5 HID: amd_sfh: Fix SRA sensor when it's the only sensor
01601fdd40ec HID: amd_sfh: Don't show wrong status for amd_sfh_hpd_info()
832ecb010e60 HID: amd_sfh: Default to HPD disabled
e38764f6dbb3 HID: amd_sfh: Allow configuring whether HPD is enabled or disabled

Nothing immediately jumps out to me, but also a more complete dmesg would be
really helpful.  Anything in journalctl -k -b-1 after it happens?  Or in
/var/log/systemd/pstore?

-- 
You may reply to this email to add a comment.

You are receiving this mail because:
You are watching the assignee of the bug.

[Bug 220224] Kernel 6.15 causes crash (general protection fault) due to amd_sfh module

[bugzilla-daemon]

https://bugzilla.kernel.org/show_bug.cgi?id=220224

--- Comment #7 from g.molinaro@linuxmail.org ---
I haven't compiled the kernel from source since Slackware 14, so I may need to
refresh my memory, but I'll try to get through those commits as soon as I can.

I don't know what you mean for a "more complete dmesg", the file I attached was
made using `sudo dmesg > dmesg.txt`, if you need something different, please
ask and I'll be happy to comply asap.

I'll fetch the output of `journactl -k -b-1` and the contents of pstore, as
well as any other info, after work. This is my only machine and I need it for
my hob, so testing may take some time, sorry.

Thank you for the timely response.

-- 
You may reply to this email to add a comment.

You are receiving this mail because:
You are watching the assignee of the bug.

[Bug 220224] Kernel 6.15 causes crash (general protection fault) due to amd_sfh module

[bugzilla-daemon]

https://bugzilla.kernel.org/show_bug.cgi?id=220224

--- Comment #8 from g.molinaro@linuxmail.org ---
Quick update.

Before leaving work for launch, I removed the blacklist file and did
`mkinitcpio -P` before shutting down the laptop. I left it connected to the
power supply and left. Upon coming back, I tried to boot into all the installed
kernels: arch-6.15.2, cachyos-6.15.2 and cachyos-lts-6.12.33. And ALL WORKED,
with the amd_sfh module loaded, without issues. Sadly, I was in a hurry and
forgot to save the logs.

Barring some gremlings, nothing had changed in my system (no updates at least),
so I decided to shutdown the PC and unplug it from the wall in order for the EC
to reset at least partially, then powered it back up multiple times, both on
battery and wall power without blacklisting the module. The results are as
follows:

6.15.2-arch1-1 : now boots up without issues (it didn't before);
6.15.2-cashyos-2 : DOES NOT BOOT
6.13.33-lts-cachyos : boots as always.

So it would seems that the issue is now somehow limited (at least for now), to
the cachyos kernel. I have ho idea how or why aarch is now working while it
wasn't before or how they all worked fine the first time.

This time tho, I have updated logs:

- Output of journalctl -k -b -1 for the failed attempt with the cachyos kernel;
- Output of journalctl -k -b for the successful boot with the arch kernel;
- Output of dmesg for the arch kernel;
- Output of dmesg -S for the arch kernel;
- A New screenshot of the kernel panic message with the 6.15.2-cachyos kernel.

More tests to follow...

---
As a side note, I found out there's a BIOS update available for this laptop (I
stopped looking at the website after a couple of years of silence). I have no
idea what it's about, and I'm holding off installing it for the moment not to
invalidate previous testing... but I'm curious if I should just to see if it
changes something. I'm open to suggestions.
---

-- 
You may reply to this email to add a comment.

You are receiving this mail because:
You are watching the assignee of the bug.

[Bug 220224] Kernel 6.15 causes crash (general protection fault) due to amd_sfh module

[bugzilla-daemon]

https://bugzilla.kernel.org/show_bug.cgi?id=220224

--- Comment #9 from g.molinaro@linuxmail.org ---
Created attachment 308243
  --> https://bugzilla.kernel.org/attachment.cgi?id=308243&action=edit
Output of journalctl -k -b-1 for the failed attempt with 6.15.2-cachyos

-- 
You may reply to this email to add a comment.

You are receiving this mail because:
You are watching the assignee of the bug.

[Bug 220224] Kernel 6.15 causes crash (general protection fault) due to amd_sfh module

[bugzilla-daemon]

https://bugzilla.kernel.org/show_bug.cgi?id=220224

--- Comment #10 from g.molinaro@linuxmail.org ---
Created attachment 308244
  --> https://bugzilla.kernel.org/attachment.cgi?id=308244&action=edit
Output of journalctl -k -b for the SUCCESSFUL attempt with 6.15.2-arch

-- 
You may reply to this email to add a comment.

You are receiving this mail because:
You are watching the assignee of the bug.

[Bug 220224] Kernel 6.15 causes crash (general protection fault) due to amd_sfh module

[bugzilla-daemon]

https://bugzilla.kernel.org/show_bug.cgi?id=220224

--- Comment #11 from g.molinaro@linuxmail.org ---
Created attachment 308245
  --> https://bugzilla.kernel.org/attachment.cgi?id=308245&action=edit
Output of dmesg for 6.15.2 arch

-- 
You may reply to this email to add a comment.

You are receiving this mail because:
You are watching the assignee of the bug.

[Bug 220224] Kernel 6.15 causes crash (general protection fault) due to amd_sfh module

[bugzilla-daemon]

https://bugzilla.kernel.org/show_bug.cgi?id=220224

--- Comment #12 from g.molinaro@linuxmail.org ---
Created attachment 308246
  --> https://bugzilla.kernel.org/attachment.cgi?id=308246&action=edit
Output of dmesg -S for 6.15.2-arch

-- 
You may reply to this email to add a comment.

You are receiving this mail because:
You are watching the assignee of the bug.

[Bug 220224] Kernel 6.15 causes crash (general protection fault) due to amd_sfh module

[bugzilla-daemon]

https://bugzilla.kernel.org/show_bug.cgi?id=220224

--- Comment #13 from g.molinaro@linuxmail.org ---
Created attachment 308247
  --> https://bugzilla.kernel.org/attachment.cgi?id=308247&action=edit
Updated Error Screenshot

-- 
You may reply to this email to add a comment.

You are receiving this mail because:
You are watching the assignee of the bug.

[Bug 220224] Kernel 6.15 causes crash (general protection fault) due to amd_sfh module

[bugzilla-daemon]

https://bugzilla.kernel.org/show_bug.cgi?id=220224

--- Comment #14 from Mario Limonciello (AMD) (mario.limonciello@amd.com) ---
Thanks - it looks like your previous boot journal caught the specific crash. 
The specific work function that you got the page fault hasn't actually tangibly
changed in any way in recent kernels.

The crash occurred here:

https://github.com/torvalds/linux/blame/27605c8c0f69e319df156b471974e4e223035378/drivers/hid/amd-sfh-hid/amd_sfh_client.c#L101

> 6.15.2-cashyos-2 : DOES NOT BOOT

Can you double check that CachyOS kernel doesn't patch amd-sfh-hid in any way
relative to upstream?

Another thing that would be helpful to check is boot that kernel with the
blacklist, but then from an ssh console run:

sudo modprobe amd-sfh dyndbg

This will tell more about the sensors that were enumerated, but it won't get us
down to the detail of the problematic sensor.  We can make some debugging
patches to output more information, but it needs to be reliably reproducible..

-- 
You may reply to this email to add a comment.

You are receiving this mail because:
You are watching the assignee of the bug.

[Bug 220224] Kernel 6.15 causes crash (general protection fault) due to amd_sfh module

[bugzilla-daemon]

https://bugzilla.kernel.org/show_bug.cgi?id=220224

--- Comment #15 from g.molinaro@linuxmail.org ---
I will ask downstream about the eventual patches.

For now, I followed your instructions about ssh, the machine went in kernel
panic soon after the modprobe.

I managed to extract a dmesg before the panic, and have the output of
journalctl -k -b-1 after the reboot (into blacklisted).

I hope these will help.

-- 
You may reply to this email to add a comment.

You are receiving this mail because:
You are watching the assignee of the bug.

[Bug 220224] Kernel 6.15 causes crash (general protection fault) due to amd_sfh module

[bugzilla-daemon]

https://bugzilla.kernel.org/show_bug.cgi?id=220224

--- Comment #16 from g.molinaro@linuxmail.org ---
Created attachment 308248
  --> https://bugzilla.kernel.org/attachment.cgi?id=308248&action=edit
Output of journalctl -k -b-1 after modprobe on Working Blacklisted

-- 
You may reply to this email to add a comment.

You are receiving this mail because:
You are watching the assignee of the bug.

[Bug 220224] Kernel 6.15 causes crash (general protection fault) due to amd_sfh module

[bugzilla-daemon]

https://bugzilla.kernel.org/show_bug.cgi?id=220224

--- Comment #17 from g.molinaro@linuxmail.org ---
Sorry, I thought I had the dmesg, but I cannot find the file. The system may
have crashed before the command could be executed via ssh.

-- 
You may reply to this email to add a comment.

You are receiving this mail because:
You are watching the assignee of the bug.

[Bug 220224] Kernel 6.15 causes crash (general protection fault) due to amd_sfh module

[bugzilla-daemon]

https://bugzilla.kernel.org/show_bug.cgi?id=220224

--- Comment #18 from Mario Limonciello (AMD) (mario.limonciello@amd.com) ---
I suspect it's a CachyOS patch.  This sensor doesn't exist upstream today.

giu 13 16:09:57 minos-b5eek kernel: pcie_mp2_amd 0000:08:00.7: sid 0xf
(tablet-mode-switch) status 0x4
giu 13 16:09:57 minos-b5eek kernel: hid-generic 0020:1022:0001.0006: hidraw5:
SENSOR HUB HID v0.00 Device [hid-amdsfh 1022:0001] on pcie_mp2_amd

But it was discussed on the mailing list:
https://lore.kernel.org/linux-input/20250309194934.1759953-1-benato.denis96@gmail.com/

It's probably that sensor causing the problem, and it would explain why it only
happened on CachyOS if they're carrying that patch.

-- 
You may reply to this email to add a comment.

You are receiving this mail because:
You are watching the assignee of the bug.

[Bug 220224] Kernel 6.15 causes crash (general protection fault) due to amd_sfh module

[bugzilla-daemon]

https://bugzilla.kernel.org/show_bug.cgi?id=220224

--- Comment #19 from g.molinaro@linuxmail.org ---
Ok, thank you.

I'll inform downstream and chuck the strange behaviour of this morning into the
"Gremlings and Black Magic" bin of MSI's UEFI/EC firmware. It won't be alone in
there.

At least I know I'm not losing anything by running with the module blacklisted.

Do you think updating the BIOS is advisable at this point? 
(The update is from November 2024, but as usual there is zero documentation
about it.)

Again, thank you for your time and patience.

-- 
You may reply to this email to add a comment.

You are receiving this mail because:
You are watching the assignee of the bug.

[Bug 220224] Kernel 6.15 causes crash (general protection fault) due to amd_sfh module

[bugzilla-daemon]

https://bugzilla.kernel.org/show_bug.cgi?id=220224

--- Comment #20 from g.molinaro@linuxmail.org ---
And yes, downstream is patching that module.
https://github.com/CachyOS/linux-cachyos/issues/483#issuecomment-2970669001

-- 
You may reply to this email to add a comment.

You are receiving this mail because:
You are watching the assignee of the bug.

[Bug 220224] Kernel 6.15 causes crash (general protection fault) due to amd_sfh module

[bugzilla-daemon]

https://bugzilla.kernel.org/show_bug.cgi?id=220224

--- Comment #21 from Mario Limonciello (AMD) (mario.limonciello@amd.com) ---
> And yes, downstream is patching that module.
> https://github.com/CachyOS/linux-cachyos/issues/483#issuecomment-2970669001

OK - work with them to see if the downstream patches are causing the problem. 
If so we can close this bug here.  If it's happening in an "unpatched" distro
kernel let's get dynamic debug output from that as well.

> Do you think updating the BIOS is advisable at this point? 
(The update is from November 2024, but as usual there is zero documentation
about it.)

Generally speaking; BIOS updates on AMD are a good idea.  Security
vulnerabilities get fixed, performance improvements etc.  But if it's it your
only machine, totally your call.

-- 
You may reply to this email to add a comment.

You are receiving this mail because:
You are watching the assignee of the bug.

[Bug 220224] Kernel 6.15 causes crash (general protection fault) due to amd_sfh module

[bugzilla-daemon]

https://bugzilla.kernel.org/show_bug.cgi?id=220224

--- Comment #22 from g.molinaro@linuxmail.org ---
Ok, I will work with downstream and forward eventual results here. 

My only concern about the BIOS update is about tainting the testing enviroment
for this bug. I will delay it for now, along with other OS updates, at least
until I'm finished testing with downstream. Thanks.

-- 
You may reply to this email to add a comment.

You are receiving this mail because:
You are watching the assignee of the bug.

[Bug 220224] Kernel 6.15 causes crash (general protection fault) due to amd_sfh module

[bugzilla-daemon]

https://bugzilla.kernel.org/show_bug.cgi?id=220224

--- Comment #23 from g.molinaro@linuxmail.org ---
So, I've been trying a kernel with this
https://lore.kernel.org/linux-input/57eb65bc-f710-4c86-ad0e-7473cc6db135@amd.com/
(provided by downstream) for a few hours and it works.
I suspect this can be closed.

Thank you and keep up the good work.

-- 
You may reply to this email to add a comment.

You are receiving this mail because:
You are watching the assignee of the bug.

[Bug 220224] Kernel 6.15 causes crash (general protection fault) due to amd_sfh module

[bugzilla-daemon]

https://bugzilla.kernel.org/show_bug.cgi?id=220224

Mario Limonciello (AMD) (mario.limonciello@amd.com) changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |RESOLVED
         Resolution|---                         |DISTRO_KERNEL

--- Comment #24 from Mario Limonciello (AMD) (mario.limonciello@amd.com) ---
OK thanks!  This was actually really good; it's valid issue on the patch that
is on it's way upstream.  I'll close the bug tracker, and we shouldn't merge
upstream until it's fixed.

-- 
You may reply to this email to add a comment.

You are receiving this mail because:
You are watching the assignee of the bug.