Re: iwlwifi devices disappear after suspend on kernel 5.17

["Toke Høiland-Jørgensen" <toke@toke.dk>]

"Grumbach, Emmanuel" <emmanuel.grumbach@intel.com> writes:

> On Tue, 2022-04-19 at 22:58 +0200, Toke Høiland-Jørgensen wrote:
>> "Grumbach, Emmanuel" <emmanuel.grumbach@intel.com> writes:
>> 
>> > On Tue, 2022-04-19 at 20:46 +0300, Grumbach, Emmanuel wrote:
>> > > On Tue, 2022-04-19 at 13:33 +0200, Toke Høiland-Jørgensen wrote:
>> > > > "Grumbach, Emmanuel" <emmanuel.grumbach@intel.com> writes:
>> > > > 
>> > > > > On Tue, 2022-04-19 at 09:41 +0300, Grumbach, Emmanuel wrote:
>> > > > > > Hi Toke,
>> > > > > > 
>> > > > > > On Tue, 2022-04-19 at 06:24 +0000, Coelho, Luciano wrote:
>> > > > > > > On Mon, 2022-04-18 at 13:36 +0200, Toke Høiland-Jørgensen wrote:
>> > > > > > > > Hi Luca
>> > > > > > > 
>> > > > > > > Hi Toke,
>> > > > > > > 
>> > > > > > > > I've started seeing issues with my iwlwifi interface going away after
>> > > > > > > > suspend. I get errors like these in dmesg:
>> > > > > > > > 
>> > > > > > > > [104393.142264] wlan0: deauthenticating from 4c:60:de:ea:b8:58 by local choice
>> > > > > > > > (Reason:
>> > > > > > > > 3=DEAUTH_LEAVING)
>> > > > > > > > [104393.347775] iwlmei 0000:00:16.0-13280904-7792-4fcb-a1aa-5e70cbb1e865: Couldn't
>> > > > > > > > get
>> > > > > > > > ACK
>> > > > > > > > from
>> > > > > > > > CSME on HOST_GOES_DOWN message
>> > > > > > > > [104393.347876] iwlmei 0000:00:16.0-13280904-7792-4fcb-a1aa-5e70cbb1e865: failed to
>> > > > > > > > send
>> > > > > > > > the
>> > > > > > > > SAP_ME_MSG_CHECK_SHARED_AREA message -19
>> > > > > > > > 
>> > > > > > > > And when the host comes back up, there is no connectivity. Restarting
>> > > > > > > > iwd fixes the problem.
>> > > > > > > > 
>> > > > > > > > This is on a 5.17.3 kernel (Arch Linux distribution kernel), and lspci
>> > > > > > > > says the WiFi device is an "Intel Corporation Wi-Fi 6 AX201".
>> > > > > > > > 
>> > > > > > > > Any ideas? :)
>> > > > > > > 
>> > > > > > > This seems to be related to iwlmei, so I added Emmanuel to the thread.
>> > > > > > > 
>> > > > > > 
>> > > > > > Can we have the full dmesg output?
>> > > > > > What NIC / platform do you have?
>> > > > > > Do you have AMT configured in the BIOS?
>> > > > > > Did you enable wireless operation in AMT?
>> > > > > 
>> > > > > Ah - this is AX201, ok, but I still need the platform and thefull dmesg :-)
>> > > > 
>> > > > It's a Lenovo ThinkPad X1 Carbon Gen 9, model 20XXS3HC26; AMT is set to
>> > > > "Disabled" in the BIOS. I rebooted and did a suspend/wake cycle after
>> > > > connecting to the WiFi network, which produced the dmesg below.
>> > > 
>> > > Thanks.
>> > > This is a Skylake platform and we didn't have a handshake with CSME which is not enabled. We
>> > > are
>> > > missing a check before we shut down iwlmei.
>> > 
>> > Hm... no, that seems to be 11th generation... so TigerLake?
>> > But still, the fix below seems relevant.
>> 
>> Hmm, tried the patch and the message is still there (as is the bug)...
>> The error code is different now, though:
>> 
>> [   65.773731] wlan0: deauthenticating from 4c:60:de:ea:b8:5a by local choice (Reason:
>> 3=DEAUTH_LEAVING)
>> [   65.973767] iwlmei 0000:00:16.0-13280904-7792-4fcb-a1aa-5e70cbb1e865: Couldn't get ACK from
>> CSME on HOST_GOES_DOWN message
>> [   65.973845] iwlmei 0000:00:16.0-13280904-7792-4fcb-a1aa-5e70cbb1e865: failed to send the
>> SAP_ME_MSG_CHECK_SHARED_AREA message -14
>> 
>
> So you do get a SAP connection. Weird.
> Checking with the CSME guys.
> Can you get dynamic debug prints for iwlmei module?
> Best would be tracing with -e iwlmei_sap_cmd

Sure! Recorded these while doing a suspend-restore, then restarting iwd:

  kworker/u16:34-34555 [004] 46452.506238: iwlmei_sap_cmd:       sap_cmd Tx: type 1010 len 8 seq 11
  kworker/u16:34-34555 [004] 46452.506243: iwlmei_me_msg:        ME message: Tx: type 3 seq 8
  kworker/u16:34-34555 [004] 46452.559407: iwlmei_sap_cmd:       sap_cmd Tx: type 1001 len 4 seq 12
  kworker/u16:14-33311 [004] 46452.573077: iwlmei_sap_cmd:       sap_cmd Tx: type 1006 len 0 seq 13
  kworker/u16:14-33311 [004] 46452.573078: iwlmei_me_msg:        ME message: Tx: type 3 seq 10
     kworker/4:0-34305 [004] 46452.706737: iwlmei_me_msg:        ME message: Tx: type 3 seq 11
   kworker/u16:8-34462 [000] 46457.939453: iwlmei_me_msg:        ME message: Tx: type 1 seq 1
     kworker/4:2-32196 [004] 46457.940910: iwlmei_me_msg:        ME message: Rx: type 2 seq 81
     kworker/4:2-32196 [004] 46457.940912: iwlmei_sap_cmd:       sap_cmd Tx: type 1013 len 0 seq 1
     kworker/4:2-32196 [004] 46457.940913: iwlmei_me_msg:        ME message: Tx: type 3 seq 2
     kworker/4:2-32196 [004] 46457.942056: iwlmei_me_msg:        ME message: Rx: type 3 seq 82
     kworker/4:2-32196 [004] 46457.942060: iwlmei_sap_cmd:       sap_cmd Rx: type 502 len 4 seq 1
     kworker/4:2-32196 [004] 46458.042205: iwlmei_me_msg:        ME message: Rx: type 3 seq 83
     kworker/4:2-32196 [004] 46458.042208: iwlmei_sap_cmd:       sap_cmd Rx: type 500 len 1896 seq 2
     kworker/4:2-32196 [004] 46458.042209: iwlmei_sap_cmd:       sap_cmd Rx: type 512 len 64 seq 3
     kworker/4:2-32196 [004] 46458.042214: iwlmei_sap_cmd:       sap_cmd Rx: type 502 len 4 seq 4
             iwd-35396 [003] 46467.085642: iwlmei_sap_cmd:       sap_cmd Tx: type 1008 len 8 seq 2
             iwd-35396 [003] 46467.085645: iwlmei_me_msg:        ME message: Tx: type 3 seq 3
             iwd-35396 [003] 46467.102818: iwlmei_sap_cmd:       sap_cmd Tx: type 1008 len 8 seq 3
             iwd-35396 [003] 46467.103369: iwlmei_sap_cmd:       sap_cmd Tx: type 1016 len 20 seq 4
             iwd-35396 [003] 46467.103842: iwlmei_sap_cmd:       sap_cmd Tx: type 1001 len 4 seq 5
             iwd-35396 [003] 46467.104689: iwlmei_sap_cmd:       sap_cmd Tx: type 1002 len 12 seq 6

The dmesg log looked like this (back to -19 in the error):

[46452.483343] wlan0: deauthenticating from 4c:60:de:ea:b8:5a by local choice (Reason: 3=DEAUTH_LEAVING)
[46452.689465] iwlmei 0000:00:16.0-13280904-7792-4fcb-a1aa-5e70cbb1e865: Couldn't get ACK from CSME on HOST_GOES_DOWN message
[46452.689567] iwlmei 0000:00:16.0-13280904-7792-4fcb-a1aa-5e70cbb1e865: failed to send the SAP_ME_MSG_CHECK_SHARED_AREA message -19

> I might also need dynamic debgug prints from the mei bus driver but that will be for later.
> Thanks for reporting and providing the data!

You're welcome! Thanks for looking into it :)

-Toke