loop on reset adapter with ixgbe

loop on reset adapter with ixgbe

[William Dauchy]

[-- Attachment #1: Type: text/plain, Size: 836 bytes --]

Hi,

On some machines with a network card named
"Intel Corporation 82599EB 10-Gigabit SFI/SFP+"

At boot time, I'm getting an infinite loop showing these messages:

ixgbe 0000:03:00.0 eth0: initiating reset to clear Tx work after link loss
ixgbe 0000:03:00.0 eth0: Reset adapter
ixgbe 0000:03:00.0 eth0: detected SFP+: 3

ethtool info:
driver: ixgbe
version: 3.8.21-k
firmware-version: 0x00000000

I'm using the last linux stable branch v3.10.x.

I need to unplug/plug the network/cable (a twinax cable) several times to
stabilize the situation and get some network.
I was wondering if I should consider this as a driver/firmware bug or if I
should look for a physical issue (I changed the physical cable several times).
Or do you need some more info to help understand this issue?

Best regards,
-- 
William

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 198 bytes --]

RE: loop on reset adapter with ixgbe

[Skidmore, Donald C]

Hey William,

Thanks for letting know what you're running into, however I don't remember ever seeing a failure quite like this.  I'm wondering if it is something we might have fixed in later versions of the driver.  By any chance could you see if you get the same failure with the latest source forge driver?  It will make it easier to track down if we are looking for something we already fix or a new problem altogether.

Thanks,
-Don Skidmore <donald.c.skidmore@intel.com>

> -----Original Message-----
> From: netdev-owner@vger.kernel.org [mailto:netdev-
> owner@vger.kernel.org] On Behalf Of William Dauchy
> Sent: Wednesday, November 20, 2013 10:25 AM
> To: netdev@vger.kernel.org
> Cc: Keller, Jacob E; Fastabend, John R; Tantilov, Emil S; Potenza, Leonardo
> Subject: loop on reset adapter with ixgbe
> 
> Hi,
> 
> On some machines with a network card named "Intel Corporation 82599EB
> 10-Gigabit SFI/SFP+"
> 
> At boot time, I'm getting an infinite loop showing these messages:
> 
> ixgbe 0000:03:00.0 eth0: initiating reset to clear Tx work after link loss ixgbe
> 0000:03:00.0 eth0: Reset adapter ixgbe 0000:03:00.0 eth0: detected SFP+: 3
> 
> ethtool info:
> driver: ixgbe
> version: 3.8.21-k
> firmware-version: 0x00000000
> 
> I'm using the last linux stable branch v3.10.x.
> 
> I need to unplug/plug the network/cable (a twinax cable) several times to
> stabilize the situation and get some network.
> I was wondering if I should consider this as a driver/firmware bug or if I
> should look for a physical issue (I changed the physical cable several times).
> Or do you need some more info to help understand this issue?
> 
> Best regards,
> --
> William

RE: loop on reset adapter with ixgbe

[Skidmore, Donald C]

> -----Original Message-----
> From: netdev-owner@vger.kernel.org [mailto:netdev-
> owner@vger.kernel.org] On Behalf Of William Dauchy
> Sent: Wednesday, November 20, 2013 10:25 AM
> To: netdev@vger.kernel.org
> Cc: Keller, Jacob E; Fastabend, John R; Tantilov, Emil S; Potenza, Leonardo
> Subject: loop on reset adapter with ixgbe
> 
> Hi,
> 
> On some machines with a network card named "Intel Corporation 82599EB
> 10-Gigabit SFI/SFP+"
> 
> At boot time, I'm getting an infinite loop showing these messages:
> 
> ixgbe 0000:03:00.0 eth0: initiating reset to clear Tx work after link loss ixgbe
> 0000:03:00.0 eth0: Reset adapter ixgbe 0000:03:00.0 eth0: detected SFP+: 3
> 
> ethtool info:
> driver: ixgbe
> version: 3.8.21-k
> firmware-version: 0x00000000
> 
> I'm using the last linux stable branch v3.10.x.
> 
> I need to unplug/plug the network/cable (a twinax cable) several times to
> stabilize the situation and get some network.
> I was wondering if I should consider this as a driver/firmware bug or if I
> should look for a physical issue (I changed the physical cable several times).
> Or do you need some more info to help understand this issue?
> 
> Best regards,
> --
> William

I also just noticed your firmware looks in correct.  What is the DevID for your device?  Likewise do you have another NIC and if so could you check it's firmware-version?

Thanks,
-Don Skidmore <donald.c.skidmore@intel.com>

Re: loop on reset adapter with ixgbe

[William Dauchy]

[-- Attachment #1: Type: text/plain, Size: 642 bytes --]

Hi,

Thank you for your quick reply.

On Nov20 18:53, Skidmore, Donald C wrote:
> Thanks for letting know what you're running into, however I don't remember ever seeing a failure quite like this.  I'm wondering if it is something we might have fixed in later versions of the driver.  By any chance could you see if you get the same failure with the latest source forge driver?  It will make it easier to track down if we are looking for something we already fix or a new problem altogether.

I am unfortunately getting the same result with ixgbe 3.18.7 compiled
with a linux kernel v3.10.x

Sorry for my late answer,
-- 
William

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 198 bytes --]

Re: loop on reset adapter with ixgbe

[William Dauchy]

[-- Attachment #1: Type: text/plain, Size: 396 bytes --]

On Nov20 18:58, Skidmore, Donald C wrote:
> I also just noticed your firmware looks in correct.  What is the DevID for your device?

might be a stupid question, but which id are you talking about? How can
I get it?

> Likewise do you have another NIC and if so could you check it's firmware-version?

I have some NIC with the same firmware without any problem.

Regards,
-- 
William

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 198 bytes --]

RE: loop on reset adapter with ixgbe

[Tantilov, Emil S]

Could you please send the complete output from dmesg along with the stats (ethtool -S) from the interface and also your .config from your kernel?

You can send the attachments directly to me or Don, or better yet open a bug at e1000.sf.net if possible.

Thanks,
Emil

>-----Original Message-----
>From: William Dauchy [mailto:william@gandi.net]
>Sent: Tuesday, November 26, 2013 5:04 AM
>To: Skidmore, Donald C
>Cc: William Dauchy; netdev@vger.kernel.org; Keller, Jacob E;
>Fastabend, John R; Tantilov, Emil S; Potenza, Leonardo
>Subject: Re: loop on reset adapter with ixgbe
>
>On Nov20 18:58, Skidmore, Donald C wrote:
>> I also just noticed your firmware looks in correct.  What
>is the DevID for your device?
>
>might be a stupid question, but which id are you talking
>about? How can
>I get it?
>
>> Likewise do you have another NIC and if so could you check
>it's firmware-version?
>
>I have some NIC with the same firmware without any problem.
>
>Regards,
>--
>William

FW: loop on reset adapter with ixgbe

[Skidmore, Donald C]

From: Skidmore, Donald C 
Sent: Tuesday, November 26, 2013 11:00 AM
To: 'William Dauchy'
Cc: netdev@vger.kernel.org; Keller, Jacob E; Fastabend, John R; Tantilov, Emil S; Potenza, Leonardo
Subject: RE: loop on reset adapter with ixgbe


Hey William,

A quick why to get the device ID would be to:

First get the PCIe bus address from "ethtool -I <port>"

[root@dcsworkstation src]# ethtool -i p258p1
driver: ixgbe
version: 3.11.33-k
firmware-version: 0x18eb0001
bus-info: 0000:05:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: yes
supports-register-dump: yes
supports-priv-flags: no

Then use that address to find the device ID:

[root@dcsworkstation src]# lspci -ns 0000:05:00.0
05:00.0 0200: 8086:10fb (rev 01)


As for the FW version I'm concerned that yours might not be correct from the output you sent me earlier.

> ethtool info:
> driver: ixgbe
> version: 3.8.21-k
> firmware-version: 0x00000000

This doesn't look correct to me I will poke our FW folks to verify.  It may be worthwhile to dump the FW and send it to me (i.e. ethtool -eeprom-dump).

Thanks,
-Don

p.s. I'm about to be out of the office until Tuesday of next week and am not sure I'll be able to get to my email so I might be slow in a reply.  :(




> -----Original Message-----
> From: William Dauchy [mailto:william@gandi.net]
> Sent: Tuesday, November 26, 2013 5:04 AM
> To: Skidmore, Donald C
> Cc: William Dauchy; netdev@vger.kernel.org; Keller, Jacob E; Fastabend,
> John R; Tantilov, Emil S; Potenza, Leonardo
> Subject: Re: loop on reset adapter with ixgbe
> 
> On Nov20 18:58, Skidmore, Donald C wrote:
> > I also just noticed your firmware looks in correct.  What is the DevID for
> your device?
> 
> might be a stupid question, but which id are you talking about? How can I get
> it?
> 
> > Likewise do you have another NIC and if so could you check it's firmware-
> version?
> 
> I have some NIC with the same firmware without any problem.
> 
> Regards,
> --
> William

Re: loop on reset adapter with ixgbe

[William Dauchy]

[-- Attachment #1: Type: text/plain, Size: 805 bytes --]

Hi Skidmore,

Sorry for the late answer, I needed to wait for a physical access.

On Nov26 18:59, Skidmore, Donald C wrote:
> [root@dcsworkstation src]# ethtool -i p258p1
> driver: ixgbe
> version: 3.11.33-k
> firmware-version: 0x18eb0001
> bus-info: 0000:05:00.0
> supports-statistics: yes
> supports-test: yes
> supports-eeprom-access: yes
> supports-register-dump: yes
> supports-priv-flags: no
> 
> Then use that address to find the device ID:
> 
> [root@dcsworkstation src]# lspci -ns 0000:05:00.0
> 05:00.0 0200: 8086:10fb (rev 01)

for me it is:
03:00.0 0200: 8086:10fb (rev 01)

> As for the FW version I'm concerned that yours might not be correct from the output you sent me earlier.

or might be a userland issue (ethtool not reading the correct part?)
-- 
William

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 198 bytes --]

Re: loop on reset adapter with ixgbe

[William Dauchy]

[-- Attachment #1: Type: text/plain, Size: 223 bytes --]

On Nov26 18:47, Tantilov, Emil S wrote:
> Could you please send the complete output from dmesg along with the stats (ethtool -S) from the interface and also your .config from your kernel?

sent privately.
-- 
William

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 198 bytes --]