[Intel-wired-lan] Bug report: Intel ICE driver

[Intel-wired-lan] Bug report: Intel ICE driver

[Nebojsa Stevanovic]

[-- Attachment #1.1: Type: text/plain, Size: 1914 bytes --]

Dear maintainers,

We are experiencing issues with RX/TX counters on Intel NIC's using ICE driver.
We started experiencing issues from kernel 6.2 onwards (6.3.5 also). We use vanilla kernel on Ubuntu 22.04 servers.

I've attached two screenshots of grafana dashboard - one showing metrics collected from firmware using ethtool, another collected from kernel (netlink or /proc/net/dev). As you can see, there are spikes showing over 400Tb/s received. We tried collecting metrics with different tools/scripts just to be sure that our collecting is not faulty, but the behaviour is same.

Using proprietary drivers is not easy, since they are not up to date with the mainline kernel development and we are facing many issues during compilation.

How to reproduce: Installing server with Ubuntu 22.04 and Intel NIC from E810 series. It happens more often on high traffic, but not exclusive.

Please let me know if I can provide any more information.

Regards,
Nebojša
[https://my.gcdn.co/images/web_3253/logo_g.png]<https://gcorelabs.com/>
Nebojsa Stevanovic


Systems Engineer

nebojsa.stevanovic@gcore.com<mailto:nebojsa.stevanovic@gcore.com>
+381642677153<tel:+381642677153>
gcore.com<https://gcore.com/>
[https://my.gcdn.co/images/web_3253/face.png]<https://www.facebook.com/gcorelabscom/>   [https://my.gcdn.co/images/web_3253/in.png] <https://www.linkedin.com/company/g-core>   [https://my.gcdn.co/images/web_3253/yout.png] <https://www.youtube.com/channel/UCFhtQE7HB097a1_Nfv-Ma_Q>        [https://my.gcdn.co/images/web_3253/weib.png] <https://www.weibo.com/p/1005056986184457>




This message is intended solely for the addressee and may contain confidential information. If you have received this message in error, please send it back to us, and immediately and permanently delete it. Do not use, copy or disclose the information contained in this message or in any attachment.

[-- Attachment #1.2: Type: text/html, Size: 10025 bytes --]

[-- Attachment #2: ethtool_scrape.png --]
[-- Type: image/png, Size: 123259 bytes --]

[-- Attachment #3: kernel_driver_scrape.png --]
[-- Type: image/png, Size: 147674 bytes --]

[-- Attachment #4: Type: text/plain, Size: 162 bytes --]

_______________________________________________
Intel-wired-lan mailing list
Intel-wired-lan@osuosl.org
https://lists.osuosl.org/mailman/listinfo/intel-wired-lan

Re: [Intel-wired-lan] Bug report: Intel ICE driver

[Przemek Kitszel]

On 7/4/23 10:50, Nebojsa Stevanovic wrote:
> Dear maintainers,
> 
> We are experiencing issues with RX/TX counters on Intel NIC's using ICE 
> driver.
> We started experiencing issues from kernel 6.2 onwards (6.3.5 also). We 
> use vanilla kernel on Ubuntu 22.04 servers.

Thank you for the report, I will take a look, we will also try to 
reproduce it locally.

> 
> I've attached two screenshots of grafana dashboard - one showing metrics 
> collected from firmware using ethtool, another collected from kernel 
> (netlink or /proc/net/dev). As you can see, there are spikes showing 
> over 400Tb/s received. We tried collecting metrics with different 
> tools/scripts just to be sure that our collecting is not faulty, but the 
> behaviour is same.
> 
> Using proprietary drivers is not easy, since they are not up to date 
> with the mainline kernel development and we are facing many issues 
> during compilation.
> 
> How to reproduce: Installing server with Ubuntu 22.04 and Intel NIC 
> from E810 series. It happens more often on high traffic, but not exclusive.
> 
> Please let me know if I can provide any more information.

Usually output of the `dmesg` command is attached for bug reports, 
please make sure that you ran the command a moment after the bug pops up.

> 
> Regards,
> Nebojša
> GCORE <https://gcorelabs.com/> 	
> *Nebojsa Stevanovic*
> Systems Engineer
> nebojsa.stevanovic@gcore.com <mailto:nebojsa.stevanovic@gcore.com>
> +381642677153 <tel:+381642677153>
> gcore.com <https://gcore.com/>
> <https://www.facebook.com/gcorelabscom/> 
> <https://www.linkedin.com/company/g-core> 
> <https://www.youtube.com/channel/UCFhtQE7HB097a1_Nfv-Ma_Q> 
> <https://www.weibo.com/p/1005056986184457>
> 
> This message is intended solely for the addressee and may contain 
> confidential information. If you have received this message in error, 
> please send it back to us, and immediately and permanently delete it. Do 
> not use, copy or disclose the information contained in this message or 
> in any attachment.
> 
> 
> _______________________________________________
> Intel-wired-lan mailing list
> Intel-wired-lan@osuosl.org
> https://lists.osuosl.org/mailman/listinfo/intel-wired-lan

Thanks,
Przemek
_______________________________________________
Intel-wired-lan mailing list
Intel-wired-lan@osuosl.org
https://lists.osuosl.org/mailman/listinfo/intel-wired-lan