[ANN] Google's Netdev-CI for IDPF and GVE

[ANN] Google's Netdev-CI for IDPF and GVE

[Sheena Mohan]

Hi everyone,

We are happy to share that Netdev-CI testing on both IDPF (running on
Google Bare Metal) and GVE (running on Google Virtual Machines) is now
up and running.
This NIPA integration work enables executing kselftests against the
current proposed net-next kernel branch on real hardware.

Thanks to Danny, Max, and Pin-yen for their contributions!

The test results and logs are available in:

IDPF Results: https://idpf-netdev-nipa.static.usercontent.goog/json/results.json
GVE Results: https://gve-netdev-nipa.static.usercontent.goog/json/results.json

Thanks,
Sheena Mohan

Re: [ANN] Google's Netdev-CI for IDPF and GVE

[Jakub Kicinski]

On Fri, 29 May 2026 13:44:48 -0700 Sheena Mohan wrote:
> We are happy to share that Netdev-CI testing on both IDPF (running on
> Google Bare Metal) and GVE (running on Google Virtual Machines) is now
> up and running.
> This NIPA integration work enables executing kselftests against the
> current proposed net-next kernel branch on real hardware.
> 
> Thanks to Danny, Max, and Pin-yen for their contributions!
> 
> The test results and logs are available in:
> 
> IDPF Results: https://idpf-netdev-nipa.static.usercontent.goog/json/results.json
> GVE Results: https://gve-netdev-nipa.static.usercontent.goog/json/results.json

Awesome stuff! Pulling the results now.

Re: [ANN] Google's Netdev-CI for IDPF and GVE

[Jakub Kicinski]

On Fri, 29 May 2026 13:59:38 -0700 Jakub Kicinski wrote:
> On Fri, 29 May 2026 13:44:48 -0700 Sheena Mohan wrote:
> > We are happy to share that Netdev-CI testing on both IDPF (running on
> > Google Bare Metal) and GVE (running on Google Virtual Machines) is now
> > up and running.
> > This NIPA integration work enables executing kselftests against the
> > current proposed net-next kernel branch on real hardware.
> > 
> > Thanks to Danny, Max, and Pin-yen for their contributions!
> > 
> > The test results and logs are available in:
> > 
> > IDPF Results: https://idpf-netdev-nipa.static.usercontent.goog/json/results.json
> > GVE Results: https://gve-netdev-nipa.static.usercontent.goog/json/results.json  
> 
> Awesome stuff! Pulling the results now.

Hi! You seem to be pulling the wrong branch stream. Please switch to:

https://netdev.bots.linux.dev/contest/branches-hw.json

Re: [ANN] Google's Netdev-CI for IDPF and GVE

[Sheena Mohan]

Thank you Jakub. Our latest results should use the correct branch.

On Mon, Jun 1, 2026 at 8:04 AM Jakub Kicinski <kuba@kernel.org> wrote:
>
> On Fri, 29 May 2026 13:59:38 -0700 Jakub Kicinski wrote:
> > On Fri, 29 May 2026 13:44:48 -0700 Sheena Mohan wrote:
> > > We are happy to share that Netdev-CI testing on both IDPF (running on
> > > Google Bare Metal) and GVE (running on Google Virtual Machines) is now
> > > up and running.
> > > This NIPA integration work enables executing kselftests against the
> > > current proposed net-next kernel branch on real hardware.
> > >
> > > Thanks to Danny, Max, and Pin-yen for their contributions!
> > >
> > > The test results and logs are available in:
> > >
> > > IDPF Results: https://idpf-netdev-nipa.static.usercontent.goog/json/results.json
> > > GVE Results: https://gve-netdev-nipa.static.usercontent.goog/json/results.json
> >
> > Awesome stuff! Pulling the results now.
>
> Hi! You seem to be pulling the wrong branch stream. Please switch to:
>
> https://netdev.bots.linux.dev/contest/branches-hw.json

Re: [ANN] Google's Netdev-CI for IDPF and GVE

[Jakub Kicinski]

On Fri, 29 May 2026 13:44:48 -0700 Sheena Mohan wrote:
> Hi everyone,
> 
> We are happy to share that Netdev-CI testing on both IDPF (running on
> Google Bare Metal) and GVE (running on Google Virtual Machines) is now
> up and running.
> This NIPA integration work enables executing kselftests against the
> current proposed net-next kernel branch on real hardware.
> 
> Thanks to Danny, Max, and Pin-yen for their contributions!
> 
> The test results and logs are available in:
> 
> IDPF Results: https://idpf-netdev-nipa.static.usercontent.goog/json/results.json
> GVE Results: https://gve-netdev-nipa.static.usercontent.goog/json/results.json

Hi Sheena!

The Google runners do not report device info. The results should
contain a "device" object that identifies external components that
may cause regressions (like device FW version), see:
https://github.com/linux-netdev/nipa/wiki/Netdev-CI-system/#device-information
In practice the main use we currently have for it is to auto-categorize
the results as executing on a real driver rather than netdevsim.

Re: [ANN] Google's Netdev-CI for IDPF and GVE

[Sheena Mohan]

Thank you Jakub. Just wanted to share that we are working on exposing
devlink info for both GVE and IDPF drivers.


On Fri, Jun 19, 2026 at 11:59 AM Jakub Kicinski <kuba@kernel.org> wrote:
>
> On Fri, 29 May 2026 13:44:48 -0700 Sheena Mohan wrote:
> > Hi everyone,
> >
> > We are happy to share that Netdev-CI testing on both IDPF (running on
> > Google Bare Metal) and GVE (running on Google Virtual Machines) is now
> > up and running.
> > This NIPA integration work enables executing kselftests against the
> > current proposed net-next kernel branch on real hardware.
> >
> > Thanks to Danny, Max, and Pin-yen for their contributions!
> >
> > The test results and logs are available in:
> >
> > IDPF Results: https://idpf-netdev-nipa.static.usercontent.goog/json/results.json
> > GVE Results: https://gve-netdev-nipa.static.usercontent.goog/json/results.json
>
> Hi Sheena!
>
> The Google runners do not report device info. The results should
> contain a "device" object that identifies external components that
> may cause regressions (like device FW version), see:
> https://github.com/linux-netdev/nipa/wiki/Netdev-CI-system/#device-information
> In practice the main use we currently have for it is to auto-categorize
> the results as executing on a real driver rather than netdevsim.

Re: [ANN] Google's Netdev-CI for IDPF and GVE

[Jakub Kicinski]

On Thu, 16 Jul 2026 16:15:35 -0700 Sheena Mohan wrote:
> Thank you Jakub. Just wanted to share that we are working on exposing
> devlink info for both GVE and IDPF drivers.

Hm, but please don't expose kernel version as running.
It will spam the aggregations which compare "platform changes"
with a different version every week for no real reason.

We know exactly which kernel was run for each test, 
so it's also useless info.

Re: [ANN] Google's Netdev-CI for IDPF and GVE

[Sheena Mohan]

On Tue, Aug 4, 2026 at 7:17 AM Jakub Kicinski <kuba@kernel.org> wrote:
>
> On Thu, 16 Jul 2026 16:15:35 -0700 Sheena Mohan wrote:
> > Thank you Jakub. Just wanted to share that we are working on exposing
> > devlink info for both GVE and IDPF drivers.
>
> Hm, but please don't expose kernel version as running.
> It will spam the aggregations which compare "platform changes"
> with a different version every week for no real reason.
>
> We know exactly which kernel was run for each test,
> so it's also useless info.
Thanks Jakub.  Device information for both GVE and IDPF is updated.
Following your suggestion, we removed the kernel version from the reported info.

Re: [ANN] Google's Netdev-CI for IDPF and GVE

[Jakub Kicinski]

On Wed, 12 Aug 2026 13:56:51 -0700 Sheena Mohan wrote:
> On Tue, Aug 4, 2026 at 7:17 AM Jakub Kicinski <kuba@kernel.org> wrote:
> >
> > On Thu, 16 Jul 2026 16:15:35 -0700 Sheena Mohan wrote:  
> > > Thank you Jakub. Just wanted to share that we are working on exposing
> > > devlink info for both GVE and IDPF drivers.  
> >
> > Hm, but please don't expose kernel version as running.
> > It will spam the aggregations which compare "platform changes"
> > with a different version every week for no real reason.
> >
> > We know exactly which kernel was run for each test,
> > so it's also useless info.  
> Thanks Jakub.  Device information for both GVE and IDPF is updated.
> Following your suggestion, we removed the kernel version from the reported info.

Thanks! Looks reasonable now.

BTW I noted that the branches tested are a bit spotty.
The gve manifest only has results for around 33% of the branches 
over the last 3 days. Some of the results are nul so the run hasn't
completed.

idpf runner looks better but is also missing around one branch a day.

Is this something you're tracking?

Re: [ANN] Google's Netdev-CI for IDPF and GVE

[Jakub Kicinski]

On Wed, 12 Aug 2026 14:54:22 -0700 Jakub Kicinski wrote:
> BTW I noted that the branches tested are a bit spotty.
> The gve manifest only has results for around 33% of the branches 
> over the last 3 days. Some of the results are nul so the run hasn't
> completed.

To be clear -- some of the results are nul, but majority of the missing
branches are completely missing.

> idpf runner looks better but is also missing around one branch a day.
> 
> Is this something you're tracking?

Re: [ANN] Google's Netdev-CI for IDPF and GVE

[Sheena Mohan]

On Wed, Aug 12, 2026 at 3:43 PM Jakub Kicinski <kuba@kernel.org> wrote:
>
> On Wed, 12 Aug 2026 14:54:22 -0700 Jakub Kicinski wrote:
> > BTW I noted that the branches tested are a bit spotty.
> > The gve manifest only has results for around 33% of the branches
> > over the last 3 days. Some of the results are nul so the run hasn't
> > completed.
>
> To be clear -- some of the results are nul, but majority of the missing
> branches are completely missing.
>
> > idpf runner looks better but is also missing around one branch a day.
> >
> > Is this something you're tracking?
Thanks Jakub. We fixed this previously but the issue seems to have
resurfaced. We will look into it.