[linux-next:master] [selftest] 236156d80d: kernel-selftests.drivers/net/netdevsim.devlink.sh.rate_test.fail

[linux-next:master] [selftest] 236156d80d: kernel-selftests.drivers/net/netdevsim.devlink.sh.rate_test.fail

[kernel test robot]

Hello,

kernel test robot noticed "kernel-selftests.drivers/net/netdevsim.devlink.sh.rate_test.fail" on:

commit: 236156d80d5efd942fc395a078d6ec6d810c2c40 ("selftest: netdevsim: Add devlink rate tc-bw test")
https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master

[test failed on linux-next/master 97987520025658f30bb787a99ffbd9bbff9ffc9d]

in testcase: kernel-selftests
version: kernel-selftests-x86_64-7ff71e6d9239-1_20250215
with following parameters:

	group: drivers


config: x86_64-rhel-9.4-kselftests
compiler: gcc-12
test machine: 36 threads 1 sockets Intel(R) Core(TM) i9-9980XE CPU @ 3.00GHz (Skylake) with 32G memory

(please refer to attached dmesg/kmsg for entire log/backtrace)


If you fix the issue in a separate patch/commit (i.e. not just a new version of
the same patch/commit), kindly add following tags
| Reported-by: kernel test robot <oliver.sang@intel.com>
| Closes: https://lore.kernel.org/oe-lkp/202507251144.b4d9d40b-lkp@intel.com


# timeout set to 600
# selftests: drivers/net/netdevsim: devlink.sh
# Preparing to flash
# Flashing
# Flash select
# Flashing done
# [fw.mgmt] Preparing to flash
# [fw.mgmt] Flashing
# [fw.mgmt] Flash select
# [fw.mgmt] Flashing done
# 
# Preparing to flash
# Flashing
# Flash select
# Flashing done
# 
# Preparing to flash
# Flashing
# Flash select
# Flashing done
# 
# TEST: fw flash test                                                 [ OK ]
# TEST: params test                                                   [ OK ]
# TEST: regions test                                                  [ OK ]
# Error: netdevsim: User setup the reload to fail for testing purposes.
# kernel answers: Invalid argument
# Error: netdevsim: User forbid the reload for testing purposes.
# kernel answers: Operation not supported
# TEST: reload test                                                   [ OK ]
# TEST: netns reload test                                             [ OK ]
# Error: netdevsim: Exceeded number of supported fib entries.
# Error: netdevsim: Exceeded number of supported fib entries.
# kernel answers: Operation not permitted
# TEST: resource test                                                 [ OK ]
# TEST: dev_info test                                                 [ OK ]
# TEST: empty reporter test                                           [ OK ]
# kernel answers: Success
# kernel answers: Success
# ./devlink.sh: line 508: echo: write error: Invalid argument
# Error: netdevsim: User setup the recover to fail for testing purposes.
# kernel answers: Invalid argument
# kernel answers: Success
# TEST: dummy reporter test                                           [ OK ]
# Unknown option "tc-bw"
# Unknown option "tc-bw"
# Unknown option "tc-bw"
# Unknown option "tc-bw"
# Unknown option "tc-bw"
# TEST: rate test                                                     [FAIL]
# 	Unexpected tc-bw value for tc6: 0 != 60
not ok 1 selftests: drivers/net/netdevsim: devlink.sh # exit=1



The kernel config and materials to reproduce are available at:
https://download.01.org/0day-ci/archive/20250725/202507251144.b4d9d40b-lkp@intel.com



-- 
0-DAY CI Kernel Test Service
https://github.com/intel/lkp-tests/wiki

Re: [linux-next:master] [selftest] 236156d80d: kernel-selftests.drivers/net/netdevsim.devlink.sh.rate_test.fail

[Jakub Kicinski]

On Fri, 25 Jul 2025 20:34:58 +0800 kernel test robot wrote:
> kernel test robot noticed "kernel-selftests.drivers/net/netdevsim.devlink.sh.rate_test.fail" on:
> 
> commit: 236156d80d5efd942fc395a078d6ec6d810c2c40 ("selftest: netdevsim: Add devlink rate tc-bw test")
> https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master
> 
> [test failed on linux-next/master 97987520025658f30bb787a99ffbd9bbff9ffc9d]

This is not helpful, you have old tools in your environment.

Ideally you'd report regressions in existing test _cases_ 
(I mean an individial [ OK ] turning into a [FAIL]).

The bash tests depend on too many CLI tools to be expected
to pass. Having to detect the tool versions is an unnecessary
burden on the test author. Tools usually get updated within
3 months and then all these checks become dead code for the
rest of time...

Re: [linux-next:master] [selftest] 236156d80d: kernel-selftests.drivers/net/netdevsim.devlink.sh.rate_test.fail

[Oliver Sang]

hi, Jakub Kicinski,

On Fri, Jul 25, 2025 at 08:08:18AM -0700, Jakub Kicinski wrote:
> On Fri, 25 Jul 2025 20:34:58 +0800 kernel test robot wrote:
> > kernel test robot noticed "kernel-selftests.drivers/net/netdevsim.devlink.sh.rate_test.fail" on:
> > 
> > commit: 236156d80d5efd942fc395a078d6ec6d810c2c40 ("selftest: netdevsim: Add devlink rate tc-bw test")
> > https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master
> > 
> > [test failed on linux-next/master 97987520025658f30bb787a99ffbd9bbff9ffc9d]
> 
> This is not helpful, you have old tools in your environment.

thanks a lot for information! any special tools need to be upgraded for the
new test by this commit? we will update our environment.

> 
> Ideally you'd report regressions in existing test _cases_ 
> (I mean an individial [ OK ] turning into a [FAIL]).

yeah, we are confused by below,

from parent:

# TEST: dummy reporter test                                           [ OK ]
# TEST: rate test                                                     [ OK ]   <-----
ok 1 selftests: drivers/net/netdevsim: devlink.sh


but by this commit:

# TEST: dummy reporter test                                           [ OK ]
# Unknown option "tc-bw"
# Unknown option "tc-bw"
# Unknown option "tc-bw"
# Unknown option "tc-bw"
# Unknown option "tc-bw"
# TEST: rate test                                                     [FAIL]   <-----
# 	Unexpected tc-bw value for tc6: 0 != 60
not ok 1 selftests: drivers/net/netdevsim: devlink.sh # exit=1



> 
> The bash tests depend on too many CLI tools to be expected
> to pass. Having to detect the tool versions is an unnecessary
> burden on the test author. Tools usually get updated within
> 3 months and then all these checks become dead code for the
> rest of time...
> 

got it, we will try to study how keep our env up-to-date.

Re: [linux-next:master] [selftest] 236156d80d: kernel-selftests.drivers/net/netdevsim.devlink.sh.rate_test.fail

[Philip Li]

On Mon, Jul 28, 2025 at 09:38:25AM +0800, Oliver Sang wrote:
> hi, Jakub Kicinski,
> 
> On Fri, Jul 25, 2025 at 08:08:18AM -0700, Jakub Kicinski wrote:
> > On Fri, 25 Jul 2025 20:34:58 +0800 kernel test robot wrote:
> > > kernel test robot noticed "kernel-selftests.drivers/net/netdevsim.devlink.sh.rate_test.fail" on:
> > > 
> > > commit: 236156d80d5efd942fc395a078d6ec6d810c2c40 ("selftest: netdevsim: Add devlink rate tc-bw test")
> > > https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master
> > > 
> > > [test failed on linux-next/master 97987520025658f30bb787a99ffbd9bbff9ffc9d]
> > 
> > This is not helpful, you have old tools in your environment.
> 
> thanks a lot for information! any special tools need to be upgraded for the
> new test by this commit? we will update our environment.

hi Jakub, after further check, it is an issue of 0day environment that the iproute2 used
is out of dated which doesn't support the 'tc-bw' option.

Sorry for this false positive, we will resolve the issue asap and consider how
to do appropriate upgrade of various tools.

Thanks

> 
> > 
> > Ideally you'd report regressions in existing test _cases_ 
> > (I mean an individial [ OK ] turning into a [FAIL]).
> 
> yeah, we are confused by below,
> 
> from parent:
> 
> # TEST: dummy reporter test                                           [ OK ]
> # TEST: rate test                                                     [ OK ]   <-----
> ok 1 selftests: drivers/net/netdevsim: devlink.sh
> 
> 
> but by this commit:
> 
> # TEST: dummy reporter test                                           [ OK ]
> # Unknown option "tc-bw"
> # Unknown option "tc-bw"
> # Unknown option "tc-bw"
> # Unknown option "tc-bw"
> # Unknown option "tc-bw"
> # TEST: rate test                                                     [FAIL]   <-----
> # 	Unexpected tc-bw value for tc6: 0 != 60
> not ok 1 selftests: drivers/net/netdevsim: devlink.sh # exit=1
> 
> 
> 
> > 
> > The bash tests depend on too many CLI tools to be expected
> > to pass. Having to detect the tool versions is an unnecessary
> > burden on the test author. Tools usually get updated within
> > 3 months and then all these checks become dead code for the
> > rest of time...
> > 
> 
> got it, we will try to study how keep our env up-to-date.
> 
> 
>