All of lore.kernel.org
 help / color / mirror / Atom feed
From: Jakub Kicinski <kuba@kernel.org>
To: Sheena Mohan <sheenamo@google.com>
Cc: Harshitha Ramamurthy <hramamurthy@google.com>,
	netdev@vger.kernel.org, Willem de Bruijn <willemb@google.com>
Subject: Re: [TEST] google runner needs nested cases
Date: Tue, 4 Aug 2026 07:25:22 -0700	[thread overview]
Message-ID: <20260804072522.784ead37@kernel.org> (raw)
In-Reply-To: <CADWJPTs6G7zy+9aLxz9QD9Fk1szZK0b-vEFUm2jxTMtxt+t1uQ@mail.gmail.com>

On Tue, 28 Jul 2026 10:07:15 -0700 Sheena Mohan wrote:
> The recent updates have been merged, and the tests should now report
> sub-case results.
> Please let us know if any further improvements are needed.

It doesn't look right.

https://gve-netdev-nipa.static.usercontent.goog/json/results-202608040108-88cb54ab-ca48-426b-9c9a-50bfbb0de32a.json

test	"napi-threaded-py"
group	"selftests-drivers-net"
result	"pass"
^^^^^^^^^^^^^
link	"https://gve-netdev-nipa.static.usercontent.goog/results/202608040108-88cb54ab-ca48-426b-9c9a-50bfbb0de32a/napi-threaded-py/logs.html"
time	20.788391

# selftests: drivers/net: napi_threaded.py
not ok 1 selftests: drivers/net: napi_threaded.py # exit=1
# Totals: pass:0 fail:1 xfail:0 xpass:0 skip:0 error:0
# not ok 1 napi_threaded.napi_init
# not ok 2 napi_threaded.change_num_queues
# not ok 3 napi_threaded.enable_dev_threaded_disable_napi_threaded

Does not look like a pass at all. Subcases not in JSON.
Not sure why the subcases are listed under the main return 
in the output, I've never seen that.


test	"psp-py"
group	"selftests-drivers-net"
result	"pass"
link	"https://gve-netdev-nipa.static.usercontent.goog/results/202608040108-88cb54ab-ca48-426b-9c9a-50bfbb0de32a/psp-py/logs.html"
time	341.833939

# selftests: drivers/net: psp.py
not ok 1 selftests: drivers/net: psp.py # exit=1
# Totals: pass:0 fail:1 xfail:0 xpass:0 skip:0 error:0

Again, doesn't seem to be a pass??


test	"queues-py"
group	"selftests-drivers-net"
result	"pass"
link	"https://gve-netdev-nipa.static.usercontent.goog/results/202608040108-88cb54ab-ca48-426b-9c9a-50bfbb0de32a/queues-py/logs.html"
time	686.483495
results	
	test	"queues-check-xsk"
	result	"pass"

Okay, here we have a subcase..

# selftests: drivers/net: queues.py
ok 1 selftests: drivers/net: queues.py
# Totals: pass:1 fail:0 xfail:0 xpass:0 skip:0 error:0
check_down
# ok 4 queues.check_xsk
# # Totals: pass:4 fail:0 xfail:0 xpass:0 skip:0 error:0

But why only one? What happened to the other 3 that ksft clearly saw
since it enumerated check_xsk as the fourth??


Something is mangling the output on your runner, it seems.
And the parsing seems off.

  parent reply	other threads:[~2026-08-04 14:25 UTC|newest]

Thread overview: 10+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-07-21 13:38 [TEST] google runner needs nested cases Jakub Kicinski
2026-07-23 17:14 ` Sheena Mohan
2026-07-23 17:36   ` Jakub Kicinski
2026-07-28 17:07     ` Sheena Mohan
2026-07-28 22:13       ` Jakub Kicinski
2026-07-28 22:38         ` Sheena Mohan
2026-07-28 23:22           ` Jakub Kicinski
2026-07-29 17:44             ` Sheena Mohan
2026-08-04 14:25       ` Jakub Kicinski [this message]
2026-08-04 17:39         ` Sheena Mohan

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20260804072522.784ead37@kernel.org \
    --to=kuba@kernel.org \
    --cc=hramamurthy@google.com \
    --cc=netdev@vger.kernel.org \
    --cc=sheenamo@google.com \
    --cc=willemb@google.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.