public inbox for dev@dpdk.org
 help / color / mirror / Atom feed
From: bugzilla@dpdk.org
To: dev@dpdk.org
Subject: [DPDK/DTS Bug 1907] filter_tests filtering out testcases, but leaving empty testsuites in result list
Date: Fri, 20 Mar 2026 20:09:06 +0000	[thread overview]
Message-ID: <bug-1907-3@http.bugs.dpdk.org/> (raw)

http://bugs.dpdk.org/show_bug.cgi?id=1907

            Bug ID: 1907
           Summary: filter_tests filtering out testcases, but leaving
                    empty testsuites in result list
           Product: DPDK
           Version: 25.11
          Hardware: All
                OS: All
            Status: UNCONFIRMED
          Severity: minor
          Priority: Normal
         Component: DTS
          Assignee: dev@dpdk.org
          Reporter: probb@iol.unh.edu
                CC: juraj.linkes@pantheon.tech, probb@iol.unh.edu
  Target Milestone: ---

When one comments out the test_suites field entirely in test_run.yaml (to
default to running the complete set of testsuites in DTS) filter_tests() only
does part of its job. It will filter out the testcases which are disallowed per
the test_run.yaml config (i.e. remove crypto tests if crypto == False in the
config). However, using the crypto example, it will remove all crypto testcases
from the execution, but leave the testsuite in the list of testsuites to run.
The result is an "empty" testsuite run.

Example (see cryptodev throughput):

 blocklist: PASS
    all_but_one_port_blocklisted: SKIP
      reason: Required capability '{LinkTopology.TWO_LINKS}' not found.
    no_blocklisted: PASS
    one_port_blocklisted: SKIP
      reason: Required capability '{LinkTopology.TWO_LINKS}' not found.
  checksum_offload: PASS
    insert_checksums: PASS
    l3_rx_checksum: PASS
    l4_rx_checksum: PASS
    no_insert_checksums: PASS
    validate_rx_checksum: PASS
    validate_sctp_checksum: SKIP
      reason: Required capability '{PORT_RX_OFFLOAD_SCTP_CKSUM}' not found.
    vlan_checksum: SKIP
      reason: Required capability '{PORT_RX_OFFLOAD_VLAN}' not found.
  cryptodev_throughput: PASS
  dual_vlan: PASS
    all_vlan_functions: PASS
    insert_second_vlan: SKIP
      reason: Required capability '{LinkTopology.TWO_LINKS}' not found.
    maintains_priority: PASS

-- 
You are receiving this mail because:
You are the assignee for the bug.

             reply	other threads:[~2026-03-20 20:09 UTC|newest]

Thread overview: 2+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-03-20 20:09 bugzilla [this message]
2026-03-24 17:27 ` [DPDK/DTS Bug 1907] filter_tests filtering out testcases, but leaving empty testsuites in result list bugzilla

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=bug-1907-3@http.bugs.dpdk.org/ \
    --to=bugzilla@dpdk.org \
    --cc=dev@dpdk.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox