[DPDK/DTS Bug 1907] filter_tests filtering out testcases, but leaving empty testsuites in result list

[DPDK/DTS Bug 1907] filter_tests filtering out testcases, but leaving empty testsuites in result list

[bugzilla]

http://bugs.dpdk.org/show_bug.cgi?id=1907

            Bug ID: 1907
           Summary: filter_tests filtering out testcases, but leaving
                    empty testsuites in result list
           Product: DPDK
           Version: 25.11
          Hardware: All
                OS: All
            Status: UNCONFIRMED
          Severity: minor
          Priority: Normal
         Component: DTS
          Assignee: dev@dpdk.org
          Reporter: probb@iol.unh.edu
                CC: juraj.linkes@pantheon.tech, probb@iol.unh.edu
  Target Milestone: ---

When one comments out the test_suites field entirely in test_run.yaml (to
default to running the complete set of testsuites in DTS) filter_tests() only
does part of its job. It will filter out the testcases which are disallowed per
the test_run.yaml config (i.e. remove crypto tests if crypto == False in the
config). However, using the crypto example, it will remove all crypto testcases
from the execution, but leave the testsuite in the list of testsuites to run.
The result is an "empty" testsuite run.

Example (see cryptodev throughput):

 blocklist: PASS
    all_but_one_port_blocklisted: SKIP
      reason: Required capability '{LinkTopology.TWO_LINKS}' not found.
    no_blocklisted: PASS
    one_port_blocklisted: SKIP
      reason: Required capability '{LinkTopology.TWO_LINKS}' not found.
  checksum_offload: PASS
    insert_checksums: PASS
    l3_rx_checksum: PASS
    l4_rx_checksum: PASS
    no_insert_checksums: PASS
    validate_rx_checksum: PASS
    validate_sctp_checksum: SKIP
      reason: Required capability '{PORT_RX_OFFLOAD_SCTP_CKSUM}' not found.
    vlan_checksum: SKIP
      reason: Required capability '{PORT_RX_OFFLOAD_VLAN}' not found.
  cryptodev_throughput: PASS
  dual_vlan: PASS
    all_vlan_functions: PASS
    insert_second_vlan: SKIP
      reason: Required capability '{LinkTopology.TWO_LINKS}' not found.
    maintains_priority: PASS

-- 
You are receiving this mail because:
You are the assignee for the bug.

[DPDK/DTS Bug 1907] filter_tests filtering out testcases, but leaving empty testsuites in result list

[bugzilla]

http://bugs.dpdk.org/show_bug.cgi?id=1907

Patrick Robb (probb@iol.unh.edu) changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
         Resolution|---                         |FIXED
             Status|IN_PROGRESS                 |RESOLVED

--- Comment #2 from Patrick Robb (probb@iol.unh.edu) ---
Merged to next-dts

-- 
You are receiving this mail because:
You are the assignee for the bug.