[igt-dev] [PATCH i-g-t 00/10] Dynamic subtests, v2

Petri Latvala
2019-08-16T09:34:35Z

Dynamic subtests, rebased.

Now with two examples: kms_plane_cursor has been changed to use
for_each_pipe instead of for_each_pipe_static, and two tests
(gem_exec_basic and perf_pmu) have been changed to expose a dynamic
subtest per i915 engine instead of a subtest per engine.

Petri Latvala (10):
lib: Introduce dynamic subtests
lib/tests: Unit tests for dynamic subtests
lib/tests: Test that igt_describe works with dynamic subtests
runner/resultgen: Refactor output parsing
runner/json_tests: Adapt to better output parsing
runner: Parse dynamic subtest outputs and results
runner/json_tests: Test dynamic subtests
kms_plane_cursor: Use dynamic subtests
perf_pmu: Use dynamic subtests
i915/gem_exec_basic: Use dynamic subtests

lib/igt_core.c | 119 +++-
lib/igt_core.h | 89 +++
lib/tests/igt_describe.c | 12 +-
lib/tests/igt_dynamic_subtests.c | 186 ++++++
lib/tests/meson.build | 1 +
runner/job_list.c | 11 +
runner/job_list.h | 3 +
.../aborted-after-a-test/reference.json | 2 +-
.../dmesg-escapes/reference.json | 2 +-
.../dmesg-results/reference.json | 8 +-
.../reference.json | 4 +-
.../reference.json | 4 +-
.../dmesg-warn-level/reference.json | 4 +-
.../dynamic-subtests/0/dmesg.txt | 7 +
.../dynamic-subtests/0/err.txt | 36 +
.../dynamic-subtests/0/journal.txt | 2 +
.../dynamic-subtests/0/out.txt | 19 +
.../dynamic-subtests/1/dmesg.txt | 5 +
.../dynamic-subtests/1/err.txt | 2 +
.../dynamic-subtests/1/journal.txt | 2 +
.../dynamic-subtests/1/out.txt | 5 +
.../dynamic-subtests/2/dmesg.txt | 11 +
.../dynamic-subtests/2/err.txt | 8 +
.../dynamic-subtests/2/journal.txt | 4 +
.../dynamic-subtests/2/out.txt | 10 +
.../dynamic-subtests/README.txt | 2 +
.../dynamic-subtests/endtime.txt | 1 +
.../dynamic-subtests/joblist.txt | 3 +
.../dynamic-subtests/metadata.txt | 12 +
.../dynamic-subtests/reference.json | 168 +++++
.../dynamic-subtests/starttime.txt | 1 +
.../dynamic-subtests/uname.txt | 1 +
.../json_tests_data/normal-run/reference.json | 8 +-
.../reference.json | 2 +-
.../notrun-results/reference.json | 2 +-
.../piglit-style-dmesg/reference.json | 8 +-
.../warnings-with-dmesg-warns/reference.json | 8 +-
.../json_tests_data/warnings/reference.json | 8 +-
runner/output_strings.h | 29 +-
runner/resultgen.c | 626 ++++++++++++------
runner/runner_json_tests.c | 3 +-
tests/i915/gem_exec_basic.c | 26 +-
tests/kms_plane_cursor.c | 34 +-
tests/perf_pmu.c | 239 +++----
44 files changed, 1341 insertions(+), 396 deletions(-)
create mode 100644 lib/tests/igt_dynamic_subtests.c
create mode 100644 runner/json_tests_data/dynamic-subtests/0/dmesg.txt
create mode 100644 runner/json_tests_data/dynamic-subtests/0/err.txt
create mode 100644 runner/json_tests_data/dynamic-subtests/0/journal.txt
create mode 100644 runner/json_tests_data/dynamic-subtests/0/out.txt
create mode 100644 runner/json_tests_data/dynamic-subtests/1/dmesg.txt
create mode 100644 runner/json_tests_data/dynamic-subtests/1/err.txt
create mode 100644 runner/json_tests_data/dynamic-subtests/1/journal.txt
create mode 100644 runner/json_tests_data/dynamic-subtests/1/out.txt
create mode 100644 runner/json_tests_data/dynamic-subtests/2/dmesg.txt
create mode 100644 runner/json_tests_data/dynamic-subtests/2/err.txt
create mode 100644 runner/json_tests_data/dynamic-subtests/2/journal.txt
create mode 100644 runner/json_tests_data/dynamic-subtests/2/out.txt
create mode 100644 runner/json_tests_data/dynamic-subtests/README.txt
create mode 100644 runner/json_tests_data/dynamic-subtests/endtime.txt
create mode 100644 runner/json_tests_data/dynamic-subtests/joblist.txt
create mode 100644 runner/json_tests_data/dynamic-subtests/metadata.txt
create mode 100644 runner/json_tests_data/dynamic-subtests/reference.json
create mode 100644 runner/json_tests_data/dynamic-subtests/starttime.txt
create mode 100644 runner/json_tests_data/dynamic-subtests/uname.txt