public inbox for igt-dev@lists.freedesktop.org
 help / color / mirror / Atom feed
From: Petri Latvala <petri.latvala@intel.com>
To: igt-dev@lists.freedesktop.org
Cc: Petri Latvala <petri.latvala@intel.com>
Subject: [igt-dev] [PATCH i-g-t 00/10] Dynamic subtests, v2
Date: Fri, 16 Aug 2019 12:34:16 +0300	[thread overview]
Message-ID: <20190816093426.10644-1-petri.latvala@intel.com> (raw)

Dynamic subtests, rebased.

Now with two examples: kms_plane_cursor has been changed to use
for_each_pipe instead of for_each_pipe_static, and two tests
(gem_exec_basic and perf_pmu) have been changed to expose a dynamic
subtest per i915 engine instead of a subtest per engine.

Petri Latvala (10):
  lib: Introduce dynamic subtests
  lib/tests: Unit tests for dynamic subtests
  lib/tests: Test that igt_describe works with dynamic subtests
  runner/resultgen: Refactor output parsing
  runner/json_tests: Adapt to better output parsing
  runner: Parse dynamic subtest outputs and results
  runner/json_tests: Test dynamic subtests
  kms_plane_cursor: Use dynamic subtests
  perf_pmu: Use dynamic subtests
  i915/gem_exec_basic: Use dynamic subtests

 lib/igt_core.c                                | 119 +++-
 lib/igt_core.h                                |  89 +++
 lib/tests/igt_describe.c                      |  12 +-
 lib/tests/igt_dynamic_subtests.c              | 186 ++++++
 lib/tests/meson.build                         |   1 +
 runner/job_list.c                             |  11 +
 runner/job_list.h                             |   3 +
 .../aborted-after-a-test/reference.json       |   2 +-
 .../dmesg-escapes/reference.json              |   2 +-
 .../dmesg-results/reference.json              |   8 +-
 .../reference.json                            |   4 +-
 .../reference.json                            |   4 +-
 .../dmesg-warn-level/reference.json           |   4 +-
 .../dynamic-subtests/0/dmesg.txt              |   7 +
 .../dynamic-subtests/0/err.txt                |  36 +
 .../dynamic-subtests/0/journal.txt            |   2 +
 .../dynamic-subtests/0/out.txt                |  19 +
 .../dynamic-subtests/1/dmesg.txt              |   5 +
 .../dynamic-subtests/1/err.txt                |   2 +
 .../dynamic-subtests/1/journal.txt            |   2 +
 .../dynamic-subtests/1/out.txt                |   5 +
 .../dynamic-subtests/2/dmesg.txt              |  11 +
 .../dynamic-subtests/2/err.txt                |   8 +
 .../dynamic-subtests/2/journal.txt            |   4 +
 .../dynamic-subtests/2/out.txt                |  10 +
 .../dynamic-subtests/README.txt               |   2 +
 .../dynamic-subtests/endtime.txt              |   1 +
 .../dynamic-subtests/joblist.txt              |   3 +
 .../dynamic-subtests/metadata.txt             |  12 +
 .../dynamic-subtests/reference.json           | 168 +++++
 .../dynamic-subtests/starttime.txt            |   1 +
 .../dynamic-subtests/uname.txt                |   1 +
 .../json_tests_data/normal-run/reference.json |   8 +-
 .../reference.json                            |   2 +-
 .../notrun-results/reference.json             |   2 +-
 .../piglit-style-dmesg/reference.json         |   8 +-
 .../warnings-with-dmesg-warns/reference.json  |   8 +-
 .../json_tests_data/warnings/reference.json   |   8 +-
 runner/output_strings.h                       |  29 +-
 runner/resultgen.c                            | 626 ++++++++++++------
 runner/runner_json_tests.c                    |   3 +-
 tests/i915/gem_exec_basic.c                   |  26 +-
 tests/kms_plane_cursor.c                      |  34 +-
 tests/perf_pmu.c                              | 239 +++----
 44 files changed, 1341 insertions(+), 396 deletions(-)
 create mode 100644 lib/tests/igt_dynamic_subtests.c
 create mode 100644 runner/json_tests_data/dynamic-subtests/0/dmesg.txt
 create mode 100644 runner/json_tests_data/dynamic-subtests/0/err.txt
 create mode 100644 runner/json_tests_data/dynamic-subtests/0/journal.txt
 create mode 100644 runner/json_tests_data/dynamic-subtests/0/out.txt
 create mode 100644 runner/json_tests_data/dynamic-subtests/1/dmesg.txt
 create mode 100644 runner/json_tests_data/dynamic-subtests/1/err.txt
 create mode 100644 runner/json_tests_data/dynamic-subtests/1/journal.txt
 create mode 100644 runner/json_tests_data/dynamic-subtests/1/out.txt
 create mode 100644 runner/json_tests_data/dynamic-subtests/2/dmesg.txt
 create mode 100644 runner/json_tests_data/dynamic-subtests/2/err.txt
 create mode 100644 runner/json_tests_data/dynamic-subtests/2/journal.txt
 create mode 100644 runner/json_tests_data/dynamic-subtests/2/out.txt
 create mode 100644 runner/json_tests_data/dynamic-subtests/README.txt
 create mode 100644 runner/json_tests_data/dynamic-subtests/endtime.txt
 create mode 100644 runner/json_tests_data/dynamic-subtests/joblist.txt
 create mode 100644 runner/json_tests_data/dynamic-subtests/metadata.txt
 create mode 100644 runner/json_tests_data/dynamic-subtests/reference.json
 create mode 100644 runner/json_tests_data/dynamic-subtests/starttime.txt
 create mode 100644 runner/json_tests_data/dynamic-subtests/uname.txt

-- 
2.19.1

_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

             reply	other threads:[~2019-08-16  9:34 UTC|newest]

Thread overview: 20+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2019-08-16  9:34 Petri Latvala [this message]
2019-08-16  9:34 ` [igt-dev] [PATCH i-g-t 01/10] lib: Introduce dynamic subtests Petri Latvala
2019-08-28 10:16   ` Arkadiusz Hiler
2019-08-28 10:30     ` Petri Latvala
2019-08-28 10:38       ` Arkadiusz Hiler
2019-08-28 12:58         ` Petri Latvala
2019-08-16  9:34 ` [igt-dev] [PATCH i-g-t 02/10] lib/tests: Unit tests for " Petri Latvala
2019-08-16  9:34 ` [igt-dev] [PATCH i-g-t 03/10] lib/tests: Test that igt_describe works with " Petri Latvala
2019-08-28 12:33   ` Arkadiusz Hiler
2019-08-28 12:39     ` Petri Latvala
2019-08-16  9:34 ` [igt-dev] [PATCH i-g-t 04/10] runner/resultgen: Refactor output parsing Petri Latvala
2019-08-28 11:48   ` Arkadiusz Hiler
2019-08-16  9:34 ` [igt-dev] [PATCH i-g-t 05/10] runner/json_tests: Adapt to better " Petri Latvala
2019-08-16  9:34 ` [igt-dev] [PATCH i-g-t 06/10] runner: Parse dynamic subtest outputs and results Petri Latvala
2019-08-16  9:34 ` [igt-dev] [PATCH i-g-t 07/10] runner/json_tests: Test dynamic subtests Petri Latvala
2019-08-16  9:34 ` [igt-dev] [PATCH i-g-t 08/10] kms_plane_cursor: Use " Petri Latvala
2019-08-16  9:34 ` [igt-dev] [PATCH i-g-t 09/10] perf_pmu: " Petri Latvala
2019-08-16  9:34 ` [igt-dev] [PATCH i-g-t 10/10] i915/gem_exec_basic: " Petri Latvala
2019-08-16 10:17 ` [igt-dev] ✓ Fi.CI.BAT: success for Dynamic subtests (rev2) Patchwork
2019-08-16 22:13 ` [igt-dev] ✓ Fi.CI.IGT: " Patchwork

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20190816093426.10644-1-petri.latvala@intel.com \
    --to=petri.latvala@intel.com \
    --cc=igt-dev@lists.freedesktop.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox