igt-dev.lists.freedesktop.org archive mirror
 help / color / mirror / Atom feed
* [igt-dev] [PATCH i-g-t 1/1] runner: Match the piglit name with -t and -x options
@ 2018-08-14 12:38 Petri Latvala
  2018-08-14 13:25 ` [igt-dev] ✓ Fi.CI.BAT: success for series starting with [i-g-t,1/1] " Patchwork
                   ` (2 more replies)
  0 siblings, 3 replies; 4+ messages in thread
From: Petri Latvala @ 2018-08-14 12:38 UTC (permalink / raw)
  To: igt-dev; +Cc: Tomi Sarvela

Instead of just matching the binary/subtest name.

Originally not implemented to get the runner landed faster. Turned out
to be simple enough.

Signed-off-by: Petri Latvala <petri.latvala@intel.com>
Cc: Tomi Sarvela <tomi.p.sarvela@intel.com>
Cc: Arkadiusz Hiler <arkadiusz.hiler@intel.com>
---
 runner/job_list.c     | 11 +++++++++--
 runner/runner_tests.c |  2 ++
 2 files changed, 11 insertions(+), 2 deletions(-)

diff --git a/runner/job_list.c b/runner/job_list.c
index e3f820c3..5fe88e4f 100644
--- a/runner/job_list.c
+++ b/runner/job_list.c
@@ -74,13 +74,19 @@ static void add_subtests(struct job_list *job_list, struct settings *settings,
 	}
 
 	while (fscanf(p, "%ms", &subtestname) == 1) {
-		if (exclude && exclude->size && matches_any(subtestname, exclude)) {
+		char *piglitname;
+
+		asprintf(&piglitname, "igt@%s@%s", binary, subtestname);
+
+		if (exclude && exclude->size && matches_any(piglitname, exclude)) {
 			free(subtestname);
+			free(piglitname);
 			continue;
 		}
 
-		if (include && include->size && !matches_any(subtestname, include)) {
+		if (include && include->size && !matches_any(piglitname, include)) {
 			free(subtestname);
+			free(piglitname);
 			continue;
 		}
 
@@ -96,6 +102,7 @@ static void add_subtests(struct job_list *job_list, struct settings *settings,
 		}
 
 		free(subtestname);
+		free(piglitname);
 	}
 
 	if (num_subtests)
diff --git a/runner/runner_tests.c b/runner/runner_tests.c
index 89b4377a..942ba26b 100644
--- a/runner/runner_tests.c
+++ b/runner/runner_tests.c
@@ -514,6 +514,8 @@ igt_main
 	job_list_filter_test("binary-exclude", "-x", "successtest", 3, 2);
 	job_list_filter_test("subtest-include", "-t", "first-subtest", 1, 1);
 	job_list_filter_test("subtest-exclude", "-x", "second-subtest", 4, 3);
+	job_list_filter_test("piglit-names", "-t", "igt@successtest", 2, 1);
+	job_list_filter_test("piglit-names-subtest", "-t", "igt@successtest@first", 1, 1);
 
 	igt_subtest_group {
 		char filename[] = "tmplistXXXXXX";
-- 
2.14.1

_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

^ permalink raw reply related	[flat|nested] 4+ messages in thread

* [igt-dev] ✓ Fi.CI.BAT: success for series starting with [i-g-t,1/1] runner: Match the piglit name with -t and -x options
  2018-08-14 12:38 [igt-dev] [PATCH i-g-t 1/1] runner: Match the piglit name with -t and -x options Petri Latvala
@ 2018-08-14 13:25 ` Patchwork
  2018-08-14 16:49 ` [igt-dev] ✗ Fi.CI.IGT: failure " Patchwork
  2018-08-16 11:16 ` [igt-dev] [PATCH i-g-t 1/1] " Arkadiusz Hiler
  2 siblings, 0 replies; 4+ messages in thread
From: Patchwork @ 2018-08-14 13:25 UTC (permalink / raw)
  To: Petri Latvala; +Cc: igt-dev

== Series Details ==

Series: series starting with [i-g-t,1/1] runner: Match the piglit name with -t and -x options
URL   : https://patchwork.freedesktop.org/series/48180/
State : success

== Summary ==

= CI Bug Log - changes from CI_DRM_4664 -> IGTPW_1709 =

== Summary - SUCCESS ==

  No regressions found.

  External URL: https://patchwork.freedesktop.org/api/1.0/series/48180/revisions/1/mbox/

== Known issues ==

  Here are the changes found in IGTPW_1709 that come from known issues:

  === IGT changes ===

    ==== Issues hit ====

    igt@drv_selftest@live_hangcheck:
      fi-skl-6700k2:      PASS -> DMESG-FAIL (fdo#106560, fdo#107174)
      fi-kbl-guc:         PASS -> DMESG-FAIL (fdo#106947)

    igt@drv_selftest@live_workarounds:
      fi-kbl-7560u:       PASS -> DMESG-FAIL (fdo#107292)

    igt@kms_frontbuffer_tracking@basic:
      fi-hsw-peppy:       PASS -> DMESG-FAIL (fdo#102614)
      {fi-byt-clapper}:   PASS -> FAIL (fdo#103167)

    igt@kms_pipe_crc_basic@suspend-read-crc-pipe-b:
      {fi-byt-clapper}:   PASS -> FAIL (fdo#103191, fdo#107362)
      fi-skl-guc:         PASS -> FAIL (fdo#103191)

    
    ==== Possible fixes ====

    igt@drv_selftest@live_coherency:
      fi-gdg-551:         DMESG-FAIL (fdo#107164) -> PASS

    igt@drv_selftest@live_hangcheck:
      fi-skl-guc:         DMESG-FAIL (fdo#107174, fdo#106685) -> PASS

    igt@gem_exec_suspend@basic-s4-devices:
      fi-kbl-7500u:       DMESG-WARN (fdo#107139, fdo#105128) -> PASS

    igt@kms_chamelium@dp-crc-fast:
      fi-kbl-7500u:       DMESG-FAIL (fdo#103841) -> PASS

    
    ==== Warnings ====

    {igt@kms_psr@primary_page_flip}:
      fi-cnl-psr:         DMESG-FAIL (fdo#107372) -> DMESG-WARN (fdo#107372)

    
  {name}: This element is suppressed. This means it is ignored when computing
          the status of the difference (SUCCESS, WARNING, or FAILURE).

  fdo#102614 https://bugs.freedesktop.org/show_bug.cgi?id=102614
  fdo#103167 https://bugs.freedesktop.org/show_bug.cgi?id=103167
  fdo#103191 https://bugs.freedesktop.org/show_bug.cgi?id=103191
  fdo#103841 https://bugs.freedesktop.org/show_bug.cgi?id=103841
  fdo#105128 https://bugs.freedesktop.org/show_bug.cgi?id=105128
  fdo#106560 https://bugs.freedesktop.org/show_bug.cgi?id=106560
  fdo#106685 https://bugs.freedesktop.org/show_bug.cgi?id=106685
  fdo#106947 https://bugs.freedesktop.org/show_bug.cgi?id=106947
  fdo#107139 https://bugs.freedesktop.org/show_bug.cgi?id=107139
  fdo#107164 https://bugs.freedesktop.org/show_bug.cgi?id=107164
  fdo#107174 https://bugs.freedesktop.org/show_bug.cgi?id=107174
  fdo#107292 https://bugs.freedesktop.org/show_bug.cgi?id=107292
  fdo#107362 https://bugs.freedesktop.org/show_bug.cgi?id=107362
  fdo#107372 https://bugs.freedesktop.org/show_bug.cgi?id=107372


== Participating hosts (54 -> 49) ==

  Missing    (5): fi-ctg-p8600 fi-ilk-m540 fi-byt-squawks fi-bsw-cyan fi-hsw-4200u 


== Build changes ==

    * IGT: IGT_4593 -> IGTPW_1709

  CI_DRM_4664: 19e458884fe1d8d10e453529933199250cc8821f @ git://anongit.freedesktop.org/gfx-ci/linux
  IGTPW_1709: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_1709/
  IGT_4593: c88e219c6e890d89b7836c5e248ffedf334d55a2 @ git://anongit.freedesktop.org/xorg/app/intel-gpu-tools

== Logs ==

For more details see: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_1709/issues.html
_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

^ permalink raw reply	[flat|nested] 4+ messages in thread

* [igt-dev] ✗ Fi.CI.IGT: failure for series starting with [i-g-t,1/1] runner: Match the piglit name with -t and -x options
  2018-08-14 12:38 [igt-dev] [PATCH i-g-t 1/1] runner: Match the piglit name with -t and -x options Petri Latvala
  2018-08-14 13:25 ` [igt-dev] ✓ Fi.CI.BAT: success for series starting with [i-g-t,1/1] " Patchwork
@ 2018-08-14 16:49 ` Patchwork
  2018-08-16 11:16 ` [igt-dev] [PATCH i-g-t 1/1] " Arkadiusz Hiler
  2 siblings, 0 replies; 4+ messages in thread
From: Patchwork @ 2018-08-14 16:49 UTC (permalink / raw)
  To: Petri Latvala; +Cc: igt-dev

== Series Details ==

Series: series starting with [i-g-t,1/1] runner: Match the piglit name with -t and -x options
URL   : https://patchwork.freedesktop.org/series/48180/
State : failure

== Summary ==

= CI Bug Log - changes from IGT_4593_full -> IGTPW_1709_full =

== Summary - FAILURE ==

  Serious unknown changes coming with IGTPW_1709_full absolutely need to be
  verified manually.
  
  If you think the reported changes have nothing to do with the changes
  introduced in IGTPW_1709_full, please notify your bug team to allow them
  to document this new failure mode, which will reduce false positives in CI.

  External URL: https://patchwork.freedesktop.org/api/1.0/series/48180/revisions/1/mbox/

== Possible new issues ==

  Here are the unknown changes that may have been introduced in IGTPW_1709_full:

  === IGT changes ===

    ==== Possible regressions ====

    igt@gem_eio@in-flight-suspend:
      shard-glk:          PASS -> DMESG-WARN

    igt@gem_eio@reset-stress:
      shard-kbl:          PASS -> FAIL

    
== Known issues ==

  Here are the changes found in IGTPW_1709_full that come from known issues:

  === IGT changes ===

    ==== Issues hit ====

    igt@gem_exec_schedule@pi-ringfull-render:
      shard-glk:          NOTRUN -> FAIL (fdo#103158)

    igt@gem_exec_suspend@basic-s4-devices:
      shard-snb:          PASS -> INCOMPLETE (fdo#105411) +1

    igt@kms_plane@plane-panning-bottom-right-suspend-pipe-a-planes:
      shard-kbl:          PASS -> INCOMPLETE (fdo#103665, fdo#107556)

    igt@kms_rotation_crc@primary-rotation-180:
      shard-snb:          PASS -> FAIL (fdo#103925)

    igt@kms_setmode@basic:
      shard-apl:          PASS -> FAIL (fdo#99912)

    
    ==== Possible fixes ====

    igt@drv_suspend@shrink:
      shard-snb:          INCOMPLETE (fdo#106886, fdo#105411) -> PASS

    igt@kms_flip@2x-flip-vs-expired-vblank:
      shard-glk:          FAIL (fdo#105363) -> PASS

    igt@kms_flip@flip-vs-expired-vblank-interruptible:
      shard-glk:          FAIL (fdo#105363, fdo#102887) -> PASS

    igt@kms_rotation_crc@sprite-rotation-180:
      shard-snb:          FAIL (fdo#103925) -> PASS

    igt@perf_pmu@busy-accuracy-50-bcs0:
      shard-snb:          INCOMPLETE (fdo#105411) -> SKIP

    
  fdo#102887 https://bugs.freedesktop.org/show_bug.cgi?id=102887
  fdo#103158 https://bugs.freedesktop.org/show_bug.cgi?id=103158
  fdo#103665 https://bugs.freedesktop.org/show_bug.cgi?id=103665
  fdo#103925 https://bugs.freedesktop.org/show_bug.cgi?id=103925
  fdo#105363 https://bugs.freedesktop.org/show_bug.cgi?id=105363
  fdo#105411 https://bugs.freedesktop.org/show_bug.cgi?id=105411
  fdo#106886 https://bugs.freedesktop.org/show_bug.cgi?id=106886
  fdo#107556 https://bugs.freedesktop.org/show_bug.cgi?id=107556
  fdo#99912 https://bugs.freedesktop.org/show_bug.cgi?id=99912


== Participating hosts (5 -> 5) ==

  No changes in participating hosts


== Build changes ==

    * IGT: IGT_4593 -> IGTPW_1709
    * Linux: CI_DRM_4660 -> CI_DRM_4664

  CI_DRM_4660: 9cd882754c1017e68ed9d2c8d57dc326530522fe @ git://anongit.freedesktop.org/gfx-ci/linux
  CI_DRM_4664: 19e458884fe1d8d10e453529933199250cc8821f @ git://anongit.freedesktop.org/gfx-ci/linux
  IGTPW_1709: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_1709/
  IGT_4593: c88e219c6e890d89b7836c5e248ffedf334d55a2 @ git://anongit.freedesktop.org/xorg/app/intel-gpu-tools

== Logs ==

For more details see: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_1709/shards.html
_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: [igt-dev] [PATCH i-g-t 1/1] runner: Match the piglit name with -t and -x options
  2018-08-14 12:38 [igt-dev] [PATCH i-g-t 1/1] runner: Match the piglit name with -t and -x options Petri Latvala
  2018-08-14 13:25 ` [igt-dev] ✓ Fi.CI.BAT: success for series starting with [i-g-t,1/1] " Patchwork
  2018-08-14 16:49 ` [igt-dev] ✗ Fi.CI.IGT: failure " Patchwork
@ 2018-08-16 11:16 ` Arkadiusz Hiler
  2 siblings, 0 replies; 4+ messages in thread
From: Arkadiusz Hiler @ 2018-08-16 11:16 UTC (permalink / raw)
  To: Petri Latvala; +Cc: igt-dev, Tomi Sarvela

On Tue, Aug 14, 2018 at 03:38:31PM +0300, Petri Latvala wrote:
> Instead of just matching the binary/subtest name.
> 
> Originally not implemented to get the runner landed faster. Turned out
> to be simple enough.
> 
> Signed-off-by: Petri Latvala <petri.latvala@intel.com>
> Cc: Tomi Sarvela <tomi.p.sarvela@intel.com>
> Cc: Arkadiusz Hiler <arkadiusz.hiler@intel.com>
Reviewed-by: Arkadiusz Hiler <arkadiusz.hiler@intel.com>
_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev

^ permalink raw reply	[flat|nested] 4+ messages in thread

end of thread, other threads:[~2018-08-16 11:16 UTC | newest]

Thread overview: 4+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2018-08-14 12:38 [igt-dev] [PATCH i-g-t 1/1] runner: Match the piglit name with -t and -x options Petri Latvala
2018-08-14 13:25 ` [igt-dev] ✓ Fi.CI.BAT: success for series starting with [i-g-t,1/1] " Patchwork
2018-08-14 16:49 ` [igt-dev] ✗ Fi.CI.IGT: failure " Patchwork
2018-08-16 11:16 ` [igt-dev] [PATCH i-g-t 1/1] " Arkadiusz Hiler

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).