* [igt-dev] [PATCH i-g-t 1/1] runner: Match the piglit name with -t and -x options
@ 2018-08-14 12:38 Petri Latvala
2018-08-14 13:25 ` [igt-dev] ✓ Fi.CI.BAT: success for series starting with [i-g-t,1/1] " Patchwork
` (2 more replies)
0 siblings, 3 replies; 4+ messages in thread
From: Petri Latvala @ 2018-08-14 12:38 UTC (permalink / raw)
To: igt-dev; +Cc: Tomi Sarvela
Instead of just matching the binary/subtest name.
Originally not implemented to get the runner landed faster. Turned out
to be simple enough.
Signed-off-by: Petri Latvala <petri.latvala@intel.com>
Cc: Tomi Sarvela <tomi.p.sarvela@intel.com>
Cc: Arkadiusz Hiler <arkadiusz.hiler@intel.com>
---
runner/job_list.c | 11 +++++++++--
runner/runner_tests.c | 2 ++
2 files changed, 11 insertions(+), 2 deletions(-)
diff --git a/runner/job_list.c b/runner/job_list.c
index e3f820c3..5fe88e4f 100644
--- a/runner/job_list.c
+++ b/runner/job_list.c
@@ -74,13 +74,19 @@ static void add_subtests(struct job_list *job_list, struct settings *settings,
}
while (fscanf(p, "%ms", &subtestname) == 1) {
- if (exclude && exclude->size && matches_any(subtestname, exclude)) {
+ char *piglitname;
+
+ asprintf(&piglitname, "igt@%s@%s", binary, subtestname);
+
+ if (exclude && exclude->size && matches_any(piglitname, exclude)) {
free(subtestname);
+ free(piglitname);
continue;
}
- if (include && include->size && !matches_any(subtestname, include)) {
+ if (include && include->size && !matches_any(piglitname, include)) {
free(subtestname);
+ free(piglitname);
continue;
}
@@ -96,6 +102,7 @@ static void add_subtests(struct job_list *job_list, struct settings *settings,
}
free(subtestname);
+ free(piglitname);
}
if (num_subtests)
diff --git a/runner/runner_tests.c b/runner/runner_tests.c
index 89b4377a..942ba26b 100644
--- a/runner/runner_tests.c
+++ b/runner/runner_tests.c
@@ -514,6 +514,8 @@ igt_main
job_list_filter_test("binary-exclude", "-x", "successtest", 3, 2);
job_list_filter_test("subtest-include", "-t", "first-subtest", 1, 1);
job_list_filter_test("subtest-exclude", "-x", "second-subtest", 4, 3);
+ job_list_filter_test("piglit-names", "-t", "igt@successtest", 2, 1);
+ job_list_filter_test("piglit-names-subtest", "-t", "igt@successtest@first", 1, 1);
igt_subtest_group {
char filename[] = "tmplistXXXXXX";
--
2.14.1
_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev
^ permalink raw reply related [flat|nested] 4+ messages in thread
* [igt-dev] ✓ Fi.CI.BAT: success for series starting with [i-g-t,1/1] runner: Match the piglit name with -t and -x options
2018-08-14 12:38 [igt-dev] [PATCH i-g-t 1/1] runner: Match the piglit name with -t and -x options Petri Latvala
@ 2018-08-14 13:25 ` Patchwork
2018-08-14 16:49 ` [igt-dev] ✗ Fi.CI.IGT: failure " Patchwork
2018-08-16 11:16 ` [igt-dev] [PATCH i-g-t 1/1] " Arkadiusz Hiler
2 siblings, 0 replies; 4+ messages in thread
From: Patchwork @ 2018-08-14 13:25 UTC (permalink / raw)
To: Petri Latvala; +Cc: igt-dev
== Series Details ==
Series: series starting with [i-g-t,1/1] runner: Match the piglit name with -t and -x options
URL : https://patchwork.freedesktop.org/series/48180/
State : success
== Summary ==
= CI Bug Log - changes from CI_DRM_4664 -> IGTPW_1709 =
== Summary - SUCCESS ==
No regressions found.
External URL: https://patchwork.freedesktop.org/api/1.0/series/48180/revisions/1/mbox/
== Known issues ==
Here are the changes found in IGTPW_1709 that come from known issues:
=== IGT changes ===
==== Issues hit ====
igt@drv_selftest@live_hangcheck:
fi-skl-6700k2: PASS -> DMESG-FAIL (fdo#106560, fdo#107174)
fi-kbl-guc: PASS -> DMESG-FAIL (fdo#106947)
igt@drv_selftest@live_workarounds:
fi-kbl-7560u: PASS -> DMESG-FAIL (fdo#107292)
igt@kms_frontbuffer_tracking@basic:
fi-hsw-peppy: PASS -> DMESG-FAIL (fdo#102614)
{fi-byt-clapper}: PASS -> FAIL (fdo#103167)
igt@kms_pipe_crc_basic@suspend-read-crc-pipe-b:
{fi-byt-clapper}: PASS -> FAIL (fdo#103191, fdo#107362)
fi-skl-guc: PASS -> FAIL (fdo#103191)
==== Possible fixes ====
igt@drv_selftest@live_coherency:
fi-gdg-551: DMESG-FAIL (fdo#107164) -> PASS
igt@drv_selftest@live_hangcheck:
fi-skl-guc: DMESG-FAIL (fdo#107174, fdo#106685) -> PASS
igt@gem_exec_suspend@basic-s4-devices:
fi-kbl-7500u: DMESG-WARN (fdo#107139, fdo#105128) -> PASS
igt@kms_chamelium@dp-crc-fast:
fi-kbl-7500u: DMESG-FAIL (fdo#103841) -> PASS
==== Warnings ====
{igt@kms_psr@primary_page_flip}:
fi-cnl-psr: DMESG-FAIL (fdo#107372) -> DMESG-WARN (fdo#107372)
{name}: This element is suppressed. This means it is ignored when computing
the status of the difference (SUCCESS, WARNING, or FAILURE).
fdo#102614 https://bugs.freedesktop.org/show_bug.cgi?id=102614
fdo#103167 https://bugs.freedesktop.org/show_bug.cgi?id=103167
fdo#103191 https://bugs.freedesktop.org/show_bug.cgi?id=103191
fdo#103841 https://bugs.freedesktop.org/show_bug.cgi?id=103841
fdo#105128 https://bugs.freedesktop.org/show_bug.cgi?id=105128
fdo#106560 https://bugs.freedesktop.org/show_bug.cgi?id=106560
fdo#106685 https://bugs.freedesktop.org/show_bug.cgi?id=106685
fdo#106947 https://bugs.freedesktop.org/show_bug.cgi?id=106947
fdo#107139 https://bugs.freedesktop.org/show_bug.cgi?id=107139
fdo#107164 https://bugs.freedesktop.org/show_bug.cgi?id=107164
fdo#107174 https://bugs.freedesktop.org/show_bug.cgi?id=107174
fdo#107292 https://bugs.freedesktop.org/show_bug.cgi?id=107292
fdo#107362 https://bugs.freedesktop.org/show_bug.cgi?id=107362
fdo#107372 https://bugs.freedesktop.org/show_bug.cgi?id=107372
== Participating hosts (54 -> 49) ==
Missing (5): fi-ctg-p8600 fi-ilk-m540 fi-byt-squawks fi-bsw-cyan fi-hsw-4200u
== Build changes ==
* IGT: IGT_4593 -> IGTPW_1709
CI_DRM_4664: 19e458884fe1d8d10e453529933199250cc8821f @ git://anongit.freedesktop.org/gfx-ci/linux
IGTPW_1709: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_1709/
IGT_4593: c88e219c6e890d89b7836c5e248ffedf334d55a2 @ git://anongit.freedesktop.org/xorg/app/intel-gpu-tools
== Logs ==
For more details see: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_1709/issues.html
_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev
^ permalink raw reply [flat|nested] 4+ messages in thread
* [igt-dev] ✗ Fi.CI.IGT: failure for series starting with [i-g-t,1/1] runner: Match the piglit name with -t and -x options
2018-08-14 12:38 [igt-dev] [PATCH i-g-t 1/1] runner: Match the piglit name with -t and -x options Petri Latvala
2018-08-14 13:25 ` [igt-dev] ✓ Fi.CI.BAT: success for series starting with [i-g-t,1/1] " Patchwork
@ 2018-08-14 16:49 ` Patchwork
2018-08-16 11:16 ` [igt-dev] [PATCH i-g-t 1/1] " Arkadiusz Hiler
2 siblings, 0 replies; 4+ messages in thread
From: Patchwork @ 2018-08-14 16:49 UTC (permalink / raw)
To: Petri Latvala; +Cc: igt-dev
== Series Details ==
Series: series starting with [i-g-t,1/1] runner: Match the piglit name with -t and -x options
URL : https://patchwork.freedesktop.org/series/48180/
State : failure
== Summary ==
= CI Bug Log - changes from IGT_4593_full -> IGTPW_1709_full =
== Summary - FAILURE ==
Serious unknown changes coming with IGTPW_1709_full absolutely need to be
verified manually.
If you think the reported changes have nothing to do with the changes
introduced in IGTPW_1709_full, please notify your bug team to allow them
to document this new failure mode, which will reduce false positives in CI.
External URL: https://patchwork.freedesktop.org/api/1.0/series/48180/revisions/1/mbox/
== Possible new issues ==
Here are the unknown changes that may have been introduced in IGTPW_1709_full:
=== IGT changes ===
==== Possible regressions ====
igt@gem_eio@in-flight-suspend:
shard-glk: PASS -> DMESG-WARN
igt@gem_eio@reset-stress:
shard-kbl: PASS -> FAIL
== Known issues ==
Here are the changes found in IGTPW_1709_full that come from known issues:
=== IGT changes ===
==== Issues hit ====
igt@gem_exec_schedule@pi-ringfull-render:
shard-glk: NOTRUN -> FAIL (fdo#103158)
igt@gem_exec_suspend@basic-s4-devices:
shard-snb: PASS -> INCOMPLETE (fdo#105411) +1
igt@kms_plane@plane-panning-bottom-right-suspend-pipe-a-planes:
shard-kbl: PASS -> INCOMPLETE (fdo#103665, fdo#107556)
igt@kms_rotation_crc@primary-rotation-180:
shard-snb: PASS -> FAIL (fdo#103925)
igt@kms_setmode@basic:
shard-apl: PASS -> FAIL (fdo#99912)
==== Possible fixes ====
igt@drv_suspend@shrink:
shard-snb: INCOMPLETE (fdo#106886, fdo#105411) -> PASS
igt@kms_flip@2x-flip-vs-expired-vblank:
shard-glk: FAIL (fdo#105363) -> PASS
igt@kms_flip@flip-vs-expired-vblank-interruptible:
shard-glk: FAIL (fdo#105363, fdo#102887) -> PASS
igt@kms_rotation_crc@sprite-rotation-180:
shard-snb: FAIL (fdo#103925) -> PASS
igt@perf_pmu@busy-accuracy-50-bcs0:
shard-snb: INCOMPLETE (fdo#105411) -> SKIP
fdo#102887 https://bugs.freedesktop.org/show_bug.cgi?id=102887
fdo#103158 https://bugs.freedesktop.org/show_bug.cgi?id=103158
fdo#103665 https://bugs.freedesktop.org/show_bug.cgi?id=103665
fdo#103925 https://bugs.freedesktop.org/show_bug.cgi?id=103925
fdo#105363 https://bugs.freedesktop.org/show_bug.cgi?id=105363
fdo#105411 https://bugs.freedesktop.org/show_bug.cgi?id=105411
fdo#106886 https://bugs.freedesktop.org/show_bug.cgi?id=106886
fdo#107556 https://bugs.freedesktop.org/show_bug.cgi?id=107556
fdo#99912 https://bugs.freedesktop.org/show_bug.cgi?id=99912
== Participating hosts (5 -> 5) ==
No changes in participating hosts
== Build changes ==
* IGT: IGT_4593 -> IGTPW_1709
* Linux: CI_DRM_4660 -> CI_DRM_4664
CI_DRM_4660: 9cd882754c1017e68ed9d2c8d57dc326530522fe @ git://anongit.freedesktop.org/gfx-ci/linux
CI_DRM_4664: 19e458884fe1d8d10e453529933199250cc8821f @ git://anongit.freedesktop.org/gfx-ci/linux
IGTPW_1709: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_1709/
IGT_4593: c88e219c6e890d89b7836c5e248ffedf334d55a2 @ git://anongit.freedesktop.org/xorg/app/intel-gpu-tools
== Logs ==
For more details see: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_1709/shards.html
_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: [igt-dev] [PATCH i-g-t 1/1] runner: Match the piglit name with -t and -x options
2018-08-14 12:38 [igt-dev] [PATCH i-g-t 1/1] runner: Match the piglit name with -t and -x options Petri Latvala
2018-08-14 13:25 ` [igt-dev] ✓ Fi.CI.BAT: success for series starting with [i-g-t,1/1] " Patchwork
2018-08-14 16:49 ` [igt-dev] ✗ Fi.CI.IGT: failure " Patchwork
@ 2018-08-16 11:16 ` Arkadiusz Hiler
2 siblings, 0 replies; 4+ messages in thread
From: Arkadiusz Hiler @ 2018-08-16 11:16 UTC (permalink / raw)
To: Petri Latvala; +Cc: igt-dev, Tomi Sarvela
On Tue, Aug 14, 2018 at 03:38:31PM +0300, Petri Latvala wrote:
> Instead of just matching the binary/subtest name.
>
> Originally not implemented to get the runner landed faster. Turned out
> to be simple enough.
>
> Signed-off-by: Petri Latvala <petri.latvala@intel.com>
> Cc: Tomi Sarvela <tomi.p.sarvela@intel.com>
> Cc: Arkadiusz Hiler <arkadiusz.hiler@intel.com>
Reviewed-by: Arkadiusz Hiler <arkadiusz.hiler@intel.com>
_______________________________________________
igt-dev mailing list
igt-dev@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/igt-dev
^ permalink raw reply [flat|nested] 4+ messages in thread
end of thread, other threads:[~2018-08-16 11:16 UTC | newest]
Thread overview: 4+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2018-08-14 12:38 [igt-dev] [PATCH i-g-t 1/1] runner: Match the piglit name with -t and -x options Petri Latvala
2018-08-14 13:25 ` [igt-dev] ✓ Fi.CI.BAT: success for series starting with [i-g-t,1/1] " Patchwork
2018-08-14 16:49 ` [igt-dev] ✗ Fi.CI.IGT: failure " Patchwork
2018-08-16 11:16 ` [igt-dev] [PATCH i-g-t 1/1] " Arkadiusz Hiler
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).