Igt-dev Archive on lore.kernel.org
 help / color / mirror / Atom feed
* [PATCH i-g-t 0/1] relax doc generation for non-compiled tests
@ 2024-09-12 14:04 Kamil Konieczny
  2024-09-12 14:04 ` [PATCH i-g-t 1/1] scripts/test_list: relax treatment of " Kamil Konieczny
                   ` (5 more replies)
  0 siblings, 6 replies; 8+ messages in thread
From: Kamil Konieczny @ 2024-09-12 14:04 UTC (permalink / raw)
  To: igt-dev
  Cc: Kamil Konieczny, Christoph Manszewski, Zbigniew Kempczyński,
	Jari Tahvanainen, Katarzyna Piecielska, Mauro Carvalho Chehab

New tests added with conditional compilation result in error reported
when generating testlist. For example, with a recent series with new
eudebug igt tests from here:
https://patchwork.freedesktop.org/series/136623/
("Test coverage for GPU debug support")

when --exclude-files option was removed from version 6:
https://patchwork.freedesktop.org/series/136623/#rev6

then compiling with testplan report warnings:

xe_eudebug.testlist: Testlist file not found.
xe_eudebug_online.testlist: Testlist file not found.
xe_exec_sip_eudebug.testlist: Testlist file not found.
Warning: Documented igt@xe_eudebug@attach-debug-metadata doesn't exist on source files
Warning: Documented igt@xe_eudebug@basic-client doesn't exist on source files
Warning: Documented igt@xe_eudebug@basic-client-th doesn't exist on source files
[...rest omitted...]

and exits with an error.

Relax that check to only report error on missing documentation, and treat
new added tests without a compiled binary as a new tests under development
or as tests outside a compilation scope (such as chamelium). This should
allow to have new tests in documentation and track them.

With dropped --exclude-files patch and dropped changes in docs/testplan/meson.build
generation of testplan succeeds and in report it can be find:

[1897/1905] Generating docs/testplan/xe_tests.rst with a custom command
xe_eudebug.testlist: Testlist file not found.
xe_eudebug_online.testlist: Testlist file not found.
xe_exec_sip_eudebug.testlist: Testlist file not found.
xe_eudebug: No binary found, test was not compiled.
xe_eudebug_online: No binary found, test was not compiled.
xe_exec_sip_eudebug: No binary found, test was not compiled.
Info: Documented igt@xe_eudebug@attach-debug-metadata don't have a binary xe_eudebug
Info: Documented igt@xe_eudebug_online@basic-breakpoint don't have a binary xe_eudebug_online
Info: Documented igt@xe_exec_sip_eudebug@breakpoint-waitsip don't have a binary xe_exec_sip_eudebug
[1898/1905] Generating docs/testplan/i915_tests.rst with a custom command
[1899/1905] Generating docs/testplan/kms_tests.rst with a custom command
[1900/1905] Generating docs/testplan/intel-ci-tests with a custom command
[1901/1905] Generating docs/testplan/xe_tests.html with a custom command
[1902/1905] Generating docs/testplan/i915_tests.html with a custom command
[1903/1905] Compiling C object runner/runner_test.p/runner_tests.c.o
[1904/1905] Generating docs/testplan/kms_tests.html with a custom command
[1905/1905] Linking target runner/runner_test


Cc: Christoph Manszewski <christoph.manszewski@intel.com>
Cc: Zbigniew Kempczyński <zbigniew.kempczynski@intel.com>
Cc: Jari Tahvanainen <jari.tahvanainen@intel.com>
Cc: Katarzyna Piecielska <katarzyna.piecielska@intel.com>
Cc: Mauro Carvalho Chehab <mchehab@kernel.org>

Kamil Konieczny (1):
  scripts/test_list: relax treatment of non-compiled tests

 scripts/test_list.py | 31 +++++++++++++++++++++++++++++--
 1 file changed, 29 insertions(+), 2 deletions(-)

-- 
2.43.0


^ permalink raw reply	[flat|nested] 8+ messages in thread

end of thread, other threads:[~2024-09-13 11:03 UTC | newest]

Thread overview: 8+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2024-09-12 14:04 [PATCH i-g-t 0/1] relax doc generation for non-compiled tests Kamil Konieczny
2024-09-12 14:04 ` [PATCH i-g-t 1/1] scripts/test_list: relax treatment of " Kamil Konieczny
2024-09-13 11:03   ` Manszewski, Christoph
2024-09-12 16:47 ` ✓ Fi.CI.BAT: success for relax doc generation for " Patchwork
2024-09-12 17:06 ` ✓ CI.xeBAT: " Patchwork
2024-09-13  5:11 ` ✗ CI.xeFULL: failure " Patchwork
2024-09-13  6:02 ` ✗ Fi.CI.IGT: " Patchwork
2024-09-13 10:58 ` [PATCH i-g-t 0/1] " Manszewski, Christoph

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox