* [igt-dev] [PATCH i-g-t v2 0/4] generate an ordered testlist for Xe driver
@ 2023-06-20 8:55 Mauro Carvalho Chehab
2023-06-20 8:55 ` [igt-dev] [PATCH i-g-t v2 1/4] scripts/test_list.py: add support for ordering testlists Mauro Carvalho Chehab
` (5 more replies)
0 siblings, 6 replies; 11+ messages in thread
From: Mauro Carvalho Chehab @ 2023-06-20 8:55 UTC (permalink / raw)
To: igt-dev
From: Mauro Carvalho Chehab <mchehab@kernel.org>
Add support for ordering tests at the documentation tool, and produce
Xe fast feedback testlists on an ordered way.
---
v2: added an extra patch to sort the tests alphabetically before
start ordering it.
Mauro Carvalho Chehab (4):
scripts/test_list.py: add support for ordering testlists
xe_test_config.json: add an order for run type
tests/xe: add run type fields to order testlists
scripts/test_list.py: produce alphabetically ordered testlists
scripts/test_list.py | 84 +++++++++++++++++++++++++++---------
tests/xe/xe_live_ktest.c | 2 +-
tests/xe/xe_module_load.c | 2 +-
tests/xe/xe_test_config.json | 7 ++-
4 files changed, 72 insertions(+), 23 deletions(-)
--
2.40.1
^ permalink raw reply [flat|nested] 11+ messages in thread
* [igt-dev] [PATCH i-g-t v2 1/4] scripts/test_list.py: add support for ordering testlists
2023-06-20 8:55 [igt-dev] [PATCH i-g-t v2 0/4] generate an ordered testlist for Xe driver Mauro Carvalho Chehab
@ 2023-06-20 8:55 ` Mauro Carvalho Chehab
2023-06-21 16:44 ` Kamil Konieczny
2023-06-20 8:55 ` [igt-dev] [PATCH i-g-t v2 2/4] xe_test_config.json: add an order for run type Mauro Carvalho Chehab
` (4 subsequent siblings)
5 siblings, 1 reply; 11+ messages in thread
From: Mauro Carvalho Chehab @ 2023-06-20 8:55 UTC (permalink / raw)
To: igt-dev
From: Mauro Carvalho Chehab <mchehab@kernel.org>
Testlists usually require an special order, like:
- an initial test which loads the driver;
- normal tests;
- dangerous tests (like KUnit ones).
Add support to handle order, by adding an "order" property at
the config file.
Signed-off-by: Mauro Carvalho Chehab <mchehab@kernel.org>
---
scripts/test_list.py | 55 ++++++++++++++++++++++++++++++++++++++------
1 file changed, 48 insertions(+), 7 deletions(-)
diff --git a/scripts/test_list.py b/scripts/test_list.py
index f676024c9571..76fdcf3dbb4f 100755
--- a/scripts/test_list.py
+++ b/scripts/test_list.py
@@ -819,18 +819,25 @@ class TestList:
# Subtest list methods
#
- def get_subtests(self, sort_field = None, expand = None):
+ def get_subtests(self, sort_field = None, expand = None, with_order = False):
"""Return an array with all subtests"""
subtests = {}
subtests[""] = []
+ order = None
+
if sort_field:
if sort_field.lower() not in self.field_list:
sys.exit(f"Field '{sort_field}' is not defined")
sort_field = self.field_list[sort_field.lower()]
+ if with_order:
+ if "_properties_" in self.props[sort_field]:
+ if "order" in self.props[sort_field]["_properties_"]:
+ order = self.props[sort_field]["_properties_"]["order"]
+
for test in sorted(self.doc.keys()):
fname = self.doc[test]["File"]
@@ -848,20 +855,54 @@ class TestList:
if sort_field in subtest:
if expand:
test_list = subtest[sort_field].split(expand)
+ test_list = [s.strip() for s in test_list]
+
for test_elem in test_list:
- test_elem = test_elem.strip()
if test_elem not in subtests:
subtests[test_elem] = []
- subtests[test_elem].append(subtest["Summary"])
+ if order:
+ subtests[test_elem].append((subtest["Summary"], test_list))
+ else:
+ subtests[test_elem].append(subtest["Summary"])
else:
if subtest[sort_field] not in subtests:
subtests[subtest[sort_field]] = []
- subtests[subtest[sort_field]].append(subtest["Summary"])
+ if order:
+ subtests[test_elem].append((subtest["Summary"], [subtest[sort_field]]))
+ else:
+ subtests[subtest[sort_field]].append(subtest["Summary"])
+ else:
+ if order:
+ subtests[test_elem].append((subtest["Summary"], [subtest[sort_field]]))
+ else:
+ subtests[""].append(subtest["Summary"])
+
+ else:
+ if order:
+ subtests[test_elem].append((subtest["Summary"], [subtest[sort_field]]))
else:
subtests[""].append(subtest["Summary"])
- else:
- subtests[""].append(subtest["Summary"])
+ if order:
+ for group, tests in subtests.items():
+ prefix_tests = []
+ suffix_tests = []
+ middle_tests = []
+ is_prefix = True
+ for k in order:
+ if k == "__all__":
+ is_prefix = False
+ continue
+ for test in tests:
+ if k in test[1]:
+ if is_prefix:
+ prefix_tests.append(test[0])
+ else:
+ suffix_tests.append(test[0])
+ for test in tests:
+ if test[0] not in prefix_tests and test[0] not in suffix_tests:
+ middle_tests.append(test[0])
+ subtests[group] = prefix_tests + middle_tests + suffix_tests
return subtests
@@ -1203,7 +1244,7 @@ class TestList:
test_prefix = re.sub(r'^igt@', '', test_prefix)
# NOTE: currently, it uses a comma for multi-value delimitter
- test_subtests = self.get_subtests(sort_field, ",")
+ test_subtests = self.get_subtests(sort_field, ",", with_order = True)
if not os.path.exists(directory):
os.makedirs(directory)
--
2.40.1
^ permalink raw reply related [flat|nested] 11+ messages in thread
* [igt-dev] [PATCH i-g-t v2 2/4] xe_test_config.json: add an order for run type
2023-06-20 8:55 [igt-dev] [PATCH i-g-t v2 0/4] generate an ordered testlist for Xe driver Mauro Carvalho Chehab
2023-06-20 8:55 ` [igt-dev] [PATCH i-g-t v2 1/4] scripts/test_list.py: add support for ordering testlists Mauro Carvalho Chehab
@ 2023-06-20 8:55 ` Mauro Carvalho Chehab
2023-06-21 16:45 ` Kamil Konieczny
2023-06-20 8:55 ` [igt-dev] [PATCH i-g-t v2 3/4] tests/xe: add run type fields to order testlists Mauro Carvalho Chehab
` (3 subsequent siblings)
5 siblings, 1 reply; 11+ messages in thread
From: Mauro Carvalho Chehab @ 2023-06-20 8:55 UTC (permalink / raw)
To: igt-dev
From: Mauro Carvalho Chehab <mchehab@kernel.org>
When generating test lists based on run type for the Xe driver,
order them in a way that the first test will be the one called
after booting the machine (e. g. module load), then normal tests
and finally KUnit ones.
Signed-off-by: Mauro Carvalho Chehab <mchehab@kernel.org>
---
tests/xe/xe_test_config.json | 7 ++++++-
1 file changed, 6 insertions(+), 1 deletion(-)
diff --git a/tests/xe/xe_test_config.json b/tests/xe/xe_test_config.json
index 334d372d1330..e89f998bc66b 100644
--- a/tests/xe/xe_test_config.json
+++ b/tests/xe/xe_test_config.json
@@ -22,7 +22,12 @@
},
"Run type": {
"_properties_": {
- "description": "Defines what category of testlist it belongs"
+ "description": "Defines what category of testlist it belongs",
+ "order": [
+ "boot",
+ "__all__",
+ "kunit"
+ ]
}
}
}
--
2.40.1
^ permalink raw reply related [flat|nested] 11+ messages in thread
* [igt-dev] [PATCH i-g-t v2 3/4] tests/xe: add run type fields to order testlists
2023-06-20 8:55 [igt-dev] [PATCH i-g-t v2 0/4] generate an ordered testlist for Xe driver Mauro Carvalho Chehab
2023-06-20 8:55 ` [igt-dev] [PATCH i-g-t v2 1/4] scripts/test_list.py: add support for ordering testlists Mauro Carvalho Chehab
2023-06-20 8:55 ` [igt-dev] [PATCH i-g-t v2 2/4] xe_test_config.json: add an order for run type Mauro Carvalho Chehab
@ 2023-06-20 8:55 ` Mauro Carvalho Chehab
2023-06-21 16:46 ` Kamil Konieczny
2023-06-20 8:55 ` [igt-dev] [PATCH i-g-t v2 4/4] scripts/test_list.py: produce alphabetically ordered testlists Mauro Carvalho Chehab
` (2 subsequent siblings)
5 siblings, 1 reply; 11+ messages in thread
From: Mauro Carvalho Chehab @ 2023-06-20 8:55 UTC (permalink / raw)
To: igt-dev
From: Mauro Carvalho Chehab <mchehab@kernel.org>
Order tests at the fast feedback testlist, when generating
testlists based on Run type field:
- add boot to xe_module_load, to run such test first when producing
a fast feedback testlist;
- place kunit tests at the end of the fast feedback testlist, as they
have a higher chance of causing GPU hangups.
Signed-off-by: Mauro Carvalho Chehab <mchehab@kernel.org>
---
tests/xe/xe_live_ktest.c | 2 +-
tests/xe/xe_module_load.c | 2 +-
2 files changed, 2 insertions(+), 2 deletions(-)
diff --git a/tests/xe/xe_live_ktest.c b/tests/xe/xe_live_ktest.c
index 7dcf679069b8..f0cbf4f623bc 100644
--- a/tests/xe/xe_live_ktest.c
+++ b/tests/xe/xe_live_ktest.c
@@ -8,7 +8,7 @@
* Sub-category: kunit
* Functionality: kunit
* Test category: functionality test
- * Run type: BAT
+ * Run type: BAT, kunit
*
* SUBTEST: bo
* Functionality: bo
diff --git a/tests/xe/xe_module_load.c b/tests/xe/xe_module_load.c
index 1c2d4a2e2ea3..3b2dc1fdc90f 100644
--- a/tests/xe/xe_module_load.c
+++ b/tests/xe/xe_module_load.c
@@ -99,7 +99,7 @@ static const char * const unwanted_drivers[] = {
/**
* SUBTEST: force-load
* Description: Load the Xe driver passing ``force_probe=*`` parameter
- * Run type: BAT
+ * Run type: BAT, boot
*
* SUBTEST: load
* Description: Load the Xe driver
--
2.40.1
^ permalink raw reply related [flat|nested] 11+ messages in thread
* [igt-dev] [PATCH i-g-t v2 4/4] scripts/test_list.py: produce alphabetically ordered testlists
2023-06-20 8:55 [igt-dev] [PATCH i-g-t v2 0/4] generate an ordered testlist for Xe driver Mauro Carvalho Chehab
` (2 preceding siblings ...)
2023-06-20 8:55 ` [igt-dev] [PATCH i-g-t v2 3/4] tests/xe: add run type fields to order testlists Mauro Carvalho Chehab
@ 2023-06-20 8:55 ` Mauro Carvalho Chehab
2023-06-21 16:48 ` Kamil Konieczny
2023-06-20 10:54 ` [igt-dev] ✓ Fi.CI.BAT: success for generate an ordered testlist for Xe driver (rev2) Patchwork
2023-06-20 15:43 ` [igt-dev] ✓ Fi.CI.IGT: " Patchwork
5 siblings, 1 reply; 11+ messages in thread
From: Mauro Carvalho Chehab @ 2023-06-20 8:55 UTC (permalink / raw)
To: igt-dev
From: Mauro Carvalho Chehab <mchehab@kernel.org>
Before start handling the subtest arrays, order it, in order
it alphabetically.
This should produce a better ordered testlist.
Signed-off-by: Mauro Carvalho Chehab <mchehab@kernel.org>
---
scripts/test_list.py | 59 +++++++++++++++++++++++---------------------
1 file changed, 31 insertions(+), 28 deletions(-)
diff --git a/scripts/test_list.py b/scripts/test_list.py
index 76fdcf3dbb4f..a55d2977c7c3 100755
--- a/scripts/test_list.py
+++ b/scripts/test_list.py
@@ -838,6 +838,7 @@ class TestList:
if "order" in self.props[sort_field]["_properties_"]:
order = self.props[sort_field]["_properties_"]["order"]
+ subtest_array = []
for test in sorted(self.doc.keys()):
fname = self.doc[test]["File"]
@@ -845,44 +846,46 @@ class TestList:
test_name = re.sub(r'\.[ch]', '', test_name)
test_name = "igt@" + test_name
- subtest_array = self.expand_subtest(fname, test_name, test, True)
+ subtest_array += self.expand_subtest(fname, test_name, test, True)
- for subtest in subtest_array:
- if self.__filter_subtest(test, subtest, True):
- continue
+ subtest_array.sort(key = lambda x : x.get('Summary'))
- if sort_field:
- if sort_field in subtest:
- if expand:
- test_list = subtest[sort_field].split(expand)
- test_list = [s.strip() for s in test_list]
+ for subtest in subtest_array:
+ if self.__filter_subtest(test, subtest, True):
+ continue
- for test_elem in test_list:
- if test_elem not in subtests:
- subtests[test_elem] = []
- if order:
- subtests[test_elem].append((subtest["Summary"], test_list))
- else:
- subtests[test_elem].append(subtest["Summary"])
- else:
- if subtest[sort_field] not in subtests:
- subtests[subtest[sort_field]] = []
- if order:
- subtests[test_elem].append((subtest["Summary"], [subtest[sort_field]]))
- else:
- subtests[subtest[sort_field]].append(subtest["Summary"])
+ if sort_field:
+ if sort_field in subtest:
+ if expand:
+ test_list = subtest[sort_field].split(expand)
+ test_list = [s.strip() for s in test_list]
+
+ for test_elem in test_list:
+ if test_elem not in subtests:
+ subtests[test_elem] = []
+ if order:
+ subtests[test_elem].append((subtest["Summary"], test_list))
+ else:
+ subtests[test_elem].append(subtest["Summary"])
else:
- if order:
- subtests[test_elem].append((subtest["Summary"], [subtest[sort_field]]))
- else:
- subtests[""].append(subtest["Summary"])
-
+ if subtest[sort_field] not in subtests:
+ subtests[subtest[sort_field]] = []
+ if order:
+ subtests[test_elem].append((subtest["Summary"], [subtest[sort_field]]))
+ else:
+ subtests[subtest[sort_field]].append(subtest["Summary"])
else:
if order:
subtests[test_elem].append((subtest["Summary"], [subtest[sort_field]]))
else:
subtests[""].append(subtest["Summary"])
+ else:
+ if order:
+ subtests[test_elem].append((subtest["Summary"], [subtest[sort_field]]))
+ else:
+ subtests[""].append(subtest["Summary"])
+
if order:
for group, tests in subtests.items():
prefix_tests = []
--
2.40.1
^ permalink raw reply related [flat|nested] 11+ messages in thread
* [igt-dev] ✓ Fi.CI.BAT: success for generate an ordered testlist for Xe driver (rev2)
2023-06-20 8:55 [igt-dev] [PATCH i-g-t v2 0/4] generate an ordered testlist for Xe driver Mauro Carvalho Chehab
` (3 preceding siblings ...)
2023-06-20 8:55 ` [igt-dev] [PATCH i-g-t v2 4/4] scripts/test_list.py: produce alphabetically ordered testlists Mauro Carvalho Chehab
@ 2023-06-20 10:54 ` Patchwork
2023-06-20 15:43 ` [igt-dev] ✓ Fi.CI.IGT: " Patchwork
5 siblings, 0 replies; 11+ messages in thread
From: Patchwork @ 2023-06-20 10:54 UTC (permalink / raw)
To: Mauro Carvalho Chehab; +Cc: igt-dev
[-- Attachment #1: Type: text/plain, Size: 5150 bytes --]
== Series Details ==
Series: generate an ordered testlist for Xe driver (rev2)
URL : https://patchwork.freedesktop.org/series/119570/
State : success
== Summary ==
CI Bug Log - changes from CI_DRM_13291 -> IGTPW_9215
====================================================
Summary
-------
**SUCCESS**
No regressions found.
External URL: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/index.html
Participating hosts (42 -> 42)
------------------------------
Additional (1): bat-dg1-8
Missing (1): fi-snb-2520m
Known issues
------------
Here are the changes found in IGTPW_9215 that come from known issues:
### IGT changes ###
#### Issues hit ####
* igt@i915_selftest@live@gt_mocs:
- bat-mtlp-8: [PASS][1] -> [DMESG-FAIL][2] ([i915#7059])
[1]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_13291/bat-mtlp-8/igt@i915_selftest@live@gt_mocs.html
[2]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/bat-mtlp-8/igt@i915_selftest@live@gt_mocs.html
* igt@i915_selftest@live@guc:
- bat-rpls-2: [PASS][3] -> [DMESG-WARN][4] ([i915#7852])
[3]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_13291/bat-rpls-2/igt@i915_selftest@live@guc.html
[4]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/bat-rpls-2/igt@i915_selftest@live@guc.html
* igt@i915_selftest@live@migrate:
- bat-dg2-11: [PASS][5] -> [DMESG-WARN][6] ([i915#7699])
[5]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_13291/bat-dg2-11/igt@i915_selftest@live@migrate.html
[6]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/bat-dg2-11/igt@i915_selftest@live@migrate.html
* igt@i915_selftest@live@slpc:
- bat-rpls-2: [PASS][7] -> [DMESG-WARN][8] ([i915#6367])
[7]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_13291/bat-rpls-2/igt@i915_selftest@live@slpc.html
[8]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/bat-rpls-2/igt@i915_selftest@live@slpc.html
#### Possible fixes ####
* igt@gem_exec_parallel@engines@userptr:
- bat-mtlp-6: [FAIL][9] ([i915#8672]) -> [PASS][10]
[9]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_13291/bat-mtlp-6/igt@gem_exec_parallel@engines@userptr.html
[10]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/bat-mtlp-6/igt@gem_exec_parallel@engines@userptr.html
* igt@i915_selftest@live@requests:
- bat-mtlp-6: [DMESG-FAIL][11] ([i915#7269]) -> [PASS][12]
[11]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_13291/bat-mtlp-6/igt@i915_selftest@live@requests.html
[12]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/bat-mtlp-6/igt@i915_selftest@live@requests.html
* igt@kms_pipe_crc_basic@nonblocking-crc-frame-sequence@pipe-c-dp-1:
- bat-dg2-8: [FAIL][13] ([i915#7932]) -> [PASS][14]
[13]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_13291/bat-dg2-8/igt@kms_pipe_crc_basic@nonblocking-crc-frame-sequence@pipe-c-dp-1.html
[14]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/bat-dg2-8/igt@kms_pipe_crc_basic@nonblocking-crc-frame-sequence@pipe-c-dp-1.html
{name}: This element is suppressed. This means it is ignored when computing
the status of the difference (SUCCESS, WARNING, or FAILURE).
[i915#1072]: https://gitlab.freedesktop.org/drm/intel/issues/1072
[i915#1845]: https://gitlab.freedesktop.org/drm/intel/issues/1845
[i915#3637]: https://gitlab.freedesktop.org/drm/intel/issues/3637
[i915#4078]: https://gitlab.freedesktop.org/drm/intel/issues/4078
[i915#4391]: https://gitlab.freedesktop.org/drm/intel/issues/4391
[i915#6367]: https://gitlab.freedesktop.org/drm/intel/issues/6367
[i915#7059]: https://gitlab.freedesktop.org/drm/intel/issues/7059
[i915#7269]: https://gitlab.freedesktop.org/drm/intel/issues/7269
[i915#7699]: https://gitlab.freedesktop.org/drm/intel/issues/7699
[i915#7828]: https://gitlab.freedesktop.org/drm/intel/issues/7828
[i915#7852]: https://gitlab.freedesktop.org/drm/intel/issues/7852
[i915#7932]: https://gitlab.freedesktop.org/drm/intel/issues/7932
[i915#8213]: https://gitlab.freedesktop.org/drm/intel/issues/8213
[i915#8513]: https://gitlab.freedesktop.org/drm/intel/issues/8513
[i915#8672]: https://gitlab.freedesktop.org/drm/intel/issues/8672
[i915#8676]: https://gitlab.freedesktop.org/drm/intel/issues/8676
[i915#8678]: https://gitlab.freedesktop.org/drm/intel/issues/8678
[i915#8679]: https://gitlab.freedesktop.org/drm/intel/issues/8679
[i915#8698]: https://gitlab.freedesktop.org/drm/intel/issues/8698
[i915#8699]: https://gitlab.freedesktop.org/drm/intel/issues/8699
[i915#8700]: https://gitlab.freedesktop.org/drm/intel/issues/8700
Build changes
-------------
* CI: CI-20190529 -> None
* IGT: IGT_7339 -> IGTPW_9215
CI-20190529: 20190529
CI_DRM_13291: 44951a61f5bdf3c19584ce0e1da5df07224d6c38 @ git://anongit.freedesktop.org/gfx-ci/linux
IGTPW_9215: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/index.html
IGT_7339: 4476edb0fb09b886f7e667d1174d13299d98c23f @ https://gitlab.freedesktop.org/drm/igt-gpu-tools.git
== Logs ==
For more details see: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/index.html
[-- Attachment #2: Type: text/html, Size: 4979 bytes --]
^ permalink raw reply [flat|nested] 11+ messages in thread
* [igt-dev] ✓ Fi.CI.IGT: success for generate an ordered testlist for Xe driver (rev2)
2023-06-20 8:55 [igt-dev] [PATCH i-g-t v2 0/4] generate an ordered testlist for Xe driver Mauro Carvalho Chehab
` (4 preceding siblings ...)
2023-06-20 10:54 ` [igt-dev] ✓ Fi.CI.BAT: success for generate an ordered testlist for Xe driver (rev2) Patchwork
@ 2023-06-20 15:43 ` Patchwork
5 siblings, 0 replies; 11+ messages in thread
From: Patchwork @ 2023-06-20 15:43 UTC (permalink / raw)
To: Mauro Carvalho Chehab; +Cc: igt-dev
[-- Attachment #1: Type: text/plain, Size: 32701 bytes --]
== Series Details ==
Series: generate an ordered testlist for Xe driver (rev2)
URL : https://patchwork.freedesktop.org/series/119570/
State : success
== Summary ==
CI Bug Log - changes from CI_DRM_13291_full -> IGTPW_9215_full
====================================================
Summary
-------
**SUCCESS**
No regressions found.
External URL: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/index.html
Participating hosts (8 -> 8)
------------------------------
Additional (1): shard-tglu0
Missing (1): shard-rkl0
Known issues
------------
Here are the changes found in IGTPW_9215_full that come from known issues:
### IGT changes ###
#### Issues hit ####
* igt@drm_fdinfo@most-busy-idle-check-all@rcs0:
- shard-rkl: [PASS][1] -> [FAIL][2] ([i915#7742])
[1]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_13291/shard-rkl-1/igt@drm_fdinfo@most-busy-idle-check-all@rcs0.html
[2]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-1/igt@drm_fdinfo@most-busy-idle-check-all@rcs0.html
* igt@gem_basic@multigpu-create-close:
- shard-rkl: NOTRUN -> [SKIP][3] ([i915#7697])
[3]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-4/igt@gem_basic@multigpu-create-close.html
* igt@gem_exec_balancer@parallel-bb-first:
- shard-rkl: NOTRUN -> [SKIP][4] ([i915#4525])
[4]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-6/igt@gem_exec_balancer@parallel-bb-first.html
* igt@gem_exec_fair@basic-deadline:
- shard-glk: [PASS][5] -> [FAIL][6] ([i915#2846])
[5]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_13291/shard-glk1/igt@gem_exec_fair@basic-deadline.html
[6]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-glk8/igt@gem_exec_fair@basic-deadline.html
* igt@gem_exec_fair@basic-none-solo@rcs0:
- shard-apl: [PASS][7] -> [FAIL][8] ([i915#2842])
[7]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_13291/shard-apl6/igt@gem_exec_fair@basic-none-solo@rcs0.html
[8]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-apl7/igt@gem_exec_fair@basic-none-solo@rcs0.html
* igt@gem_exec_suspend@basic-s4-devices@smem:
- shard-rkl: NOTRUN -> [ABORT][9] ([i915#7975] / [i915#8213])
[9]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-1/igt@gem_exec_suspend@basic-s4-devices@smem.html
* igt@gem_lmem_swapping@heavy-verify-multi-ccs:
- shard-glk: NOTRUN -> [SKIP][10] ([fdo#109271] / [i915#4613])
[10]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-glk7/igt@gem_lmem_swapping@heavy-verify-multi-ccs.html
* igt@gem_lmem_swapping@heavy-verify-random-ccs:
- shard-rkl: NOTRUN -> [SKIP][11] ([i915#4613]) +2 similar issues
[11]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-7/igt@gem_lmem_swapping@heavy-verify-random-ccs.html
* igt@gem_ppgtt@blt-vs-render-ctxn:
- shard-snb: [PASS][12] -> [INCOMPLETE][13] ([i915#8295])
[12]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_13291/shard-snb4/igt@gem_ppgtt@blt-vs-render-ctxn.html
[13]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-snb6/igt@gem_ppgtt@blt-vs-render-ctxn.html
* igt@gem_pxp@reject-modify-context-protection-on:
- shard-rkl: NOTRUN -> [SKIP][14] ([i915#4270])
[14]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-2/igt@gem_pxp@reject-modify-context-protection-on.html
* igt@gem_readwrite@new-obj:
- shard-rkl: NOTRUN -> [SKIP][15] ([i915#3282]) +1 similar issue
[15]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-4/igt@gem_readwrite@new-obj.html
* igt@gem_userptr_blits@coherency-unsync:
- shard-rkl: NOTRUN -> [SKIP][16] ([i915#3297])
[16]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-7/igt@gem_userptr_blits@coherency-unsync.html
* igt@gem_userptr_blits@dmabuf-sync:
- shard-glk: NOTRUN -> [SKIP][17] ([fdo#109271] / [i915#3323])
[17]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-glk6/igt@gem_userptr_blits@dmabuf-sync.html
* igt@gem_userptr_blits@readonly-pwrite-unsync:
- shard-tglu: NOTRUN -> [SKIP][18] ([i915#3297]) +1 similar issue
[18]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-tglu-9/igt@gem_userptr_blits@readonly-pwrite-unsync.html
* igt@gen3_render_tiledy_blits:
- shard-rkl: NOTRUN -> [SKIP][19] ([fdo#109289])
[19]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-6/igt@gen3_render_tiledy_blits.html
* igt@gen9_exec_parse@batch-invalid-length:
- shard-rkl: NOTRUN -> [SKIP][20] ([i915#2527])
[20]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-4/igt@gen9_exec_parse@batch-invalid-length.html
* igt@i915_hwmon@hwmon-read:
- shard-rkl: NOTRUN -> [SKIP][21] ([i915#7707])
[21]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-4/igt@i915_hwmon@hwmon-read.html
* igt@i915_pm_dc@dc6-dpms:
- shard-tglu: [PASS][22] -> [FAIL][23] ([i915#3989] / [i915#454])
[22]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_13291/shard-tglu-4/igt@i915_pm_dc@dc6-dpms.html
[23]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-tglu-6/igt@i915_pm_dc@dc6-dpms.html
* igt@i915_pm_dc@dc9-dpms:
- shard-tglu: [PASS][24] -> [SKIP][25] ([i915#4281])
[24]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_13291/shard-tglu-2/igt@i915_pm_dc@dc9-dpms.html
[25]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-tglu-5/igt@i915_pm_dc@dc9-dpms.html
* igt@i915_pm_rpm@dpms-mode-unset-lpsp:
- shard-rkl: NOTRUN -> [SKIP][26] ([i915#1397])
[26]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-4/igt@i915_pm_rpm@dpms-mode-unset-lpsp.html
* igt@i915_pm_rpm@gem-execbuf-stress-pc8:
- shard-rkl: NOTRUN -> [SKIP][27] ([fdo#109506])
[27]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-7/igt@i915_pm_rpm@gem-execbuf-stress-pc8.html
* igt@i915_selftest@perf@engine_cs:
- shard-snb: [PASS][28] -> [ABORT][29] ([i915#4528] / [i915#4579])
[28]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_13291/shard-snb1/igt@i915_selftest@perf@engine_cs.html
[29]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-snb7/igt@i915_selftest@perf@engine_cs.html
* igt@kms_big_fb@4-tiled-max-hw-stride-32bpp-rotate-0-hflip:
- shard-rkl: NOTRUN -> [SKIP][30] ([i915#5286]) +2 similar issues
[30]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-4/igt@kms_big_fb@4-tiled-max-hw-stride-32bpp-rotate-0-hflip.html
* igt@kms_big_fb@y-tiled-8bpp-rotate-270:
- shard-rkl: NOTRUN -> [SKIP][31] ([fdo#111614] / [i915#3638]) +1 similar issue
[31]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-2/igt@kms_big_fb@y-tiled-8bpp-rotate-270.html
* igt@kms_big_fb@yf-tiled-max-hw-stride-32bpp-rotate-0-async-flip:
- shard-tglu: NOTRUN -> [SKIP][32] ([fdo#111615])
[32]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-tglu-6/igt@kms_big_fb@yf-tiled-max-hw-stride-32bpp-rotate-0-async-flip.html
* igt@kms_big_fb@yf-tiled-max-hw-stride-32bpp-rotate-0-hflip-async-flip:
- shard-rkl: NOTRUN -> [SKIP][33] ([fdo#110723]) +1 similar issue
[33]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-2/igt@kms_big_fb@yf-tiled-max-hw-stride-32bpp-rotate-0-hflip-async-flip.html
* igt@kms_ccs@pipe-b-ccs-on-another-bo-y_tiled_ccs:
- shard-rkl: NOTRUN -> [SKIP][34] ([i915#3734] / [i915#5354] / [i915#6095]) +2 similar issues
[34]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-4/igt@kms_ccs@pipe-b-ccs-on-another-bo-y_tiled_ccs.html
* igt@kms_ccs@pipe-b-crc-primary-basic-4_tiled_dg2_rc_ccs_cc:
- shard-rkl: NOTRUN -> [SKIP][35] ([i915#5354] / [i915#6095]) +4 similar issues
[35]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-4/igt@kms_ccs@pipe-b-crc-primary-basic-4_tiled_dg2_rc_ccs_cc.html
* igt@kms_ccs@pipe-b-random-ccs-data-y_tiled_gen12_mc_ccs:
- shard-rkl: NOTRUN -> [SKIP][36] ([i915#3886] / [i915#5354] / [i915#6095]) +1 similar issue
[36]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-7/igt@kms_ccs@pipe-b-random-ccs-data-y_tiled_gen12_mc_ccs.html
* igt@kms_ccs@pipe-c-bad-pixel-format-y_tiled_gen12_mc_ccs:
- shard-tglu: NOTRUN -> [SKIP][37] ([i915#3689] / [i915#3886] / [i915#5354] / [i915#6095]) +1 similar issue
[37]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-tglu-6/igt@kms_ccs@pipe-c-bad-pixel-format-y_tiled_gen12_mc_ccs.html
* igt@kms_ccs@pipe-c-crc-primary-basic-y_tiled_gen12_rc_ccs_cc:
- shard-glk: NOTRUN -> [SKIP][38] ([fdo#109271] / [i915#3886]) +1 similar issue
[38]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-glk8/igt@kms_ccs@pipe-c-crc-primary-basic-y_tiled_gen12_rc_ccs_cc.html
* igt@kms_ccs@pipe-d-bad-rotation-90-4_tiled_dg2_mc_ccs:
- shard-tglu: NOTRUN -> [SKIP][39] ([i915#3689] / [i915#5354] / [i915#6095])
[39]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-tglu-10/igt@kms_ccs@pipe-d-bad-rotation-90-4_tiled_dg2_mc_ccs.html
* igt@kms_ccs@pipe-d-crc-sprite-planes-basic-4_tiled_dg2_mc_ccs:
- shard-rkl: NOTRUN -> [SKIP][40] ([i915#5354]) +11 similar issues
[40]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-6/igt@kms_ccs@pipe-d-crc-sprite-planes-basic-4_tiled_dg2_mc_ccs.html
* igt@kms_cdclk@plane-scaling:
- shard-rkl: NOTRUN -> [SKIP][41] ([i915#3742])
[41]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-6/igt@kms_cdclk@plane-scaling.html
* igt@kms_chamelium_color@ctm-limited-range:
- shard-rkl: NOTRUN -> [SKIP][42] ([fdo#111827])
[42]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-2/igt@kms_chamelium_color@ctm-limited-range.html
* igt@kms_chamelium_frames@hdmi-crc-multiple:
- shard-rkl: NOTRUN -> [SKIP][43] ([i915#7828]) +3 similar issues
[43]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-6/igt@kms_chamelium_frames@hdmi-crc-multiple.html
* igt@kms_content_protection@content_type_change:
- shard-rkl: NOTRUN -> [SKIP][44] ([i915#4579] / [i915#7118]) +1 similar issue
[44]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-4/igt@kms_content_protection@content_type_change.html
* igt@kms_cursor_crc@cursor-sliding-512x512:
- shard-rkl: NOTRUN -> [SKIP][45] ([i915#3359]) +1 similar issue
[45]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-2/igt@kms_cursor_crc@cursor-sliding-512x512.html
* igt@kms_cursor_legacy@basic-busy-flip-before-cursor-atomic:
- shard-rkl: NOTRUN -> [SKIP][46] ([i915#4103])
[46]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-4/igt@kms_cursor_legacy@basic-busy-flip-before-cursor-atomic.html
* igt@kms_cursor_legacy@cursorb-vs-flipa-atomic:
- shard-tglu: NOTRUN -> [SKIP][47] ([fdo#109274])
[47]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-tglu-9/igt@kms_cursor_legacy@cursorb-vs-flipa-atomic.html
* igt@kms_cursor_legacy@cursorb-vs-flipb-legacy:
- shard-rkl: NOTRUN -> [SKIP][48] ([fdo#111825]) +2 similar issues
[48]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-4/igt@kms_cursor_legacy@cursorb-vs-flipb-legacy.html
* igt@kms_cursor_legacy@cursorb-vs-flipb-toggle:
- shard-rkl: NOTRUN -> [SKIP][49] ([fdo#111767] / [fdo#111825])
[49]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-1/igt@kms_cursor_legacy@cursorb-vs-flipb-toggle.html
* igt@kms_flip@2x-plain-flip-ts-check-interruptible:
- shard-tglu: NOTRUN -> [SKIP][50] ([fdo#109274] / [i915#3637])
[50]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-tglu-6/igt@kms_flip@2x-plain-flip-ts-check-interruptible.html
* igt@kms_flip_scaled_crc@flip-32bpp-4tile-to-32bpp-4tiledg2rcccs-downscaling@pipe-a-valid-mode:
- shard-rkl: NOTRUN -> [SKIP][51] ([i915#2672] / [i915#4579])
[51]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-6/igt@kms_flip_scaled_crc@flip-32bpp-4tile-to-32bpp-4tiledg2rcccs-downscaling@pipe-a-valid-mode.html
* igt@kms_flip_scaled_crc@flip-32bpp-linear-to-64bpp-linear-upscaling@pipe-a-valid-mode:
- shard-glk: [PASS][52] -> [DMESG-FAIL][53] ([i915#118])
[52]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_13291/shard-glk5/igt@kms_flip_scaled_crc@flip-32bpp-linear-to-64bpp-linear-upscaling@pipe-a-valid-mode.html
[53]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-glk3/igt@kms_flip_scaled_crc@flip-32bpp-linear-to-64bpp-linear-upscaling@pipe-a-valid-mode.html
* igt@kms_flip_scaled_crc@flip-64bpp-xtile-to-32bpp-xtile-upscaling@pipe-a-valid-mode:
- shard-glk: NOTRUN -> [SKIP][54] ([fdo#109271] / [i915#4579]) +4 similar issues
[54]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-glk4/igt@kms_flip_scaled_crc@flip-64bpp-xtile-to-32bpp-xtile-upscaling@pipe-a-valid-mode.html
* igt@kms_force_connector_basic@force-load-detect:
- shard-rkl: NOTRUN -> [SKIP][55] ([fdo#109285] / [i915#4098])
[55]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-4/igt@kms_force_connector_basic@force-load-detect.html
* igt@kms_frontbuffer_tracking@fbcpsr-2p-primscrn-cur-indfb-draw-mmap-wc:
- shard-rkl: NOTRUN -> [SKIP][56] ([fdo#111825] / [i915#1825]) +11 similar issues
[56]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-2/igt@kms_frontbuffer_tracking@fbcpsr-2p-primscrn-cur-indfb-draw-mmap-wc.html
* igt@kms_frontbuffer_tracking@psr-1p-pri-indfb-multidraw:
- shard-glk: NOTRUN -> [SKIP][57] ([fdo#109271]) +31 similar issues
[57]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-glk3/igt@kms_frontbuffer_tracking@psr-1p-pri-indfb-multidraw.html
* igt@kms_frontbuffer_tracking@psr-1p-primscrn-pri-indfb-draw-render:
- shard-rkl: NOTRUN -> [SKIP][58] ([i915#3023]) +10 similar issues
[58]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-1/igt@kms_frontbuffer_tracking@psr-1p-primscrn-pri-indfb-draw-render.html
* igt@kms_frontbuffer_tracking@psr-2p-primscrn-cur-indfb-draw-mmap-wc:
- shard-tglu: NOTRUN -> [SKIP][59] ([fdo#109280])
[59]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-tglu-7/igt@kms_frontbuffer_tracking@psr-2p-primscrn-cur-indfb-draw-mmap-wc.html
* igt@kms_hdr@bpc-switch-dpms:
- shard-rkl: NOTRUN -> [SKIP][60] ([i915#3555] / [i915#4579])
[60]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-2/igt@kms_hdr@bpc-switch-dpms.html
* igt@kms_plane_scaling@plane-downscale-with-modifiers-factor-0-5@pipe-b-vga-1:
- shard-snb: NOTRUN -> [SKIP][61] ([fdo#109271] / [i915#4579]) +8 similar issues
[61]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-snb7/igt@kms_plane_scaling@plane-downscale-with-modifiers-factor-0-5@pipe-b-vga-1.html
* igt@kms_plane_scaling@plane-scaler-with-clipping-clamping-rotation@pipe-b-hdmi-a-2:
- shard-rkl: NOTRUN -> [SKIP][62] ([i915#4579] / [i915#5176]) +2 similar issues
[62]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-4/igt@kms_plane_scaling@plane-scaler-with-clipping-clamping-rotation@pipe-b-hdmi-a-2.html
* igt@kms_plane_scaling@plane-scaler-with-rotation-unity-scaling@pipe-a-hdmi-a-1:
- shard-rkl: NOTRUN -> [SKIP][63] ([i915#5176]) +2 similar issues
[63]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-7/igt@kms_plane_scaling@plane-scaler-with-rotation-unity-scaling@pipe-a-hdmi-a-1.html
* igt@kms_plane_scaling@planes-downscale-factor-0-25-upscale-20x20@pipe-a-hdmi-a-2:
- shard-rkl: NOTRUN -> [SKIP][64] ([i915#5235])
[64]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-1/igt@kms_plane_scaling@planes-downscale-factor-0-25-upscale-20x20@pipe-a-hdmi-a-2.html
* igt@kms_plane_scaling@planes-downscale-factor-0-25-upscale-20x20@pipe-b-hdmi-a-2:
- shard-rkl: NOTRUN -> [SKIP][65] ([i915#4579] / [i915#5235])
[65]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-1/igt@kms_plane_scaling@planes-downscale-factor-0-25-upscale-20x20@pipe-b-hdmi-a-2.html
* igt@kms_plane_scaling@planes-downscale-factor-0-75-unity-scaling@pipe-a-vga-1:
- shard-snb: NOTRUN -> [SKIP][66] ([fdo#109271]) +13 similar issues
[66]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-snb6/igt@kms_plane_scaling@planes-downscale-factor-0-75-unity-scaling@pipe-a-vga-1.html
* igt@kms_prime@d3hot:
- shard-rkl: NOTRUN -> [SKIP][67] ([i915#6524])
[67]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-2/igt@kms_prime@d3hot.html
* igt@kms_psr2_sf@overlay-plane-move-continuous-exceed-sf:
- shard-glk: NOTRUN -> [SKIP][68] ([fdo#109271] / [i915#658])
[68]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-glk6/igt@kms_psr2_sf@overlay-plane-move-continuous-exceed-sf.html
* igt@kms_psr2_sf@primary-plane-update-sf-dmg-area-big-fb:
- shard-rkl: NOTRUN -> [SKIP][69] ([i915#658])
[69]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-1/igt@kms_psr2_sf@primary-plane-update-sf-dmg-area-big-fb.html
* igt@kms_psr@psr2_sprite_mmap_cpu:
- shard-tglu: NOTRUN -> [SKIP][70] ([fdo#110189])
[70]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-tglu-8/igt@kms_psr@psr2_sprite_mmap_cpu.html
* igt@kms_psr@sprite_mmap_cpu:
- shard-rkl: NOTRUN -> [SKIP][71] ([i915#1072]) +3 similar issues
[71]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-2/igt@kms_psr@sprite_mmap_cpu.html
* igt@kms_setmode@basic@pipe-a-vga-1:
- shard-snb: NOTRUN -> [FAIL][72] ([i915#5465]) +1 similar issue
[72]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-snb4/igt@kms_setmode@basic@pipe-a-vga-1.html
* igt@kms_vblank@pipe-d-query-forked-busy-hang:
- shard-rkl: NOTRUN -> [SKIP][73] ([i915#4070] / [i915#533] / [i915#6768]) +1 similar issue
[73]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-7/igt@kms_vblank@pipe-d-query-forked-busy-hang.html
* igt@kms_writeback@writeback-check-output:
- shard-rkl: NOTRUN -> [SKIP][74] ([i915#2437])
[74]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-1/igt@kms_writeback@writeback-check-output.html
* igt@perf@unprivileged-single-ctx-counters:
- shard-rkl: NOTRUN -> [SKIP][75] ([i915#2433])
[75]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-2/igt@perf@unprivileged-single-ctx-counters.html
* igt@tools_test@sysfs_l3_parity:
- shard-rkl: NOTRUN -> [SKIP][76] ([fdo#109307])
[76]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-7/igt@tools_test@sysfs_l3_parity.html
* igt@v3d/v3d_perfmon@create-two-perfmon:
- shard-rkl: NOTRUN -> [SKIP][77] ([fdo#109315]) +4 similar issues
[77]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-4/igt@v3d/v3d_perfmon@create-two-perfmon.html
* igt@vc4/vc4_perfmon@get-values-valid-perfmon:
- shard-rkl: NOTRUN -> [SKIP][78] ([i915#7711]) +1 similar issue
[78]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-6/igt@vc4/vc4_perfmon@get-values-valid-perfmon.html
#### Possible fixes ####
* igt@drm_fdinfo@most-busy-check-all@rcs0:
- shard-rkl: [FAIL][79] ([i915#7742]) -> [PASS][80]
[79]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_13291/shard-rkl-6/igt@drm_fdinfo@most-busy-check-all@rcs0.html
[80]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-2/igt@drm_fdinfo@most-busy-check-all@rcs0.html
* igt@gem_ctx_exec@basic-nohangcheck:
- shard-tglu: [FAIL][81] ([i915#6268]) -> [PASS][82]
[81]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_13291/shard-tglu-4/igt@gem_ctx_exec@basic-nohangcheck.html
[82]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-tglu-5/igt@gem_ctx_exec@basic-nohangcheck.html
* igt@gem_eio@unwedge-stress:
- {shard-dg1}: [FAIL][83] ([i915#5784]) -> [PASS][84] +1 similar issue
[83]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_13291/shard-dg1-14/igt@gem_eio@unwedge-stress.html
[84]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-dg1-14/igt@gem_eio@unwedge-stress.html
* igt@gem_exec_fair@basic-deadline:
- shard-rkl: [FAIL][85] ([i915#2846]) -> [PASS][86]
[85]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_13291/shard-rkl-1/igt@gem_exec_fair@basic-deadline.html
[86]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-4/igt@gem_exec_fair@basic-deadline.html
* igt@gem_exec_fair@basic-pace-share@rcs0:
- shard-rkl: [FAIL][87] ([i915#2842]) -> [PASS][88]
[87]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_13291/shard-rkl-4/igt@gem_exec_fair@basic-pace-share@rcs0.html
[88]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-1/igt@gem_exec_fair@basic-pace-share@rcs0.html
* igt@gem_exec_fair@basic-pace@rcs0:
- shard-glk: [FAIL][89] ([i915#2842]) -> [PASS][90] +1 similar issue
[89]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_13291/shard-glk6/igt@gem_exec_fair@basic-pace@rcs0.html
[90]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-glk8/igt@gem_exec_fair@basic-pace@rcs0.html
* igt@i915_pm_lpsp@kms-lpsp@kms-lpsp-hdmi-a:
- {shard-dg1}: [SKIP][91] ([i915#1937] / [i915#4579]) -> [PASS][92]
[91]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_13291/shard-dg1-12/igt@i915_pm_lpsp@kms-lpsp@kms-lpsp-hdmi-a.html
[92]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-dg1-19/igt@i915_pm_lpsp@kms-lpsp@kms-lpsp-hdmi-a.html
* igt@i915_pm_rpm@dpms-lpsp:
- shard-rkl: [SKIP][93] ([i915#1397]) -> [PASS][94] +1 similar issue
[93]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_13291/shard-rkl-4/igt@i915_pm_rpm@dpms-lpsp.html
[94]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-7/igt@i915_pm_rpm@dpms-lpsp.html
* igt@i915_pm_rpm@modeset-lpsp-stress-no-wait:
- {shard-dg1}: [SKIP][95] ([i915#1397]) -> [PASS][96]
[95]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_13291/shard-dg1-14/igt@i915_pm_rpm@modeset-lpsp-stress-no-wait.html
[96]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-dg1-19/igt@i915_pm_rpm@modeset-lpsp-stress-no-wait.html
* igt@kms_cursor_legacy@flip-vs-cursor-atomic-transitions-varying-size:
- shard-apl: [FAIL][97] ([i915#2346]) -> [PASS][98]
[97]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_13291/shard-apl6/igt@kms_cursor_legacy@flip-vs-cursor-atomic-transitions-varying-size.html
[98]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-apl7/igt@kms_cursor_legacy@flip-vs-cursor-atomic-transitions-varying-size.html
* igt@kms_cursor_legacy@single-move@pipe-b:
- shard-rkl: [INCOMPLETE][99] ([i915#8011]) -> [PASS][100]
[99]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_13291/shard-rkl-7/igt@kms_cursor_legacy@single-move@pipe-b.html
[100]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-2/igt@kms_cursor_legacy@single-move@pipe-b.html
* igt@perf@stress-open-close@0-rcs0:
- shard-glk: [ABORT][101] ([i915#5213] / [i915#7941]) -> [PASS][102]
[101]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_13291/shard-glk3/igt@perf@stress-open-close@0-rcs0.html
[102]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-glk7/igt@perf@stress-open-close@0-rcs0.html
* igt@perf_pmu@render-node-busy-idle@vcs1:
- {shard-dg1}: [FAIL][103] ([i915#4349]) -> [PASS][104]
[103]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_13291/shard-dg1-12/igt@perf_pmu@render-node-busy-idle@vcs1.html
[104]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-dg1-13/igt@perf_pmu@render-node-busy-idle@vcs1.html
#### Warnings ####
* igt@kms_fbcon_fbt@fbc-suspend:
- shard-glk: [FAIL][105] ([i915#4767]) -> [DMESG-FAIL][106] ([i915#118])
[105]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_13291/shard-glk8/igt@kms_fbcon_fbt@fbc-suspend.html
[106]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-glk5/igt@kms_fbcon_fbt@fbc-suspend.html
* igt@kms_multipipe_modeset@basic-max-pipe-crc-check:
- shard-rkl: [SKIP][107] ([i915#4816]) -> [SKIP][108] ([i915#4070] / [i915#4816])
[107]: https://intel-gfx-ci.01.org/tree/drm-tip/CI_DRM_13291/shard-rkl-7/igt@kms_multipipe_modeset@basic-max-pipe-crc-check.html
[108]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/shard-rkl-2/igt@kms_multipipe_modeset@basic-max-pipe-crc-check.html
{name}: This element is suppressed. This means it is ignored when computing
the status of the difference (SUCCESS, WARNING, or FAILURE).
[fdo#109271]: https://bugs.freedesktop.org/show_bug.cgi?id=109271
[fdo#109274]: https://bugs.freedesktop.org/show_bug.cgi?id=109274
[fdo#109280]: https://bugs.freedesktop.org/show_bug.cgi?id=109280
[fdo#109285]: https://bugs.freedesktop.org/show_bug.cgi?id=109285
[fdo#109289]: https://bugs.freedesktop.org/show_bug.cgi?id=109289
[fdo#109300]: https://bugs.freedesktop.org/show_bug.cgi?id=109300
[fdo#109307]: https://bugs.freedesktop.org/show_bug.cgi?id=109307
[fdo#109315]: https://bugs.freedesktop.org/show_bug.cgi?id=109315
[fdo#109506]: https://bugs.freedesktop.org/show_bug.cgi?id=109506
[fdo#110189]: https://bugs.freedesktop.org/show_bug.cgi?id=110189
[fdo#110723]: https://bugs.freedesktop.org/show_bug.cgi?id=110723
[fdo#111614]: https://bugs.freedesktop.org/show_bug.cgi?id=111614
[fdo#111615]: https://bugs.freedesktop.org/show_bug.cgi?id=111615
[fdo#111767]: https://bugs.freedesktop.org/show_bug.cgi?id=111767
[fdo#111825]: https://bugs.freedesktop.org/show_bug.cgi?id=111825
[fdo#111827]: https://bugs.freedesktop.org/show_bug.cgi?id=111827
[i915#1072]: https://gitlab.freedesktop.org/drm/intel/issues/1072
[i915#118]: https://gitlab.freedesktop.org/drm/intel/issues/118
[i915#1257]: https://gitlab.freedesktop.org/drm/intel/issues/1257
[i915#1397]: https://gitlab.freedesktop.org/drm/intel/issues/1397
[i915#1825]: https://gitlab.freedesktop.org/drm/intel/issues/1825
[i915#1937]: https://gitlab.freedesktop.org/drm/intel/issues/1937
[i915#2346]: https://gitlab.freedesktop.org/drm/intel/issues/2346
[i915#2433]: https://gitlab.freedesktop.org/drm/intel/issues/2433
[i915#2437]: https://gitlab.freedesktop.org/drm/intel/issues/2437
[i915#2527]: https://gitlab.freedesktop.org/drm/intel/issues/2527
[i915#2575]: https://gitlab.freedesktop.org/drm/intel/issues/2575
[i915#2587]: https://gitlab.freedesktop.org/drm/intel/issues/2587
[i915#2672]: https://gitlab.freedesktop.org/drm/intel/issues/2672
[i915#2842]: https://gitlab.freedesktop.org/drm/intel/issues/2842
[i915#2846]: https://gitlab.freedesktop.org/drm/intel/issues/2846
[i915#3023]: https://gitlab.freedesktop.org/drm/intel/issues/3023
[i915#3281]: https://gitlab.freedesktop.org/drm/intel/issues/3281
[i915#3282]: https://gitlab.freedesktop.org/drm/intel/issues/3282
[i915#3297]: https://gitlab.freedesktop.org/drm/intel/issues/3297
[i915#3299]: https://gitlab.freedesktop.org/drm/intel/issues/3299
[i915#3323]: https://gitlab.freedesktop.org/drm/intel/issues/3323
[i915#3359]: https://gitlab.freedesktop.org/drm/intel/issues/3359
[i915#3458]: https://gitlab.freedesktop.org/drm/intel/issues/3458
[i915#3555]: https://gitlab.freedesktop.org/drm/intel/issues/3555
[i915#3637]: https://gitlab.freedesktop.org/drm/intel/issues/3637
[i915#3638]: https://gitlab.freedesktop.org/drm/intel/issues/3638
[i915#3689]: https://gitlab.freedesktop.org/drm/intel/issues/3689
[i915#3734]: https://gitlab.freedesktop.org/drm/intel/issues/3734
[i915#3742]: https://gitlab.freedesktop.org/drm/intel/issues/3742
[i915#3886]: https://gitlab.freedesktop.org/drm/intel/issues/3886
[i915#3989]: https://gitlab.freedesktop.org/drm/intel/issues/3989
[i915#4070]: https://gitlab.freedesktop.org/drm/intel/issues/4070
[i915#4077]: https://gitlab.freedesktop.org/drm/intel/issues/4077
[i915#4078]: https://gitlab.freedesktop.org/drm/intel/issues/4078
[i915#4083]: https://gitlab.freedesktop.org/drm/intel/issues/4083
[i915#4098]: https://gitlab.freedesktop.org/drm/intel/issues/4098
[i915#4103]: https://gitlab.freedesktop.org/drm/intel/issues/4103
[i915#4212]: https://gitlab.freedesktop.org/drm/intel/issues/4212
[i915#4215]: https://gitlab.freedesktop.org/drm/intel/issues/4215
[i915#4270]: https://gitlab.freedesktop.org/drm/intel/issues/4270
[i915#4281]: https://gitlab.freedesktop.org/drm/intel/issues/4281
[i915#4349]: https://gitlab.freedesktop.org/drm/intel/issues/4349
[i915#4391]: https://gitlab.freedesktop.org/drm/intel/issues/4391
[i915#4423]: https://gitlab.freedesktop.org/drm/intel/issues/4423
[i915#4525]: https://gitlab.freedesktop.org/drm/intel/issues/4525
[i915#4528]: https://gitlab.freedesktop.org/drm/intel/issues/4528
[i915#454]: https://gitlab.freedesktop.org/drm/intel/issues/454
[i915#4579]: https://gitlab.freedesktop.org/drm/intel/issues/4579
[i915#4613]: https://gitlab.freedesktop.org/drm/intel/issues/4613
[i915#4767]: https://gitlab.freedesktop.org/drm/intel/issues/4767
[i915#4816]: https://gitlab.freedesktop.org/drm/intel/issues/4816
[i915#4833]: https://gitlab.freedesktop.org/drm/intel/issues/4833
[i915#4958]: https://gitlab.freedesktop.org/drm/intel/issues/4958
[i915#5176]: https://gitlab.freedesktop.org/drm/intel/issues/5176
[i915#5213]: https://gitlab.freedesktop.org/drm/intel/issues/5213
[i915#5235]: https://gitlab.freedesktop.org/drm/intel/issues/5235
[i915#5286]: https://gitlab.freedesktop.org/drm/intel/issues/5286
[i915#533]: https://gitlab.freedesktop.org/drm/intel/issues/533
[i915#5354]: https://gitlab.freedesktop.org/drm/intel/issues/5354
[i915#5461]: https://gitlab.freedesktop.org/drm/intel/issues/5461
[i915#5465]: https://gitlab.freedesktop.org/drm/intel/issues/5465
[i915#5784]: https://gitlab.freedesktop.org/drm/intel/issues/5784
[i915#6095]: https://gitlab.freedesktop.org/drm/intel/issues/6095
[i915#6268]: https://gitlab.freedesktop.org/drm/intel/issues/6268
[i915#6524]: https://gitlab.freedesktop.org/drm/intel/issues/6524
[i915#658]: https://gitlab.freedesktop.org/drm/intel/issues/658
[i915#6621]: https://gitlab.freedesktop.org/drm/intel/issues/6621
[i915#6768]: https://gitlab.freedesktop.org/drm/intel/issues/6768
[i915#6806]: https://gitlab.freedesktop.org/drm/intel/issues/6806
[i915#7116]: https://gitlab.freedesktop.org/drm/intel/issues/7116
[i915#7118]: https://gitlab.freedesktop.org/drm/intel/issues/7118
[i915#7697]: https://gitlab.freedesktop.org/drm/intel/issues/7697
[i915#7707]: https://gitlab.freedesktop.org/drm/intel/issues/7707
[i915#7711]: https://gitlab.freedesktop.org/drm/intel/issues/7711
[i915#7742]: https://gitlab.freedesktop.org/drm/intel/issues/7742
[i915#7828]: https://gitlab.freedesktop.org/drm/intel/issues/7828
[i915#7941]: https://gitlab.freedesktop.org/drm/intel/issues/7941
[i915#7975]: https://gitlab.freedesktop.org/drm/intel/issues/7975
[i915#8011]: https://gitlab.freedesktop.org/drm/intel/issues/8011
[i915#8213]: https://gitlab.freedesktop.org/drm/intel/issues/8213
[i915#8292]: https://gitlab.freedesktop.org/drm/intel/issues/8292
[i915#8295]: https://gitlab.freedesktop.org/drm/intel/issues/8295
[i915#8347]: https://gitlab.freedesktop.org/drm/intel/issues/8347
[i915#8414]: https://gitlab.freedesktop.org/drm/intel/issues/8414
[i915#8661]: https://gitlab.freedesktop.org/drm/intel/issues/8661
Build changes
-------------
* CI: CI-20190529 -> None
* IGT: IGT_7339 -> IGTPW_9215
* Piglit: piglit_4509 -> None
CI-20190529: 20190529
CI_DRM_13291: 44951a61f5bdf3c19584ce0e1da5df07224d6c38 @ git://anongit.freedesktop.org/gfx-ci/linux
IGTPW_9215: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/index.html
IGT_7339: 4476edb0fb09b886f7e667d1174d13299d98c23f @ https://gitlab.freedesktop.org/drm/igt-gpu-tools.git
piglit_4509: fdc5a4ca11124ab8413c7988896eec4c97336694 @ git://anongit.freedesktop.org/piglit
== Logs ==
For more details see: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9215/index.html
[-- Attachment #2: Type: text/html, Size: 36725 bytes --]
^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: [igt-dev] [PATCH i-g-t v2 1/4] scripts/test_list.py: add support for ordering testlists
2023-06-20 8:55 ` [igt-dev] [PATCH i-g-t v2 1/4] scripts/test_list.py: add support for ordering testlists Mauro Carvalho Chehab
@ 2023-06-21 16:44 ` Kamil Konieczny
0 siblings, 0 replies; 11+ messages in thread
From: Kamil Konieczny @ 2023-06-21 16:44 UTC (permalink / raw)
To: igt-dev
Hi Mauro,
On 2023-06-20 at 10:55:19 +0200, Mauro Carvalho Chehab wrote:
> From: Mauro Carvalho Chehab <mchehab@kernel.org>
>
> Testlists usually require an special order, like:
> - an initial test which loads the driver;
> - normal tests;
> - dangerous tests (like KUnit ones).
>
> Add support to handle order, by adding an "order" property at
> the config file.
>
> Signed-off-by: Mauro Carvalho Chehab <mchehab@kernel.org>
Acked-by: Kamil Konieczny <kamil.konieczny@linux.intel.com>
> ---
> scripts/test_list.py | 55 ++++++++++++++++++++++++++++++++++++++------
> 1 file changed, 48 insertions(+), 7 deletions(-)
>
> diff --git a/scripts/test_list.py b/scripts/test_list.py
> index f676024c9571..76fdcf3dbb4f 100755
> --- a/scripts/test_list.py
> +++ b/scripts/test_list.py
> @@ -819,18 +819,25 @@ class TestList:
> # Subtest list methods
> #
>
> - def get_subtests(self, sort_field = None, expand = None):
> + def get_subtests(self, sort_field = None, expand = None, with_order = False):
>
> """Return an array with all subtests"""
>
> subtests = {}
> subtests[""] = []
>
> + order = None
> +
> if sort_field:
> if sort_field.lower() not in self.field_list:
> sys.exit(f"Field '{sort_field}' is not defined")
> sort_field = self.field_list[sort_field.lower()]
>
> + if with_order:
> + if "_properties_" in self.props[sort_field]:
> + if "order" in self.props[sort_field]["_properties_"]:
> + order = self.props[sort_field]["_properties_"]["order"]
> +
> for test in sorted(self.doc.keys()):
> fname = self.doc[test]["File"]
>
> @@ -848,20 +855,54 @@ class TestList:
> if sort_field in subtest:
> if expand:
> test_list = subtest[sort_field].split(expand)
> + test_list = [s.strip() for s in test_list]
> +
> for test_elem in test_list:
> - test_elem = test_elem.strip()
> if test_elem not in subtests:
> subtests[test_elem] = []
> - subtests[test_elem].append(subtest["Summary"])
> + if order:
> + subtests[test_elem].append((subtest["Summary"], test_list))
> + else:
> + subtests[test_elem].append(subtest["Summary"])
> else:
> if subtest[sort_field] not in subtests:
> subtests[subtest[sort_field]] = []
> - subtests[subtest[sort_field]].append(subtest["Summary"])
> + if order:
> + subtests[test_elem].append((subtest["Summary"], [subtest[sort_field]]))
> + else:
> + subtests[subtest[sort_field]].append(subtest["Summary"])
> + else:
> + if order:
> + subtests[test_elem].append((subtest["Summary"], [subtest[sort_field]]))
> + else:
> + subtests[""].append(subtest["Summary"])
> +
> + else:
> + if order:
> + subtests[test_elem].append((subtest["Summary"], [subtest[sort_field]]))
> else:
> subtests[""].append(subtest["Summary"])
>
> - else:
> - subtests[""].append(subtest["Summary"])
> + if order:
> + for group, tests in subtests.items():
> + prefix_tests = []
> + suffix_tests = []
> + middle_tests = []
> + is_prefix = True
> + for k in order:
> + if k == "__all__":
> + is_prefix = False
> + continue
> + for test in tests:
> + if k in test[1]:
> + if is_prefix:
> + prefix_tests.append(test[0])
> + else:
> + suffix_tests.append(test[0])
> + for test in tests:
> + if test[0] not in prefix_tests and test[0] not in suffix_tests:
> + middle_tests.append(test[0])
> + subtests[group] = prefix_tests + middle_tests + suffix_tests
>
> return subtests
>
> @@ -1203,7 +1244,7 @@ class TestList:
> test_prefix = re.sub(r'^igt@', '', test_prefix)
>
> # NOTE: currently, it uses a comma for multi-value delimitter
> - test_subtests = self.get_subtests(sort_field, ",")
> + test_subtests = self.get_subtests(sort_field, ",", with_order = True)
>
> if not os.path.exists(directory):
> os.makedirs(directory)
> --
> 2.40.1
>
^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: [igt-dev] [PATCH i-g-t v2 2/4] xe_test_config.json: add an order for run type
2023-06-20 8:55 ` [igt-dev] [PATCH i-g-t v2 2/4] xe_test_config.json: add an order for run type Mauro Carvalho Chehab
@ 2023-06-21 16:45 ` Kamil Konieczny
0 siblings, 0 replies; 11+ messages in thread
From: Kamil Konieczny @ 2023-06-21 16:45 UTC (permalink / raw)
To: igt-dev
Hi Mauro,
On 2023-06-20 at 10:55:20 +0200, Mauro Carvalho Chehab wrote:
> From: Mauro Carvalho Chehab <mchehab@kernel.org>
>
> When generating test lists based on run type for the Xe driver,
> order them in a way that the first test will be the one called
> after booting the machine (e. g. module load), then normal tests
> and finally KUnit ones.
>
> Signed-off-by: Mauro Carvalho Chehab <mchehab@kernel.org>
Reviewed-by: Kamil Konieczny <kamil.konieczny@linux.intel.com>
> ---
> tests/xe/xe_test_config.json | 7 ++++++-
> 1 file changed, 6 insertions(+), 1 deletion(-)
>
> diff --git a/tests/xe/xe_test_config.json b/tests/xe/xe_test_config.json
> index 334d372d1330..e89f998bc66b 100644
> --- a/tests/xe/xe_test_config.json
> +++ b/tests/xe/xe_test_config.json
> @@ -22,7 +22,12 @@
> },
> "Run type": {
> "_properties_": {
> - "description": "Defines what category of testlist it belongs"
> + "description": "Defines what category of testlist it belongs",
> + "order": [
> + "boot",
> + "__all__",
> + "kunit"
> + ]
> }
> }
> }
> --
> 2.40.1
>
^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: [igt-dev] [PATCH i-g-t v2 3/4] tests/xe: add run type fields to order testlists
2023-06-20 8:55 ` [igt-dev] [PATCH i-g-t v2 3/4] tests/xe: add run type fields to order testlists Mauro Carvalho Chehab
@ 2023-06-21 16:46 ` Kamil Konieczny
0 siblings, 0 replies; 11+ messages in thread
From: Kamil Konieczny @ 2023-06-21 16:46 UTC (permalink / raw)
To: igt-dev
Hi Mauro,
On 2023-06-20 at 10:55:21 +0200, Mauro Carvalho Chehab wrote:
> From: Mauro Carvalho Chehab <mchehab@kernel.org>
>
> Order tests at the fast feedback testlist, when generating
> testlists based on Run type field:
>
> - add boot to xe_module_load, to run such test first when producing
> a fast feedback testlist;
> - place kunit tests at the end of the fast feedback testlist, as they
> have a higher chance of causing GPU hangups.
>
> Signed-off-by: Mauro Carvalho Chehab <mchehab@kernel.org>
Reviewed-by: Kamil Konieczny <kamil.konieczny@linux.intel.com>
> ---
> tests/xe/xe_live_ktest.c | 2 +-
> tests/xe/xe_module_load.c | 2 +-
> 2 files changed, 2 insertions(+), 2 deletions(-)
>
> diff --git a/tests/xe/xe_live_ktest.c b/tests/xe/xe_live_ktest.c
> index 7dcf679069b8..f0cbf4f623bc 100644
> --- a/tests/xe/xe_live_ktest.c
> +++ b/tests/xe/xe_live_ktest.c
> @@ -8,7 +8,7 @@
> * Sub-category: kunit
> * Functionality: kunit
> * Test category: functionality test
> - * Run type: BAT
> + * Run type: BAT, kunit
> *
> * SUBTEST: bo
> * Functionality: bo
> diff --git a/tests/xe/xe_module_load.c b/tests/xe/xe_module_load.c
> index 1c2d4a2e2ea3..3b2dc1fdc90f 100644
> --- a/tests/xe/xe_module_load.c
> +++ b/tests/xe/xe_module_load.c
> @@ -99,7 +99,7 @@ static const char * const unwanted_drivers[] = {
> /**
> * SUBTEST: force-load
> * Description: Load the Xe driver passing ``force_probe=*`` parameter
> - * Run type: BAT
> + * Run type: BAT, boot
> *
> * SUBTEST: load
> * Description: Load the Xe driver
> --
> 2.40.1
>
^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: [igt-dev] [PATCH i-g-t v2 4/4] scripts/test_list.py: produce alphabetically ordered testlists
2023-06-20 8:55 ` [igt-dev] [PATCH i-g-t v2 4/4] scripts/test_list.py: produce alphabetically ordered testlists Mauro Carvalho Chehab
@ 2023-06-21 16:48 ` Kamil Konieczny
0 siblings, 0 replies; 11+ messages in thread
From: Kamil Konieczny @ 2023-06-21 16:48 UTC (permalink / raw)
To: igt-dev
Hi Mauro,
On 2023-06-20 at 10:55:22 +0200, Mauro Carvalho Chehab wrote:
> From: Mauro Carvalho Chehab <mchehab@kernel.org>
>
> Before start handling the subtest arrays, order it, in order
> it alphabetically.
>
> This should produce a better ordered testlist.
>
> Signed-off-by: Mauro Carvalho Chehab <mchehab@kernel.org>
Acked-by: Kamil Konieczny <kamil.konieczny@linux.intel.com>
> ---
> scripts/test_list.py | 59 +++++++++++++++++++++++---------------------
> 1 file changed, 31 insertions(+), 28 deletions(-)
>
> diff --git a/scripts/test_list.py b/scripts/test_list.py
> index 76fdcf3dbb4f..a55d2977c7c3 100755
> --- a/scripts/test_list.py
> +++ b/scripts/test_list.py
> @@ -838,6 +838,7 @@ class TestList:
> if "order" in self.props[sort_field]["_properties_"]:
> order = self.props[sort_field]["_properties_"]["order"]
>
> + subtest_array = []
> for test in sorted(self.doc.keys()):
> fname = self.doc[test]["File"]
>
> @@ -845,44 +846,46 @@ class TestList:
> test_name = re.sub(r'\.[ch]', '', test_name)
> test_name = "igt@" + test_name
>
> - subtest_array = self.expand_subtest(fname, test_name, test, True)
> + subtest_array += self.expand_subtest(fname, test_name, test, True)
>
> - for subtest in subtest_array:
> - if self.__filter_subtest(test, subtest, True):
> - continue
> + subtest_array.sort(key = lambda x : x.get('Summary'))
>
> - if sort_field:
> - if sort_field in subtest:
> - if expand:
> - test_list = subtest[sort_field].split(expand)
> - test_list = [s.strip() for s in test_list]
> + for subtest in subtest_array:
> + if self.__filter_subtest(test, subtest, True):
> + continue
>
> - for test_elem in test_list:
> - if test_elem not in subtests:
> - subtests[test_elem] = []
> - if order:
> - subtests[test_elem].append((subtest["Summary"], test_list))
> - else:
> - subtests[test_elem].append(subtest["Summary"])
> - else:
> - if subtest[sort_field] not in subtests:
> - subtests[subtest[sort_field]] = []
> - if order:
> - subtests[test_elem].append((subtest["Summary"], [subtest[sort_field]]))
> - else:
> - subtests[subtest[sort_field]].append(subtest["Summary"])
> + if sort_field:
> + if sort_field in subtest:
> + if expand:
> + test_list = subtest[sort_field].split(expand)
> + test_list = [s.strip() for s in test_list]
> +
> + for test_elem in test_list:
> + if test_elem not in subtests:
> + subtests[test_elem] = []
> + if order:
> + subtests[test_elem].append((subtest["Summary"], test_list))
> + else:
> + subtests[test_elem].append(subtest["Summary"])
> else:
> - if order:
> - subtests[test_elem].append((subtest["Summary"], [subtest[sort_field]]))
> - else:
> - subtests[""].append(subtest["Summary"])
> -
> + if subtest[sort_field] not in subtests:
> + subtests[subtest[sort_field]] = []
> + if order:
> + subtests[test_elem].append((subtest["Summary"], [subtest[sort_field]]))
> + else:
> + subtests[subtest[sort_field]].append(subtest["Summary"])
> else:
> if order:
> subtests[test_elem].append((subtest["Summary"], [subtest[sort_field]]))
> else:
> subtests[""].append(subtest["Summary"])
>
> + else:
> + if order:
> + subtests[test_elem].append((subtest["Summary"], [subtest[sort_field]]))
> + else:
> + subtests[""].append(subtest["Summary"])
> +
> if order:
> for group, tests in subtests.items():
> prefix_tests = []
> --
> 2.40.1
>
^ permalink raw reply [flat|nested] 11+ messages in thread
end of thread, other threads:[~2023-06-21 16:49 UTC | newest]
Thread overview: 11+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2023-06-20 8:55 [igt-dev] [PATCH i-g-t v2 0/4] generate an ordered testlist for Xe driver Mauro Carvalho Chehab
2023-06-20 8:55 ` [igt-dev] [PATCH i-g-t v2 1/4] scripts/test_list.py: add support for ordering testlists Mauro Carvalho Chehab
2023-06-21 16:44 ` Kamil Konieczny
2023-06-20 8:55 ` [igt-dev] [PATCH i-g-t v2 2/4] xe_test_config.json: add an order for run type Mauro Carvalho Chehab
2023-06-21 16:45 ` Kamil Konieczny
2023-06-20 8:55 ` [igt-dev] [PATCH i-g-t v2 3/4] tests/xe: add run type fields to order testlists Mauro Carvalho Chehab
2023-06-21 16:46 ` Kamil Konieczny
2023-06-20 8:55 ` [igt-dev] [PATCH i-g-t v2 4/4] scripts/test_list.py: produce alphabetically ordered testlists Mauro Carvalho Chehab
2023-06-21 16:48 ` Kamil Konieczny
2023-06-20 10:54 ` [igt-dev] ✓ Fi.CI.BAT: success for generate an ordered testlist for Xe driver (rev2) Patchwork
2023-06-20 15:43 ` [igt-dev] ✓ Fi.CI.IGT: " Patchwork
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox