[igt-dev] [PATCH 0/3] Add seperate blacklist for specific config

[igt-dev] [PATCH 0/3] Add seperate blacklist for specific config

[Kunal Joshi]

Different setups in CI may have different config,
we can apply suitable blacklist and get clear
results.

Kunal Joshi (3):
  tests/intel-ci: Added chamelium config blacklist
  tests/intel-ci: Added psr config blacklist
  tests/intel-ci: added blacklist to meson.build

 tests/intel-ci/chamelium.blacklist | 1 +
 tests/intel-ci/meson.build         | 2 ++
 tests/intel-ci/psr.blacklist       | 1 +
 3 files changed, 4 insertions(+)
 create mode 100644 tests/intel-ci/chamelium.blacklist
 create mode 100644 tests/intel-ci/psr.blacklist

-- 
2.25.1

[igt-dev] [PATCH 1/3] tests/intel-ci: Added chamelium config blacklist

[Kunal Joshi]

blacklist for non chamelium config

Signed-off-by: Kunal Joshi <kunal1.joshi@intel.com>
---
 tests/intel-ci/chamelium.blacklist | 1 +
 1 file changed, 1 insertion(+)
 create mode 100644 tests/intel-ci/chamelium.blacklist

diff --git a/tests/intel-ci/chamelium.blacklist b/tests/intel-ci/chamelium.blacklist
new file mode 100644
index 000000000..c0325b555
--- /dev/null
+++ b/tests/intel-ci/chamelium.blacklist
@@ -0,0 +1 @@
+igt@.*chamelium.*
-- 
2.25.1

[igt-dev] [PATCH 2/3] tests/intel-ci: Added psr config blacklist

[Kunal Joshi]

blacklist for non psr config

Signed-off-by: Kunal Joshi <kunal1.joshi@intel.com>
---
 tests/intel-ci/psr.blacklist | 1 +
 1 file changed, 1 insertion(+)
 create mode 100644 tests/intel-ci/psr.blacklist

diff --git a/tests/intel-ci/psr.blacklist b/tests/intel-ci/psr.blacklist
new file mode 100644
index 000000000..8356a92f7
--- /dev/null
+++ b/tests/intel-ci/psr.blacklist
@@ -0,0 +1 @@
+igt@.*psr.*
-- 
2.25.1

[igt-dev] [PATCH 3/3] tests/intel-ci: added blacklist to meson.build

[Kunal Joshi]

Signed-off-by: Kunal Joshi <kunal1.joshi@intel.com>
---
 tests/intel-ci/meson.build | 2 ++
 1 file changed, 2 insertions(+)

diff --git a/tests/intel-ci/meson.build b/tests/intel-ci/meson.build
index d5a6e4f47..9f6ed501d 100644
--- a/tests/intel-ci/meson.build
+++ b/tests/intel-ci/meson.build
@@ -7,6 +7,8 @@ intelci_files = [
   'blacklist-pre-merge.txt',
   'xe-fast-feedback.testlist',
   'xe.blocklist.txt',
+  'chamelium.blacklist',
+  'psr.blacklist',
 ]
 
 install_data(sources : intelci_files, install_dir : datadir)
-- 
2.25.1

[igt-dev] ○ CI.xeBAT: info for Add seperate blacklist for specific config (rev2)

[Patchwork]

[-- Attachment #1: Type: text/plain, Size: 347 bytes --]

== Series Details ==

Series: Add seperate blacklist for specific config (rev2)
URL   : https://patchwork.freedesktop.org/series/120824/
State : info

== Summary ==

Participating hosts:
bat-pvc-2
bat-atsm-2
bat-dg2-oem2
bat-adlp-7
Missing hosts results[0]:
Results: [IGTPW_9431](https://intel-gfx-ci.01.org/tree/intel-xe/IGTPW_9431/index.html)



[-- Attachment #2: Type: text/html, Size: 863 bytes --]

[igt-dev] ✗ Fi.CI.BAT: failure for Add seperate blacklist for specific config (rev2)

[Patchwork]

[-- Attachment #1: Type: text/plain, Size: 11234 bytes --]

== Series Details ==

Series: Add seperate blacklist for specific config (rev2)
URL   : https://patchwork.freedesktop.org/series/120824/
State : failure

== Summary ==

CI Bug Log - changes from IGT_7393 -> IGTPW_9431
====================================================

Summary
-------

  **FAILURE**

  Serious unknown changes coming with IGTPW_9431 absolutely need to be
  verified manually.
  
  If you think the reported changes have nothing to do with the changes
  introduced in IGTPW_9431, please notify your bug team to allow them
  to document this new failure mode, which will reduce false positives in CI.

  External URL: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9431/index.html

Participating hosts (44 -> 43)
------------------------------

  Missing    (1): fi-snb-2520m 

Possible new issues
-------------------

  Here are the unknown changes that may have been introduced in IGTPW_9431:

### IGT changes ###

#### Possible regressions ####

  * igt@kms_addfb_basic@basic:
    - fi-kbl-soraka:      [PASS][1] -> [INCOMPLETE][2]
   [1]: https://intel-gfx-ci.01.org/tree/drm-tip/IGT_7393/fi-kbl-soraka/igt@kms_addfb_basic@basic.html
   [2]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9431/fi-kbl-soraka/igt@kms_addfb_basic@basic.html

  
Known issues
------------

  Here are the changes found in IGTPW_9431 that come from known issues:

### IGT changes ###

#### Issues hit ####

  * igt@core_auth@basic-auth:
    - bat-adlp-11:        NOTRUN -> [ABORT][3] ([i915#8011])
   [3]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9431/bat-adlp-11/igt@core_auth@basic-auth.html

  * igt@gem_exec_suspend@basic-s0@lmem0:
    - bat-atsm-1:         NOTRUN -> [DMESG-WARN][4] ([i915#8841]) +3 similar issues
   [4]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9431/bat-atsm-1/igt@gem_exec_suspend@basic-s0@lmem0.html

  * igt@gem_exec_suspend@basic-s3@lmem0:
    - bat-atsm-1:         NOTRUN -> [DMESG-WARN][5] ([i915#8504] / [i915#8841])
   [5]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9431/bat-atsm-1/igt@gem_exec_suspend@basic-s3@lmem0.html

  * igt@gem_lmem_swapping@basic:
    - fi-apl-guc:         NOTRUN -> [SKIP][6] ([fdo#109271] / [i915#4613]) +3 similar issues
   [6]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9431/fi-apl-guc/igt@gem_lmem_swapping@basic.html

  * igt@i915_pm_rpm@module-reload:
    - fi-rkl-11600:       [PASS][7] -> [FAIL][8] ([i915#7940])
   [7]: https://intel-gfx-ci.01.org/tree/drm-tip/IGT_7393/fi-rkl-11600/igt@i915_pm_rpm@module-reload.html
   [8]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9431/fi-rkl-11600/igt@i915_pm_rpm@module-reload.html

  * igt@i915_selftest@live@gt_heartbeat:
    - fi-apl-guc:         NOTRUN -> [DMESG-FAIL][9] ([i915#5334])
   [9]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9431/fi-apl-guc/igt@i915_selftest@live@gt_heartbeat.html

  * igt@i915_selftest@live@requests:
    - bat-mtlp-6:         [PASS][10] -> [DMESG-FAIL][11] ([i915#8497])
   [10]: https://intel-gfx-ci.01.org/tree/drm-tip/IGT_7393/bat-mtlp-6/igt@i915_selftest@live@requests.html
   [11]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9431/bat-mtlp-6/igt@i915_selftest@live@requests.html

  * igt@i915_selftest@live@slpc:
    - bat-rpls-1:         NOTRUN -> [DMESG-WARN][12] ([i915#6367])
   [12]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9431/bat-rpls-1/igt@i915_selftest@live@slpc.html

  * igt@i915_suspend@basic-s3-without-i915:
    - bat-atsm-1:         NOTRUN -> [SKIP][13] ([i915#6645])
   [13]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9431/bat-atsm-1/igt@i915_suspend@basic-s3-without-i915.html
    - bat-rpls-1:         NOTRUN -> [ABORT][14] ([i915#6687] / [i915#7978] / [i915#8668])
   [14]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9431/bat-rpls-1/igt@i915_suspend@basic-s3-without-i915.html

  * igt@kms_chamelium_hpd@common-hpd-after-suspend:
    - bat-atsm-1:         NOTRUN -> [SKIP][15] ([i915#6078])
   [15]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9431/bat-atsm-1/igt@kms_chamelium_hpd@common-hpd-after-suspend.html

  * igt@kms_chamelium_hpd@vga-hpd-fast:
    - fi-apl-guc:         NOTRUN -> [SKIP][16] ([fdo#109271]) +22 similar issues
   [16]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9431/fi-apl-guc/igt@kms_chamelium_hpd@vga-hpd-fast.html

  * igt@kms_pipe_crc_basic@nonblocking-crc-frame-sequence:
    - bat-dg2-11:         NOTRUN -> [SKIP][17] ([i915#1845] / [i915#5354]) +3 similar issues
   [17]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9431/bat-dg2-11/igt@kms_pipe_crc_basic@nonblocking-crc-frame-sequence.html

  * igt@kms_pipe_crc_basic@suspend-read-crc:
    - bat-atsm-1:         NOTRUN -> [SKIP][18] ([i915#1836])
   [18]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9431/bat-atsm-1/igt@kms_pipe_crc_basic@suspend-read-crc.html

  * igt@kms_psr@primary_mmap_gtt:
    - bat-rplp-1:         NOTRUN -> [SKIP][19] ([i915#1072]) +1 similar issue
   [19]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9431/bat-rplp-1/igt@kms_psr@primary_mmap_gtt.html

  * igt@kms_setmode@basic-clone-single-crtc:
    - bat-rplp-1:         NOTRUN -> [ABORT][20] ([i915#8260] / [i915#8668])
   [20]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9431/bat-rplp-1/igt@kms_setmode@basic-clone-single-crtc.html

  
#### Possible fixes ####

  * igt@i915_pm_rpm@basic-pci-d3-state:
    - fi-skl-guc:         [FAIL][21] ([i915#7940]) -> [PASS][22]
   [21]: https://intel-gfx-ci.01.org/tree/drm-tip/IGT_7393/fi-skl-guc/igt@i915_pm_rpm@basic-pci-d3-state.html
   [22]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9431/fi-skl-guc/igt@i915_pm_rpm@basic-pci-d3-state.html

  * igt@i915_selftest@live@gt_heartbeat:
    - fi-kbl-guc:         [DMESG-FAIL][23] ([i915#5334] / [i915#7872]) -> [PASS][24]
   [23]: https://intel-gfx-ci.01.org/tree/drm-tip/IGT_7393/fi-kbl-guc/igt@i915_selftest@live@gt_heartbeat.html
   [24]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9431/fi-kbl-guc/igt@i915_selftest@live@gt_heartbeat.html

  * igt@i915_selftest@live@migrate:
    - bat-rpls-2:         [DMESG-FAIL][25] ([i915#7699] / [i915#7913]) -> [PASS][26]
   [25]: https://intel-gfx-ci.01.org/tree/drm-tip/IGT_7393/bat-rpls-2/igt@i915_selftest@live@migrate.html
   [26]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9431/bat-rpls-2/igt@i915_selftest@live@migrate.html
    - bat-atsm-1:         [INCOMPLETE][27] ([i915#7913] / [i915#8504]) -> [PASS][28]
   [27]: https://intel-gfx-ci.01.org/tree/drm-tip/IGT_7393/bat-atsm-1/igt@i915_selftest@live@migrate.html
   [28]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9431/bat-atsm-1/igt@i915_selftest@live@migrate.html

  * igt@i915_selftest@live@reset:
    - bat-rpls-1:         [ABORT][29] ([i915#4983] / [i915#7461] / [i915#8347] / [i915#8384]) -> [PASS][30]
   [29]: https://intel-gfx-ci.01.org/tree/drm-tip/IGT_7393/bat-rpls-1/igt@i915_selftest@live@reset.html
   [30]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9431/bat-rpls-1/igt@i915_selftest@live@reset.html

  * igt@i915_selftest@live@slpc:
    - bat-mtlp-8:         [DMESG-WARN][31] ([i915#6367]) -> [PASS][32]
   [31]: https://intel-gfx-ci.01.org/tree/drm-tip/IGT_7393/bat-mtlp-8/igt@i915_selftest@live@slpc.html
   [32]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9431/bat-mtlp-8/igt@i915_selftest@live@slpc.html

  * igt@kms_pipe_crc_basic@suspend-read-crc@pipe-a-hdmi-a-3:
    - bat-dg2-11:         [INCOMPLETE][33] ([i915#7908]) -> [PASS][34]
   [33]: https://intel-gfx-ci.01.org/tree/drm-tip/IGT_7393/bat-dg2-11/igt@kms_pipe_crc_basic@suspend-read-crc@pipe-a-hdmi-a-3.html
   [34]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9431/bat-dg2-11/igt@kms_pipe_crc_basic@suspend-read-crc@pipe-a-hdmi-a-3.html

  
#### Warnings ####

  * igt@i915_module_load@load:
    - bat-adlp-11:        [ABORT][35] ([i915#4423]) -> [DMESG-WARN][36] ([i915#4423])
   [35]: https://intel-gfx-ci.01.org/tree/drm-tip/IGT_7393/bat-adlp-11/igt@i915_module_load@load.html
   [36]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9431/bat-adlp-11/igt@i915_module_load@load.html

  * igt@i915_pm_rpm@basic-rte:
    - fi-kbl-guc:         [FAIL][37] ([i915#8843]) -> [FAIL][38] ([i915#7940])
   [37]: https://intel-gfx-ci.01.org/tree/drm-tip/IGT_7393/fi-kbl-guc/igt@i915_pm_rpm@basic-rte.html
   [38]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9431/fi-kbl-guc/igt@i915_pm_rpm@basic-rte.html

  * igt@kms_psr@cursor_plane_move:
    - bat-rplp-1:         [ABORT][39] ([i915#8434]) -> [SKIP][40] ([i915#1072])
   [39]: https://intel-gfx-ci.01.org/tree/drm-tip/IGT_7393/bat-rplp-1/igt@kms_psr@cursor_plane_move.html
   [40]: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9431/bat-rplp-1/igt@kms_psr@cursor_plane_move.html

  
  {name}: This element is suppressed. This means it is ignored when computing
          the status of the difference (SUCCESS, WARNING, or FAILURE).

  [fdo#109271]: https://bugs.freedesktop.org/show_bug.cgi?id=109271
  [i915#1072]: https://gitlab.freedesktop.org/drm/intel/issues/1072
  [i915#1836]: https://gitlab.freedesktop.org/drm/intel/issues/1836
  [i915#1845]: https://gitlab.freedesktop.org/drm/intel/issues/1845
  [i915#4423]: https://gitlab.freedesktop.org/drm/intel/issues/4423
  [i915#4613]: https://gitlab.freedesktop.org/drm/intel/issues/4613
  [i915#4983]: https://gitlab.freedesktop.org/drm/intel/issues/4983
  [i915#5334]: https://gitlab.freedesktop.org/drm/intel/issues/5334
  [i915#5354]: https://gitlab.freedesktop.org/drm/intel/issues/5354
  [i915#6078]: https://gitlab.freedesktop.org/drm/intel/issues/6078
  [i915#6367]: https://gitlab.freedesktop.org/drm/intel/issues/6367
  [i915#6645]: https://gitlab.freedesktop.org/drm/intel/issues/6645
  [i915#6687]: https://gitlab.freedesktop.org/drm/intel/issues/6687
  [i915#7461]: https://gitlab.freedesktop.org/drm/intel/issues/7461
  [i915#7699]: https://gitlab.freedesktop.org/drm/intel/issues/7699
  [i915#7872]: https://gitlab.freedesktop.org/drm/intel/issues/7872
  [i915#7908]: https://gitlab.freedesktop.org/drm/intel/issues/7908
  [i915#7913]: https://gitlab.freedesktop.org/drm/intel/issues/7913
  [i915#7940]: https://gitlab.freedesktop.org/drm/intel/issues/7940
  [i915#7978]: https://gitlab.freedesktop.org/drm/intel/issues/7978
  [i915#8011]: https://gitlab.freedesktop.org/drm/intel/issues/8011
  [i915#8260]: https://gitlab.freedesktop.org/drm/intel/issues/8260
  [i915#8347]: https://gitlab.freedesktop.org/drm/intel/issues/8347
  [i915#8384]: https://gitlab.freedesktop.org/drm/intel/issues/8384
  [i915#8434]: https://gitlab.freedesktop.org/drm/intel/issues/8434
  [i915#8497]: https://gitlab.freedesktop.org/drm/intel/issues/8497
  [i915#8504]: https://gitlab.freedesktop.org/drm/intel/issues/8504
  [i915#8668]: https://gitlab.freedesktop.org/drm/intel/issues/8668
  [i915#8841]: https://gitlab.freedesktop.org/drm/intel/issues/8841
  [i915#8843]: https://gitlab.freedesktop.org/drm/intel/issues/8843


Build changes
-------------

  * CI: CI-20190529 -> None
  * IGT: IGT_7393 -> IGTPW_9431

  CI-20190529: 20190529
  CI_DRM_13394: 4fab7ebb2e3675cb9fcd7a94a7b34caa0ea855cf @ git://anongit.freedesktop.org/gfx-ci/linux
  IGTPW_9431: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9431/index.html
  IGT_7393: 7393

== Logs ==

For more details see: https://intel-gfx-ci.01.org/tree/drm-tip/IGTPW_9431/index.html

[-- Attachment #2: Type: text/html, Size: 13230 bytes --]

Re: [igt-dev] [PATCH 1/3] tests/intel-ci: Added chamelium config blacklist

[Karthik B S]

Hi,

Please update the subject to say "non-chamelium" config blacklist. Feels 
a little misleading currently.

On 7/19/2023 12:39 PM, Kunal Joshi wrote:
> blacklist for non chamelium config

Please add details as to where/why this will be used.

With these updates to the commit message, the patch LGTM.

Reviewed-by: Karthik B S <karthik.b.s@intel.com>

>
> Signed-off-by: Kunal Joshi <kunal1.joshi@intel.com>
> ---
>   tests/intel-ci/chamelium.blacklist | 1 +
>   1 file changed, 1 insertion(+)
>   create mode 100644 tests/intel-ci/chamelium.blacklist
>
> diff --git a/tests/intel-ci/chamelium.blacklist b/tests/intel-ci/chamelium.blacklist
> new file mode 100644
> index 000000000..c0325b555
> --- /dev/null
> +++ b/tests/intel-ci/chamelium.blacklist
> @@ -0,0 +1 @@
> +igt@.*chamelium.*

Re: [igt-dev] [PATCH 2/3] tests/intel-ci: Added psr config blacklist

[Karthik B S]

Hi,

Same comments as previous patch.

With those updates in commit message the patch LGTM.

Reviewed-by: Karthik B S <karthik.b.s@intel.com>

On 7/19/2023 12:39 PM, Kunal Joshi wrote:
> blacklist for non psr config
>
> Signed-off-by: Kunal Joshi <kunal1.joshi@intel.com>
> ---
>   tests/intel-ci/psr.blacklist | 1 +
>   1 file changed, 1 insertion(+)
>   create mode 100644 tests/intel-ci/psr.blacklist
>
> diff --git a/tests/intel-ci/psr.blacklist b/tests/intel-ci/psr.blacklist
> new file mode 100644
> index 000000000..8356a92f7
> --- /dev/null
> +++ b/tests/intel-ci/psr.blacklist
> @@ -0,0 +1 @@
> +igt@.*psr.*

Re: [igt-dev] [PATCH 1/3] tests/intel-ci: Added chamelium config blacklist

[Joshi, Kunal1]

Thanks karthik for reviewing.

Will do suggested changes before merging

On 7/20/2023 10:20 AM, Karthik B S wrote:
> Hi,
>
> Please update the subject to say "non-chamelium" config blacklist. 
> Feels a little misleading currently.
>
> On 7/19/2023 12:39 PM, Kunal Joshi wrote:
>> blacklist for non chamelium config
>
> Please add details as to where/why this will be used.
>
> With these updates to the commit message, the patch LGTM.
>
> Reviewed-by: Karthik B S <karthik.b.s@intel.com>
>

Thanks Karthik for reviewing.

Will do suggested changes for both pathces before merging

Regards

Kunal Joshi

Re: [igt-dev] [PATCH 3/3] tests/intel-ci: added blacklist to meson.build

[Karthik B S]

On 7/19/2023 12:39 PM, Kunal Joshi wrote:
> Signed-off-by: Kunal Joshi <kunal1.joshi@intel.com>
Reviewed-by: Karthik B S <karthik.b.s@intel.com>
> ---
>   tests/intel-ci/meson.build | 2 ++
>   1 file changed, 2 insertions(+)
>
> diff --git a/tests/intel-ci/meson.build b/tests/intel-ci/meson.build
> index d5a6e4f47..9f6ed501d 100644
> --- a/tests/intel-ci/meson.build
> +++ b/tests/intel-ci/meson.build
> @@ -7,6 +7,8 @@ intelci_files = [
>     'blacklist-pre-merge.txt',
>     'xe-fast-feedback.testlist',
>     'xe.blocklist.txt',
> +  'chamelium.blacklist',
> +  'psr.blacklist',
>   ]
>   
>   install_data(sources : intelci_files, install_dir : datadir)