Igt-dev Archive on lore.kernel.org
 help / color / mirror / Atom feed
* [igt-dev] [PATCH i-g-t v5 00/11] Xe: set Run type from testlist instead of defining it
@ 2023-09-08 10:31 Mauro Carvalho Chehab
  2023-09-08 10:31 ` [igt-dev] [PATCH i-g-t v5 01/11] test_list.py: add support for reading testlist regular expressions Mauro Carvalho Chehab
                   ` (13 more replies)
  0 siblings, 14 replies; 15+ messages in thread
From: Mauro Carvalho Chehab @ 2023-09-08 10:31 UTC (permalink / raw)
  To: igt-dev; +Cc: tomasz.mistat, jari.tahvanainen

From: Mauro Carvalho Chehab <mchehab@kernel.org>

Right now, we're keeping testlists both at documentation and on
separate testlist files. That makes harder to maintain. It also
requires splitting wildcards on multiple fields just due to that.

In the end, only the testlist files are updated.

So, simplify the maintainance by reading the testlists and parsing
them directly.

This will also handle tests that are blacklisted for all platforms.

---

v5:
  - Restored patch descriptions modified due to previous reviews;
  - No changes at the patches.

v4:
  - XLS spreadsheet output format improved;
  - XLS logic can now split fields per their values. This is used for
    GPU excluded platform field, as this is meant to indicate that a
    test is blacklisted due to the lack of hardware support on a given
    platform;
  - When updating fields from testlists/blocklists, only store
    value when it is not empty and don't have a default value;
  - remove a broken logic of trying to automate adding a prefix to
    testlists.

v3:
  - Added a patch to handle testlist/blacklist regular expressions
    the same way as done by IGT runner

v2:
  - v2: no changes. Just rebased on the top of current TIP

Mauro Carvalho Chehab (11):
  test_list.py: add support for reading testlist regular expressions
  xe_test_config.json: add testlists and blocklists
  kms_test_config.json: add testlists and blocklists
  tests: Intel Xe: drop Run type field
  tests: Intel KMS: drop Run type field
  scripts/test_list.py: move "FULL" testlist to config file
  scripts/test_list.py: don't be greedy while matching data from
    testlists
  scripts/test_list.py: fix gen_testlist logic
  scripts/test_list.py: add support for expanding fields on spreadsheet
  scripts/doc_to_xls.py: expand GPU excluded platform
  scripts/doc_to_xls.py: improve XLS output format

 scripts/doc_to_xls.py                  |  22 ++-
 scripts/test_list.py                   | 119 +++++++++++++-
 tests/chamelium/kms_chamelium_audio.c  |   4 -
 tests/chamelium/kms_chamelium_color.c  |   3 -
 tests/chamelium/kms_chamelium_edid.c   |  10 --
 tests/chamelium/kms_chamelium_frames.c |  10 --
 tests/chamelium/kms_chamelium_hpd.c    |  25 ---
 tests/intel/kms_big_fb.c               |  12 --
 tests/intel/kms_big_joiner.c           |   3 -
 tests/intel/kms_busy.c                 |   5 -
 tests/intel/kms_ccs.c                  |   3 -
 tests/intel/kms_cdclk.c                |   3 -
 tests/intel/kms_draw_crc.c             |   3 -
 tests/intel/kms_dsc.c                  |   1 -
 tests/intel/kms_fb_coherency.c         |   1 -
 tests/intel/kms_fbcon_fbt.c            |   4 -
 tests/intel/kms_fence_pin_leak.c       |   1 -
 tests/intel/kms_flip_scaled_crc.c      |  19 ---
 tests/intel/kms_flip_tiling.c          |   1 -
 tests/intel/kms_frontbuffer_tracking.c | 206 -------------------------
 tests/intel/kms_legacy_colorkey.c      |   2 -
 tests/intel/kms_mmap_write_crc.c       |   1 -
 tests/intel/kms_pipe_b_c_ivb.c         |   5 -
 tests/intel/kms_psr.c                  |  19 ---
 tests/intel/kms_psr2_sf.c              |   8 -
 tests/intel/kms_psr2_su.c              |   2 -
 tests/intel/kms_psr_stress_test.c      |   2 -
 tests/intel/kms_pwrite_crc.c           |   1 -
 tests/intel/kms_test_config.json       |  15 +-
 tests/intel/xe_ccs.c                   |   1 -
 tests/intel/xe_compute.c               |   1 -
 tests/intel/xe_create.c                |   2 -
 tests/intel/xe_debugfs.c               |   1 -
 tests/intel/xe_dma_buf_sync.c          |   4 -
 tests/intel/xe_evict.c                 |  10 --
 tests/intel/xe_exec_balancer.c         |  11 --
 tests/intel/xe_exec_basic.c            |   6 -
 tests/intel/xe_exec_compute_mode.c     |   4 -
 tests/intel/xe_exec_fault_mode.c       |   8 -
 tests/intel/xe_exec_reset.c            |  23 ---
 tests/intel/xe_exec_store.c            |   2 -
 tests/intel/xe_exec_threads.c          |   2 -
 tests/intel/xe_exercise_blt.c          |   1 -
 tests/intel/xe_gpgpu_fill.c            |   1 -
 tests/intel/xe_guc_pc.c                |   9 --
 tests/intel/xe_huc_copy.c              |   1 -
 tests/intel/xe_intel_bb.c              |  13 --
 tests/intel/xe_live_ktest.c            |   1 -
 tests/intel/xe_media_fill.c            |   1 -
 tests/intel/xe_mmap.c                  |   1 -
 tests/intel/xe_mmio.c                  |   1 -
 tests/intel/xe_module_load.c           |   6 -
 tests/intel/xe_noexec_ping_pong.c      |   1 -
 tests/intel/xe_pm.c                    |   2 -
 tests/intel/xe_pm_residency.c          |   4 -
 tests/intel/xe_prime_self_import.c     |   8 -
 tests/intel/xe_query.c                 |   1 -
 tests/intel/xe_spin_batch.c            |   4 -
 tests/intel/xe_sysfs_defaults.c        |   1 -
 tests/intel/xe_sysfs_scheduler.c       |   1 -
 tests/intel/xe_sysfs_tile.c            |   1 -
 tests/intel/xe_test_config.json        |   7 +
 tests/intel/xe_uevent.c                |   1 -
 tests/intel/xe_vm.c                    |  22 ---
 tests/intel/xe_waitfence.c             |   1 -
 tests/kms_3d.c                         |   1 -
 tests/kms_addfb_basic.c                |  27 ----
 tests/kms_async_flips.c                |   6 -
 tests/kms_atomic.c                     |   8 -
 tests/kms_atomic_interruptible.c       |   5 -
 tests/kms_atomic_transition.c          |   7 -
 tests/kms_bw.c                         |   1 -
 tests/kms_color.c                      |   7 -
 tests/kms_concurrent.c                 |   1 -
 tests/kms_content_protection.c         |   7 -
 tests/kms_cursor_crc.c                 |   4 -
 tests/kms_cursor_edge_walk.c           |   1 -
 tests/kms_cursor_legacy.c              |  16 --
 tests/kms_display_modes.c              |   2 -
 tests/kms_dither.c                     |   2 -
 tests/kms_dp_aux_dev.c                 |   1 -
 tests/kms_flip.c                       |  26 ----
 tests/kms_flip_event_leak.c            |   1 -
 tests/kms_force_connector_basic.c      |   4 -
 tests/kms_getfb.c                      |   7 -
 tests/kms_hdmi_inject.c                |   2 -
 tests/kms_hdr.c                        |   8 -
 tests/kms_invalid_mode.c               |   1 -
 tests/kms_lease.c                      |  21 ---
 tests/kms_multipipe_modeset.c          |   1 -
 tests/kms_panel_fitting.c              |   2 -
 tests/kms_pipe_crc_basic.c             |   9 --
 tests/kms_plane.c                      |   6 -
 tests/kms_plane_alpha_blend.c          |   4 -
 tests/kms_plane_cursor.c               |   3 -
 tests/kms_plane_lowres.c               |   2 -
 tests/kms_plane_multiple.c             |   2 -
 tests/kms_plane_scaling.c              |  21 ---
 tests/kms_prime.c                      |   3 -
 tests/kms_prop_blob.c                  |   4 -
 tests/kms_properties.c                 |   2 -
 tests/kms_rmfb.c                       |   2 -
 tests/kms_rotation_crc.c               |  10 --
 tests/kms_scaling_modes.c              |   1 -
 tests/kms_selftest.c                   |   1 -
 tests/kms_sequence.c                   |   2 -
 tests/kms_setmode.c                    |   6 -
 tests/kms_sysfs_edid_timing.c          |   1 -
 tests/kms_tiled_display.c              |   2 -
 tests/kms_tv_load_detect.c             |   1 -
 tests/kms_universal_plane.c            |   4 -
 tests/kms_vblank.c                     |   9 --
 tests/kms_vrr.c                        |   5 -
 tests/kms_writeback.c                  |   4 -
 tests/testdisplay.c                    |   1 -
 115 files changed, 152 insertions(+), 796 deletions(-)

-- 
2.41.0

^ permalink raw reply	[flat|nested] 15+ messages in thread

end of thread, other threads:[~2023-09-08 17:31 UTC | newest]

Thread overview: 15+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2023-09-08 10:31 [igt-dev] [PATCH i-g-t v5 00/11] Xe: set Run type from testlist instead of defining it Mauro Carvalho Chehab
2023-09-08 10:31 ` [igt-dev] [PATCH i-g-t v5 01/11] test_list.py: add support for reading testlist regular expressions Mauro Carvalho Chehab
2023-09-08 10:31 ` [igt-dev] [PATCH i-g-t v5 02/11] xe_test_config.json: add testlists and blocklists Mauro Carvalho Chehab
2023-09-08 10:31 ` [igt-dev] [PATCH i-g-t v5 03/11] kms_test_config.json: " Mauro Carvalho Chehab
2023-09-08 10:31 ` [igt-dev] [PATCH i-g-t v5 04/11] tests: Intel Xe: drop Run type field Mauro Carvalho Chehab
2023-09-08 10:31 ` [igt-dev] [PATCH i-g-t v5 05/11] tests: Intel KMS: " Mauro Carvalho Chehab
2023-09-08 10:31 ` [igt-dev] [PATCH i-g-t v5 06/11] scripts/test_list.py: move "FULL" testlist to config file Mauro Carvalho Chehab
2023-09-08 10:31 ` [igt-dev] [PATCH i-g-t v5 07/11] scripts/test_list.py: don't be greedy while matching data from testlists Mauro Carvalho Chehab
2023-09-08 10:31 ` [igt-dev] [PATCH i-g-t v5 08/11] scripts/test_list.py: fix gen_testlist logic Mauro Carvalho Chehab
2023-09-08 10:31 ` [igt-dev] [PATCH i-g-t v5 09/11] scripts/test_list.py: add support for expanding fields on spreadsheet Mauro Carvalho Chehab
2023-09-08 10:31 ` [igt-dev] [PATCH i-g-t v5 10/11] scripts/doc_to_xls.py: expand GPU excluded platform Mauro Carvalho Chehab
2023-09-08 10:31 ` [igt-dev] [PATCH i-g-t v5 11/11] scripts/doc_to_xls.py: improve XLS output format Mauro Carvalho Chehab
2023-09-08 11:15 ` [igt-dev] ✓ Fi.CI.BAT: success for Xe: set Run type from testlist instead of defining it Patchwork
2023-09-08 11:16 ` [igt-dev] ✓ CI.xeBAT: " Patchwork
2023-09-08 17:31 ` [igt-dev] ✓ Fi.CI.IGT: " Patchwork

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox