Re: drm-ci: flaky tests for msm driver testing

[Vignesh Raman <vignesh.raman@collabora.com>]

Hi Maintainers,

On 12/07/24 11:35, Vignesh Raman wrote:
> Hi Maintainers,
> 
> On 28/05/24 11:39, Vignesh Raman wrote:
>> Hi Maintainers,
>>
>> There are some flaky tests reported for msm driver testing in drm-ci 
>> for the below boards.
>>
>> *)
>> # Board Name: apq8096-db820c
>> # IGT Version: 1.28-g0df7b9b97
>> # Linux Version: 6.9.0-rc7
>> # Failure Rate: 50
>> dumb_buffer@create-clear
>>
>> *)
>> # Board Name: sc7180-trogdor-kingoftown
>> # IGT Version: 1.28-g0df7b9b97
>> # Linux Version: 6.9.0-rc7
>> # Failure Rate: 50
>> msm_mapping@shadow
>> msm_shrink@copy-gpu-oom-32
>> msm_shrink@copy-gpu-oom-8
>>
>> *)
>> # Board Name: sc7180-trogdor-lazor-limozeen-nots-r5
>> # IGT Version: 1.28-g0df7b9b97
>> # Linux Version: 6.9.0-rc7
>> # Failure Rate: 50
>> msm_mapping@shadow
>>
>> *)
>> # Board Name: sdm845-cheza-r3
>> # IGT Version: 1.28-g0df7b9b97
>> # Linux Version: 6.9.0-rc7
>> # Failure Rate: 50
>> kms_cursor_legacy@basic-flip-after-cursor-atomic
>> kms_cursor_legacy@basic-flip-after-cursor-legacy
>> kms_cursor_legacy@basic-flip-after-cursor-varying-size
>> kms_cursor_legacy@basic-flip-before-cursor-varying-size
>> kms_cursor_legacy@flip-vs-cursor-atomic-transitions
>> kms_cursor_legacy@flip-vs-cursor-atomic-transitions-varying-size
>> kms_cursor_legacy@flip-vs-cursor-varying-size
>> kms_cursor_legacy@short-flip-after-cursor-atomic-transitions
>> kms_cursor_legacy@short-flip-after-cursor-atomic-transitions-varying-size
>> kms_cursor_legacy@short-flip-after-cursor-toggle
>> kms_cursor_legacy@short-flip-before-cursor-atomic-transitions
>> kms_cursor_legacy@short-flip-before-cursor-atomic-transitions-varying-size
>> msm_shrink@copy-gpu-32
>> msm_shrink@copy-gpu-oom-32
>>
>> Will add these tests in,
>> drivers/gpu/drm/ci/xfails/msm-apq8096-flakes.txt
>> drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-kingoftown-flakes.txt
>> drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-lazor-limozeen-flakes.txt
>> drivers/gpu/drm/ci/xfails/msm-sdm845-flakes.txt
>>
>> (https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git/tree/Documentation/gpu/automated_testing.rst#n70)
>>
>> Please could you have a look at these test results and let us know if 
>> you need more information. Thank you.
> 
> There are some flaky tests reported for msm driver testing in drm-ci 
> with the recent IGT uprev 
> (https://gitlab.freedesktop.org/drm/misc/kernel/-/commit/0e7f4e6a20d550252c4f355d5a303b1d9c8ff052)
> 
> *)
> # Board Name: sc7180-trogdor-lazor-limozeen-nots-r5
> # Bug Report: 
> https://lore.kernel.org/linux-arm-msm/661483c8-ad82-400d-bcd8-e94986d20d7d@collabora.com/T/#u
> # Failure Rate: 100
> # IGT Version: 1.28-gf13702b8e
> # Linux Version: 6.10.0-rc5
> kms_lease@page-flip-implicit-plane
> 
> *)
> # Board Name: sdm845-cheza-r3
> # Bug Report: 
> https://lore.kernel.org/linux-arm-msm/661483c8-ad82-400d-bcd8-e94986d20d7d@collabora.com/T/#u
> # Failure Rate: 50
> # IGT Version: 1.28-gf13702b8e
> # Linux Version: 6.10.0-rc5
> kms_cursor_legacy@short-flip-before-cursor-toggle
> kms_cursor_legacy@flip-vs-cursor-toggle
> msm/msm_shrink@copy-mmap-oom-8s
> 
> The expectation files have been updated with these tests,
> https://gitlab.freedesktop.org/drm/misc/kernel/-/blob/drm-misc-next/drivers/gpu/drm/ci/xfails/msm-sc7180-trogdor-lazor-limozeen-flakes.txt
> 
> https://gitlab.freedesktop.org/drm/misc/kernel/-/blob/drm-misc-next/drivers/gpu/drm/ci/xfails/msm-sdm845-flakes.txt

There are some flaky tests reported for msm driver testing in drm-ci 
with the recent IGT uprev.

# Board Name: sdm845-cheza-r3
# Failure Rate: 50
# IGT Version: 1.28-ga73311079
# Linux Version: 6.11.0-rc2
kms_lease@page-flip-implicit-plane

# Board Name: sdm845-cheza-r3
# Failure Rate: 50
# IGT Version: 1.28-ga73311079
# Linux Version: 6.11.0-rc5
kms_flip@flip-vs-expired-vblank

The expectation files have been updated with these tests,

https://gitlab.freedesktop.org/drm/misc/kernel/-/blob/drm-misc-next/drivers/gpu/drm/ci/xfails/msm-sdm845-flakes.txt

Please could you have a look at these test results and let us know if 
you need more information. Thank you.

Regards,
Vignesh