Re: [docs] Updating the list of sanity tested distros?

[Richard Purdie <richard.purdie@linuxfoundation.org>]

On Fri, 2023-07-28 at 20:41 +0200, Michael Opdenacker via
lists.yoctoproject.org wrote:
> Greetings,
> 
> As far as I understand, the list of distros that the Yocto Project 
> supports (or should claim it supports) is the intersection of the list 
> of sanity tested distros (SANITY_TESTED_DISTROS in 
> meta-poky/conf/distro/poky.conf) and the distribution versions that are 
> still publicly supported by their vendors (as checked on Wikipedia). 
> There's no point in claiming to support a distribution for which package 
> updates are no longer available.
> 
> Currently for master, this intersection is only:
> 
>   * Ubuntu 20.04 (LTS)
>   * Ubuntu 22.04 (LTS)
>   * Fedora 37
>   * Debian GNU/Linux 11.x (Bullseye)
>   * OpenSUSE Leap 15.4
> 
> Here are a few obvious absents here:
> 
>   * AlmaLinux: version 8.7 and 9.1 are still in SANITY_TESTED_DISTROS
>     but they are obsolete. I see an AlmaLinux9 worker on
>     https://autobuilder.yoctoproject.org/typhoon/#/workers, but I don't
>     know whether it's 9.1 or 9.2 (not obsolete unlike 9.1).
>   * Fedora 38: important as Fedora 37 ends in November. I see a Fedora38
>     worker, but there are still failed jobs, even though the majority
>     are successful. When is a distro version ready to be added to
>     SANITY_TESTED_DISTROS?.
>   * Debian 12: we also have such a worker, with a mix of successful and
>     failed builds. Is this version eligible too?
>   * OpenSuse Leap 15.5, as OpenSuse Leap 15.4 expires in November too. I
>     see a worker, but with only failed builds.
> 
> I'd say that the most urgent one is AlmaLinux 9.2 as otherwise we don't 
> support AlmaLinux any more. The next ones for the end of the year are 
> Fedora 38 and OpenSuse Leap 15.5.
> 
> Would you have any thoughts?
> 
> I was about to send a documentation update to declare that master (and 
> probably Mickledore and Kirkstone) only support 5 different distribution 
> versions, but a longer list would look better...

We keep seeming to discuss this but it is really quite simple, we
document what we test on.

We are currently testing on alma8 and alma9. I don't know which version
of alma9 but I'd suspect the most recent one and we can check. We can
list those until the workers are retired.

With regard to the failed builds, the question is whether the failed
builds are due to the patches under test or some underlying issue with
those systems. They would not be in general use in the pool if they
weren't able to build master so it is fine to document all of those
there for master. I'm sure the failures are due to failures in patches
under test at this point.

The exclusion list for older releases can be and is different as some
workers are not enabled for some releases. You can see the mappings
here:

https://git.yoctoproject.org/yocto-autobuilder2/tree/config.py#n160

i.e. mickledore is matching master so far and kirkstone isn't using
fedora38 yet (for example).

Cheers,

Richard