Using Unicamp's Minicloud for the QEMU CI

Using Unicamp's Minicloud for the QEMU CI

[Lucas Mateus Martins Araujo e Castro]

[-- Attachment #1: Type: text/plain, Size: 949 bytes --]

Hi everyone!

I would like gauge the interest in using Minicloud's infrastructure[1] 
for the CI, talking with some people from there they are interested. It 
has both ppc64 and pp64le images, multiple versions of 4 distros 
(Ubuntu, Fedora, Debian and CentOS).

I've made a initial test setup in a fork[2] with a branch(ppc64-runners) 
that has both a new pipeline with jobs to run on the ppc64/ppc64le 
runners and updated some scripts (mainly the build-environment.yml) to 
automate the setup of the environment in those architectures.

[1] https://openpower.ic.unicamp.br/minicloud/

[2] https://gitlab.com/ppc64/qemu/-/pipelines

Att.

-- 
Lucas Mateus M. Araujo e Castro
Instituto de Pesquisas ELDORADO 
<https://www.eldorado.org.br/?utm_campaign=assinatura_de_e-mail&utm_medium=email&utm_source=RD+Station>
Departamento Computação Embarcada
Analista de Software Trainee
Aviso Legal - Disclaimer <https://www.eldorado.org.br/disclaimer.html>

[-- Attachment #2: Type: text/html, Size: 1513 bytes --]

Using Unicamp's Minicloud for the QEMU CI

[Lucas Mateus Martins Araujo e Castro]

[-- Attachment #1: Type: text/plain, Size: 1011 bytes --]

Hi everyone!

I would like gauge the interest in using Minicloud's infrastructure[1] 
for the CI, talking with some people from there they are interested. It 
has both ppc64 and pp64le images, multiple versions of 4 distros 
(Ubuntu, Fedora, Debian and CentOS).

I've made a initial test setup in a fork[2] with a branch(ppc64-runners) 
that has both a new pipeline with jobs to run on the ppc64/ppc64le 
runners and updated some scripts (mainly the build-environment.yml) to 
automate the setup of the environment in those architectures.

[1] https://openpower.ic.unicamp.br/minicloud/

[2] https://gitlab.com/ppc64/qemu/-/pipelines

P.S.: Re-sending due to an error

Att.

-- 
Lucas Mateus M. Araujo e Castro
Instituto de Pesquisas ELDORADO 
<https://www.eldorado.org.br/?utm_campaign=assinatura_de_e-mail&utm_medium=email&utm_source=RD+Station>
Departamento Computação Embarcada
Analista de Software Trainee
Aviso Legal - Disclaimer <https://www.eldorado.org.br/disclaimer.html>

[-- Attachment #2: Type: text/html, Size: 1720 bytes --]

Re: Using Unicamp's Minicloud for the QEMU CI

[Lucas Mateus Martins Araujo e Castro]

[-- Attachment #1: Type: text/plain, Size: 703 bytes --]

ping

Any interest in this?

On 12/07/2022 11:51, Lucas Mateus Martins Araujo e Castro wrote:
>
> Hi everyone!
>
> I would like gauge the interest in using Minicloud's infrastructure[1] 
> for the CI, talking with some people from there they are interested. 
> It has both ppc64 and pp64le images, multiple versions of 4 distros 
> (Ubuntu, Fedora, Debian and CentOS).
>
>
-- 
Lucas Mateus M. Araujo e Castro
Instituto de Pesquisas ELDORADO 
<https://www.eldorado.org.br/?utm_campaign=assinatura_de_e-mail&utm_medium=email&utm_source=RD+Station>
Departamento Computação Embarcada
Analista de Software Trainee
Aviso Legal - Disclaimer <https://www.eldorado.org.br/disclaimer.html>

[-- Attachment #2: Type: text/html, Size: 1308 bytes --]

Re: Using Unicamp's Minicloud for the QEMU CI

[Peter Maydell]

On Thu, 18 Aug 2022 at 17:11, Lucas Mateus Martins Araujo e Castro
<lucas.araujo@eldorado.org.br> wrote:
> Lucas wrote:
>> I would like gauge the interest in using Minicloud's infrastructure[1]
>> for the CI, talking with some people from there they are interested.
>> It has both ppc64 and pp64le images, multiple versions of 4 distros
>> (Ubuntu, Fedora, Debian and CentOS).

> ping
>
> Any interest in this?

PPC host is something we're currently missing in our testing, so definitely
yes in principle. I don't know what the specifics of getting new runners
set up is, though. Alex ?

thanks
-- PMM

Re: Using Unicamp's Minicloud for the QEMU CI

[Alex Bennée]

Peter Maydell <peter.maydell@linaro.org> writes:

> On Thu, 18 Aug 2022 at 17:11, Lucas Mateus Martins Araujo e Castro
> <lucas.araujo@eldorado.org.br> wrote:
>> Lucas wrote:
>>> I would like gauge the interest in using Minicloud's infrastructure[1]
>>> for the CI, talking with some people from there they are interested.
>>> It has both ppc64 and pp64le images, multiple versions of 4 distros
>>> (Ubuntu, Fedora, Debian and CentOS).
>
>> ping
>>
>> Any interest in this?
>
> PPC host is something we're currently missing in our testing, so definitely
> yes in principle. I don't know what the specifics of getting new runners
> set up is, though. Alex ?

So the first thing is can we have a minicloud VM dedicated to CI 24/7?
Our current usage of the GitLab CI model relies on the runner always
running on the host rather than being spun up on demand.

After that you need to extend:

  scripts/ci/setup/build-environment.yml
  scripts/ci/setup/gitlab-runner.yml

to setup a ppc64 host and setup the gitlab runner on it. We document
this at:

  https://qemu.readthedocs.io/en/latest/devel/ci.html#machine-setup-howto

After that we can define a new variable in the GitLab config
(PPC64_RUNNER_AVAILABLE) and then define some custom build jobs in:

  .gitlab-ci.d/custom-runners/

to run the build and test on the native ppc64 HW.

It looks like your branch has most of this stuff already but I couldn't
see any successful runs. I think this is tripped up by our switch to not
trigger CI by default. See the documentation about QEMU_CI:

  https://qemu.readthedocs.io/en/latest/devel/ci.html#setting-aliases-in-your-git-config

-- 
Alex Bennée