From: "Alex Bennée" <alex.bennee@linaro.org>
To: qemu-devel@nongnu.org
Cc: fam@euphon.net, berrange@redhat.com, stefanb@linux.vnet.ibm.com,
"Alex Bennée" <alex.bennee@linaro.org>,
richard.henderson@linaro.org, f4bug@amsat.org, cota@braap.org,
stefanha@redhat.com, marcandre.lureau@redhat.com,
pbonzini@redhat.com, aurelien@aurel32.net
Subject: [PATCH v1 00/13] docker multiarch awareness
Date: Fri, 24 Jan 2020 20:40:13 +0000 [thread overview]
Message-ID: <20200124204026.2107-1-alex.bennee@linaro.org> (raw)
Hi,
This is a series I've had on the back-burner for awhile. The idea is
to make the docker build system fully multiarch aware. Much like the
check-tcg system this involves a bunch of included Makefile
fragments. It also tries to address the need to track docker
dependencies in the Makefile explicitly by allowing more automatic
resolution.
One area where I'd like advice is if we should bother to make the
build targets backwards compatible - or is it fair to ask developers
to go through the pain of retraining their brains for the more regular
naming:
make docker-test-build@debian10-arm64-build-qemu J=30
I've included testing/next out of completeness.
Alex Bennée (11):
tests/docker: move most cross compilers to buster base
tests/docker: better handle symlinked libs
.shippable: --disable-docs for cross-compile tests
tests/docker: move all cross-compilers images into dockerfiles.cross
tests/docker: move all multiarch containers into dockerfiles.multiarch
tests/docker: search the tests/docker tree to inline parent dockerfile
tests/docker: switch to multiarch aware container support
tests/docker: add debian10-native-qemu-build
tests/docker: rename the cross builds
tests/docker: re-enable cross-compiling for x86_64 hosts
tests/docker: enable cross-compilers for aarch64
Thomas Huth (1):
gitlab-ci: Refresh the list of iotests
Wainer dos Santos Moschetta (1):
travis.yml: Install genisoimage package
.gitlab-ci.yml | 12 +-
.shippable.yml | 2 +-
.travis.yml | 8 ++
tests/docker/Makefile.include | 126 +++++++-----------
tests/docker/docker.py | 12 +-
.../dockerfiles.aarch64/Makefile.include | 24 ++++
.../debian10-aarch64-qemu-build.docker | 1 +
.../debian10-alpha-test-build.docker | 1 +
.../debian10-x86_64-qemu-build.docker | 1 +
.../debian9-armel-qemu-build.docker | 1 +
.../debian10-alpha-build-tests.docker} | 0
.../debian10-amd64-build-qemu.docker} | 0
.../debian10-arm64-build-qemu.docker} | 0
.../debian10-armel-build-qemu.docker} | 2 +-
.../debian10-armhf-build-qemu.docker} | 2 +-
.../debian10-hppa-build-tests.docker} | 0
.../debian10-m68k-build-tests.docker} | 0
.../debian10-mips-build-qemu.docker} | 0
.../debian10-mips64-build-tests.docker} | 0
.../debian10-mips64el-build-qemu.docker} | 2 +-
.../debian10-mipsel-build-qemu.docker} | 2 +-
.../debian10-powerpc-build-tests.docker} | 0
.../debian10-ppc64-build-tests.docker} | 0
.../debian10-ppc64el-build-qemu.docker} | 2 +-
.../debian10-riscv64-build-tests.docker} | 0
.../debian10-s390x-build-qemu.docker} | 2 +-
.../debian10-sh4-build-tests.docker} | 0
.../debian10-sparc64-build-tests.docker} | 0
.../debian9-tricore-build-tests.docker} | 0
.../debian9-xtensa-build-tests.docker} | 0
.../fedora-cris-build-tests.docker} | 0
.../fedora-i386-build-qemu.docker} | 0
.../dockerfiles.multiarch/Makefile.include | 17 +++
.../debian10.docker | 0
.../debian9.docker | 0
.../dockerfiles.x86_64/Makefile.include | 26 ++++
.../debain10-x86_64-qemu-build.docker | 1 +
.../debian10-alpha-build-tests.docker | 1 +
.../debian10-amd64-build-qemu.docker | 1 +
.../debian10-arm64-build-qemu.docker | 1 +
.../debian10-armel-build-qemu.docker | 1 +
.../debian10-armhf-build-qemu.docker | 1 +
.../debian10-hppa-build-tests.docker | 1 +
.../debian10-m68k-build-tests.docker | 1 +
.../debian10-mips-build-qemu.docker | 1 +
.../debian10-mips64-build-tests.docker | 1 +
.../debian10-mips64el-build-qemu.docker | 1 +
.../debian10-mipsel-build-qemu.docker | 1 +
.../debian10-native-qemu-build.docker | 1 +
.../debian10-powerpc-build-tests.docker | 1 +
.../debian10-ppc64-build-tests.docker | 1 +
.../debian10-ppc64el-build-qemu.docker | 1 +
.../debian10-riscv64-build-tests.docker | 1 +
.../debian10-s390x-build-qemu.docker | 1 +
.../debian10-sh4-build-tests.docker | 1 +
.../debian10-sparc64-build-tests.docker | 1 +
.../debian9-mxe-win32-build-qemu.docker} | 0
.../debian9-mxe-win64-build-qemu.docker} | 0
.../debian9-mxe.docker | 0
.../debian9-tricore-build-tests.docker | 1 +
.../debian9-xtensa-build-tests.docker | 1 +
.../fedora-cris-build-tests.docker | 1 +
.../fedora-i386-build-tests.docker | 1 +
.../travis.docker | 0
tests/docker/dockerfiles/debian-amd64.docker | 2 +-
.../debian10-native-qemu-build.docker | 15 +++
tests/tcg/configure.sh | 38 +++---
67 files changed, 204 insertions(+), 118 deletions(-)
create mode 100644 tests/docker/dockerfiles.aarch64/Makefile.include
create mode 120000 tests/docker/dockerfiles.aarch64/debian10-aarch64-qemu-build.docker
create mode 120000 tests/docker/dockerfiles.aarch64/debian10-alpha-test-build.docker
create mode 120000 tests/docker/dockerfiles.aarch64/debian10-x86_64-qemu-build.docker
create mode 120000 tests/docker/dockerfiles.aarch64/debian9-armel-qemu-build.docker
rename tests/docker/{dockerfiles/debian-alpha-cross.docker => dockerfiles.cross/debian10-alpha-build-tests.docker} (100%)
rename tests/docker/{dockerfiles/debian-amd64-cross.docker => dockerfiles.cross/debian10-amd64-build-qemu.docker} (100%)
rename tests/docker/{dockerfiles/debian-arm64-cross.docker => dockerfiles.cross/debian10-arm64-build-qemu.docker} (100%)
rename tests/docker/{dockerfiles/debian-armel-cross.docker => dockerfiles.cross/debian10-armel-build-qemu.docker} (97%)
rename tests/docker/{dockerfiles/debian-armhf-cross.docker => dockerfiles.cross/debian10-armhf-build-qemu.docker} (97%)
rename tests/docker/{dockerfiles/debian-hppa-cross.docker => dockerfiles.cross/debian10-hppa-build-tests.docker} (100%)
rename tests/docker/{dockerfiles/debian-m68k-cross.docker => dockerfiles.cross/debian10-m68k-build-tests.docker} (100%)
rename tests/docker/{dockerfiles/debian-mips-cross.docker => dockerfiles.cross/debian10-mips-build-qemu.docker} (100%)
rename tests/docker/{dockerfiles/debian-mips64-cross.docker => dockerfiles.cross/debian10-mips64-build-tests.docker} (100%)
rename tests/docker/{dockerfiles/debian-mips64el-cross.docker => dockerfiles.cross/debian10-mips64el-build-qemu.docker} (98%)
rename tests/docker/{dockerfiles/debian-mipsel-cross.docker => dockerfiles.cross/debian10-mipsel-build-qemu.docker} (97%)
rename tests/docker/{dockerfiles/debian-powerpc-cross.docker => dockerfiles.cross/debian10-powerpc-build-tests.docker} (100%)
rename tests/docker/{dockerfiles/debian-ppc64-cross.docker => dockerfiles.cross/debian10-ppc64-build-tests.docker} (100%)
rename tests/docker/{dockerfiles/debian-ppc64el-cross.docker => dockerfiles.cross/debian10-ppc64el-build-qemu.docker} (97%)
rename tests/docker/{dockerfiles/debian-riscv64-cross.docker => dockerfiles.cross/debian10-riscv64-build-tests.docker} (100%)
rename tests/docker/{dockerfiles/debian-s390x-cross.docker => dockerfiles.cross/debian10-s390x-build-qemu.docker} (98%)
rename tests/docker/{dockerfiles/debian-sh4-cross.docker => dockerfiles.cross/debian10-sh4-build-tests.docker} (100%)
rename tests/docker/{dockerfiles/debian-sparc64-cross.docker => dockerfiles.cross/debian10-sparc64-build-tests.docker} (100%)
rename tests/docker/{dockerfiles/debian-tricore-cross.docker => dockerfiles.cross/debian9-tricore-build-tests.docker} (100%)
rename tests/docker/{dockerfiles/debian-xtensa-cross.docker => dockerfiles.cross/debian9-xtensa-build-tests.docker} (100%)
rename tests/docker/{dockerfiles/fedora-cris-cross.docker => dockerfiles.cross/fedora-cris-build-tests.docker} (100%)
rename tests/docker/{dockerfiles/fedora-i386-cross.docker => dockerfiles.cross/fedora-i386-build-qemu.docker} (100%)
create mode 100644 tests/docker/dockerfiles.multiarch/Makefile.include
rename tests/docker/{dockerfiles => dockerfiles.multiarch}/debian10.docker (100%)
rename tests/docker/{dockerfiles => dockerfiles.multiarch}/debian9.docker (100%)
create mode 100644 tests/docker/dockerfiles.x86_64/Makefile.include
create mode 120000 tests/docker/dockerfiles.x86_64/debain10-x86_64-qemu-build.docker
create mode 120000 tests/docker/dockerfiles.x86_64/debian10-alpha-build-tests.docker
create mode 120000 tests/docker/dockerfiles.x86_64/debian10-amd64-build-qemu.docker
create mode 120000 tests/docker/dockerfiles.x86_64/debian10-arm64-build-qemu.docker
create mode 120000 tests/docker/dockerfiles.x86_64/debian10-armel-build-qemu.docker
create mode 120000 tests/docker/dockerfiles.x86_64/debian10-armhf-build-qemu.docker
create mode 120000 tests/docker/dockerfiles.x86_64/debian10-hppa-build-tests.docker
create mode 120000 tests/docker/dockerfiles.x86_64/debian10-m68k-build-tests.docker
create mode 120000 tests/docker/dockerfiles.x86_64/debian10-mips-build-qemu.docker
create mode 120000 tests/docker/dockerfiles.x86_64/debian10-mips64-build-tests.docker
create mode 120000 tests/docker/dockerfiles.x86_64/debian10-mips64el-build-qemu.docker
create mode 120000 tests/docker/dockerfiles.x86_64/debian10-mipsel-build-qemu.docker
create mode 120000 tests/docker/dockerfiles.x86_64/debian10-native-qemu-build.docker
create mode 120000 tests/docker/dockerfiles.x86_64/debian10-powerpc-build-tests.docker
create mode 120000 tests/docker/dockerfiles.x86_64/debian10-ppc64-build-tests.docker
create mode 120000 tests/docker/dockerfiles.x86_64/debian10-ppc64el-build-qemu.docker
create mode 120000 tests/docker/dockerfiles.x86_64/debian10-riscv64-build-tests.docker
create mode 120000 tests/docker/dockerfiles.x86_64/debian10-s390x-build-qemu.docker
create mode 120000 tests/docker/dockerfiles.x86_64/debian10-sh4-build-tests.docker
create mode 120000 tests/docker/dockerfiles.x86_64/debian10-sparc64-build-tests.docker
rename tests/docker/{dockerfiles/debian-win32-cross.docker => dockerfiles.x86_64/debian9-mxe-win32-build-qemu.docker} (100%)
rename tests/docker/{dockerfiles/debian-win64-cross.docker => dockerfiles.x86_64/debian9-mxe-win64-build-qemu.docker} (100%)
rename tests/docker/{dockerfiles => dockerfiles.x86_64}/debian9-mxe.docker (100%)
create mode 120000 tests/docker/dockerfiles.x86_64/debian9-tricore-build-tests.docker
create mode 120000 tests/docker/dockerfiles.x86_64/debian9-xtensa-build-tests.docker
create mode 120000 tests/docker/dockerfiles.x86_64/fedora-cris-build-tests.docker
create mode 120000 tests/docker/dockerfiles.x86_64/fedora-i386-build-tests.docker
rename tests/docker/{dockerfiles => dockerfiles.x86_64}/travis.docker (100%)
create mode 100644 tests/docker/dockerfiles/debian10-native-qemu-build.docker
--
2.20.1
next reply other threads:[~2020-01-24 20:43 UTC|newest]
Thread overview: 20+ messages / expand[flat|nested] mbox.gz Atom feed top
2020-01-24 20:40 Alex Bennée [this message]
2020-01-24 20:40 ` [PATCH v1 01/13] tests/docker: move most cross compilers to buster base Alex Bennée
2020-01-24 20:40 ` [PATCH v1 02/13] tests/docker: better handle symlinked libs Alex Bennée
2020-01-27 19:24 ` Philippe Mathieu-Daudé
2020-01-24 20:40 ` [PATCH v1 03/13] gitlab-ci: Refresh the list of iotests Alex Bennée
2020-01-24 20:40 ` [PATCH v1 04/13] travis.yml: Install genisoimage package Alex Bennée
2020-01-24 20:40 ` [PATCH v1 05/13] .shippable: --disable-docs for cross-compile tests Alex Bennée
2020-01-24 20:40 ` [PATCH v1 06/13] tests/docker: move all cross-compilers images into dockerfiles.cross Alex Bennée
2020-01-24 20:40 ` [PATCH v1 07/13] tests/docker: move all multiarch containers into dockerfiles.multiarch Alex Bennée
2020-01-24 20:40 ` [PATCH v1 08/13] tests/docker: search the tests/docker tree to inline parent dockerfile Alex Bennée
2020-01-24 20:40 ` [PATCH v1 09/13] tests/docker: switch to multiarch aware container support Alex Bennée
2020-01-24 20:40 ` [PATCH v1 10/13] tests/docker: add debian10-native-qemu-build Alex Bennée
2020-01-27 19:41 ` Philippe Mathieu-Daudé
2020-01-24 20:40 ` [PATCH v1 11/13] tests/docker: rename the cross builds Alex Bennée
2020-01-24 20:40 ` [PATCH v1 12/13] tests/docker: re-enable cross-compiling for x86_64 hosts Alex Bennée
2020-01-24 22:29 ` Richard Henderson
2020-01-27 18:30 ` Alex Bennée
2020-01-27 19:38 ` Philippe Mathieu-Daudé
2020-01-27 19:43 ` Philippe Mathieu-Daudé
2020-01-24 20:40 ` [PATCH v1 13/13] tests/docker: enable cross-compilers for aarch64 Alex Bennée
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20200124204026.2107-1-alex.bennee@linaro.org \
--to=alex.bennee@linaro.org \
--cc=aurelien@aurel32.net \
--cc=berrange@redhat.com \
--cc=cota@braap.org \
--cc=f4bug@amsat.org \
--cc=fam@euphon.net \
--cc=marcandre.lureau@redhat.com \
--cc=pbonzini@redhat.com \
--cc=qemu-devel@nongnu.org \
--cc=richard.henderson@linaro.org \
--cc=stefanb@linux.vnet.ibm.com \
--cc=stefanha@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).