qemu-devel.nongnu.org archive mirror
 help / color / mirror / Atom feed
From: "Alex Bennée" <alex.bennee@linaro.org>
To: peter.maydell@linaro.org
Cc: qemu-devel@nongnu.org, "Alex Bennée" <alex.bennee@linaro.org>,
	"Fam Zheng" <famz@redhat.com>,
	"Philippe Mathieu-Daudé" <f4bug@amsat.org>
Subject: [Qemu-devel] [PULL v3 20/20] docker: add linux-user powered cross builder for QEMU
Date: Thu,  5 Jul 2018 17:03:29 +0100	[thread overview]
Message-ID: <20180705160329.30386-21-alex.bennee@linaro.org> (raw)
In-Reply-To: <20180705160329.30386-1-alex.bennee@linaro.org>

We can't use cross compilers in the current Debian stable and Debian
sid is sketchy as hell. So for powerpc fall back to dog-fooding our
own linux-user to do the build.

As we can only build the base image with a suitably configured
source tree we fall back to checking for its existence when we can't
build it from scratch. However this does mean you don't have to keep
a static powerpc-linux-user in your active configuration just to
update the cross build image.

Signed-off-by: Alex Bennée <alex.bennee@linaro.org>
Reviewed-by: Philippe Mathieu-Daudé <f4bug@amsat.org>
Tested-by: Philippe Mathieu-Daudé <f4bug@amsat.org>

diff --git a/tests/docker/Makefile.include b/tests/docker/Makefile.include
index 7b99df5464..b2a7e761cc 100644
--- a/tests/docker/Makefile.include
+++ b/tests/docker/Makefile.include
@@ -64,15 +64,19 @@ docker-binfmt-image-debian-%: $(DOCKER_FILES_DIR)/debian-bootstrap.docker
 		$(error DEB_ARCH not set, debootstrap of debian-$* would fail))
 	$(if $(DEB_TYPE),,\
 		$(error DEB_TYPE not set, debootstrap of debian-$* would fail))
-	$(call quiet-command,						\
-		DEB_ARCH=$(DEB_ARCH)					\
-		DEB_TYPE=$(DEB_TYPE)					\
-		$(DOCKER_SCRIPT) build qemu:debian-$* $< 		\
-		$(if $V,,--quiet) $(if $(NOCACHE),--no-cache) 		\
-		$(if $(NOUSER),,--add-current-user) 			\
-		$(if $(EXTRA_FILES),--extra-files $(EXTRA_FILES))	\
-		$(if $(EXECUTABLE),--include-executable=$(EXECUTABLE)), \
-		"BUILD","binfmt debian-$* (debootstrapped)")
+	$(if $(filter $(QEMU_TARGET),$(TARGET_DIRS)),				\
+		$(call quiet-command,						\
+			DEB_ARCH=$(DEB_ARCH)					\
+			DEB_TYPE=$(DEB_TYPE)					\
+			$(DOCKER_SCRIPT) build qemu:debian-$* $< 		\
+			$(if $V,,--quiet) $(if $(NOCACHE),--no-cache) 		\
+			$(if $(NOUSER),,--add-current-user) 			\
+			$(if $(EXTRA_FILES),--extra-files $(EXTRA_FILES))	\
+			$(if $(EXECUTABLE),--include-executable=$(EXECUTABLE)), \
+			"BUILD","binfmt debian-$* (debootstrapped)"),		\
+		$(call quiet-command,						\
+			$(DOCKER_SCRIPT) check --quiet qemu:debian-$* $<,	\
+			"CHECK", "debian-$* exists"))
 
 endif
 
@@ -117,6 +121,21 @@ docker-image-travis: NOUSER=1
 # Specialist build images, sometimes very limited tools
 docker-image-tricore-cross: docker-image-debian9
 
+# Rules for building linux-user powered images
+#
+# These are slower than using native cross compiler setups but can
+# work around issues with poorly working multi-arch systems and broken
+# packages.
+
+# Jessie is the last supported release for powerpc, but multi-arch is
+# broken so we need a qemu-linux-user for this target
+docker-binfmt-image-debian-powerpc-user: DEB_ARCH = powerpc
+docker-binfmt-image-debian-powerpc-user: DEB_TYPE = jessie
+docker-binfmt-image-debian-powerpc-user: QEMU_TARGET = ppc-linux-user
+docker-binfmt-image-debian-powerpc-user: EXECUTABLE = ${BUILD_DIR}/ppc-linux-user/qemu-ppc
+docker-image-debian-powerpc-user-cross: docker-binfmt-image-debian-powerpc-user
+DOCKER_USER_IMAGES += debian-powerpc-user
+
 # Expand all the pre-requistes for each docker image and test combination
 $(foreach i,$(filter-out $(DOCKER_INTERMEDIATE_IMAGES),$(DOCKER_IMAGES) $(DOCKER_DEPRECATED_IMAGES)), \
 	$(foreach t,$(DOCKER_TESTS) $(DOCKER_TOOLS), \
@@ -146,6 +165,11 @@ docker:
 	@echo
 	@echo 'Available container images:'
 	@echo '    $(DOCKER_IMAGES)'
+ifneq ($(DOCKER_USER_IMAGES),)
+	@echo
+	@echo 'Available linux-user images (docker-binfmt-image-debian-%):'
+	@echo '    $(DOCKER_USER_IMAGES)'
+endif
 	@echo
 	@echo 'Available tests:'
 	@echo '    $(DOCKER_TESTS)'
diff --git a/tests/docker/dockerfiles/debian-powerpc-user-cross.docker b/tests/docker/dockerfiles/debian-powerpc-user-cross.docker
new file mode 100644
index 0000000000..6938a845ee
--- /dev/null
+++ b/tests/docker/dockerfiles/debian-powerpc-user-cross.docker
@@ -0,0 +1,15 @@
+#
+# Docker powerpc cross-compiler target for QEMU
+#
+# We can't use current Debian stable cross-compilers to build powerpc
+# as it has been dropped as a release architecture. Using Debian Sid
+# is just far too sketchy a build environment. This leaves us the
+# final option of using linux-user. This image is based of the
+# debootstrapped qemu:debian-powerpc-user but doesn't need any extra
+# magic once it is setup.
+#
+FROM qemu:debian-powerpc-user
+
+RUN echo man-db man-db/auto-update boolean false | debconf-set-selections
+RUN apt-get update && \
+    DEBIAN_FRONTEND=noninteractive apt-get build-dep -yy qemu
-- 
2.17.1

  parent reply	other threads:[~2018-07-05 16:13 UTC|newest]

Thread overview: 22+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2018-07-05 16:03 [Qemu-devel] [PULL v3 00/20] Travis, Code Coverage and Cross Build updates Alex Bennée
2018-07-05 16:03 ` [Qemu-devel] [PULL v3 01/20] Revert "Makefile: Rename TARGET_DIRS to TARGET_LIST" Alex Bennée
2018-07-05 16:03 ` [Qemu-devel] [PULL v3 02/20] travis: do not waste time cloning unused submodules Alex Bennée
2018-07-05 16:03 ` [Qemu-devel] [PULL v3 03/20] travis: test out-of-tree builds Alex Bennée
2018-07-05 16:03 ` [Qemu-devel] [PULL v3 04/20] build-system: remove per-test GCOV reporting Alex Bennée
2018-07-05 16:03 ` [Qemu-devel] [PULL v3 05/20] .gitignore: add .gcov files Alex Bennée
2018-07-05 16:03 ` [Qemu-devel] [PULL v3 06/20] docker: add gcovr to travis image Alex Bennée
2018-07-05 16:03 ` [Qemu-devel] [PULL v3 07/20] travis: add gcovr summary for GCOV build Alex Bennée
2018-07-05 16:03 ` [Qemu-devel] [PULL v3 08/20] build-system: add clean-coverage target Alex Bennée
2018-07-05 16:03 ` [Qemu-devel] [PULL v3 09/20] build-system: add coverage-report target Alex Bennée
2018-07-05 16:03 ` [Qemu-devel] [PULL v3 10/20] linux-user: introduce preexit_cleanup Alex Bennée
2018-07-05 16:03 ` [Qemu-devel] [PULL v3 11/20] linux-user: add gcov support to preexit_cleanup Alex Bennée
2018-07-05 16:03 ` [Qemu-devel] [PULL v3 12/20] docker: ubuntu: Update the package list before installing new ones Alex Bennée
2018-07-05 16:03 ` [Qemu-devel] [PULL v3 13/20] docker: ubuntu: Use SDL2 Alex Bennée
2018-07-05 16:03 ` [Qemu-devel] [PULL v3 14/20] docker: Clean the MXE base image Alex Bennée
2018-07-05 16:03 ` [Qemu-devel] [PULL v3 15/20] docker: Do not run tests in 'intermediate' images Alex Bennée
2018-07-05 16:03 ` [Qemu-devel] [PULL v3 16/20] docker: drop QEMU build-dep from bootstrap Alex Bennée
2018-07-05 16:03 ` [Qemu-devel] [PULL v3 17/20] docker: debian-bootstrap.pre allow customising of variant/url Alex Bennée
2018-07-05 16:03 ` [Qemu-devel] [PULL v3 18/20] docker: add special handling for FROM:debian-%-user targets Alex Bennée
2018-07-05 16:03 ` [Qemu-devel] [PULL v3 19/20] docker: add special rule for deboostrapped images Alex Bennée
2018-07-05 16:03 ` Alex Bennée [this message]
2018-07-05 18:10 ` [Qemu-devel] [PULL v3 00/20] Travis, Code Coverage and Cross Build updates Peter Maydell

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20180705160329.30386-21-alex.bennee@linaro.org \
    --to=alex.bennee@linaro.org \
    --cc=f4bug@amsat.org \
    --cc=famz@redhat.com \
    --cc=peter.maydell@linaro.org \
    --cc=qemu-devel@nongnu.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).