From: "Alex Bennée" <alex.bennee@linaro.org>
To: peter.maydell@linaro.org
Cc: qemu-devel@nongnu.org, cota@braap.org, famz@redhat.com,
berrange@redhat.com, f4bug@amsat.org,
richard.henderson@linaro.org, balrogg@gmail.com,
aurelien@aurel32.net, agraf@suse.de,
"Alex Bennée" <alex.bennee@linaro.org>
Subject: [Qemu-devel] [PULL v2 44/57] tests/tcg/Makefile: update to be called from Makefile.target
Date: Thu, 21 Jun 2018 07:25:52 +0100 [thread overview]
Message-ID: <20180621062605.941-45-alex.bennee@linaro.org> (raw)
In-Reply-To: <20180621062605.941-1-alex.bennee@linaro.org>
This make is now invoked from each individual target make with the
appropriate CC and EXTRA_CFLAGS set for each guest. It then includes
additional Makefile.targets from:
- tests/tcg/multiarch (always)
- tests/tcg/$(TARGET_BASE_ARCH) (if available)
- tests/tcg/$(TARGET_NAME)
The order is important as the later Makefile's may want to suppress
TESTS from its base arch profile. Each included Makefile.target is
responsible for adding TESTS as well as defining any special build
instructions for individual tests.
Signed-off-by: Alex Bennée <alex.bennee@linaro.org>
Reviewed-by: Richard Henderson <richard.henderson@linaro.org>
Reviewed-by: Philippe Mathieu-Daudé <f4bug@amsat.org>
Tested-by: Philippe Mathieu-Daudé <f4bug@amsat.org>
diff --git a/MAINTAINERS b/MAINTAINERS
index de1ae8423e..4c955425b9 100644
--- a/MAINTAINERS
+++ b/MAINTAINERS
@@ -2156,6 +2156,12 @@ W: https://travis-ci.org/qemu/qemu
W: https://app.shippable.com/github/qemu/qemu
W: http://patchew.org/QEMU/
+Guest Test Compilation Support
+M: Alex Bennée <alex.bennee@linaro.org>
+R: Philippe Mathieu-Daudé <f4bug@amsat.org>
+F: tests/tcg/Makefile
+L: qemu-devel@nongnu.org
+
Documentation
-------------
Build system architecture
diff --git a/tests/tcg/Makefile b/tests/tcg/Makefile
index e12395117a..e7dbcdb5bf 100644
--- a/tests/tcg/Makefile
+++ b/tests/tcg/Makefile
@@ -1,125 +1,94 @@
+# -*- Mode: makefile -*-
+#
+# TCG tests
+#
+# These are complicated by the fact we want to build them for guest
+# systems. This requires knowing what guests we are building and which
+# ones we have cross-compilers for or docker images with
+# cross-compilers.
+#
+# The tests themselves should be as minimal as possible as
+# cross-compilers don't always have a large amount of libraries
+# available.
+#
+# We only include the host build system for SRC_PATH and we don't
+# bother with the common rules.mk. We expect the following:
+#
+# CC - the C compiler command
+# EXTRA_CFLAGS - any extra CFLAGS
+# BUILD_STATIC - are we building static binaries
+#
+# By default all tests are statically compiled but some host systems
+# may not package static libraries by default. If an external
+# cross-compiler can only build dynamic libraries the user might need
+# to make extra efforts to ensure ld.so can link at runtime when the
+# tests are run.
+#
+# We also accept SPEED=slow to enable slower running tests
+#
+# We also expect to be in the tests build dir for the FOO-linux-user.
+#
+
-include ../../config-host.mak
--include $(SRC_PATH)/rules.mak
+-include ../config-target.mak
-$(call set-vpath, $(SRC_PATH)/tests/tcg)
+quiet-command = $(if $(V),$1,$(if $(2),@printf " %-7s %s\n" $2 $3 && $1, @$1))
-QEMU=../../i386-linux-user/qemu-i386
-QEMU_X86_64=../../x86_64-linux-user/qemu-x86_64
-CC_X86_64=$(CC_I386) -m64
+# Tests we are building
+TESTS=
-QEMU_INCLUDES += -I../..
-CFLAGS=-Wall -O2 -g -fno-strict-aliasing
-#CFLAGS+=-msse2
+# Start with a blank slate, the build targets get to add stuff first
+CFLAGS=
+QEMU_CFLAGS=
LDFLAGS=
-# TODO: automatically detect ARM and MIPS compilers, and run those too
-
-# runcom maps page 0, so it requires root privileges
-# also, pi_10.com runs indefinitely
-
-I386_TESTS=hello-i386 \
- sha1-i386 \
- test-i386 \
- test-i386-fprem \
- # runcom
+# The QEMU for this TARGET
+QEMU=../qemu-$(TARGET_NAME)
-# native i386 compilers sometimes are not biarch. assume cross-compilers are
-ifneq ($(ARCH),i386)
-I386_TESTS+=run-test-x86_64
+# If TCG debugging is enabled things are a lot slower
+ifeq ($(CONFIG_DEBUG_TCG),y)
+TIMEOUT=45
+else
+TIMEOUT=15
endif
-TESTS = test_path
-ifneq ($(call find-in-path, $(CC_I386)),)
-TESTS += $(I386_TESTS)
+# The order we include is important. We include multiarch, base arch
+# and finally arch if it's not the same as base arch.
+-include $(SRC_PATH)/tests/tcg/multiarch/Makefile.target
+-include $(SRC_PATH)/tests/tcg/$(TARGET_BASE_ARCH)/Makefile.target
+ifneq ($(TARGET_BASE_ARCH),$(TARGET_NAME))
+-include $(SRC_PATH)/tests/tcg/$(TARGET_NAME)/Makefile.target
endif
-all: $(patsubst %,run-%,$(TESTS))
-test: all
-
-# rules to run tests
-
-.PHONY: $(patsubst %,run-%,$(TESTS))
-
-run-%: %
- -$(QEMU) ./$*
-
-run-hello-i386: hello-i386
-run-sha1-i386: sha1-i386
-
-run-test-i386: test-i386
- ./test-i386 > test-i386.ref
- -$(QEMU) test-i386 > test-i386.out
- @if diff -u test-i386.ref test-i386.out ; then echo "Auto Test OK"; fi
-
-run-test-i386-fprem: test-i386-fprem
- ./test-i386-fprem > test-i386-fprem.ref
- -$(QEMU) test-i386-fprem > test-i386-fprem.out
- @if diff -u test-i386-fprem.ref test-i386-fprem.out ; then echo "Auto Test OK"; fi
-
-run-test-x86_64: test-x86_64
- ./test-x86_64 > test-x86_64.ref
- -$(QEMU_X86_64) test-x86_64 > test-x86_64.out
- @if diff -u test-x86_64.ref test-x86_64.out ; then echo "Auto Test OK"; fi
-
-
-run-runcom: runcom
- -$(QEMU) ./runcom $(SRC_PATH)/tests/pi_10.com
-
-run-test_path: test_path
- ./test_path
-
-# rules to compile tests
-
-hello-i386: hello-i386.c
- $(CC_I386) -nostdlib $(CFLAGS) -static $(LDFLAGS) -o $@ $<
- strip $@
-
-# i386/x86_64 emulation test (test various opcodes) */
-test-i386: test-i386.c test-i386-code16.S test-i386-vm86.S \
- test-i386.h test-i386-shift.h test-i386-muldiv.h
- $(CC_I386) $(QEMU_INCLUDES) $(CFLAGS) $(LDFLAGS) -o $@ \
- $(<D)/test-i386.c $(<D)/test-i386-code16.S $(<D)/test-i386-vm86.S -lm
-
-test-i386-fprem: test-i386-fprem.c
- $(CC_I386) $(QEMU_INCLUDES) $(CFLAGS) $(LDFLAGS) -o $@ $^
-
-test-x86_64: test-i386.c \
- test-i386.h test-i386-shift.h test-i386-muldiv.h
- $(CC_X86_64) $(QEMU_INCLUDES) $(CFLAGS) $(LDFLAGS) -o $@ $(<D)/test-i386.c -lm
-
-# vm86 test
-runcom: runcom.c
- $(CC_I386) $(CFLAGS) $(LDFLAGS) -o $@ $<
-
-# speed test
-sha1-i386: sha1.c
- $(CC_I386) $(CFLAGS) $(LDFLAGS) -o $@ $<
-
-# arm test
-hello-arm: hello-arm.o
- arm-linux-ld -o $@ $<
+# Add the common build options
+CFLAGS+=-Wall -O0 -g -fno-strict-aliasing
+ifeq ($(BUILD_STATIC),y)
+LDFLAGS+=-static
+endif
-hello-arm.o: hello-arm.c
- arm-linux-gcc -Wall -g -O2 -c -o $@ $<
+%: %.c
+ $(CC) $(CFLAGS) $(EXTRA_CFLAGS) $< -o $@ $(LDFLAGS)
-test-arm-iwmmxt: test-arm-iwmmxt.s
- cpp < $< | arm-linux-gnu-gcc -Wall -static -march=iwmmxt -mabi=aapcs -x assembler - -o $@
+all: $(TESTS)
-# MIPS test
-hello-mips: hello-mips.c
- mips-linux-gnu-gcc -nostdlib -static -mno-abicalls -fno-PIC -mabi=32 -Wall -Wextra -g -O2 -o $@ $<
+#
+# Test Runners
+#
+# By default we just run the test with the appropriate QEMU for the
+# target. More advanced tests may want to override the runner in their
+# specific make rules. Additional runners for the same binary should
+# be added to EXTRA_RUNS.
+#
-hello-mipsel: hello-mips.c
- mipsel-linux-gnu-gcc -nostdlib -static -mno-abicalls -fno-PIC -mabi=32 -Wall -Wextra -g -O2 -o $@ $<
+RUN_TESTS=$(patsubst %,run-%, $(TESTS))
+RUN_TESTS+=$(EXTRA_RUNS)
-# testsuite for the CRIS port.
-test-cris:
- $(MAKE) -C cris check
+run-%: %
+ $(call quiet-command, \
+ timeout $(TIMEOUT) $(QEMU) $< > $<.out, \
+ "TEST", "$< on $(TARGET_NAME)")
-# testsuite for the LM32 port.
-test-lm32:
- $(MAKE) -C lm32 check
+.PHONY: run
+run: $(RUN_TESTS)
-clean:
- rm -f *~ *.o test-i386.out test-i386.ref \
- test-x86_64.log test-x86_64.ref qruncom $(TESTS)
+# There is no clean target, the calling make just rm's the tests build dir
--
2.17.1
next prev parent reply other threads:[~2018-06-21 6:32 UTC|newest]
Thread overview: 69+ messages / expand[flat|nested] mbox.gz Atom feed top
2018-06-21 6:25 [Qemu-devel] [PULL v2 00/57] add check-tcg and associated machinery Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 01/57] docker: docker.py wrap StringIO import for python3 Alex Bennée
2018-06-21 8:49 ` Peter Maydell
2018-06-21 9:13 ` Daniel P. Berrangé
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 02/57] configure: add support for --cross-cc-FOO Alex Bennée
2019-08-20 13:32 ` Peter Maydell
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 03/57] configure: move i386_cc to cross_cc_i386 Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 04/57] configure: allow user to specify --cross-cc-cflags-foo= Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 05/57] configure: set cross_cc_FOO for host compiler Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 06/57] docker: Add "cc" subcommand Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 07/57] docker: extend "cc" command to accept compiler Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 08/57] docker: allow "cc" command to run in user context Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 09/57] docker: Makefile.include introduce DOCKER_SCRIPT Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 10/57] tests/tcg: move architecture independent tests into subdir Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 11/57] tests/tcg/multiarch: Build fix for linux-test Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 12/57] tests/tcg/multiarch: enable additional linux-test tests Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 13/57] tests/tcg/multiarch: don't hard code paths/ports for linux-test Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 14/57] tests/tcg/multiarch: move most output to stdout Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 15/57] tests/tcg: move i386 specific tests into subdir Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 16/57] tests/tcg: enable building for i386 Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 17/57] tests/tcg/i386: Build fix for hello-i386 Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 18/57] tests/tcg/i386: fix test-i386 Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 19/57] tests/tcg/i386: add runner for test-i386-fprem Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 20/57] tests/tcg/x86_64: add Makefile.target Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 21/57] tests/tcg/i386/test-i386: use modern vector_size attributes Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 22/57] tests/tcg/i386/test-i386: fix printf format Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 23/57] tests/tcg: move ARM specific tests into subdir Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 24/57] tests/tcg: enable building for ARM Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 25/57] tests/tcg/arm: fix up test-arm-iwmmxt test Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 26/57] tests/tcg: enable building for AArch64 Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 27/57] tests/tcg/arm: add fcvt test cases for AArch32/64 Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 28/57] tests/tcg: move MIPS specific tests into subdir Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 29/57] tests/tcg: enable building for MIPS Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 30/57] tests/docker/Makefile.include: fix mipsel-cross dependancy Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 31/57] tests/tcg/mips: include common mips hello-mips Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 32/57] tests/tcg: enable building for s390x Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 33/57] tests/tcg: enable building for ppc64 Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 34/57] tests/tcg: enable building for Alpha Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 35/57] tests/tcg/alpha: add Alpha specific tests Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 36/57] tests/tcg: enable building for HPPA Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 37/57] tests/tcg: enable building for m68k Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 38/57] tests/tcg: enable building for sh4 Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 39/57] tests/tcg: enable building for sparc64 Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 40/57] tests/tcg: enable building for mips64 Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 41/57] tests/tcg: enable building for RISCV64 Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 42/57] docker: move debian-powerpc-cross to sid based build Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 43/57] tests/tcg: enable building for PowerPC Alex Bennée
2018-06-21 6:25 ` Alex Bennée [this message]
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 45/57] Makefile.target: add (clean-/build-)guest-tests targets Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 46/57] tests/Makefile.include: add [build|clean|check]-tcg targets Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 47/57] tests/tcg: add run, diff, and skip helper macros Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 48/57] tests/tcg: override runners for broken tests Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 49/57] tests/tcg/i386: extend timeout for runcom test Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 50/57] tests: add top-level make dependency for docker builds Alex Bennée
2018-06-21 6:25 ` [Qemu-devel] [PULL v2 51/57] docker: docker.py use "version" to probe usage Alex Bennée
2018-06-21 6:26 ` [Qemu-devel] [PULL v2 52/57] docker: docker.py don't conflate checksums for extra_files Alex Bennée
2018-06-21 6:26 ` [Qemu-devel] [PULL v2 53/57] docker: docker.py add check sub-command Alex Bennée
2018-06-21 6:26 ` [Qemu-devel] [PULL v2 54/57] tests/Makefile: call sub-makes with SKIP_DOCKER_BUILD=1 Alex Bennée
2018-06-21 6:26 ` [Qemu-devel] [PULL v2 55/57] docker: docker.py adding age check command Alex Bennée
2018-06-21 6:26 ` [Qemu-devel] [PULL v2 56/57] tests/docker/Makefile.include: only force SID to NOCACHE if old Alex Bennée
2018-06-21 6:26 ` [Qemu-devel] [PULL v2 57/57] .travis.yml: add check-tcg test Alex Bennée
2018-06-21 12:00 ` [Qemu-devel] [PULL v2 00/57] add check-tcg and associated machinery Peter Maydell
2018-06-21 12:29 ` Alex Bennée
2018-06-21 14:48 ` Alex Bennée
2018-06-21 15:01 ` Philippe Mathieu-Daudé
2018-06-21 15:12 ` Alex Bennée
2018-06-21 16:04 ` Philippe Mathieu-Daudé
2018-06-21 16:12 ` Philippe Mathieu-Daudé
2018-06-22 11:40 ` Peter Maydell
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20180621062605.941-45-alex.bennee@linaro.org \
--to=alex.bennee@linaro.org \
--cc=agraf@suse.de \
--cc=aurelien@aurel32.net \
--cc=balrogg@gmail.com \
--cc=berrange@redhat.com \
--cc=cota@braap.org \
--cc=f4bug@amsat.org \
--cc=famz@redhat.com \
--cc=peter.maydell@linaro.org \
--cc=qemu-devel@nongnu.org \
--cc=richard.henderson@linaro.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).