From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:4830:134:3::10]:59330) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1XW3sw-0002qT-JZ for qemu-devel@nongnu.org; Mon, 22 Sep 2014 09:42:43 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1XW3so-0002GA-2S for qemu-devel@nongnu.org; Mon, 22 Sep 2014 09:42:34 -0400 Received: from e06smtp10.uk.ibm.com ([195.75.94.106]:46320) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1XW3sn-00024e-Pm for qemu-devel@nongnu.org; Mon, 22 Sep 2014 09:42:26 -0400 Received: from /spool/local by e06smtp10.uk.ibm.com with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted for from ; Mon, 22 Sep 2014 14:42:18 +0100 Received: from b06cxnps3075.portsmouth.uk.ibm.com (d06relay10.portsmouth.uk.ibm.com [9.149.109.195]) by d06dlp03.portsmouth.uk.ibm.com (Postfix) with ESMTP id E26E01B08049 for ; Mon, 22 Sep 2014 14:43:23 +0100 (BST) Received: from d06av01.portsmouth.uk.ibm.com (d06av01.portsmouth.uk.ibm.com [9.149.37.212]) by b06cxnps3075.portsmouth.uk.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id s8MDgFGh40763492 for ; Mon, 22 Sep 2014 13:42:15 GMT Received: from d06av01.portsmouth.uk.ibm.com (localhost [127.0.0.1]) by d06av01.portsmouth.uk.ibm.com (8.14.4/8.14.4/NCO v10.0 AVout) with ESMTP id s8MDgESe003412 for ; Mon, 22 Sep 2014 07:42:14 -0600 Message-ID: <54202736.80801@de.ibm.com> Date: Mon, 22 Sep 2014 15:42:14 +0200 From: Christian Borntraeger MIME-Version: 1.0 References: <1410530338-17615-1-git-send-email-pbonzini@redhat.com> <1410530338-17615-6-git-send-email-pbonzini@redhat.com> In-Reply-To: <1410530338-17615-6-git-send-email-pbonzini@redhat.com> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Subject: Re: [Qemu-devel] [PULL 05/21] rules.mak: Fix DSO build by pulling in archive symbols List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: Paolo Bonzini , qemu-devel@nongnu.org Cc: Fam Zheng On 09/12/2014 03:58 PM, Paolo Bonzini wrote: > From: Fam Zheng > > This fixes an issue with module build system. block/iscsi.so is > currently broken: > > $ ~/build/last/qemu-img > Failed to open module: /home/fam/build/master/block-iscsi.so: > undefined symbol: qmp_query_uuid > qemu-img: Not enough arguments > Try 'qemu-img --help' for more information > > To fix this, we should (at least) let qemu-img link qmp_query_uuid from > libqemustub.a. (There are a few other symbols missing, as well.) > > This patch changes the linking rules to: > > 1) Build ".mo" with "ld -r -o $@ $^" for each ".so", and later build .so > with it. > > 2) Always build all the .mo before linking the executables. This is > achieved by adding those .mo files to the executables' "-y" > variables. > > 3) When linking an executable, those .mo files in its "-y" variables are > filtered out, and replaced by one or more -Wl,-u,$symbol flags. This > is done in the added macro "process-archive-undefs". > > These "-Wl,-u,$symbol" flags will force ld to pull in the function > definition from the archives when linking. > > Note that the .mo objects, that are actually meant to be linked in > the executables, are already expanded in unnest-vars, before the > linking command. So we are safe to simply filter out .mo for the > purpose of pulling undefined symbols. > > process-archive-undefs works as this: For each ".mo", find all the > undefined symbols in it, filter ones that are defined in the > archives. For each of these symbols, generate a "-Wl,-u,$symbol" in > the link command, and put them before archive names in the command > line. > > Suggested-by: H.J. Lu > Signed-off-by: Fam Zheng > Signed-off-by: Paolo Bonzini This patch breaks building the mo files in po/ for me: make -C po install make[1]: Entering directory `/home/dailybuild/builder/packages/BUILD/qemu-2.1.0/po' LD -r tr.mo /usr/bin/ld: no input file Christian > --- > rules.mak | 43 ++++++++++++++++++++++++++++++++++++++++--- > 1 file changed, 40 insertions(+), 3 deletions(-) > > diff --git a/rules.mak b/rules.mak > index ba2f4c1..1d73293 100644 > --- a/rules.mak > +++ b/rules.mak > @@ -22,6 +22,32 @@ QEMU_DGFLAGS += -MMD -MP -MT $@ -MF $(*D)/$(*F).d > # Same as -I$(SRC_PATH) -I., but for the nested source/object directories > QEMU_INCLUDES += -I$( > +WL_U := -Wl,-u, > +find-symbols = $(if $1, $(sort $(shell nm -P -g $1 | $2))) > +defined-symbols = $(call find-symbols,$1,awk '$$2!="U"{print $$1}') > +undefined-symbols = $(call find-symbols,$1,awk '$$2=="U"{print $$1}') > + > +# All the .mo objects in -m variables are also added into corresponding -y > +# variable in unnest-vars, but filtered out here, when LINK is called. > +# > +# The .mo objects are supposed to be linked as a DSO, for module build. So here > +# they are only used as a placeholders to generate those "archive undefined" > +# symbol options (-Wl,-u,$symbol_name), which are the archive functions > +# referenced by the code in the DSO. > +# > +# Also the presence in -y variables will also guarantee they are built before > +# linking executables that will load them. So we can look up symbol reference > +# in LINK. > +# > +# This is necessary because the exectuable itself may not use the function, in > +# which case the function would not be linked in. Then the DSO loading will > +# fail because of the missing symbol. > +process-archive-undefs = $(filter-out %.a %.mo,$1) \ > + $(addprefix $(WL_U), \ > + $(filter $(call defined-symbols,$(filter %.a, $1)), \ > + $(call undefined-symbols,$(filter %.mo,$1)))) \ > + $(filter %.a,$1) > + > extract-libs = $(strip $(foreach o,$1,$($o-libs))) > expand-objs = $(strip $(sort $(filter %.o,$1)) \ > $(foreach o,$(filter %.mo,$1),$($o-objs)) \ > @@ -38,7 +64,8 @@ LINKPROG = $(or $(CXX),$(CC)) > > ifeq ($(LIBTOOL),) > LINK = $(call quiet-command, $(LINKPROG) $(QEMU_CFLAGS) $(CFLAGS) $(LDFLAGS) -o $@ \ > - $1 $(version-obj-y) $(call extract-libs,$1) $(LIBS)," LINK $(TARGET_DIR)$@") > + $(call process-archive-undefs, $1) \ > + $(version-obj-y) $(call extract-libs,$1) $(LIBS)," LINK $(TARGET_DIR)$@") > else > LIBTOOL += $(if $(V),,--quiet) > %.lo: %.c > @@ -50,7 +77,8 @@ LIBTOOL += $(if $(V),,--quiet) > > LINK = $(call quiet-command,\ > $(if $(filter %.lo %.la,$1),$(LIBTOOL) --mode=link --tag=CC \ > - )$(LINKPROG) $(QEMU_CFLAGS) $(CFLAGS) $(LDFLAGS) -o $@ $1 \ > + )$(LINKPROG) $(QEMU_CFLAGS) $(CFLAGS) $(LDFLAGS) -o $@ \ > + $(call process-archive-undefs, $1)\ > $(if $(filter %.lo %.la,$1),$(version-lobj-y),$(version-obj-y)) \ > $(if $(filter %.lo %.la,$1),$(LIBTOOLFLAGS)) \ > $(call extract-libs,$(1:.lo=.o)) $(LIBS),$(if $(filter %.lo %.la,$1),"lt LINK ", " LINK ")"$(TARGET_DIR)$@") > @@ -76,11 +104,17 @@ endif > > %$(DSOSUF): CFLAGS += -fPIC -DBUILD_DSO > %$(DSOSUF): LDFLAGS += $(LDFLAGS_SHARED) > -%$(DSOSUF): > +%$(DSOSUF): %.mo > $(call LINK,$^) > @# Copy to build root so modules can be loaded when program started without install > $(if $(findstring /,$@),$(call quiet-command,cp $@ $(subst /,-,$@), " CP $(subst /,-,$@)")) > > + > +LD_REL := $(CC) -nostdlib -Wl,-r > + > +%.mo: > + $(call quiet-command,$(LD_REL) -o $@ $^," LD -r $(TARGET_DIR)$@") > + > .PHONY: modules > modules: > > @@ -306,6 +340,9 @@ define unnest-vars > # For module build, build shared libraries during "make modules" > # For non-module build, add -m to -y > $(if $(CONFIG_MODULES), > + $(foreach o,$($v), > + $(eval $o: $($o-objs))) > + $(eval $(patsubst %-m,%-y,$v) += $($v)) > $(eval modules: $($v:%.mo=%$(DSOSUF))), > $(eval $(patsubst %-m,%-y,$v) += $(call expand-objs, $($v))))) >