All of lore.kernel.org
 help / color / mirror / Atom feed
* Parallel make supported?
@ 2014-12-18 22:36 Peter Kay
  2014-12-19 10:05 ` Ian Campbell
  0 siblings, 1 reply; 8+ messages in thread
From: Peter Kay @ 2014-12-18 22:36 UTC (permalink / raw)
  To: xen-devel


[-- Attachment #1.1: Type: text/plain, Size: 236 bytes --]

Is parallel make supported for xen? If I compile 4.5 rc4 (although the
error exists with many other prior releases too) with make -j4 world it
fails part way through with an error 2. This does not occur with a straight
'make world'

PK

[-- Attachment #1.2: Type: text/html, Size: 287 bytes --]

[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: Parallel make supported?
  2014-12-18 22:36 Parallel make supported? Peter Kay
@ 2014-12-19 10:05 ` Ian Campbell
  2014-12-19 22:09   ` Peter Kay
  0 siblings, 1 reply; 8+ messages in thread
From: Ian Campbell @ 2014-12-19 10:05 UTC (permalink / raw)
  To: Peter Kay; +Cc: xen-devel

On Thu, 2014-12-18 at 22:36 +0000, Peter Kay wrote:
> Is parallel make supported for xen? If I compile 4.5 rc4 (although the
> error exists with many other prior releases too) with make -j4 world
> it fails part way through with an error 2. This does not occur with a
> straight 'make world'

It is expected to work in general, I build with -j12 all the time. There
are some subdirs which enforce serialised build for various reasons,
perhaps there is one more we've not spotted or perhaps there is just a
bug in the Makefiles somewhere.

Please post your build logs showing the error.

Ian.

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: Parallel make supported?
  2014-12-19 10:05 ` Ian Campbell
@ 2014-12-19 22:09   ` Peter Kay
  2014-12-29 13:01     ` Wei Liu
  0 siblings, 1 reply; 8+ messages in thread
From: Peter Kay @ 2014-12-19 22:09 UTC (permalink / raw)
  To: Ian Campbell; +Cc: xen-devel


[-- Attachment #1.1: Type: text/plain, Size: 886 bytes --]

Thanks, see attached :

This is on Salix 14.1 running the 3.17.4 kernel. That's not particularly
relevant though, as I had exactly the same error on Debian using other
kernel versions.

On 19 December 2014 at 10:05, Ian Campbell <Ian.Campbell@citrix.com> wrote:

> On Thu, 2014-12-18 at 22:36 +0000, Peter Kay wrote:
> > Is parallel make supported for xen? If I compile 4.5 rc4 (although the
> > error exists with many other prior releases too) with make -j4 world
> > it fails part way through with an error 2. This does not occur with a
> > straight 'make world'
>
> It is expected to work in general, I build with -j12 all the time. There
> are some subdirs which enforce serialised build for various reasons,
> perhaps there is one more we've not spotted or perhaps there is just a
> bug in the Makefiles somewhere.
>
> Please post your build logs showing the error.
>
> Ian.
>
>
>

[-- Attachment #1.2: Type: text/html, Size: 1389 bytes --]

[-- Attachment #2: build.log.gz --]
[-- Type: application/x-gzip, Size: 30631 bytes --]

[-- Attachment #3: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: Parallel make supported?
  2014-12-19 22:09   ` Peter Kay
@ 2014-12-29 13:01     ` Wei Liu
  2015-01-05 16:01       ` Ian Campbell
  0 siblings, 1 reply; 8+ messages in thread
From: Wei Liu @ 2014-12-29 13:01 UTC (permalink / raw)
  To: Peter Kay; +Cc: wei.liu2, Ian Campbell, xen-devel

Please don't top post.

On Fri, Dec 19, 2014 at 10:09:31PM +0000, Peter Kay wrote:
> Thanks, see attached :
> 
> This is on Salix 14.1 running the 3.17.4 kernel. That's not particularly
> relevant though, as I had exactly the same error on Debian using other
> kernel versions.
> 

Looking at your build log

gcc     -pthread -Wl,-soname -Wl,libxenstore.so.3.0 -shared -o libxenstore.so.3.0.3 xs.opic xs_lib.opic
ar rcs libxenstore.a xs.o xs_lib.o
gcc xs_tdb_dump.o utils.o tdb.o talloc.o     -o xs_tdb_dump
gcc xenstored_core.o xenstored_watch.o xenstored_domain.o xenstored_transaction.o xs_lib.o talloc.o utils.o tdb.o hashtable.o xenstored_posix.o     /home/peter/Downloads/xen-4.5.0-rc4/tools/xenstore/../../tools/libxc/libxenctrl.so  -o xenstored
gcc init-xenstore-domain.o libxenstore.so     /home/peter/Downloads/xen-4.5.0-rc4/tools/xenstore/../../tools/libxc/libxenctrl.so /home/peter/Downloads/xen-4.5.0-rc4/tools/xenstore/../../tools/libxc/libxenguest.so /home/peter/Downloads/xen-4.5.0-rc4/tools/xenstore/../../tools/xenstore/libxenstore.so -o init-xenstore-domain
gcc: error: libxenstore.so: No such file or directory
gcc: error: /home/peter/Downloads/xen-4.5.0-rc4/tools/xenstore/../../tools/xenstore/libxenstore.so: No such file or directory
make[4]: *** [init-xenstore-domain] Error 1
make[4]: Leaving directory `/home/peter/Downloads/xen-4.5.0-rc4/tools/xenstore'
make[3]: *** [subdir-install-xenstore] Error 2
make[3]: Leaving directory `/home/peter/Downloads/xen-4.5.0-rc4/tools'
make[2]: *** [subdirs-install] Error 2
make[2]: Leaving directory `/home/peter/Downloads/xen-4.5.0-rc4/tools'
make[1]: *** [install-tools] Error 2
make[1]: *** Waiting for unfinished jobs....

libxenstore.so is missing. However Makefile dependency ensures the
compilation of init-xenstore-domain does not proceed unless
libxenstore.so exists.

Two "ln -sf" are missing in your log.

ln -sf libxenstore.so.3.0.3 libxenstore.so.3.0
ln -sf libxenstore.so.3.0 libxenstore.so

?

Wei.

> On 19 December 2014 at 10:05, Ian Campbell <Ian.Campbell@citrix.com> wrote:
> 
> > On Thu, 2014-12-18 at 22:36 +0000, Peter Kay wrote:
> > > Is parallel make supported for xen? If I compile 4.5 rc4 (although the
> > > error exists with many other prior releases too) with make -j4 world
> > > it fails part way through with an error 2. This does not occur with a
> > > straight 'make world'
> >
> > It is expected to work in general, I build with -j12 all the time. There
> > are some subdirs which enforce serialised build for various reasons,
> > perhaps there is one more we've not spotted or perhaps there is just a
> > bug in the Makefiles somewhere.
> >
> > Please post your build logs showing the error.
> >
> > Ian.
> >
> >
> >


> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xen.org
> http://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: Parallel make supported?
  2014-12-29 13:01     ` Wei Liu
@ 2015-01-05 16:01       ` Ian Campbell
  2015-01-06  0:08         ` Peter Kay
  0 siblings, 1 reply; 8+ messages in thread
From: Ian Campbell @ 2015-01-05 16:01 UTC (permalink / raw)
  To: Wei Liu; +Cc: xen-devel, Peter Kay

On Mon, 2014-12-29 at 13:01 +0000, Wei Liu wrote:
> Please don't top post.
> 
> On Fri, Dec 19, 2014 at 10:09:31PM +0000, Peter Kay wrote:
> > Thanks, see attached :
> > 
> > This is on Salix 14.1 running the 3.17.4 kernel. That's not particularly
> > relevant though, as I had exactly the same error on Debian using other
> > kernel versions.
> > 
> 
> Looking at your build log
> 
> gcc     -pthread -Wl,-soname -Wl,libxenstore.so.3.0 -shared -o libxenstore.so.3.0.3 xs.opic xs_lib.opic
> ar rcs libxenstore.a xs.o xs_lib.o
> gcc xs_tdb_dump.o utils.o tdb.o talloc.o     -o xs_tdb_dump
> gcc xenstored_core.o xenstored_watch.o xenstored_domain.o xenstored_transaction.o xs_lib.o talloc.o utils.o tdb.o hashtable.o xenstored_posix.o     /home/peter/Downloads/xen-4.5.0-rc4/tools/xenstore/../../tools/libxc/libxenctrl.so  -o xenstored
> gcc init-xenstore-domain.o libxenstore.so     /home/peter/Downloads/xen-4.5.0-rc4/tools/xenstore/../../tools/libxc/libxenctrl.so /home/peter/Downloads/xen-4.5.0-rc4/tools/xenstore/../../tools/libxc/libxenguest.so /home/peter/Downloads/xen-4.5.0-rc4/tools/xenstore/../../tools/xenstore/libxenstore.so -o init-xenstore-domain
> gcc: error: libxenstore.so: No such file or directory
> gcc: error: /home/peter/Downloads/xen-4.5.0-rc4/tools/xenstore/../../tools/xenstore/libxenstore.so: No such file or directory
> make[4]: *** [init-xenstore-domain] Error 1
> make[4]: Leaving directory `/home/peter/Downloads/xen-4.5.0-rc4/tools/xenstore'
> make[3]: *** [subdir-install-xenstore] Error 2
> make[3]: Leaving directory `/home/peter/Downloads/xen-4.5.0-rc4/tools'
> make[2]: *** [subdirs-install] Error 2
> make[2]: Leaving directory `/home/peter/Downloads/xen-4.5.0-rc4/tools'
> make[1]: *** [install-tools] Error 2
> make[1]: *** Waiting for unfinished jobs....
> 
> libxenstore.so is missing. However Makefile dependency ensures the
> compilation of init-xenstore-domain does not proceed unless
> libxenstore.so exists.

Right. Specifically (quoting a select few lines from
tools/xenstore/Makefile):

        LIBXENSTORE := libxenstore.so
        init-xenstore-domain: init-xenstore-domain.o $(LIBXENSTORE)
        libxenstore.so: libxenstore.so.$(MAJOR)
        libxenstore.so.$(MAJOR): libxenstore.so.$(MAJOR).$(MINOR)
        libxenstore.so.$(MAJOR).$(MINOR): xs.opic xs_lib.opic
        
So it would be a make bug if init-xenstore-domain were linked without
having created libxenstore.so first, but that (such an obvious bug in
make) doesn't seem very likely.

Peter, what does
        ls -l tools/xenstore/libxenstore*
show?

Also "make -d -C tools/xenstore init-xenstore-domain" might give a clue
as to why make thinks it doesn't need to rebuild those objects.

If $(LIBXENSTORE) were unset then that might explain things, but I can't
see how that could happen, it must always be either libxenstore.so or
libxenstore.a. Changing the init-xenstore-domain rule to:
        init-xenstore-domain: init-xenstore-domain.o $(LIBXENSTORE)
        	@echo init-xenstore-domain using $(LIBXENSTORE)
        	$(CC) $^ $(LDFLAGS) $(LDLIBS_libxenctrl) $(LDLIBS_libxenguest) $(LDLIBS_libxenstore) -o $@ $(APPEND_LDFLAGS)
would confirm or deny that theory (nb before @echo needs to be a hard
tab).

Ian.

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: Parallel make supported?
  2015-01-05 16:01       ` Ian Campbell
@ 2015-01-06  0:08         ` Peter Kay
  2015-01-06 10:36           ` Wei Liu
  0 siblings, 1 reply; 8+ messages in thread
From: Peter Kay @ 2015-01-06  0:08 UTC (permalink / raw)
  To: Ian Campbell; +Cc: Wei Liu, xen-devel


[-- Attachment #1.1: Type: text/plain, Size: 3765 bytes --]

root[xen-4.5.0-rc4]# ls -l tools/xenstore/libxenstore*
-rw-r--r-- 1 root root 98580 Dec 19 22:02 tools/xenstore/libxenstore.a
-rwxr-xr-x 1 root root 82624 Dec 19 22:02
tools/xenstore/libxenstore.so.3.0.3

Please see output of make -d -C tools/xenstore init-xenstore-domain
attached - it's quite long uncompressed

PK

On 5 January 2015 at 16:01, Ian Campbell <Ian.Campbell@citrix.com> wrote:

> On Mon, 2014-12-29 at 13:01 +0000, Wei Liu wrote:
> > Please don't top post.
> >
> > On Fri, Dec 19, 2014 at 10:09:31PM +0000, Peter Kay wrote:
> > > Thanks, see attached :
> > >
> > > This is on Salix 14.1 running the 3.17.4 kernel. That's not
> particularly
> > > relevant though, as I had exactly the same error on Debian using other
> > > kernel versions.
> > >
> >
> > Looking at your build log
> >
> > gcc     -pthread -Wl,-soname -Wl,libxenstore.so.3.0 -shared -o
> libxenstore.so.3.0.3 xs.opic xs_lib.opic
> > ar rcs libxenstore.a xs.o xs_lib.o
> > gcc xs_tdb_dump.o utils.o tdb.o talloc.o     -o xs_tdb_dump
> > gcc xenstored_core.o xenstored_watch.o xenstored_domain.o
> xenstored_transaction.o xs_lib.o talloc.o utils.o tdb.o hashtable.o
> xenstored_posix.o
>  /home/peter/Downloads/xen-4.5.0-rc4/tools/xenstore/../../tools/libxc/libxenctrl.so
> -o xenstored
> > gcc init-xenstore-domain.o libxenstore.so
>  /home/peter/Downloads/xen-4.5.0-rc4/tools/xenstore/../../tools/libxc/libxenctrl.so
> /home/peter/Downloads/xen-4.5.0-rc4/tools/xenstore/../../tools/libxc/libxenguest.so
> /home/peter/Downloads/xen-4.5.0-rc4/tools/xenstore/../../tools/xenstore/libxenstore.so
> -o init-xenstore-domain
> > gcc: error: libxenstore.so: No such file or directory
> > gcc: error:
> /home/peter/Downloads/xen-4.5.0-rc4/tools/xenstore/../../tools/xenstore/libxenstore.so:
> No such file or directory
> > make[4]: *** [init-xenstore-domain] Error 1
> > make[4]: Leaving directory
> `/home/peter/Downloads/xen-4.5.0-rc4/tools/xenstore'
> > make[3]: *** [subdir-install-xenstore] Error 2
> > make[3]: Leaving directory `/home/peter/Downloads/xen-4.5.0-rc4/tools'
> > make[2]: *** [subdirs-install] Error 2
> > make[2]: Leaving directory `/home/peter/Downloads/xen-4.5.0-rc4/tools'
> > make[1]: *** [install-tools] Error 2
> > make[1]: *** Waiting for unfinished jobs....
> >
> > libxenstore.so is missing. However Makefile dependency ensures the
> > compilation of init-xenstore-domain does not proceed unless
> > libxenstore.so exists.
>
> Right. Specifically (quoting a select few lines from
> tools/xenstore/Makefile):
>
>         LIBXENSTORE := libxenstore.so
>         init-xenstore-domain: init-xenstore-domain.o $(LIBXENSTORE)
>         libxenstore.so: libxenstore.so.$(MAJOR)
>         libxenstore.so.$(MAJOR): libxenstore.so.$(MAJOR).$(MINOR)
>         libxenstore.so.$(MAJOR).$(MINOR): xs.opic xs_lib.opic
>
> So it would be a make bug if init-xenstore-domain were linked without
> having created libxenstore.so first, but that (such an obvious bug in
> make) doesn't seem very likely.
>
> Peter, what does
>         ls -l tools/xenstore/libxenstore*
> show?
>
> Also "make -d -C tools/xenstore init-xenstore-domain" might give a clue
> as to why make thinks it doesn't need to rebuild those objects.
>
> If $(LIBXENSTORE) were unset then that might explain things, but I can't
> see how that could happen, it must always be either libxenstore.so or
> libxenstore.a. Changing the init-xenstore-domain rule to:
>         init-xenstore-domain: init-xenstore-domain.o $(LIBXENSTORE)
>                 @echo init-xenstore-domain using $(LIBXENSTORE)
>                 $(CC) $^ $(LDFLAGS) $(LDLIBS_libxenctrl)
> $(LDLIBS_libxenguest) $(LDLIBS_libxenstore) -o $@ $(APPEND_LDFLAGS)
> would confirm or deny that theory (nb before @echo needs to be a hard
> tab).
>
> Ian.
>
>

[-- Attachment #1.2: Type: text/html, Size: 4757 bytes --]

[-- Attachment #2: xsdm.gz --]
[-- Type: application/x-gzip, Size: 27374 bytes --]

[-- Attachment #3: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: Parallel make supported?
  2015-01-06  0:08         ` Peter Kay
@ 2015-01-06 10:36           ` Wei Liu
  2015-01-06 10:39             ` Ian Campbell
  0 siblings, 1 reply; 8+ messages in thread
From: Wei Liu @ 2015-01-06 10:36 UTC (permalink / raw)
  To: Peter Kay; +Cc: Wei Liu, Ian Campbell, xen-devel

On Tue, Jan 06, 2015 at 12:08:33AM +0000, Peter Kay wrote:
> root[xen-4.5.0-rc4]# ls -l tools/xenstore/libxenstore*
> -rw-r--r-- 1 root root 98580 Dec 19 22:02 tools/xenstore/libxenstore.a
> -rwxr-xr-x 1 root root 82624 Dec 19 22:02
> tools/xenstore/libxenstore.so.3.0.3
> 
> Please see output of make -d -C tools/xenstore init-xenstore-domain
> attached - it's quite long uncompressed
> 

The log file suggests compilation of init-xenstore-domain is
successful. :-/

If you encounter that problem with parallel build you might want to
invoke make with "-j"?

Wei.

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: Parallel make supported?
  2015-01-06 10:36           ` Wei Liu
@ 2015-01-06 10:39             ` Ian Campbell
  0 siblings, 0 replies; 8+ messages in thread
From: Ian Campbell @ 2015-01-06 10:39 UTC (permalink / raw)
  To: Wei Liu; +Cc: xen-devel, Peter Kay

On Tue, 2015-01-06 at 10:36 +0000, Wei Liu wrote:
> On Tue, Jan 06, 2015 at 12:08:33AM +0000, Peter Kay wrote:

Peter, could you not top post and do trim your quotes please.

> > root[xen-4.5.0-rc4]# ls -l tools/xenstore/libxenstore*
> > -rw-r--r-- 1 root root 98580 Dec 19 22:02 tools/xenstore/libxenstore.a
> > -rwxr-xr-x 1 root root 82624 Dec 19 22:02
> > tools/xenstore/libxenstore.so.3.0.3
> > 
> > Please see output of make -d -C tools/xenstore init-xenstore-domain
> > attached - it's quite long uncompressed
> > 
> 
> The log file suggests compilation of init-xenstore-domain is
> successful. :-/
> 
> If you encounter that problem with parallel build you might want to
> invoke make with "-j"?

Sorry, my fault for not including that in the initial suggestion.

Ian.

^ permalink raw reply	[flat|nested] 8+ messages in thread

end of thread, other threads:[~2015-01-06 10:39 UTC | newest]

Thread overview: 8+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2014-12-18 22:36 Parallel make supported? Peter Kay
2014-12-19 10:05 ` Ian Campbell
2014-12-19 22:09   ` Peter Kay
2014-12-29 13:01     ` Wei Liu
2015-01-05 16:01       ` Ian Campbell
2015-01-06  0:08         ` Peter Kay
2015-01-06 10:36           ` Wei Liu
2015-01-06 10:39             ` Ian Campbell

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.