All of lore.kernel.org
 help / color / mirror / Atom feed
* why do numerous .bb files set "PARALLEL_MAKE"?
@ 2011-11-04 15:57 Robert P. J. Day
  2011-11-04 16:03 ` Joshua Lock
                   ` (2 more replies)
  0 siblings, 3 replies; 8+ messages in thread
From: Robert P. J. Day @ 2011-11-04 15:57 UTC (permalink / raw)
  To: Yocto discussion list


  stumbled over this so i did a more thorough search:

$ grep -w PARALLEL_MAKE $(find . -name *.bb)
./meta/recipes-qt/qt-apps/qmmp_0.5.1.bb:PARALLEL_MAKE = ""
./meta/recipes-core/eggdbus/eggdbus_0.6.bb:PARALLEL_MAKE = ""
./meta/recipes-core/gettext/gettext_0.16.1.bb:PARALLEL_MAKE = ""
./meta/recipes-core/gettext/gettext_0.18.1.1.bb:#PARALLEL_MAKE = ""
./meta/recipes-bsp/pciutils/pciutils_3.1.7.bb:PARALLEL_MAKE = ""
./meta/recipes-extended/sat-solver/sat-solver_git.bb:PARALLEL_MAKE=""
./meta/recipes-extended/bash/bash_3.2.48.bb:PARALLEL_MAKE = ""
./meta/recipes-extended/tcp-wrappers/tcp-wrappers_7.6.bb:PARALLEL_MAKE = ""
./meta/recipes-extended/groff/groff_1.20.1.bb:PARALLEL_MAKE = ""
... more snipped ...

  why are individual recipes setting PARALLEL_MAKE to the empty
string?  it's a *build* option, why would it have any relevance to
individual .bb files?

  conversely, i don't see a single .bb file that sets
BB_NUMBER_THREADS.  the above just looks ... odd.

rday

-- 

========================================================================
Robert P. J. Day                                 Ottawa, Ontario, CANADA
                        http://crashcourse.ca

Twitter:                                       http://twitter.com/rpjday
LinkedIn:                               http://ca.linkedin.com/in/rpjday
========================================================================


^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: why do numerous .bb files set "PARALLEL_MAKE"?
  2011-11-04 15:57 why do numerous .bb files set "PARALLEL_MAKE"? Robert P. J. Day
@ 2011-11-04 16:03 ` Joshua Lock
  2011-11-04 16:06   ` Robert P. J. Day
  2011-11-04 16:10   ` Chris Larson
  2011-11-04 16:05 ` Gary Thomas
  2011-11-04 16:07 ` Martin Jansa
  2 siblings, 2 replies; 8+ messages in thread
From: Joshua Lock @ 2011-11-04 16:03 UTC (permalink / raw)
  To: yocto

On 04/11/11 08:57, Robert P. J. Day wrote:
> 
>   stumbled over this so i did a more thorough search:
> 
> $ grep -w PARALLEL_MAKE $(find . -name *.bb)
> ./meta/recipes-qt/qt-apps/qmmp_0.5.1.bb:PARALLEL_MAKE = ""
> ./meta/recipes-core/eggdbus/eggdbus_0.6.bb:PARALLEL_MAKE = ""
> ./meta/recipes-core/gettext/gettext_0.16.1.bb:PARALLEL_MAKE = ""
> ./meta/recipes-core/gettext/gettext_0.18.1.1.bb:#PARALLEL_MAKE = ""
> ./meta/recipes-bsp/pciutils/pciutils_3.1.7.bb:PARALLEL_MAKE = ""
> ./meta/recipes-extended/sat-solver/sat-solver_git.bb:PARALLEL_MAKE=""
> ./meta/recipes-extended/bash/bash_3.2.48.bb:PARALLEL_MAKE = ""
> ./meta/recipes-extended/tcp-wrappers/tcp-wrappers_7.6.bb:PARALLEL_MAKE = ""
> ./meta/recipes-extended/groff/groff_1.20.1.bb:PARALLEL_MAKE = ""
> ... more snipped ...
> 
>   why are individual recipes setting PARALLEL_MAKE to the empty
> string?  it's a *build* option, why would it have any relevance to
> individual .bb files?

Because that individual BB file has problems being run with parallel
make (make -j).

> 
>   conversely, i don't see a single .bb file that sets
> BB_NUMBER_THREADS.  the above just looks ... odd.

That's the amount of threads BitBake creates, tasks it will run in parallel.

Cheers,
Joshua
-- 
Joshua Lock
        Yocto Project "Johannes factotum"
        Intel Open Source Technology Centre


^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: why do numerous .bb files set "PARALLEL_MAKE"?
  2011-11-04 15:57 why do numerous .bb files set "PARALLEL_MAKE"? Robert P. J. Day
  2011-11-04 16:03 ` Joshua Lock
@ 2011-11-04 16:05 ` Gary Thomas
  2011-11-04 16:07 ` Martin Jansa
  2 siblings, 0 replies; 8+ messages in thread
From: Gary Thomas @ 2011-11-04 16:05 UTC (permalink / raw)
  To: Robert P. J. Day; +Cc: Yocto discussion list

On 2011-11-04 09:57, Robert P. J. Day wrote:
>
>    stumbled over this so i did a more thorough search:
>
> $ grep -w PARALLEL_MAKE $(find . -name *.bb)
> ./meta/recipes-qt/qt-apps/qmmp_0.5.1.bb:PARALLEL_MAKE = ""
> ./meta/recipes-core/eggdbus/eggdbus_0.6.bb:PARALLEL_MAKE = ""
> ./meta/recipes-core/gettext/gettext_0.16.1.bb:PARALLEL_MAKE = ""
> ./meta/recipes-core/gettext/gettext_0.18.1.1.bb:#PARALLEL_MAKE = ""
> ./meta/recipes-bsp/pciutils/pciutils_3.1.7.bb:PARALLEL_MAKE = ""
> ./meta/recipes-extended/sat-solver/sat-solver_git.bb:PARALLEL_MAKE=""
> ./meta/recipes-extended/bash/bash_3.2.48.bb:PARALLEL_MAKE = ""
> ./meta/recipes-extended/tcp-wrappers/tcp-wrappers_7.6.bb:PARALLEL_MAKE = ""
> ./meta/recipes-extended/groff/groff_1.20.1.bb:PARALLEL_MAKE = ""
> ... more snipped ...
>
>    why are individual recipes setting PARALLEL_MAKE to the empty
> string?  it's a *build* option, why would it have any relevance to
> individual .bb files?

These recipes don't support random ordering of some operations, thus
they are forcing make to run single-threaded.

>
>    conversely, i don't see a single .bb file that sets
> BB_NUMBER_THREADS.  the above just looks ... odd.

I think that setting this variable in a recipe would not have any effect.

-- 
------------------------------------------------------------
Gary Thomas                 |  Consulting for the
MLB Associates              |    Embedded world
------------------------------------------------------------


^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: why do numerous .bb files set "PARALLEL_MAKE"?
  2011-11-04 16:03 ` Joshua Lock
@ 2011-11-04 16:06   ` Robert P. J. Day
  2011-11-04 16:10   ` Chris Larson
  1 sibling, 0 replies; 8+ messages in thread
From: Robert P. J. Day @ 2011-11-04 16:06 UTC (permalink / raw)
  To: Joshua Lock; +Cc: yocto

On Fri, 4 Nov 2011, Joshua Lock wrote:

> On 04/11/11 08:57, Robert P. J. Day wrote:
> >
> >   stumbled over this so i did a more thorough search:
> >
> > $ grep -w PARALLEL_MAKE $(find . -name *.bb)
> > ./meta/recipes-qt/qt-apps/qmmp_0.5.1.bb:PARALLEL_MAKE = ""
> > ./meta/recipes-core/eggdbus/eggdbus_0.6.bb:PARALLEL_MAKE = ""
> > ./meta/recipes-core/gettext/gettext_0.16.1.bb:PARALLEL_MAKE = ""
> > ./meta/recipes-core/gettext/gettext_0.18.1.1.bb:#PARALLEL_MAKE = ""
> > ./meta/recipes-bsp/pciutils/pciutils_3.1.7.bb:PARALLEL_MAKE = ""
> > ./meta/recipes-extended/sat-solver/sat-solver_git.bb:PARALLEL_MAKE=""
> > ./meta/recipes-extended/bash/bash_3.2.48.bb:PARALLEL_MAKE = ""
> > ./meta/recipes-extended/tcp-wrappers/tcp-wrappers_7.6.bb:PARALLEL_MAKE = ""
> > ./meta/recipes-extended/groff/groff_1.20.1.bb:PARALLEL_MAKE = ""
> > ... more snipped ...
> >
> >   why are individual recipes setting PARALLEL_MAKE to the empty
> > string?  it's a *build* option, why would it have any relevance to
> > individual .bb files?
>
> Because that individual BB file has problems being run with parallel
> make (make -j).

  ok, makes sense, thanks.

rday

-- 

========================================================================
Robert P. J. Day                                 Ottawa, Ontario, CANADA
                        http://crashcourse.ca

Twitter:                                       http://twitter.com/rpjday
LinkedIn:                               http://ca.linkedin.com/in/rpjday
========================================================================


^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: why do numerous .bb files set "PARALLEL_MAKE"?
  2011-11-04 15:57 why do numerous .bb files set "PARALLEL_MAKE"? Robert P. J. Day
  2011-11-04 16:03 ` Joshua Lock
  2011-11-04 16:05 ` Gary Thomas
@ 2011-11-04 16:07 ` Martin Jansa
  2011-11-04 16:12   ` Robert P. J. Day
  2011-11-07 10:22   ` Richard Purdie
  2 siblings, 2 replies; 8+ messages in thread
From: Martin Jansa @ 2011-11-04 16:07 UTC (permalink / raw)
  To: Robert P. J. Day; +Cc: Yocto discussion list

[-- Attachment #1: Type: text/plain, Size: 1869 bytes --]

On Fri, Nov 04, 2011 at 11:57:46AM -0400, Robert P. J. Day wrote:
> 
>   stumbled over this so i did a more thorough search:
> 
> $ grep -w PARALLEL_MAKE $(find . -name *.bb)
> ./meta/recipes-qt/qt-apps/qmmp_0.5.1.bb:PARALLEL_MAKE = ""
> ./meta/recipes-core/eggdbus/eggdbus_0.6.bb:PARALLEL_MAKE = ""
> ./meta/recipes-core/gettext/gettext_0.16.1.bb:PARALLEL_MAKE = ""
> ./meta/recipes-core/gettext/gettext_0.18.1.1.bb:#PARALLEL_MAKE = ""
> ./meta/recipes-bsp/pciutils/pciutils_3.1.7.bb:PARALLEL_MAKE = ""
> ./meta/recipes-extended/sat-solver/sat-solver_git.bb:PARALLEL_MAKE=""
> ./meta/recipes-extended/bash/bash_3.2.48.bb:PARALLEL_MAKE = ""
> ./meta/recipes-extended/tcp-wrappers/tcp-wrappers_7.6.bb:PARALLEL_MAKE = ""
> ./meta/recipes-extended/groff/groff_1.20.1.bb:PARALLEL_MAKE = ""
> ... more snipped ...
> 
>   why are individual recipes setting PARALLEL_MAKE to the empty
> string?  it's a *build* option, why would it have any relevance to
> individual .bb files?

because some projects fail to build in parallel and we don't have
manpower to fix them all?

>   conversely, i don't see a single .bb file that sets
> BB_NUMBER_THREADS.  the above just looks ... odd.
> 
> rday
> 
> -- 
> 
> ========================================================================
> Robert P. J. Day                                 Ottawa, Ontario, CANADA
>                         http://crashcourse.ca
> 
> Twitter:                                       http://twitter.com/rpjday
> LinkedIn:                               http://ca.linkedin.com/in/rpjday
> ========================================================================
> _______________________________________________
> yocto mailing list
> yocto@yoctoproject.org
> https://lists.yoctoproject.org/listinfo/yocto

-- 
Martin 'JaMa' Jansa     jabber: Martin.Jansa@gmail.com

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 205 bytes --]

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: why do numerous .bb files set "PARALLEL_MAKE"?
  2011-11-04 16:03 ` Joshua Lock
  2011-11-04 16:06   ` Robert P. J. Day
@ 2011-11-04 16:10   ` Chris Larson
  1 sibling, 0 replies; 8+ messages in thread
From: Chris Larson @ 2011-11-04 16:10 UTC (permalink / raw)
  To: Joshua Lock; +Cc: yocto

On Fri, Nov 4, 2011 at 9:03 AM, Joshua Lock <josh@linux.intel.com> wrote:
> On 04/11/11 08:57, Robert P. J. Day wrote:
>>
>>   stumbled over this so i did a more thorough search:
>>
>> $ grep -w PARALLEL_MAKE $(find . -name *.bb)
>> ./meta/recipes-qt/qt-apps/qmmp_0.5.1.bb:PARALLEL_MAKE = ""
>> ./meta/recipes-core/eggdbus/eggdbus_0.6.bb:PARALLEL_MAKE = ""
>> ./meta/recipes-core/gettext/gettext_0.16.1.bb:PARALLEL_MAKE = ""
>> ./meta/recipes-core/gettext/gettext_0.18.1.1.bb:#PARALLEL_MAKE = ""
>> ./meta/recipes-bsp/pciutils/pciutils_3.1.7.bb:PARALLEL_MAKE = ""
>> ./meta/recipes-extended/sat-solver/sat-solver_git.bb:PARALLEL_MAKE=""
>> ./meta/recipes-extended/bash/bash_3.2.48.bb:PARALLEL_MAKE = ""
>> ./meta/recipes-extended/tcp-wrappers/tcp-wrappers_7.6.bb:PARALLEL_MAKE = ""
>> ./meta/recipes-extended/groff/groff_1.20.1.bb:PARALLEL_MAKE = ""
>> ... more snipped ...
>>
>>   why are individual recipes setting PARALLEL_MAKE to the empty
>> string?  it's a *build* option, why would it have any relevance to
>> individual .bb files?
>
> Because that individual BB file has problems being run with parallel
> make (make -j).

To clarify/elaborate a bit: the build system of the project that the
recipe is building doesn't support make -j (generally, this means
they're missing rules for dependencies, it's implicit, rather than
explicit). It's best to get these fixed upstream, where possible, but
we often just disable it to get it to work so we can move on. Feel
free to report these issues as bugs to the upstream projects, if
you're feeling motivated :)
-- 
Christopher Larson
clarson at kergoth dot com
Founder - BitBake, OpenEmbedded, OpenZaurus
Maintainer - Tslib
Senior Software Engineer, Mentor Graphics


^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: why do numerous .bb files set "PARALLEL_MAKE"?
  2011-11-04 16:07 ` Martin Jansa
@ 2011-11-04 16:12   ` Robert P. J. Day
  2011-11-07 10:22   ` Richard Purdie
  1 sibling, 0 replies; 8+ messages in thread
From: Robert P. J. Day @ 2011-11-04 16:12 UTC (permalink / raw)
  To: Martin Jansa; +Cc: Yocto discussion list

On Fri, 4 Nov 2011, Martin Jansa wrote:

> On Fri, Nov 04, 2011 at 11:57:46AM -0400, Robert P. J. Day wrote:
> >
> >   stumbled over this so i did a more thorough search:
> >
> > $ grep -w PARALLEL_MAKE $(find . -name *.bb)
> > ./meta/recipes-qt/qt-apps/qmmp_0.5.1.bb:PARALLEL_MAKE = ""
> > ./meta/recipes-core/eggdbus/eggdbus_0.6.bb:PARALLEL_MAKE = ""
> > ./meta/recipes-core/gettext/gettext_0.16.1.bb:PARALLEL_MAKE = ""
> > ./meta/recipes-core/gettext/gettext_0.18.1.1.bb:#PARALLEL_MAKE = ""
> > ./meta/recipes-bsp/pciutils/pciutils_3.1.7.bb:PARALLEL_MAKE = ""
> > ./meta/recipes-extended/sat-solver/sat-solver_git.bb:PARALLEL_MAKE=""
> > ./meta/recipes-extended/bash/bash_3.2.48.bb:PARALLEL_MAKE = ""
> > ./meta/recipes-extended/tcp-wrappers/tcp-wrappers_7.6.bb:PARALLEL_MAKE = ""
> > ./meta/recipes-extended/groff/groff_1.20.1.bb:PARALLEL_MAKE = ""
> > ... more snipped ...
> >
> >   why are individual recipes setting PARALLEL_MAKE to the empty
> > string?  it's a *build* option, why would it have any relevance to
> > individual .bb files?
>
> because some projects fail to build in parallel and we don't have
> manpower to fix them all?

  ok, i've been properly chastised.  movin' on ...

rday


^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: why do numerous .bb files set "PARALLEL_MAKE"?
  2011-11-04 16:07 ` Martin Jansa
  2011-11-04 16:12   ` Robert P. J. Day
@ 2011-11-07 10:22   ` Richard Purdie
  1 sibling, 0 replies; 8+ messages in thread
From: Richard Purdie @ 2011-11-07 10:22 UTC (permalink / raw)
  To: Martin Jansa; +Cc: Yocto discussion list

On Fri, 2011-11-04 at 17:07 +0100, Martin Jansa wrote:
> On Fri, Nov 04, 2011 at 11:57:46AM -0400, Robert P. J. Day wrote:
> > 
> >   stumbled over this so i did a more thorough search:
> > 
> > $ grep -w PARALLEL_MAKE $(find . -name *.bb)
> > ./meta/recipes-qt/qt-apps/qmmp_0.5.1.bb:PARALLEL_MAKE = ""
> > ./meta/recipes-core/eggdbus/eggdbus_0.6.bb:PARALLEL_MAKE = ""
> > ./meta/recipes-core/gettext/gettext_0.16.1.bb:PARALLEL_MAKE = ""
> > ./meta/recipes-core/gettext/gettext_0.18.1.1.bb:#PARALLEL_MAKE = ""
> > ./meta/recipes-bsp/pciutils/pciutils_3.1.7.bb:PARALLEL_MAKE = ""
> > ./meta/recipes-extended/sat-solver/sat-solver_git.bb:PARALLEL_MAKE=""
> > ./meta/recipes-extended/bash/bash_3.2.48.bb:PARALLEL_MAKE = ""
> > ./meta/recipes-extended/tcp-wrappers/tcp-wrappers_7.6.bb:PARALLEL_MAKE = ""
> > ./meta/recipes-extended/groff/groff_1.20.1.bb:PARALLEL_MAKE = ""
> > ... more snipped ...
> > 
> >   why are individual recipes setting PARALLEL_MAKE to the empty
> > string?  it's a *build* option, why would it have any relevance to
> > individual .bb files?
> 
> because some projects fail to build in parallel and we don't have
> manpower to fix them all?

Just for reference we have actually fixed a lot of these in other
places, particularly where they're on the critical path. The situation
is a lot better than it ever used to be although obviously still room
for improvement!

Cheers,

Richard



^ permalink raw reply	[flat|nested] 8+ messages in thread

end of thread, other threads:[~2011-11-07 10:22 UTC | newest]

Thread overview: 8+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2011-11-04 15:57 why do numerous .bb files set "PARALLEL_MAKE"? Robert P. J. Day
2011-11-04 16:03 ` Joshua Lock
2011-11-04 16:06   ` Robert P. J. Day
2011-11-04 16:10   ` Chris Larson
2011-11-04 16:05 ` Gary Thomas
2011-11-04 16:07 ` Martin Jansa
2011-11-04 16:12   ` Robert P. J. Day
2011-11-07 10:22   ` Richard Purdie

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.