Hob - proper way to select machine and customer layers

Hob - proper way to select machine and customer layers

[jfabernathy]

So I thought I'd give hob a test. Basically, I wanted to do what I could 
already do with the command line.

Normally, after I set the environment variables, I edit the local.conf 
to change my machine type and parallel processing options. Then I point 
the download directory to a centralized one on my system, and add some 
License statements and some CORE-IMAGE-EXTRA-INSTALL statements for 
extra packages. Then I edit the bblayer.conf to had the path to my layer 
and the meta-intel layers.

To use Hob, I set my environment variable and the just ran hob.  It was 
very slow going through the first 63 packages. I think this is because 
parallel options had not been set and the packages were all being 
downloaded again.  But after I got to the UI of hob, I got errors adding 
my layers to get to the meta-intel layers I wanted.  So I started over 
and edited local.conf and bblayer.conf prior to launching hob.  Now I 
could see my machine from meta-intel, but I could not add my layer in. 
Parsing errors.

Before I report an error, I wanted to see if I have the hob startup 
process right. The issues is around the right way to add 
meta-intel/meta-cedartrail and my personal layer in my home directory.

Any advice?

JIm A

Re: Hob - proper way to select machine and customer layers

[jfabernathy]

On 06/21/2012 10:49 AM, jfabernathy wrote:
> So I thought I'd give hob a test. Basically, I wanted to do what I 
> could already do with the command line.
>
> Normally, after I set the environment variables, I edit the local.conf 
> to change my machine type and parallel processing options. Then I 
> point the download directory to a centralized one on my system, and 
> add some License statements and some CORE-IMAGE-EXTRA-INSTALL 
> statements for extra packages. Then I edit the bblayer.conf to had the 
> path to my layer and the meta-intel layers.
>
> To use Hob, I set my environment variable and the just ran hob.  It 
> was very slow going through the first 63 packages. I think this is 
> because parallel options had not been set and the packages were all 
> being downloaded again.  But after I got to the UI of hob, I got 
> errors adding my layers to get to the meta-intel layers I wanted.  So 
> I started over and edited local.conf and bblayer.conf prior to 
> launching hob.  Now I could see my machine from meta-intel, but I 
> could not add my layer in. Parsing errors.
>
> Before I report an error, I wanted to see if I have the hob startup 
> process right. The issues is around the right way to add 
> meta-intel/meta-cedartrail and my personal layer in my home directory.
>
> Any advice?
>
> JIm A
>
My experimenting tells me that currently Hob (denzil) only work with new 
added layers that are in the poky directory and not in your home 
directory.  This is a different requirement than normal command line 
usage of bitbake.

Jim A

Re: Hob - proper way to select machine and customer layers

[Paul Eggleton]

On Thursday 21 June 2012 14:39:30 jfabernathy wrote:
> On 06/21/2012 10:49 AM, jfabernathy wrote:
> > To use Hob, I set my environment variable and the just ran hob.  It
> > was very slow going through the first 63 packages. I think this is
> > because parallel options had not been set and the packages were all
> > being downloaded again.

You're referring to the initial pseudo build here I presume?

> > But after I got to the UI of hob, I got
> > errors adding my layers to get to the meta-intel layers I wanted.  So
> > I started over and edited local.conf and bblayer.conf prior to
> > launching hob.  Now I could see my machine from meta-intel, but I
> > could not add my layer in. Parsing errors.

By parsing errors it would help if you were more specific. Do you mean the 
following?

ERROR: Unable to parse /home/paul/poky/meta-intel/meta-
cedartrail/conf/layer.conf: Failure expanding variable BBPATH, expression was 
${BBPATH}:/home/paul/poky/meta-intel which triggered exception Exception: 
variable BBPATH references itself!

> > Before I report an error, I wanted to see if I have the hob startup
> > process right. The issues is around the right way to add
> > meta-intel/meta-cedartrail and my personal layer in my home directory.
> > 
> > Any advice?
> > 
> > JIm A
> 
> My experimenting tells me that currently Hob (denzil) only work with new
> added layers that are in the poky directory and not in your home
> directory.  This is a different requirement than normal command line
> usage of bitbake.

Assuming the error you're seeing is the one above, I don't think that's the 
problem - the problem AFAICT is that the order of the layers hob is using is 
not the same as the order in which it displays them, and the order it uses is 
not compatible with the old method of setting BBPATH which meta-intel and its 
sub-layers use, which is 'BBPATH := "${BBPATH} /extra/path/to/add"' - if 
BBPATH is not already set as it would not be if this is the first layer in the 
list, then it is unable to expand BBPATH and you get this failure. You can 
reproduce this outside of hob just by reordering the entries in bblayers.conf.

So there are a few issues highlighted here:

1) Hob is re-ordering the layer list and it definitely shouldn't be. I've filed 
bug #2649 to get this fixed.

2) We really ought to go through and fix the BBPATH setting for all layers to 
not use the old method of appending to it.

3) It may be useful for people to be able to change the order of layers in the 
layer list within hob, particularly for situations where class/conf files are 
overlayed (which is to be avoided, but does occur).

Cheers,
Paul

-- 

Paul Eggleton
Intel Open Source Technology Centre

Re: Hob - proper way to select machine and customer layers

[jfabernathy]

On 06/22/2012 07:17 AM, Paul Eggleton wrote:
> On Thursday 21 June 2012 14:39:30 jfabernathy wrote:
>> On 06/21/2012 10:49 AM, jfabernathy wrote:
>>> To use Hob, I set my environment variable and the just ran hob.  It
>>> was very slow going through the first 63 packages. I think this is
>>> because parallel options had not been set and the packages were all
>>> being downloaded again.
> You're referring to the initial pseudo build here I presume?
Yes.
>>> But after I got to the UI of hob, I got
>>> errors adding my layers to get to the meta-intel layers I wanted.  So
>>> I started over and edited local.conf and bblayer.conf prior to
>>> launching hob.  Now I could see my machine from meta-intel, but I
>>> could not add my layer in. Parsing errors.
> By parsing errors it would help if you were more specific. Do you mean the
> following?
>
> ERROR: Unable to parse /home/paul/poky/meta-intel/meta-
> cedartrail/conf/layer.conf: Failure expanding variable BBPATH, expression was
> ${BBPATH}:/home/paul/poky/meta-intel which triggered exception Exception:
> variable BBPATH references itself!
ERROR: Unable to parse /home/jim/poky/meta-hob/conf/layer.conf:
Failure expanding variable BBPATH, expression was
$(BBPATH):/home/jim/meta-jfa:/home/jim/poky/meta
which triggered exception Exception: variable BBPATH
references itself!
>>> Before I report an error, I wanted to see if I have the hob startup
>>> process right. The issues is around the right way to add
>>> meta-intel/meta-cedartrail and my personal layer in my home directory.
>>>
>>> Any advice?
>>>
>>> JIm A
>> My experimenting tells me that currently Hob (denzil) only work with new
>> added layers that are in the poky directory and not in your home
>> directory.  This is a different requirement than normal command line
>> usage of bitbake.
> Assuming the error you're seeing is the one above, I don't think that's the
> problem - the problem AFAICT is that the order of the layers hob is using is
> not the same as the order in which it displays them, and the order it uses is
> not compatible with the old method of setting BBPATH which meta-intel and its
> sub-layers use, which is 'BBPATH := "${BBPATH} /extra/path/to/add"' - if
> BBPATH is not already set as it would not be if this is the first layer in the
> list, then it is unable to expand BBPATH and you get this failure. You can
> reproduce this outside of hob just by reordering the entries in bblayers.conf.
>
> So there are a few issues highlighted here:
>
> 1) Hob is re-ordering the layer list and it definitely shouldn't be. I've filed
> bug #2649 to get this fixed.
>
> 2) We really ought to go through and fix the BBPATH setting for all layers to
> not use the old method of appending to it.
>
> 3) It may be useful for people to be able to change the order of layers in the
> layer list within hob, particularly for situations where class/conf files are
> overlayed (which is to be avoided, but does occur).
>
> Cheers,
> Paul
>
Seems that you understand the problem :-)

Jim A