hob usage

hob usage

[Jim Abernathy]

I have a question about hob usage.  I understand the basics of hob and 
how it adds packages.  I also understand how it will parse through my 
local.conf and include any extra packages that I may have included by 
using IMAGE_INSTALL += <package>.

I've found that if I start with a clean BSP and use hob to add a 
package, it will allow me to save that configuration anywhere.  I'm not 
sure where I should save it.  It contains the IMAGE_INSTALL for the 
packages I've selected, but is also includes a 'require' statement, 
which seems to have a relative path, like:

require recipes-sato/images/core-image-sato.bb

Where is the location I should save the hob configuration file? I know 
that if I save it outside my poky directory, the package will not be 
included, so it's important where it goes.

Jim A

Re: hob usage

[McClintock Matthew-B29882]

On Tue, Jan 10, 2012 at 9:56 PM, Jim Abernathy <jfabernathy@gmail.com> wrote:
> I have a question about hob usage.  I understand the basics of hob and how
> it adds packages.  I also understand how it will parse through my local.conf
> and include any extra packages that I may have included by using
> IMAGE_INSTALL += <package>.
>
> I've found that if I start with a clean BSP and use hob to add a package, it
> will allow me to save that configuration anywhere.  I'm not sure where I
> should save it.  It contains the IMAGE_INSTALL for the packages I've
> selected, but is also includes a 'require' statement, which seems to have a
> relative path, like:
>
> require recipes-sato/images/core-image-sato.bb
>
> Where is the location I should save the hob configuration file? I know that
> if I save it outside my poky directory, the package will not be included, so
> it's important where it goes.

This is one of those quirks about hob I found weird. I filed a bug about this:

http://bugzilla.yoctoproject.org/show_bug.cgi?id=1573

In general you need to save it somewhere one of your layers looks for
additional recipes to run it from the command line.

-M

HOB usage

[madeeha javed]

Hi,

I an using Yocto Edison. My machine configuration is beagleboard. And
when I launch hob and Bake. I get a message that Output Image Type is
not set.When I Edit-> Preferences, I see that jffs2 and tar.bz2 are
set. And even if I select a different type, the message keeps is
there.

Any suggestions?

Thanks!
Best regards,
Madeeha

Re: HOB usage

[Joshua Lock]

On 05/12/11 10:35, madeeha javed wrote:
> I an using Yocto Edison. My machine configuration is beagleboard. And
> when I launch hob and Bake. I get a message that Output Image Type is
> not set.When I Edit-> Preferences, I see that jffs2 and tar.bz2 are
> set. And even if I select a different type, the message keeps is
> there.

Madeeha,

I'm not able to replicate this issue. Have you modified any of the
configuration files by hand? The three key files in build/conf are
hob-post.conf, hob-pre.conf, local.conf

It's possible you've hard-assigned the variable in there.

If you can provide more information I can try and replicate. A copy of
the above configuration files would be useful.

Regards,
Joshua
-- 
Joshua Lock
        Yocto Project "Johannes factotum"
        Intel Open Source Technology Centre

Re: HOB usage

[Sathishkumar Duraisamy]

Hi,

I migrating from Openembedded to yocto project and using Beagleboard
as playground.

On Fri, Dec 9, 2011 at 3:27 AM, Joshua Lock <josh@linux.intel.com> wrote:
>
> On 05/12/11 10:35, madeeha javed wrote:
>> I an using Yocto Edison. My machine configuration is beagleboard. And
>> when I launch hob and Bake. I get a message that Output Image Type is
>> not set.When I Edit-> Preferences, I see that jffs2 and tar.bz2 are
>> set. And even if I select a different type, the message keeps is
>> there.
>
I too faced similar problem for hob.

> Madeeha,
>
> I'm not able to replicate this issue. Have you modified any of the
> configuration files by hand? The three key files in build/conf are
> hob-post.conf, hob-pre.conf, local.conf

Please find these files in the attachment.

>
> It's possible you've hard-assigned the variable in there.
>
> If you can provide more information I can try and replicate. A copy of
> the above configuration files would be useful.

In openembedded, I see the some lines like this

# Add the required image file system types below. Valid are
# jffs2, tar(.gz|bz2), cpio(.gz), cramfs, ext2(.gz), ext3(.gz), ext4(.gz|.bz2),
# squashfs, squashfs-lzma
IMAGE_FSTYPES = "jffs2 tar"

which is moved to hob-post.conf, which may causing the problems I hope.
-- 
Regards,
Sathishkumar D
http://flowersopenlab.weebly.com/

Re: HOB usage

[Joshua Lock]

On 08/12/11 20:52, Sathishkumar Duraisamy wrote:
> Hi,
> 
> I migrating from Openembedded to yocto project and using Beagleboard
> as playground.
> 
> On Fri, Dec 9, 2011 at 3:27 AM, Joshua Lock <josh@linux.intel.com> wrote:
>>
>> On 05/12/11 10:35, madeeha javed wrote:
>>> I an using Yocto Edison. My machine configuration is beagleboard. And
>>> when I launch hob and Bake. I get a message that Output Image Type is
>>> not set.When I Edit-> Preferences, I see that jffs2 and tar.bz2 are
>>> set. And even if I select a different type, the message keeps is
>>> there.
>>
> I too faced similar problem for hob.
> 
>> Madeeha,
>>
>> I'm not able to replicate this issue. Have you modified any of the
>> configuration files by hand? The three key files in build/conf are
>> hob-post.conf, hob-pre.conf, local.conf
> 
> Please find these files in the attachment.

Did you forget the attachment? Or did the mailing list strip it?

> 
>>
>> It's possible you've hard-assigned the variable in there.
>>
>> If you can provide more information I can try and replicate. A copy of
>> the above configuration files would be useful.
> 
> In openembedded, I see the some lines like this
> 
> # Add the required image file system types below. Valid are
> # jffs2, tar(.gz|bz2), cpio(.gz), cramfs, ext2(.gz), ext3(.gz), ext4(.gz|.bz2),
> # squashfs, squashfs-lzma
> IMAGE_FSTYPES = "jffs2 tar"
> 
> which is moved to hob-post.conf, which may causing the problems I hope.

Anywhere you set with = is a 'hard' assignment which we cannot override.

Several of hobs settings are in hob-post.conf, if they have already been
hard assigned in a configuration file which is parsed earlier we cannot
override it.

If you set the IMAGE_FSTYPES with ?= setting them from the GUI should world.

Please be aware we're working to resolve such issues for hob in Yocto 1.2.

Regards,
Joshua
-- 
Joshua Lock
        Yocto Project "Johannes factotum"
        Intel Open Source Technology Centre

Re: HOB usage

[Sathishkumar Duraisamy]

[-- Attachment #1: Type: text/plain, Size: 2128 bytes --]

On Fri, Dec 9, 2011 at 10:28 AM, Joshua Lock <josh@linux.intel.com> wrote:
> On 08/12/11 20:52, Sathishkumar Duraisamy wrote:
>> Hi,
>>
>> I migrating from Openembedded to yocto project and using Beagleboard
>> as playground.
>>
>> On Fri, Dec 9, 2011 at 3:27 AM, Joshua Lock <josh@linux.intel.com> wrote:
>>>
>>> On 05/12/11 10:35, madeeha javed wrote:
>>>> I an using Yocto Edison. My machine configuration is beagleboard. And
>>>> when I launch hob and Bake. I get a message that Output Image Type is
>>>> not set.When I Edit-> Preferences, I see that jffs2 and tar.bz2 are
>>>> set. And even if I select a different type, the message keeps is
>>>> there.
>>>
>> I too faced similar problem for hob.
>>
>>> Madeeha,
>>>
>>> I'm not able to replicate this issue. Have you modified any of the
>>> configuration files by hand? The three key files in build/conf are
>>> hob-post.conf, hob-pre.conf, local.conf
>>
>> Please find these files in the attachment.
>
> Did you forget the attachment? Or did the mailing list strip it?

Sorry, I forget to attach.
>
>>
>>>
>>> It's possible you've hard-assigned the variable in there.
>>>
>>> If you can provide more information I can try and replicate. A copy of
>>> the above configuration files would be useful.
>>
>> In openembedded, I see the some lines like this
>>
>> # Add the required image file system types below. Valid are
>> # jffs2, tar(.gz|bz2), cpio(.gz), cramfs, ext2(.gz), ext3(.gz), ext4(.gz|.bz2),
>> # squashfs, squashfs-lzma
>> IMAGE_FSTYPES = "jffs2 tar"
>>
>> which is moved to hob-post.conf, which may causing the problems I hope.
>
> Anywhere you set with = is a 'hard' assignment which we cannot override.
>
> Several of hobs settings are in hob-post.conf, if they have already been
> hard assigned in a configuration file which is parsed earlier we cannot
> override it.
>
> If you set the IMAGE_FSTYPES with ?= setting them from the GUI should world.
>
> Please be aware we're working to resolve such issues for hob in Yocto 1.2.
>


-- 
Regards,
Sathishkumar D
http://flowersopenlab.weebly.com/

[-- Attachment #2: hob-confs.tar.gz --]
[-- Type: application/x-gzip, Size: 4383 bytes --]

Re: HOB usage

[Sathishkumar Duraisamy]

On Fri, Dec 9, 2011 at 10:37 AM, Sathishkumar Duraisamy
<bewithsathish@gmail.com> wrote:
> On Fri, Dec 9, 2011 at 10:28 AM, Joshua Lock <josh@linux.intel.com> wrote:
>> On 08/12/11 20:52, Sathishkumar Duraisamy wrote:
>>> Hi,
>>>
>>> I migrating from Openembedded to yocto project and using Beagleboard
>>> as playground.
>>>
>>> On Fri, Dec 9, 2011 at 3:27 AM, Joshua Lock <josh@linux.intel.com> wrote:
>>>>
>>>> On 05/12/11 10:35, madeeha javed wrote:
>>>>> I an using Yocto Edison. My machine configuration is beagleboard. And
>>>>> when I launch hob and Bake. I get a message that Output Image Type is
>>>>> not set.When I Edit-> Preferences, I see that jffs2 and tar.bz2 are
>>>>> set. And even if I select a different type, the message keeps is
>>>>> there.
>>>>
>>> I too faced similar problem for hob.
>>>
>>>> Madeeha,
>>>>
>>>> I'm not able to replicate this issue. Have you modified any of the
>>>> configuration files by hand? The three key files in build/conf are
>>>> hob-post.conf, hob-pre.conf, local.conf
>>>
>>> Please find these files in the attachment.
>>
>> Did you forget the attachment? Or did the mailing list strip it?
>
> Sorry, I forget to attach.
>>
>>>
>>>>
>>>> It's possible you've hard-assigned the variable in there.
>>>>
>>>> If you can provide more information I can try and replicate. A copy of
>>>> the above configuration files would be useful.
>>>
>>> In openembedded, I see the some lines like this
>>>
>>> # Add the required image file system types below. Valid are
>>> # jffs2, tar(.gz|bz2), cpio(.gz), cramfs, ext2(.gz), ext3(.gz), ext4(.gz|.bz2),
>>> # squashfs, squashfs-lzma
>>> IMAGE_FSTYPES = "jffs2 tar"
>>>
>>> which is moved to hob-post.conf, which may causing the problems I hope.
>>

I forget to say, in bash terminal, it works fine. In hob only it
causing the issue.

-- 
Regards,
Sathishkumar D
http://flowersopenlab.weebly.com/

Re: HOB usage

[Joshua Lock]

On 08/12/11 21:18, Sathishkumar Duraisamy wrote:
> On Fri, Dec 9, 2011 at 10:37 AM, Sathishkumar Duraisamy
> <bewithsathish@gmail.com> wrote:
>> On Fri, Dec 9, 2011 at 10:28 AM, Joshua Lock <josh@linux.intel.com> wrote:
>>> On 08/12/11 20:52, Sathishkumar Duraisamy wrote:
>>>> Hi,
>>>>
>>>> I migrating from Openembedded to yocto project and using Beagleboard
>>>> as playground.
>>>>
>>>> On Fri, Dec 9, 2011 at 3:27 AM, Joshua Lock <josh@linux.intel.com> wrote:
>>>>>
>>>>> On 05/12/11 10:35, madeeha javed wrote:
>>>>>> I an using Yocto Edison. My machine configuration is beagleboard. And
>>>>>> when I launch hob and Bake. I get a message that Output Image Type is
>>>>>> not set.When I Edit-> Preferences, I see that jffs2 and tar.bz2 are
>>>>>> set. And even if I select a different type, the message keeps is
>>>>>> there.
>>>>>
>>>> I too faced similar problem for hob.
>>>>
>>>>> Madeeha,
>>>>>
>>>>> I'm not able to replicate this issue. Have you modified any of the
>>>>> configuration files by hand? The three key files in build/conf are
>>>>> hob-post.conf, hob-pre.conf, local.conf
>>>>
>>>> Please find these files in the attachment.
>>>
>>> Did you forget the attachment? Or did the mailing list strip it?
>>
>> Sorry, I forget to attach.
>>>
>>>>
>>>>>
>>>>> It's possible you've hard-assigned the variable in there.
>>>>>
>>>>> If you can provide more information I can try and replicate. A copy of
>>>>> the above configuration files would be useful.
>>>>
>>>> In openembedded, I see the some lines like this
>>>>
>>>> # Add the required image file system types below. Valid are
>>>> # jffs2, tar(.gz|bz2), cpio(.gz), cramfs, ext2(.gz), ext3(.gz), ext4(.gz|.bz2),
>>>> # squashfs, squashfs-lzma
>>>> IMAGE_FSTYPES = "jffs2 tar"
>>>>
>>>> which is moved to hob-post.conf, which may causing the problems I hope.
>>>
> 
> I forget to say, in bash terminal, it works fine. In hob only it
> causing the issue.
> 

The hob-pre and hob-post files are not used from the terminal, unless
you explicitly pass them.
I will look at the configuration files you've shared.

Also, can you tell us how you are launching hob?

Regards,
Joshua
-- 
Joshua Lock
        Yocto Project "Johannes factotum"
        Intel Open Source Technology Centre

Re: HOB usage

[Joshua Lock]

On 08/12/11 21:07, Sathishkumar Duraisamy wrote:
> On Fri, Dec 9, 2011 at 10:28 AM, Joshua Lock <josh@linux.intel.com> wrote:
>> On 08/12/11 20:52, Sathishkumar Duraisamy wrote:
>>> Hi,
>>>
>>> I migrating from Openembedded to yocto project and using Beagleboard
>>> as playground.
>>>
>>> On Fri, Dec 9, 2011 at 3:27 AM, Joshua Lock <josh@linux.intel.com> wrote:
>>>>
>>>> On 05/12/11 10:35, madeeha javed wrote:
>>>>> I an using Yocto Edison. My machine configuration is beagleboard. And
>>>>> when I launch hob and Bake. I get a message that Output Image Type is
>>>>> not set.When I Edit-> Preferences, I see that jffs2 and tar.bz2 are
>>>>> set. And even if I select a different type, the message keeps is
>>>>> there.
>>>>
>>> I too faced similar problem for hob.
>>>
>>>> Madeeha,
>>>>
>>>> I'm not able to replicate this issue. Have you modified any of the
>>>> configuration files by hand? The three key files in build/conf are
>>>> hob-post.conf, hob-pre.conf, local.conf
>>>
>>> Please find these files in the attachment.

Nothing is jumping out here. Interesting.

Would you be willing to file a bug at bugzilla.yoctoproject.org where we
can track and resolve this issue?

Could you provide information on what MACHINE you're building for and
any custom configuration files?
For example if this is a machine which isn't in OE-Core/Yocto it'd be
useful to have a look at the machine.conf

Further can you share in that report the method you use to start the Hob
GUI, i.e. wrapper script or some other invocation.

Thanks,
Joshua

-- 
Joshua Lock
        Yocto Project "Johannes factotum"
        Intel Open Source Technology Centre

Re: HOB usage

[Sathishkumar Duraisamy]

Hi,

Today, I tried to reproduce the problem and magically, today, hob
works as expected.  So, I started once again with new config, and
again I tried to reproduce the problem. But the problem exists.

The reason for this, once we select our images in the
edit->preference, it writes our preference in the file hob-post.conf
file. But it doesn't parses it again unless we are restarting the hob
again.

Here are some code snippets that it confirms this:

In file scripts/hob,

#hob is started with reading these files.
bitbake -r conf/hob-pre.conf -R conf/hob-post.conf -u hob

In file poky-edison-6.0/bitbake/lib/bb/ui/hob.py

    def preferences_cb(self, action):
        resp = self.prefs.run()
        self.prefs.write_changes()
        self.prefs.hide()

which ultimately, calls poky-edison-6.0/bitbake/lib/bb/ui/crumbs/configrator.py

    def writeConfFile(self, conffile, contents):
        """
        Make a backup copy of conffile and write a new file in its stead with
        the lines in the contents list.
        """
        # Create a backup of the conf file
        bkup = "%s~" % conffile
        os.rename(conffile, bkup)

        # Write the contents list object to the conf file
        with open(conffile, "w") as new:
            new.write("".join(contents))


Here it just writes, but never parses it again. So, unless, we close
and restart hob, preferences doesn't take change.

So, have to fix this, to ask to parses it again once the changes are written.

-- 
Regards,
Sathishkumar D
http://flowersopenlab.weebly.com/

Re: HOB usage

[Joshua Lock]

On 11/12/11 21:20, Sathishkumar Duraisamy wrote:
> Hi,
> 
> Today, I tried to reproduce the problem and magically, today, hob
> works as expected.  So, I started once again with new config, and
> again I tried to reproduce the problem. But the problem exists.
> 
> The reason for this, once we select our images in the
> edit->preference, it writes our preference in the file hob-post.conf
> file. But it doesn't parses it again unless we are restarting the hob
> again.

Hmm, your analysis seems sound enough. We do call the setVariable
command on the cooker which I had expected to ensure the variable was
set appropriately without a reparse.

We can easily add a patch to trigger a reparse once IMAGE_FSTYPES is
changed, as we do with several of the other preference values.

Something like:

joshual@shamshir:~/Projects/Yocto/poky-stable [josh/edison *]
$ git diff
diff --git a/bitbake/lib/bb/ui/crumbs/hobprefs.py
b/bitbake/lib/bb/ui/crumbs/hob
index 5dfb0e6..3f6f128 100644
--- a/bitbake/lib/bb/ui/crumbs/hobprefs.py
+++ b/bitbake/lib/bb/ui/crumbs/hobprefs.py
@@ -39,6 +39,7 @@ class HobPrefs(gtk.Dialog):
             self.selected_image_types =
handler.remove_image_output_type(ot)

         self.configurator.setConfVar('IMAGE_FSTYPES', "%s" % "
".join(self.sele
+        self.reload_required = True

     def sdk_machine_combo_changed_cb(self, combo, handler):
         sdk_mach = combo.get_active_text()

Cheers,
Joshua
-- 
Joshua Lock
        Yocto Project "Johannes factotum"
        Intel Open Source Technology Centre

Re: HOB usage

[Ni Qingliang]

[-- Attachment #1: Type: text/plain, Size: 1643 bytes --]

https://niqingliang2003.files.wordpress.com/2011/12/taijitu.png
I have wrote a GUI tool for internal use, 
is it possible to implement thus GUI tool for yocto?
the attachement is the UI.

every circle represents one package, the arrow between them represents
the dependency.
indeed, the dependency relation in this tool is defined by custom config
file, but I think maybe I can use the relation exported from bitbake, is
it possible or easily to implement?

On Fri, 2011-12-09 at 05:57 +0800, Joshua Lock wrote:
> On 05/12/11 10:35, madeeha javed wrote:
> > I an using Yocto Edison. My machine configuration is beagleboard. And
> > when I launch hob and Bake. I get a message that Output Image Type is
> > not set.When I Edit-> Preferences, I see that jffs2 and tar.bz2 are
> > set. And even if I select a different type, the message keeps is
> > there.
> 
> Madeeha,
> 
> I'm not able to replicate this issue. Have you modified any of the
> configuration files by hand? The three key files in build/conf are
> hob-post.conf, hob-pre.conf, local.conf
> 
> It's possible you've hard-assigned the variable in there.
> 
> If you can provide more information I can try and replicate. A copy of
> the above configuration files would be useful.
> 
> Regards,
> Joshua
> --
> Joshua Lock
>         Yocto Project "Johannes factotum"
>         Intel Open Source Technology Centre
> _______________________________________________
> yocto mailing list
> yocto@yoctoproject.org
> https://lists.yoctoproject.org/listinfo/yocto

-- 
Yi Qingliang
niqingliang@insigma.com.cn
https://niqingliang2003.wordpress.com

[-- Attachment #2: unknown-JY8K6V --]
[-- Type: image/png, Size: 70266 bytes --]

Re: HOB usage

[Joshua Lock]

On 19/12/11 00:47, Ni Qingliang wrote:
> https://niqingliang2003.files.wordpress.com/2011/12/taijitu.png
> I have wrote a GUI tool for internal use, 
> is it possible to implement thus GUI tool for yocto?
> the attachement is the UI.
> 
> every circle represents one package, the arrow between them represents
> the dependency.
> indeed, the dependency relation in this tool is defined by custom config
> file, but I think maybe I can use the relation exported from bitbake, is
> it possible or easily to implement?

In short, yes - it's possible to implement such a tool for Yocto.

BitBake has a dependency viewer GUI already, it uses a set of tables
rather than a graph of nodes - presumably because the graph is *very*
large once you get past a trivial build.

You can play with the depexp by invoking:
bitbake -g -u depexp some-build-target

Internally BitBake generates a data structure of the interdependencies
(the g switch) which by default outputs a graphviz .dot file.
The -u depexp tells BitBake to instead draw the data structure using the
depexp GUI (lib/bb/ui/depexp.py).

Extending this GUI to offer a graph view might be interesting, the
difficulty will be in helping folks navigate the enormous graph...

Regards,
Joshua
-- 
Joshua Lock
        Yocto Project "Johannes factotum"
        Intel Open Source Technology Centre

Re: HOB usage

[Ni Qingliang]

thanks your explanation.

for the navigation problem, maybe we can use nautilus as a reference.
one floating textbox for searching.

I will make further investigate, thanks again.:)

On Tue, 2011-12-20 at 03:27 +0800, Joshua Lock wrote:
> On 19/12/11 00:47, Ni Qingliang wrote:
> > https://niqingliang2003.files.wordpress.com/2011/12/taijitu.png
> > I have wrote a GUI tool for internal use,
> > is it possible to implement thus GUI tool for yocto?
> > the attachement is the UI.
> >
> > every circle represents one package, the arrow between them represents
> > the dependency.
> > indeed, the dependency relation in this tool is defined by custom config
> > file, but I think maybe I can use the relation exported from bitbake, is
> > it possible or easily to implement?
> 
> In short, yes - it's possible to implement such a tool for Yocto.
> 
> BitBake has a dependency viewer GUI already, it uses a set of tables
> rather than a graph of nodes - presumably because the graph is *very*
> large once you get past a trivial build.
> 
> You can play with the depexp by invoking:
> bitbake -g -u depexp some-build-target
> 
> Internally BitBake generates a data structure of the interdependencies
> (the g switch) which by default outputs a graphviz .dot file.
> The -u depexp tells BitBake to instead draw the data structure using the
> depexp GUI (lib/bb/ui/depexp.py).
> 
> Extending this GUI to offer a graph view might be interesting, the
> difficulty will be in helping folks navigate the enormous graph...
> 
> Regards,
> Joshua
> --
> Joshua Lock
>         Yocto Project "Johannes factotum"
>         Intel Open Source Technology Centre

-- 
Yi Qingliang
niqingliang@insigma.com.cn
https://niqingliang2003.wordpress.com