how can i ask to keep all the generated "nativesdk" rpms?

how can i ask to keep all the generated "nativesdk" rpms?

[Robert P. J. Day]

  not sure how dumb a question this is, but as i was doing a basic OE
build, i saw the growing number of "nativesdk" rpms piling up under
tmp/deploy/rpm/x86_64_linux, and wanted to examine a couple of them
later, but after the sysroot was (i assume) populated with all of
these rpms, that entire directory was deleted.

  is there a switch to preserve that directory? thanks.

rday

-- 

========================================================================
Robert P. J. Day                                 Ottawa, Ontario, CANADA
                        http://crashcourse.ca

Twitter:                                       http://twitter.com/rpjday
LinkedIn:                               http://ca.linkedin.com/in/rpjday
========================================================================

Re: how can i ask to keep all the generated "nativesdk" rpms?

[Robert P. J. Day]

On Wed, 19 Oct 2016, Robert P. J. Day wrote:

>
>   not sure how dumb a question this is, but as i was doing a basic OE
> build, i saw the growing number of "nativesdk" rpms piling up under
> tmp/deploy/rpm/x86_64_linux, and wanted to examine a couple of them
> later, but after the sysroot was (i assume) populated with all of
> these rpms, that entire directory was deleted.
>
>   is there a switch to preserve that directory? thanks.

  oh, wait, i think i found it:

SDKIMAGE_FEATURES += "package-management"

does that look right?

rday

-- 

========================================================================
Robert P. J. Day                                 Ottawa, Ontario, CANADA
                        http://crashcourse.ca

Twitter:                                       http://twitter.com/rpjday
LinkedIn:                               http://ca.linkedin.com/in/rpjday
========================================================================

Re: how can i ask to keep all the generated "nativesdk" rpms?

[Paul Eggleton]

On Wed, 19 Oct 2016 11:27:05 Robert P. J. Day wrote:
> On Wed, 19 Oct 2016, Robert P. J. Day wrote:
> >   not sure how dumb a question this is, but as i was doing a basic OE
> > 
> > build, i saw the growing number of "nativesdk" rpms piling up under
> > tmp/deploy/rpm/x86_64_linux, and wanted to examine a couple of them
> > later, but after the sysroot was (i assume) populated with all of
> > these rpms, that entire directory was deleted.
> > 
> >   is there a switch to preserve that directory? thanks.
> 
>   oh, wait, i think i found it:
> 
> SDKIMAGE_FEATURES += "package-management"
> 
> does that look right?

No, it doesn't. That's for turning on package management database in the SDK, 
which is not quite the same thing. The fact that those rpms are disappearing 
is a separate issue.

Are you using rm_work?

Cheers,
Paul

-- 

Paul Eggleton
Intel Open Source Technology Centre

Re: how can i ask to keep all the generated "nativesdk" rpms?

[Robert P. J. Day]

On Thu, 20 Oct 2016, Paul Eggleton wrote:

> On Wed, 19 Oct 2016 11:27:05 Robert P. J. Day wrote:
> > On Wed, 19 Oct 2016, Robert P. J. Day wrote:
> > >   not sure how dumb a question this is, but as i was doing a basic OE
> > >
> > > build, i saw the growing number of "nativesdk" rpms piling up under
> > > tmp/deploy/rpm/x86_64_linux, and wanted to examine a couple of them
> > > later, but after the sysroot was (i assume) populated with all of
> > > these rpms, that entire directory was deleted.
> > >
> > >   is there a switch to preserve that directory? thanks.
> >
> >   oh, wait, i think i found it:
> >
> > SDKIMAGE_FEATURES += "package-management"
> >
> > does that look right?
>
> No, it doesn't. That's for turning on package management database in the SDK,
> which is not quite the same thing. The fact that those rpms are disappearing
> is a separate issue.
>
> Are you using rm_work?

  no. and are you sure you're reading the above correctly? i'm not
saying

  IMAGE_FEATURES += "package-management"

i was reading this:

https://patchwork.openembedded.org/patch/120705/

but perhaps i'm just misinterpreting what i'm reading.

rday

-- 

========================================================================
Robert P. J. Day                                 Ottawa, Ontario, CANADA
                        http://crashcourse.ca

Twitter:                                       http://twitter.com/rpjday
LinkedIn:                               http://ca.linkedin.com/in/rpjday
========================================================================

Re: how can i ask to keep all the generated "nativesdk" rpms?

[Paul Eggleton]

On Wed, 19 Oct 2016 15:32:25 Robert P. J. Day wrote:
> On Thu, 20 Oct 2016, Paul Eggleton wrote:
> > On Wed, 19 Oct 2016 11:27:05 Robert P. J. Day wrote:
> > > On Wed, 19 Oct 2016, Robert P. J. Day wrote:
> > > >   not sure how dumb a question this is, but as i was doing a basic OE
> > > > 
> > > > build, i saw the growing number of "nativesdk" rpms piling up under
> > > > tmp/deploy/rpm/x86_64_linux, and wanted to examine a couple of them
> > > > later, but after the sysroot was (i assume) populated with all of
> > > > these rpms, that entire directory was deleted.
> > > > 
> > > >   is there a switch to preserve that directory? thanks.
> > >   
> > >   oh, wait, i think i found it:
> > > SDKIMAGE_FEATURES += "package-management"
> > > 
> > > does that look right?
> > 
> > No, it doesn't. That's for turning on package management database in the
> > SDK, which is not quite the same thing. The fact that those rpms are
> > disappearing is a separate issue.
> > 
> > Are you using rm_work?
> 
>   no. and are you sure you're reading the above correctly? i'm not
> saying
> 
>   IMAGE_FEATURES += "package-management"

Yep, I understood.
 
> i was reading this:
> 
> https://patchwork.openembedded.org/patch/120705/
> 
> but perhaps i'm just misinterpreting what i'm reading.

Right - that patch makes the preservation of the package management database 
(what it refers to as the "packaging data") conditional. That code does 
nothing with the packages themselves.

Cheers,
Paul

-- 

Paul Eggleton
Intel Open Source Technology Centre

Re: how can i ask to keep all the generated "nativesdk" rpms?

[Robert P. J. Day]

On Thu, 20 Oct 2016, Paul Eggleton wrote:

> On Wed, 19 Oct 2016 15:32:25 Robert P. J. Day wrote:
> > On Thu, 20 Oct 2016, Paul Eggleton wrote:
> > > On Wed, 19 Oct 2016 11:27:05 Robert P. J. Day wrote:
> > > > On Wed, 19 Oct 2016, Robert P. J. Day wrote:
> > > > >   not sure how dumb a question this is, but as i was doing a basic OE
> > > > >
> > > > > build, i saw the growing number of "nativesdk" rpms piling up under
> > > > > tmp/deploy/rpm/x86_64_linux, and wanted to examine a couple of them
> > > > > later, but after the sysroot was (i assume) populated with all of
> > > > > these rpms, that entire directory was deleted.
> > > > >
> > > > >   is there a switch to preserve that directory? thanks.
> > > >
> > > >   oh, wait, i think i found it:
> > > > SDKIMAGE_FEATURES += "package-management"
> > > >
> > > > does that look right?
> > >
> > > No, it doesn't. That's for turning on package management database in the
> > > SDK, which is not quite the same thing. The fact that those rpms are
> > > disappearing is a separate issue.
> > >
> > > Are you using rm_work?
> >
> >   no. and are you sure you're reading the above correctly? i'm not
> > saying
> >
> >   IMAGE_FEATURES += "package-management"
>
> Yep, I understood.
>
> > i was reading this:
> >
> > https://patchwork.openembedded.org/patch/120705/
> >
> > but perhaps i'm just misinterpreting what i'm reading.
>
> Right - that patch makes the preservation of the package management database
> (what it refers to as the "packaging data") conditional. That code does
> nothing with the packages themselves.

  i'm about to create a new project directory as a test ... is there
any configuration i should do to try to preserve all those nativesdk
rpm files?

rday

-- 

========================================================================
Robert P. J. Day                                 Ottawa, Ontario, CANADA
                        http://crashcourse.ca

Twitter:                                       http://twitter.com/rpjday
LinkedIn:                               http://ca.linkedin.com/in/rpjday
========================================================================

Re: how can i ask to keep all the generated "nativesdk" rpms?

[Paul Eggleton]

On Wed, 19 Oct 2016 15:42:27 Robert P. J. Day wrote:
> On Thu, 20 Oct 2016, Paul Eggleton wrote:
> > On Wed, 19 Oct 2016 15:32:25 Robert P. J. Day wrote:
> > > On Thu, 20 Oct 2016, Paul Eggleton wrote:
> > > > On Wed, 19 Oct 2016 11:27:05 Robert P. J. Day wrote:
> > > > > On Wed, 19 Oct 2016, Robert P. J. Day wrote:
> > > > > >   not sure how dumb a question this is, but as i was doing a basic
> > > > > >   OE
> > > > > > 
> > > > > > build, i saw the growing number of "nativesdk" rpms piling up
> > > > > > under
> > > > > > tmp/deploy/rpm/x86_64_linux, and wanted to examine a couple of
> > > > > > them
> > > > > > later, but after the sysroot was (i assume) populated with all of
> > > > > > these rpms, that entire directory was deleted.
> > > > > > 
> > > > > >   is there a switch to preserve that directory? thanks.
> > > > >   
> > > > >   oh, wait, i think i found it:
> > > > > SDKIMAGE_FEATURES += "package-management"
> > > > > 
> > > > > does that look right?
> > > > 
> > > > No, it doesn't. That's for turning on package management database in
> > > > the
> > > > SDK, which is not quite the same thing. The fact that those rpms are
> > > > disappearing is a separate issue.
> > > > 
> > > > Are you using rm_work?
> > > > 
> > >   no. and are you sure you're reading the above correctly? i'm not
> > > 
> > > saying
> > > 
> > >   IMAGE_FEATURES += "package-management"
> > 
> > Yep, I understood.
> > 
> > > i was reading this:
> > > 
> > > https://patchwork.openembedded.org/patch/120705/
> > > 
> > > but perhaps i'm just misinterpreting what i'm reading.
> > 
> > Right - that patch makes the preservation of the package management
> > database (what it refers to as the "packaging data") conditional. That
> > code does nothing with the packages themselves.
> 
>   i'm about to create a new project directory as a test ... is there
> any configuration i should do to try to preserve all those nativesdk
> rpm files?

I am not aware of any configuration that should control the presence or 
absence of those files. As far as I'm concerned, if they are disappearing and 
you're not doing anything to delete them, that's a bug.

Cheers,
Paul

-- 

Paul Eggleton
Intel Open Source Technology Centre

Re: how can i ask to keep all the generated "nativesdk" rpms?

[Robert P. J. Day]

On Thu, 20 Oct 2016, Paul Eggleton wrote:

> On Wed, 19 Oct 2016 15:42:27 Robert P. J. Day wrote:
> > On Thu, 20 Oct 2016, Paul Eggleton wrote:
> > > On Wed, 19 Oct 2016 15:32:25 Robert P. J. Day wrote:
> > > > On Thu, 20 Oct 2016, Paul Eggleton wrote:
> > > > > On Wed, 19 Oct 2016 11:27:05 Robert P. J. Day wrote:
> > > > > > On Wed, 19 Oct 2016, Robert P. J. Day wrote:
> > > > > > >   not sure how dumb a question this is, but as i was doing a basic
> > > > > > >   OE
> > > > > > >
> > > > > > > build, i saw the growing number of "nativesdk" rpms piling up
> > > > > > > under
> > > > > > > tmp/deploy/rpm/x86_64_linux, and wanted to examine a couple of
> > > > > > > them
> > > > > > > later, but after the sysroot was (i assume) populated with all of
> > > > > > > these rpms, that entire directory was deleted.
> > > > > > >
> > > > > > >   is there a switch to preserve that directory? thanks.
> > > > > >
> > > > > >   oh, wait, i think i found it:
> > > > > > SDKIMAGE_FEATURES += "package-management"
> > > > > >
> > > > > > does that look right?
> > > > >
> > > > > No, it doesn't. That's for turning on package management database in
> > > > > the
> > > > > SDK, which is not quite the same thing. The fact that those rpms are
> > > > > disappearing is a separate issue.
> > > > >
> > > > > Are you using rm_work?
> > > > >
> > > >   no. and are you sure you're reading the above correctly? i'm not
> > > >
> > > > saying
> > > >
> > > >   IMAGE_FEATURES += "package-management"
> > >
> > > Yep, I understood.
> > >
> > > > i was reading this:
> > > >
> > > > https://patchwork.openembedded.org/patch/120705/
> > > >
> > > > but perhaps i'm just misinterpreting what i'm reading.
> > >
> > > Right - that patch makes the preservation of the package management
> > > database (what it refers to as the "packaging data") conditional. That
> > > code does nothing with the packages themselves.
> >
> >   i'm about to create a new project directory as a test ... is there
> > any configuration i should do to try to preserve all those nativesdk
> > rpm files?
>
> I am not aware of any configuration that should control the presence
> or absence of those files. As far as I'm concerned, if they are
> disappearing and you're not doing anything to delete them, that's a
> bug.

  so, i'm home and on a different system about to do a build ...
refresh my memory, where are all those nativesdk rpms supposed to show
up? if memory serves, they were under tmp/deploy/rpm/x86_64_linux.
anything i should set before i attempt a build?

rday

-- 

========================================================================
Robert P. J. Day                                 Ottawa, Ontario, CANADA
                        http://crashcourse.ca

Twitter:                                       http://twitter.com/rpjday
LinkedIn:                               http://ca.linkedin.com/in/rpjday
========================================================================

Re: how can i ask to keep all the generated "nativesdk" rpms?

[Richard Purdie]

On Wed, 2016-10-19 at 17:34 -0400, Robert P. J. Day wrote:
>   so, i'm home and on a different system about to do a build ...
> refresh my memory, where are all those nativesdk rpms supposed to
> show
> up? if memory serves, they were under tmp/deploy/rpm/x86_64_linux.
> anything i should set before i attempt a build?

For SDKMACHINE="x86_64", the would appear in:

tmp/deploy/rpm/x86_64_nativesdk/

and SDKMACHINE="i686" in:

tmp/deploy/rpm/i686_nativesdk/

Switching SDKMACHINE might have been a trigger for one set
disappearing, particularly on older versions. Which version was this?
There were some bugs fixed in master/morty related to it.

Cheers,

Richard

Re: how can i ask to keep all the generated "nativesdk" rpms?

[Robert P. J. Day]

[-- Attachment #1: Type: text/plain, Size: 1385 bytes --]

On Wed, 19 Oct 2016, Richard Purdie wrote:

> On Wed, 2016-10-19 at 17:34 -0400, Robert P. J. Day wrote:
> >   so, i'm home and on a different system about to do a build ...
> > refresh my memory, where are all those nativesdk rpms supposed to
> > show
> > up? if memory serves, they were under tmp/deploy/rpm/x86_64_linux.
> > anything i should set before i attempt a build?
>
> For SDKMACHINE="x86_64", the would appear in:
>
> tmp/deploy/rpm/x86_64_nativesdk/
>
> and SDKMACHINE="i686" in:
>
> tmp/deploy/rpm/i686_nativesdk/
>
> Switching SDKMACHINE might have been a trigger for one set
> disappearing, particularly on older versions. Which version was this?
> There were some bugs fixed in master/morty related to it.

  i'm building with an up-to-date checkout of poky, and am building a
core-image-minimal for mpc8315. i know i saw all those nativesdk rpms
earlier today -- do you want me to run a test of some kind?

rday

-- 

========================================================================
Robert P. J. Day                                 Ottawa, Ontario, CANADA
                        http://crashcourse.ca

Twitter:                                       http://twitter.com/rpjday
LinkedIn:                               http://ca.linkedin.com/in/rpjday
========================================================================

Re: how can i ask to keep all the generated "nativesdk" rpms?

[Robert P. J. Day]

[-- Attachment #1: Type: text/plain, Size: 2028 bytes --]

On Wed, 19 Oct 2016, Richard Purdie wrote:

> On Wed, 2016-10-19 at 17:34 -0400, Robert P. J. Day wrote:
> >   so, i'm home and on a different system about to do a build ...
> > refresh my memory, where are all those nativesdk rpms supposed to
> > show up? if memory serves, they were under
> > tmp/deploy/rpm/x86_64_linux. anything i should set before i
> > attempt a build?
>
> For SDKMACHINE="x86_64", the would appear in:
>
> tmp/deploy/rpm/x86_64_nativesdk/
>
> and SDKMACHINE="i686" in:
>
> tmp/deploy/rpm/i686_nativesdk/
>
> Switching SDKMACHINE might have been a trigger for one set
> disappearing, particularly on older versions. Which version was
> this? There were some bugs fixed in master/morty related to it.

  just for fun, i'm going to do a fresh build right now, involving:

* fresh "git pull" of poky
* MACHINE=mpc8315e-rdb
* bitbake core-image-minimal

  current state of poky (master branch)

$ git show
commit ef627ab364d52fe19994c94c1a78fbe21620a32c
Author: Joshua Lock <joshua.g.lock@intel.com>
Date:   Wed Oct 12 21:46:42 2016 +0100

    local.conf.sample.extended: remove RM_OLD_IMAGE
    ... etc ...

  that's it, no other customization other than selecting MACHINE and
pointing build at my local source mirror. and away we go ... and the
end result is, under tmp/deploy/rpm/:

$ ls -l
total 328
drwxr-xr-x. 2 rpjday rpjday   4096 Oct 20 05:54 all
drwxr-xr-x. 2 rpjday rpjday  40960 Oct 20 06:06 mpc8315e_rdb
drwxr-xr-x. 2 rpjday rpjday 286720 Oct 20 06:09 ppce300c3
$

should i have expected a nativesdk directory?

rday

-- 

========================================================================
Robert P. J. Day                                 Ottawa, Ontario, CANADA
                        http://crashcourse.ca

Twitter:                                       http://twitter.com/rpjday
LinkedIn:                               http://ca.linkedin.com/in/rpjday
========================================================================

Re: how can i ask to keep all the generated "nativesdk" rpms?

[Richard Purdie]

On Thu, 2016-10-20 at 06:31 -0400, Robert P. J. Day wrote:
>   just for fun, i'm going to do a fresh build right now, involving:
> 
> * fresh "git pull" of poky
> * MACHINE=mpc8315e-rdb
> * bitbake core-image-minimal
> 
[...]
> $ ls -l
> total 328
> drwxr-xr-x. 2 rpjday rpjday   4096 Oct 20 05:54 all
> drwxr-xr-x. 2 rpjday rpjday  40960 Oct 20 06:06 mpc8315e_rdb
> drwxr-xr-x. 2 rpjday rpjday 286720 Oct 20 06:09 ppce300c3
> $
> 
> should i have expected a nativesdk directory?

No, since you didn't build anything that uses nativesdk. Examples that
do would be:

bitbake buildtools-tarball
bitbake core-image-minimal -c populate_sdk

Cheers,

Richard

Re: how can i ask to keep all the generated "nativesdk" rpms?

[Robert P. J. Day]

[-- Attachment #1: Type: text/plain, Size: 1224 bytes --]

On Thu, 20 Oct 2016, Richard Purdie wrote:

> On Thu, 2016-10-20 at 06:31 -0400, Robert P. J. Day wrote:
> >   just for fun, i'm going to do a fresh build right now, involving:
> >
> > * fresh "git pull" of poky
> > * MACHINE=mpc8315e-rdb
> > * bitbake core-image-minimal
> >
> [...]
> > $ ls -l
> > total 328
> > drwxr-xr-x. 2 rpjday rpjday   4096 Oct 20 05:54 all
> > drwxr-xr-x. 2 rpjday rpjday  40960 Oct 20 06:06 mpc8315e_rdb
> > drwxr-xr-x. 2 rpjday rpjday 286720 Oct 20 06:09 ppce300c3
> > $
> >
> > should i have expected a nativesdk directory?
>
> No, since you didn't build anything that uses nativesdk. Examples that
> do would be:
>
> bitbake buildtools-tarball
> bitbake core-image-minimal -c populate_sdk

  ah, now it becomes clear, thanks.

rday

-- 

========================================================================
Robert P. J. Day                                 Ottawa, Ontario, CANADA
                        http://crashcourse.ca

Twitter:                                       http://twitter.com/rpjday
LinkedIn:                               http://ca.linkedin.com/in/rpjday
========================================================================

Re: how can i ask to keep all the generated "nativesdk" rpms?

[Burton, Ross]

[-- Attachment #1: Type: text/plain, Size: 178 bytes --]

On 20 October 2016 at 11:31, Robert P. J. Day <rpjday@crashcourse.ca> wrote:

> should i have expected a nativesdk directory?
>

Not if you didn't build a SDK, no.

Ross

[-- Attachment #2: Type: text/html, Size: 590 bytes --]

Re: how can i ask to keep all the generated "nativesdk" rpms?

[Richard Purdie]

On Thu, 2016-10-20 at 08:52 +1300, Paul Eggleton wrote:
> On Wed, 19 Oct 2016 15:42:27 Robert P. J. Day wrote:
> > 
> > On Thu, 20 Oct 2016, Paul Eggleton wrote:
> > > 
> > > On Wed, 19 Oct 2016 15:32:25 Robert P. J. Day wrote:
> > > > 
> > > > i was reading this:
> > > > 
> > > > https://patchwork.openembedded.org/patch/120705/
> > > > 
> > > > but perhaps i'm just misinterpreting what i'm reading.
> > > Right - that patch makes the preservation of the package
> > > management
> > > database (what it refers to as the "packaging data") conditional.
> > > That
> > > code does nothing with the packages themselves.
> >   i'm about to create a new project directory as a test ... is
> > there
> > any configuration i should do to try to preserve all those
> > nativesdk
> > rpm files?
> I am not aware of any configuration that should control the presence
> or 
> absence of those files. As far as I'm concerned, if they are
> disappearing and 
> you're not doing anything to delete them, that's a bug.

I have a suspicion that this is the sstate code removing them because
it decided that they were stale for some reason. Changing SDKMACHINE
could conceivably do that (but probably shouldn't?), as could updating
the metadata and the system deciding the data there was stale and
"unreachable" from the new metadata.

So I can imagine it happening but am not sure what the trigger would
have been. If they were stale/unreachable, it might have been correct
to remove them.

Cheers,

Richard