Cleaning tmp folder

Cleaning tmp folder

[Shane Dixon]

I've been digging through the bitbake files and I don't see any recipe
for cleaning the tmp folder.  I typically just blow away the entire tmp/
folder and build again, but then I'm spending time rebuilding the native
packages and crosscompiler.

Is there a bitbake recipe for cleaning out all non-native and
non-crosscompiler packages from tmp or am I stuck just starting over
each time?

-- 
Shane Dixon
Linux Engineer
Atmel Corporation
E-mail: shane.dixon@atmel.com

Re: Cleaning tmp folder

[Andrea Adami]

This will change hopefully soon. There are plans to redesign the whole tmpdir.
My first wish is to have pstage out of there, in order to reduce build
time (I'd keep /tmp in RAM).

Regards
Andrea

Re: Cleaning tmp folder

[Denys Dmytriyenko]

On Wed, Mar 18, 2009 at 12:33:58AM +0100, Andrea Adami wrote:
> This will change hopefully soon. There are plans to redesign the whole tmpdir.
> My first wish is to have pstage out of there, in order to reduce build
> time (I'd keep /tmp in RAM).

Ah, I just replied to the original email, but wanted to follow up with you...

As part of Koen's directory restructuring proposal, I suggested to have 
DEPLOY_DIR moved outside of TMPDIR, which was generally accepted (so I guess 
I need to prep a patch for review...)

By default, pstage is located inside DEPLOY_DIR, thus once the above change is 
done, it would be Ok to kill TMPDIR but still use pstage packages, reducing 
the build time.

There maybe some issues though, when packages don't get rebuild even though 
there were changes - mostly because PR is not bumped or because one 
of *_FEATURES variables got changed...

-- 
Denys

Re: Cleaning tmp folder

[Frans Meulenbroeks]

A crude temp solution could be to just remove the stamps of all
non-native, non-cross packages.

Also if you only want to reclaim space I guess it is ok to remove the
work subdir (or at least in my case (beagleboard) the work/arm* dir)
If this is not right I guess someone will correct me :-)

Btw: it would also be nice to have a command to purge the tmp dir, so
if X build for r0 is there and X build for r1 is there the r0 version
is nuked. Never got to writing something for that though :-)

Frans.

Re: Cleaning tmp folder

[Denys Dmytriyenko]

On Wed, Mar 18, 2009 at 09:21:53AM +0100, Frans Meulenbroeks wrote:
> A crude temp solution could be to just remove the stamps of all
> non-native, non-cross packages.
> 
> Also if you only want to reclaim space I guess it is ok to remove the
> work subdir (or at least in my case (beagleboard) the work/arm* dir)
> If this is not right I guess someone will correct me :-)
> 
> Btw: it would also be nice to have a command to purge the tmp dir, so
> if X build for r0 is there and X build for r1 is there the r0 version
> is nuked. Never got to writing something for that though :-)

Speaking of purging tmp/work - you might want to look for
INHERIT += "rm_work", which cleans work directory for every package, after 
it's built and staged/packaged.

-- 
Denys

Re: Cleaning tmp folder

[Frans Meulenbroeks]

2009/3/18 Denys Dmytriyenko <denis@denix.org>:
> On Wed, Mar 18, 2009 at 09:21:53AM +0100, Frans Meulenbroeks wrote:
>> A crude temp solution could be to just remove the stamps of all
>> non-native, non-cross packages.
>>
>> Also if you only want to reclaim space I guess it is ok to remove the
>> work subdir (or at least in my case (beagleboard) the work/arm* dir)
>> If this is not right I guess someone will correct me :-)
>>
>> Btw: it would also be nice to have a command to purge the tmp dir, so
>> if X build for r0 is there and X build for r1 is there the r0 version
>> is nuked. Never got to writing something for that though :-)
>
> Speaking of purging tmp/work - you might want to look for
> INHERIT += "rm_work", which cleans work directory for every package, after
> it's built and staged/packaged.
>

Nice, but is there a way to overrule it on the command line.
Generally I'd like to have this, but when working on a new package I
typically like to have a look at the work dir too before committing
the new recipe.

FM

Re: Cleaning tmp folder

[Denys Dmytriyenko]

On Tue, Mar 17, 2009 at 10:20:36PM +0000, Shane Dixon wrote:
> I've been digging through the bitbake files and I don't see any recipe
> for cleaning the tmp folder.  I typically just blow away the entire tmp/
> folder and build again, but then I'm spending time rebuilding the native
> packages and crosscompiler.
> 
> Is there a bitbake recipe for cleaning out all non-native and
> non-crosscompiler packages from tmp or am I stuck just starting over
> each time?

If you have packaged staging enabled (see INHERIT += "packaged-staging"), you 
can try setting DEPLOY_DIR_PSTAGE (or entire DEPLOY_DIR) outside of TMPDIR.

Then you can safely kill TMPDIR and 
${DEPLOY_DIR_PSTAGE}/${DISTRO}${PSTAGE_EXTRAPATH} while keeping 
${DEPLOY_DIR_PSTAGE}/${DISTRO}${PSTAGE_EXTRAPATH}${TMPDIR//\//-}

That would _reuse_ staging packages for native, cross and sdk packages and 
_rebuild_ the target ones.

The above directories in my case are:
[1] /home/oe/deploy/pstage/angstromglibc
[2] /home/oe/deploy/pstage/angstromglibc-home-oe-tmp

Kill the [1] and keep the [2] :)

Hope this helps.

-- 
Denys

Re: Cleaning tmp folder

[Michael 'Mickey' Lauer]

On Wednesday 18 March 2009 01:06:00 Denys Dmytriyenko wrote:
> On Tue, Mar 17, 2009 at 10:20:36PM +0000, Shane Dixon wrote:
> > I've been digging through the bitbake files and I don't see any recipe
> > for cleaning the tmp folder.  I typically just blow away the entire tmp/
> > folder and build again, but then I'm spending time rebuilding the native
> > packages and crosscompiler.
> >
> > Is there a bitbake recipe for cleaning out all non-native and
> > non-crosscompiler packages from tmp or am I stuck just starting over
> > each time?
>
> If you have packaged staging enabled (see INHERIT += "packaged-staging"),
> you can try setting DEPLOY_DIR_PSTAGE (or entire DEPLOY_DIR) outside of
> TMPDIR.

Note that this doesn't work atm. since DEPLOY_DIR is not using a weak 
assignment in bitbake.conf -- something which I'm changing as we speak.

-- 
:M:

Re: Cleaning tmp folder

[Denys Dmytriyenko]

On Thu, Mar 19, 2009 at 11:01:08AM +0100, Michael 'Mickey' Lauer wrote:
> On Wednesday 18 March 2009 01:06:00 Denys Dmytriyenko wrote:
> > On Tue, Mar 17, 2009 at 10:20:36PM +0000, Shane Dixon wrote:
> > > I've been digging through the bitbake files and I don't see any recipe
> > > for cleaning the tmp folder.  I typically just blow away the entire tmp/
> > > folder and build again, but then I'm spending time rebuilding the native
> > > packages and crosscompiler.
> > >
> > > Is there a bitbake recipe for cleaning out all non-native and
> > > non-crosscompiler packages from tmp or am I stuck just starting over
> > > each time?
> >
> > If you have packaged staging enabled (see INHERIT += "packaged-staging"),
> > you can try setting DEPLOY_DIR_PSTAGE (or entire DEPLOY_DIR) outside of
> > TMPDIR.
> 
> Note that this doesn't work atm. since DEPLOY_DIR is not using a weak 
> assignment in bitbake.conf -- something which I'm changing as we speak.

Correct, DEPLOY_DIR is not a weak assignment. But I believe DEPLOY_DIR_PSTAGE 
is. Also, it can be "fixed" locally in the overlay.

-- 
Denys