Detecting missing build dependencies

Detecting missing build dependencies

[Ulf Magnusson]

Hello,

If a recipe has a missing build dependency that the sysroot just
happens to contain anyway from an earlier build, then the build will
succeed only to fail later when the sysroot no longer has the build
dependency. We want to avoid that, so we're looking for ways to
automatically check for unspecified build dependencies.

The only method I know of at the moment is to remove or rename tmp/ so
that the build uses a fresh sysroot and then trying to rebuild the
recipe. Is there something nicer? I think I remember reading about a
script for testing for missing build dependencies, but I might be
misremembering.

Cheers,
Ulf

Re: Detecting missing build dependencies

[Martin Jansa]

[-- Attachment #1: Type: text/plain, Size: 970 bytes --]

On Wed, Jan 27, 2016 at 03:45:30PM +0100, Ulf Magnusson wrote:
> Hello,
> 
> If a recipe has a missing build dependency that the sysroot just
> happens to contain anyway from an earlier build, then the build will
> succeed only to fail later when the sysroot no longer has the build
> dependency. We want to avoid that, so we're looking for ways to
> automatically check for unspecified build dependencies.
> 
> The only method I know of at the moment is to remove or rename tmp/ so
> that the build uses a fresh sysroot and then trying to rebuild the
> recipe. Is there something nicer? I think I remember reading about a
> script for testing for missing build dependencies, but I might be
> misremembering.

See openembedded-core/scripts/test-dependencies.sh but it basically
automates rebuilding recipes after removing TMPDIR, but also it detects
autodetected dependencies.

Regards,

-- 
Martin 'JaMa' Jansa     jabber: Martin.Jansa@gmail.com

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 188 bytes --]

Re: Detecting missing build dependencies

[Burton, Ross]

[-- Attachment #1: Type: text/plain, Size: 560 bytes --]

On 27 January 2016 at 14:45, Ulf Magnusson <ulfalizer@gmail.com> wrote:

> The only method I know of at the moment is to remove or rename tmp/ so
> that the build uses a fresh sysroot and then trying to rebuild the
> recipe. Is there something nicer? I think I remember reading about a
> script for testing for missing build dependencies, but I might be
> misremembering.
>

You're thinking of scripts/test-dependencies.sh.

Personally I just use wipe-sysroot (faster than deleting tmp) and
buildhistory-diff to verify build dependencies.

Ross

[-- Attachment #2: Type: text/html, Size: 1035 bytes --]

Re: Detecting missing build dependencies

[Ulf Magnusson]

On Wed, Jan 27, 2016 at 3:59 PM, Martin Jansa <martin.jansa@gmail.com> wrote:
> On 27 January 2016 at 14:45, Ulf Magnusson <ulfalizer@gmail.com> wrote:
>> ...
> See openembedded-core/scripts/test-dependencies.sh but it basically
> automates rebuilding recipes after removing TMPDIR, but also it detects
> autodetected dependencies.
>
> Regards,
>
> --
> Martin 'JaMa' Jansa     jabber: Martin.Jansa@gmail.com

On Wed, Jan 27, 2016 at 4:02 PM, Burton, Ross <ross.burton@intel.com> wrote:
>
> On 27 January 2016 at 14:45, Ulf Magnusson <ulfalizer@gmail.com> wrote:
>> ...
>
> You're thinking of scripts/test-dependencies.sh.
>
> Personally I just use wipe-sysroot (faster than deleting tmp) and
> buildhistory-diff to verify build dependencies.
>
> Ross

Thanks for the tips! I have two questions:

 1) Why does test-dependencies.sh remove TMPDIR instead of just wiping the
    sysroots?

 2) Is there any overhead for subsequent builds from wiping the sysroots?
    Guessing there shouldn't be, but better check.

Thanks,
Ulf

Re: Detecting missing build dependencies

[Burton, Ross]

[-- Attachment #1: Type: text/plain, Size: 535 bytes --]

On 27 January 2016 at 15:29, Ulf Magnusson <ulfalizer@gmail.com> wrote:

>  1) Why does test-dependencies.sh remove TMPDIR instead of just wiping the
>     sysroots?
>

For the thorough testing that test-dependencies does you could argue that
entirely wiping tmpdir ensures that the builds are done from clean.

 2) Is there any overhead for subsequent builds from wiping the sysroots?
>     Guessing there shouldn't be, but better check.
>

Only the overhead of extracting from sstate to repopulate the sysroot.

Ross

[-- Attachment #2: Type: text/html, Size: 1158 bytes --]