* Broken dependency behavior in master?
@ 2011-04-01 0:23 Scott Garman
2011-04-01 11:31 ` Richard Purdie
0 siblings, 1 reply; 7+ messages in thread
From: Scott Garman @ 2011-04-01 0:23 UTC (permalink / raw)
To: Paul Eggleton; +Cc: poky@yoctoproject.org
Hi Paul,
Beth pointed me to a failure occurring on the autobuilder when building
docbook-sgml-dtd-3.1-native using the latest master:
http://autobuilder.pokylinux.org:8010/builders/nightly-external/builds/88/steps/shell_3/logs/stdio
I am able to reproduce it on my development system. The problem occurs
because sgml-common-native is not being fully built before
docbook-sgml-dtd-3.1-native, even though it is listed in DEPENDS. I see
log files only up to the do_configure step for sgml-common-native.
This makes me think something could be seriously broken in master when
it comes to handling build dependencies.
I've verified that sgml-common-native is showing up as a build
dependency properly in the dependency explorer.
...ok, looking at the recent commits in master, this one raised my
suspicion:
http://git.pokylinux.org/cgit/cgit.cgi/poky/commit/?id=b4268c08c350a7928a0b1a041b04ffe5a44e77b4
I just tried reverting that and doing a new build, and the build
completed successfully. Could you take a closer look at it?
Thanks,
Scott
--
Scott Garman
Embedded Linux Engineer - Yocto Project
Intel Open Source Technology Center
^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: Broken dependency behavior in master?
2011-04-01 0:23 Broken dependency behavior in master? Scott Garman
@ 2011-04-01 11:31 ` Richard Purdie
2011-04-01 15:23 ` Scott Garman
0 siblings, 1 reply; 7+ messages in thread
From: Richard Purdie @ 2011-04-01 11:31 UTC (permalink / raw)
To: Scott Garman; +Cc: Paul Eggleton, poky@yoctoproject.org
On Thu, 2011-03-31 at 17:23 -0700, Scott Garman wrote:
> Beth pointed me to a failure occurring on the autobuilder when building
> docbook-sgml-dtd-3.1-native using the latest master:
>
> http://autobuilder.pokylinux.org:8010/builders/nightly-external/builds/88/steps/shell_3/logs/stdio
>
> I am able to reproduce it on my development system. The problem occurs
> because sgml-common-native is not being fully built before
> docbook-sgml-dtd-3.1-native, even though it is listed in DEPENDS. I see
> log files only up to the do_configure step for sgml-common-native.
Looking at the log above and keeping the order but removing some lines:
NOTE: package sgml-common-native-0.6.3-r0: task do_configure: Succeeded
NOTE: Running task 1263 of 7259 (ID: 7236, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/sgml-common/sgml-common-native_0.6.3.bb, do_compile)
NOTE: package sgml-common-native-0.6.3-r0: task do_compile: Started
NOTE: package sgml-common-native-0.6.3-r0: task do_compile: Succeeded
NOTE: Running task 1269 of 7259 (ID: 7231, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/sgml-common/sgml-common-native_0.6.3.bb, do_install)
NOTE: package sgml-common-native-0.6.3-r0: task do_install: Started
NOTE: package sgml-common-native-0.6.3-r0: task do_install: Succeeded
NOTE: Running task 1271 of 7259 (ID: 7232, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/sgml-common/sgml-common-native_0.6.3.bb, do_populate_sysroot)
NOTE: Running noexec task 1272 of 7259 (ID: 7238, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/sgml-common/sgml-common-native_0.6.3.bb, do_package)
NOTE: Running noexec task 1273 of 7259 (ID: 7237, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/sgml-common/sgml-common-native_0.6.3.bb, do_package_write)
NOTE: package sgml-common-native-0.6.3-r0: task do_populate_sysroot: Started
NOTE: package sgml-common-native-0.6.3-r0: task do_populate_sysroot: Succeeded
NOTE: Running noexec task 1287 of 7259 (ID: 7234, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/sgml-common/sgml-common-native_0.6.3.bb, do_build)
NOTE: Running task 1288 of 7259 (ID: 7239, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/sgml-common/sgml-common-native_0.6.3.bb, do_rm_work)
NOTE: package libxft-1_2.2.0-r0: task do_populate_lic: Succeeded
NOTE: package sgml-common-native-0.6.3-r0: task do_rm_work: Started
NOTE: package sgml-common-native-0.6.3-r0: task do_rm_work: Succeeded
Then later we see:
NOTE: Running task 1370 of 7259 (ID: 6965, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/docbook-sgml-dtd/docbook-sgml-dtd-3.1-native.bb, do_configure)
NOTE: package opensp-native-1.5-r0: task do_populate_lic: Started
NOTE: package docbook-sgml-dtd-3.1-native-1.0-r1.0: task do_configure: Started
[...]
NOTE: Running task 1375 of 7259 (ID: 5055, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/perl/libxml-parser-perl-native_2.36.bb, do_populate_sysroot)
NOTE: package docbook-sgml-dtd-3.1-native-1.0-r1.0: task do_populate_lic: Started
WARNING: docbook-sgml-dtd-3.1-native: Something went wrong with copying: OASIS to /srv/home/pokybuild/poky-slave/nightly-external/build/meta/files/common-licenses
WARNING: This could be either because we do not have a generic for this license or the LICENSE field is incorrect
NOTE: package docbook-dsssl-stylesheets-native-1.79-r2: task do_configure: Started
NOTE: package docbook-sgml-dtd-3.1-native-1.0-r1.0: task do_compile: Started
ERROR: Function 'docbook_sgml_dtd_sstate_postinst' failed (see /srv/home/pokybuild/poky-slave/nightly-external/build/build/tmp/work/x86_64-linux/docbook-sgml-dtd-3.1-native-1.0-r1.0/temp/log.do_populate_lic.14913 for further information)
NOTE: package docbook-dsssl-stylesheets-native-1.79-r2: task do_configure: Succeeded
NOTE: Running noexec task 1376 of 7259 (ID: 5061, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/perl/libxml-parser-perl-native_2.36.bb, do_package)
NOTE: Running noexec task 1377 of 7259 (ID: 5060, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/perl/libxml-parser-perl-native_2.36.bb, do_package_write)
NOTE: Running task 1378 of 7259 (ID: 6951, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/docbook-dsssl-stylesheets/docbook-dsssl-stylesheets-native_1.79.bb, do_compile)
ERROR: Logfile of failure stored in: /srv/home/pokybuild/poky-slave/nightly-external/build/build/tmp/work/x86_64-linux/docbook-sgml-dtd-3.1-native-1.0-r1.0/temp/log.do_populate_lic.14913
Log data follows:
| WARNING: docbook-sgml-dtd-3.1-native: Something went wrong with copying: OASIS to /srv/home/pokybuild/poky-slave/nightly-external/build/meta/files/common-licenses
| WARNING: This could be either because we do not have a generic for this license or the LICENSE field is incorrect
| ERROR: Function 'docbook_sgml_dtd_sstate_postinst' failed (see /srv/home/pokybuild/poky-slave/nightly-external/build/build/tmp/work/x86_64-linux/docbook-sgml-dtd-3.1-native-1.0-r1.0/temp/log.do_populate_lic.14913 for further information)
| install-catalog: "/srv/home/pokybuild/poky-slave/nightly-external/build/build/tmp/sysroots/x86_64-linux/etc/sgml/sgml-docbook-dtd-3.1.cat" does not exist or is empty.
NOTE: package docbook-sgml-dtd-3.1-native-1.0-r1.0: task do_populate_lic: Failed
ERROR: Task 6970 (/srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/docbook-sgml-dtd/docbook-sgml-dtd-3.1-native.bb, do_populate_lic) failed with exit code '1'
NOTE: Running task 1379 of 7259 (ID: 6935, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/sgmlspl/sgmlspl-native_1.03ii.bb, do_configure)
NOTE: package docbook-sgml-dtd-3.1-native-1.0-r1.0: task do_compile: Succeeded
NOTE: Running task 1380 of 7259 (ID: 6961, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/docbook-sgml-dtd/docbook-sgml-dtd-3.1-native.bb, do_install)
NOTE: package docbook-dsssl-stylesheets-native-1.79-r2: task do_populate_lic: Started
WARNING: docbook-dsssl-stylesheets-native: Something went wrong with copying: DSSSL to /srv/home/pokybuild/poky-slave/nightly-external/build/meta/files/common-licenses
WARNING: This could be either because we do not have a generic for this license or the LICENSE field is incorrect
NOTE: package libxml-parser-perl-native-2.36-r1: task do_populate_sysroot: Started
ERROR: Function 'docbook_dsssl_stylesheets_sstate_postinst' failed (see /srv/home/pokybuild/poky-slave/nightly-external/build/build/tmp/work/x86_64-linux/docbook-dsssl-stylesheets-native-1.79-r2/temp/log.do_populate_lic.15063 for further information)
ERROR: Logfile of failure stored in: /srv/home/pokybuild/poky-slave/nightly-external/build/build/tmp/work/x86_64-linux/docbook-dsssl-stylesheets-native-1.79-r2/temp/log.do_populate_lic.15063
Log data follows:
| WARNING: docbook-dsssl-stylesheets-native: Something went wrong with copying: DSSSL to /srv/home/pokybuild/poky-slave/nightly-external/build/meta/files/common-licenses
| WARNING: This could be either because we do not have a generic for this license or the LICENSE field is incorrect
| ERROR: Function 'docbook_dsssl_stylesheets_sstate_postinst' failed (see /srv/home/pokybuild/poky-slave/nightly-external/build/build/tmp/work/x86_64-linux/docbook-dsssl-stylesheets-native-1.79-r2/temp/log.do_populate_lic.15063 for further information)
| install-catalog: "/srv/home/pokybuild/poky-slave/nightly-external/build/build/tmp/sysroots/x86_64-linux/etc/sgml/dsssl-docbook-stylesheets.cat" does not exist or is empty.
NOTE: package docbook-dsssl-stylesheets-native-1.79-r2: task do_populate_lic: Failed
ERROR: Task 6955 (/srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/docbook-dsssl-stylesheets/docbook-dsssl-stylesheets-native_1.79.bb, do_populate_lic) failed with exit code '1'
NOTE: Running task 1381 of 7259 (ID: 6940, /srv/home/pokybuild/poky-slave/nightly-ext
> This makes me think something could be seriously broken in master when
> it comes to handling build dependencies.
>
> I've verified that sgml-common-native is showing up as a build
> dependency properly in the dependency explorer.
I'm not convinced as its clear above that sgml-common-native is being
built before docbook-dsssl-stylesheets-native do_configure runs.
> ...ok, looking at the recent commits in master, this one raised my
> suspicion:
>
> http://git.pokylinux.org/cgit/cgit.cgi/poky/commit/?id=b4268c08c350a7928a0b1a041b04ffe5a44e77b4
>
> I just tried reverting that and doing a new build, and the build
> completed successfully. Could you take a closer look at it?
So its not to say you're wrong about that commit but certainly there is
more to it that build dependencies simply being ignored as I can't see
any evidence of that.
Did both your builds have rm_work enabled?
Cheers,
Richard
^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: Broken dependency behavior in master?
2011-04-01 11:31 ` Richard Purdie
@ 2011-04-01 15:23 ` Scott Garman
2011-04-01 17:34 ` Richard Purdie
0 siblings, 1 reply; 7+ messages in thread
From: Scott Garman @ 2011-04-01 15:23 UTC (permalink / raw)
To: Richard Purdie; +Cc: Paul Eggleton, poky@yoctoproject.org
On 04/01/2011 04:31 AM, Richard Purdie wrote:
> On Thu, 2011-03-31 at 17:23 -0700, Scott Garman wrote:
>> Beth pointed me to a failure occurring on the autobuilder when building
>> docbook-sgml-dtd-3.1-native using the latest master:
>>
>> http://autobuilder.pokylinux.org:8010/builders/nightly-external/builds/88/steps/shell_3/logs/stdio
>>
>> I am able to reproduce it on my development system. The problem occurs
>> because sgml-common-native is not being fully built before
>> docbook-sgml-dtd-3.1-native, even though it is listed in DEPENDS. I see
>> log files only up to the do_configure step for sgml-common-native.
>
> Looking at the log above and keeping the order but removing some lines:
>
>
> NOTE: package sgml-common-native-0.6.3-r0: task do_configure: Succeeded
> NOTE: Running task 1263 of 7259 (ID: 7236, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/sgml-common/sgml-common-native_0.6.3.bb, do_compile)
> NOTE: package sgml-common-native-0.6.3-r0: task do_compile: Started
> NOTE: package sgml-common-native-0.6.3-r0: task do_compile: Succeeded
> NOTE: Running task 1269 of 7259 (ID: 7231, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/sgml-common/sgml-common-native_0.6.3.bb, do_install)
> NOTE: package sgml-common-native-0.6.3-r0: task do_install: Started
> NOTE: package sgml-common-native-0.6.3-r0: task do_install: Succeeded
> NOTE: Running task 1271 of 7259 (ID: 7232, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/sgml-common/sgml-common-native_0.6.3.bb, do_populate_sysroot)
> NOTE: Running noexec task 1272 of 7259 (ID: 7238, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/sgml-common/sgml-common-native_0.6.3.bb, do_package)
> NOTE: Running noexec task 1273 of 7259 (ID: 7237, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/sgml-common/sgml-common-native_0.6.3.bb, do_package_write)
> NOTE: package sgml-common-native-0.6.3-r0: task do_populate_sysroot: Started
> NOTE: package sgml-common-native-0.6.3-r0: task do_populate_sysroot: Succeeded
> NOTE: Running noexec task 1287 of 7259 (ID: 7234, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/sgml-common/sgml-common-native_0.6.3.bb, do_build)
> NOTE: Running task 1288 of 7259 (ID: 7239, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/sgml-common/sgml-common-native_0.6.3.bb, do_rm_work)
> NOTE: package libxft-1_2.2.0-r0: task do_populate_lic: Succeeded
> NOTE: package sgml-common-native-0.6.3-r0: task do_rm_work: Started
> NOTE: package sgml-common-native-0.6.3-r0: task do_rm_work: Succeeded
>
> Then later we see:
>
> NOTE: Running task 1370 of 7259 (ID: 6965, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/docbook-sgml-dtd/docbook-sgml-dtd-3.1-native.bb, do_configure)
> NOTE: package opensp-native-1.5-r0: task do_populate_lic: Started
> NOTE: package docbook-sgml-dtd-3.1-native-1.0-r1.0: task do_configure: Started
>
> [...]
>
> NOTE: Running task 1375 of 7259 (ID: 5055, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/perl/libxml-parser-perl-native_2.36.bb, do_populate_sysroot)
> NOTE: package docbook-sgml-dtd-3.1-native-1.0-r1.0: task do_populate_lic: Started
> WARNING: docbook-sgml-dtd-3.1-native: Something went wrong with copying: OASIS to /srv/home/pokybuild/poky-slave/nightly-external/build/meta/files/common-licenses
> WARNING: This could be either because we do not have a generic for this license or the LICENSE field is incorrect
> NOTE: package docbook-dsssl-stylesheets-native-1.79-r2: task do_configure: Started
> NOTE: package docbook-sgml-dtd-3.1-native-1.0-r1.0: task do_compile: Started
> ERROR: Function 'docbook_sgml_dtd_sstate_postinst' failed (see /srv/home/pokybuild/poky-slave/nightly-external/build/build/tmp/work/x86_64-linux/docbook-sgml-dtd-3.1-native-1.0-r1.0/temp/log.do_populate_lic.14913 for further information)
> NOTE: package docbook-dsssl-stylesheets-native-1.79-r2: task do_configure: Succeeded
> NOTE: Running noexec task 1376 of 7259 (ID: 5061, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/perl/libxml-parser-perl-native_2.36.bb, do_package)
> NOTE: Running noexec task 1377 of 7259 (ID: 5060, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/perl/libxml-parser-perl-native_2.36.bb, do_package_write)
> NOTE: Running task 1378 of 7259 (ID: 6951, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/docbook-dsssl-stylesheets/docbook-dsssl-stylesheets-native_1.79.bb, do_compile)
> ERROR: Logfile of failure stored in: /srv/home/pokybuild/poky-slave/nightly-external/build/build/tmp/work/x86_64-linux/docbook-sgml-dtd-3.1-native-1.0-r1.0/temp/log.do_populate_lic.14913
> Log data follows:
> | WARNING: docbook-sgml-dtd-3.1-native: Something went wrong with copying: OASIS to /srv/home/pokybuild/poky-slave/nightly-external/build/meta/files/common-licenses
> | WARNING: This could be either because we do not have a generic for this license or the LICENSE field is incorrect
> | ERROR: Function 'docbook_sgml_dtd_sstate_postinst' failed (see /srv/home/pokybuild/poky-slave/nightly-external/build/build/tmp/work/x86_64-linux/docbook-sgml-dtd-3.1-native-1.0-r1.0/temp/log.do_populate_lic.14913 for further information)
> | install-catalog: "/srv/home/pokybuild/poky-slave/nightly-external/build/build/tmp/sysroots/x86_64-linux/etc/sgml/sgml-docbook-dtd-3.1.cat" does not exist or is empty.
> NOTE: package docbook-sgml-dtd-3.1-native-1.0-r1.0: task do_populate_lic: Failed
> ERROR: Task 6970 (/srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/docbook-sgml-dtd/docbook-sgml-dtd-3.1-native.bb, do_populate_lic) failed with exit code '1'
> NOTE: Running task 1379 of 7259 (ID: 6935, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/sgmlspl/sgmlspl-native_1.03ii.bb, do_configure)
> NOTE: package docbook-sgml-dtd-3.1-native-1.0-r1.0: task do_compile: Succeeded
> NOTE: Running task 1380 of 7259 (ID: 6961, /srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/docbook-sgml-dtd/docbook-sgml-dtd-3.1-native.bb, do_install)
> NOTE: package docbook-dsssl-stylesheets-native-1.79-r2: task do_populate_lic: Started
> WARNING: docbook-dsssl-stylesheets-native: Something went wrong with copying: DSSSL to /srv/home/pokybuild/poky-slave/nightly-external/build/meta/files/common-licenses
> WARNING: This could be either because we do not have a generic for this license or the LICENSE field is incorrect
> NOTE: package libxml-parser-perl-native-2.36-r1: task do_populate_sysroot: Started
> ERROR: Function 'docbook_dsssl_stylesheets_sstate_postinst' failed (see /srv/home/pokybuild/poky-slave/nightly-external/build/build/tmp/work/x86_64-linux/docbook-dsssl-stylesheets-native-1.79-r2/temp/log.do_populate_lic.15063 for further information)
> ERROR: Logfile of failure stored in: /srv/home/pokybuild/poky-slave/nightly-external/build/build/tmp/work/x86_64-linux/docbook-dsssl-stylesheets-native-1.79-r2/temp/log.do_populate_lic.15063
> Log data follows:
> | WARNING: docbook-dsssl-stylesheets-native: Something went wrong with copying: DSSSL to /srv/home/pokybuild/poky-slave/nightly-external/build/meta/files/common-licenses
> | WARNING: This could be either because we do not have a generic for this license or the LICENSE field is incorrect
> | ERROR: Function 'docbook_dsssl_stylesheets_sstate_postinst' failed (see /srv/home/pokybuild/poky-slave/nightly-external/build/build/tmp/work/x86_64-linux/docbook-dsssl-stylesheets-native-1.79-r2/temp/log.do_populate_lic.15063 for further information)
> | install-catalog: "/srv/home/pokybuild/poky-slave/nightly-external/build/build/tmp/sysroots/x86_64-linux/etc/sgml/dsssl-docbook-stylesheets.cat" does not exist or is empty.
> NOTE: package docbook-dsssl-stylesheets-native-1.79-r2: task do_populate_lic: Failed
> ERROR: Task 6955 (/srv/home/pokybuild/poky-slave/nightly-external/build/meta/recipes-devtools/docbook-dsssl-stylesheets/docbook-dsssl-stylesheets-native_1.79.bb, do_populate_lic) failed with exit code '1'
> NOTE: Running task 1381 of 7259 (ID: 6940, /srv/home/pokybuild/poky-slave/nightly-ext
>
>> This makes me think something could be seriously broken in master when
>> it comes to handling build dependencies.
>>
>> I've verified that sgml-common-native is showing up as a build
>> dependency properly in the dependency explorer.
>
> I'm not convinced as its clear above that sgml-common-native is being
> built before docbook-dsssl-stylesheets-native do_configure runs.
That was the case on the autobuilder. On my local development system, I
proved to myself without a doubt that sgml-common-native only got as far
as do_configure before the docbook-sgml-dtd-3.1-native error was
encountered.
I also then ran bitbake sgml-common-native afterward and verified that
the remaining build steps were run to make sure it wasn't a case of
missing log files.
> Did both your builds have rm_work enabled?
My local build did not have rm_work enabled, but I believe it is enabled
on the autobuilder.
Scott
--
Scott Garman
Embedded Linux Engineer - Yocto Project
Intel Open Source Technology Center
^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: Broken dependency behavior in master?
2011-04-01 15:23 ` Scott Garman
@ 2011-04-01 17:34 ` Richard Purdie
2011-04-01 18:49 ` Scott Garman
0 siblings, 1 reply; 7+ messages in thread
From: Richard Purdie @ 2011-04-01 17:34 UTC (permalink / raw)
To: Scott Garman; +Cc: Paul Eggleton, poky@yoctoproject.org
On Fri, 2011-04-01 at 08:23 -0700, Scott Garman wrote:
> On 04/01/2011 04:31 AM, Richard Purdie wrote:
> >> This makes me think something could be seriously broken in master when
> >> it comes to handling build dependencies.
> >>
> >> I've verified that sgml-common-native is showing up as a build
> >> dependency properly in the dependency explorer.
> >
> > I'm not convinced as its clear above that sgml-common-native is being
> > built before docbook-dsssl-stylesheets-native do_configure runs.
>
> That was the case on the autobuilder. On my local development system, I
> proved to myself without a doubt that sgml-common-native only got as far
> as do_configure before the docbook-sgml-dtd-3.1-native error was
> encountered.
With or without sstate involvement?
This looks like some kind of sstate issue but without logs this is near
impossible to comment on. The logs you've pointed at don't show the
problem you're describing.
I don't think the problem is as simple as you're suggesting it is though
as the core dependency resolution appears to be working (and has not
changed in a long time). What perhaps isn't in something in the sstate
task acceleration.
> I also then ran bitbake sgml-common-native afterward and verified that
> the remaining build steps were run to make sure it wasn't a case of
> missing log files.
>
> > Did both your builds have rm_work enabled?
>
> My local build did not have rm_work enabled, but I believe it is enabled
> on the autobuilder.
It is enabled on the autobuilder and that gives a useful data point,
thanks.
Richard
^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: Broken dependency behavior in master?
2011-04-01 17:34 ` Richard Purdie
@ 2011-04-01 18:49 ` Scott Garman
2011-04-04 16:32 ` Paul Eggleton
0 siblings, 1 reply; 7+ messages in thread
From: Scott Garman @ 2011-04-01 18:49 UTC (permalink / raw)
To: Richard Purdie; +Cc: Paul Eggleton, poky@yoctoproject.org
On 04/01/2011 10:34 AM, Richard Purdie wrote:
> On Fri, 2011-04-01 at 08:23 -0700, Scott Garman wrote:
>> On 04/01/2011 04:31 AM, Richard Purdie wrote:
>>>> This makes me think something could be seriously broken in master when
>>>> it comes to handling build dependencies.
>>>>
>>>> I've verified that sgml-common-native is showing up as a build
>>>> dependency properly in the dependency explorer.
>>>
>>> I'm not convinced as its clear above that sgml-common-native is being
>>> built before docbook-dsssl-stylesheets-native do_configure runs.
>>
>> That was the case on the autobuilder. On my local development system, I
>> proved to myself without a doubt that sgml-common-native only got as far
>> as do_configure before the docbook-sgml-dtd-3.1-native error was
>> encountered.
>
> With or without sstate involvement?
I've reproduced this now, multiple times, using builds from scratch,
including the fact that reverting that commit fixes the the problem for me.
> This looks like some kind of sstate issue but without logs this is near
> impossible to comment on. The logs you've pointed at don't show the
> problem you're describing.
Please grab what you need to from here:
http://www.zenlinux.com/dropbox/
> I don't think the problem is as simple as you're suggesting it is though
> as the core dependency resolution appears to be working (and has not
> changed in a long time). What perhaps isn't in something in the sstate
> task acceleration.
Sure, I'm not insisting that this is the cause - it was just my initial
hunch. And your intuition is clearly better than mine when it comes to
this, so I trust it.
Scott
--
Scott Garman
Embedded Linux Engineer - Yocto Project
Intel Open Source Technology Center
^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: Broken dependency behavior in master?
2011-04-01 18:49 ` Scott Garman
@ 2011-04-04 16:32 ` Paul Eggleton
2011-04-04 17:03 ` Richard Purdie
0 siblings, 1 reply; 7+ messages in thread
From: Paul Eggleton @ 2011-04-04 16:32 UTC (permalink / raw)
To: Scott Garman; +Cc: poky@yoctoproject.org
On Friday 01 April 2011 19:49:13 Scott Garman wrote:
> I've reproduced this now, multiple times, using builds from scratch,
> including the fact that reverting that commit fixes the the problem for me.
I can confirm this, even though on the face of it the patch should not cause
any issues.
I haven't completely isolated the cause yet, however the problem occurs in
sstate_task_postfunc -> sstate_install -> docbook_sgml_dtd_sstate_postinst
which oddly seems to be being merged into the do_populate_lic task. I'm not
sure but I'm assuming that these sstate functions should not be being executed
under these circumstances.
Cheers,
Paul
--
Paul Eggleton
Intel Open Source Technology Centre (UK)
^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: Broken dependency behavior in master?
2011-04-04 16:32 ` Paul Eggleton
@ 2011-04-04 17:03 ` Richard Purdie
0 siblings, 0 replies; 7+ messages in thread
From: Richard Purdie @ 2011-04-04 17:03 UTC (permalink / raw)
To: Paul Eggleton; +Cc: poky@yoctoproject.org
On Mon, 2011-04-04 at 17:32 +0100, Paul Eggleton wrote:
> On Friday 01 April 2011 19:49:13 Scott Garman wrote:
> > I've reproduced this now, multiple times, using builds from scratch,
> > including the fact that reverting that commit fixes the the problem for me.
>
> I can confirm this, even though on the face of it the patch should not cause
> any issues.
>
> I haven't completely isolated the cause yet, however the problem occurs in
> sstate_task_postfunc -> sstate_install -> docbook_sgml_dtd_sstate_postinst
> which oddly seems to be being merged into the do_populate_lic task. I'm not
> sure but I'm assuming that these sstate functions should not be being executed
> under these circumstances.
Some data points on this:
"bitbake docbook-sgml-dtd-3.1-native -c populate_lic"
is the reproducer and the problem is the line:
SSTATEPOSTINSTFUNCS += "docbook_sgml_dtd_sstate_postinst"
in docbook-sgml-dtd-native.inc. This is running at populate_lic time as
well as populate_sysroot when its meant to run.
The commit Scott found is just a coincidence on some task order and not
responsible for this issue. I believe Scott is going to test+send a fix
which ensures the postinst only runs for the populate_sysroot postinst.
Cheers,
Richard
^ permalink raw reply [flat|nested] 7+ messages in thread
end of thread, other threads:[~2011-04-04 17:03 UTC | newest]
Thread overview: 7+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2011-04-01 0:23 Broken dependency behavior in master? Scott Garman
2011-04-01 11:31 ` Richard Purdie
2011-04-01 15:23 ` Scott Garman
2011-04-01 17:34 ` Richard Purdie
2011-04-01 18:49 ` Scott Garman
2011-04-04 16:32 ` Paul Eggleton
2011-04-04 17:03 ` Richard Purdie
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.