Re: [OE-core] [PATCH v4 0/5] Add bblock helper scripts

[Alexandre Belloni <alexandre.belloni@bootlin.com>]

On 21/09/2023 16:24:30+0200, Julien Stephan wrote:
> Le jeu. 21 sept. 2023 � 15:11, Alexandre Belloni
> <alexandre.belloni@bootlin.com> a �crit :
> >
> > Hello,
> >
> > On 20/09/2023 16:20:42+0200, Julien Stephan wrote:
> > > Hi Alexandre,
> > > sorry for the late reply.
> > >
> > > I was not able to reproduce this issue on my local setup, but I did
> > > find another (similar??)  bug, I fixed it, so hopefully it will also
> > > fix the one detected by the autobuilder.
> > > I updated my branch on poky-contrib
> > > (https://git.yoctoproject.org/poky-contrib/log/?h=jstephan/bblock)
> > > (with this fix and a few other ones), can you try it on autobuilder? I
> > > didn't send a newer version of the series in case the issue is still
> > > there.
> >
> > This was sent to the autobuilders:
> >
> > https://autobuilder.yoctoproject.org/typhoon/#/builders/86/builds/5785/steps/14/logs/stdio
> >
> 
> Hi Alexandre,
> 
> Thank you! Unfortunately I can see that it is still failing on the same test :(
> I may need your help here.
> 
> Here is what my test is supposed to do:
> From the autobuilder log I can see that the machine is set to qemux86-64 so :
> 
> $ bblock -d # unlock all recipes and remove build/conf/bblock.conf file
> $ MACHINE=qemuarm block quilt -t compile # lock do_compile for bc for
> qemuarm arch so block.conf file should look like this:
> 
> # Generated by bblock
> SIGGEN_LOCKEDSIGS_TASKSIG_CHECK = "info"
> SIGGEN_LOCKEDSIGS_TYPES += "${PACKAGE_ARCHS}"
> 
> SIGGEN_LOCKEDSIGS_cortexa15t2hf-neon += "quilt:do_compile:<sig>"
> 
> # modify the quilt's do_compile task by adding an empty
> do_compile:append function
> $ bitbake -n quilt # for qemux86-64 machine
> 
> Because quilt is supposed to be locked for qemuarm, I am not supposed
> to see any warning, but the log on the autobuilder says:
> "WARNING: The quilt:do_compile sig is computed to be
> d5902ba1813663fcd92fc5afb9026e01c01ccdbcc0ff792aad555522ce407c31, but
> the sig is locked to
> c9c5724b6f125763f1f0e2c87e6451acdaf59f7aba7efe387c2908d14486f3fe in
> SIGGEN_LOCKEDSIGS_core2-64\""
> 
> meaning bblock.conf contains:
> 
> SIGGEN_LOCKEDSIGS_core2-64 += "quilt:do_compile:<sig>
> 
> 
> So I can see two possible reasons for that:
> * MACHINE=qemuarm block quilt -t compile  is not using the machine I
> give on the command line, but why??

As I said in the call, look at this log from the build:

https://autobuilder.yoctoproject.org/typhoon/#/builders/86/builds/5785/steps/13/logs/stdio

It tells you that MACHINE = "qemux86-64" ends up in auto.conf which is
then used by the build so overriding it from the command line doesn't
work.

> * bblock.conf gets polluted by another test that also tries to lock
> quilt's do_compile function for qemux86-64 because of parallelism  (I
> was not able to reproduce it locally)
> 
> Do you have an idea why this test is failing?
> My next move would be to place all the tests in a single test to
> remove the parallelism issue (if that is the issue) but I would prefer
> to avoid wasting your time starting builds for me several times..
> 
> Also, I didn't manage to print log messages on my test, how can I do that?
> 
> Cheers
> Julien
> > >
> > > Please let me know if I can do anything else
> > > Cheers
> > > Julien
> > >
> > > Le ven. 11 ao�t 2023 � 10:45, Alexandre Belloni
> > > <alexandre.belloni@bootlin.com> a �crit :
> > > >
> > > > On 11/08/2023 10:00:33+0200, Alexandre Belloni wrote:
> > > > > On 10/08/2023 15:21:14+0200, Alexandre Belloni wrote:
> > > > > > Hello, this causes oe-selftest failures on the autobuilders:
> > > > > >
> > > > > > https://autobuilder.yoctoproject.org/typhoon/#/builders/79/builds/5589/steps/14/logs/stdio
> > > > > > https://autobuilder.yoctoproject.org/typhoon/#/builders/86/builds/5577/steps/14/logs/stdio
> > > > > > https://autobuilder.yoctoproject.org/typhoon/#/builders/80/builds/5536/steps/14/logs/stdio
> > > > > > https://autobuilder.yoctoproject.org/typhoon/#/builders/87/builds/5613/steps/14/logs/stdio
> > > > > >
> > > > > > 2023-08-10 09:44:34,071 - oe-selftest - INFO - bblock.BBLock.test_lock_architecture_specific (subunit.RemotedTestCase)
> > > > > > 2023-08-10 09:44:34,072 - oe-selftest - INFO -  ... FAIL
> > > > > > Stderr:
> > > > > > 2023-08-10 09:40:23,454 - oe-selftest - INFO - Adding: "include selftest.inc" in /home/pokybuild/yocto-worker/oe-selftest-centos/build/build-st-2290072/conf/local.conf
> > > > > > 2023-08-10 09:40:23,455 - oe-selftest - INFO - Adding: "include bblayers.inc" in bblayers.conf
> > > > > > 2023-08-10 09:44:34,072 - oe-selftest - INFO - 3: 1/34 29/533 (250.62s) (0 failed) (bblock.BBLock.test_lock_architecture_specific)
> > > > > > 2023-08-10 09:44:34,072 - oe-selftest - INFO - testtools.testresult.real._StringException: Traceback (most recent call last):
> > > > > >   File "/home/pokybuild/yocto-worker/oe-selftest-centos/build/meta/lib/oeqa/selftest/cases/bblock.py", line 103, in test_lock_architecture_specific
> > > > > >     self.assertNotIn(info_message, result.output)
> > > > > >   File "/usr/lib64/python3.9/unittest/case.py", line 1111, in assertNotIn
> > > > > >     self.fail(self._formatMessage(msg, standardMsg))
> > > > > >   File "/usr/lib64/python3.9/unittest/case.py", line 676, in fail
> > > > > >     raise self.failureException(msg)
> > > > > > AssertionError: 'NOTE: The following recipes have locked tasks: quilt' unexpectedly found in 'NOTE: Reconnecting to bitbake server...
> > > > > >
> > > > >
> > > > > Hum, wait, I got this without the patch series. Let me investigate.
> > > >
> > > > Actually, I still had the series :)
> > > >
> > >
> > > Hi Alexandre,
> > >
> > > I am not able to reproduce it locally, so it is difficult to fix the issue.
> > >
> > >
> > >
> > > > Alexandre Belloni, co-owner and COO, Bootlin
> > > > Embedded Linux and Kernel engineering
> > > > https://bootlin.com
> >
> > --
> > Alexandre Belloni, co-owner and COO, Bootlin
> > Embedded Linux and Kernel engineering
> > https://bootlin.com

-- 
Alexandre Belloni, co-owner and COO, Bootlin
Embedded Linux and Kernel engineering
https://bootlin.com