Bitbake r1090 (env hiding) makes my build fail.

Bitbake r1090 (env hiding) makes my build fail.

[Rob Kramer]

Hia,

I'm tracking the stable branch and recently updated bitbake to HEAD. When
trying a build-from-scratch, I noticed BB quickly failed in shasum-native.
Some manual svn disecting pointed to r1090 as the one that caused the fail.
I tried adding a BB_PRESERVE_ENV, but no difference.

Output is at http://pastebin.com/m65e66603. There is no log.do_compile
generated for some reason, and a build with -D shows nothing much. The gcc
invoke actually works OK and produces the oe_shasum256 executable.

Any ideas what could be wrong with my setup?

Cheers!

    Rob

Re: Bitbake r1090 (env hiding) makes my build fail.

[Mike (mwester)]

Rob Kramer wrote:
> Hia,
> 
> I'm tracking the stable branch and recently updated bitbake to HEAD. When
> trying a build-from-scratch, I noticed BB quickly failed in shasum-native.
> Some manual svn disecting pointed to r1090 as the one that caused the fail.
> I tried adding a BB_PRESERVE_ENV, but no difference.
> 
> Output is at http://pastebin.com/m65e66603. There is no log.do_compile
> generated for some reason, and a build with -D shows nothing much. The gcc
> invoke actually works OK and produces the oe_shasum256 executable.
> 
> Any ideas what could be wrong with my setup?

You've gotten further than I have in tracking this down!  Good find in
pointing the finger of suspicion on the env hiding stuff.

There have been a number of folks who have encountered this problem --
including me, at one point.  I struggled with it, determined it was
ccache that was messing up, and at that point I took the easy way out
and just renamed the /usr/bin/ccache binary to get my builds running again.

Oddly enough, now ccache seems to work fine, and I can troubleshoot no
further.

Try messing about with ccache -- disable it, or clean the caches out,
and see if anything will help.  Or you can just do what I did, and
disable it by brute force (rename the hosts' ccache binary).

Mike (mwester)

Re: Bitbake r1090 (env hiding) makes my build fail.

[Koen Kooi]

On 24-11-08 05:54, Mike (mwester) wrote:
> Rob Kramer wrote:
>> Hia,
>>
>> I'm tracking the stable branch and recently updated bitbake to HEAD. When
>> trying a build-from-scratch, I noticed BB quickly failed in shasum-native.
>> Some manual svn disecting pointed to r1090 as the one that caused the fail.
>> I tried adding a BB_PRESERVE_ENV, but no difference.
>>
>> Output is at http://pastebin.com/m65e66603. There is no log.do_compile
>> generated for some reason, and a build with -D shows nothing much. The gcc
>> invoke actually works OK and produces the oe_shasum256 executable.
>>
>> Any ideas what could be wrong with my setup?
>
> You've gotten further than I have in tracking this down!  Good find in
> pointing the finger of suspicion on the env hiding stuff.
>
> There have been a number of folks who have encountered this problem --
> including me, at one point.  I struggled with it, determined it was
> ccache that was messing up, and at that point I took the easy way out
> and just renamed the /usr/bin/ccache binary to get my builds running again.

Why not put

CCACHE=""

in local.conf?

regards,

Koen

PS: Is that on a RH (derived) buildhost?

Re: Bitbake r1090 (env hiding) makes my build fail.

[Philip Balister]

[-- Attachment #1: Type: text/plain, Size: 1346 bytes --]

Koen Kooi wrote:
> On 24-11-08 05:54, Mike (mwester) wrote:
>> Rob Kramer wrote:
>>> Hia,
>>>
>>> I'm tracking the stable branch and recently updated bitbake to HEAD. 
>>> When
>>> trying a build-from-scratch, I noticed BB quickly failed in 
>>> shasum-native.
>>> Some manual svn disecting pointed to r1090 as the one that caused the 
>>> fail.
>>> I tried adding a BB_PRESERVE_ENV, but no difference.
>>>
>>> Output is at http://pastebin.com/m65e66603. There is no log.do_compile
>>> generated for some reason, and a build with -D shows nothing much. 
>>> The gcc
>>> invoke actually works OK and produces the oe_shasum256 executable.
>>>
>>> Any ideas what could be wrong with my setup?
>>
>> You've gotten further than I have in tracking this down!  Good find in
>> pointing the finger of suspicion on the env hiding stuff.
>>
>> There have been a number of folks who have encountered this problem --
>> including me, at one point.  I struggled with it, determined it was
>> ccache that was messing up, and at that point I took the easy way out
>> and just renamed the /usr/bin/ccache binary to get my builds running 
>> again.
> 
> Why not put
> 
> CCACHE=""
> 
> in local.conf?
> 
> regards,
> 
> Koen
> 
> PS: Is that on a RH (derived) buildhost?

I had this problem on a RHEL4 machine.

Philip

[-- Attachment #2: S/MIME Cryptographic Signature --]
[-- Type: application/x-pkcs7-signature, Size: 3303 bytes --]

Re: Bitbake r1090 (env hiding) makes my build fail.

[Leon Woestenberg]

Hello guys,

On Mon, Nov 24, 2008 at 1:55 PM, Philip Balister <philip@balister.org> wrote:
> Koen Kooi wrote:
>> On 24-11-08 05:54, Mike (mwester) wrote:
>>> Rob Kramer wrote:
>>>> Hia,
>> Why not put
>>
>> CCACHE=""
>>
>> in local.conf?
>>
>> regards,
>>
>> Koen
>>
>> PS: Is that on a RH (derived) buildhost?
>
> I had this problem on a RHEL4 machine.
>

Q: Did this problem reproduce reliably each time?


Background: I have seen my builds-from-scratch fail very early as
well, but it does not reproduce often. In my case, I suspect a
concurrency issue, i.e. BB_NUMBER_THREADS larger than 1? It fails
every 1 out of 50 times or so here... I am still tracking that one
down.


Regards,
-- 
Leon

Re: Bitbake r1090 (env hiding) makes my build fail.

[Philip Balister]

[-- Attachment #1: Type: text/plain, Size: 828 bytes --]

Leon Woestenberg wrote:
> Hello guys,
> 
> On Mon, Nov 24, 2008 at 1:55 PM, Philip Balister <philip@balister.org> wrote:
>> Koen Kooi wrote:
>>> On 24-11-08 05:54, Mike (mwester) wrote:
>>>> Rob Kramer wrote:
>>>>> Hia,
>>> Why not put
>>>
>>> CCACHE=""
>>>
>>> in local.conf?
>>>
>>> regards,
>>>
>>> Koen
>>>
>>> PS: Is that on a RH (derived) buildhost?
>> I had this problem on a RHEL4 machine.
>>
> 
> Q: Did this problem reproduce reliably each time?
> 
> 
> Background: I have seen my builds-from-scratch fail very early as
> well, but it does not reproduce often. In my case, I suspect a
> concurrency issue, i.e. BB_NUMBER_THREADS larger than 1? It fails
> every 1 out of 50 times or so here... I am still tracking that one
> down.

100% failure. Identical symptoms to mwester.

Philip

[-- Attachment #2: S/MIME Cryptographic Signature --]
[-- Type: application/x-pkcs7-signature, Size: 3303 bytes --]

Re: Bitbake r1090 (env hiding) makes my build fail.

[Mike (mwester)]

Koen Kooi wrote:

> Why not put
> 
> CCACHE=""
> 
> in local.conf?

:-)  Because I dislike the concept of ccache for one thing, but to be
honest, at the time I did that, I rather suspect that I didn't edit
local.conf because I didn't want to take the time to re-parse everything. :)

> regards,
> 
> Koen
> 
> PS: Is that on a RH (derived) buildhost?

Yes (RHEL 4, and CentOS 5.1).


Mike (mwester)

Re: Bitbake r1090 (env hiding) makes my build fail.

[Rob Kramer]

[Re-posted with lines trimmed, sorry if this arrives twice]

Koen Kooi wrote:
> Why not put
> 
> CCACHE=""
> 
> in local.conf?

I just commented out the CCACHE line in bitbake.conf for testing. The result
then is a bit more interesting:

| + do_compile
| +
gcc -isystem/bulk/opt/oe/stable/build-ble-i586/tmp/staging/\
x86_64-linux/include  -O2 -isystem/bulk/opt/oe/stable/build\
-ble-i586/tmp/staging/x86_64-linux/include -o
oe_sha256sum main.c sha256.c
| gcc: error trying to exec 'cc1': execvp: No such file or directory
| gcc: error trying to exec 'cc1': execvp: No such file or directory
NOTE: Task
failed: /bulk/opt/oe/stable/build-ble-i586/tmp/work/\
shasum-native-1.0-r1/temp/log.do_compile.32323

I.e. gcc can't find its backend (which should be
at /usr/lib64/gcc/x86_64-suse-linux/4.3/cc1 on my machine). I can't see in
r1090 what could cause that. "export BB_PRESERVE_ENV=1" doesn't help.

> PS: Is that on a RH (derived) buildhost?

OpenSuse 11, x86_64, building i586..

Cheers!

    Rob

Update: Bitbake r1090 (env hiding) makes my build fail.

[Rob Kramer]

Hia,

After several hours of hunting, the problem (for stable branch) comes down
to this: there needs to be an 'export PATH' in one of the config files,
otherwise my host compiler fails in the previously stated manner (calling
it explicitly as /usr/bin/gcc also works). The .dev trunk has the export in
bitbake.conf.

Even with the export, I still get screwy ccache behaviour, but if I just add
a CCACHE = "" then all is well.

Cheers,

    Rob


Rob Kramer wrote:
> Hia,
> 
> I'm tracking the stable branch and recently updated bitbake to HEAD. When
> trying a build-from-scratch, I noticed BB quickly failed in shasum-native.
> Some manual svn disecting pointed to r1090 as the one that caused the
> fail. I tried adding a BB_PRESERVE_ENV, but no difference.
> 
> Output is at http://pastebin.com/m65e66603. There is no log.do_compile
> generated for some reason, and a build with -D shows nothing much. The gcc
> invoke actually works OK and produces the oe_shasum256 executable.
> 
> Any ideas what could be wrong with my setup?
> 
> Cheers!
> 
>     Rob