Help needed: (Resend) Failures with nbench

Help needed: (Resend) Failures with nbench

[Nelson, Sam]

[-- Attachment #1: Type: text/plain, Size: 4012 bytes --]

Hello all,
We are encountering the following error very often in our nightly builds. Other times it works fine.
The reason seems to be due to the make process trying to compile before the touch pointer.h succeeds.
See highlighted text in red.
Not sure if this is because of the -j 4.
Anybody else have seen this issue.  Appreciate your comments and help in resolving this issue.

With regards,
Sam

NOTE: recipe nbench-byte-2.2.3-r0: task do_compile: Started
ERROR: Function failed: do_compile (see /home/gtbldadm/yocto/mcsdk-3_00_00_11/oe-layersetup-mcsdk/build/arago-tmp-external-linaro-toolchain/work/armv7ahf-vfp-neon-oe-linux-gnueabi/nbench-byte-2.2.3-r0/temp/log.do_compile.28346 for further information)
ERROR: Logfile of failure stored in: /home/gtbldadm/yocto/mcsdk-3_00_00_11/oe-layersetup-mcsdk/build/arago-tmp-external-linaro-toolchain/work/armv7ahf-vfp-neon-oe-linux-gnueabi/nbench-byte-2.2.3-r0/temp/log.do_compile.28346
Log data follows:
| DEBUG: Executing shell function do_compile
| NOTE: make -j 4 -e MAKEFLAGS=
| touch pointer.h ;
| arm-linux-gnueabihf-gcc  -march=armv7-a    -marm -mthumb-interwork -mfloat-abi=hard -mfpu=neon -mtune=cortex-a15  -isystem/opt/linaro-2013.03/arm-linux-gnueabihf/include  -fstack-protector -D_FORTIFY_SOURCE=1 -O2 -pipe -g -feliminate-unused-debug-types  -L/opt/linaro-2013.03/arm-linux-gnueabihf/lib -Wl,-rpath-link,/opt/linaro-2013.03/arm-linux-gnueabihf/lib -Wl,-O1 -Wl,--hash-style=gnu --sysroot=/home/gtbldadm/yocto/mcsdk-3_00_00_11/oe-layersetup-mcsdk/build/arago-tmp-external-linaro-toolchain/sysroots/keystone-evm  -DLINUX  -isystem/opt/linaro-2013.03/arm-linux-gnueabihf/include  -fstack-protector -D_FORTIFY_SOURCE=1 -O2 -pipe -g -feliminate-unused-debug-types\
|              -c misc.c
| ./sysinfo.sh arm-linux-gnueabihf-gcc  -march=armv7-a    -marm -mthumb-interwork -mfloat-abi=hard -mfpu=neon -mtune=cortex-a15  -isystem/opt/linaro-2013.03/arm-linux-gnueabihf/include  -fstack-protector -D_FORTIFY_SOURCE=1 -O2 -pipe -g -feliminate-unused-debug-types  -L/opt/linaro-2013.03/arm-linux-gnueabihf/lib -Wl,-rpath-link,/opt/linaro-2013.03/arm-linux-gnueabihf/lib -Wl,-O1 -Wl,--hash-style=gnu --sysroot=/home/gtbldadm/yocto/mcsdk-3_00_00_11/oe-layersetup-mcsdk/build/arago-tmp-external-linaro-toolchain/sysroots/keystone-evm  -DLINUX  -isystem/opt/linaro-2013.03/arm-linux-gnueabihf/include  -fstack-protector -D_FORTIFY_SOURCE=1 -O2 -pipe -g -feliminate-unused-debug-types
| ./sysinfo.sh arm-linux-gnueabihf-gcc  -march=armv7-a    -marm -mthumb-interwork -mfloat-abi=hard -mfpu=neon -mtune=cortex-a15  -isystem/opt/linaro-2013.03/arm-linux-gnueabihf/include  -fstack-protector -D_FORTIFY_SOURCE=1 -O2 -pipe -g -feliminate-unused-debug-types  -L/opt/linaro-2013.03/arm-linux-gnueabihf/lib -Wl,-rpath-link,/opt/linaro-2013.03/arm-linux-gnueabihf/lib -Wl,-O1 -Wl,--hash-style=gnu --sysroot=/home/gtbldadm/yocto/mcsdk-3_00_00_11/oe-layersetup-mcsdk/build/arago-tmp-external-linaro-toolchain/sysroots/keystone-evm  -DLINUX  -isystem/opt/linaro-2013.03/arm-linux-gnueabihf/include  -fstack-protector -D_FORTIFY_SOURCE=1 -O2 -pipe -g -feliminate-unused-debug-types
| In file included from misc.h:36:0,
|                  from misc.c:23:
| nmglobal.h:29:21: fatal error: pointer.h: No such file or directory
| compilation terminated.
| make: *** [misc.o] Error 1
| make: *** Waiting for unfinished jobs....
| ERROR: oe_runmake failed
| ERROR: Function failed: do_compile (see /home/gtbldadm/yocto/mcsdk-3_00_00_11/oe-layersetup-mcsdk/build/arago-tmp-external-linaro-toolchain/work/armv7ahf-vfp-neon-oe-linux-gnueabi/nbench-byte-2.2.3-r0/temp/log.do_compile.28346 for further information)
NOTE: recipe nbench-byte-2.2.3-r0: task do_compile: Failed
ERROR: Task 2812 (/home/gtbldadm/yocto/mcsdk-3_00_00_11/oe-layersetup-mcsdk/sources/meta-openembedded/meta-oe/recipes-benchmark/nbench-byte/nbench-byte_2.2.3.bb, do_compile) failed with exit code '1'
WARNING: QA Issue: syslog-ng: Files/directories were installed but not shipped


[-- Attachment #2: Type: text/html, Size: 9139 bytes --]

Re: Help needed: (Resend) Failures with nbench

[Denys Dmytriyenko]

On Thu, Jun 27, 2013 at 11:56:50AM -0400, Nelson, Sam wrote:
>    Hello all,
> 
>    We are encountering the following error very often in our nightly builds.
>    Other times it works fine.
> 
>    The reason seems to be due to the make process trying to compile before
>    the touch pointer.h succeeds.
> 
>    See highlighted text in red.
> 
>    Not sure if this is because of the -j 4.
> 
>    Anybody else have seen this issue.  Appreciate your comments and help in
>    resolving this issue.

Sam,

I haven't seen this failure and we are building nbench in our nightly builds 
as well, using -j 16 and even higher.

From your description of the problem it looks like a race condition. You can 
try adding this line to the recipe to force building nbench package in a 
single thread - see if it helps:

PARALLEL_MAKE = ""

-- 
Denys


>    NOTE: recipe nbench-byte-2.2.3-r0: task do_compile: Started
> 
>    ERROR: Function failed: do_compile (see
>    /home/gtbldadm/yocto/mcsdk-3_00_00_11/oe-layersetup-mcsdk/build/arago-tmp-external-linaro-toolchain/work/armv7ahf-vfp-neon-oe-linux-gnueabi/nbench-byte-2.2.3-r0/temp/log.do_compile.28346
>    for further information)
> 
>    ERROR: Logfile of failure stored in:
>    /home/gtbldadm/yocto/mcsdk-3_00_00_11/oe-layersetup-mcsdk/build/arago-tmp-external-linaro-toolchain/work/armv7ahf-vfp-neon-oe-linux-gnueabi/nbench-byte-2.2.3-r0/temp/log.do_compile.28346
> 
>    Log data follows:
> 
>    | DEBUG: Executing shell function do_compile
> 
>    | NOTE: make -j 4 -e MAKEFLAGS=
> 
>    | touch pointer.h ;
> 
>    | arm-linux-gnueabihf-gcc  -march=armv7-a    -marm -mthumb-interwork
>    -mfloat-abi=hard -mfpu=neon -mtune=cortex-a15 
>    -isystem/opt/linaro-2013.03/arm-linux-gnueabihf/include  -fstack-protector
>    -D_FORTIFY_SOURCE=1 -O2 -pipe -g -feliminate-unused-debug-types 
>    -L/opt/linaro-2013.03/arm-linux-gnueabihf/lib
>    -Wl,-rpath-link,/opt/linaro-2013.03/arm-linux-gnueabihf/lib -Wl,-O1
>    -Wl,--hash-style=gnu
>    --sysroot=/home/gtbldadm/yocto/mcsdk-3_00_00_11/oe-layersetup-mcsdk/build/arago-tmp-external-linaro-toolchain/sysroots/keystone-evm 
>    -DLINUX  -isystem/opt/linaro-2013.03/arm-linux-gnueabihf/include 
>    -fstack-protector -D_FORTIFY_SOURCE=1 -O2 -pipe -g
>    -feliminate-unused-debug-types\
> 
>    |              -c misc.c
> 
>    | ./sysinfo.sh arm-linux-gnueabihf-gcc  -march=armv7-a    -marm
>    -mthumb-interwork -mfloat-abi=hard -mfpu=neon -mtune=cortex-a15 
>    -isystem/opt/linaro-2013.03/arm-linux-gnueabihf/include  -fstack-protector
>    -D_FORTIFY_SOURCE=1 -O2 -pipe -g -feliminate-unused-debug-types 
>    -L/opt/linaro-2013.03/arm-linux-gnueabihf/lib
>    -Wl,-rpath-link,/opt/linaro-2013.03/arm-linux-gnueabihf/lib -Wl,-O1
>    -Wl,--hash-style=gnu
>    --sysroot=/home/gtbldadm/yocto/mcsdk-3_00_00_11/oe-layersetup-mcsdk/build/arago-tmp-external-linaro-toolchain/sysroots/keystone-evm 
>    -DLINUX  -isystem/opt/linaro-2013.03/arm-linux-gnueabihf/include 
>    -fstack-protector -D_FORTIFY_SOURCE=1 -O2 -pipe -g
>    -feliminate-unused-debug-types
> 
>    | ./sysinfo.sh arm-linux-gnueabihf-gcc  -march=armv7-a    -marm
>    -mthumb-interwork -mfloat-abi=hard -mfpu=neon -mtune=cortex-a15 
>    -isystem/opt/linaro-2013.03/arm-linux-gnueabihf/include  -fstack-protector
>    -D_FORTIFY_SOURCE=1 -O2 -pipe -g -feliminate-unused-debug-types 
>    -L/opt/linaro-2013.03/arm-linux-gnueabihf/lib
>    -Wl,-rpath-link,/opt/linaro-2013.03/arm-linux-gnueabihf/lib -Wl,-O1
>    -Wl,--hash-style=gnu
>    --sysroot=/home/gtbldadm/yocto/mcsdk-3_00_00_11/oe-layersetup-mcsdk/build/arago-tmp-external-linaro-toolchain/sysroots/keystone-evm 
>    -DLINUX  -isystem/opt/linaro-2013.03/arm-linux-gnueabihf/include 
>    -fstack-protector -D_FORTIFY_SOURCE=1 -O2 -pipe -g
>    -feliminate-unused-debug-types
> 
>    | In file included from misc.h:36:0,
> 
>    |                  from misc.c:23:
> 
>    | nmglobal.h:29:21: fatal error: pointer.h: No such file or directory
> 
>    | compilation terminated.
> 
>    | make: *** [misc.o] Error 1
> 
>    | make: *** Waiting for unfinished jobs....
> 
>    | ERROR: oe_runmake failed
> 
>    | ERROR: Function failed: do_compile (see
>    /home/gtbldadm/yocto/mcsdk-3_00_00_11/oe-layersetup-mcsdk/build/arago-tmp-external-linaro-toolchain/work/armv7ahf-vfp-neon-oe-linux-gnueabi/nbench-byte-2.2.3-r0/temp/log.do_compile.28346
>    for further information)
> 
>    NOTE: recipe nbench-byte-2.2.3-r0: task do_compile: Failed
> 
>    ERROR: Task 2812
>    (/home/gtbldadm/yocto/mcsdk-3_00_00_11/oe-layersetup-mcsdk/sources/meta-openembedded/meta-oe/recipes-benchmark/nbench-byte/nbench-byte_2.2.3.bb,
>    do_compile) failed with exit code '1'
> 
>    WARNING: QA Issue: syslog-ng: Files/directories were installed but not
>    shipped
> 
>     

Re: Help needed: (Resend) Failures with nbench

[Ranjeet]

> Denys Dmytriyenko <denys@...> writes:
 From your description of the problem it looks like a race condition. You 
can try adding this line to the recipe to force building nbench package in a 
single thread - see if it helps:
> 
> PARALLEL_MAKE = ""
> 

Adding 
PARALLEL_MAKE = ""

worked for me! Thanks :)