Toolchain rework, call for testing

Toolchain rework, call for testing

[Khem Raj]

Hi All

Recently glibc build has been simplified upstream. It has dropped the
dependency on libgcc_s and libgcc_eh for building glibc itself.
This means that we can simplify our toolchain bootstrap a bit by
dropping 1 of the 3 cross gcc build stages. We do not need
gcc-cross-intermediate
anymore. This should bring some build time reduction and simplify the
bootstrap. I have a series of patches which I have tested
by building core-image-minimal and meta-toolchain for all supported
qemu architectures and also uclibc/eglibc both
but it needs a lot more testing therefore I am calling out wider
audience for help in testing it out.

The branch is

http://git.openembedded.org/openembedded-core-contrib/log/?h=kraj/toolchain-rework

Thanks

-Khem

Re: Toolchain rework, call for testing

[Jack Mitchell]

On 17/08/12 05:47, Khem Raj wrote:
> Hi All
>
> Recently glibc build has been simplified upstream. It has dropped the
> dependency on libgcc_s and libgcc_eh for building glibc itself.
> This means that we can simplify our toolchain bootstrap a bit by
> dropping 1 of the 3 cross gcc build stages. We do not need
> gcc-cross-intermediate
> anymore. This should bring some build time reduction and simplify the
> bootstrap. I have a series of patches which I have tested
> by building core-image-minimal and meta-toolchain for all supported
> qemu architectures and also uclibc/eglibc both
> but it needs a lot more testing therefore I am calling out wider
> audience for help in testing it out.
>
> The branch is
>
> http://git.openembedded.org/openembedded-core-contrib/log/?h=kraj/toolchain-rework
>
> Thanks
>
> -Khem
>
> _______________________________________________
> Openembedded-devel mailing list
> Openembedded-devel@lists.openembedded.org
> http://lists.linuxtogo.org/cgi-bin/mailman/listinfo/openembedded-devel


Hi Khem,

I successfully built core-image-minimal for qemuarm and tested it in 
qemu with a completely fresh clone.

Build output as follows:

    [jack@archHP build]$ bitbake core-image-minimal
    Pseudo is not present but is required, building this first before
    the main build
    Parsing recipes: 100%
    |###############################################################################|
    ETA:  00:00:00
    Parsing of 824 .bb files complete (0 cached, 824 parsed). 1122
    targets, 36 skipped, 0 masked, 0 errors.

    Build Configuration:
    BB_VERSION        = "1.15.3"
    TARGET_ARCH       = "arm"
    TARGET_OS         = "linux-gnueabi"
    MACHINE           = "qemuarm"
    DISTRO_VERSION    = "oe-core.0"
    TUNE_FEATURES     = "armv5 dsp thumb arm926ejs"
    TARGET_FPU        = "soft"
    meta              =
    "kraj/toolchain-rework:126a0363d03c1f5ff7a6b8ae0939d1a9ff8336f0"

    NOTE: Resolving any missing task queue dependencies
    NOTE: Preparing runqueue
    NOTE: Executing SetScene Tasks
    NOTE: Executing RunQueue Tasks
    NOTE: Tasks Summary: Attempted 63 tasks of which 0 didn't need to be
    rerun and all succeeded.
    Loading cache: 100%
    |#################################################################################|
    ETA:  00:00:00
    Loaded 1123 entries from dependency cache.

    Build Configuration:
    BB_VERSION        = "1.15.3"
    TARGET_ARCH       = "arm"
    TARGET_OS         = "linux-gnueabi"
    MACHINE           = "qemuarm"
    DISTRO_VERSION    = "oe-core.0"
    TUNE_FEATURES     = "armv5 dsp thumb arm926ejs"
    TARGET_FPU        = "soft"
    meta              =
    "kraj/toolchain-rework:126a0363d03c1f5ff7a6b8ae0939d1a9ff8336f0"

    NOTE: Resolving any missing task queue dependencies
    NOTE: Preparing runqueue
    NOTE: Executing SetScene Tasks
    NOTE: Executing RunQueue Tasks
    WARNING: Failed to fetch URL
    http://kernel.org/pub/linux/libs/security/linux-privs/libcap2/libcap-2.22.tar.bz2,
    attempting MIRRORS if available
    WARNING: Failed to fetch URL
    http://www.apache.org/dist/subversion/subversion-1.7.2.tar.bz2,
    attempting MIRRORS if available
    WARNING: Failed to fetch URL
    ftp://ftp.ossp.org/pkg/lib/uuid/uuid-1.6.2.tar.gz, attempting
    MIRRORS if available
    WARNING: unifdef-native: No generic license file exists for: GPL in
    any provider
    WARNING: Failed to fetch URL
    http://kernel.org/pub/linux/kernel/people/jsipek/guilt/guilt-0.33.tar.gz,
    attempting MIRRORS if available
    ERROR: chrpath command failed with exit code 7
    ERROR: chrpath command failed with exit code 7
    WARNING: ossp-uuid-native: No generic license file exists for:
    ossp_uuid in any provider
    WARNING: Failed to fetch URL
    ftp://ftp.debian.org/debian/pool/main/b/base-passwd/base-passwd_3.5.24.tar.gz,
    attempting MIRRORS if available
    WARNING: Failed to fetch URL
    http://kernel.org/pub/linux/utils/kernel/hotplug/udev-164.tar.gz,
    attempting MIRRORS if available
    NOTE: validating kernel configuration

    WARNING: QA Issue: udev: /lib/libgudev-1.0.so.0.0.1, installed in
    the base_prefix, requires a shared library under exec_prefix (/usr):
    libgobject-2.0.so.0 => /usr/lib/libgobject-2.0.so.0 (0xdead2000)
    WARNING: QA Issue: udev: /lib/libgudev-1.0.so.0.0.1, installed in
    the base_prefix, requires a shared library under exec_prefix (/usr):
    libgthread-2.0.so.0 => /usr/lib/libgthread-2.0.so.0 (0xdead3000)
    WARNING: QA Issue: udev: /lib/libgudev-1.0.so.0.0.1, installed in
    the base_prefix, requires a shared library under exec_prefix (/usr):
    libffi.so.5 => /usr/lib/libffi.so.5 (0xdead4000)
    WARNING: QA Issue: udev: /lib/libgudev-1.0.so.0.0.1, installed in
    the base_prefix, requires a shared library under exec_prefix (/usr):
    libglib-2.0.so.0 => /usr/lib/libglib-2.0.so.0 (0xdead5000)
    WARNING: QA Issue: udev: /lib/udev/udev-acl, installed in the
    base_prefix, requires a shared library under exec_prefix (/usr):
    libglib-2.0.so.0 => /usr/lib/libglib-2.0.so.0 (0xdead2000)
    NOTE: Tasks Summary: Attempted 1513 tasks of which 236 didn't need
    to be rerun and all succeeded.

    Summary: There were 13 WARNING messages shown.
    Summary: There were 2 ERROR messages shown, returning a non-zero
    exit code.


Regards,

-- 

   Jack Mitchell (jack@embed.me.uk)
   Embedded Systems Engineer
   http://www.embed.me.uk

--

Re: [yocto] Toolchain rework, call for testing

[Martin Jansa]

[-- Attachment #1: Type: text/plain, Size: 3137 bytes --]

On Thu, Aug 16, 2012 at 09:47:37PM -0700, Khem Raj wrote:
> Hi All
> 
> Recently glibc build has been simplified upstream. It has dropped the
> dependency on libgcc_s and libgcc_eh for building glibc itself.
> This means that we can simplify our toolchain bootstrap a bit by
> dropping 1 of the 3 cross gcc build stages. We do not need
> gcc-cross-intermediate
> anymore. This should bring some build time reduction and simplify the
> bootstrap. I have a series of patches which I have tested
> by building core-image-minimal and meta-toolchain for all supported
> qemu architectures and also uclibc/eglibc both
> but it needs a lot more testing therefore I am calling out wider
> audience for help in testing it out.
> 
> The branch is
> 
> http://git.openembedded.org/openembedded-core-contrib/log/?h=kraj/toolchain-rework

eglibc fails to build in incremental build

| arm-oe-linux-gnueabi-gcc  -march=armv4t -marm -mthumb-interwork -mtune=arm920t --sysroot=/OE/shr-core/tmp-eglibc/sysroots/om-gta02-tcbootstrap   -nostdlib -nostartfiles -r -o /OE/shr-core/tmp-eglibc/work/armv4t-oe-linux-gnueabi/eglibc-2.16-r6+svnr19922/build-arm-oe-linux-gnueabi/libc_pic.os \
|  -Wl,-d -Wl,--whole-archive /OE/shr-core/tmp-eglibc/work/armv4t-oe-linux-gnueabi/eglibc-2.16-r6+svnr19922/build-arm-oe-linux-gnueabi/libc_pic.a -o /OE/shr-core/tmp-eglibc/work/armv4t-oe-linux-gnueabi/eglibc-2.16-r6+svnr19922/build-arm-oe-linux-gnueabi/libc_pic.os
| arm-oe-linux-gnueabi-gcc  -march=armv4t -marm -mthumb-interwork -mtune=arm920t --sysroot=/OE/shr-core/tmp-eglibc/sysroots/om-gta02-tcbootstrap   -nostdlib -nostartfiles -r -o /OE/shr-core/tmp-eglibc/work/armv4t-oe-linux-gnueabi/eglibc-2.16-r6+svnr19922/build-arm-oe-linux-gnueabi/elf/librtld.map.o '-Wl,-(' /OE/shr-core/tmp-eglibc/work/armv4t-oe-linux-gnueabi/eglibc-2.16-r6+svnr19922/build-arm-oe-linux-gnueabi/elf/dl-allobjs.os /OE/shr-core/tmp-eglibc/work/armv4t-oe-linux-gnueabi/eglibc-2.16-r6+svnr19922/build-arm-oe-linux-gnueabi/libc_pic.a -lgcc '-Wl,-)' -Wl,-Map,/OE/shr-core/tmp-eglibc/work/armv4t-oe-linux-gnueabi/eglibc-2.16-r6+svnr19922/build-arm-oe-linux-gnueabi/elf/librtld.mapT
| /OE/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/libexec/armv4t-oe-linux-gnueabi.gcc-cross-initial/gcc/arm-oe-linux-gnueabi/4.7.2/ld: cannot find -lgcc
| collect2: error: ld returned 1 exit status
| make[2]: *** [/OE/shr-core/tmp-eglibc/work/armv4t-oe-linux-gnueabi/eglibc-2.16-r6+svnr19922/build-arm-oe-linux-gnueabi/elf/librtld.map] Error 1
| make[2]: *** Waiting for unfinished jobs....
| make[2]: Leaving directory `/OE/shr-core/tmp-eglibc/work/armv4t-oe-linux-gnueabi/eglibc-2.16-r6+svnr19922/eglibc-2_16/libc/elf'
| make[1]: *** [elf/subdir_lib] Error 2
| make[1]: Leaving directory `/OE/shr-core/tmp-eglibc/work/armv4t-oe-linux-gnueabi/eglibc-2.16-r6+svnr19922/eglibc-2_16/libc'

Maybe it's because 
http://git.openembedded.org/openembedded-core/commit/?id=30617bde61a3b0a0944b49a0c9fb7159dacbb19f
is missing PR bump and gcc wasn't rebuilt before eglibc upgrade (OEBasic not OEBasicHash here).

Cheers,
-- 
Martin 'JaMa' Jansa     jabber: Martin.Jansa@gmail.com

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 205 bytes --]

Re: [yocto] Toolchain rework, call for testing

[Khem Raj]

On Tue, Aug 21, 2012 at 5:18 AM, Martin Jansa <martin.jansa@gmail.com> wrote:
>
> Maybe it's because
> http://git.openembedded.org/openembedded-core/commit/?id=30617bde61a3b0a0944b49a0c9fb7159dacbb19f
> is missing PR bump and gcc wasn't rebuilt before eglibc upgrade (OEBasic not OEBasicHash here).

yes seems so. I have stopped using OEBasic long ago, you should stop
using it too.
But feel free to send a PR bump patchlet.

Re: [yocto] Toolchain rework, call for testing

[Martin Jansa]

[-- Attachment #1: Type: text/plain, Size: 700 bytes --]

On Tue, Aug 21, 2012 at 10:15:47AM -0700, Khem Raj wrote:
> On Tue, Aug 21, 2012 at 5:18 AM, Martin Jansa <martin.jansa@gmail.com> wrote:
> >
> > Maybe it's because
> > http://git.openembedded.org/openembedded-core/commit/?id=30617bde61a3b0a0944b49a0c9fb7159dacbb19f
> > is missing PR bump and gcc wasn't rebuilt before eglibc upgrade (OEBasic not OEBasicHash here).
> 
> yes seems so. I have stopped using OEBasic long ago, you should stop
> using it too.

I'm using OEBasicHash on one jenkins setup, but that one is still
building changes from 2 days ago.. (building 24/7.. )

> But feel free to send a PR bump patchlet.

-- 
Martin 'JaMa' Jansa     jabber: Martin.Jansa@gmail.com

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 205 bytes --]