[Buildroot] Results of an all-package build

[Buildroot] Results of an all-package build

[Arnout Vandecappelle]

  Hi all,

  As part of the test of the disable-doc patch I just sent, I built something
approaching an allyespackageconfig for x86_64 with a Sourcery-2012.09 toolchain.
Interesting to look at the results.

- The following fail to build:

  * classpath
  * diffutils
  * gpsd
  * ipsec-tools
  * linux-pam
  * ltp-testsuite
  * matchbox-desktop
  * metacity
  * webkit
  * neard
  * netatalk
  * network-manager
  * pcmanfm
  * pv
  * sconeserver-http-sconesite-image
  * xdriver_xf86-video-geode
  * xdriver_xf86-input-synaptics
  * valgrind (because glibc 2.16 is not supported, needs valgrind bump)
  * xstroke
  * grub
  * uboot (wrong ARCH parameter)

  midori and jamvm are not built because they depend on the above.

  There are a few more that fail to build in my environment if the
libxml2/mesa3d and linux-fusion patches are not applied. Also xenomai
must be extracted manually before the build, otherwise linux fails to
build.

- About 920 packages (host+target) are built, from 843 source
tarballs.

- legal-info succeeds without problems, except that sylpheed's
license file is not correctly defined.

- I also built a 3.2.28 kernel with Xenomai extension (OCF and RTAI
don't have support for that kernel version) and a x86_64 defconfig.

- cramfs fails to build because it's too large; iso9660 fails to
build because of grub.

- Resulting image sizes:

-rw-r--r-- 1 arnout arnout 374M Dec 13 05:47 bzImage
-rwxr-xr-x 1 arnout arnout  24K Dec 13 05:31 isolinux.bin*
-rwxr-xr-x 1 arnout arnout  27K Dec 13 05:31 pxelinux.bin*
-rw-r--r-- 1 arnout arnout 378M Dec 13 05:38 rootfs.cloop
-rw-r--r-- 1 arnout arnout 903M Dec 13 05:40 rootfs.cpio
-rw-r--r-- 1 arnout arnout 1.1G Dec 13 05:42 rootfs.ext2
-rw-r--r-- 1 arnout arnout 473M Dec 13 05:51 rootfs.jffs2
-rw-r--r-- 1 arnout arnout 899M Dec 13 05:54 rootfs.romfs
-rw-r--r-- 1 arnout arnout 369M Dec 13 05:56 rootfs.squashfs
-rw-r--r-- 1 arnout arnout 922M Dec 13 05:59 rootfs.tar
-rw-r--r-- 1 arnout arnout 251M Dec 13 06:12 rootfs.tar.lzma
-rw-r--r-- 1 arnout arnout 516M Dec 13 06:15 rootfs.ubi
-rw-r--r-- 1 arnout arnout 508M Dec 13 06:15 rootfs.ubifs

- The output directory (including all these images) is 31GB: 21GB
for build, 6.5GB for images, 2.9GB for host of which 2GB for staging.
The sources (excluding toolchain) are 1.6GB.

- Time for a clean build (without ccache and JLEVEL=3) on my laptop
is 6 hours. A yocto build takes roughly the same time on my laptop,
but has less than half as many packages.


  Regards,
  Arnout

-- 
Arnout Vandecappelle                               arnout at mind be
Senior Embedded Software Architect                 +32-16-286540
Essensium/Mind                                     http://www.mind.be
G.Geenslaan 9, 3001 Leuven, Belgium                BE 872 984 063 RPR Leuven
LinkedIn profile: http://www.linkedin.com/in/arnoutvandecappelle
GPG fingerprint:  7CB5 E4CC 6C2E EFD4 6E3D A754 F963 ECAB 2450 2F1F

[Buildroot] Results of an all-package build

[Peter Korsgaard]

>>>>> "Arnout" == Arnout Vandecappelle <arnout@mind.be> writes:

Hi,

 Arnout>  As part of the test of the disable-doc patch I just sent, I
 Arnout> built something approaching an allyespackageconfig for x86_64
 Arnout> with a Sourcery-2012.09 toolchain.  Interesting to look at the
 Arnout> results.

 Arnout> - The following fail to build:

 Arnout>  * classpath
 Arnout>  * diffutils
 Arnout>  * gpsd
 Arnout>  * ipsec-tools
 Arnout>  * linux-pam
 Arnout>  * ltp-testsuite
 Arnout>  * matchbox-desktop
 Arnout>  * metacity
 Arnout>  * webkit
 Arnout>  * neard
 Arnout>  * netatalk
 Arnout>  * network-manager
 Arnout>  * pcmanfm
 Arnout>  * pv
 Arnout>  * sconeserver-http-sconesite-image
 Arnout>  * xdriver_xf86-video-geode
 Arnout>  * xdriver_xf86-input-synaptics
 Arnout>  * valgrind (because glibc 2.16 is not supported, needs valgrind bump)
 Arnout>  * xstroke
 Arnout>  * grub
 Arnout>  * uboot (wrong ARCH parameter)

 Arnout>  midori and jamvm are not built because they depend on the above.

Interesting, and better than I feared ;) Do you have the build errors
archived somewhere? I would like to see atleast the classpath issue.


 Arnout>  There are a few more that fail to build in my environment if the
 Arnout> libxml2/mesa3d and linux-fusion patches are not applied. Also xenomai
 Arnout> must be extracted manually before the build, otherwise linux fails to
 Arnout> build.

 Arnout> - About 920 packages (host+target) are built, from 843 source
 Arnout> tarballs.

 Arnout> - legal-info succeeds without problems, except that sylpheed's
 Arnout> license file is not correctly defined.

Ok, could you provide a bit more info or send patches, please?


 Arnout> -rw-r--r-- 1 arnout arnout 374M Dec 13 05:47 bzImage
 Arnout> -rwxr-xr-x 1 arnout arnout  24K Dec 13 05:31 isolinux.bin*
 Arnout> -rwxr-xr-x 1 arnout arnout  27K Dec 13 05:31 pxelinux.bin*
 Arnout> -rw-r--r-- 1 arnout arnout 378M Dec 13 05:38 rootfs.cloop
 Arnout> -rw-r--r-- 1 arnout arnout 903M Dec 13 05:40 rootfs.cpio
 Arnout> -rw-r--r-- 1 arnout arnout 1.1G Dec 13 05:42 rootfs.ext2
 Arnout> -rw-r--r-- 1 arnout arnout 473M Dec 13 05:51 rootfs.jffs2
 Arnout> -rw-r--r-- 1 arnout arnout 899M Dec 13 05:54 rootfs.romfs
 Arnout> -rw-r--r-- 1 arnout arnout 369M Dec 13 05:56 rootfs.squashfs
 Arnout> -rw-r--r-- 1 arnout arnout 922M Dec 13 05:59 rootfs.tar
 Arnout> -rw-r--r-- 1 arnout arnout 251M Dec 13 06:12 rootfs.tar.lzma
 Arnout> -rw-r--r-- 1 arnout arnout 516M Dec 13 06:15 rootfs.ubi
 Arnout> -rw-r--r-- 1 arnout arnout 508M Dec 13 06:15 rootfs.ubifs

 Arnout> - The output directory (including all these images) is 31GB: 21GB
 Arnout> for build, 6.5GB for images, 2.9GB for host of which 2GB for staging.
 Arnout> The sources (excluding toolchain) are 1.6GB.

 Arnout> - Time for a clean build (without ccache and JLEVEL=3) on my laptop
 Arnout> is 6 hours. A yocto build takes roughly the same time on my laptop,
 Arnout> but has less than half as many packages.

Heh. Nice, it seems doable to do this on a relatively regular schedule.

Thanks!

-- 
Bye, Peter Korsgaard

[Buildroot] Results of an all-package build

[Arnout Vandecappelle]

On 16/12/12 01:07, Peter Korsgaard wrote:
>>>>>> "Arnout" == Arnout Vandecappelle<arnout@mind.be>  writes:
> 
> Hi,
> 
>   Arnout>   As part of the test of the disable-doc patch I just sent, I
>   Arnout>  built something approaching an allyespackageconfig for x86_64
>   Arnout>  with a Sourcery-2012.09 toolchain.  Interesting to look at the
>   Arnout>  results.
> 
>   Arnout>  - The following fail to build:
> 
>   Arnout>   * classpath
>   Arnout>   * diffutils
>   Arnout>   * gpsd
>   Arnout>   * ipsec-tools
>   Arnout>   * linux-pam
>   Arnout>   * ltp-testsuite
>   Arnout>   * matchbox-desktop
>   Arnout>   * metacity
>   Arnout>   * webkit
>   Arnout>   * neard
>   Arnout>   * netatalk
>   Arnout>   * network-manager
>   Arnout>   * pcmanfm
>   Arnout>   * pv
>   Arnout>   * sconeserver-http-sconesite-image
>   Arnout>   * xdriver_xf86-video-geode
>   Arnout>   * xdriver_xf86-input-synaptics
>   Arnout>   * valgrind (because glibc 2.16 is not supported, needs valgrind bump)
>   Arnout>   * xstroke
>   Arnout>   * grub
>   Arnout>   * uboot (wrong ARCH parameter)
> 
>   Arnout>   midori and jamvm are not built because they depend on the above.
> 
> Interesting, and better than I feared ;) Do you have the build errors
> archived somewhere? I would like to see atleast the classpath issue.

 No I haven't, but they're easy enough to reproduce.

 For classpath:

checking for QtCore QtGui >= 4.1.0... yes
checking QT_CFLAGS... -I/home/arnout/src/buildroot/output-ext-toolchain-x86_64/host/usr/x86_64-buildroot-linux-gnu/sysroot/usr/include/QtGui -DQT_SHARED -I/home/arnout/src/buildroot/output-ext-toolchain-x86_64/host/usr/x86_64-buildroot-linux-gnu/sysroot/usr/include -I/home/arnout/src/buildroot/output-ext-toolchain-x86_64/host/usr/x86_64-buildroot-linux-gnu/sysroot/usr/include/QtCore  
checking QT_LIBS... -lQtGui -L/home/arnout/src/buildroot/output-ext-toolchain-x86_64/host/usr/x86_64-buildroot-linux-gnu/sysroot/usr/lib -lQtCore  
checking for /home/arnout/src/buildroot/output-ext-toolchain-x86_64/host/usr/x86_64-buildroot-linux-gnu/sysroot/usr/include/QtGui/QWidget... configure: error: cannot check for file existence when cross compiling


 I'll try to re-run current HEAD (which has fixed quite a few packages
already) with make -k and put it on a pastebin.


>   Arnout>   There are a few more that fail to build in my environment if the
>   Arnout>  libxml2/mesa3d and linux-fusion patches are not applied. Also xenomai
>   Arnout>  must be extracted manually before the build, otherwise linux fails to
>   Arnout>  build.
> 
>   Arnout>  - About 920 packages (host+target) are built, from 843 source
>   Arnout>  tarballs.
> 
>   Arnout>  - legal-info succeeds without problems, except that sylpheed's
>   Arnout>  license file is not correctly defined.
> 
> Ok, could you provide a bit more info or send patches, please?

 You already fixed it :-)

[snip]
>   Arnout>  - Time for a clean build (without ccache and JLEVEL=3) on my laptop
>   Arnout>  is 6 hours. A yocto build takes roughly the same time on my laptop,
>   Arnout>  but has less than half as many packages.
> 
> Heh. Nice, it seems doable to do this on a relatively regular schedule.

 Yep. Although the Linaro toolchain is probably a more appropriate choice.

 Regards,
 Arnout


-- 
Arnout Vandecappelle                               arnout at mind be
Senior Embedded Software Architect                 +32-16-286540
Essensium/Mind                                     http://www.mind.be
G.Geenslaan 9, 3001 Leuven, Belgium                BE 872 984 063 RPR Leuven
LinkedIn profile: http://www.linkedin.com/in/arnoutvandecappelle
GPG fingerprint:  7CB5 E4CC 6C2E EFD4 6E3D A754 F963 ECAB 2450 2F1F

[Buildroot] Results of an all-package build

[Arnout Vandecappelle]

On 17/12/12 09:49, Arnout Vandecappelle wrote:
> On 16/12/12 01:07, Peter Korsgaard wrote:
>>>>>>> >>>>>>  "Arnout" == Arnout Vandecappelle<arnout@mind.be>   writes:
>> >
>> >  Hi,
>> >
>> >     Arnout>    As part of the test of the disable-doc patch I just sent, I
>> >     Arnout>   built something approaching an allyespackageconfig for x86_64
>> >     Arnout>   with a Sourcery-2012.09 toolchain.  Interesting to look at the
>> >     Arnout>   results.
>> >
>> >     Arnout>   - The following fail to build:
>> >
>> >     Arnout>    * classpath
>> >     Arnout>    * diffutils
>> >     Arnout>    * gpsd
>> >     Arnout>    * ipsec-tools
>> >     Arnout>    * linux-pam
>> >     Arnout>    * ltp-testsuite
>> >     Arnout>    * matchbox-desktop
>> >     Arnout>    * metacity
>> >     Arnout>    * webkit

  Webkit is fixed now.

>> >     Arnout>    * neard
>> >     Arnout>    * netatalk

  Not fixed by lib64 patch...

>> >     Arnout>    * network-manager
>> >     Arnout>    * pcmanfm
>> >     Arnout>    * pv
>> >     Arnout>    * sconeserver-http-sconesite-image

  Not fixed by using pkg-config...

>> >     Arnout>    * xdriver_xf86-video-geode
>> >     Arnout>    * xdriver_xf86-input-synaptics
>> >     Arnout>    * valgrind (because glibc 2.16 is not supported, needs valgrind bump)
>> >     Arnout>    * xstroke
>> >     Arnout>    * grub
>> >     Arnout>    * uboot (wrong ARCH parameter)

>   I'll try to re-run current HEAD (which has fixed quite a few packages
> already) with make -k and put it on a pastebin.

  The results of a make -k of just these packages (except for grub and 
uboot) is on http://tny.cz/8f1cf19f .

  Regards,
  Arnout

-- 
Arnout Vandecappelle                               arnout at mind be
Senior Embedded Software Architect                 +32-16-286540
Essensium/Mind                                     http://www.mind.be
G.Geenslaan 9, 3001 Leuven, Belgium                BE 872 984 063 RPR Leuven
LinkedIn profile: http://www.linkedin.com/in/arnoutvandecappelle
GPG fingerprint:  7CB5 E4CC 6C2E EFD4 6E3D A754 F963 ECAB 2450 2F1F

[Buildroot] Results of an all-package build

[Arnout Vandecappelle]

On 16/12/12 01:07, Peter Korsgaard wrote:
>   Arnout>   midori and jamvm are not built because they depend on the above.
>
> Interesting, and better than I feared;)  Do you have the build errors
> archived somewhere? I would like to see atleast the classpath issue.

  FYI, the classpath issue occurs when Qt is enabled. It's configure.ac 
uses AC_CHECK_FILE which isn't supported when cross-compiling. It should 
use AC_CHECK_HEADER instead.

  Regards,
  Arnout

-- 
Arnout Vandecappelle                               arnout at mind be
Senior Embedded Software Architect                 +32-16-286540
Essensium/Mind                                     http://www.mind.be
G.Geenslaan 9, 3001 Leuven, Belgium                BE 872 984 063 RPR Leuven
LinkedIn profile: http://www.linkedin.com/in/arnoutvandecappelle
GPG fingerprint:  7CB5 E4CC 6C2E EFD4 6E3D A754 F963 ECAB 2450 2F1F