do_package task of the kernel takes extremely long

do_package task of the kernel takes extremely long

[Daniel Kenji Morgan]

Hello,

I'm still fairly new to Yocto, and having some trouble with kernel
packaging taking an extremely long time.
I will try and keep details as simple as possible to explain my situation.

I am building images for the machine "imx6qsabrelite" in the
"meta-fsl-arm" BSP layer using Poky 1.3 (danny).
To make it easier to test out changes to the linux kernel source, I have
a copy of the source in a local subversion repository, which is checked
out to a local working copy.

I have created a kernel recipe to inherit "externalsrc" and set "S" to
the local working copy directory.
I have added a "configure_prepend" task to stage the build directory.
I use "bitbake core-image-minimal" to build the image.

Here is what I have found from checking the "do_package" task duration
of the kernel in the build stats:

1. Using a local working copy directory (subversion 1.6), the duration
exceeds 4000 seconds.

2. Using a local working copy directory (subversion 1.7), the duration
takes approximately 800 seconds.

3. Using the original kernel recipe which obtains the kernel source off
a Git repository from the internet, the duration takes approximately 400
seconds.

Checking the "do_package" task, it seems like all directories and
sub-directorys of the source are checked recursively in the process.
I think it's safe to say that the number of subversion administrative
directorys is affecting the "do_package" task duration.

Is there any way to make the "do_package" task ignore .svn
administrative directories?

Re: do_package task of the kernel takes extremely long

[Bruce Ashfield]

[-- Attachment #1: Type: text/plain, Size: 2863 bytes --]

On Thu, Jan 24, 2013 at 6:29 AM, Daniel Kenji Morgan <
daniel.kenji.morgan@gmail.com> wrote:

> Hello,
>
> I'm still fairly new to Yocto, and having some trouble with kernel
> packaging taking an extremely long time.
> I will try and keep details as simple as possible to explain my situation.
>
> I am building images for the machine "imx6qsabrelite" in the
> "meta-fsl-arm" BSP layer using Poky 1.3 (danny).
> To make it easier to test out changes to the linux kernel source, I have
> a copy of the source in a local subversion repository, which is checked
> out to a local working copy.
>

kernel source in subversion, is obviously not an optimal configuration,
see below.


>
> I have created a kernel recipe to inherit "externalsrc" and set "S" to
> the local working copy directory.
> I have added a "configure_prepend" task to stage the build directory.
> I use "bitbake core-image-minimal" to build the image.
>
> Here is what I have found from checking the "do_package" task duration
> of the kernel in the build stats:
>
> 1. Using a local working copy directory (subversion 1.6), the duration
> exceeds 4000 seconds.
>
> 2. Using a local working copy directory (subversion 1.7), the duration
> takes approximately 800 seconds.
>
> 3. Using the original kernel recipe which obtains the kernel source off
> a Git repository from the internet, the duration takes approximately 400
> seconds.
>
>
As for the fetch, it is a one time cost, incremental updates to the tree are
simple and fast, so it can't and shouldn't be counted as a constant
overhead.
The development advantages of working out of a git repository based kernel
are significant (in terms of efficiency and diagnostics, etc) and shouldn't
be
discounted.

But as for some of the other comments, they are known and tracked by
several items in the bugtracker to address these issues:

https://bugzilla.yoctoproject.org/show_bug.cgi?id=3517
https://bugzilla.yoctoproject.org/show_bug.cgi?id=2686

as well as other bitbake/build system generic items (that I can't find at
the moment).

I already have some items in progress for 3517, and they'll be out shortly
for
inclusion in yocto 1.4.

Cheers,

Bruce



> Checking the "do_package" task, it seems like all directories and
> sub-directorys of the source are checked recursively in the process.
> I think it's safe to say that the number of subversion administrative
> directorys is affecting the "do_package" task duration.
>
> Is there any way to make the "do_package" task ignore .svn
> administrative directories?
>
> _______________________________________________
> yocto mailing list
> yocto@yoctoproject.org
> https://lists.yoctoproject.org/listinfo/yocto
>



-- 
"Thou shalt not follow the NULL pointer, for chaos and madness await thee
at its end"

[-- Attachment #2: Type: text/html, Size: 4543 bytes --]