From: Jack Mitchell <ml@communistcode.co.uk>
To: openembedded-core@lists.openembedded.org
Subject: Re: Accelerate do_package
Date: Fri, 12 Oct 2012 13:13:12 +0100 [thread overview]
Message-ID: <50780958.4080209@communistcode.co.uk> (raw)
In-Reply-To: <CAGiJk9fX67UyL_NQo-TWUzgpu=0wq6N3u9pDmKnOskbsjNhxAQ@mail.gmail.com>
On 12/10/12 12:43, Samuel Stirtzel wrote:
> Hi,
> after re-building Qt the third time today, I was curious why
> do_package takes this long.
>
> From my investigation it looks like the library stripping is the culprit,
> it lets my system idle with 5% CPU usage over a long time.
>
> Would it be possible to accelerate do_package with parallelisation?
> Likely I could look into this sometime soon, but I'd rather hear your
> thoughts on this first.
>
>
> PS:
> Also sstate creation and rootfs packing could be made faster with
> pbzip2 [1] / pigz [2] (we have a recipe for pigz), or is anthing
> preventing this?
>
> [1] http://compression.ca/pbzip2/
> [2] http://zlib.net/pigz/
>
>
Samuel,
You being up an interesting point here as I have recently been mulling
over ways of improving performance. I believe performance improvements
are one of the targets of the 1.4 yocto/oe-core release so it will be
properly discussed then.
In the meantime a couple of points I was thinking about related to
improving performance was by deeming some tasks as "non active" such as
they didn't take up a thread of your total specified. This could be
applied to low-cpu intensive tasks such as do_fetch and do_package which
I believe would greatly speed up the build and make more efficient use
of the CPU.
As for using pbzip2/pigz I believe there was a discussion on it and
something was said regarding the compatibility of the created archives.
For example an archive created by pigz could sometimes not be
uncompressed by gzip, I am just remembering this from memory though, I'm
sure a search of the list would be more enlightening.
Regards,
--
Jack Mitchell (jack@embed.me.uk)
Embedded Systems Engineer
http://www.embed.me.uk
--
next prev parent reply other threads:[~2012-10-12 12:24 UTC|newest]
Thread overview: 3+ messages / expand[flat|nested] mbox.gz Atom feed top
2012-10-12 11:43 Accelerate do_package Samuel Stirtzel
2012-10-12 12:13 ` Jack Mitchell [this message]
2012-10-12 12:24 ` Richard Purdie
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=50780958.4080209@communistcode.co.uk \
--to=ml@communistcode.co.uk \
--cc=openembedded-core@lists.openembedded.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.