From: Jack Mitchell <ml@communistcode.co.uk>
To: openembedded-core@lists.openembedded.org
Subject: Re: Accelerate do_package
Date: Fri, 12 Oct 2012 13:13:12 +0100 [thread overview]
Message-ID: <50780958.4080209@communistcode.co.uk> (raw)
In-Reply-To: <CAGiJk9fX67UyL_NQo-TWUzgpu=0wq6N3u9pDmKnOskbsjNhxAQ@mail.gmail.com>
On 12/10/12 12:43, Samuel Stirtzel wrote:
> Hi,
> after re-building Qt the third time today, I was curious why
> do_package takes this long.
>
> From my investigation it looks like the library stripping is the culprit,
> it lets my system idle with 5% CPU usage over a long time.
>
> Would it be possible to accelerate do_package with parallelisation?
> Likely I could look into this sometime soon, but I'd rather hear your
> thoughts on this first.
>
>
> PS:
> Also sstate creation and rootfs packing could be made faster with
> pbzip2 [1] / pigz [2] (we have a recipe for pigz), or is anthing
> preventing this?
>
> [1] http://compression.ca/pbzip2/
> [2] http://zlib.net/pigz/
>
>
Samuel,
You being up an interesting point here as I have recently been mulling
over ways of improving performance. I believe performance improvements
are one of the targets of the 1.4 yocto/oe-core release so it will be
properly discussed then.
In the meantime a couple of points I was thinking about related to
improving performance was by deeming some tasks as "non active" such as
they didn't take up a thread of your total specified. This could be
applied to low-cpu intensive tasks such as do_fetch and do_package which
I believe would greatly speed up the build and make more efficient use
of the CPU.
As for using pbzip2/pigz I believe there was a discussion on it and
something was said regarding the compatibility of the created archives.
For example an archive created by pigz could sometimes not be
uncompressed by gzip, I am just remembering this from memory though, I'm
sure a search of the list would be more enlightening.
Regards,
--
Jack Mitchell (jack@embed.me.uk)
Embedded Systems Engineer
http://www.embed.me.uk
--
next prev parent reply other threads:[~2012-10-12 12:24 UTC|newest]
Thread overview: 3+ messages / expand[flat|nested] mbox.gz Atom feed top
2012-10-12 11:43 Accelerate do_package Samuel Stirtzel
2012-10-12 12:13 ` Jack Mitchell [this message]
2012-10-12 12:24 ` Richard Purdie
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=50780958.4080209@communistcode.co.uk \
--to=ml@communistcode.co.uk \
--cc=openembedded-core@lists.openembedded.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox