From: Saul Wold <sgw@linux.intel.com>
To: Patches and discussions about the oe-core layer
<openembedded-core@lists.openembedded.org>
Cc: Koen Kooi <koen@dominion.thruhere.net>
Subject: Re: [PATCH 0/3] Fix xz compression command and optimize compression time
Date: Tue, 17 Jul 2012 09:27:42 -0700 [thread overview]
Message-ID: <5005927E.6000509@linux.intel.com> (raw)
In-Reply-To: <cover.1342116650.git.andrei@gherzan.ro>
On 07/12/2012 11:13 AM, Andrei Gherzan wrote:
> Koen suggested to add -T to xz commands. We have this option implemented in our current version .1alpha.
>
> -T threads, --threads=threads
> Specify the number of worker threads to use. Setting threads to
> a special value 0 makes xz use as many threads as there are CPU
> cores on the system. The actual number of threads can be less
> than threads if the input file is not big enough for threading
> with the given settings or if using more threads would exceed
> the memory usage limit.
>
> -------------------
>
> Memory: 7.8 GiB
> Processor:: Intel® Core™ i5-2540M CPU @ 2.60GHz × 4
>
> File to compress: 1.9G
>
> xz -f -k -e -9 --check=crc32 (current configuration)
> Memory: 673Mb
> real 6m37.170s
> user 6m35.389s
> sys 0m0.884s
> Compressed file size: 3.4Mb
>
> xz -f -k -e -9 -T 4 --check=crc32
> Memory: Cannot allocate memory
>
> xz -f -k -e -8 -T 4 --check=crc32
> Memory: 1.8G
> real 3m24.462s
> user 12m8.502s
> sys 0m2.180s
> Compressed file size: 3.4Mb
>
> xz -f -k -T 4 --check=crc32 (-e defaults to -6)
> Memory: 471Mb
> real 1m9.265s
> user 4m8.972s
> sys 0m0.944s
> Compressed file size: 3.4Mb
>
> So my conclusion would be to use the default -e -6 with -T 0.
>
> The following changes since commit 90ad663909c0c8a405b22a510c9f957007d02669:
>
> upstream_tracking: update boost (2012-07-09 17:21:38 +0100)
>
> are available in the git repository at:
>
> git://git.yoctoproject.org/poky-contrib ag/xz
> http://git.yoctoproject.org/cgit.cgi/poky-contrib/log/?h=ag/xz
>
> Andrei Gherzan (3):
> image_types.bbclass: Fix COMPRESS_CMD for xz to redirect compressed
> data to file
> image_types.bbclass: Add XZ variable to set number of threads to be
> used while compressing
> image_types.bbclass: Default XZ_COMPRESSION_LEVEL to -e -6
>
> meta/classes/image_types.bbclass | 5 +++--
> 1 file changed, 3 insertions(+), 2 deletions(-)
>
Merged into OE-Core
Thanks
Sau!
prev parent reply other threads:[~2012-07-17 16:39 UTC|newest]
Thread overview: 15+ messages / expand[flat|nested] mbox.gz Atom feed top
2012-07-12 18:13 [PATCH 0/3] Fix xz compression command and optimize compression time Andrei Gherzan
2012-07-12 18:13 ` [PATCH 1/3] image_types.bbclass: Fix COMPRESS_CMD for xz to redirect compressed data to file Andrei Gherzan
2012-07-12 18:13 ` [PATCH 2/3] image_types.bbclass: Add XZ variable to set number of threads to be used while compressing Andrei Gherzan
2012-07-12 18:13 ` [PATCH 3/3] image_types.bbclass: Default XZ_COMPRESSION_LEVEL to -e -6 Andrei Gherzan
2012-07-12 18:58 ` [PATCH 0/3] Fix xz compression command and optimize compression time Koen Kooi
2012-07-12 19:20 ` McClintock Matthew-B29882
2012-07-12 19:22 ` Saul Wold
2012-07-12 19:59 ` Andrei Gherzan
2012-07-12 20:14 ` Khem Raj
2012-07-13 6:45 ` Koen Kooi
2012-07-13 8:19 ` Andrea Adami
2012-07-13 9:44 ` Andrei Gherzan
2012-07-13 9:54 ` Andrea Adami
2012-07-13 9:59 ` Andrei Gherzan
2012-07-17 16:27 ` Saul Wold [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=5005927E.6000509@linux.intel.com \
--to=sgw@linux.intel.com \
--cc=koen@dominion.thruhere.net \
--cc=openembedded-core@lists.openembedded.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox