All of lore.kernel.org
 help / color / mirror / Atom feed
From: Alexander Kanavin <alexander.kanavin@linux.intel.com>
To: Leonardo Sandoval <leonardo.sandoval.gonzalez@linux.intel.com>
Cc: openembedded-core@lists.openembedded.org
Subject: Re: [PATCHv2 0/2] Multi-threaded RPM support
Date: Fri, 9 Jun 2017 12:13:15 +0300	[thread overview]
Message-ID: <ee386b4e-eb83-d201-da7e-28940c1202ff@linux.intel.com> (raw)
In-Reply-To: <1496956519.26945.171.camel@linux.intel.com>

On 06/09/2017 12:15 AM, Leonardo Sandoval wrote:
> On Thu, 2017-06-08 at 17:42 +0300, Alexander Kanavin wrote:
>> Changes in version 2: use openmp for multi-processing instead of NSPR library, as
>> requested by upstream. Add a link to the upstream submission to patches.
>>
>> These two patches add multi-threaded features to RPM to speed up the do_package_write_rpm task.
>>
>> Specifically:
>>
>> 1) Multi-threaded xz compressor is used instead of default single-threaded gz. This has the most
>> dramatic effect when a recipe produces a smaller number of large-sized packages.
>>
>> 2) Packages creation is run in multiple threads via thread pools. This is most beneficial when
>> a recipe produces a large amount of small packages.
>>
>> Some not very scientific benchmarks for time and .rpm sizes
>> (time is measured for do_package_write_rpm tasks only):
>>
>
> Tried v2 again and I am getting this problem (segmentation faults):
>
> http://errors.yoctoproject.org/Errors/Build/38812/
>
>
> The idea I have is to get some numbers from buildstats and have better
> insight of the impact of this series. BTW, I tried core-image-sato.

Now I see the issue locally, even though it does not crash, but I think 
it's the same issue :) Bear with me, it's my first openmp adventure ever.

Alex



      reply	other threads:[~2017-06-09  9:13 UTC|newest]

Thread overview: 10+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2017-06-08 14:42 [PATCHv2 0/2] Multi-threaded RPM support Alexander Kanavin
2017-06-08 14:42 ` [PATCHv2 1/2] package_rpm.bbclass: use multithreaded xz compression Alexander Kanavin
2017-06-08 14:42 ` [PATCHv2 2/2] rpm: run binary package generation via thread pools Alexander Kanavin
2017-06-08 16:55   ` Mark Hatle
2017-06-08 17:23     ` Alexander Kanavin
2017-06-08 20:29       ` Mark Hatle
2017-06-09  9:02         ` Alexander Kanavin
2017-06-09 11:18           ` Alexander Kanavin
2017-06-08 21:15 ` [PATCHv2 0/2] Multi-threaded RPM support Leonardo Sandoval
2017-06-09  9:13   ` Alexander Kanavin [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=ee386b4e-eb83-d201-da7e-28940c1202ff@linux.intel.com \
    --to=alexander.kanavin@linux.intel.com \
    --cc=leonardo.sandoval.gonzalez@linux.intel.com \
    --cc=openembedded-core@lists.openembedded.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.