Openembedded Core Discussions
 help / color / mirror / Atom feed
From: "Armin Kuster" <akuster808@gmail.com>
To: Richard Purdie <richard.purdie@linuxfoundation.org>,
	openembedded-core <openembedded-core@lists.openembedded.org>
Cc: Joshua Watt <JPEWhacker@gmail.com>,
	Michael Halstead <mhalstead@linuxfoundation.org>
Subject: Re: [OE-core] Public project sstate/hash equivalence mirror now live
Date: Sun, 12 Sep 2021 07:55:17 -0700	[thread overview]
Message-ID: <95bf1261-eb40-cafa-3153-0c472142fb98@gmail.com> (raw)
In-Reply-To: <0b6111c1d71f1665cacafafaea972e609a77a0cd.camel@linuxfoundation.org>



On 9/12/21 4:46 AM, Richard Purdie wrote:
> We made the autobuilder sstate public a while ago but it wasn't useful after we
> switched to hash equivalence by default. I'm pleased to be able to report that
> we now have a read-only public server for the hash equivalence. We did have to
> fix a small API omission and a couple of sstate related bugs but I'm pleased to
> be able to report it is now operational and usable. An example config would be:
>
> SSTATE_MIRRORS ?= "file://.* http://sstate.yoctoproject.org/dev/PATH;downloadfilename=PATH"
> BB_HASHSERVE_UPSTREAM = "typhoon.yocto.io:8687"
>
> I've included an example image build below where it took 11 minutes for a 
> core-image-minimal image build. Obviously this is only of benefit if you're
> building configurations that match the project autobuilder although hash
> equivalence could be useful alone in reducing some build times.

What branches that support hash equivalence will be available other than
Master?


>
> I have updated the local.conf sample file in poky to match the new release.
> We're not widely highlighting that information as yet as it remains to be seen
> how well it scales and what the hosting impacts for it will look like but it is
> there to experiment with to a wider audience such as this list.

The should improve the out-of-the-box experience.

thanks,

> The builds will sit for a long time whilst it queries hash equivalency and I
> appreciate the UI feedback could be better there but one step at a time!
>
> Cheers,
>
> Richard
>
> $ time bitbake core-image-minimal
> Loading cache: 100% |                                                                                                                                                       | ETA:  --:--:--
> Loaded 0 entries from dependency cache.
> Parsing recipes: 100% |######################################################################################################################################################| Time: 0:00:03
> Parsing of 871 .bb files complete (0 cached, 871 parsed). 1519 targets, 49 skipped, 0 masked, 0 errors.
> NOTE: Resolving any missing task queue dependencies
>
> Build Configuration:
> BB_VERSION           = "1.51.1"
> BUILD_SYS            = "x86_64-linux"
> NATIVELSBSTRING      = "ubuntu-20.04"
> TARGET_SYS           = "x86_64-poky-linux"
> MACHINE              = "qemux86-64"
> DISTRO               = "poky"
> DISTRO_VERSION       = "3.3+snapshot-89e48765083f15bf79839a778d08a68f8aece51d"
> TUNE_FEATURES        = "m64 core2"
> TARGET_FPU           = ""
> meta                 
> meta-poky            
> meta-yocto-bsp       
> meta-selftest        = "master:89e48765083f15bf79839a778d08a68f8aece51d"
>
> Initialising tasks: 100% |###################################################################################################################################################| Time: 0:03:40
> Checking sstate mirror object availability: 100% |###########################################################################################################################| Time: 0:00:28
> Sstate summary: Wanted 1525 Local 0 Network 1515 Missed 10 Current 0 (99% match, 0% complete)
> NOTE: Executing Tasks
> NOTE: Tasks Summary: Attempted 3913 tasks of which 3603 didn't need to be rerun and all succeeded.
>
> real	11m2.578s
> user	0m42.927s
> sys	0m9.963s
>
>
>
>
> 
>


  reply	other threads:[~2021-09-12 14:55 UTC|newest]

Thread overview: 6+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2021-09-12 11:46 Public project sstate/hash equivalence mirror now live Richard Purdie
2021-09-12 14:55 ` Armin Kuster [this message]
2021-09-12 15:58   ` [OE-core] " Richard Purdie
2021-09-12 16:01     ` Joshua Watt
2021-09-14 15:27       ` Konrad Weihmann
2021-09-14 16:26         ` Richard Purdie

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=95bf1261-eb40-cafa-3153-0c472142fb98@gmail.com \
    --to=akuster808@gmail.com \
    --cc=JPEWhacker@gmail.com \
    --cc=mhalstead@linuxfoundation.org \
    --cc=openembedded-core@lists.openembedded.org \
    --cc=richard.purdie@linuxfoundation.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox