From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: by yocto-www.yoctoproject.org (Postfix, from userid 118) id F3D85E00A5C; Fri, 24 Mar 2017 03:45:06 -0700 (PDT) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on yocto-www.yoctoproject.org X-Spam-Level: X-Spam-Status: No, score=-6.8 required=5.0 tests=BAYES_00,DKIM_SIGNED, HTML_MESSAGE, RCVD_IN_DNSWL_HI, T_DKIM_INVALID autolearn=ham version=3.3.1 X-Spam-HAM-Report: * -5.0 RCVD_IN_DNSWL_HI RBL: Sender listed at http://www.dnswl.org/, high * trust * [192.55.52.115 listed in list.dnswl.org] * -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 0.0 HTML_MESSAGE BODY: HTML included in message * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * 0.0 T_DKIM_INVALID DKIM-Signature header exists but is not valid Received: from mga14.intel.com (mga14.intel.com [192.55.52.115]) by yocto-www.yoctoproject.org (Postfix) with ESMTP id 54702E009B9 for ; Fri, 24 Mar 2017 03:45:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=intel.com; i=@intel.com; q=dns/txt; s=intel; t=1490352304; x=1521888304; h=message-id:subject:from:to:cc:date:in-reply-to: references:mime-version; bh=8vehMsVyhBCPJWOzfDY9D5tt3wLhHpkyhB+26LhdUtk=; b=OmjxlPaKpVAh4VS5qVOZslkgmyvjBc3iIw+jGqKilL0abaNL8hQ1m60y iOWaG/HhEJKpuS0aUSKhIh2pe57Mgg==; Received: from fmsmga004.fm.intel.com ([10.253.24.48]) by fmsmga103.fm.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 24 Mar 2017 03:45:02 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.36,214,1486454400"; d="scan'208,217";a="239877313" Received: from jlock-mobl1.ger.corp.intel.com ([10.252.28.195]) by fmsmga004.fm.intel.com with ESMTP; 24 Mar 2017 03:45:00 -0700 Message-ID: <1490352299.3439.3.camel@linux.intel.com> From: Joshua Lock To: Alain Achkar , yocto@yoctoproject.org Date: Fri, 24 Mar 2017 10:44:59 +0000 In-Reply-To: References: <1478889473.18810.3.camel@toganlabs.com> X-Mailer: Evolution 3.22.6 (3.22.6-1.fc25) Mime-Version: 1.0 Subject: Re: Buildbot / Autobuilder / custom? X-BeenThere: yocto@yoctoproject.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Discussion of all things Yocto Project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 Mar 2017 10:45:07 -0000 Content-Type: multipart/alternative; boundary="=-m+Myivc2gRvcz7MexmC7" --=-m+Myivc2gRvcz7MexmC7 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 8bit Hi Alain, On Thu, 2017-03-23 at 17:40 -0400, Alain Achkar wrote: > I followed http://git.yoctoproject.org/cgit.cgi/yocto-autobuilder/tre > e/README-QUICKSTARTand got: > checking controller.cfg > LOADING CONFIG FILE > error while parsing config file: > Traceback (most recent call last): >   File "/media/data/yocto-autobuilder/lib/python2.7/site- > packages/Twisted-12.2.0-py2.7-linux- > x86_64.egg/twisted/internet/defer.py", line 1187, in unwindGenerator >     return _inlineCallbacks(None, gen, Deferred()) >   File "/media/data/yocto-autobuilder/lib/python2.7/site- > packages/Twisted-12.2.0-py2.7-linux- > x86_64.egg/twisted/internet/defer.py", line 1045, in _inlineCallbacks >     result = g.send(result) >   File "/media/data/yocto-autobuilder/lib/python2.7/site- > packages/buildbot-0.8.8- > py2.7.egg/buildbot/scripts/upgrade_master.py", line 169, in > upgradeMaster >     master_cfg = loadConfig(config, configFile) >   File "/media/data/yocto-autobuilder/lib/python2.7/site- > packages/buildbot-0.8.8- > py2.7.egg/buildbot/scripts/upgrade_master.py", line 53, in loadConfig >     config['basedir'], configFileName) > --- --- >   File "/media/data/yocto-autobuilder/lib/python2.7/site- > packages/buildbot-0.8.8-py2.7.egg/buildbot/config.py", line 149, in > loadConfig >     exec f in localDict >   File "/media/data/yocto-autobuilder/yocto- > controller/controller.cfg", line 94, in >     yocto_buildsets.createBuildsets() >   File "/media/data/yocto-autobuilder/lib/python2.7/site- > packages/autobuilder/Autobuilder.py", line 65, in createBuildsets >     self.parseBuildSet(buildset) >   File "/media/data/yocto-autobuilder/lib/python2.7/site- > packages/autobuilder/Autobuilder.py", line 102, in parseBuildSet >     self.parseRepos(buildset) >   File "/media/data/yocto-autobuilder/lib/python2.7/site- > packages/autobuilder/Autobuilder.py", line 127, in parseRepos >     if layer.iterkeys().next() not in self.repos: > exceptions.AttributeError: 'list' object has no attribute 'iterkeys' I appear to have left a stray comma in buildset- config.controller/nightly.conf which causes the parser to choke. I've fixed this in the master branch of yocto-autobuilder: http://git.yoctop roject.org/clean/cgit.cgi/yocto- autobuilder/commit/?id=239eeaa1e2cf3a985e75f8b75dedfe704a7d6991 You'll need to edit buildset-config/nightly.conf on your local instance similarly to remove the comma at the end of the repos list, around line 38. Thanks for reporting this error! Joshua > Errors loading configuration: >   error while parsing config file: 'list' object has no attribute > 'iterkeys' (traceback in logfile) >  To start the autobuilder: >  ./yocto-start-autobuilder > > >  To stop the autobuilder: >  ./yocto-stop-autobuilder > > > >0< alain@esxi-ub1 Thu Mar 23 05:34 PM [master !?] /media/data/yocto- > autobuilder > > > > Any ideas on how to fix this? > On Mon, Nov 14, 2016 at 1:40 PM, Bill Randle > wrote: > > Yes, the 2 TB is for everything you might do with an AutoBuilder. > > The > > > > actual space used will be closer to your 35 GB, since you're > > building > > > > only a single image / work product. People have used BuilBot > > directly > > > > for automated builds, but using the AutoBuilder code (which runs > > > > BuildBot underneath) gives you added flexibility and capability > > > > without much additional overhead. > > > > > > > >     -Bill > > > > > > > > On Mon, Nov 14, 2016 at 8:13 AM, Alain Achkar > .com> wrote: > > > > > Thanks for your answers! From reading these links, it is still > > not clear to > > > > > me if this might be overkill for my requirements. AB Cluster > > Setup talks > > > > > about "the worker requires 2+ TB to hold all the build temp files > > and git > > > > > repos. If build artifacts and a local sstate mirror are included, > > additional > > > > > worker space is required." > > > > > > > > > > Currently, my build only takes 35GB, so I think what these links > > are talking > > > > > about is how to replicate what the Autobuilder project > > > > > https://autobuilder.yoctoproject.org/ already does. > > > > > > > > > > To clarify, I am not interested in running builds and tests for > > everything > > > > > that Yocto already builds and tests (i.e. all the processor > > architectures, > > > > > all the machine types, etc.).  I am interested in running one > > build for one > > > > > machine type (the Variscite DART-6UL i.MX6UL arm-based processor, > > for which > > > > > NXP/Freescale and Variscite have provided recipes and layers > > for). > > > > > > > > > > I know that autobuilder includes BuildBot (this is why I > > specified it in > > > > > parentheses) but my question remains: do I only install BuildBot > > and try to > > > > > build my machine type with it, or do I install Autobuilder? > > > > > > > > > > On Mon, Nov 14, 2016 at 10:10 AM, Bill Randle > com> wrote: > > > > >> > > > > >> Also, be sure to check the Yocto Project wiki pages: > > > > >>     https://wiki.yoctoproject.org/wiki/The_Yocto_Autobuilder > > > > >> in particular, the AB cluster setup and AB maintenance links. > > Even > > > > >> though the one link refers to setting up an entire cluster, I've > > used > > > > >> that procedure to setup a single autobuilder, as well. > > > > >> > > > > >>     -Bill > > > > >> > > > > >> On Fri, Nov 11, 2016 at 10:37 AM, Beth 'pidge' Flanagan > > > > >> wrote: > > > > >> > On Fri, 2016-11-11 at 12:35 -0500, Alain Achkar wrote: > > > > >> >> Hello Joshua! > > > > >> >> > > > > >> >> We are using Yocto to build for the Variscite DART-6UL SoM > > which is > > > > >> >> based on Freescale/NXP i.MX6UL (http://variwiki.com/index.php > > ?title=D > > > > >> >> ART-6UL_Yocto_Jethro_R1_build). > > > > >> >> > > > > >> >> Currently, developers run builds manually on their desktops. > > We are > > > > >> >> considering using a continuous integration server. I found > > out that > > > > >> >> The Yocto Project uses Autobuilder which in turn uses > > BuildBot. I > > > > >> >> read most of the introductory documentation. > > > > >> >> > > > > >> >> Would you recommend that we install only BuildBot and > > configure it to > > > > >> >> build what we need? > > > > >> >> > > > > >> >> OR > > > > >> >> > > > > >> >> Would you recommend that we install Autobuilder (and > > BuildBot) and > > > > >> >> configure it to build what we need? > > > > >> > > > > > >> > Actually, the yocto-autobuilder already contains buildbot so > > no need > > > > >> > for both. > > > > >> > > > > > >> > If you read: > > > > >> > > > > > >> > http://git.yoctoproject.org/cgit.cgi/yocto-autobuilder/tree/RE > > ADME-QUIC > > > > >> > KSTART > > > > >> > > > > > >> > and probably some of the other READMEs and the documentation > > in the > > > > >> > docs directory of the yocto-autobuilder directory, it should > > get you > > > > >> > started in the right direction. > > > > >> > > > > > >> > Feel free to ask questions if you need help. > > > > >> > > > > > >> > -b > > > > >> > > > > > >> > Elizabeth 'pidge' Flanagan > > > > >> > Founder/CTO Togán Labs > > > > >> > www.toganlabs.com > > > > >> > > > > > >> >> > > > > >> >> What is the faster path to get up and running? > > > > >> >> > > > > >> >> Thanks! > > > > >> >> Alain. > > > > >> >> > > > > >> >> -- > > > > >> >> Alain Achkar, M.Eng. | Software Engineer > > > > >> >> Triacta Power Solutions > > > > >> >> (O) 613.256.2868 (C) 613.406.6520 > > > > >> >> www.triacta.com > > > > >> > > > > > >> > > > > > >> > > > > > >> > -- > > > > >> > _______________________________________________ > > > > >> > yocto mailing list > > > > >> > yocto@yoctoproject.org > > > > >> > https://lists.yoctoproject.org/listinfo/yocto > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > > > > > Alain Achkar, M.Eng. | Software Engineer > > > > > > > > > > Triacta Power Solutions > > > > > > > > > > (O) 613.256.2868 (C) 613.406.6520 > > > > > > > > > > www.triacta.com > > > > > > > --  > Alain Achkar, M.Eng. | Software Engineer > Triacta Power Solutions > (O) 613.256.2868 (C) 613.406.6520 > > www.triacta.com   > --=-m+Myivc2gRvcz7MexmC7 Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: quoted-printable
Hi Alain,

On Thu, 2017= -03-23 at 17:40 -0400, Alain Achkar wrote:
<= div dir=3D"ltr">I followed http://git.yoctoproject.org/= cgit.cgi/yocto-autobuilder/tree/README-QUICKSTART
and got:

<snip>

checking controller.cfg
LOADING CONFIG FILE
error while parsing config file:
Traceback (most recent call las= t):
  File "/medi= a/data/yocto-autobuilder/lib/python2.7/site-packages/Twisted-12.2.0-py2.7-l= inux-x86_64.egg/twisted/internet/defer.py", line 1187, in unwindGenerator
    return _i= nlineCallbacks(None, gen, Deferred())
  File "/media/data/yocto-autobuilder/lib/python2.7/si= te-packages/Twisted-12.2.0-py2.7-linux-x86_64.egg/twisted/internet/defer.py= ", line 1045, in _inlineCallbacks
    result =3D g.send(result)
  File "/media/data/yocto-autobuilder/li= b/python2.7/site-packages/buildbot-0.8.8-py2.7.egg/buildbot/scripts/upgrade= _master.py", line 169, in upgradeMaster
    master_cfg =3D loadConfig(config, configFil= e)
  File "/media= /data/yocto-autobuilder/lib/python2.7/site-packages/buildbot-0.8.8-py2.7.eg= g/buildbot/scripts/upgrade_master.py", line 53, in loadConfig
<= div>    config['basedir'], co= nfigFileName)
--- <= exception caught here> ---
  File "/media/data/yocto-autobuilder/lib/python2.7/site-packa= ges/buildbot-0.8.8-py2.7.egg/buildbot/config.py", line 149, in loadConfig
    exec f in= localDict
  File= "/media/data/yocto-autobuilder/yocto-controller/controller.cfg", line 94, = in <module>
&nbs= p;   yocto_buildsets.createBuildsets()
  File "/media/data/yocto-autobuilder/lib/python= 2.7/site-packages/autobuilder/Autobuilder.py", line 65, in createBuildsets<= /font>
    self.par= seBuildSet(buildset)
&= nbsp; File "/media/data/yocto-autobuilder/lib/python2.7/site-packages/autob= uilder/Autobuilder.py", line 102, in parseBuildSet
    self.parseRepos(buildset)=
  File "/media/data/yoc= to-autobuilder/lib/python2.7/site-packages/autobuilder/Autobuilder.py", lin= e 127, in parseRepos
&= nbsp;   if layer.iterkeys().next() not in self.repos:
exceptions.Attrib= uteError: 'list' object has no attribute 'iterkeys'
<= /div>

I appear to have left a stray comma i= n buildset-config.controller/nightly.conf which causes the parser to choke.= I've fixed this in the master branch of yocto-autobuilder: http://git.yoctoproject.org/clean/cgit= .cgi/yocto-autobuilder/commit/?id=3D239eeaa1e2cf3a985e75f8b75dedfe704a7d699= 1


You'll need to edit buildset-= config/nightly.conf on your local instance similarly to remove the comma at= the end of the repos list, around line 38.

Thanks= for reporting this error!

Joshua

Errors loading configuration:
  error while parsing config file: 'list' ob= ject has no attribute 'iterkeys' (traceback in logfile)
 To start the autobuilder:
 ./yocto-start-autobuilder= <worker|controller|both>

 T= o stop the autobuilder:

>0< alain@esxi-ub1 Thu Mar 23 05:34 PM [mas= ter !?] /media/data/yocto-autobuilder >

Any ideas on how to fix this?
<= br>
On Mon, Nov 14, 2016 at 1:40 PM, Bill Randle = <bill.randle@gmail.com> wrote:
Yes, the 2 TB is for everything you might do with an AutoBuilder. The actual space used will be closer to your 35 GB, since you're building
only a single image / work product. People have used BuilBot directly
for automated builds, but using the AutoBuilder code (which runs
BuildBot underneath) gives you added flexibility and capability
without much additional overhead.

    -Bill

On Mon, Nov 14, 2016 at 8:13 AM, Alain Achkar <alain.achkar@triacta.com> wrote:
> Thanks for your answers! From reading these links, it is still not cle= ar to
> me if this might be overkill for my requirements. AB Cluster Setup tal= ks
> about "the worker requires 2+ TB to hold all the build temp files and = git
> repos. If build artifacts and a local sstate mirror are included, addi= tional
> worker space is required."
>
> Currently, my build only takes 35GB, so I think what these links are t= alking
> about is how to replicate what the Autobuilder project
> https://autobuilder.yoctoproject.org/ already doe= s.
>
> To clarify, I am not interested in running builds and tests for everyt= hing
> that Yocto already builds and tests (i.e. all the processor architectu= res,
> all the machine types, etc.).  I am interested in running one bui= ld for one
> machine type (the Variscite DART-6UL i.MX6UL arm-based processor, for = which
> NXP/Freescale and Variscite have provided recipes and layers for).
>
> I know that autobuilder includes BuildBot (this is why I specified it = in
> parentheses) but my question remains: do I only install BuildBot and t= ry to
> build my machine type with it, or do I install Autobuilder?
>
> On Mon, Nov 14, 2016 at 10:10 AM, Bill Randle <bill.randle@gmail.com> wrote:
>>
>> Also, be sure to check the Yocto Project wiki pages:
>>     https://wiki.yoc= toproject.org/wiki/The_Yocto_Autobuilder
>> in particular, the AB cluster setup and AB maintenance links. Even=
>> though the one link refers to setting up an entire cluster, I've u= sed
>> that procedure to setup a single autobuilder, as well.
>>
>>     -Bill
>>
>> On Fri, Nov 11, 2016 at 10:37 AM, Beth 'pidge' Flanagan
>> <pidge@toganlabs.com= > wrote:
>> > On Fri, 2016-11-11 at 12:35 -0500, Alain Achkar wrote:
>> >> Hello Joshua!
>> >>
>> >> We are using Yocto to build for the Variscite DART-6UL So= M which is
>> >> based on Freescale/NXP i.MX6UL (http://vari= wiki.com/index.php?title=3DD
>> >> ART-6UL_Yocto_Jethro_R1_build).
>> >>
>> >> Currently, developers run builds manually on their deskto= ps. We are
>> >> considering using a continuous integration server. I foun= d out that
>> >> The Yocto Project uses Autobuilder which in turn uses Bui= ldBot. I
>> >> read most of the introductory documentation.
>> >>
>> >> Would you recommend that we install only BuildBot and con= figure it to
>> >> build what we need?
>> >>
>> >> OR
>> >>
>> >> Would you recommend that we install Autobuilder (and Buil= dBot) and
>> >> configure it to build what we need?
>> >
>> > Actually, the yocto-autobuilder already contains buildbot so = no need
>> > for both.
>> >
>> > If you read:
>> >
>> > http://git.yoct= oproject.org/cgit.cgi/yocto-autobuilder/tree/README-QUIC
>> > KSTART
>> >
>> > and probably some of the other READMEs and the documentation = in the
>> > docs directory of the yocto-autobuilder directory, it should = get you
>> > started in the right direction.
>> >
>> > Feel free to ask questions if you need help.
>> >
>> > -b
>> >
>> > Elizabeth 'pidge' Flanagan
>> > Founder/CTO Tog=C3=A1n Labs
>> > www.toganlabs.com
>> >
>> >>
>> >> What is the faster path to get up and running?
>> >>
>> >> Thanks!
>> >> Alain.
>> >>
>> >> --
>> >> Alain Achkar, M.Eng. | Software Engineer
>> >> Triacta Power Solutions
>> >> (O) 6= 13.256.2868 (C) 613= .406.6520
>> >> www.triacta.com
>> >
>> >
>> >
>> > --
>> > _______________________________________________
>> > yocto mailing list
>> > yocto@yoctoproject.= org
>> > https://lists.yoctoproject.org/listi= nfo/yocto
>
>
>
>
> --
>
> Alain Achkar, M.Eng. | Software Engineer
>
> Triacta Power Solutions
>
> (O) 613.256.2868 (C) 613.406.6520=
>
> www.triacta.com




-- =

Alain Ac= hkar, M.Eng. | Software Engineer

Triacta Power Solutions

(O) 613.256.2868 (C) = 613.406.6520

www.triacta.com <= span style=3D"color:rgb(31,73,125)"> 

--=-m+Myivc2gRvcz7MexmC7--