localhostbecontroller error

localhostbecontroller error

[Daniel Goguen]

[-- Attachment #1: Type: text/plain, Size: 3435 bytes --]

Hi All,

I've successfully created a few .hddimg files that ran successfully on a
raspberry pi and would now like to use toaster for building and maintaining
builds.

From the web GUI I'm able to select raspberrypi as the target machine,
which automatically adds the five layers:

    openembedded-core
    meta-oe
    meta-yocto-bsp
    meta-yocto
    meta-raspberrypi

I then select *rpi-basic-image* as the image recipe and click on 'build
selected recipes' but get the following error:

*Traceback (most recent call last):*
*  File
"/home/daniel/poky/bitbake/lib/toaster/bldcontrol/management/commands/runbuilds.py",
line 60, in schedule*
*    bec.triggerBuild(br.brbitbake_set.all(), br.brlayer_set.all(),
br.brvariable_set.all(), br.brtarget_set.all())*
*  File
"/home/daniel/poky/bitbake/lib/toaster/bldcontrol/localhostbecontroller.py",
line 369, in triggerBuild*
*    bbctrl = self.getBBController()*
*  File "/home/daniel/poky/bitbake/lib/toaster/bldcontrol/bbcontroller.py",
line 166, in getBBController*
*    self.startBBServer()*
*  File
"/home/daniel/poky/bitbake/lib/toaster/bldcontrol/localhostbecontroller.py",
line 122, in startBBServer*
*    cmdoutput = self._shellcmd(cmd)*
*  File
"/home/daniel/poky/bitbake/lib/toaster/bldcontrol/localhostbecontroller.py",
line 69, in _shellcmd*
*    raise ShellCmdException(err)*

*ShellCmdException: command: bash -c "source
/home/daniel/poky/_toaster_clones/_http___git.yoctoproject.org_git_poky_jethro/oe-init-build-env
/home/daniel/poky/build 2>&1 >toaster_server.log && bitbake --read
/home/daniel/poky/build/conf/toaster-pre.conf --postread
/home/daniel/poky/build/conf/toaster.conf --server-only -t xmlrpc -B
0.0.0.0:0 <http://0.0.0.0:0> 2>&1 >>toaster_server.log " *

*I've noticed slight differences between the localhostbecontroller hosted
on the openembedded git repository and the one at git.yoctoproject. *

Within the localhostbecontroller.py file, the exception error occurs within
the _shellcmd:

   * def _shellcmd(self, command, cwd = None):*
*        if cwd is None:*
*            cwd = self.be.sourcedir*

*        logger.debug("lbc_shellcmmd: (%s) %s" % (cwd, command))*
*        p = subprocess.Popen(command, cwd = cwd, shell=True,
stdout=subprocess.PIPE, stderr=subprocess.PIPE)*
*        (out,err) = p.communicate()*
*        p.wait()*
*        if p.returncode:*
*            if len(err) == 0:*
*                err = "command: %s \n%s" % (command, out)*
*            else:*
*                err = "command: %s \n%s" % (command, err)*
*            logger.warn("localhostbecontroller: shellcmd error %s" % err)*
*            raise ShellCmdException(err)*
*        else:*
*            logger.debug("localhostbecontroller: shellcmd success")*
*            return out*

since I haven't been able to build successfully through toaster yet, has
anyone else faced the same issue?

thanks,

Daniel Goguen, B.Eng
R&D Specialist
(506) 869-3628 <%28506%29%20869-3622> (office)
(506) 850-8012 <%28506%29%20380-5086> (mobile)

-- 


(800) 561-8880 (toll-free)
(506) 847-2348 (fax)
www.dplwireless.com

------------------------------
This e-mail, and any attachments, contains information that is, or may be, 
confidential and proprietary. If you are not the intended recipient, please 
notify the sender that you have received this communication in error, and 
delete it.

[-- Attachment #2: Type: text/html, Size: 8087 bytes --]

Re: localhostbecontroller error

[Michael Wood]

Hi Daniel,

Could you describe your project setup, I'll try and see if I can 
recreate the issue; what version of toaster are you using? and what 
release is the project set to?

Thanks,

Michael

On 28/03/16 19:57, Daniel Goguen wrote:
> Hi All,
>
> I've successfully created a few .hddimg files that ran successfully on 
> a raspberry pi and would now like to use toaster for building and 
> maintaining builds.
>
> From the web GUI I'm able to select raspberrypi as the target machine, 
> which automatically adds the five layers:
>
>     openembedded-core
>     meta-oe
>     meta-yocto-bsp
>     meta-yocto
>     meta-raspberrypi
>
> I then select *rpi-basic-image* as the image recipe and click on 
> 'build selected recipes' but get the following error:
>
> /Traceback (most recent call last):/
> /  File 
> "/home/daniel/poky/bitbake/lib/toaster/bldcontrol/management/commands/runbuilds.py", 
> line 60, in schedule/
> /bec.triggerBuild(br.brbitbake_set.all(), br.brlayer_set.all(), 
> br.brvariable_set.all(), br.brtarget_set.all())/
> /  File 
> "/home/daniel/poky/bitbake/lib/toaster/bldcontrol/localhostbecontroller.py", 
> line 369, in triggerBuild/
> /    bbctrl = self.getBBController()/
> /  File 
> "/home/daniel/poky/bitbake/lib/toaster/bldcontrol/bbcontroller.py", 
> line 166, in getBBController/
> /    self.startBBServer()/
> /  File 
> "/home/daniel/poky/bitbake/lib/toaster/bldcontrol/localhostbecontroller.py", 
> line 122, in startBBServer/
> /    cmdoutput = self._shellcmd(cmd)/
> /  File 
> "/home/daniel/poky/bitbake/lib/toaster/bldcontrol/localhostbecontroller.py", 
> line 69, in _shellcmd/
> /    raise ShellCmdException(err)/
> /
> /
> /ShellCmdException: command: bash -c "source 
> /home/daniel/poky/_toaster_clones/_http___git.yoctoproject.org_git_poky_jethro/oe-init-build-env 
> /home/daniel/poky/build 2>&1 >toaster_server.log && bitbake --read 
> /home/daniel/poky/build/conf/toaster-pre.conf --postread 
> /home/daniel/poky/build/conf/toaster.conf --server-only -t xmlrpc -B 
> 0.0.0.0:0 <http://0.0.0.0:0> 2>&1 >>toaster_server.log " /
> /
> /
> /I've noticed slight differences between the localhostbecontroller 
> hosted on the openembedded git repository and the one at 
> git.yoctoproject. /
>
> Within the localhostbecontroller.py file, the exception error occurs 
> within the _shellcmd:
>
> **/*def _shellcmd*(self, command, cwd = None):/
> /        if cwd is None:/
> /            cwd = self.be.sourcedir/
> /
> /
> /        logger.debug("lbc_shellcmmd: (%s) %s" % (cwd, command))/
> /        p = subprocess.Popen(command, cwd = cwd, shell=True, 
> stdout=subprocess.PIPE, stderr=subprocess.PIPE)/
> /        (out,err) = p.communicate()/
> /        p.wait()/
> /        if p.returncode:/
> /            if len(err) == 0:/
> /                err = "command: %s \n%s" % (command, out)/
> /            else:/
> /                err = "command: %s \n%s" % (command, err)/
> /            logger.warn("localhostbecontroller: shellcmd error %s" % 
> err)/
> /            raise ShellCmdException(err)/
> /        else:/
> /            logger.debug("localhostbecontroller: shellcmd success")/
> /            return out/
>
> since I haven't been able to build successfully through toaster yet, 
> has anyone else faced the same issue?
>
> thanks,
>
> Daniel Goguen, B.Eng
> R&D Specialist
> (506) 869-3628 <tel:%28506%29%20869-3622> (office)
> (506) 850-8012 <tel:%28506%29%20380-5086> (mobile)
>
>
> (800) 561-8880 (toll-free)
> (506) 847-2348 (fax)
> www.dplwireless.com <http://www.dplwireless.com>
>
> ------------------------------------------------------------------------
> This e-mail, and any attachments, contains information that is, or may 
> be, confidential and proprietary. If you are not the intended 
> recipient, please notify the sender that you have received this 
> communication in error, and delete it.
>
>

Re: localhostbecontroller error

[Daniel Goguen]

[-- Attachment #1: Type: text/plain, Size: 4774 bytes --]

while the above error seems intermittent and still looking into, I've
managed to launch the bitbake server from Toaster (and had before) but
since the shell displays the following message:
"2016-03-29 15:49:53,830 DEBUG localhostbecontroller: Build launched,
exiting. Follow build logs at /home/daniel/poky/build/toaster_ui.log"

at the same time that the Toaster GUI was not updating the progress bar I
thought something was wrong and closed the program before there was
anything in the log file, but eventually I let toaster run longer and
discovered that the image files were being generated anyway and
successfully ran a test image in QEMU. At first I thought it could be
related to running a build whose tasks were already created (second time
running a successful build) but I then tried adding a new layer to the
build and am seeing the same problem with the GUI progress bar. Anyone else
experience this issue?

thanks,
Daniel

Daniel Goguen, B.Eng
R&D Specialist
(506) 869-3628 <%28506%29%20869-3622> (office)
(506) 850-8012 <%28506%29%20380-5086> (mobile)

On Mon, Mar 28, 2016 at 3:57 PM, Daniel Goguen <
daniel.goguen@dplwireless.com> wrote:

> Hi All,
>
> I've successfully created a few .hddimg files that ran successfully on a
> raspberry pi and would now like to use toaster for building and maintaining
> builds.
>
> From the web GUI I'm able to select raspberrypi as the target machine,
> which automatically adds the five layers:
>
>     openembedded-core
>     meta-oe
>     meta-yocto-bsp
>     meta-yocto
>     meta-raspberrypi
>
> I then select *rpi-basic-image* as the image recipe and click on 'build
> selected recipes' but get the following error:
>
> *Traceback (most recent call last):*
> *  File
> "/home/daniel/poky/bitbake/lib/toaster/bldcontrol/management/commands/runbuilds.py",
> line 60, in schedule*
> *    bec.triggerBuild(br.brbitbake_set.all(), br.brlayer_set.all(),
> br.brvariable_set.all(), br.brtarget_set.all())*
> *  File
> "/home/daniel/poky/bitbake/lib/toaster/bldcontrol/localhostbecontroller.py",
> line 369, in triggerBuild*
> *    bbctrl = self.getBBController()*
> *  File
> "/home/daniel/poky/bitbake/lib/toaster/bldcontrol/bbcontroller.py", line
> 166, in getBBController*
> *    self.startBBServer()*
> *  File
> "/home/daniel/poky/bitbake/lib/toaster/bldcontrol/localhostbecontroller.py",
> line 122, in startBBServer*
> *    cmdoutput = self._shellcmd(cmd)*
> *  File
> "/home/daniel/poky/bitbake/lib/toaster/bldcontrol/localhostbecontroller.py",
> line 69, in _shellcmd*
> *    raise ShellCmdException(err)*
>
> *ShellCmdException: command: bash -c "source
> /home/daniel/poky/_toaster_clones/_http___git.yoctoproject.org_git_poky_jethro/oe-init-build-env
> /home/daniel/poky/build 2>&1 >toaster_server.log && bitbake --read
> /home/daniel/poky/build/conf/toaster-pre.conf --postread
> /home/daniel/poky/build/conf/toaster.conf --server-only -t xmlrpc -B
> 0.0.0.0:0 <http://0.0.0.0:0> 2>&1 >>toaster_server.log " *
>
> *I've noticed slight differences between the localhostbecontroller hosted
> on the openembedded git repository and the one at git.yoctoproject. *
>
> Within the localhostbecontroller.py file, the exception error occurs
> within the _shellcmd:
>
>    * def _shellcmd(self, command, cwd = None):*
> *        if cwd is None:*
> *            cwd = self.be.sourcedir*
>
> *        logger.debug("lbc_shellcmmd: (%s) %s" % (cwd, command))*
> *        p = subprocess.Popen(command, cwd = cwd, shell=True,
> stdout=subprocess.PIPE, stderr=subprocess.PIPE)*
> *        (out,err) = p.communicate()*
> *        p.wait()*
> *        if p.returncode:*
> *            if len(err) == 0:*
> *                err = "command: %s \n%s" % (command, out)*
> *            else:*
> *                err = "command: %s \n%s" % (command, err)*
> *            logger.warn("localhostbecontroller: shellcmd error %s" % err)*
> *            raise ShellCmdException(err)*
> *        else:*
> *            logger.debug("localhostbecontroller: shellcmd success")*
> *            return out*
>
> since I haven't been able to build successfully through toaster yet, has
> anyone else faced the same issue?
>
> thanks,
>
> Daniel Goguen, B.Eng
> R&D Specialist
> (506) 869-3628 <%28506%29%20869-3622> (office)
> (506) 850-8012 <%28506%29%20380-5086> (mobile)
>

-- 


(800) 561-8880 (toll-free)
(506) 847-2348 (fax)
www.dplwireless.com

------------------------------
This e-mail, and any attachments, contains information that is, or may be, 
confidential and proprietary. If you are not the intended recipient, please 
notify the sender that you have received this communication in error, and 
delete it.

[-- Attachment #2: Type: text/html, Size: 10736 bytes --]

Re: localhostbecontroller error

[Barros Pena, Belen]

On 29/03/2016 19:56, "toaster-bounces@yoctoproject.org on behalf of Daniel
Goguen" <toaster-bounces@yoctoproject.org on behalf of
daniel.goguen@dplwireless.com> wrote:

>while the above error seems intermittent and still looking into, I've
>managed to launch the bitbake server from Toaster (and had before) but
>since the shell displays the following message:
>"2016-03-29 15:49:53,830 DEBUG localhostbecontroller: Build launched,
>exiting. Follow build logs at /home/daniel/poky/build/toaster_ui.log"
>
>
>at the same time that the Toaster GUI was not updating the progress bar I
>thought something was wrong and closed the program before there was
>anything in the log file, but eventually I let toaster run longer and
>discovered that the image files were being
> generated anyway and successfully ran a test image in QEMU. At first I
>thought it could be related to running a build whose tasks were already
>created (second time running a successful build) but I then tried adding
>a new layer to the build and am seeing the
> same problem with the GUI progress bar. Anyone else experience this
>issue?

Hi Daniel,

Yes, this is a known problem I'm afraid

https://bugzilla.yoctoproject.org/show_bug.cgi?id=8328

If you are using the Yocto Project Jethro release, the bars won't update
anywhere. In the master branch the progress bars are updating in the page
showing project builds, but they don't update in the page showing all
builds. 

Hopefully we'll get to fix it properly at some point.

Cheers

Belén

>
>
>thanks,
>Daniel
>
>
>
>Daniel Goguen, B.Eng
>
>R&D Specialist
>(506) 869-3628 <tel:%28506%29%20869-3622> (office)
>
>(506) 850-8012 <tel:%28506%29%20380-5086> (mobile)
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>On Mon, Mar 28, 2016 at 3:57 PM, Daniel Goguen
><daniel.goguen@dplwireless.com> wrote:
>
>Hi All,
>
>
>I've successfully created a few .hddimg files that ran successfully on a
>raspberry pi and would now like to use toaster for building and
>maintaining builds.
>
>
From the web GUI I'm able to select raspberrypi as the target machine,
>which automatically adds the five layers:
>
>
>    openembedded-core
>    meta-oe
>    meta-yocto-bsp
>    meta-yocto
>    meta-raspberrypi
>
>
>
>I then select 
>rpi-basic-image as the image recipe and click on 'build selected recipes'
>but get the following error:
>
>
>Traceback (most recent call last):
>  File 
>"/home/daniel/poky/bitbake/lib/toaster/bldcontrol/management/commands/runb
>uilds.py", line 60, in schedule
>    bec.triggerBuild(br.brbitbake_set.all(), br.brlayer_set.all(),
>br.brvariable_set.all(), br.brtarget_set.all())
>  File 
>"/home/daniel/poky/bitbake/lib/toaster/bldcontrol/localhostbecontroller.py
>", line 369, in triggerBuild
>    bbctrl = self.getBBController()
>  File 
>"/home/daniel/poky/bitbake/lib/toaster/bldcontrol/bbcontroller.py", line
>166, in getBBController
>    self.startBBServer()
>  File 
>"/home/daniel/poky/bitbake/lib/toaster/bldcontrol/localhostbecontroller.py
>", line 122, in startBBServer
>    cmdoutput = self._shellcmd(cmd)
>  File 
>"/home/daniel/poky/bitbake/lib/toaster/bldcontrol/localhostbecontroller.py
>", line 69, in _shellcmd
>    raise ShellCmdException(err)
>
>
>ShellCmdException: command: bash -c "source
>/home/daniel/poky/_toaster_clones/_http___git.yoctoproject.org_git_poky_je
>thro/oe-init-build-env /home/daniel/poky/build 2>&1 >toaster_server.log
>&& bitbake --read /home/daniel/poky/build/conf/toaster-pre.conf
> --postread /home/daniel/poky/build/conf/toaster.conf --server-only -t
>xmlrpc -B 
>0.0.0.0:0 <http://0.0.0.0:0> 2>&1 >>toaster_server.log "
>
>
>I've noticed slight differences between the localhostbecontroller hosted
>on the openembedded git repository and the one at git.yoctoproject.
>
>
>Within the localhostbecontroller.py file, the exception error occurs
>within the _shellcmd:
>
>
>    def _shellcmd(self, command, cwd = None):
>        if cwd is None:
>            cwd = self.be.sourcedir
>
>
>        logger.debug("lbc_shellcmmd: (%s) %s" % (cwd, command))
>        p = subprocess.Popen(command, cwd = cwd, shell=True,
>stdout=subprocess.PIPE, stderr=subprocess.PIPE)
>        (out,err) = p.communicate()
>        p.wait()
>        if p.returncode:
>            if len(err) == 0:
>                err = "command: %s \n%s" % (command, out)
>            else:
>                err = "command: %s \n%s" % (command, err)
>            logger.warn("localhostbecontroller: shellcmd error %s" % err)
>            raise ShellCmdException(err)
>        else:
>            logger.debug("localhostbecontroller: shellcmd success")
>            return out
>
>
>
>since I haven't been able to build successfully through toaster yet, has
>anyone else faced the same issue?
>
>
>thanks,
>
>
>
>
>Daniel Goguen, B.Eng
>
>R&D Specialist
>(506) 869-3628 <tel:%28506%29%20869-3622> (office)
>
>(506) 850-8012 <tel:%28506%29%20380-5086> (mobile)
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>(800) 561-8880 (toll-free)
>(506) 847-2348 (fax)
>www.dplwireless.com <http://www.dplwireless.com>
>
>
>________________________________________
>This e-mail, and any attachments, contains information that is, or may
>be, confidential and proprietary. If you are not the intended recipient,
>please notify the sender that you have received this communication in
>error, and
> delete it.