Re: [Announcement] Yocto Project 1.5 Milestone 3 now available.

[Robert Berger <gmane@reliableembeddedsystems.com>]

Hi,

On 08/12/2013 02:30 PM, Björn Stenberg wrote:
> Paul Eggleton wrote:
>> Right, that's what we would be aiming for. Perhaps you could talk a little
>> bit about how you manage your hardware testing and any additional software
>> and scripts you make use of there?
> 
> We run our tests from buildbot, using an expect script 

I currently run my tests manually, but the plan was to implement
something in expect as well, since this seems to be made exactly for
this kind of stuff.

... but instead of something proprietary I would rather prefer to have a
generic solution where "the community" solves problems together with me.

> to allocate the right serial port (and wait if it is busy), fetch the built files, unpack the rootfs to an NFS disk, reset the board, tftp the kernel and dtb, boot the kernel and start the test suite.
> 
> A line-based timeout is used for for the test suites, meaning that the timeout is reset for each new line of output. This allows us to handle very long-running test cases while still being able detect hung tests rather quickly.
> 
> Multiple images and test suites are built and ran in parallell, which is why the script waits for the serial port. One of the test suites we run is ptest-runner.
> 
> The output of all tests is parsed and stored in a database, cross-referenced with the buildbot build info. We have written an extension to the buildbot web interface presenting the test results as they relate to each build.
> 

Are your scripts available somewhere to give it a try? Do they integrate
into autobuilder?

Regards,

Robert




..."German programmers tend to take it as a personal insult when a fault
is detected in code that they have written." - Debora Weber-Wulff
weberwu@tfh-berlin.de [comp.risks 16.94]

My public pgp key is available,at:
http://pgp.mit.edu:11371/pks/lookup?op=get&search=0x90320BF1