[Xenomai-core] Proposal to use buildbot for Xenomai

[Xenomai-core] Proposal to use buildbot for Xenomai

[Niklaus Giger]

[-- Attachment #1: Type: text/plain, Size: 2792 bytes --]

Hi everybody

If you point your browser at http://ngiger.dyndns.org/buildbot/ (with ending 
slash please), you will find a first prototype of the continuos integration 
tool buildbot (http://buildbot.sourceforge.net/)

It proves that it possible to automatically retrieve each revison of the 
Xenomai and compile it for (at the moment) two targets, a stock PPC and a 
custom PPC405 board (cross-compiling).

At the moment it already is useful for me, but I would like to ask your 
opinion about its usefulness. Would this be useful for you too? Do you have a 
special target to propose (other architectures, other target like skins, all 
xenomai components as modules/built-ins, mvm simulator)?

Be warned that setting up a buildbot master/slave using known good 
configuration is easy and can be accomplished in less than half an hour, but 
tweaking the master.cfg takes time and errors are not always easy to spot. 
E.g. I spent about 40 hours to until I could present you this email and the 
attached documents.

Corrections/suggestions to all documents included are welcome.

In the attached tar file you find a pdf file with detailed instructions on how 
to setup a build slave/master for xenomai to experiment with. 

I am willing to work in the next weeks (or months) to improve the buildbot 
master, integrate more slaves. If the xenomai developers would like to 
transfer (now or some time later) the master to another machine this would be 
fine for me too. Anywhy if this buildbot master generates too much traffic I 
might be forced to remove it, as the machine is my private small server 
connected via ASDL (1000kb upstream and only about 200kb downstream for you).

My plans to improve include:
- fix any error reported by the eventual users of the buildbot
- fix some buildbot minor annoyance
  a) may be a prettier stylesheet
  b) use the names of the buildsteps as in 
http://ngiger.dyndns.org/buildbot/hcu3/builds/13 also in the main page)

- Handle correctly cases like changes in the xenomai repository which require 
new configs, new kernel or patch-versions

- Not only compile xenomai but also actually run some tests to prove the 
changes valid. 
  This will either require buildbot changes to add a step where one can reboot 
a slave and run the next step with the new kernel (How to handle non-boots?) 
or 
  add a separate target board whose power supply can be switched off/on by an 
external device. What I found are either 
I) Ethernet controlled power switch like
http://info.infratec-ag.de/catalog/product_info.php?products_id=830&language=en&osCsid=a3995263b1f1ca75af33fe9d0d5fa384 
or IO-devices, like the
II) USB LabJack http://www.labjack.com/labjack_u12.html.
Suggestions for a cheaper solution would be always welcome.
 
Best regards

-- 
Niklaus Giger

[-- Attachment #2: xeno_buildbot.tar.bz2 --]
[-- Type: application/x-tbz, Size: 90913 bytes --]

Re: [Xenomai-core] Proposal to use buildbot for Xenomai

[Jan Kiszka]

[-- Attachment #1: Type: text/plain, Size: 4037 bytes --]

Niklaus Giger wrote:
> Hi everybody
> 
> If you point your browser at http://ngiger.dyndns.org/buildbot/ (with ending 
> slash please), you will find a first prototype of the continuos integration 
> tool buildbot (http://buildbot.sourceforge.net/)
> 
> It proves that it possible to automatically retrieve each revison of the 
> Xenomai and compile it for (at the moment) two targets, a stock PPC and a 
> custom PPC405 board (cross-compiling).
> 
> At the moment it already is useful for me, but I would like to ask your 
> opinion about its usefulness. Would this be useful for you too? Do you have a 
> special target to propose (other architectures, other target like skins, all 
> xenomai components as modules/built-ins, mvm simulator)?

This is a really great idea! Of course, I already have another test
candidate in mind: RTnet 8). Specifically the PPC environment would be
interesting, as our "buildbot" (sorry, Wolfgang G. ;) ) is typically
very busy so that build regressions are sometimes only detected with
delay on that platform. Is it also possible to explicitly trigger an
update and rebuild?

But also for Xenomai I would see this as a very useful tool, e.g. for
2.4 build tests (I must confess I only test sporadically against this
kernel).

> 
> Be warned that setting up a buildbot master/slave using known good 
> configuration is easy and can be accomplished in less than half an hour, but 
> tweaking the master.cfg takes time and errors are not always easy to spot. 
> E.g. I spent about 40 hours to until I could present you this email and the 
> attached documents.
> 
> Corrections/suggestions to all documents included are welcome.
> 
> In the attached tar file you find a pdf file with detailed instructions on how 
> to setup a build slave/master for xenomai to experiment with. 
> 
> I am willing to work in the next weeks (or months) to improve the buildbot 
> master, integrate more slaves. If the xenomai developers would like to 
> transfer (now or some time later) the master to another machine this would be 
> fine for me too. Anywhy if this buildbot master generates too much traffic I 
> might be forced to remove it, as the machine is my private small server 
> connected via ASDL (1000kb upstream and only about 200kb downstream for you).
> 
> My plans to improve include:
> - fix any error reported by the eventual users of the buildbot
> - fix some buildbot minor annoyance
>   a) may be a prettier stylesheet
>   b) use the names of the buildsteps as in 
> http://ngiger.dyndns.org/buildbot/hcu3/builds/13 also in the main page)
> 
> - Handle correctly cases like changes in the xenomai repository which require 
> new configs, new kernel or patch-versions
> 
> - Not only compile xenomai but also actually run some tests to prove the 
> changes valid. 

Yep, a very good idea as well. Regression tests, also in combination
with more complex applications on top of Xenomai (like RTnet ;): a
simple loopback ping test e.g.), would improve the code quality even
faster during the development cycles.

>   This will either require buildbot changes to add a step where one can reboot 
> a slave and run the next step with the new kernel (How to handle non-boots?) 
> or 
>   add a separate target board whose power supply can be switched off/on by an 
> external device. What I found are either 
> I) Ethernet controlled power switch like
> http://info.infratec-ag.de/catalog/product_info.php?products_id=830&language=en&osCsid=a3995263b1f1ca75af33fe9d0d5fa384 
> or IO-devices, like the
> II) USB LabJack http://www.labjack.com/labjack_u12.html.
> Suggestions for a cheaper solution would be always welcome.

Is there no reset button you could control via a master station, e.g. by
attaching some cheap electronic to a parallel or serial port?

I just remember that DENX once had or still have a remote PPC test-lab
running. I CC'ed Wolfgang, maybe he could comment on this if and how it
could be used.

Jan


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 252 bytes --]

Re: [Xenomai-core] Proposal to use buildbot for Xenomai

[Niklaus Giger]

Am Samstag, 8. April 2006 10:44 schrieb Jan Kiszka:
> Niklaus Giger wrote:
> > Hi everybody
<..>
> This is a really great idea! Of course, I already have another test
> candidate in mind: RTnet 8). Specifically the PPC environment would be
> interesting, as our "buildbot" (sorry, Wolfgang G. ;) ) is typically
> very busy so that build regressions are sometimes only detected with
> delay on that platform. Is it also possible to explicitly trigger an
> update and rebuild?
Yes of course. Just select a buildslave (e.g. ppc or hcu3 -> 
http://ngiger.dyndns.org/buildbot/hcu3) and you may manually trigger it. I 
intentionally left this facility open for everybody to test it. But it would 
of course be possible to restrict it only to a few selected developers. 

If you want, I can help you to setup the master.cfg for a rtnet buildbot.

> But also for Xenomai I would see this as a very useful tool, e.g. for
> 2.4 build tests (I must confess I only test sporadically against this
> kernel).
I will add one. Could you please e-mail me (privately if you want) a working 
config (ppc, no cross compiling if possible). Or do you want to add a build 
slave under your control?
<..>
> Is there no reset button you could control via a master station, e.g. by
> attaching some cheap electronic to a parallel or serial port?
There is a reset button, but then you have it running and consuming 
electricity all the times.
> I just remember that DENX once had or still have a remote PPC test-lab
> running. I CC'ed Wolfgang, maybe he could comment on this if and how it
> could be used.
I would be willing to setup a buildbot for the u-boot, too, as my board boots 
with a very outdated version of u-boot.

Best regards

-- 
Niklaus Giger

Re: [Xenomai-core] Proposal to use buildbot for Xenomai

[Jan Kiszka]

[-- Attachment #1: Type: text/plain, Size: 2097 bytes --]

Niklaus Giger wrote:
> Am Samstag, 8. April 2006 10:44 schrieb Jan Kiszka:
>> Niklaus Giger wrote:
>>> Hi everybody
> <..>
>> This is a really great idea! Of course, I already have another test
>> candidate in mind: RTnet 8). Specifically the PPC environment would be
>> interesting, as our "buildbot" (sorry, Wolfgang G. ;) ) is typically
>> very busy so that build regressions are sometimes only detected with
>> delay on that platform. Is it also possible to explicitly trigger an
>> update and rebuild?
> Yes of course. Just select a buildslave (e.g. ppc or hcu3 -> 
> http://ngiger.dyndns.org/buildbot/hcu3) and you may manually trigger it. I 
> intentionally left this facility open for everybody to test it. But it would 
> of course be possible to restrict it only to a few selected developers. 
> 
> If you want, I can help you to setup the master.cfg for a rtnet buildbot.

I would love to, but you know - time...

> 
>> But also for Xenomai I would see this as a very useful tool, e.g. for
>> 2.4 build tests (I must confess I only test sporadically against this
>> kernel).
> I will add one. Could you please e-mail me (privately if you want) a working 
> config (ppc, no cross compiling if possible). Or do you want to add a build 
> slave under your control?

Hmm, I would prefer to just use something, especially as my PPC
experiences are quite limited :). But I guess here are qualified people
listening who can quickly dig out some config.

> <..>
>> Is there no reset button you could control via a master station, e.g. by
>> attaching some cheap electronic to a parallel or serial port?
> There is a reset button, but then you have it running and consuming 
> electricity all the times.

Yep, understandable.

>> I just remember that DENX once had or still have a remote PPC test-lab
>> running. I CC'ed Wolfgang, maybe he could comment on this if and how it
>> could be used.
> I would be willing to setup a buildbot for the u-boot, too, as my board boots 
> with a very outdated version of u-boot.
> 
> Best regards
> 

Jan


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 252 bytes --]

Re: [Xenomai-core] Proposal to use buildbot for Xenomai

[Wolfgang Grandegger]

Jan Kiszka wrote:
> Niklaus Giger wrote:
>> Am Samstag, 8. April 2006 10:44 schrieb Jan Kiszka:
>>> Niklaus Giger wrote:
>>>> Hi everybody
>> <..>
>>> This is a really great idea! Of course, I already have another test
>>> candidate in mind: RTnet 8). Specifically the PPC environment would be
>>> interesting, as our "buildbot" (sorry, Wolfgang G. ;) ) is typically
>>> very busy so that build regressions are sometimes only detected with
>>> delay on that platform. Is it also possible to explicitly trigger an
>>> update and rebuild?
>> Yes of course. Just select a buildslave (e.g. ppc or hcu3 -> 
>> http://ngiger.dyndns.org/buildbot/hcu3) and you may manually trigger it. I 
>> intentionally left this facility open for everybody to test it. But it would 
>> of course be possible to restrict it only to a few selected developers. 
>>
>> If you want, I can help you to setup the master.cfg for a rtnet buildbot.
> 
> I would love to, but you know - time...
> 
>>> But also for Xenomai I would see this as a very useful tool, e.g. for
>>> 2.4 build tests (I must confess I only test sporadically against this
>>> kernel).
>> I will add one. Could you please e-mail me (privately if you want) a working 
>> config (ppc, no cross compiling if possible). Or do you want to add a build 
>> slave under your control?
> 
> Hmm, I would prefer to just use something, especially as my PPC
> experiences are quite limited :). But I guess here are qualified people
> listening who can quickly dig out some config.

In arch/ppc/configs of the (DENX) 2.4 kernel are plenty of 
configurations for the PowerPC boards, e.g. TQM8620_defconfig, 
icecube_5200_defconfig, TQM866M_defconfig, etc. But we need cross 
compilation for most of the embedded boards. Do you need the 
configuration with IPIPE and Xenomai options enabled?

> 
>> <..>
>>> Is there no reset button you could control via a master station, e.g. by
>>> attaching some cheap electronic to a parallel or serial port?
>> There is a reset button, but then you have it running and consuming 
>> electricity all the times.
> 
> Yep, understandable.
> 
>>> I just remember that DENX once had or still have a remote PPC test-lab
>>> running. I CC'ed Wolfgang, maybe he could comment on this if and how it
>>> could be used.
>> I would be willing to setup a buildbot for the u-boot, too, as my board boots 
>> with a very outdated version of u-boot.

We simply use remote controllable power switches to switch the boards on 
and off.

Wolfgang.

Re: [Xenomai-core] Proposal to use buildbot for Xenomai

[Philippe Gerum]

Niklaus Giger wrote:
> Hi everybody
> 
> If you point your browser at http://ngiger.dyndns.org/buildbot/ (with ending 
> slash please), you will find a first prototype of the continuos integration 
> tool buildbot (http://buildbot.sourceforge.net/)
> 

Great stuff.

> It proves that it possible to automatically retrieve each revison of the 
> Xenomai and compile it for (at the moment) two targets, a stock PPC and a 
> custom PPC405 board (cross-compiling).
> 
> At the moment it already is useful for me, but I would like to ask your 
> opinion about its usefulness. Would this be useful for you too? Do you have a 
> special target to propose (other architectures, other target like skins, all 
> xenomai components as modules/built-ins, mvm simulator)?
> 

With the growing number of supported archs, not to speak of the two 
major kernel versions supported (2.4/2.6) for some of them, a tool 
providing continuous integration is clearly extremely useful, since it's 
now virtually impossible for all developers to systematically check 
their work against all possible arch/config combinations.

Additionally, setting up a build slave for any particular arch of 
interest is something users wanting to contribute back could do rather 
easily, and specifically companies who happen to be happy Xenomai users.

AFAIC, the upside would be to be able to produce performance numbers 
after the builds by running regression tests, so that we could evaluate 
the impact of core changes almost immediately.

-- 

Philippe.