From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: by yocto-www.yoctoproject.org (Postfix, from userid 118) id 5F169E00997; Tue, 28 Apr 2015 12:54:15 -0700 (PDT) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on yocto-www.yoctoproject.org X-Spam-Level: X-Spam-Status: No, score=-2.6 required=5.0 tests=BAYES_00,RCVD_IN_DNSWL_LOW autolearn=ham version=3.3.1 X-Spam-HAM-Report: * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [209.85.212.182 listed in list.dnswl.org] * -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] Received: from mail-wi0-f182.google.com (mail-wi0-f182.google.com [209.85.212.182]) by yocto-www.yoctoproject.org (Postfix) with ESMTP id ECE9DE00932 for ; Tue, 28 Apr 2015 12:54:11 -0700 (PDT) Received: by wiun10 with SMTP id n10so41987518wiu.1 for ; Tue, 28 Apr 2015 12:54:10 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:date:from:user-agent:mime-version:to :subject:references:in-reply-to:content-type :content-transfer-encoding; bh=6Ob/O8FyOGFJbZlfd1NObZJXs7LDYQdpNNOx201wBh0=; b=SrTHjCH+p5/t3dsx3WRNHtJKRdzE003pxd0RULkSM8gHUNdtjs6up5G8JTqWExYCU4 MFrchErSN9ngiAllZ8kkimfSCaNx2yON1sxAGZOdhYoEqKNdzuV9Ld/0f4Zii3RSvdru WmXvjKrWwVCGlXhPAJmsntz/cW6kxAwoZ9ys7guliPZTjo/u/qd077DkYtzS2baaMcsv Ww1k+pU2zv0w3d8ivG1DdCDFj257gx6B9+EzMuWyCgqOeTOXQ7So2shqCqEhmBsiQkAX r99wx8wBMJFaDduVdC//Gj3lbtX9ukgvpTsIzUNwFcSbIUPt786OVbsTuaPFRVVM4adO YgZA== X-Gm-Message-State: ALoCoQmbwrIcJWiiZM5Aic9808XMYme5Mr9auNCoHnfI2H8VChYc4s8IjkbFrcef408sFuCUkO68 X-Received: by 10.194.63.80 with SMTP id e16mr88296wjs.56.1430250850447; Tue, 28 Apr 2015 12:54:10 -0700 (PDT) Received: from [192.168.0.15] (cpc73680-dals20-2-0-cust304.20-2.cable.virginm.net. [80.194.17.49]) by mx.google.com with ESMTPSA id fm8sm17916826wib.9.2015.04.28.12.54.09 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 28 Apr 2015 12:54:09 -0700 (PDT) Message-ID: <553FE560.50600@intel.com> Date: Tue, 28 Apr 2015 20:54:08 +0100 From: Michael Wood User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: "toaster@yoctoproject.org" References: In-Reply-To: Subject: Re: announcing the toaster test framework X-BeenThere: toaster@yoctoproject.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Web based interface for BitBake List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Apr 2015 19:54:15 -0000 Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit On 27/04/15 18:22, Damian, Alexandru wrote: > Hi, > > I put together a couple of scripts that will monitor the toaster > mailing list, and provide smoke testing on each patchset submitted to > review request. > > A very rough form of these scripts existed for some time, but I've > taken time to clean that up, and enough code to be able to add tests > very easily, and make everything a bit more reliable. > > It lives outside of the poky/ or bitbake/ trees, and you can check out > the code here, until moved to a proper repo. > > > http://git.yoctoproject.org/cgit/cgit.cgi/poky-contrib/log/?h=yocto-tts/master > > > Currently, my installation is emailing tests results only to me, but > once I've been satisfied that it doesn't crash or burn the mailing > list, I will update the setup to mail results directly to the mailing > list. > > > You can also use it to manually run tests on your branch prior to > submission. > I know this wasn't an RFC but I do have one question... you're encoraging people to write tests for this new framework, but when are we saying a test be sent to the "toaster test framework" and when should it be a unit test in Toaster? ...My thoughts are that if it's possible to write the unit test in toaster with django[1] (i.e no external tools) then that should be the primary place for tests, we should be in the habbit of running ./manage.py test pre-submission of patches. Those tests are broken or missing at the moment, so I hope we can fix those first. What do you think? [1] e.g. some I wrote for the error-report-web: http://git.yoctoproject.org/cgit/cgit.cgi/error-report-web/tree/Post/test.py > Cheers, > Alex > > -- > Alex Damian > Yocto Project > SSG / OTC > >