From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <richard.purdie@linuxfoundation.org>
Received: by yocto-www.yoctoproject.org (Postfix, from userid 118)
	id 038ACE00A16; Fri,  8 May 2015 09:33:10 -0700 (PDT)
X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on
	yocto-www.yoctoproject.org
X-Spam-Level: 
X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=ham
	version=3.3.1
X-Spam-HAM-Report: * -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1%
	*      [score: 0.0000]
Received: from dan.rpsys.net (5751f4a1.skybroadband.com [87.81.244.161])
	by yocto-www.yoctoproject.org (Postfix) with ESMTP id 513FEE009F8
	for <toaster@yoctoproject.org>; Fri,  8 May 2015 09:33:08 -0700 (PDT)
Received: from localhost (localhost [127.0.0.1])
	by dan.rpsys.net (8.14.4/8.14.4/Debian-4.1ubuntu1) with ESMTP id
	t48GX5AM024800; Fri, 8 May 2015 17:33:05 +0100
Received: from dan.rpsys.net ([127.0.0.1])
	by localhost (dan.rpsys.net [127.0.0.1]) (amavisd-new, port 10024)
	with LMTP id V7yJowco4rrB; Fri,  8 May 2015 17:33:05 +0100 (BST)
Received: from [192.168.3.10] ([192.168.3.10]) (authenticated bits=0)
	by dan.rpsys.net (8.14.4/8.14.4/Debian-4.1ubuntu1) with ESMTP id
	t48GWnPO024795
	(version=TLSv1/SSLv3 cipher=AES128-GCM-SHA256 bits=128 verify=NOT);
	Fri, 8 May 2015 17:33:00 +0100
Message-ID: <1431102769.8074.294.camel@linuxfoundation.org>
From: Richard Purdie <richard.purdie@linuxfoundation.org>
To: "Damian, Alexandru" <alexandru.damian@intel.com>
Date: Fri, 08 May 2015 17:32:49 +0100
In-Reply-To: <CAJ2CSBtN+on15wbMZcM2Zxqhe4m-xFwya8Br7jCNXAqBdCXiaw@mail.gmail.com>
References: <CAJ2CSBv-fX3s0OhaRkd1q=J=4DX9RwG2tpamGjJa2FAeEWJX7A@mail.gmail.com>
	<1431093153.8074.291.camel@linuxfoundation.org>
	<CAJ2CSBtN+on15wbMZcM2Zxqhe4m-xFwya8Br7jCNXAqBdCXiaw@mail.gmail.com>
X-Mailer: Evolution 3.12.10-0ubuntu1~14.10.1 
Mime-Version: 1.0
Cc: "toaster@yoctoproject.org" <toaster@yoctoproject.org>
Subject: Re: toaster automated testing
X-BeenThere: toaster@yoctoproject.org
X-Mailman-Version: 2.1.13
Precedence: list
List-Id: Web based interface for BitBake <toaster.yoctoproject.org>
List-Unsubscribe: <https://lists.yoctoproject.org/options/toaster>,
	<mailto:toaster-request@yoctoproject.org?subject=unsubscribe>
List-Archive: <http://lists.yoctoproject.org/pipermail/toaster>
List-Post: <mailto:toaster@yoctoproject.org>
List-Help: <mailto:toaster-request@yoctoproject.org?subject=help>
List-Subscribe: <https://lists.yoctoproject.org/listinfo/toaster>,
	<mailto:toaster-request@yoctoproject.org?subject=subscribe>
X-List-Received-Date: Fri, 08 May 2015 16:33:10 -0000
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: 7bit

On Fri, 2015-05-08 at 15:21 +0100, Damian, Alexandru wrote:
> My thinking is that unit tests, that are to be run inside the django
> application, should be in bitbake.
>
> These tests are integration and smoke tests, with a long list of
> dependencies (selenium, browsers, w3c-validator, various other tools)
> and I wouldn't want to bring these dependencies into Bitbake.
> Furthermore, the code structure is not integrated at all with current
> code in Toaster, Bitbake, or oe-selftest framework. It doesn't fit in.
>
> Unit tests that validate individual Toaster features and bug fixes are
> to be implemented in Django unit test framework, and live inside
> Bitbake.


I agree they don't belong alongside the existing tests, we could put
them in a contrib style directory though (I'm open to suggestions) and
document that there are certain dependencies needed to use them?

Cheers,

Richard