From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mailman by lists.gnu.org with tmda-scanned (Exim 4.43) id 1K3pXc-0003lB-Im for qemu-devel@nongnu.org; Wed, 04 Jun 2008 05:44:24 -0400 Received: from exim by lists.gnu.org with spam-scanned (Exim 4.43) id 1K3pXb-0003kj-CR for qemu-devel@nongnu.org; Wed, 04 Jun 2008 05:44:23 -0400 Received: from [199.232.76.173] (port=48308 helo=monty-python.gnu.org) by lists.gnu.org with esmtp (Exim 4.43) id 1K3pXb-0003kX-7W for qemu-devel@nongnu.org; Wed, 04 Jun 2008 05:44:23 -0400 Received: from miranda.se.axis.com ([193.13.178.8]:57897) by monty-python.gnu.org with esmtps (TLS-1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.60) (envelope-from ) id 1K3pXa-00012Y-N0 for qemu-devel@nongnu.org; Wed, 04 Jun 2008 05:44:23 -0400 Received: from axis.com (edgar.se.axis.com [10.93.151.1]) by miranda.se.axis.com (8.13.4/8.13.4/Debian-3sarge3) with ESMTP id m549iHS6016303 for ; Wed, 4 Jun 2008 11:44:17 +0200 Date: Wed, 4 Jun 2008 11:44:17 +0200 From: "Edgar E. Iglesias" Subject: Re: [Qemu-devel] Suggestion for testing framework Message-ID: <20080604094417.GA26034@edgar.se.axis.com> References: <767386.58386.qm@web57006.mail.re3.yahoo.com> <200806032302.09778.paul@codesourcery.com> <5d6222a80806031505t15f18fe7u256514ccbdc9960@mail.gmail.com> <200806032325.02120.paul@codesourcery.com> <20080603223507.GB25242@networkno.de> <761ea48b0806032341h418e935id0a816d0d4d2686a@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <761ea48b0806032341h418e935id0a816d0d4d2686a@mail.gmail.com> Reply-To: qemu-devel@nongnu.org List-Id: qemu-devel.nongnu.org List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: Laurent Desnogues Cc: qemu-devel@nongnu.org On Wed, Jun 04, 2008 at 08:41:58AM +0200, Laurent Desnogues wrote: > On Wed, Jun 4, 2008 at 12:35 AM, Thiemo Seufer wrote: > > OTOH, something like the CRIS testsuite (which was ported from GNU sim) > > for other target architectures could be very useful. > > That would certainly be something very valuable but it would > need a tremendous amount of work and would have to be > done by a different person than the original coder (or else > you could not catch misunderstandings of the instruction > descriptions for instance). It's good if someone else writes the tests but I don't feel it's that critical for qemu. The tests certainly dont _have_ to be written by others to have great value. I agree that it might require a bit of work but luckily it can be done incrementally. An annoying thing with the CRIS testsuite (the way it runs now) is that it requires the CRIS compiler to build the test-cases before they can run. It would be nice to have a check-notools rule (or similar) that would download a pre-compiled testsuite so anyone could run it. I don't think we can expect developers to have toolchains for all the supported targets and to keep them all up to date as new testcases are added which may require modern tool versions. Best regards -- Edgar E. Iglesias Axis Communications AB