From mboxrd@z Thu Jan 1 00:00:00 1970 From: Jiri Olsa Subject: Re: [PATCH 0/9] perf test: the testsuite again Date: Sun, 27 Mar 2016 14:24:41 +0200 Message-ID: <20160327122441.GL4015@krava.sund.root.ku.dk> References: Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Return-path: Received: from mx1.redhat.com ([209.132.183.28]:54947 "EHLO mx1.redhat.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751879AbcC0MYp (ORCPT ); Sun, 27 Mar 2016 08:24:45 -0400 Content-Disposition: inline In-Reply-To: Sender: linux-perf-users-owner@vger.kernel.org List-ID: To: Michael Petlan Cc: linux-perf-users@vger.kernel.org, acme@kernel.org On Wed, Mar 16, 2016 at 02:50:06PM +0100, Michael Petlan wrote: > Hi all, > > after some time, I am sending the proposed testsuite again. I have fixed > couple of things there since last time. > > * three verbosity levels are now supported (perf test suite -vv) > * logs and temp files are stored in /tmp/, so the main tree is not > spoiled anymore > * more things can be parametrized from the outside > * log parsing should be more robust now > > The testsuite is roughly tested on x86_64, i386, ppc64, s390x and aarch64. > The following patches should be applicable upon the Arnaldo's tree, to the > 'perf/core' branch. > > Some issues to be discussed: > > 1) Packaging > > While the other tests are packed within perf, the character of this suite > does not fit that model very well. Nowadays, it is run only when the dir > 'testsuite' is found in the current dir. Otherwise the test is skipped. > I still haven't found any better solution for this. > > 2) In case it gets into the kernel tree, where the 'upstream' will be? > > I have been developing the suite in my github repository [1]. I am planning > to continue with that, if the suite gets or not into the kernel tree. There > are still many testcases missing. I also backport the suite for RHEL testing > purposes. > > It is easier for me to continue the development there and merge bigger > chunks into the kernel tree, than move all the development here. Is that > an acceptable model? > > Is there anything else that you would like to point at? ctrl-c does not stop the suite.. I checked and you run several command on background.. is there a reason for that? [jolsa@krava perf]$ sudo ./perf test suite -v 44: Testsuite : --- start --- test child forked, pid 25786 ======== base_stat ======== -- [ PASS ] -- perf_stat :: test_basic :: basic execution ... -- [ PASS ] -- perf_annotate :: test_basic :: redirected input -- [ PASS ] -- perf_annotate :: test_basic :: execution without data ## [ PASS ] ## perf_annotate :: test_basic SUMMARY ## [ SKIP ] ## perf_annotate :: cleanup :: testcase skipped ======== base_report ======== ^C [jolsa@krava perf]$ ^C [jolsa@krava perf]$ ^C [jolsa@krava perf]$ -- [ PASS ] -- perf_report :: setup :: prepare the perf.data file -- [ SKIP ] -- perf_report :: test_basic :: help message :: testcase skipped -- [ FAIL ] -- perf_report :: test_basic :: basic execution (output regexp parsing) -- [ FAIL ] -- perf_report :: test_basic :: number of samples (output regexp parsing) -- [ PASS ] -- perf_report :: test_basic :: header jirka