linux-perf-users.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Michael Petlan <mpetlan@redhat.com>
To: "Arnaldo Carvalho de Melo" <acme@redhat.com>,
	"Jiri Olsa" <jolsa@redhat.com>,
	"平松雅巳 / HIRAMATU,MASAMI" <masami.hiramatsu.pt@hitachi.com>
Cc: "linux-perf-users@vger.kernel.org" <linux-perf-users@vger.kernel.org>
Subject: [PATCH 0/2] The testsuite again
Date: Fri, 04 Dec 2015 18:10:55 +0100	[thread overview]
Message-ID: <1449249055.24573.183.camel@redhat.com> (raw)

Hi all!

I have extended the testsuite I announced some time ago and cleaned
it up a bit, so it should be in a better shape than before.  I also
created a perf test entry for running it from perf-test.

How to test it:

- apply patches; make
- ./perf test suite [-v]

There are some failures now,  but they should be passing when other
patches are applied (basically the patches related to the bugs I've
reported and/or sent patches for (perf list segfault, "bogus values
of variables in userspace probes", etc...).

I briefly tested it on aarch64 (X-Gene) and ppc64le architectures,
and of course x86_64.

In the current state,  it searches for the "testsuite" directory in
`pwd`, when not found, the testcase is skipped. --> Maybe we should
think about some packaging, standard locations or whatever.

Thoughts?

Regards,
Michael



Michael Petlan (2):
  perf test: Adding an entry for the perftool-testsuite
  perf test: Introducing new testsuite

 tools/perf/tests/Build                             |   1 +
 tools/perf/tests/builtin-test.c                    |   4 +
 tools/perf/tests/suite.c                           | 143 +++++++++++++
 tools/perf/tests/suite.h                           |  30 +++
 tools/perf/tests/tests.h                           |   1 +
 tools/perf/testsuite/base_annotate/cleanup.sh      |  22 ++
 .../perf/testsuite/base_annotate/examples/Makefile |  13 ++
 tools/perf/testsuite/base_annotate/examples/load.c |  24 +++
 tools/perf/testsuite/base_annotate/settings.sh     |  15 ++
 tools/perf/testsuite/base_annotate/setup.sh        |  35 ++++
 tools/perf/testsuite/base_annotate/test_basic.sh   | 169 +++++++++++++++
 tools/perf/testsuite/base_buildid/cleanup.sh       |  20 ++
 tools/perf/testsuite/base_buildid/settings.sh      |  23 +++
 tools/perf/testsuite/base_buildid/setup.sh         |  26 +++
 .../testsuite/base_buildid/test_buildid-list.sh    |  79 +++++++
 tools/perf/testsuite/base_list/cleanup.sh          |  19 ++
 tools/perf/testsuite/base_list/settings.sh         |  15 ++
 tools/perf/testsuite/base_list/setup.sh            |  20 ++
 tools/perf/testsuite/base_list/test_basic.sh       |  88 ++++++++
 tools/perf/testsuite/base_probe/cleanup.sh         |  22 ++
 tools/perf/testsuite/base_probe/examples/Makefile  |  13 ++
 .../perf/testsuite/base_probe/examples/advanced.c  |  40 ++++
 .../testsuite/base_probe/examples/exact_counts.c   |  35 ++++
 tools/perf/testsuite/base_probe/examples/test.c    |  35 ++++
 tools/perf/testsuite/base_probe/settings.sh        |  42 ++++
 tools/perf/testsuite/base_probe/setup.sh           |  23 +++
 .../base_probe/test_adding_blacklisted.sh          |  63 ++++++
 .../testsuite/base_probe/test_adding_kernel.sh     | 229 +++++++++++++++++++++
 tools/perf/testsuite/base_probe/test_advanced.sh   | 124 +++++++++++
 tools/perf/testsuite/base_probe/test_basic.sh      |  79 +++++++
 .../perf/testsuite/base_probe/test_exact_counts.sh | 106 ++++++++++
 .../testsuite/base_probe/test_invalid_options.sh   |  80 +++++++
 .../testsuite/base_probe/test_line_semantics.sh    |  56 +++++
 tools/perf/testsuite/base_probe/test_listing.sh    | 154 ++++++++++++++
 .../perf/testsuite/base_probe/test_probe_syntax.sh | 119 +++++++++++
 tools/perf/testsuite/base_report/cleanup.sh        |  22 ++
 tools/perf/testsuite/base_report/settings.sh       |  15 ++
 tools/perf/testsuite/base_report/setup.sh          |  26 +++
 .../testsuite/base_report/stderr-whitelist.txt     |   1 +
 tools/perf/testsuite/base_report/test_basic.sh     | 169 +++++++++++++++
 tools/perf/testsuite/base_stat/cleanup.sh          |  21 ++
 tools/perf/testsuite/base_stat/settings.sh         |  10 +
 tools/perf/testsuite/base_stat/test_basic.sh       |  68 ++++++
 tools/perf/testsuite/base_stat/test_hw.sh          |  50 +++++
 tools/perf/testsuite/base_stat/test_hwcache.sh     |  51 +++++
 .../perf/testsuite/base_stat/test_intel_uncore.sh  |  46 +++++
 .../testsuite/base_stat/test_powerpc_hv_24x7.sh    |  60 ++++++
 .../base_stat/test_tracepoints_definition.sh       |  60 ++++++
 tools/perf/testsuite/base_trace/cleanup.sh         |  19 ++
 tools/perf/testsuite/base_trace/settings.sh        |  10 +
 tools/perf/testsuite/base_trace/setup.sh           |  16 ++
 .../perf/testsuite/base_trace/stderr-whitelist.txt |   1 +
 tools/perf/testsuite/base_trace/test_basic.sh      | 129 ++++++++++++
 tools/perf/testsuite/base_trace/test_record.sh     |  45 ++++
 .../testsuite/common/check_all_lines_matched.pl    |  38 ++++
 .../testsuite/common/check_all_patterns_found.pl   |  33 +++
 .../testsuite/common/check_any_pattern_found.pl    |  14 ++
 .../testsuite/common/check_buildids_vs_files.pl    |  22 ++
 .../testsuite/common/check_errors_whitelisted.pl   |  50 +++++
 .../testsuite/common/check_exact_pattern_order.pl  |  27 +++
 .../testsuite/common/check_kallsyms_vs_probes.pl   |  48 +++++
 .../testsuite/common/check_no_patterns_found.pl    |  33 +++
 tools/perf/testsuite/common/init.sh                |  67 ++++++
 tools/perf/testsuite/common/parametrization.sh     |  32 +++
 tools/perf/testsuite/common/patterns.sh            | 117 +++++++++++
 tools/perf/testsuite/common/settings.sh            |  57 +++++
 66 files changed, 3324 insertions(+)
 create mode 100644 tools/perf/tests/suite.c
 create mode 100644 tools/perf/tests/suite.h
 create mode 100755 tools/perf/testsuite/base_annotate/cleanup.sh
 create mode 100644 tools/perf/testsuite/base_annotate/examples/Makefile
 create mode 100644 tools/perf/testsuite/base_annotate/examples/load.c
 create mode 100644 tools/perf/testsuite/base_annotate/settings.sh
 create mode 100755 tools/perf/testsuite/base_annotate/setup.sh
 create mode 100755 tools/perf/testsuite/base_annotate/test_basic.sh
 create mode 100755 tools/perf/testsuite/base_buildid/cleanup.sh
 create mode 100644 tools/perf/testsuite/base_buildid/settings.sh
 create mode 100755 tools/perf/testsuite/base_buildid/setup.sh
 create mode 100755 tools/perf/testsuite/base_buildid/test_buildid-list.sh
 create mode 100755 tools/perf/testsuite/base_list/cleanup.sh
 create mode 100644 tools/perf/testsuite/base_list/settings.sh
 create mode 100755 tools/perf/testsuite/base_list/setup.sh
 create mode 100755 tools/perf/testsuite/base_list/test_basic.sh
 create mode 100755 tools/perf/testsuite/base_probe/cleanup.sh
 create mode 100644 tools/perf/testsuite/base_probe/examples/Makefile
 create mode 100644 tools/perf/testsuite/base_probe/examples/advanced.c
 create mode 100644 tools/perf/testsuite/base_probe/examples/exact_counts.c
 create mode 100644 tools/perf/testsuite/base_probe/examples/test.c
 create mode 100644 tools/perf/testsuite/base_probe/settings.sh
 create mode 100755 tools/perf/testsuite/base_probe/setup.sh
 create mode 100755 tools/perf/testsuite/base_probe/test_adding_blacklisted.sh
 create mode 100755 tools/perf/testsuite/base_probe/test_adding_kernel.sh
 create mode 100755 tools/perf/testsuite/base_probe/test_advanced.sh
 create mode 100755 tools/perf/testsuite/base_probe/test_basic.sh
 create mode 100755 tools/perf/testsuite/base_probe/test_exact_counts.sh
 create mode 100755 tools/perf/testsuite/base_probe/test_invalid_options.sh
 create mode 100755 tools/perf/testsuite/base_probe/test_line_semantics.sh
 create mode 100755 tools/perf/testsuite/base_probe/test_listing.sh
 create mode 100755 tools/perf/testsuite/base_probe/test_probe_syntax.sh
 create mode 100755 tools/perf/testsuite/base_report/cleanup.sh
 create mode 100644 tools/perf/testsuite/base_report/settings.sh
 create mode 100755 tools/perf/testsuite/base_report/setup.sh
 create mode 100644 tools/perf/testsuite/base_report/stderr-whitelist.txt
 create mode 100755 tools/perf/testsuite/base_report/test_basic.sh
 create mode 100755 tools/perf/testsuite/base_stat/cleanup.sh
 create mode 100644 tools/perf/testsuite/base_stat/settings.sh
 create mode 100755 tools/perf/testsuite/base_stat/test_basic.sh
 create mode 100755 tools/perf/testsuite/base_stat/test_hw.sh
 create mode 100755 tools/perf/testsuite/base_stat/test_hwcache.sh
 create mode 100755 tools/perf/testsuite/base_stat/test_intel_uncore.sh
 create mode 100755 tools/perf/testsuite/base_stat/test_powerpc_hv_24x7.sh
 create mode 100755 tools/perf/testsuite/base_stat/test_tracepoints_definition.sh
 create mode 100755 tools/perf/testsuite/base_trace/cleanup.sh
 create mode 100644 tools/perf/testsuite/base_trace/settings.sh
 create mode 100755 tools/perf/testsuite/base_trace/setup.sh
 create mode 100644 tools/perf/testsuite/base_trace/stderr-whitelist.txt
 create mode 100755 tools/perf/testsuite/base_trace/test_basic.sh
 create mode 100755 tools/perf/testsuite/base_trace/test_record.sh
 create mode 100755 tools/perf/testsuite/common/check_all_lines_matched.pl
 create mode 100755 tools/perf/testsuite/common/check_all_patterns_found.pl
 create mode 100755 tools/perf/testsuite/common/check_any_pattern_found.pl
 create mode 100755 tools/perf/testsuite/common/check_buildids_vs_files.pl
 create mode 100755 tools/perf/testsuite/common/check_errors_whitelisted.pl
 create mode 100755 tools/perf/testsuite/common/check_exact_pattern_order.pl
 create mode 100755 tools/perf/testsuite/common/check_kallsyms_vs_probes.pl
 create mode 100755 tools/perf/testsuite/common/check_no_patterns_found.pl
 create mode 100644 tools/perf/testsuite/common/init.sh
 create mode 100644 tools/perf/testsuite/common/parametrization.sh
 create mode 100644 tools/perf/testsuite/common/patterns.sh
 create mode 100644 tools/perf/testsuite/common/settings.sh

                 reply	other threads:[~2015-12-04 17:10 UTC|newest]

Thread overview: [no followups] expand[flat|nested]  mbox.gz  Atom feed

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=1449249055.24573.183.camel@redhat.com \
    --to=mpetlan@redhat.com \
    --cc=acme@redhat.com \
    --cc=jolsa@redhat.com \
    --cc=linux-perf-users@vger.kernel.org \
    --cc=masami.hiramatsu.pt@hitachi.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).