All of lore.kernel.org
 help / color / mirror / Atom feed
From: Michael Petlan <mpetlan@redhat.com>
To: "Arnaldo Carvalho de Melo" <acme@redhat.com>,
	"Jiri Olsa" <jolsa@redhat.com>,
	"平松雅巳 / HIRAMATU,MASAMI" <masami.hiramatsu.pt@hitachi.com>
Cc: "linux-perf-users@vger.kernel.org" <linux-perf-users@vger.kernel.org>
Subject: [PATCH 0/2] The testsuite again
Date: Fri, 04 Dec 2015 18:10:55 +0100	[thread overview]
Message-ID: <1449249055.24573.183.camel@redhat.com> (raw)

Hi all!

I have extended the testsuite I announced some time ago and cleaned
it up a bit, so it should be in a better shape than before.  I also
created a perf test entry for running it from perf-test.

How to test it:

- apply patches; make
- ./perf test suite [-v]

There are some failures now,  but they should be passing when other
patches are applied (basically the patches related to the bugs I've
reported and/or sent patches for (perf list segfault, "bogus values
of variables in userspace probes", etc...).

I briefly tested it on aarch64 (X-Gene) and ppc64le architectures,
and of course x86_64.

In the current state,  it searches for the "testsuite" directory in
`pwd`, when not found, the testcase is skipped. --> Maybe we should
think about some packaging, standard locations or whatever.

Thoughts?

Regards,
Michael



Michael Petlan (2):
  perf test: Adding an entry for the perftool-testsuite
  perf test: Introducing new testsuite

 tools/perf/tests/Build                             |   1 +
 tools/perf/tests/builtin-test.c                    |   4 +
 tools/perf/tests/suite.c                           | 143 +++++++++++++
 tools/perf/tests/suite.h                           |  30 +++
 tools/perf/tests/tests.h                           |   1 +
 tools/perf/testsuite/base_annotate/cleanup.sh      |  22 ++
 .../perf/testsuite/base_annotate/examples/Makefile |  13 ++
 tools/perf/testsuite/base_annotate/examples/load.c |  24 +++
 tools/perf/testsuite/base_annotate/settings.sh     |  15 ++
 tools/perf/testsuite/base_annotate/setup.sh        |  35 ++++
 tools/perf/testsuite/base_annotate/test_basic.sh   | 169 +++++++++++++++
 tools/perf/testsuite/base_buildid/cleanup.sh       |  20 ++
 tools/perf/testsuite/base_buildid/settings.sh      |  23 +++
 tools/perf/testsuite/base_buildid/setup.sh         |  26 +++
 .../testsuite/base_buildid/test_buildid-list.sh    |  79 +++++++
 tools/perf/testsuite/base_list/cleanup.sh          |  19 ++
 tools/perf/testsuite/base_list/settings.sh         |  15 ++
 tools/perf/testsuite/base_list/setup.sh            |  20 ++
 tools/perf/testsuite/base_list/test_basic.sh       |  88 ++++++++
 tools/perf/testsuite/base_probe/cleanup.sh         |  22 ++
 tools/perf/testsuite/base_probe/examples/Makefile  |  13 ++
 .../perf/testsuite/base_probe/examples/advanced.c  |  40 ++++
 .../testsuite/base_probe/examples/exact_counts.c   |  35 ++++
 tools/perf/testsuite/base_probe/examples/test.c    |  35 ++++
 tools/perf/testsuite/base_probe/settings.sh        |  42 ++++
 tools/perf/testsuite/base_probe/setup.sh           |  23 +++
 .../base_probe/test_adding_blacklisted.sh          |  63 ++++++
 .../testsuite/base_probe/test_adding_kernel.sh     | 229 +++++++++++++++++++++
 tools/perf/testsuite/base_probe/test_advanced.sh   | 124 +++++++++++
 tools/perf/testsuite/base_probe/test_basic.sh      |  79 +++++++
 .../perf/testsuite/base_probe/test_exact_counts.sh | 106 ++++++++++
 .../testsuite/base_probe/test_invalid_options.sh   |  80 +++++++
 .../testsuite/base_probe/test_line_semantics.sh    |  56 +++++
 tools/perf/testsuite/base_probe/test_listing.sh    | 154 ++++++++++++++
 .../perf/testsuite/base_probe/test_probe_syntax.sh | 119 +++++++++++
 tools/perf/testsuite/base_report/cleanup.sh        |  22 ++
 tools/perf/testsuite/base_report/settings.sh       |  15 ++
 tools/perf/testsuite/base_report/setup.sh          |  26 +++
 .../testsuite/base_report/stderr-whitelist.txt     |   1 +
 tools/perf/testsuite/base_report/test_basic.sh     | 169 +++++++++++++++
 tools/perf/testsuite/base_stat/cleanup.sh          |  21 ++
 tools/perf/testsuite/base_stat/settings.sh         |  10 +
 tools/perf/testsuite/base_stat/test_basic.sh       |  68 ++++++
 tools/perf/testsuite/base_stat/test_hw.sh          |  50 +++++
 tools/perf/testsuite/base_stat/test_hwcache.sh     |  51 +++++
 .../perf/testsuite/base_stat/test_intel_uncore.sh  |  46 +++++
 .../testsuite/base_stat/test_powerpc_hv_24x7.sh    |  60 ++++++
 .../base_stat/test_tracepoints_definition.sh       |  60 ++++++
 tools/perf/testsuite/base_trace/cleanup.sh         |  19 ++
 tools/perf/testsuite/base_trace/settings.sh        |  10 +
 tools/perf/testsuite/base_trace/setup.sh           |  16 ++
 .../perf/testsuite/base_trace/stderr-whitelist.txt |   1 +
 tools/perf/testsuite/base_trace/test_basic.sh      | 129 ++++++++++++
 tools/perf/testsuite/base_trace/test_record.sh     |  45 ++++
 .../testsuite/common/check_all_lines_matched.pl    |  38 ++++
 .../testsuite/common/check_all_patterns_found.pl   |  33 +++
 .../testsuite/common/check_any_pattern_found.pl    |  14 ++
 .../testsuite/common/check_buildids_vs_files.pl    |  22 ++
 .../testsuite/common/check_errors_whitelisted.pl   |  50 +++++
 .../testsuite/common/check_exact_pattern_order.pl  |  27 +++
 .../testsuite/common/check_kallsyms_vs_probes.pl   |  48 +++++
 .../testsuite/common/check_no_patterns_found.pl    |  33 +++
 tools/perf/testsuite/common/init.sh                |  67 ++++++
 tools/perf/testsuite/common/parametrization.sh     |  32 +++
 tools/perf/testsuite/common/patterns.sh            | 117 +++++++++++
 tools/perf/testsuite/common/settings.sh            |  57 +++++
 66 files changed, 3324 insertions(+)
 create mode 100644 tools/perf/tests/suite.c
 create mode 100644 tools/perf/tests/suite.h
 create mode 100755 tools/perf/testsuite/base_annotate/cleanup.sh
 create mode 100644 tools/perf/testsuite/base_annotate/examples/Makefile
 create mode 100644 tools/perf/testsuite/base_annotate/examples/load.c
 create mode 100644 tools/perf/testsuite/base_annotate/settings.sh
 create mode 100755 tools/perf/testsuite/base_annotate/setup.sh
 create mode 100755 tools/perf/testsuite/base_annotate/test_basic.sh
 create mode 100755 tools/perf/testsuite/base_buildid/cleanup.sh
 create mode 100644 tools/perf/testsuite/base_buildid/settings.sh
 create mode 100755 tools/perf/testsuite/base_buildid/setup.sh
 create mode 100755 tools/perf/testsuite/base_buildid/test_buildid-list.sh
 create mode 100755 tools/perf/testsuite/base_list/cleanup.sh
 create mode 100644 tools/perf/testsuite/base_list/settings.sh
 create mode 100755 tools/perf/testsuite/base_list/setup.sh
 create mode 100755 tools/perf/testsuite/base_list/test_basic.sh
 create mode 100755 tools/perf/testsuite/base_probe/cleanup.sh
 create mode 100644 tools/perf/testsuite/base_probe/examples/Makefile
 create mode 100644 tools/perf/testsuite/base_probe/examples/advanced.c
 create mode 100644 tools/perf/testsuite/base_probe/examples/exact_counts.c
 create mode 100644 tools/perf/testsuite/base_probe/examples/test.c
 create mode 100644 tools/perf/testsuite/base_probe/settings.sh
 create mode 100755 tools/perf/testsuite/base_probe/setup.sh
 create mode 100755 tools/perf/testsuite/base_probe/test_adding_blacklisted.sh
 create mode 100755 tools/perf/testsuite/base_probe/test_adding_kernel.sh
 create mode 100755 tools/perf/testsuite/base_probe/test_advanced.sh
 create mode 100755 tools/perf/testsuite/base_probe/test_basic.sh
 create mode 100755 tools/perf/testsuite/base_probe/test_exact_counts.sh
 create mode 100755 tools/perf/testsuite/base_probe/test_invalid_options.sh
 create mode 100755 tools/perf/testsuite/base_probe/test_line_semantics.sh
 create mode 100755 tools/perf/testsuite/base_probe/test_listing.sh
 create mode 100755 tools/perf/testsuite/base_probe/test_probe_syntax.sh
 create mode 100755 tools/perf/testsuite/base_report/cleanup.sh
 create mode 100644 tools/perf/testsuite/base_report/settings.sh
 create mode 100755 tools/perf/testsuite/base_report/setup.sh
 create mode 100644 tools/perf/testsuite/base_report/stderr-whitelist.txt
 create mode 100755 tools/perf/testsuite/base_report/test_basic.sh
 create mode 100755 tools/perf/testsuite/base_stat/cleanup.sh
 create mode 100644 tools/perf/testsuite/base_stat/settings.sh
 create mode 100755 tools/perf/testsuite/base_stat/test_basic.sh
 create mode 100755 tools/perf/testsuite/base_stat/test_hw.sh
 create mode 100755 tools/perf/testsuite/base_stat/test_hwcache.sh
 create mode 100755 tools/perf/testsuite/base_stat/test_intel_uncore.sh
 create mode 100755 tools/perf/testsuite/base_stat/test_powerpc_hv_24x7.sh
 create mode 100755 tools/perf/testsuite/base_stat/test_tracepoints_definition.sh
 create mode 100755 tools/perf/testsuite/base_trace/cleanup.sh
 create mode 100644 tools/perf/testsuite/base_trace/settings.sh
 create mode 100755 tools/perf/testsuite/base_trace/setup.sh
 create mode 100644 tools/perf/testsuite/base_trace/stderr-whitelist.txt
 create mode 100755 tools/perf/testsuite/base_trace/test_basic.sh
 create mode 100755 tools/perf/testsuite/base_trace/test_record.sh
 create mode 100755 tools/perf/testsuite/common/check_all_lines_matched.pl
 create mode 100755 tools/perf/testsuite/common/check_all_patterns_found.pl
 create mode 100755 tools/perf/testsuite/common/check_any_pattern_found.pl
 create mode 100755 tools/perf/testsuite/common/check_buildids_vs_files.pl
 create mode 100755 tools/perf/testsuite/common/check_errors_whitelisted.pl
 create mode 100755 tools/perf/testsuite/common/check_exact_pattern_order.pl
 create mode 100755 tools/perf/testsuite/common/check_kallsyms_vs_probes.pl
 create mode 100755 tools/perf/testsuite/common/check_no_patterns_found.pl
 create mode 100644 tools/perf/testsuite/common/init.sh
 create mode 100644 tools/perf/testsuite/common/parametrization.sh
 create mode 100644 tools/perf/testsuite/common/patterns.sh
 create mode 100644 tools/perf/testsuite/common/settings.sh

                 reply	other threads:[~2015-12-04 17:10 UTC|newest]

Thread overview: [no followups] expand[flat|nested]  mbox.gz  Atom feed

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=1449249055.24573.183.camel@redhat.com \
    --to=mpetlan@redhat.com \
    --cc=acme@redhat.com \
    --cc=jolsa@redhat.com \
    --cc=linux-perf-users@vger.kernel.org \
    --cc=masami.hiramatsu.pt@hitachi.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.