Linux Perf Users
 help / color / mirror / Atom feed
From: sashiko-bot@kernel.org
To: "Ian Rogers" <irogers@google.com>
Cc: linux-perf-users@vger.kernel.org
Subject: Re: [PATCH v1 07/14] perf test: Show snippet failure output for verbose=1
Date: Thu, 14 May 2026 15:50:40 +0000	[thread overview]
Message-ID: <20260514155041.1529DC2BCB3@smtp.kernel.org> (raw)
In-Reply-To: <20260513230450.529380-8-irogers@google.com>

Thank you for your contribution! Sashiko AI review found 2 potential issue(s) to consider:
- [Medium] Unbounded output and error context starvation in Pass 0
- [Low] Undefined behavior when passing uncasted signed char to `tolower()`
--

commit 957cea0e8173df2ef71d1dc7480195a00fb7a68a
Author: Ian Rogers <irogers@google.com>

perf test: Show snippet failure output for verbose=1

This commit implements a bounded snippet processor for test failure outputs
when running in verbose mode. It aims to extract important keywords like
'error', 'fail', or 'segv' to isolate the root cause, rather than dumping
the entire raw output buffer.

> diff --git a/tools/perf/tests/builtin-test.c b/tools/perf/tests/builtin-test.c
> index ad1b941731ca1..45c1afb9ad333 100644
> --- a/tools/perf/tests/builtin-test.c
> +++ b/tools/perf/tests/builtin-test.c
[ ... ]
> @@ -394,6 +396,210 @@ static int print_test_result(struct test_suite *t, int curr_suite, int curr_test
[ ... ]
> +static const char *find_next_keyword(const char *str, size_t max_len, size_t *kw_len)
> +{
> +	const char *best = NULL;
> +	size_t best_len = 0;
> +	int k;
> +
> +	for (k = 0; fail_keywords[k]; k++) {
> +		const char *s = str;
> +		size_t len = strlen(fail_keywords[k]);
> +
> +		while ((size_t)(s - str) + len <= max_len) {
> +			size_t i;
> +
> +			for (i = 0; i < len; i++) {
> +				if (tolower(s[i]) != fail_keywords[k][i])

Could this trigger undefined behavior? The output stream might contain
arbitrary binary data or non-ASCII UTF-8 bytes.

Since the argument to tolower() must be representable as an unsigned char
or EOF, passing a negative value from a signed char can result in
undefined behavior.

Should s[i] be cast to an unsigned char here?

> +					break;
> +			}
[ ... ]
> +static void print_test_failure_snippet(FILE *fp, const char *buf)
> +{
[ ... ]
> +	/* Pass 0: Unconditionally pick marker lines */
> +	for (i = 0; i < num_lines; i++) {
> +		if (line_contains(lines[i], line_lens[i], "----")) {
> +			pick[i] = true;
> +			if (picked_count < failure_snippet_lines)
> +				picked_count++;
> +		}
> +	}

Does this bypass the failure_snippet_lines limit if a test outputs many
marker lines? Since pick[i] is set to true unconditionally, a test with
hundreds of marker lines might cause an unbounded terminal dump.

Additionally, if there are enough marker lines, picked_count will fully
consume the quota before Pass 1 executes. As a result, Pass 1 will be
skipped entirely:

> +
> +	/* Pass 1: Pick lines with failure keywords from start */
> +	for (i = 0; i < num_lines && picked_count < failure_snippet_lines; i++) {

Is it possible this starves the quota and prevents actual failure context
from being picked up?

-- 
Sashiko AI review · https://sashiko.dev/#/patchset/20260513230450.529380-1-irogers@google.com?part=7

  reply	other threads:[~2026-05-14 15:50 UTC|newest]

Thread overview: 21+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-05-13 23:04 [PATCH v1 00/14] perf test: Harness improvements Ian Rogers
2026-05-13 23:04 ` [PATCH v1 01/14] perf jevents.py: Make generated C code more kernel style Ian Rogers
2026-05-13 23:04 ` [PATCH v1 02/14] perf pmu-events: Add API to get metric table name and iterate tables Ian Rogers
2026-05-14 11:42   ` sashiko-bot
2026-05-13 23:04 ` [PATCH v1 03/14] perf test: Drain pipe after child finishes to avoid losing output Ian Rogers
2026-05-13 23:04 ` [PATCH v1 04/14] perf test: Support dynamic test suites with setup callback and private data Ian Rogers
2026-05-14 12:10   ` sashiko-bot
2026-05-13 23:04 ` [PATCH v1 05/14] perf test pmu-events: A sub-test per metric table Ian Rogers
2026-05-13 23:04 ` [PATCH v1 06/14] perf test: Refactor parallel poll loop to drain all pipes simultaneously Ian Rogers
2026-05-14 14:27   ` sashiko-bot
2026-05-13 23:04 ` [PATCH v1 07/14] perf test: Show snippet failure output for verbose=1 Ian Rogers
2026-05-14 15:50   ` sashiko-bot [this message]
2026-05-13 23:04 ` [PATCH v1 08/14] perf test: Add summary reporting Ian Rogers
2026-05-14 16:10   ` sashiko-bot
2026-05-13 23:04 ` [PATCH v1 09/14] perf test: Fix subtest status alignment for multi-digit indexes Ian Rogers
2026-05-13 23:04 ` [PATCH v1 10/14] perf test: Skip shebang and SPDX comments in shell test descriptions Ian Rogers
2026-05-13 23:04 ` [PATCH v1 11/14] perf test: Split monolithic 'util' test suite into sub-tests Ian Rogers
2026-05-13 23:04 ` [PATCH v1 12/14] perf test: Add -j/--junit option for JUnit XML test reports Ian Rogers
2026-05-14 17:48   ` sashiko-bot
2026-05-13 23:04 ` [PATCH v1 13/14] perf test: Add shell test to validate JUnit XML reporting output Ian Rogers
2026-05-13 23:04 ` [PATCH v1 14/14] perf test: Remove /usr/bin/cc dependency from Intel PT shell test Ian Rogers

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20260514155041.1529DC2BCB3@smtp.kernel.org \
    --to=sashiko-bot@kernel.org \
    --cc=irogers@google.com \
    --cc=linux-perf-users@vger.kernel.org \
    --cc=sashiko-reviews@lists.linux.dev \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox