From: Namhyung Kim <namhyung@kernel.org>
To: Ian Rogers <irogers@google.com>
Cc: sashiko-reviews@lists.linux.dev,
Thomas Richter <tmricht@linux.ibm.com>,
Arnaldo Carvalho de Melo <acme@kernel.org>,
linux-perf-users@vger.kernel.org, linux-s390@vger.kernel.org,
Vasily Gorbik <gor@linux.ibm.com>,
Heiko Carstens <hca@linux.ibm.com>,
Alexander Gordeev <agordeev@linux.ibm.com>
Subject: Re: [PATCH linux-next] perf test: Skip failing 'perf test aslr' test case
Date: Wed, 24 Jun 2026 12:42:51 -0700 [thread overview]
Message-ID: <ajwzO4GJ8Uj_2mwi@google.com> (raw)
In-Reply-To: <CAP-5=fUJbh=dXiadCJJ4d_prCxox1G0WW_WODwSHC4DvwWuQag@mail.gmail.com>
Hello,
On Mon, Jun 22, 2026 at 11:17:41AM -0700, Ian Rogers wrote:
> On Fri, Jun 19, 2026 at 2:42 AM <sashiko-bot@kernel.org> wrote:
> >
> > Thank you for your contribution! Sashiko AI review found 2 potential issue(s) to consider:
> > - [Medium] Unconditionally setting `err=2` when skipping `test_callchain_aslr` masks prior test failures.
> > - [Medium] Skipping the test incorrectly triggers the test failure cleanup path, leaking the temporary directory in `/tmp/`.
> > --
> >
> > commit d772895777a1677561d1802ac157c32ce73e1379
> > Author: Thomas Richter <tmricht@linux.ibm.com>
> >
> > perf test: Skip failing 'perf test aslr' test case
> >
> > The test case 'perf test aslr' fails on s390. This commit fixes the failure
> > by skipping the subtest test_callchain_aslr and emitting a hint when the
> > --call-graph dwarf option is selected.
> >
> > Fixes: 60bc9fbc0589 ("perf test: Add inject ASLR test")
Shouldn't it be 190c45463844?
> >
> > > diff --git a/tools/perf/tests/shell/inject_aslr.sh b/tools/perf/tests/shell/inject_aslr.sh
> > > index c00461828ea79..7fdb43679dc84 100755
> > > --- a/tools/perf/tests/shell/inject_aslr.sh
> > > +++ b/tools/perf/tests/shell/inject_aslr.sh
> > > @@ -135,8 +135,15 @@ test_callchain_aslr() {
> > > echo "Callchain ASLR test [Failed - no noploop samples in original file]"
> > > err=1
> > > elif [ -z "$new_addr" ]; then
> > > - echo "Callchain ASLR test [Failed - could not find remapped address]"
> > > - err=1
> > > + if perf evlist -v -i "${data}" | grep -q 'sample_type:.*STACK_USER'; then
> > > + echo "Dropping stack user sample as possible ASLR leak"
> > > + echo "Call-graph dwarf not supported with 'perf inject --aslr'"
> > > + echo "Callchain ASLR test [Skip]"
> > > + err=2
> >
> > [Severity: Medium]
> > Does unconditionally setting err=2 here mask prior test failures?
> >
> > If an earlier subtest fails, the global err variable is set to 1. When
> > test_callchain_aslr() decides to skip and assigns err=2, it overwrites
> > this previous failure state.
> >
> > Since the perf test framework treats an exit code of 2 as a SKIP, the test
> > suite will report the entire script as skipped, completely hiding the
> > actual failure from the prior subtest.
Right, it should not overwrite if it's already 1.
Thanks,
Namhyng
> >
> > [Severity: Medium]
> > Will skipping this test inadvertently trigger the test failure cleanup path
> > and leak the temporary directory?
> >
> > The cleanup() function in tools/perf/tests/shell/inject_aslr.sh explicitly
> > aborts deletion if the exit code or err is non-zero:
> >
> > cleanup() {
> > if [ "${exit_code}" -ne 0 ] || [ "${err}" -ne 0 ]; then
>
>
> Thanks for the fix Thomas! I completely agree with what you've done,
> but it exposed this latent issue that we should make the exit_code/err
> comparison -eq 1 rather than -ne 0. Perhaps Arnaldo can fix this, or
> we can address it as a follow-up.
>
> Reviewed-by: Ian Rogers <irogers@google.com>
>
> Thanks,
> Ian
>
> > echo "Test failed! Preserving temp directory: ${temp_dir}"
> > return
> > fi
> > ...
> > }
> >
> > Because cleanup() was not updated to handle the new skip state, it
> > mistakenly treats err=2 as a test failure. This unconditionally leaves
> > behind the /tmp/perf-test-aslr.XXXXXX directory every time the test skips.
> >
> > > + else
> > > + echo "Callchain ASLR test [Failed - could not find remapped address]"
> > > + err=1
> > > + fi
> > > elif [ "$orig_addr" = "$new_addr" ]; then
> > > echo "Callchain ASLR test [Failed - addresses are not remapped]"
> > > err=1
> >
> > --
> > Sashiko AI review · https://sashiko.dev/#/patchset/20260619093531.4038655-1-tmricht@linux.ibm.com?part=1
> >
prev parent reply other threads:[~2026-06-24 19:42 UTC|newest]
Thread overview: 4+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-06-19 9:35 [PATCH linux-next] perf test: Skip failing 'perf test aslr' test case Thomas Richter
2026-06-19 9:42 ` sashiko-bot
2026-06-22 18:17 ` Ian Rogers
2026-06-24 19:42 ` Namhyung Kim [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=ajwzO4GJ8Uj_2mwi@google.com \
--to=namhyung@kernel.org \
--cc=acme@kernel.org \
--cc=agordeev@linux.ibm.com \
--cc=gor@linux.ibm.com \
--cc=hca@linux.ibm.com \
--cc=irogers@google.com \
--cc=linux-perf-users@vger.kernel.org \
--cc=linux-s390@vger.kernel.org \
--cc=sashiko-reviews@lists.linux.dev \
--cc=tmricht@linux.ibm.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox