Live Patching
 help / color / mirror / Atom feed
From: sashiko-bot@kernel.org
To: live-patching@vger.kernel.org, "Song Liu" <song@kernel.org>
Cc: jpoimboe@kernel.org, kernel-team@meta.com, peterz@infradead.org,
	joe.lawrence@redhat.com, pmladek@suse.com, jikos@kernel.org,
	mbenes@suse.cz, puranjay@kernel.org
Subject: Re: [PATCH v2 05/58] objtool/klp: Build klp test fixtures through the harness
Date: Mon, 14 Sep 2026 06:41:22 +0000	[thread overview]
Message-ID: <20260914064122.F118C1F000FF@smtp.kernel.org> (raw)
In-Reply-To: <20260914062514.926997-6-song@kernel.org>

Thank you for your contribution! Sashiko AI review found 3 potential issue(s) to consider:
- [Medium] The global `orig_obj` and `patched_obj` variables are not reset by `build_pair()`, causing state leakage between sequential test segments.
- [Medium] `make_vmlinux_pair()` masks malformed test invocations as toolchain deficiencies, resulting in silent test skips.
- [Medium] `run_objtool_check` fails to invalidate the `.checksummed` cache flag after modifying object files in-place.
--

commit 19435afd8ba9b070d7a97986a8ecde2ed711708b
Author: Song Liu <song@kernel.org>
Subject: objtool/klp: Build klp test fixtures through the harness

This commit refactors the objtool livepatch testing harness to standardize
fixture compilation, abstracting build and linking routines. It extracts object
creation and checksum generation into helper functions. It also adds logic to
handle vmlinux pairs and properly sequence objtool checks.

> diff --git a/tools/objtool/tests/lib.sh b/tools/objtool/tests/lib.sh
> index 7185198253bb7..0a9da178f4dc8 100644
> --- a/tools/objtool/tests/lib.sh
> +++ b/tools/objtool/tests/lib.sh

[ ... ]

> @@ -211,17 +224,64 @@ clang_only()
>  	declared_skip "clang only${1:+: $1}"
>  }
>  
> +# build_one <fixture.c> <output object> [cflags...]
> +build_one()
> +{

[ ... ]

> +}
> +
>  # build_pair <fixture.c> [cflags...]
>  build_pair()
>  {
> -	local fixture="$FIXTURES_DIR/$1"; shift
> +	local fixture="$1"; shift
>  
> -	[ -f "$fixture" ] || fail "missing fixture $fixture"
> +	build_one "$fixture" orig.o "$@"
> +	build_one "$fixture" patched.o "$@" -DPATCHED
>  }

[Severity: Medium]
Does this code leave orig_obj pointing to stale data if run after
make_vmlinux_pair()?

If a test sequences its segments so that make_vmlinux_pair() is called first
(which sets the global orig_obj=vmlinux.o), and then build_pair() is called,
build_pair() does not reset orig_obj to orig.o. 

Would this cause a subsequent run_diff() to erroneously diff the stale
vmlinux.o instead of the newly built orig.o?

> +# run_objtool_check <objtool arguments...>
> +#
> +# Run objtool's ordinary check pass over the pair, as the kernel build does.
> +#

[ ... ]

> +run_objtool_check()
> +{
> +	local obj
> +
> +	for obj in "$orig_obj" "$patched_obj"; do
> +		"$OBJTOOL" "$@" "$workdir/$obj" ||
> +			fail "objtool $* failed on $obj"
> +	done
> +}

[Severity: Medium]
Can this function leave a stale checksum cache in place?

Other functions that create or modify objects, like build_one() and
partial_link(), remove the $workdir/.checksummed marker. 

Since run_objtool_check() executes objtool directly on the test objects, which
can append new sections like ORC metadata, should it also remove the
.checksummed file to prevent subsequent run_checksum() calls from skipping
generation and using stale checksum data?

[ ... ]

> +make_vmlinux_pair()
> +{
> +	local orig=() patched=() seen= arg
> +
> +	for arg in "$@"; do
> +		if [ "$arg" = -- ]; then seen=y; continue; fi
> +		if [ -n "$seen" ]; then patched+=( "$arg" ); else orig+=( "$arg" ); fi
> +	done
> +
> +	partial_link "$workdir/vmlinux.o" "${orig[@]}" ||
> +		probe_skip "partial link unavailable"

[Severity: Medium]
Will this silently mask test definition bugs as toolchain deficiencies?

If a test author accidentally malforms the arguments by omitting the --
delimiter, the $orig or $patched arrays will be empty. Calling partial_link
with empty input arrays would correctly fail, but capturing that failure here
and executing probe_skip masks it. 

Doesn't this contradict the commit's design principle that a fixture which will
not compile should be a failure rather than a skip?

-- 
Sashiko AI review · https://sashiko.dev/#/patchset/20260914062514.926997-1-song@kernel.org?part=5

  reply	other threads:[~2026-09-14  6:41 UTC|newest]

Thread overview: 88+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-09-14  6:24 [PATCH v2 00/58] Unit test framework for klp-build toolchain Song Liu
2026-09-14  6:24 ` [PATCH v2 01/58] objtool: Add test harness for the klp subcommands Song Liu
2026-09-14  6:24 ` [PATCH v2 02/58] objtool/klp: Check the klp test environment once, before any test Song Liu
2026-09-14  6:37   ` sashiko-bot
2026-09-14 18:39     ` Song Liu
2026-09-14  6:24 ` [PATCH v2 03/58] objtool/klp: Group the klp tests by architecture Song Liu
2026-09-14  6:24 ` [PATCH v2 04/58] objtool/klp: Classify klp test outcomes Song Liu
2026-09-14  6:39   ` sashiko-bot
2026-09-14 18:50     ` Song Liu
2026-09-14  6:24 ` [PATCH v2 05/58] objtool/klp: Build klp test fixtures through the harness Song Liu
2026-09-14  6:41   ` sashiko-bot [this message]
2026-09-14 19:52     ` Song Liu
2026-09-14  6:24 ` [PATCH v2 06/58] objtool/klp: Grow the klp test harness vocabulary Song Liu
2026-09-14  6:41   ` sashiko-bot
2026-09-14 20:37     ` Song Liu
2026-09-14  6:24 ` [PATCH v2 07/58] objtool/klp: Give each run one working directory, one per test inside it Song Liu
2026-09-14  6:24 ` [PATCH v2 08/58] objtool/klp: Run the klp tests under set -u Song Liu
2026-09-14  6:24 ` [PATCH v2 09/58] objtool/klp: Document the klp test harness Song Liu
2026-09-14  6:24 ` [PATCH v2 10/58] objtool: Keep failing test workdirs by default Song Liu
2026-09-14  6:37   ` sashiko-bot
2026-09-14 18:25     ` Song Liu
2026-09-14  6:24 ` [PATCH v2 11/58] objtool: Forward toolchain variables to the klp test runner Song Liu
2026-09-14  6:39   ` sashiko-bot
2026-09-14 20:48     ` Song Liu
2026-09-14  6:24 ` [PATCH v2 12/58] objtool/klp: Add test for rejecting changed data Song Liu
2026-09-14  6:24 ` [PATCH v2 13/58] objtool/klp: Add test for newly introduced data Song Liu
2026-09-14  6:38   ` sashiko-bot
2026-09-14 20:47     ` Song Liu
2026-09-14  6:24 ` [PATCH v2 14/58] objtool/klp: Add test for newly introduced functions Song Liu
2026-09-14  6:24 ` [PATCH v2 15/58] objtool/klp: Add test for static local correlation Song Liu
2026-09-14  6:24 ` [PATCH v2 16/58] objtool/klp: Add test for cold function halves Song Liu
2026-09-14  6:38   ` sashiko-bot
2026-09-14 20:55     ` Song Liu
2026-09-14  6:24 ` [PATCH v2 17/58] objtool/klp: Add test for special section extraction Song Liu
2026-09-14  6:24 ` [PATCH v2 18/58] objtool/klp: Add test for selective " Song Liu
2026-09-14  6:24 ` [PATCH v2 19/58] objtool/klp: Add test for jump table key relocations Song Liu
2026-09-14  6:46   ` sashiko-bot
2026-09-14 20:55     ` Song Liu
2026-09-14  6:24 ` [PATCH v2 20/58] objtool/klp: Add test for rejecting module-owned static branch keys Song Liu
2026-09-14  6:24 ` [PATCH v2 21/58] objtool/klp: Add test for rejecting module-owned static call keys Song Liu
2026-09-14  6:24 ` [PATCH v2 22/58] objtool/klp: Add test for symids in discarded sections Song Liu
2026-09-14  6:24 ` [PATCH v2 23/58] objtool/klp: Add test for rejecting references to init code/data Song Liu
2026-09-14  6:24 ` [PATCH v2 24/58] objtool/klp: Add test for correlation across ThinLTO name mangling Song Liu
2026-09-14  6:24 ` [PATCH v2 25/58] objtool/klp: Add test for objects without .modinfo Song Liu
2026-09-14  6:24 ` [PATCH v2 26/58] objtool/klp: Add test for unchecksummed input Song Liu
2026-09-14  6:24 ` [PATCH v2 27/58] objtool/klp: Add klp diff and post-link regression tests Song Liu
2026-09-14  6:24 ` [PATCH v2 28/58] objtool/klp: Add test for klp reloc section naming in module objects Song Liu
2026-09-14  6:24 ` [PATCH v2 29/58] objtool/klp: Add test for vmlinux relocs in a patched module Song Liu
2026-09-14  6:24 ` [PATCH v2 30/58] objtool/klp: Add test for Module.symvers path normalization Song Liu
2026-09-14  6:24 ` [PATCH v2 31/58] objtool/klp: Add test for the contents of the klp_funcs list Song Liu
2026-09-14  6:46   ` sashiko-bot
2026-09-14 21:00     ` Song Liu
2026-09-14  6:24 ` [PATCH v2 32/58] objtool/klp: Add test for EXPORT_SYMBOL_FOR_MODULES references Song Liu
2026-09-14  6:45   ` sashiko-bot
2026-09-14 21:04     ` Song Liu
2026-09-14  6:24 ` [PATCH v2 33/58] objtool/klp: Add test for new references to exported symbols Song Liu
2026-09-14  6:24 ` [PATCH v2 34/58] objtool/klp: Add test for empty x86 alternative replacements Song Liu
2026-09-14  6:24 ` [PATCH v2 35/58] objtool/klp: Add test for recorded checksum values Song Liu
2026-09-14  6:24 ` [PATCH v2 36/58] objtool/klp: Add test for position-independent checksums Song Liu
2026-09-14  6:46   ` sashiko-bot
2026-09-14 21:42     ` Song Liu
2026-09-14  6:24 ` [PATCH v2 37/58] objtool/klp: Add test for sympos in module objects Song Liu
2026-09-14  6:49   ` sashiko-bot
2026-09-14 21:08     ` Song Liu
2026-09-14  6:24 ` [PATCH v2 38/58] objtool/klp: Add test for sympos resolved against a linked vmlinux Song Liu
2026-09-14  6:24 ` [PATCH v2 39/58] objtool/klp: Add test for static locals which must not be correlated Song Liu
2026-09-14  6:24 ` [PATCH v2 40/58] objtool/klp: Add test for __bug_table, __ex_table and __mcount_loc extraction Song Liu
2026-09-14  6:24 ` [PATCH v2 41/58] objtool/klp: Add test for kCFI prefix symbols and traps Song Liu
2026-09-14  6:24 ` [PATCH v2 42/58] objtool/klp: Add test for symbols whose linkage the patch changes Song Liu
2026-09-14  6:47   ` sashiko-bot
2026-09-14  6:24 ` [PATCH v2 43/58] objtool/klp: Test rejection of a file-local static branch key Song Liu
2026-09-14  6:25 ` [PATCH v2 44/58] objtool/klp: Test a hand-built livepatch module's static call keys Song Liu
2026-09-14  6:25 ` [PATCH v2 45/58] objtool/klp: Test text annotations on alternative replacements Song Liu
2026-09-14  6:25 ` [PATCH v2 46/58] objtool/klp: Add test for data object checksums Song Liu
2026-09-14  6:25 ` [PATCH v2 47/58] objtool/klp: Add test for symbols with no checksum entry of their own Song Liu
2026-09-14  6:48   ` sashiko-bot
2026-09-14 22:08     ` Song Liu
2026-09-14  6:25 ` [PATCH v2 48/58] objtool/klp: Add test for a static branch introduced by the patch Song Liu
2026-09-14  6:25 ` [PATCH v2 49/58] objtool/klp: Add test for tracepoint and pr_debug static branch keys Song Liu
2026-09-14  6:25 ` [PATCH v2 50/58] objtool/klp: Add test for a static call introduced by the patch Song Liu
2026-09-14  6:25 ` [PATCH v2 51/58] objtool/klp: Add test for instruction operand checksums Song Liu
2026-09-14  6:25 ` [PATCH v2 52/58] objtool/klp: Add test for alternative replacement code in checksums Song Liu
2026-09-14  6:25 ` [PATCH v2 53/58] objtool/klp: Add test for the alignment of cloned data sections Song Liu
2026-09-14  6:25 ` [PATCH v2 54/58] objtool/klp: Add test for a patch which strips a data annotation Song Liu
2026-09-14  6:25 ` [PATCH v2 55/58] objtool/klp: Add test for absolute and __ADDRESSABLE symbols Song Liu
2026-09-14  6:25 ` [PATCH v2 56/58] objtool/klp: Add test for UBSAN metadata in an unchanged function Song Liu
2026-09-14  6:25 ` [PATCH v2 57/58] objtool/klp: Add test for Clang switch jump tables Song Liu
2026-09-14  6:25 ` [PATCH v2 58/58] objtool/klp: Add test for ThinLTO symbols sharing a demangled name Song Liu

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20260914064122.F118C1F000FF@smtp.kernel.org \
    --to=sashiko-bot@kernel.org \
    --cc=jikos@kernel.org \
    --cc=joe.lawrence@redhat.com \
    --cc=jpoimboe@kernel.org \
    --cc=kernel-team@meta.com \
    --cc=live-patching@vger.kernel.org \
    --cc=mbenes@suse.cz \
    --cc=peterz@infradead.org \
    --cc=pmladek@suse.com \
    --cc=puranjay@kernel.org \
    --cc=sashiko-reviews@lists.linux.dev \
    --cc=song@kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox