From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from 66-220-144-178.mail-mxout.facebook.com (66-220-144-178.mail-mxout.facebook.com [66.220.144.178]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 23CBF30216D for ; Mon, 17 Aug 2026 04:22:11 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=66.220.144.178 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1786940532; cv=none; b=ktMRl/iZzhOyaib/65Xi+V//XDbKZJ7lF0ClwgGSs4bzj7zMe+dctm5pJHS6Yk+Ngtyt8E/FzA9vxoorHB+HHCSo0X4yjdM33BvECEXLq59A67+xpdp8mLXUoD90wi6VnhBYq1EUALX94mYHPWjlHeU/+HaeBtTrXm0wjREoSyk= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1786940532; c=relaxed/simple; bh=1HU6aWke/FMDdwfTFIrp6htusJcwQxqwl6PziKfKBI8=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version; b=qrK8+k+woKoqeJKOis2GQqLfTiAGxPonm5BGukF2HIpzfs2+4iEFFgrZ2SrqfpOGb0T51EvqtN82DLeNtcLU66w52KEpOuqTxBnxk7bwTOEWUjEixpVeH/+9gHXpuLnRCKXG/fR3xZH27kYd1DLLvDVumT6UL0nYTKoThyEA0Z4= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=fail (p=none dis=none) header.from=linux.dev; spf=fail smtp.mailfrom=linux.dev; arc=none smtp.client-ip=66.220.144.178 Authentication-Results: smtp.subspace.kernel.org; dmarc=fail (p=none dis=none) header.from=linux.dev Authentication-Results: smtp.subspace.kernel.org; spf=fail smtp.mailfrom=linux.dev Received: by devvm16039.vll0.facebook.com (Postfix, from userid 128203) id 29B8D24982E7FF; Sun, 16 Aug 2026 21:22:07 -0700 (PDT) From: Yonghong Song To: bpf@vger.kernel.org Cc: Alexei Starovoitov , Andrii Nakryiko , Daniel Borkmann , Eduard Zingerman , kernel-team@fb.com Subject: [PATCH bpf-next v6 05/10] bpf: Account R2 of register-pair returns in live register analysis Date: Sun, 16 Aug 2026 21:22:07 -0700 Message-ID: <20260817042207.2289995-1-yonghong.song@linux.dev> X-Mailer: git-send-email 2.53.0 In-Reply-To: <20260817042141.2286086-1-yonghong.song@linux.dev> References: <20260817042141.2286086-1-yonghong.song@linux.dev> Precedence: bulk X-Mailing-List: bpf@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable A BPF_EXIT of a subprogram returning a value larger than 8 bytes (a struct/union or an __int128) reads R2 as well as R0, since the second hal= f of the return value is passed back in R2. compute_insn_live_regs() only marked R0 used at exit, so a callee's R2 could be considered dead and cleaned from checkpointed states, which would allow unsound state pruning= . Mark R2 as read at the BPF_EXIT of a subprogram that does return a regist= er pair. bpf_compute_live_registers() now loops over the subprograms and, fo= r each, over the [start, end) instruction range from env->subprog_info[], s= o the return convention is queried once per subprogram through bpf_ret_reg_pair() rather than once per instruction. Marking R2 at every exit instead would be simpler, but R2 would then stay live backwards across any call that is not followed by a write to R2, whi= ch is nearly every program, and would needlessly hurt state pruning. Acked-by: Eduard Zingerman Signed-off-by: Yonghong Song --- kernel/bpf/liveness.c | 20 ++++++++++++++------ 1 file changed, 14 insertions(+), 6 deletions(-) diff --git a/kernel/bpf/liveness.c b/kernel/bpf/liveness.c index 74fc4b3f80d6..71f998c6eb88 100644 --- a/kernel/bpf/liveness.c +++ b/kernel/bpf/liveness.c @@ -2060,7 +2060,8 @@ static inline u16 mask_hi(u32 m) { return (u16)(m >= > 16); } /* Compute info->{use,def} fields for the instruction */ static void compute_insn_live_regs(struct bpf_verifier_env *env, struct bpf_insn *insn, - struct insn_live_regs *info) + struct insn_live_regs *info, + bool ret_reg_pair) { struct bpf_call_summary cs; const u8 class =3D BPF_CLASS(insn->code); @@ -2072,6 +2073,7 @@ static void compute_insn_live_regs(struct bpf_verif= ier_env *env, const u32 src32 =3D mask_lo(src); const u32 dst32 =3D mask_lo(dst); const u32 r0 =3D reg64_mask(0); + const u32 r2 =3D reg64_mask(BPF_REG_2); u32 def =3D 0; u32 use =3D U32_MAX; =20 @@ -2191,7 +2193,7 @@ static void compute_insn_live_regs(struct bpf_verif= ier_env *env, break; case BPF_EXIT: def =3D 0; - use =3D r0; + use =3D ret_reg_pair ? (r0 | r2) : r0; break; case BPF_CALL: def =3D ALL_CALLER_SAVED_REGS; @@ -2228,8 +2230,8 @@ int bpf_compute_live_registers(struct bpf_verifier_= env *env) struct insn_live_regs *state; int insn_cnt =3D env->prog->len; u64 pos, insn_pos; - int err =3D 0, i, j; - bool changed; + int err =3D 0, i, j, subprog, start, end; + bool changed, ret_reg_pair; =20 /* Use the following algorithm: * - define the following: @@ -2256,8 +2258,14 @@ int bpf_compute_live_registers(struct bpf_verifier= _env *env) goto out; } =20 - for (i =3D 0; i < insn_cnt; ++i) - compute_insn_live_regs(env, &insns[i], &state[i]); + for (subprog =3D 0; subprog < env->subprog_cnt; subprog++) { + start =3D env->subprog_info[subprog].start; + end =3D env->subprog_info[subprog + 1].start; + ret_reg_pair =3D bpf_ret_reg_pair(env, subprog); + + for (i =3D start; i < end; ++i) + compute_insn_live_regs(env, &insns[i], &state[i], ret_reg_pair); + } =20 /* Forward pass: resolve stack access through FP-derived pointers */ err =3D bpf_compute_subprog_arg_access(env); --=20 2.53.0-Meta