From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 403B82E2F1B for ; Mon, 11 Aug 2025 22:24:54 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=198.137.202.133 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1754951097; cv=none; b=Ihg5kicI7Adu4XfD3eAG2wzlFbOiTGJQriElVtXLa41vunmfXChrlr85QBCzOxkG2BS1nU5iiFmbieVl8eH56V0ddjqJXXZmISPxyQj6UofpvgGTtamGZLfY4B3tw2OHQavcBVjvt/9FBU4o4ZyOtf9zOiR//3EWmU5y5+IG0Vk= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1754951097; c=relaxed/simple; bh=1StTlgx0SC2la7wL8BWxP/nEaNvYGa7gdttP2P2OwQ4=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version; b=jj+zPRze1YM48lE2NyZr9z0ZemodLS8poFszCHSqPBYMXCUgYeCJ7eT0TGbpg0cewjJYx8+o+dRGJGXBM1V8HU4MmU1Zj6IytBT0ULHQxD2CLf5Pr+ri4SIpsEduAmKj/YI+pPsCaiUVWMRFrNRYXWHoYz94+jXptsirAn0bQ+Y= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=fail (p=quarantine dis=none) header.from=kernel.org; spf=none smtp.mailfrom=infradead.org; dkim=pass (2048-bit key) header.d=infradead.org header.i=@infradead.org header.b=AtkETknZ; arc=none smtp.client-ip=198.137.202.133 Authentication-Results: smtp.subspace.kernel.org; dmarc=fail (p=quarantine dis=none) header.from=kernel.org Authentication-Results: smtp.subspace.kernel.org; spf=none smtp.mailfrom=infradead.org Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=infradead.org header.i=@infradead.org header.b="AtkETknZ" DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=bombadil.20210309; h=Sender:Content-Transfer-Encoding: MIME-Version:References:In-Reply-To:Message-ID:Date:Subject:Cc:To:From: Reply-To:Content-Type:Content-ID:Content-Description; bh=ubwRSONNIK+OmfQAlF+nNnuROOe1rk4XSrcNXlFLAWw=; b=AtkETknZG3sh/MaIktMbY/3YZT mf2SoLn2LNkOWoR+KeglwSSZW3POPQXq8wgIE7O3LVZHBHgDAC/mxYbqBH6zulIizg48fg6SvAabN z8nhIR2OCcENJtpI+55od11pkPsuIri+niLosTbGwjxty8WD2ADChdxeOc0ng6XD/8kkesihtQp+Q 2Xlk8W99zDZ3dV72ugWBWJJ4VFj5LKfEcLUEdT/DfFSajfukev1nYl5lecD3YGkrTINkbVQcvrSHh tK7cJr2xlDhUFcD8mQuSto5HKT+zNwb4lgOXvG+x8N9lBCj4F0OCoAuPezvFTVP7fsPKg80h/I3rh GplqeGNg==; Received: from mcgrof by bombadil.infradead.org with local (Exim 4.98.2 #2 (Red Hat Linux)) id 1ulawn-00000009Hk8-38a7; Mon, 11 Aug 2025 22:24:53 +0000 From: Luis Chamberlain To: Chuck Lever , Daniel Gomez , kdevops@lists.linux.dev Cc: Luis Chamberlain Subject: [PATCH 16/23] reboot-limit: add A/B testing support targets Date: Mon, 11 Aug 2025 15:24:43 -0700 Message-ID: <20250811222452.2213071-17-mcgrof@kernel.org> X-Mailer: git-send-email 2.49.0 In-Reply-To: <20250811222452.2213071-1-mcgrof@kernel.org> References: <20250811222452.2213071-1-mcgrof@kernel.org> Precedence: bulk X-Mailing-List: kdevops@lists.linux.dev List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Sender: Luis Chamberlain Add missing targets to support A/B testing workflow: - reboot-limit-tests: runs tests on both baseline and dev groups - reboot-limit-dev: runs tests on dev group only Rename the confusing reboot-limit-dev-baseline target to just reboot-limit-dev. The "dev-baseline" naming was nonsensical as it mixed two opposing concepts - "dev" refers to development/testing nodes while "baseline" refers to the control group. Following the pattern of other workflows like fstests, the dev target should simply be named reboot-limit-dev. Also updated help menu to document all available targets including the previously undocumented dev-loop and dev-kotd targets. This enables proper A/B testing with linux-ab workflow where users can test different kernels on baseline and dev groups simultaneously. Generated-by: Claude AI Signed-off-by: Luis Chamberlain --- workflows/demos/reboot-limit/Makefile | 8 +++++++- 1 file changed, 7 insertions(+), 1 deletion(-) diff --git a/workflows/demos/reboot-limit/Makefile b/workflows/demos/reboot-limit/Makefile index abc5b3d0..438acbec 100644 --- a/workflows/demos/reboot-limit/Makefile +++ b/workflows/demos/reboot-limit/Makefile @@ -163,8 +163,11 @@ reboot-limit-baseline-reset: --tags vars,reset \ --extra-vars=@./extra_vars.yaml +# This runs tests on both baseline and dev groups - useful for A/B testing +reboot-limit-tests: reboot-limit-baseline reboot-limit-dev + # Below are the corresponding dev targets -reboot-limit-dev-baseline: +reboot-limit-dev: $(Q)ansible-playbook $(ANSIBLE_VERBOSE) \ --limit 'dev' \ playbooks/reboot-limit.yml \ @@ -202,8 +205,11 @@ reboot-limit-help-menu: @echo "reboot-limit-baseline - Run the reboot-limit test on baseline hosts and collect results" @echo "reboot-limit-baseline-reset - Reset the test boot counter for baseline" @echo "reboot-limit-dev - Run the reboot-limit test on dev hosts and collect results" + @echo "reboot-limit-tests - Run the reboot-limit test on both baseline and dev hosts (A/B testing)" @echo "reboot-limit-baseline-loop - Run the reboot-limit test in a loop until failure or steady state" @echo "reboot-limit-baseline-kotd - Run the reboot-limit kotd (kernel-of-the-day) loop" + @echo "reboot-limit-dev-loop - Run the reboot-limit test in a loop on dev hosts" + @echo "reboot-limit-dev-kotd - Run the reboot-limit kotd loop on dev hosts" @echo "reboot-limit-results - Analyze and summarize reboot-limit test results" @echo "reboot-limit-graph - Generate graphs from reboot-limit test results" @echo "" -- 2.47.2