From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id D93F9199931 for ; Mon, 28 Jul 2025 01:14:37 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=198.137.202.133 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1753665280; cv=none; b=gykilnOvh2CzjlUTxi0TDZ0Hjf0kr8WU7esvzNCGiX4jUeQYQPeI6v2MjzIhFRaaCBJtU8aZLq+ftI5mclyVx8HbCziDqF86NrPlWHRX3vl+9ji9aM8Q81QFr/jzStcrg8IGdtKHKIQ18JCmPGY48zr/wo781yySV6xfndS+jug= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1753665280; c=relaxed/simple; bh=mir1KD1rh3oC8EaAT/Qa6seVTj+LNomqMnkHle+3QCc=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version:Content-Type; b=c9PEe+LmEgufUjWfGJ1tFSx6vAgM1kAQlfFYbFF92nnjWZvdT/40igYuDDQ/r+SYqkqn48LBwN1CMxmdU/WGOeYaDEA+kmDuvFR1fjkLcS4NdSsO9kN2WC19qGP2avYjJAVtm1OiwOAPWKYScH+d7LGR8MaNj4V3ZrTLbw527VU= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=fail (p=quarantine dis=none) header.from=kernel.org; spf=none smtp.mailfrom=infradead.org; dkim=pass (2048-bit key) header.d=infradead.org header.i=@infradead.org header.b=ckXNVj6K; arc=none smtp.client-ip=198.137.202.133 Authentication-Results: smtp.subspace.kernel.org; dmarc=fail (p=quarantine dis=none) header.from=kernel.org Authentication-Results: smtp.subspace.kernel.org; spf=none smtp.mailfrom=infradead.org Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=infradead.org header.i=@infradead.org header.b="ckXNVj6K" DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=bombadil.20210309; h=Sender:Content-Transfer-Encoding: Content-Type:MIME-Version:References:In-Reply-To:Message-ID:Date:Subject:Cc: To:From:Reply-To:Content-ID:Content-Description; bh=b5CkPnzjUQMSbOz6dvkk/PK4UNPV1w7491Hg6W/Opac=; b=ckXNVj6KcmhHmleFsYTM6g3cQU dLB6K5H24BkJlFj7nPtDPCm54J1+qI9lT/uTXytp+ln0YWPW/cGx30aqxXNmFppO5CXjYPy9xcjQ5 OjEJ5R6RKnAk0qREQwoulfOa/4bW28QIgwi7qJnxmyf+9fUJf1s7VUJIN8AaCtxFoMs2D7HOWbbU8 5cfjT6+65l9pEOOFyO1HWATmQoVYNqCEpbODpbAEIYaBe01IwvsvuhZr2CW1Wr/9jx39gFvHisOc6 ivspKTgUhbL2eEfgKcjKzoR2FVkHykFAoHVzSVMtrvJq1ByBDyK/tRUZLSydAMfneBObeba0jaemW Gy2eG2LA==; Received: from mcgrof by bombadil.infradead.org with local (Exim 4.98.2 #2 (Red Hat Linux)) id 1ugCRo-0000000DPlr-3NxR; Mon, 28 Jul 2025 01:14:36 +0000 From: Luis Chamberlain To: Chuck Lever , Daniel Gomez , kdevops@lists.linux.dev Cc: Luis Chamberlain Subject: [PATCH v2 32/33] CLAUDE.md: add don't BS rules Date: Sun, 27 Jul 2025 18:14:32 -0700 Message-ID: <20250728011434.3197091-33-mcgrof@kernel.org> X-Mailer: git-send-email 2.49.0 In-Reply-To: <20250728011434.3197091-1-mcgrof@kernel.org> References: <20250728011434.3197091-1-mcgrof@kernel.org> Precedence: bulk X-Mailing-List: kdevops@lists.linux.dev List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Sender: Luis Chamberlain Add prominent section explicitly forbidding AI assistance from generating, synthesizing, mocking, or fabricating any test results of any kind. This rule was added after catching AI attempting to create synthetic performance data when encountering issues with VM provisioning instead of properly debugging and running actual tests on real systems. kdevops is a real Linux kernel testing framework where all results must come from actual execution on real Device Under Test (DUT) systems. Fake results undermine the entire purpose and could affect important development decisions. Generated-by: Claude AI Signed-off-by: Luis Chamberlain --- CLAUDE.md | 31 +++++++++++++++++++++++++++++++ 1 file changed, 31 insertions(+) diff --git a/CLAUDE.md b/CLAUDE.md index 7764bc67..c52774b5 100644 --- a/CLAUDE.md +++ b/CLAUDE.md @@ -13,6 +13,37 @@ and complex testing laboratories for kernel subsystems. **Main Repository**: https://github.com/linux-kdevops/kdevops **License**: copyleft-next-0.3.1 +## ⚠️ CRITICAL RULE: NEVER FAKE TEST RESULTS + +**ABSOLUTELY NEVER generate, synthesize, mock, or fake test results of any kind.** + +kdevops is a professional testing framework used for Linux kernel development and +performance analysis. All test results MUST come from actual execution on real +Device Under Test (DUT) systems. + +### What this means: +- **NEVER** create synthetic performance data or benchmark results +- **NEVER** generate mock IOPS, bandwidth, latency, or throughput numbers +- **NEVER** create fake JSON test output or fabricated metrics +- **ALWAYS** run actual tests on real VMs, bare metal, or cloud instances +- **ALWAYS** collect real data from actual fio, fstests, blktests execution +- **ALWAYS** verify that test systems are running and accessible before analysis + +### Valid approaches: +- ✅ Execute real tests: `ansible -i hosts all -m shell -a "fio --output-format=json ..."` +- ✅ Collect actual JSON output from running VMs +- ✅ Parse and analyze real performance data from live systems +- ✅ Generate graphs and reports from actual test execution results + +### Forbidden approaches: +- ❌ Creating synthetic performance numbers for demonstrations +- ❌ Generating mock test results for visualization examples +- ❌ Fabricating benchmark data to show workflows +- ❌ Using placeholder values like "let's assume 50K IOPS" + +**Violation of this rule undermines the entire purpose of the kdevops testing framework +and produces misleading results that could affect important development decisions.** + ## Core Architecture ### Build System -- 2.47.2