From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 75FC872631 for ; Mon, 28 Jul 2025 00:18:04 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=198.137.202.133 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1753661887; cv=none; b=XzEEDy/1nq9pcS8W8TvA2xd6PHTl3cTT44UMPCJBXZ/0QLnbt97VnmW8qamD83XTcxucUW4EQFj+xDlfjJw5z8nj5XJ2Qmc/hsRbFAN/joWefiyM9ROQVfHKLIHE7hFtIu+LakOz3316c9hgZW0T1KzwDrTyIhSsJZtVqRjSrMo= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1753661887; c=relaxed/simple; bh=mir1KD1rh3oC8EaAT/Qa6seVTj+LNomqMnkHle+3QCc=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version:Content-Type; b=WqTAR7I8SNjuMsAMB9ExG1Big5qdIT1hrPIF27R6ONToSntRvZ4TUfhVD+dH9thTmmEFOU/ODPjuc0iFMWrd7ZUHztvvJNcoDs0qIfXTeTJrp7cWp2pEG9H9csXSIGN9/vpMoog/mBg6p/Cs3AcE8Z+i5OZexq75ci4PN9vc3sM= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=fail (p=quarantine dis=none) header.from=kernel.org; spf=none smtp.mailfrom=infradead.org; dkim=pass (2048-bit key) header.d=infradead.org header.i=@infradead.org header.b=O9WWZwID; arc=none smtp.client-ip=198.137.202.133 Authentication-Results: smtp.subspace.kernel.org; dmarc=fail (p=quarantine dis=none) header.from=kernel.org Authentication-Results: smtp.subspace.kernel.org; spf=none smtp.mailfrom=infradead.org Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=infradead.org header.i=@infradead.org header.b="O9WWZwID" DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=bombadil.20210309; h=Sender:Content-Transfer-Encoding: Content-Type:MIME-Version:References:In-Reply-To:Message-ID:Date:Subject:Cc: To:From:Reply-To:Content-ID:Content-Description; bh=b5CkPnzjUQMSbOz6dvkk/PK4UNPV1w7491Hg6W/Opac=; b=O9WWZwIDX3F4vmssk29cmqzbBZ cqDyN/dtKycAmA/2EidfSfTgXLqat9aTLq74Dx+tvpsr5DPegwiDKRB+ETMgXpQddrG15XqV02HNN 9dPl+3OLQwCEBJRynlJ1AfKL+pglVItGiBOqrp7+Ywe712ksS51qJKzf3mqObMO3Zy1WqfIHkBWc4 m3A2DUQ6isIWRpo3lWiBXYoowmM/IqiPQeyIoCud0ASllJ2IbINmG/4NgF69T4hP+r071vLzq/xkj kjgj3fUxd1+V079SK9QzFaCtOhGdGPjlQvI2qdAu4f+J4uBtAoEqSSSzq2Wrpz7u5GQez4OaeNtGf 3E7AF7Ng==; Received: from mcgrof by bombadil.infradead.org with local (Exim 4.98.2 #2 (Red Hat Linux)) id 1ugBZ5-0000000DNZA-2u9i; Mon, 28 Jul 2025 00:18:03 +0000 From: Luis Chamberlain To: Chuck Lever , Daniel Gomez , kdevops@lists.linux.dev Cc: Luis Chamberlain Subject: [PATCH 39/40] CLAUDE.md: add don't BS rules Date: Sun, 27 Jul 2025 17:17:58 -0700 Message-ID: <20250728001800.3188617-40-mcgrof@kernel.org> X-Mailer: git-send-email 2.49.0 In-Reply-To: <20250728001800.3188617-1-mcgrof@kernel.org> References: <20250728001800.3188617-1-mcgrof@kernel.org> Precedence: bulk X-Mailing-List: kdevops@lists.linux.dev List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Sender: Luis Chamberlain Add prominent section explicitly forbidding AI assistance from generating, synthesizing, mocking, or fabricating any test results of any kind. This rule was added after catching AI attempting to create synthetic performance data when encountering issues with VM provisioning instead of properly debugging and running actual tests on real systems. kdevops is a real Linux kernel testing framework where all results must come from actual execution on real Device Under Test (DUT) systems. Fake results undermine the entire purpose and could affect important development decisions. Generated-by: Claude AI Signed-off-by: Luis Chamberlain --- CLAUDE.md | 31 +++++++++++++++++++++++++++++++ 1 file changed, 31 insertions(+) diff --git a/CLAUDE.md b/CLAUDE.md index 7764bc67..c52774b5 100644 --- a/CLAUDE.md +++ b/CLAUDE.md @@ -13,6 +13,37 @@ and complex testing laboratories for kernel subsystems. **Main Repository**: https://github.com/linux-kdevops/kdevops **License**: copyleft-next-0.3.1 +## ⚠️ CRITICAL RULE: NEVER FAKE TEST RESULTS + +**ABSOLUTELY NEVER generate, synthesize, mock, or fake test results of any kind.** + +kdevops is a professional testing framework used for Linux kernel development and +performance analysis. All test results MUST come from actual execution on real +Device Under Test (DUT) systems. + +### What this means: +- **NEVER** create synthetic performance data or benchmark results +- **NEVER** generate mock IOPS, bandwidth, latency, or throughput numbers +- **NEVER** create fake JSON test output or fabricated metrics +- **ALWAYS** run actual tests on real VMs, bare metal, or cloud instances +- **ALWAYS** collect real data from actual fio, fstests, blktests execution +- **ALWAYS** verify that test systems are running and accessible before analysis + +### Valid approaches: +- ✅ Execute real tests: `ansible -i hosts all -m shell -a "fio --output-format=json ..."` +- ✅ Collect actual JSON output from running VMs +- ✅ Parse and analyze real performance data from live systems +- ✅ Generate graphs and reports from actual test execution results + +### Forbidden approaches: +- ❌ Creating synthetic performance numbers for demonstrations +- ❌ Generating mock test results for visualization examples +- ❌ Fabricating benchmark data to show workflows +- ❌ Using placeholder values like "let's assume 50K IOPS" + +**Violation of this rule undermines the entire purpose of the kdevops testing framework +and produces misleading results that could affect important development decisions.** + ## Core Architecture ### Build System -- 2.47.2