From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id D4F23275AF9 for ; Wed, 27 Aug 2025 19:24:37 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1756322678; cv=none; b=gebGFTUFfd1alkx2UpJMNIBMtaRjc+DPqFy0zhP5cwG3wUsBdgd570jD0s4DE/x+rqYHZ15VmdKu+iLGSloJjdGf5w/hjNjO8iEb5acodcfCcGHrtdgOt17lyfJlgrobW/VA00tH/Q+syXkTzU8viUYbZqpefC5QFjMHVeM1Eco= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1756322678; c=relaxed/simple; bh=At2dEO18djUqSB9vnIH0VqbzKvbSoJRuIIxX6mujkZs=; h=Date:From:To:Cc:Subject:Message-ID:References:MIME-Version: Content-Type:Content-Disposition:In-Reply-To; b=Y0dud50+4nu+vX1soxeIXi9um2n7zLTbb7VlvJRqR9d82R7oTmfmh6Ej8BzoMJiEShzw1JRRj1Afrgx6cHYCOwiFSIyqvMlTdKbRLP6LYKjtBu1TjBbiYrTtxZW+9BKUA+pYMi2zXjBPSCzmwE+B6C6pXW09+WBYruRh8OthVCE= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=DlnzAjKs; arc=none smtp.client-ip=10.30.226.201 Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="DlnzAjKs" Received: by smtp.kernel.org (Postfix) with ESMTPSA id 2F3FFC4CEF4; Wed, 27 Aug 2025 19:24:37 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1756322677; bh=At2dEO18djUqSB9vnIH0VqbzKvbSoJRuIIxX6mujkZs=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=DlnzAjKst0hJFQl34kaQ6+uT1gBrHn8hLu6t6Lj6/QrNGk7MfVt7rW4gyY88KGF0/ 7tlgg1MZ8QuM1IbohkpLfQKBg0OK2//C6iK3u7sq4Buj4i0rTEw/KZpDVQGHejwK1f P9upjRD9QWysTkVFNfX/ecix6YE7TpCLtI0SVs2bEQYe922yCho4sOeu26BGFvngyL 8q+cxDW0D+TfraJS4QmfDBqjutPJpszHjmX/lGniQuLkHrbzCCSbOEByTsBZwtakHv +P47v61xGLTA3BFq136N0BE/1mN0dZXxkI/Tz+s6Av8EKACcVliQJ4j2Q8OUs6ixQd pwy9ZfdpsODew== Date: Wed, 27 Aug 2025 12:24:35 -0700 From: Luis Chamberlain To: Chuck Lever Cc: Daniel Gomez , hui81.qi@samsung.com, kundan.kumar@samsung.com, kdevops@lists.linux.dev Subject: Re: [PATCH 2/2] ai: add multi-filesystem testing support for Milvus benchmarks Message-ID: References: <20250827093202.3539990-1-mcgrof@kernel.org> <20250827093202.3539990-3-mcgrof@kernel.org> <3b88e74a-76ce-4ab3-bc7d-43d7e7b3aaf3@kernel.org> Precedence: bulk X-Mailing-List: kdevops@lists.linux.dev List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <3b88e74a-76ce-4ab3-bc7d-43d7e7b3aaf3@kernel.org> On Wed, Aug 27, 2025 at 10:47:51AM -0400, Chuck Lever wrote: > On 8/27/25 5:32 AM, Luis Chamberlain wrote: > > Extend the AI workflow to support testing Milvus across multiple > > filesystem configurations simultaneously. This enables comprehensive > > performance comparisons between different filesystems and their > > configuration options. > > > > Key features: > > - Dynamic node generation based on enabled filesystem configurations > > - Support for XFS, EXT4, and BTRFS with various mount options > > - Per-filesystem result collection and analysis > > - A/B testing across all filesystem configurations > > - Automated comparison graphs between filesystems > > > > Filesystem configurations: > > - XFS: default, nocrc, bigtime with various block sizes (512, 1k, 2k, 4k) > > - EXT4: default, nojournal, bigalloc configurations > > - BTRFS: default, zlib, lzo, zstd compression options > > > > Defconfigs: > > - ai-milvus-multifs: Test 7 filesystem configs with A/B testing > > - ai-milvus-multifs-distro: Test with distribution kernels > > - ai-milvus-multifs-extended: Extended configs (14 filesystems total) > > > > Node generation: > > The system dynamically generates nodes based on enabled filesystem > > configurations. With A/B testing enabled, this creates baseline and > > dev nodes for each filesystem (e.g., debian13-ai-xfs-4k and > > debian13-ai-xfs-4k-dev). > > > > Usage: > > make defconfig-ai-milvus-multifs > > make bringup # Creates nodes for each filesystem > > make ai # Setup infrastructure on all nodes > > make ai-tests # Run benchmarks on all filesystems > > make ai-results # Collect and compare results > > > > This enables systematic evaluation of how different filesystems and > > their configurations affect vector database performance. > > > > Generated-by: Claude AI > > Signed-off-by: Luis Chamberlain > > Hey Luis - > > I'm looking at adding "AI optimized" and "GPU optimized" machine size > choices in the cloud provider Kconfigs. I assume this set can take > advantage of those. Any suggestions, or let me know if I'm way off base. That would be next to add variability support, so patches welcomed on top! Some docs: https://milvus.io/docs/v2.3.x/install_standalone-helm-gpu.md https://milvus.io/docs/gpu_index.md https://milvus.io/docs/gpu-cagra.md Luis