From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 56F8C168BD for ; Fri, 3 Oct 2025 20:20:01 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1759522801; cv=none; b=tRrelTSbYSW/Glp1mSm9S/7ve+Uvsga/ALjlaTq/6yGv7kwxZbEPuMWfjU5HB2cy5vtyGNm3c4eQHCHvXrfJmLmdwMeM184FTk9mandLrSY73RGPdXixs9VZwiZgeYEJPp+u1rvr9cjOTTah5vyGJd7uxA1ce+sh+qTPvkqxSAo= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1759522801; c=relaxed/simple; bh=DpwgceQxHi/rU6gJbTAvq3GLKhtgMz/pzaP6pczXWy8=; h=From:To:Cc:Subject:Date:Message-ID:MIME-Version; b=XGAVylM5BuvIahVuL+e5kk2EimXOyM2C4TOWvYyZDRLs1UvCKoOKDUvYlLwy/yGMuN/1sR2RpxYPWl7u7tduJl+Jw8AxSFbe4xb/7mOqR/Unvt1Hlha8OL7WiwG7rt6AvGK2F6ndQAw1wVfbjaN+B6ycdiZsNwdw0y6XxdnCqFY= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=iK7BRo+i; arc=none smtp.client-ip=10.30.226.201 Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="iK7BRo+i" Received: by smtp.kernel.org (Postfix) with ESMTPSA id 9B604C4CEF5; Fri, 3 Oct 2025 20:20:00 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1759522801; bh=DpwgceQxHi/rU6gJbTAvq3GLKhtgMz/pzaP6pczXWy8=; h=From:To:Cc:Subject:Date:From; b=iK7BRo+iCh0Xi7jwa5rcnmkwG57GpF8xTrGom1BGt9/qT9UjWaekVbdkpCmbzq1gz hfTinZBqJRkjjhmYmY7kKhPSy8yw1LfTwE4e0llasXKoJXCXJxtdRL2yY5ENaVZul7 UrX13H2FyywHlsw7WlRRbA6Wz8JyQeBwhJTsW+Qiuq9cOn9jqbLTmo8NgDojjAIEq8 PqNkncth0rhUyyIB0gAPV+dJaQfwUyrFWtRHC/QnpucYzJ2KkeHMIqYNzuJYift5M6 RhGmIrlgsUf3DzKqBRu5ysbx6AcHiPoduYoCdKZDuaLVUvQnWme/qOGtM+Ilx8SrCo AiPTE8cgipA9g== From: Chuck Lever To: Cc: Luis Chamberlain , Chuck Lever Subject: [PATCH v2 0/8] nfs: few fixes and enhancements Date: Fri, 3 Oct 2025 16:19:48 -0400 Message-ID: <20251003201958.24452-1-cel@kernel.org> X-Mailer: git-send-email 2.51.0 Precedence: bulk X-Mailing-List: kdevops@lists.linux.dev List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit From: Chuck Lever Original cover: In prepration for talking about NFS tests at the MSST conference today I figured I'd give a run to all NFS tests. I ran out of time but at least this plumbed quite a bit of the stuff to get some results out. The iSCSI stuff is likely not correct, and can be dropped. So, feel free to take in only what makes sense and drop whatever silly thing you see. Updates: I'm reposting because, strangely, I never received these patches in my inbox. I pulled this series from lore using "b4 am" so we can keep reviewing. For "devconfig: exclude nfsd from journal upload client configuration", I wonder if instead of "nfsd", the new checks should look for the "service" group, which usually includes nfsd, the SMB server, the iscsi target, and the Kerberos KDC. Any opinion on that? I've dropped the iSCSI-specific changes. Except for a couple of nits, the remaining patches look great to me. The original idea for pNFS block testing was that a separate iSCSI target was to be set up: either it is outside the kdevops test network, or it is enabled by setting CONFIG_KDEVOPS_ENABLE_ISCSI. Then change the kdevops nfsd server to use that iSCSI target by changing the "Persistent storage for exported file systems" setting to "iSCSI". It's easier overall if the iSCSI target host is separate from the kdevops nfsd host. iSCSI loopback is not as performant and is less reliable, I've found -- and maybe not supported on every Linux distribution we want to run kdevops on, IIRC. The gitr, nfstest, and pynfs workflows should all be able to use pNFS block, and indeed the latter two have additional tests especially for pNFS block layout. So fstests-specific pNFS block patches don't seem right to me. Luis, if you believe I missed something and need to revisit one or more of the patches I've left out, please don't hesitate to bring it up. Luis Chamberlain (8): defconfigs: add NFS testing configurations devconfig: exclude nfsd from journal upload client configuration iscsi: add missing initiator packages for Debian nfsd_add_export: fix become method for filesystem formatting workflows: fstests: fix incorrect pNFS export configuration nfstest: add results visualization support fstests: add soak duration to nfs template pynfs: add visualization support for test results defconfigs/nfs-fstests | 38 + defconfigs/nfs-gitr | 38 + defconfigs/nfs-ltp | 31 + defconfigs/nfstests | 30 + defconfigs/pynfs-pnfs-block | 34 + playbooks/roles/devconfig/tasks/main.yml | 3 + playbooks/roles/fstests/tasks/main.yml | 5 +- .../roles/fstests/templates/nfs/nfs.config | 4 + playbooks/roles/iscsi/vars/Debian.yml | 3 + .../nfsd_add_export/tasks/storage/local.yml | 3 +- scripts/workflows/pynfs/visualize_results.py | 1014 +++++++++++++++++ workflows/Makefile | 4 + workflows/nfstest/Makefile | 1 + .../nfstest/scripts/generate_nfstest_html.py | 783 +++++++++++++ .../nfstest/scripts/parse_nfstest_results.py | 277 +++++ .../scripts/visualize_nfstest_results.sh | 61 + workflows/pynfs/Makefile | 17 +- 17 files changed, 2341 insertions(+), 5 deletions(-) create mode 100644 defconfigs/nfs-fstests create mode 100644 defconfigs/nfs-gitr create mode 100644 defconfigs/nfs-ltp create mode 100644 defconfigs/nfstests create mode 100644 defconfigs/pynfs-pnfs-block create mode 100755 scripts/workflows/pynfs/visualize_results.py create mode 100755 workflows/nfstest/scripts/generate_nfstest_html.py create mode 100755 workflows/nfstest/scripts/parse_nfstest_results.py create mode 100755 workflows/nfstest/scripts/visualize_nfstest_results.sh -- 2.51.0