From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-8.8 required=3.0 tests=BAYES_00, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,MENTIONS_GIT_HOSTING, SPF_HELO_NONE,SPF_PASS,UNPARSEABLE_RELAY autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id DCC60C4743D for ; Sun, 6 Jun 2021 14:44:43 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id B05836142D for ; Sun, 6 Jun 2021 14:44:43 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230088AbhFFOqc (ORCPT ); Sun, 6 Jun 2021 10:46:32 -0400 Received: from out20-73.mail.aliyun.com ([115.124.20.73]:44199 "EHLO out20-73.mail.aliyun.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S230025AbhFFOqb (ORCPT ); Sun, 6 Jun 2021 10:46:31 -0400 X-Alimail-AntiSpam: AC=CONTINUE;BC=0.07436705|-1;CH=green;DM=|CONTINUE|false|;DS=CONTINUE|ham_system_inform|0.0263461-0.00517875-0.968475;FP=0|0|0|0|0|-1|-1|-1;HT=ay29a033018047211;MF=guan@eryu.me;NM=1;PH=DS;RN=4;RT=4;SR=0;TI=SMTPD_---.KOQDl36_1622990679; Received: from localhost(mailfrom:guan@eryu.me fp:SMTPD_---.KOQDl36_1622990679) by smtp.aliyun-inc.com(10.147.42.16); Sun, 06 Jun 2021 22:44:39 +0800 Date: Sun, 6 Jun 2021 22:44:39 +0800 From: Eryu Guan To: "Darrick J. Wong" Cc: guaneryu@gmail.com, linux-xfs@vger.kernel.org, fstests@vger.kernel.org Subject: Re: [PATCHSET RFC 00/10] fstests: move test group lists into test files Message-ID: References: <162199360248.3744214.17042613373014687643.stgit@locust> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <162199360248.3744214.17042613373014687643.stgit@locust> Precedence: bulk List-ID: X-Mailing-List: linux-xfs@vger.kernel.org On Tue, May 25, 2021 at 06:46:42PM -0700, Darrick J. Wong wrote: > Hi all, > > Test group files (e.g. tests/generic/group) are a pain to keep up. > Every week I rebase on Eryu's latest upstream, and every week I have to > slog through dozens of trivial merge conflicts because of the > groupfiles. Moving tests is annoying because we have to maintain all > this code to move the group associations from one /group file to > another. Thanks for doing this! It looks find overall from a quick look. Mind adding some words in README file as well? > > It doesn't need to be this way -- we could move each test's group > information into the test itself, and automatically generate the group > files as part of the make process. This series does exactly that. > > The first few patches add some convenient anchors for the new > per-testfile group tagging and a conversion script to migrate existing > test files. Next there's a huge patch that is the results of running > the conversion script, followed by cleanup of the golden outputs. After > that comes the build infrastructure to generate group files and other The group files are auto-generated correctly upon "make", but "make group" printed tons of errors like: [root@fedoravm xfstests]# make group [GROUP] /root/workspace/xfstests/group /root/workspace/xfstests/tests/btrfs/001: line 9: ./common/test_names: No such file or directory /root/workspace/xfstests/tests/btrfs/001: line 10: _set_seq_and_groups: command not found /root/workspace/xfstests/tests/btrfs/001: line 21: ./common/rc: No such file or directory /root/workspace/xfstests/tests/btrfs/001: line 22: ./common/filter: No such file or directory /root/workspace/xfstests/tests/btrfs/001: line 23: ./common/filter.btrfs: No such file or directory /root/workspace/xfstests/tests/btrfs/001: line 26: _supported_fs: command not found /root/workspace/xfstests/tests/btrfs/001: line 27: _require_scratch: command not found /root/workspace/xfstests/tests/btrfs/001: line 30: _scratch_mount: command not found /root/workspace/xfstests/tests/btrfs/001: line 38: _filter_scratch: command not found /root/workspace/xfstests/tests/btrfs/001: line 38: subvolume: command not found ls: cannot access '/snap': No such file or directory ls: cannot access '/snap': No such file or directory /root/workspace/xfstests/tests/btrfs/001: line 50: _filter_scratch: command not found /root/workspace/xfstests/tests/btrfs/001: line 50: subvolume: command not found ls: cannot access '/subvol': No such file or directory /root/workspace/xfstests/tests/btrfs/001: line 60: _btrfs_get_subvolid: command not found /root/workspace/xfstests/tests/btrfs/001: line 61: _filter_scratch: command not found /root/workspace/xfstests/tests/btrfs/001: line 61: subvolume: command not found /root/workspace/xfstests/tests/btrfs/001: line 62: _scratch_cycle_mount: command not found /root/workspace/xfstests/tests/btrfs/001: line 65: _scratch_unmount: command not found /root/workspace/xfstests/tests/btrfs/001: line 67: _scratch_mount: command not found /root/workspace/xfstests/tests/btrfs/001: line 71: _filter_scratch: command not found /root/workspace/xfstests/tests/btrfs/001: line 71: subvolume: command not found /root/workspace/xfstests/tests/btrfs/001: line 72: _scratch_cycle_mount: command not found /root/workspace/xfstests/tests/btrfs/001: line 78: subvolume: command not found /root/workspace/xfstests/tests/btrfs/001: line 81: _filter_btrfs_subvol_delete: command not found /root/workspace/xfstests/tests/btrfs/001: line 81: subvolume: command not found /root/workspace/xfstests/tests/btrfs/001: line 84: _scratch_cycle_mount: command not found I think it's better to let 'make group' work as well, it might be easier to re-generated just group files. > tweaks to the existing maintainer scripts to use the new infrastructure. > Finally, remove the group files themselves and the (now unnecessary) > code that maintained them. > > If you're going to start using this mess, you probably ought to just > pull from my git trees, which are linked below. > > This is an extraordinary way to destroy everything. Enjoy! > Comments and questions are, as always, welcome. > > --D > > fstests git tree: > https://git.kernel.org/cgit/linux/kernel/git/djwong/xfstests-dev.git/log/?h=autogenerate-groupfiles I noticed that your patches are based on your internal base, and this branch couldn't be pulled into current master branch. But this is fine for RFC patches I think :) Thanks, Eryu