From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id 008D8C001B2 for ; Tue, 20 Dec 2022 00:00:18 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232572AbiLTAAS (ORCPT ); Mon, 19 Dec 2022 19:00:18 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:49260 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S232570AbiLTAAP (ORCPT ); Mon, 19 Dec 2022 19:00:15 -0500 Received: from outgoing.mit.edu (outgoing-auth-1.mit.edu [18.9.28.11]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 573B212776 for ; Mon, 19 Dec 2022 16:00:14 -0800 (PST) Received: from cwcc.thunk.org (pool-173-48-120-46.bstnma.fios.verizon.net [173.48.120.46]) (authenticated bits=0) (User authenticated as tytso@ATHENA.MIT.EDU) by outgoing.mit.edu (8.14.7/8.12.4) with ESMTP id 2BK000qr006248 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 19 Dec 2022 19:00:01 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=mit.edu; s=outgoing; t=1671494402; bh=IYZ41/ONUgKeMJ3VQL7wbKBdlqxgeeEefwxpyFy9RcU=; h=Date:From:To:Cc:Subject:References:In-Reply-To; b=V+b4FK4uRmyxKnYzmCm8yjFdQ7WMqAPjhCy6+7pGSxmT98lDYEldcB5Aw6xhXoLEU gIcJ6f/cm/2W62qYMXpW9t/wcMBHy0PsDU0fVI+WMK00EuPmsPHyXD1xIgoB4Q+8st pVSJ8IDvA2BtfSEE5Ukqi+Jf7JbKn9XEgcgkSgxNFQp9iE4npQYTl/XjluZkoQG7Qs CS9SioxBODagsKMOuTEbvHk4DhHuv5ORXgiLnH0VlpZ3OeCOxV9oqtpGTXXWojEebl ayn2QXENr2/3C3MNBWF3lTGGprRiADsMMSAAQAr5aabvGu9iTP+h6tg5vY79NsieTs zxM5byHtyxcwQ== Received: by cwcc.thunk.org (Postfix, from userid 15806) id 75EB515C3511; Mon, 19 Dec 2022 19:00:00 -0500 (EST) Date: Mon, 19 Dec 2022 19:00:00 -0500 From: "Theodore Ts'o" To: "Darrick J. Wong" Cc: Qu Wenruo , Qu Wenruo , linux-btrfs@vger.kernel.org, fstests@vger.kernel.org Subject: Re: [PATCH] fstests: report: add arch and kernel version info into testsuite attributes Message-ID: References: <20221216070543.31638-1-wqu@suse.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: Precedence: bulk List-ID: X-Mailing-List: linux-btrfs@vger.kernel.org For what it's worth, here is how I add properties to the xunit file. I do it after the fact using a tiny python script: https://github.com/tytso/xfstests-bld/blob/master/test-appliance/files/usr/local/bin/update_properties_xunit This way I can dump a lot of interesting information about the test run into the XML file. (See attached for the beginning of a results.xml file generated by gce-xfstests.) I also have a handy script which allows me to run separate file system configs in separate VM's, and then combine the xunuit files together: https://github.com/tytso/xfstests-bld/blob/master/test-appliance/files/usr/local/bin/merge_xunit https://github.com/tytso/xfstests-bld/blob/master/test-appliance/files/usr/local/bin/combine_xunit I'm a **big** fan of this approach, since it allows me to take about 24 hours worth of test runs, shard them across 12 different VM's, so that it akes about 2.5 hours of wall clock time to do a full ext4 test run. After all, cloud VM time is cheap; software engineering time is expensive. :-) - Ted