From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id 2E99FC433EF for ; Wed, 9 Mar 2022 19:01:00 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232102AbiCITB5 (ORCPT ); Wed, 9 Mar 2022 14:01:57 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:44666 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S230261AbiCITB4 (ORCPT ); Wed, 9 Mar 2022 14:01:56 -0500 Received: from bombadil.infradead.org (bombadil.infradead.org [IPv6:2607:7c80:54:e::133]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 0F86C9E57D for ; Wed, 9 Mar 2022 11:00:57 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=bombadil.20210309; h=Sender:In-Reply-To:Content-Type: MIME-Version:References:Message-ID:Subject:Cc:To:From:Date:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description; bh=xhr2CmmYZuf5RbJ/cVs+BdGvtRZIFC9nUre+0XVD3Oo=; b=Q5YVn6JZjJ5pUlfyDeMlQssP89 Z7PLSx34b/w/9o3rU/721oHkXK/xSDsI8MdtjABmL2q5hp/eed3SdNJ+n8ABA2/UxB6EhM9i4m2U5 hLYdq+/dTbrGgygOGDXZUa82HQ5FDUPgLOnP7Ll7UV7a8CKEryoKZYRSB0NRPAaladoqrIVVPttT1 egGUVMayVEvzJUErBsMEfCgxBtwUU0ZAN1vL2BKhVY3k5zuJQXeOjMRxYxLTOMS29QBN/E0g/mV+y s3cdP1mi6Knn9GP1E9QK9JOzM6wr3DSMkgJm9IV20PpgvB3YIVRAuGUrDnrsrp7nEj4VXoJS1nAXv wY5x4J8A==; Received: from mcgrof by bombadil.infradead.org with local (Exim 4.94.2 #2 (Red Hat Linux)) id 1nS1YH-00AAp0-Qp; Wed, 09 Mar 2022 19:00:49 +0000 Date: Wed, 9 Mar 2022 11:00:49 -0800 From: Luis Chamberlain To: Josef Bacik Cc: Theodore Ts'o , Greg KH , Amir Goldstein , Sasha Levin , lsf-pc , linux-fsdevel , Jan Kara , "Darrick J. Wong" , Matthew Wilcox Subject: Re: [LSF/MM TOPIC] FS, MM, and stable trees Message-ID: References: <20190212170012.GF69686@sasha-vm> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: Sender: Luis Chamberlain Precedence: bulk List-ID: X-Mailing-List: linux-fsdevel@vger.kernel.org On Wed, Mar 09, 2022 at 01:49:18PM -0500, Josef Bacik wrote: > On Wed, Mar 09, 2022 at 10:41:53AM -0800, Luis Chamberlain wrote: > > On Tue, Mar 08, 2022 at 11:40:18AM -0500, Theodore Ts'o wrote: > > > One of my team members has been working with Darrick to set up a set > > > of xfs configs[1] recommended by Darrick, and she's stood up an > > > automated test spinner using gce-xfstests which can watch a git branch > > > and automatically kick off a set of tests whenever it is updated. > > > > I think its important to note, as we would all know, that contrary to > > most other subsystems, in so far as blktests and fstests is concerned, > > simply passing a test once does not mean there is no issue given that > > some test can fail with a failure rate of 1/1,000 for instance. > > > > FWIW we (the btrfs team) have been running nightly runs of fstests against our > devel branch for over a year and tracking the results. That's wonderful, what is your steady state goal? And do you have your configurations used public and also your baseline somehwere? I think this later aspect could be very useful to everyone. Yes, everyone's test setup can be different, but this is why I went with a loopback/truncated file setup, it does find more issues and so far these have all been real. It kind of begs the question if we should adopt something like kconfig on fstests to help enable a few test configs we can agree on. Thoughts? I've been experimenting a lot with this on kdevops. So the Kconfig logic could easily just move to fstests. Luis