From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 56567C25B10 for ; Mon, 13 May 2024 13:18:12 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id C8C1D6B0298; Mon, 13 May 2024 09:18:11 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id C3BF36B029A; Mon, 13 May 2024 09:18:11 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id B02506B029B; Mon, 13 May 2024 09:18:11 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0014.hostedemail.com [216.40.44.14]) by kanga.kvack.org (Postfix) with ESMTP id 91E3F6B0298 for ; Mon, 13 May 2024 09:18:11 -0400 (EDT) Received: from smtpin01.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay04.hostedemail.com (Postfix) with ESMTP id 4332A1A0DED for ; Mon, 13 May 2024 13:18:11 +0000 (UTC) X-FDA: 82113425982.01.ED4883E Received: from outgoing.mit.edu (outgoing-auth-1.mit.edu [18.9.28.11]) by imf06.hostedemail.com (Postfix) with ESMTP id 5AF9C180020 for ; Mon, 13 May 2024 13:18:09 +0000 (UTC) Authentication-Results: imf06.hostedemail.com; dkim=pass header.d=mit.edu header.s=outgoing header.b=IifgAf4f; dmarc=pass (policy=none) header.from=mit.edu; spf=pass (imf06.hostedemail.com: domain of tytso@mit.edu designates 18.9.28.11 as permitted sender) smtp.mailfrom=tytso@mit.edu ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1715606289; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=fusCymI4GhBy81z2Xc6g11DY96LNc+EefUe6nehYSRU=; b=w9K2mjXuT4MhpCtpyAKFWDht6a4Pa002g8SvXtnci0eAOPQHOKQnUnMgKU07YvF6j3MRz8 DKbm7zlucTWMC8gIxaQHWanEhn18l6ihhBGqcjr/UsBQd+8ClHlc/7vfPsexqCgctOMORw +7CHs5yTD9Dx9P1tRR6qA939tplHF4k= ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1715606289; a=rsa-sha256; cv=none; b=QyZeuSRSu+g+0/eKTyRBZtPKM11g34uFaE8m7/YxTMlmx2jtk0nojEeIxMGU5+GlR75o2J t51Gc9GJw2bMbbDmMbbaKfrw4c2JQijdsfbI81PSkrC8peqdzjmnmF6+HrKnrHBsX6DbmK eFwxS/9SH/c9rha8+zsDQPvPMLalQ2I= ARC-Authentication-Results: i=1; imf06.hostedemail.com; dkim=pass header.d=mit.edu header.s=outgoing header.b=IifgAf4f; dmarc=pass (policy=none) header.from=mit.edu; spf=pass (imf06.hostedemail.com: domain of tytso@mit.edu designates 18.9.28.11 as permitted sender) smtp.mailfrom=tytso@mit.edu Received: from macsyma.thunk.org ([50.204.89.32]) (authenticated bits=0) (User authenticated as tytso@ATHENA.MIT.EDU) by outgoing.mit.edu (8.14.7/8.12.4) with ESMTP id 44DDHsBl000516 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 13 May 2024 09:17:55 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=mit.edu; s=outgoing; t=1715606277; bh=fusCymI4GhBy81z2Xc6g11DY96LNc+EefUe6nehYSRU=; h=Date:From:Subject:Message-ID:MIME-Version:Content-Type; b=IifgAf4fU1FayX/7K8/8GofW+2BjfJgpnpnyO74mQZwA5fUCxtF27onioRAvtS3JS 2xADWgLG1Im7FPtrcOaXmQHVykmy0yzQ7pvAeu592lUAeDz9CAjKxCb6QkM0y5Mvbf Z3uBx7iwWZQV4EJzID9rwvhc3pZQaefWZcJCMExD+eBN7QgLJLxiA3JHDf+Orjgh3K XcNWCslc8L55q207Rg8qypvcE5wXldh9JKkzMqq+CSp+C2aNI74xl0M6+Nd/5QVWbz MrO7VDWEvv5+Hrqknb6OVuYtgpgWFBSmlS5NP0P2q2n3A18Wv7lMFmwh8aoVGH/rGt Y6A07YGUjiDYw== Received: by macsyma.thunk.org (Postfix, from userid 15806) id AA89F340269; Mon, 13 May 2024 09:17:53 -0400 (EDT) Date: Mon, 13 May 2024 07:17:53 -0600 From: "Theodore Ts'o" To: Chuck Lever III Cc: Steve French , Amir Goldstein , Luis Chamberlain , "lsf-pc@lists.linux-foundation.org" , "kdevops@lists.linux.dev" , Linux FS Devel , linux-mm , "linux-cxl@vger.kernel.org" , Jan Kara Subject: Re: kdevops BoF at LSFMM Message-ID: <20240513131753.GA520598@mit.edu> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Stat-Signature: fifq6jzyfr3wkme7tfz3jxg6fs4tzmtm X-Rspamd-Queue-Id: 5AF9C180020 X-Rspam-User: X-Rspamd-Server: rspam01 X-HE-Tag: 1715606289-346059 X-HE-Meta: U2FsdGVkX19zFrEH4tJ0kYtaypFFHvO3kr/7AX50rrKqKK+RdyHd5wN8jPMitvM94JOtHNrEToAqe3pvObNpR+8V+QLkUlkcMxRUsgIxK9X21nyHqrqEIk5N150OF914GpjNyFw1CnDogZT15mjL+SNDEeyxBn7piDv91ZoRcSCLN98nnSGNFofdlsqOtB/WaKadNI9BcYtj7aBwyC8Vm3juX4TJ7YmFNRy5SqDMQ5tuiIvyexlXuFypgnZ1Hzb+lXc5XEdTlMm5qLqNYS/oedi9hlH2Cv5+GAzaQtNkATPKrx1mmXqmH1OOyKQq2YgWS/w4xNh+xRb2St43dxKlDl8lFjDLNT9OraRowwB9QtewggLf8PUFTENz8XhjuUNjKe+xtk8ybu9/61tEPBLPBO2UscsQF+l/7Vt65S13ov1SKV8QV1kUeOpVCDPPdGiW0we0CHQWUCai/FdXDI0Y8QB/IU3iT4XY+VpweEAKXZxDA5upLeLf9Mb6+ZUZ2qc9/8XZOHO6xXHB0gck2Ph/JDzXVYF+OV5sjSOtp+1brErRsNu25ys8bn3gV7vMbVO6OhLVHeArMygoKAPj0EiCcPQNy5WFY/dzn/sFociIAzBT+FwGOY1m0iX01yvWhfk5/kIrWOO7cj6L7uyhPpekInU2Tn+qMr32gsCrStJ2IWZ1lbg9YaPE8I2QlFGhWRwRPoi4zNgNNSzPX64WVXI3EV4vLLj1IvFKvCTwdQ+487JieiDr+PFDgpOc345/enk6+I0MNq1ucZ/nHyucPmqE5Lr8TXqQCnzw3RL511USGl2H8ma+X42yRFBVffm3GguMKi0vp0NreA5eqPKS/WhNZNP95f1MmcPhn3dZjAYN2qFIJovwgryuyHdejPUL30yqFY+nlvolF2aQ4IXFPjxeqlA5hwoGK96mjVROh+oum6lJ4WlqAJ+bIa3MnDMaGMAB0wm+yyc1MLOWEm3qw4S YrttJdXe vxgw1Vwi2J+UhQLZvU+uC7q2Z9rGdVj1Xqx3flruyi1j1bFP1y/U1kyXNdk1cyUrb8lP2zgGoN0QAkRPlYNH29ErQXM5VaNJuYyX5PvTe94VcbqFIKPAdclFopMI5BlYr9/vHLHbi7c/UCkumh0DAA6GHH8RIrx8p+T9sbCUR4AmxpRelI6moc/ujW37ya0HGlsZZFeqv05fqsxU47Qqbme9cPmaafIwV8UYaGBdIV60ayUJt6L5JPHEasv+PZEL7xJGQ X-Bogosity: Ham, tests=bogofilter, spamicity=0.000001, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On Wed, May 08, 2024 at 05:54:50PM +0000, Chuck Lever III wrote: > > In my experience, these require the addition of a CI > apparatus like BuildBot or Jenkins -- they are not > directly part of kdevops' mission. Scott Mayhew and > I have been playing with BuildBot, and there are some > areas where integration between kdevops and BuildBot > could be improved (and could be discussed next week). This is support which gce-xfstests has. You can either have it watch a particular branch on a git repo, and whenever it changes it will kick off a tests: gce-xfstests ltm [-c ] [-g ]|[] ... [--repo ] \ --watch As an example: gce-xfstests ltm -c ext4/all -g auto --repo ext4 --watch dev Or you can specify a specific commit that you want to run tests on: gce-xfstests ltm -c ext4/all -g auto --repo ext4 --commit dev In the two examples above ext4 is an abbrevation so you don't have to type the full URL; you can define additional abbrevs in your config file. > > 3) make it easier to auto-bisect what commit regressed when a failing test > > is spotted > > Jeff Layton has mentioned this as well. I don't think > it would be impossible to get kdevops to orchestrate > a bisect, as long as it has an automatic way to decide > when to use "git bisect {good|bad}" gce-xfstests has this as well: gce-xfstests ltm [-c ] [-g ]|[] ... [--repo ] \ --bisect-bad --bisect-good \ [--bisect-good ...] So yeah, not that hard --- we had intern learn how to program in Go and to implement the base lightweight test manager, and a team of undergraduates who implemented the build server, test spinner, and auto-bisector as part of their software engineering classes's project. :-) The code is up on github at github.com/tytso/xfstests-bld if anyone wants to repurpose it. - Ted