From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id CD8ABF327AA for ; Tue, 21 Apr 2026 06:37:22 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender:List-Subscribe:List-Help :List-Post:List-Archive:List-Unsubscribe:List-Id:MIME-Version:In-Reply-To: Content-Type:References:Message-ID:Subject:Cc:To:From:Date:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=Jwy0ErYhQwDtkS6lU3uNj5qgfy89MD4OsWQOU7ZwBxM=; b=m5T8nU1k7Fml8fHgxaLMzccT13 6PeFJTyYlp7OQtRgsreK1YVBurcsR0YnS4AD9azrcFMrl6MtTt1DLYpAL4PNeq5IWICy911v/4UgU FqOjNPb9PVz6yJSMDEwmazkLsNzrO5XjVOBNlvdDznCkfCZNj5itsgsbRHKDdeKqPdTFeRVXTXFGU 24fVw/geikkUYaypvcPu/WdB7yWAvMSCKgwatcM5vc0KhfRPC+xdxTjuIbhq7knfLkxjXieWE8qfM lWojavZDtGdnjik4tPjtp/MInb53JUZDWvaM44b+VFvyvCLjbhs1NJhw4JhfG2JzibZ4qDeV47nRe gMFgx2Bg==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.98.2 #2 (Red Hat Linux)) id 1wF4jX-000000086oO-2RDH; Tue, 21 Apr 2026 06:37:19 +0000 Received: from esa4.hgst.iphmx.com ([216.71.154.42]) by bombadil.infradead.org with esmtps (Exim 4.98.2 #2 (Red Hat Linux)) id 1wF4jV-000000086o3-0HxA for linux-nvme@lists.infradead.org; Tue, 21 Apr 2026 06:37:18 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=wdc.com; i=@wdc.com; q=dns/txt; s=dkim.wdc.com; t=1776753437; x=1808289437; h=date:from:to:cc:subject:message-id:references: in-reply-to:mime-version; bh=dqvJpIZ5ERDmdeOmzJ6FWoRW/zBcru3pZ/TZgJgIv2Y=; b=mi/o8vFVi0WJByCTsmrAa/Fpwy/9rYQ+HdgRZQONC9bGsD8Jyh6Q4ya/ wFolJ8hxGOg2T+W2hrHOtFOj2ShwmFu2qjNPg70iUL3n3f7MshUVbeJLl rgRrl0+Ttw4QbWjl3LgVv5oliELK5gZ8wlYfyx8JKTpmJ8IYpBPVpd1+r HuBIx09hXlQiU44c2ffl9E0JpWiuu/670ziqPhHkxBwt4xFTpGLwfaC0d Tv7mhBTfMC8BZszshW6uumzQOfcmZwPdpAHAhknfhpds8fUWGwZFt06t7 V67nvDGTZi6Gz7Bot/JJurBEwSSqap6Hnjb8Yx1fKnfZfBxCHuG3rgywf w==; X-CSE-ConnectionGUID: wYk2TSPrRNeTHlv8UL/ooQ== X-CSE-MsgGUID: FiJTI4stQLqw4KEBg6eMGw== X-IronPort-AV: E=Sophos;i="6.23,191,1770566400"; d="scan'208";a="141149431" Received: from mail-southcentralusazon11011023.outbound.protection.outlook.com (HELO SN4PR0501CU005.outbound.protection.outlook.com) ([40.93.194.23]) by ob1.hgst.iphmx.com with ESMTP/TLS/ECDHE-RSA-AES128-GCM-SHA256; 21 Apr 2026 14:37:13 +0800 ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=SB6EqA2DfNy8pzp0PduTf06L4NZaXgdgbz3Fbs1bsQQeqrkvltG5m4Qr/IauOpPKfY8QXgqTYQRmket1Yt9c0daRM5Vcaf7uCISnhIi3hsCXOSsuv1ssStQJzFVSqU4iJDxMArdUVIX78lj4d9dgPomKuu1KFcseFXPDaVcALxyUdDIXnfq100eEl8+gydJ3jppgTl3r90JgRvX7VVPHtAhy8uwcvlgXVw7NhUCbewA0H4v4X8H0B3wMmzfx3iJmZKa7gyYVdYmTSBw6Wkmczdsmo4vCWmkZ5P2G3Ktm+btwHWx/6SkYE4K91ygFw4hoGiDgGd4YCxsGwDzPKMYNzQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=Jwy0ErYhQwDtkS6lU3uNj5qgfy89MD4OsWQOU7ZwBxM=; b=JolbwG26mz9hkRalvbv0JDTlBZaCHpkzLLqRELbSnaFSBucofRitYJSKKLuKUa+Iviel9G6Cdjel0TmIl9lKZzAxB3XXNJa603qx1S8GTBaUGa0Nn0RXEmAUvrjRUZdpegZyhyMqNbCcoXBIFeFw61UloMhXV2oNqtW/ht2yUmWItoN0O9WV4gjHxkWvuTskpd7lMUbFAFI9NBX71BW1WFJuZNzO7yFnfCfhpDQ98N4QIPV+kqOKhqAim/jr33KW62taU+09lFIl/YFoaiydjWSVPHGNWn143XsQrtELkjIXxkKMifX9r67m8qsXkDfW0nNqAj2s7Z0MDufKukhIzQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=wdc.com; dmarc=pass action=none header.from=wdc.com; dkim=pass header.d=wdc.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sharedspace.onmicrosoft.com; s=selector2-sharedspace-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Jwy0ErYhQwDtkS6lU3uNj5qgfy89MD4OsWQOU7ZwBxM=; b=VLUzXQn3eB80Zf1svA7ZOEmD5jGlIKBIU8lwiDkvFXjWNMQEIm5TeR2RL29CIfT89dC21uxfii83YlzpAS8qhHjQZZxAWSPY6PPkc1oMJXDfa9Ttfe+Bj1AAStg+E1A/vS/iaOrNToM500ZKsFK3RMNvmee/c+gAiUd/8dK86Bk= Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=wdc.com; Received: from SN7PR04MB8532.namprd04.prod.outlook.com (2603:10b6:806:350::6) by LV8PR04MB9223.namprd04.prod.outlook.com (2603:10b6:408:25f::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.9818.33; Tue, 21 Apr 2026 06:37:10 +0000 Received: from SN7PR04MB8532.namprd04.prod.outlook.com ([fe80::ce42:7775:2df8:8729]) by SN7PR04MB8532.namprd04.prod.outlook.com ([fe80::ce42:7775:2df8:8729%6]) with mapi id 15.20.9818.033; Tue, 21 Apr 2026 06:37:10 +0000 Date: Tue, 21 Apr 2026 15:37:01 +0900 From: Shin'ichiro Kawasaki To: Daniel Wagner Cc: Chaitanya Kulkarni , "linux-block@vger.kernel.org" , "linux-scsi@vger.kernel.org" , "linux-nvme@lists.infradead.org" , "lsf-pc@lists.linux-foundation.org" , Bart Van Assche , Hannes Reinecke , hch , Jens Axboe , "sagi@grimberg.me" , "tytso@mit.edu" , Johannes Thumshirn , Christian Brauner , "Martin K. Petersen" , "linux-fsdevel@vger.kernel.org" , Javier =?utf-8?B?R29uesOhbGV6?= , "willy@infradead.org" , Jan Kara , "amir73il@gmail.com" , "vbabka@suse.cz" , Damien Le Moal Subject: Re: [LSF/MM/BPF ATTEND][LSF/MM/BPF TOPIC] : blktests: status, expansion plan for the storage stack test framework Message-ID: References: <31a2a4c2-8c33-429a-a2b1-e1f3a0e90d72@nvidia.com> <459953fa-5330-4eb1-a1b4-7683b04e3d45@flourine.local> Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-ClientProxiedBy: TYCP286CA0110.JPNP286.PROD.OUTLOOK.COM (2603:1096:400:29c::17) To SN7PR04MB8532.namprd04.prod.outlook.com (2603:10b6:806:350::6) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: SN7PR04MB8532:EE_|LV8PR04MB9223:EE_ X-MS-Office365-Filtering-Correlation-Id: 02f073c1-98da-42e4-a280-08de9f706a21 WDCIPOUTBOUND: EOP-TRUE X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|19092799006|366016|376014|7416014|1800799024|56012099003|18002099003|22082099003; X-Microsoft-Antispam-Message-Info: Pf6iiOWQpH/kb7FoSugH3hPVXnp2Kn6Nda0t6FYzsV7MR+2w270F2yQXTZbj23w0VFngMuCAaCd2yPd2OvHNPIMh0MmkCS3q5HRCkMn5kLNUQDggpFErwtmega5eFDKRPlLxdYce2mK1knaQgHZwoCoIa6bOXyv5SspPmLQSPi1wMoJbN+bmM1bom0ub7K4XDyF7zET5LvaW5dOrj79p7MTeDbccDGirx8YQci/zN98f5pODNnaapuk+urSQRy4LLHsJpVFUUSZUmIc2F8mscFhXKEWvcn7TjXw+qC5zfi/c9jsppzWmd42aDAUfeWNhFFLu3pSIPu/GS/N9XFT31ot4rxNAy8KS/QuzRO3Olc+zFzd5MACY2A9bwy3r+kfd4zgFJQmdEw4fMbHY/qfBKHDAKt3PPOLUaySOud42xsAgqrIRvnjOs201EJjLxu5X6+mAQFbRy0QqN98oe6D9T/DERdVrzmI8tERWkQ4qCP9eq8xS7dfzzc2JlWtA3rb1H/P1jRLBWrP4M3NGq2GZw8PqcryCW65RsYQkfwOiJrumz43u/Uk3NCS7T6SZisrevOC0/JPQqayclKDmOaTVg2LSb2F6XiWJX1QkBRpw9OjAguJIC12YTi7wITFlS2zZBb2Sa9RhfGOYNPlODAi4+H0hcWOa/rVw/QfkOX6JrkU1YF8C281meuXuz8pAFIlNa74yXxrBf1wMXbj8FBY947bkBTQYqs4nFxGSKj/Q2jhj8NBlgybDblyp3nSivun9 X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:SN7PR04MB8532.namprd04.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(19092799006)(366016)(376014)(7416014)(1800799024)(56012099003)(18002099003)(22082099003);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?rqH38QM4TWvR3HtVJrH22MPVJc5sft8n3WZthieGV1KiuHzpg8MMVbNi4/su?= =?us-ascii?Q?3eT3iPqOx+XQE/JZ9co5vHmF5CGDwZPov6Kj0WtJZXWHAK3Thk/kMEVKy6A7?= =?us-ascii?Q?Id2zGcBWEotuezZP7vDp5zdDOqDvZEDVxIV78dy9fQth+CuJ3y1CpEXL49gy?= =?us-ascii?Q?ElDRGuiVGD3KSq7og0m8paDgRYFKaVtTgLMlaxA86Bf0UuqhIbTtALlGzfnh?= =?us-ascii?Q?Ok5Xplc2K9q8nfpxOTLMSJDNkhgLbuEc7vu6p2ggmvV3fErypN45TqH1dyuc?= =?us-ascii?Q?xwCEGAje2TZcq5ZyJbfVT4s2ufBU7KW+kMqBqqrWTmRPcd72HNbu81+dX7oc?= =?us-ascii?Q?VRmsnfBP0IJwnMP/RZ4S1ntptwqBKwhGAULo9MKfm/DhTywjEfCPkuNoO2Nl?= =?us-ascii?Q?nhwVygpMSmDCo0b/H1ku7Yst66r1hTEf+M8hOT6URMwKbhzh6OxNBoUCyYBb?= =?us-ascii?Q?+Kgv9v5JKwwmucZ7iwDLNzjRvtdVM3EFxDtGB+zkemRvBN+No75tsysSVcfM?= =?us-ascii?Q?6yCJPvVNZ1CL5c3YjbNPREXKx7SCvRoT+VpKKe3jb5+j4vbxeSyFENiIUhqa?= =?us-ascii?Q?e/ScXlN8w6eQeriw1BG+8nHfOMwwzfBn1jlGqPczBnPtBS9+PT9PUmdUUBAi?= =?us-ascii?Q?1PQ387xUo3Mzb0nYgMAnU9o06a8KHlfJHjuMYeL1WQJr/rmkGUMLraJ3yQNA?= =?us-ascii?Q?xYVDBPlpXy2qlcTdwF6w/X1Jv5c2RxgqN4TjQmGR1xz5u3XbXzmBTLfo55fS?= =?us-ascii?Q?UDr4KsjTUCjkRCSRJujzvP2GhmhkuJhd1xTqbjwn6XQnagqhpai2TDS2+w/g?= =?us-ascii?Q?KI0DbiUlgHob1+aauOrJ7wN0EQVEYf8+w+/9i28Ogha29rftMJRpyc3M6jiY?= =?us-ascii?Q?Fe09w7cY4Bs886IsA4zoFW+0ITLn6kbaWhMAr9z7Am7OqahC0WKjHA8kJ0fk?= =?us-ascii?Q?wxL0lUtlET4aeb3Et480D8jn9/0Eb6LBzLgxVSnc8VGtt5BYC+BDpwqECgIx?= =?us-ascii?Q?DzCw58mHxBcHOAzyftfQLGAF9SiRieR2Ua5DEf9IKrwpO+BrlfYlt4/zt2YC?= =?us-ascii?Q?9Me9UycCKOJ8VKjvVEj/t1ORqVHRhWyCoxwPzEFYqMPbk2UbzW/R05uqoOhf?= =?us-ascii?Q?xTd80Yh1dV/eSWimidZFhZvsXG9tiBiCUPBN3WY8D+Qbl4OW2bKaVVxNa3RV?= =?us-ascii?Q?GFQUqknzK+G4KyuLN375MjnMjKJkfz4/j4op7HZ+kYwe52pGtIIilW9L/Blg?= =?us-ascii?Q?v2TqCWI2p5He+6LYkeZP+IipbJaFanJ37eXrID+yu8TPZdi9cSxV3+tXtJzP?= =?us-ascii?Q?JGGe3VsUVlVm4xVJ9q6TrDQO6M/j6Yx2kr+eET1u2EmBtcYyIe9pvCV5iKGL?= =?us-ascii?Q?A/h5Sk5sc+R6aRgR6CGdXU41g5tMwcZgg3gnx8NA8RTJovdgikpEQHCFaB58?= =?us-ascii?Q?NwugU+feFqY9xTnEjCZ01Ucg2E8mZr9v+lGj+OG/FZw36Tn/2OWs1/K+Chhi?= =?us-ascii?Q?G/wvM+cYLPtSaABNukOK2w0pjuxRoEETIDjUaz1axh/y8oAsKQkZDPTxZE8K?= =?us-ascii?Q?zi87RDF7YBzeHi8tZnFgHjJwhCLquwjQRwwX2RSqvjNUrMOm7loif9z0RHUD?= =?us-ascii?Q?Elxr55Y1WT4qr505rIYWlKA2kIehH/1AaRsId/jln5U4p5uCOPrAAcypif1N?= =?us-ascii?Q?rrtDAqA/ttu7STWGOdzSBnV8xGUL87uQOHlj/1jEMZA064gUTd+19RfIwr1X?= =?us-ascii?Q?L/ay0fUvj99vICcpHaIaqzyb42uFaDc=3D?= X-Exchange-RoutingPolicyChecked: p+0Fh26hbL6iLo+Pm+3Lt+yjIbx5jyj8E2LeMtZjRn+7v9jVukzeVr4+GTxLucYHsJHQzs7EtyOAVhfl6tFfHHA5Zmr6t8XLmW6M5KoNB+l3MEqdYz1rQS4Fj/H8E4nHPhF2YzRX7TL53317tkHzbXXBCT7FYYk8/mOHfAmBFDKI7APofPMMWWunq/t19XlgawPBCdtrX1rRdem8P7HDTOVtuqTKNe30PswsLVpUR0VGy6nsVVMhmpLDJPCyWfOVfyCw+leyGErVRzwncrtqzQEpqt/YNV2Qi8vBBarhq54ZlxrChtPoHeFiYIDM0pEJhzU/FrqU6/DIalxt7WPsyw== X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0: 7cbDWpzeGhOIos7CLXS91Z7ucRd1RjVUoQTVzgQyvrsrUZarIQUtNTWfXB7acnlgejAn8/8gBRZKiwebWi35GSMdDl0ZRjR5c/GXGbJ5yySkIu5hLVSz6iGIOWajRBOUeKWhV9s1pETYyAQDjGdH26V7RjaQ00y57w+98znO5GqBxY6Kk+8kjVyCZ3c9sbPM6x61HoICFaOEVxxdCJPY4Yf2ky60GI6LKbkEHj6fBPfUShbq5YYPM6FKze4bwtcaLjxrdR+AjHeDVg48bKp7tIof1Yt+5wslrTcDiPncw1RlJx5lBTTF9HIjPN/DyDdubOgHowCF6Has4pky8/F9xS/GQHqfq10tGjkrkuuZHyzZFbPcKaFB56KUQkCGiHWJCLtJIKG4pAqq9NfXZ19xF4D3WgJZZHfOzCSnbCe4FUhlmCQR0A6th7wPIvfz8w35cpdQdY+Tu115o9r9f3SrrxufQWBKyPgS7Gs0o7lu1s48srCZGVS0tKvcxRIoNywPhrc52cfr88ZnDEBU6WTvcZrz5lTIWsEbJALkrO8FV7AftFAsL/VI9o+7SsnLThIlo1z7VCfxz5qFk9Yl/5d+gqgA64DOyaJVR8BqQqSqNE1kgEIFr3IPqAPfHNi98+8I X-OriginatorOrg: wdc.com X-MS-Exchange-CrossTenant-Network-Message-Id: 02f073c1-98da-42e4-a280-08de9f706a21 X-MS-Exchange-CrossTenant-AuthSource: SN7PR04MB8532.namprd04.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 21 Apr 2026 06:37:10.3091 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: b61c8803-16f3-4c35-9b17-6f65f441df86 X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: TGMy2QKzU8nBjeOmhB2VTiG6Eu4sLdJDW8/hp/IUUuy+UvOhDCGboCKsku6RcXnvyyQtwZLdxAyx19iU3oCtomfKMhr06oz+uiGGhiHm+uQ= X-MS-Exchange-Transport-CrossTenantHeadersStamped: LV8PR04MB9223 X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20260420_233717_174244_157A999B X-CRM114-Status: GOOD ( 16.78 ) X-BeenThere: linux-nvme@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: "Linux-nvme" Errors-To: linux-nvme-bounces+linux-nvme=archiver.kernel.org@lists.infradead.org On Feb 13, 2026 / 11:23, Shinichiro Kawasaki wrote: [...] > Here I share the list of improvement > opportunities from my view point (I already mentioned the first three items). > > 1. We can have more CI infra to make the most of blktests > 2. We can add config examples to help new users > 3. We can measure code coverage to identify missing test areas > 4. Long standing failures make test result reports dirty > - I feel lockdep WARNs are tend to be left unfixed rather long period. > How can we gather effort to fix them? > 5. We can refactor and clean up blktests framework for ease of maintainance > (e.g. trap handling) > 6. Some users run blktests with built-in kernel modules, which makes a number > of test cases skipped. We can add more built-in kernel modules support to > expand test coverage for such use case. I read through this e-mail thread again, and revised the list of improvement opportunities. Hope this list helps the discussion at the session. 1. configuration example, documentation, or tool for ease of new users 2. blktests framework capabilitly - more bug detection capability (such as kmemleak) - code coverage measurement per test case - VM integration (virtme-ng? valid use case?) - parallel execution for shorter run - built-in module testing - multi device testing 3. blktests CI 4. longstanding failures - nvme/005 tcp transport, nbd/002 5. test area coverage expansion (which area do we lack tests?) - code coverage information as the guide - new category candidates (rnbd?) 6. blktests framework refactoring - trap handling One thing I added was "multi device testing". Most of the test cases use single test device for single test run, while md/003 and bcache/001 require multiple devices for single test run. There was a discussion how to specify multiple devices in the config file [*]. [*] https://lore.kernel.org/linux-block/aXHbPWCf5SfycpBX@shinmob/