From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id 70A24EB64D9 for ; Fri, 16 Jun 2023 01:58:08 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232966AbjFPB6G (ORCPT ); Thu, 15 Jun 2023 21:58:06 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:34834 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229509AbjFPB6F (ORCPT ); Thu, 15 Jun 2023 21:58:05 -0400 Received: from EUR05-VI1-obe.outbound.protection.outlook.com (mail-vi1eur05on2070.outbound.protection.outlook.com [40.107.21.70]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 64A1C1FE8 for ; Thu, 15 Jun 2023 18:58:02 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=DAuuFDkkD9GOGrXJbj+T3m7gqMsL5EB6AP463/RS45QXijlO1pBAmUJWhE5VSU21obKu5sStqg+qwHbe8nbOGM1Obn4G4F5EEHZqdCImI8xv+whQgkBZewO4x3Ars8rmQz58JV5c+J9LLi77QTj1uIXzwymB9cnZoXj6FQV6Y9JK8FL0NOwZhLpNWY6yEafOIRCwDjxGJn8WILFnL3GAtflTzYEVXJFdwZI5P9T5Kaq1MkvjMBvA6wtxhuhhCxcSWgHH9SF4J4cvC8H/IQlsynn34Lc5hZvn3iRJKL3icxDZgyXyuFjb6Ejf6G2fzCbhaG+0UOclB5O9NSgos9/2ig== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=LKYLGW0pCpKxLIYzsPYUI1KunpVoOWm6USjDZCW3aKU=; b=S9CBT2TN/HYI0xk1J6dAsD6WZs11eTGGtn5XZeKpf8biJ81sjxUNmAPSu14BnGPvv+E+xM/qtXOk1mMfb6cRgEk+SUamqy6/ZSBVkETTuV4wDkEPVHDNVRUtFfjNM8cIolqsIR0dqw51LaFvJTM6QaB2KeV5pKdmp+v3ZvNxij/2X43b1gjPzo4BbmkjkL6CwwUTD3i/vtv3elNUWqFY4zXozI2ydmies0S/iIfWQhoUVN+Bng5vhcpJR3oMHgkzox6QcC1OCsM77ZpfVEzokiJNbAQ9Ch7ugAgXpqp+9WCAjF51H9VdqciKh2lCRtUVJxvpZe/naOENCyHDMLknlw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=suse.com; dmarc=pass action=none header.from=suse.com; dkim=pass header.d=suse.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=LKYLGW0pCpKxLIYzsPYUI1KunpVoOWm6USjDZCW3aKU=; b=d0fVnwYRY380vtjrOCZujuFHwioqu9FKc1x9rpOd4hh0w49Tt+A49yKkIXedg7a7JhnCBo4uvDJ0uSm11e7NZY/c2/KG2xGYlF7NmPgvMrv8yK+IH6N3TxExZZcCEc7H9d0dsXjdKY56GZRH6Q7dvEV/IBw7RYRRk3Y+STy0ubgd214aWKs1m9J84+/3zegWYsmNAoTr9h8HoPYJgDB7z52fGJnFALbaM3Mz8mAmpgS4P94sIIFnZGAXBlkksNnsdePc0Gh9KPXD6kSEeaSz37I09pxI3NMeh9L25b2gzy0y3mMWXbZtwEKtiys+Ey6UoQR5H8DlAgKaSuO4BXyVag== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=suse.com; Received: from AS8PR04MB8465.eurprd04.prod.outlook.com (2603:10a6:20b:348::19) by AS8PR04MB9189.eurprd04.prod.outlook.com (2603:10a6:20b:44c::10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6455.38; Fri, 16 Jun 2023 01:57:58 +0000 Received: from AS8PR04MB8465.eurprd04.prod.outlook.com ([fe80::7b80:d77b:1fc5:2ba2]) by AS8PR04MB8465.eurprd04.prod.outlook.com ([fe80::7b80:d77b:1fc5:2ba2%7]) with mapi id 15.20.6500.025; Fri, 16 Jun 2023 01:57:58 +0000 Message-ID: <8b24dc83-1506-b5cc-1441-5233d161f5d8@suse.com> Date: Fri, 16 Jun 2023 09:57:47 +0800 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.12.0 Subject: Re: BUG in raid6_pq while running fstest btrfs/286 To: Jeff Layton , Alexander Gordeev , Song Liu , Heiko Carstens , Giulio Benetti Cc: linux-btrfs , David Sterba References: <72097c8f447b02fb4ed3cb6b898d73423ca52d09.camel@kernel.org> Content-Language: en-US From: Qu Wenruo In-Reply-To: <72097c8f447b02fb4ed3cb6b898d73423ca52d09.camel@kernel.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-ClientProxiedBy: TYAPR01CA0113.jpnprd01.prod.outlook.com (2603:1096:404:2a::29) To AS8PR04MB8465.eurprd04.prod.outlook.com (2603:10a6:20b:348::19) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: AS8PR04MB8465:EE_|AS8PR04MB9189:EE_ X-MS-Office365-Filtering-Correlation-Id: 8ff6b79e-0f1e-42ed-b9e2-08db6e0d1be8 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: WKwNQOb89aDpIILoaiep5U4qg2tdwAgVtf5HM3ZgAxd+WIVWKmv5IQIdTtxQggBV0SFwIXBuBeD8pTXq1M2KgF6PVVIXRiT1bHum5eboqXHeW9+55sloEH7aUHcYnbhsjX5Y2n+AdouIKQ/QaiLE4dF0ORi0XC0Ud2ZR+P2LrYO+JTG0wyTIgOhDEN268Pc4Bq9C4IeDvQv8sD4hW3dKqhUblg72Qkbt7jaiyT/PCp9RwOxqnsszTT6JZ6y6Ebk7cOUd2YIWiGVxGBS9ndHFXWYWUgvVkf7sQ+QczakdO3TKUBda/1DQxyg42UPDbjy05z5OalV3mE5OLy2k5yrxFPfiN6D7ej+TKjcD2IpmVGa5VJaOgwA1XdAT8pTr45jwpkPna3dtQF9tH+IKSlf8IsfojcfHvfxAW3Wx4U7Z0QeQo3Z5lxuv+fnDapxY/IUfS3XhFIq0yGcopxX8PPeeZ+BIjYbMGwK6btbxwbIZ450vFMqfZZLUQs4N2xw/WNQ+XgTf4M1yO56q3M8vgM3S12teolHYTw+H6pk/gXEQz//mjsP9kxfFtYHpmn1e13jQldtYcBXnx0U4Ze5sgLsrkQYTsf42IwFPatKCPzs++qrI9rqUXy3Izd2mGnIQNpZGOmZFpJp9Mh4jgg17tjkmhg== X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:AS8PR04MB8465.eurprd04.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230028)(346002)(136003)(366004)(376002)(396003)(39860400002)(451199021)(31686004)(53546011)(5660300002)(41300700001)(6512007)(186003)(966005)(36756003)(6506007)(30864003)(4326008)(66556008)(45080400002)(8936002)(66946007)(83380400001)(66476007)(478600001)(316002)(8676002)(6666004)(110136005)(54906003)(6486002)(31696002)(86362001)(2906002)(2616005)(38100700002)(45980500001)(43740500002);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?d256R2hHZytHYm9KNnNQd3hHODJxS2t2ZC9hbTZqMDdPZ3N6eXU2RXJZTitB?= =?utf-8?B?clhXeE9VdnVVQlpMeDVlRmJlRTM2c05oNWxSY1ZyMHp2M3dJaHlaTk1BSlRQ?= =?utf-8?B?Y1pURno2WnA2dkh5ZU5NQWtwS1JsNDh2MTRlemtUZ1loYjlxNXZsUDlvendD?= =?utf-8?B?Sll4dEVhdkVFRDVEOEJyYTBpTlBpd0ZvRGRBUTFBaDRITUczU3FERy9BaDNq?= =?utf-8?B?UWR4Z2NjS09EaXdMdUFLRjhlbjJxNUJGejk5bWd2T3dXNGJyQ1R0dGcrSVAv?= =?utf-8?B?S1RLTlp2Y2tUNDcveVNUVkF3TWtCUDhIVy9IL3JRNldBalI2WmNEdnVpNXNa?= =?utf-8?B?SXZ2N2hnNWZ4eEJpWjBvYmRKVHRtRTFLYlB5ekd0aU5ETnBrYnlDb3pmdkZl?= =?utf-8?B?R0dqd2JmakxCWmdsekowSE44aWxEWHhObEtnTjlHcThLNXlTa3dFNjlaV0Fx?= =?utf-8?B?T0ZEbWtmUE5aRW9Da3ZzK2hMUm5zYlEvRkZjTTNqY3RsQWFWcWJ0WW1oc0N3?= =?utf-8?B?L2ZKc0cwSTRuNVJVcytlWll3dk5VUU5sQmxxbmJKaHgzaWRPY3pHWUx1LzV4?= =?utf-8?B?QjJ1ZkkvamVBQ2dFblZhNmFzKzd6UTllOEIzZ2ROSk9tRTRpWjVvUVJUb2Fu?= =?utf-8?B?eTIzWHFJOHFlL3ZDS2lJQlZucVllSjZVaTRya0J1WFBXTjREZEoybmtmTEQx?= =?utf-8?B?bWo5THpRV3hiUVB5eXk3RFdUNFZLdXlXMlM0ZDhDSWJmTlRCK0RORjZaUWdS?= =?utf-8?B?dy9qb2l6WTZNTnNMNjlrY3RPN1hkOEhFWFBuOTRXY3VQWEdLZHNMN2hPS2do?= =?utf-8?B?VzRLMUUrZzRueElqS01hdHhhdnQ2eGgva0VFY2ZoeUNpYm0zUE1ZRFVQR2U0?= =?utf-8?B?RHloM3dFZ0ZzemEyYklTVXZxazBnK3lVdVZ2UXBKaFpldXk0R2ZzNUwwR2dm?= =?utf-8?B?OEQ5NVJKTUo0cDBWcThsV3Nka0J3ekZ0VUFGaVBqVHdyOVVsakFycHRqZ3NX?= =?utf-8?B?cis0RFhjTVA1b1pEdCs3dmNhMWJhcExLSVZRSytXRnBnNzRwYytpWm83RTBt?= =?utf-8?B?bzE3NVo4Q000RS9McHdFUGRlMlkwR0Z3OEJPd1NyeFgxVHp1TlV3OGhscDlv?= =?utf-8?B?UDRVZDR5ajlqTVB4dGllbW9sUDZNTVJ2YlRnK01lRVdTTm1BZFFlQWp2cGJQ?= =?utf-8?B?OXBQZlhabkpDYTU4UnNvVUFuSGRoQ0l5VG5CTkg4b1J2RDZIMWdxZ1pONHhG?= =?utf-8?B?SWhTTlFSdXVuZkczdklPV0ZvOFZPZDhEVnFYM09OUHVaQmNoTXBRYWNQNmRY?= =?utf-8?B?cXptSEV6bys5MjRaWXZnRGRZV0NSd1hxdGJwNGhUalpXMnpwY2xEZ3ZRUlZw?= =?utf-8?B?aWZ5cGFINFFlY1pGV1FCTWg5b1YrM3BGNTgyWFE3VnE4NTdwdkhoTjRaeTVu?= =?utf-8?B?dVBZdldLUXdwSGI2T0FkVlV0TzMrYnYyRDBVMHhTTGJKTnMrbHRwQzRRa2Y0?= =?utf-8?B?S0VMR1Jjbno1WFZjUytkdUhjNXVPK3FucWNKclR3ZjNxUDBJTGdTKzA2azFL?= =?utf-8?B?SlcvcmJoNVc1YTZ0LzlUTUtpeXhaY1JxRkJkVjN2VjR2Vk53U2g5aDZnOGNw?= =?utf-8?B?dU9OSHNyUitjb3Azd3k4QTBLS1RWRkFVZ0xTY2ZwSDZqS0MwWVpkSzdoTFBR?= =?utf-8?B?TVBaWkdPWTFjRmZjMkE1T3djdjNnVU9LMzNnaE5OZmVnTHV4UjMzOWhLaG9v?= =?utf-8?B?RmlId3NEbUZaK0RqRmxFRnZHeVBqNk9XR2RWSlB0dDNiWkxhRmxpK0VxbXVj?= =?utf-8?B?elpvSVhKR1lIb2VieFR4R3dFajI5UkxSelpNdXZNencyUmsyNWxtc2I4UmZv?= =?utf-8?B?OTAvWVJrbk8zMDJHN1lrTTQ2bDJHbk14UnhtK3VIYm5JUDM4QlFnYTRKdHBM?= =?utf-8?B?d3IyNys5d1FuQ1ErNFllNDJtZit5UVhlZUVVZkRnL1RBQis1dkxiTTJTbGtE?= =?utf-8?B?VGN3bVg2bUtudGJsSituT3RsVzVVb3lDSFRlK1pGR1Q4MlJjd1VHeHNVeDln?= =?utf-8?B?U015ZzJxcXA0Mkt4Sk51UHpWMGJjM2tuS1NKcTAwamNMR0lSK0lZMjhNaHNL?= =?utf-8?Q?WcEi5YGLt+yeb5G27LkGiv3AV?= X-OriginatorOrg: suse.com X-MS-Exchange-CrossTenant-Network-Message-Id: 8ff6b79e-0f1e-42ed-b9e2-08db6e0d1be8 X-MS-Exchange-CrossTenant-AuthSource: AS8PR04MB8465.eurprd04.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 16 Jun 2023 01:57:58.7134 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: f7a17af6-1c5c-4a36-aa8b-f5be247aa4ba X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: 2jlH8SEobvdwWpB0aWa4ZKH0CUeT90EGFuBv4egYkjjUqIZglLPvhRKfqTGCQvNM X-MS-Exchange-Transport-CrossTenantHeadersStamped: AS8PR04MB9189 Precedence: bulk List-ID: X-Mailing-List: linux-btrfs@vger.kernel.org On 2023/6/16 01:58, Jeff Layton wrote: > I hit this today, while doing some testing with kdevops. Test btrfs/286 > was running when it failed: > > [ 4759.230216] run fstests btrfs/286 at 2023-06-15 16:11:41 > [ 4759.636322] BTRFS: device fsid 8d197804-9964-4b3f-bbea-3ef33869b564 devid 1 transid 484 /dev/loop16 scanned by mount (893879) > [ 4759.641190] BTRFS info (device loop16): using crc32c (crc32c-intel) checksum algorithm > [ 4759.644817] BTRFS info (device loop16): using free space tree > [ 4759.650706] BTRFS info (device loop16): enabling ssd optimizations > [ 4759.652720] BTRFS info (device loop16): auto enabling async discard > [ 4760.484561] BTRFS: device fsid 2a451aed-b7b6-4498-ba17-0e28a2e1a26b devid 1 transid 6 /dev/loop5 scanned by (udev-worker) (894101) > [ 4760.494221] BTRFS: device fsid 2a451aed-b7b6-4498-ba17-0e28a2e1a26b devid 2 transid 6 /dev/loop6 scanned by (udev-worker) (892207) > [ 4760.497373] BTRFS: device fsid 2a451aed-b7b6-4498-ba17-0e28a2e1a26b devid 3 transid 6 /dev/loop7 scanned by (udev-worker) (892535) > [ 4760.502687] BTRFS: device fsid 2a451aed-b7b6-4498-ba17-0e28a2e1a26b devid 4 transid 6 /dev/loop8 scanned by mkfs.btrfs (894095) > [ 4760.515672] BTRFS info (device loop5): using crc32c (crc32c-intel) checksum algorithm > [ 4760.519412] BTRFS info (device loop5): setting nodatasum > [ 4760.521777] BTRFS info (device loop5): using free space tree > [ 4760.527120] BTRFS info (device loop5): enabling ssd optimizations > [ 4760.528861] BTRFS info (device loop5): auto enabling async discard > [ 4760.532184] BTRFS info (device loop5): checking UUID tree > [ 4762.658754] BTRFS info (device loop5): using crc32c (crc32c-intel) checksum algorithm > [ 4762.662098] BTRFS info (device loop5): allowing degraded mounts > [ 4762.664749] BTRFS info (device loop5): setting nodatasum > [ 4762.667347] BTRFS info (device loop5): using free space tree > [ 4762.672306] BTRFS warning (device loop5): devid 2 uuid de8712ab-ca85-4414-93a7-213060d1831d is missing > [ 4762.676977] BTRFS info (device loop5): enabling ssd optimizations > [ 4762.679852] BTRFS info (device loop5): auto enabling async discard > [ 4763.355404] BTRFS info (device loop5): dev_replace from (devid 2) to /dev/loop9 started > [ 4763.595633] BTRFS info (device loop5): dev_replace from (devid 2) to /dev/loop9 finished > [ 4764.044660] 286 (893750): drop_caches: 3 > [ 4765.384814] BTRFS: device fsid 7acce38c-63c2-4365-a338-e1f6c0fd484b devid 1 transid 6 /dev/loop5 scanned by (udev-worker) (894101) > [ 4765.392235] BTRFS: device fsid 7acce38c-63c2-4365-a338-e1f6c0fd484b devid 2 transid 6 /dev/loop6 scanned by (udev-worker) (892207) > [ 4765.404469] BTRFS: device fsid 7acce38c-63c2-4365-a338-e1f6c0fd484b devid 3 transid 6 /dev/loop7 scanned by (udev-worker) (894101) > [ 4765.412107] BTRFS: device fsid 7acce38c-63c2-4365-a338-e1f6c0fd484b devid 4 transid 6 /dev/loop8 scanned by mkfs.btrfs (894169) > [ 4765.429084] BTRFS info (device loop5): using crc32c (crc32c-intel) checksum algorithm > [ 4765.433332] BTRFS info (device loop5): setting nodatasum > [ 4765.435506] BTRFS info (device loop5): using free space tree > [ 4765.440808] BTRFS info (device loop5): enabling ssd optimizations > [ 4765.442402] BTRFS info (device loop5): auto enabling async discard > [ 4765.444752] BTRFS info (device loop5): checking UUID tree > [ 4767.634901] BTRFS info (device loop5): using crc32c (crc32c-intel) checksum algorithm > [ 4767.637985] BTRFS info (device loop5): allowing degraded mounts > [ 4767.640216] BTRFS info (device loop5): setting nodatasum > [ 4767.642221] BTRFS info (device loop5): using free space tree > [ 4767.646646] BTRFS warning (device loop5): devid 2 uuid 6240c286-893c-4d19-bbf5-f1d2fecc6b96 is missing > [ 4767.650311] BTRFS warning (device loop5): devid 2 uuid 6240c286-893c-4d19-bbf5-f1d2fecc6b96 is missing > [ 4767.655256] BTRFS info (device loop5): enabling ssd optimizations > [ 4767.658073] BTRFS info (device loop5): auto enabling async discard > [ 4768.343633] BTRFS info (device loop5): dev_replace from (devid 2) to /dev/loop9 started > [ 4768.608799] BTRFS info (device loop5): dev_replace from (devid 2) to /dev/loop9 finished > [ 4768.750345] 286 (893750): drop_caches: 3 > [ 4769.993871] BTRFS: device fsid 965cdb50-095a-4fd9-bcda-2c17bd80c3ad devid 1 transid 6 /dev/loop5 scanned by (udev-worker) (894101) > [ 4770.002879] BTRFS: device fsid 965cdb50-095a-4fd9-bcda-2c17bd80c3ad devid 2 transid 6 /dev/loop6 scanned by (udev-worker) (892207) > [ 4770.015617] BTRFS: device fsid 965cdb50-095a-4fd9-bcda-2c17bd80c3ad devid 3 transid 6 /dev/loop7 scanned by (udev-worker) (894101) > [ 4770.021936] BTRFS: device fsid 965cdb50-095a-4fd9-bcda-2c17bd80c3ad devid 4 transid 6 /dev/loop8 scanned by mkfs.btrfs (894243) > [ 4770.041357] BTRFS info (device loop5): using crc32c (crc32c-intel) checksum algorithm > [ 4770.043426] BTRFS info (device loop5): setting nodatasum > [ 4770.045340] BTRFS info (device loop5): using free space tree > [ 4770.050615] BTRFS info (device loop5): enabling ssd optimizations > [ 4770.053473] BTRFS info (device loop5): auto enabling async discard > [ 4770.056311] BTRFS info (device loop5): checking UUID tree > [ 4772.692223] BTRFS info (device loop5): using crc32c (crc32c-intel) checksum algorithm > [ 4772.695043] BTRFS info (device loop5): allowing degraded mounts > [ 4772.697901] BTRFS info (device loop5): setting nodatasum > [ 4772.700355] BTRFS info (device loop5): using free space tree > [ 4772.704900] BTRFS warning (device loop5): devid 2 uuid 5fa35bdf-8f54-4652-ba28-7c302a265f8d is missing > [ 4772.708151] BTRFS warning (device loop5): devid 2 uuid 5fa35bdf-8f54-4652-ba28-7c302a265f8d is missing > [ 4772.713703] BTRFS info (device loop5): enabling ssd optimizations > [ 4772.716270] BTRFS info (device loop5): auto enabling async discard > [ 4773.735253] BTRFS info (device loop5): dev_replace from (devid 2) to /dev/loop9 started > [ 4774.089640] BTRFS info (device loop5): dev_replace from (devid 2) to /dev/loop9 finished > [ 4774.269606] 286 (893750): drop_caches: 3 > [ 4775.897236] BTRFS: device fsid 0552fbf6-2877-4ab3-b5a2-da5db268e1c3 devid 1 transid 6 /dev/loop5 scanned by (udev-worker) (894101) > [ 4775.905939] BTRFS: device fsid 0552fbf6-2877-4ab3-b5a2-da5db268e1c3 devid 2 transid 6 /dev/loop6 scanned by mkfs.btrfs (894317) > [ 4775.909603] BTRFS: device fsid 0552fbf6-2877-4ab3-b5a2-da5db268e1c3 devid 3 transid 6 /dev/loop7 scanned by mkfs.btrfs (894317) > [ 4775.913080] BTRFS: device fsid 0552fbf6-2877-4ab3-b5a2-da5db268e1c3 devid 4 transid 6 /dev/loop8 scanned by mkfs.btrfs (894317) > [ 4775.928177] BTRFS info (device loop5): using crc32c (crc32c-intel) checksum algorithm > [ 4775.930566] BTRFS info (device loop5): setting nodatasum > [ 4775.932930] BTRFS info (device loop5): using free space tree > [ 4775.937296] BTRFS info (device loop5): enabling ssd optimizations > [ 4775.938306] BTRFS info (device loop5): auto enabling async discard > [ 4775.940084] BTRFS info (device loop5): checking UUID tree > [ 4779.204728] BTRFS info (device loop5): using crc32c (crc32c-intel) checksum algorithm > [ 4779.207351] BTRFS info (device loop5): allowing degraded mounts > [ 4779.210284] BTRFS info (device loop5): setting nodatasum > [ 4779.212740] BTRFS info (device loop5): using free space tree > [ 4779.218547] BTRFS warning (device loop5): devid 2 uuid 9a9f7178-0caa-4c5f-8f92-034e72257005 is missing > [ 4779.221982] BTRFS warning (device loop5): devid 2 uuid 9a9f7178-0caa-4c5f-8f92-034e72257005 is missing > [ 4779.227912] BTRFS info (device loop5): enabling ssd optimizations > [ 4779.230483] BTRFS info (device loop5): auto enabling async discard > [ 4780.128223] BTRFS info (device loop5): dev_replace from (devid 2) to /dev/loop9 started > [ 4780.422390] BUG: kernel NULL pointer dereference, address: 0000000000000000 > [ 4780.423934] #PF: supervisor read access in kernel mode > [ 4780.425584] #PF: error_code(0x0000) - not-present page > [ 4780.427234] PGD 0 P4D 0 > [ 4780.428293] Oops: 0000 [#1] PREEMPT SMP PTI > [ 4780.429722] CPU: 3 PID: 761699 Comm: kworker/u16:4 Not tainted 6.4.0-rc6+ #6 > [ 4780.431582] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.16.2-1.fc38 04/01/2014 > [ 4780.433897] Workqueue: btrfs-rmw rmw_rbio_work [btrfs] > [ 4780.435655] RIP: 0010:raid6_sse21_gen_syndrome+0x9e/0x130 [raid6_pq] > [ 4780.437518] Code: 4d 8d 54 05 00 44 89 c0 48 c1 e0 03 48 29 c6 49 8b 03 48 01 d0 0f 18 00 66 0f 6f 10 49 8b 01 0f 18 04 10 66 0f 6f e2 49 8b 01 <66> 0f 6f 34 10 4c 89 d0 45 85 c0 78 34 48 8b 08 0f 18 04 11 66 0f > [ 4780.442488] RSP: 0018:ffffb66f0296fdc8 EFLAGS: 00010286 > [ 4780.444147] RAX: 0000000000000000 RBX: 0000000000001000 RCX: ffffa0ff4cfa3248 > [ 4780.446192] RDX: 0000000000000000 RSI: ffffa0f74cfa3238 RDI: 0000000000000000 > [ 4780.448278] RBP: ffffa0ff4e72a000 R08: 00000000fffffffe R09: ffffa0ff4cfa3238 > [ 4780.450387] R10: ffffa0ff4cfa3230 R11: ffffa0ff4cfa3240 R12: ffffa0fe8bdf3000 > [ 4780.452515] R13: ffffa0ff4cfa3240 R14: 0000000000000003 R15: 0000000000000000 > [ 4780.454638] FS: 0000000000000000(0000) GS:ffffa0ff77cc0000(0000) knlGS:0000000000000000 > [ 4780.456956] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 > [ 4780.458778] CR2: 0000000000000000 CR3: 000000015eb0a001 CR4: 0000000000060ee0 > [ 4780.460789] Call Trace: > [ 4780.461832] > [ 4780.462804] ? __die+0x1f/0x70 > [ 4780.463915] ? page_fault_oops+0x159/0x450 > [ 4780.465207] ? fixup_exception+0x22/0x310 > [ 4780.466484] ? exc_page_fault+0x7a/0x180 > [ 4780.467666] ? asm_exc_page_fault+0x22/0x30 > [ 4780.468879] ? raid6_sse21_gen_syndrome+0x9e/0x130 [raid6_pq] > [ 4780.470372] ? raid6_sse21_gen_syndrome+0x38/0x130 [raid6_pq] > [ 4780.471801] rmw_rbio+0x5c8/0xa80 [btrfs] > [ 4780.472987] ? preempt_count_add+0x6a/0xa0 > [ 4780.474061] ? lock_stripe_add+0xe1/0x290 [btrfs] > [ 4780.475288] process_one_work+0x1c7/0x3d0 > [ 4780.476304] worker_thread+0x4d/0x380 > [ 4780.477232] ? __pfx_worker_thread+0x10/0x10 > [ 4780.478241] kthread+0xf3/0x120 > [ 4780.479071] ? __pfx_kthread+0x10/0x10 > [ 4780.479982] ret_from_fork+0x2c/0x50 > [ 4780.480843] > [ 4780.481488] Modules linked in: dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio dm_log_writes dm_flakey nls_iso8859_1 nls_cp437 vfat fat ext4 9p crc16 joydev kvm_intel netfs virtio_net mbcache cirrus kvm psmouse pcspkr net_failover failover xfs irqbypass drm_shmem_helper virtio_balloon jbd2 evdev button 9pnet_virtio drm_kms_helper loop drm dm_mod zram zsmalloc crct10dif_pclmul crc32_pclmul ghash_clmulni_intel sha512_ssse3 sha512_generic aesni_intel nvme virtio_blk crypto_simd nvme_core virtio_pci cryptd t10_pi virtio i6300esb virtio_pci_legacy_dev crc64_rocksoft_generic virtio_pci_modern_dev crc64_rocksoft crc64 virtio_ring serio_raw btrfs blake2b_generic libcrc32c crc32c_generic crc32c_intel xor raid6_pq autofs4 > [ 4780.492421] CR2: 0000000000000000 > [ 4780.493185] ---[ end trace 0000000000000000 ]--- > [ 4780.494099] RIP: 0010:raid6_sse21_gen_syndrome+0x9e/0x130 [raid6_pq] > [ 4780.495217] Code: 4d 8d 54 05 00 44 89 c0 48 c1 e0 03 48 29 c6 49 8b 03 48 01 d0 0f 18 00 66 0f 6f 10 49 8b 01 0f 18 04 10 66 0f 6f e2 49 8b 01 <66> 0f 6f 34 10 4c 89 d0 45 85 c0 78 34 48 8b 08 0f 18 04 11 66 0f > [ 4780.498186] RSP: 0018:ffffb66f0296fdc8 EFLAGS: 00010286 > [ 4780.499138] RAX: 0000000000000000 RBX: 0000000000001000 RCX: ffffa0ff4cfa3248 > [ 4780.500327] RDX: 0000000000000000 RSI: ffffa0f74cfa3238 RDI: 0000000000000000 > [ 4780.501533] RBP: ffffa0ff4e72a000 R08: 00000000fffffffe R09: ffffa0ff4cfa3238 > [ 4780.502683] R10: ffffa0ff4cfa3230 R11: ffffa0ff4cfa3240 R12: ffffa0fe8bdf3000 > [ 4780.503827] R13: ffffa0ff4cfa3240 R14: 0000000000000003 R15: 0000000000000000 > [ 4780.504971] FS: 0000000000000000(0000) GS:ffffa0ff77cc0000(0000) knlGS:0000000000000000 > [ 4780.506207] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 > [ 4780.507143] CR2: 0000000000000000 CR3: 000000015eb0a001 CR4: 0000000000060ee0 > [ 4780.508242] note: kworker/u16:4[761699] exited with irqs disabled > [ 4780.509242] note: kworker/u16:4[761699] exited with preempt_count 1 > > > Looks like a quadword move failed? I'm not well-versed in SSE asm, I'm afraid: > > $ ./scripts/faddr2line --list ./lib/raid6/raid6_pq.ko raid6_sse21_gen_syndrome+0x9e/0x130 > raid6_sse21_gen_syndrome+0x9e/0x130: > > raid6_sse21_gen_syndrome at /home/jlayton/git/kdevops/linux/lib/raid6/sse2.c:56 > 51 for ( d = 0 ; d < bytes ; d += 16 ) { > 52 asm volatile("prefetchnta %0" : : "m" (dptr[z0][d])); > 53 asm volatile("movdqa %0,%%xmm2" : : "m" (dptr[z0][d])); /* P[0] */ > 54 asm volatile("prefetchnta %0" : : "m" (dptr[z0-1][d])); > 55 asm volatile("movdqa %xmm2,%xmm4"); /* Q[0] */ >> 56< asm volatile("movdqa %0,%%xmm6" : : "m" (dptr[z0-1][d])); > 57 for ( z = z0-2 ; z >= 0 ; z-- ) { > 58 asm volatile("prefetchnta %0" : : "m" (dptr[z][d])); > 59 asm volatile("pcmpgtb %xmm4,%xmm5"); > 60 asm volatile("paddb %xmm4,%xmm4"); > 61 asm volatile("pand %xmm0,%xmm5"); > > > This machine is running v6.4.0-rc5 with some ctime handling patches on > top (nothing that should affect anything at this level). The Kconfig is > config-next-20230530 from the kdevops tree: > > https://github.com/linux-kdevops/kdevops/blob/master/playbooks/roles/bootlinux/templates/config-next-20230530) > > Let me know if you need other info! Unfortunately there are similar reports but I failed to reproduce anywhere. In the past, I have added extra debugging for the reporter, and the result is, at least every pointer is valid, until the control is passed to the optimization routine... You can try to disable SSE for the vCPU, or even pass AVX feature to the vCPU, and normally you would see the error gone. The last time I see such problem is from David, but we did not got any progress any further. Thanks, Qu