From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-5.3 required=3.0 tests=BAYES_00, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS, USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id C115EC433B4 for ; Wed, 7 Apr 2021 18:21:39 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 852CE611C1 for ; Wed, 7 Apr 2021 18:21:38 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 852CE611C1 Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=molgen.mpg.de Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id DD9AC6B0073; Wed, 7 Apr 2021 14:21:37 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id D8AAA6B0078; Wed, 7 Apr 2021 14:21:37 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id C2B036B007D; Wed, 7 Apr 2021 14:21:37 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0104.hostedemail.com [216.40.44.104]) by kanga.kvack.org (Postfix) with ESMTP id A41706B0073 for ; Wed, 7 Apr 2021 14:21:37 -0400 (EDT) Received: from smtpin25.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay05.hostedemail.com (Postfix) with ESMTP id 56FA418179031 for ; Wed, 7 Apr 2021 18:21:37 +0000 (UTC) X-FDA: 78006389034.25.53660B9 Received: from mx1.molgen.mpg.de (mx3.molgen.mpg.de [141.14.17.11]) by imf03.hostedemail.com (Postfix) with ESMTP id F0DBEC0007D4 for ; Wed, 7 Apr 2021 18:21:33 +0000 (UTC) Received: from [192.168.0.2] (ip5f5ae880.dynamic.kabel-deutschland.de [95.90.232.128]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) (Authenticated sender: pmenzel) by mx.molgen.mpg.de (Postfix) with ESMTPSA id 03491206473D0; Wed, 7 Apr 2021 20:21:34 +0200 (CEST) To: Hugh Dickins Cc: linux-mm@kvack.org, linux-raid@vger.kernel.org From: Paul Menzel Subject: SHM: blk_update_request: I/O error, dev loop5, sector 1001648 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 0 Message-ID: <2fb258a5-30d6-472c-364f-e190346e40d3@molgen.mpg.de> Date: Wed, 7 Apr 2021 20:21:33 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.9.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US X-Stat-Signature: q1ur3uhz166d8xay8p4abze45qshmzjk X-Rspamd-Server: rspam04 X-Rspamd-Queue-Id: F0DBEC0007D4 Received-SPF: none (molgen.mpg.de>: No applicable sender policy available) receiver=imf03; identity=mailfrom; envelope-from=""; helo=mx1.molgen.mpg.de; client-ip=141.14.17.11 X-HE-DKIM-Result: none/none X-HE-Tag: 1617819693-993100 Content-Transfer-Encoding: quoted-printable X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Dear Linux folks, Probably, I am overlooking something, but testing a RAID6 setup with=20 loop-mounted fails on 16 GB RAM system (AMD and Intel), results in the=20 errors below. This happens with Linux 4.19.57 and 5.10.24 for example. $ cd /dev/shm $ for i in $(seq 1 16); do truncate -s 512M vdisk$i.img; done [=E2=80=A6] $ sudo mdadm --create /dev/md1 --level=3D6 --raid-devices=3D16=20 /dev/loop{0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15} $ dmesg [=E2=80=A6] [879198.509123] md/raid:md1: not clean -- starting background reconstruct= ion [879198.515895] md/raid:md1: device loop15 operational as raid disk 15 [879198.522115] md/raid:md1: device loop14 operational as raid disk 14 [879198.528323] md/raid:md1: device loop13 operational as raid disk 13 [879198.534525] md/raid:md1: device loop12 operational as raid disk 12 [879198.540724] md/raid:md1: device loop11 operational as raid disk 11 [879198.546924] md/raid:md1: device loop10 operational as raid disk 10 [879198.553126] md/raid:md1: device loop9 operational as raid disk 9 [879198.559155] md/raid:md1: device loop8 operational as raid disk 8 [879198.565185] md/raid:md1: device loop7 operational as raid disk 7 [879198.571212] md/raid:md1: device loop6 operational as raid disk 6 [879198.577238] md/raid:md1: device loop5 operational as raid disk 5 [879198.583269] md/raid:md1: device loop4 operational as raid disk 4 [879198.589296] md/raid:md1: device loop3 operational as raid disk 3 [879198.595324] md/raid:md1: device loop2 operational as raid disk 2 [879198.601353] md/raid:md1: device loop1 operational as raid disk 1 [879198.607381] md/raid:md1: device loop0 operational as raid disk 0 [879198.613971] md/raid:md1: raid level 6 active with 16 out of 16=20 devices, algorithm 2 [879198.621667] md1: detected capacity change from 0 to 7486832640 [879198.627643] md: resync of RAID array md1 [879203.512870] blk_update_request: I/O error, dev loop5, sector 1001648=20 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 0 [879203.512872] blk_update_request: I/O error, dev loop6, sector 1001648=20 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 0 [879203.512874] blk_update_request: I/O error, dev loop7, sector 1001648=20 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 0 [879203.512878] blk_update_request: I/O error, dev loop8, sector 1001656=20 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 0 [879203.512880] blk_update_request: I/O error, dev loop9, sector 1001656=20 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 0 [879203.512882] blk_update_request: I/O error, dev loop10, sector=20 1001656 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 0 [879203.512884] blk_update_request: I/O error, dev loop11, sector=20 1001656 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 0 [879203.512885] blk_update_request: I/O error, dev loop12, sector=20 1001656 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 0 [879203.512886] blk_update_request: I/O error, dev loop13, sector=20 1001656 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 0 [879203.512887] blk_update_request: I/O error, dev loop15, sector=20 1001656 op 0x0:(READ) flags 0x0 phys_seg 1 prio class 0 [879203.526116] md/raid:md1: 558 read_errors > 557 stripes [879203.526117] md/raid:md1: 558 read_errors > 557 stripes [879203.526118] md/raid:md1: 558 read_errors > 557 stripes [879203.526118] md/raid:md1: Too many read errors, failing device loop6. [879203.526118] md/raid:md1: Too many read errors, failing device loop7. [879203.526119] md/raid:md1: Disk failure on loop6, disabling device. md/raid:md1: Operation continuing on 15 devices. [879203.526120] md/raid:md1: Disk failure on loop7, disabling device. md/raid:md1: Operation continuing on 14 devices. [879203.526127] md/raid:md1: read error not correctable (sector 1002288=20 on loop9). [879203.526128] md/raid:md1: read error not correctable (sector 1002288=20 on loop10). [879203.526129] md/raid:md1: read error not correctable (sector 1002288=20 on loop8). [879203.526130] md/raid:md1: read error not correctable (sector 1002288=20 on loop11). [879203.526131] md/raid:md1: read error not correctable (sector 1002288=20 on loop12). [879203.526134] md/raid:md1: read error not correctable (sector 1002288=20 on loop15). [879203.526136] md/raid:md1: read error not correctable (sector 1002280=20 on loop2). [879203.526137] md/raid:md1: read error not correctable (sector 1002280=20 on loop0). [879203.526138] md/raid:md1: read error not correctable (sector 1002288=20 on loop2). [879203.526139] md/raid:md1: read error not correctable (sector 1002288=20 on loop4). [879203.528980] md: md1: resync interrupted. [879203.746692] md/raid:md1: Too many read errors, failing device loop5. [879203.765274] md: resync of RAID array md1 [879203.769254] md: md1: resync done. [879220.534393] md1: detected capacity change from 7486832640 to 0 [879220.540270] md: md1 stopped. $ sudo mdadm -S /dev/md1 && sudo losetup -D && rm vdisk* ``` Kind regards, Paul