From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id 45661C4332F for ; Thu, 2 Nov 2023 13:03:47 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229770AbjKBNDs (ORCPT ); Thu, 2 Nov 2023 09:03:48 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:40502 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229607AbjKBNDr (ORCPT ); Thu, 2 Nov 2023 09:03:47 -0400 X-Greylist: delayed 1018 seconds by postgrey-1.37 at lindbergh.monkeyblade.net; Thu, 02 Nov 2023 06:03:44 PDT Received: from mail.thelounge.net (mail.thelounge.net [91.118.73.15]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 7A197BD for ; Thu, 2 Nov 2023 06:03:44 -0700 (PDT) Received: from [10.10.10.2] (rh.vpn.thelounge.net [10.10.10.2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256) (No client certificate requested) (Authenticated sender: h.reindl@thelounge.net) by mail.thelounge.net (THELOUNGE MTA) with ESMTPSA id 4SLkCN4P0ZzXRZ for ; Thu, 2 Nov 2023 13:46:35 +0100 (CET) Message-ID: Date: Thu, 2 Nov 2023 13:46:35 +0100 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: problem with recovered array Content-Language: en-US References: <87273fc6-9531-4072-ae6c-06306e9a269d@eyal.emu.id.au> <577244fc-f43a-4e1f-bf34-d1c194fd90b4@eyal.emu.id.au> <0dc5a117-97be-4ed1-9976-1f754a6abf91@eyal.emu.id.au> <37b6265a-b925-4910-b092-59177b639ca9@eyal.emu.id.au> <22339749-c498-459e-9dbe-c12859be0580@eyal.emu.id.au> From: Reindl Harald Autocrypt: addr=h.reindl@thelounge.net; keydata= xsDNBFq9ahEBDADEQKxJxY4WUy7Ukg6JbzwAUI+VQYpnRuFKLIvcU+2x8zzf8cLaPUiNhJKN 3fD8fhCc2+nEcSVwLDMoVZfsg3BKM/uE/d2XNb3K4s13g3ggSYW9PCeOrbcRwuIvK5gsUqbj vXSAOcrR7gz/zD6wTYSNnaj+VO4gsoeCzBkjy9RQlHBfW+bkW3coDCK7DocqmSRTNRYrkZNR P1HJBUvK3YOSawbeEa8+l7EbHiW+sdlc79qi8dkHavn/OqiNJQErQQaS9FGR7pA5SvMvG5Wq 22I8Ny00RPhUOMbcNTOIGUY/ZP8KPm5mPfa9TxrJXavpGL2S1DE/q5t4iJb4GfsEMVCNCw9E 6TaW7x6t1885YF/IZITaOzrROfxapsi/as+aXrJDuUq09yBCimg19mXurnjiYlJmI6B0x7S9 wjCGP+aZqhqW9ghirM82U/CVeBQx7afi29y6bogjl6eBP7Z3ZNmwRBC3H23FcoloJMXokUm3 p2DiTcs2XViKlks6Co/TqFEAEQEAAc0mUmVpbmRsIEhhcmFsZCA8aC5yZWluZGxAdGhlbG91 bmdlLm5ldD7CwREEEwEIADsCGyMFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AWIQSdK0bNvBQK NnU65NczF01aWJK3uAUCWr1qowIZAQAKCRAzF01aWJK3uEznDACGncwi0KfKOltOBmzIQNIn 7kPOBFU8KGIjONpg/5r82zwDEpFOTKw+hCttokV6+9K+j8Iut0u9o7iSQNA70cXqkaqPndxB uRIi/L6nm2ZlUMvQj9QD5U+mdTtSQH5WrC5lo2RYT2sTWoAFQ6CSnxxJd9Ud7rjbDy7GRnwv IRMfFJZtTf6HAKj8dZecwnBaHqgZQgRAhdsUtH8ejDsWlfxW1Qp3+Vq008OE3XXOFQX5qXWK MESOnTtGMq1mU/Pesmyp0+z58l6HyUmcoWruyAmjX7yGQPOT5APg2LFpMHA6LIu40mbb/pfg 5am8LWLBXQRCP1D/XLOuQ5DO6mWY0rtQ8ztZ5Wihi5qA9QKcJxmZcdmurlaxi3mavR3VgCIc 3hDPcvUqBwB5boNZspowYoHQ21g9qyFHOyeS69SNYhsHPCTr6+mSyn+p4ou4JTKiDRR16q5X hHfXO9Ao9zvVVhuw+P4YySmTRRlgJtcneniH8CBbr9PsjzhVcX2RkOCC+ObOwM0EWr1qEQEM ANIkbSUr1zk5kE8aXQgt4NFRfkngeDLrvxEgaiTZp93oSkd7mYDVBE3bA4g4tng2WPQL+vnb 371eaROa+C7/6CNYJorBx79l+J5qZGXiW56btJEIER0R5yuxIZ9CH+qyO1X47z8chbHHuWrZ bTyq4eDrF7dTnEKIHFH9wF15yfKuiSuUg4I2Gdk9eg4vv9Eyy/RypBPDrjoQmfsKJjKN81Hy AP6hP9hXL4Wd68VBFBpFCb+5diP+CKo+3xSZr4YUNr3AKFt/19j2jJ8LWqt0Gyf87rUIzAN8 TgLKITW8kH8J1hiy/ofOyMH1AgBJNky1YHPZU3z1FWgqeTCwlCiPd6cQfuTXrIFP1dHciLpj 8haE7f2d4mIHPEFcUXTL0R6J1G++7/EDxDArUJ9oUYygVLQ0/LnCPWMwh7xst8ER994l9li3 PA9k9zZ3OYmcmB7iqIB+R7Z8gLbqjS+JMeyqKuWzU5tvV9H3LbOw86r2IRJp3J7XxaXigJJY 7HoOBA8NwQARAQABwsD2BBgBCAAgFiEEnStGzbwUCjZ1OuTXMxdNWliSt7gFAlq9ahECGwwA CgkQMxdNWliSt7hVMwwAmzm7mHYGuChRV3hbI3fjzH+S6+QtiAH0uPrApvTozu8u72pcuvJW J4qyK5V/0gsFS8pwdC9dfF8FGMDbHprs6wK0rMqaDawAL8xWKvmyi6ZLsjVScA6aM307CEVr v5FJiibO+te+FkzaO9+axEjloSQ9DbJHbE3Sh7tLhpBmDQVBCzfSV7zQtsy9L3mDKJf7rW+z hqO9JA885DHHsVPPhA9mNgfRvzQJn/3fFFzqmRVf7mgBV8Wn8aepEUGAd2HzVAb3f1+TS04P +RI8qKoqeVdZlbwJD59XUDJrnetQrBEfhEd8naW8mHyEWHVJZnSTUIfPz2sneW1Zu2XkfqwV eW+IyDAcYyTXqnEGdFSEgwgzliPJDWm5CHbsU++7Kzar5d5flRgGbtcxqkpl8j0N0BUlN4fA cTqn2HJNlhMSV0ZocQ0888Zaq2S5totXr7yuiDzwrp70m9bJY+VPDjaUtWruf2Yiez3EAhtU K4rYsjPimkSIVdrNM//wVKdCTbO+ Organization: the lounge interactive design To: linux-raid@vger.kernel.org In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: linux-raid@vger.kernel.org Am 02.11.23 um 13:29 schrieb eyal@eyal.emu.id.au: > See update further down. > > Interestingly, after about 1.5 hours, when there were 1GB of dirty > blocks, the whole lot was cleared fast: > > 2023-11-02 23:08:49 Dirty:           1018924 kB > 2023-11-02 23:08:59 Dirty:           1018640 kB > 2023-11-02 23:09:09 Dirty:           1018732 kB > 2023-11-02 23:09:19 Dirty:            592196 kB > 2023-11-02 23:09:29 Dirty:              1188 kB > 2023-11-02 23:09:39 Dirty:               944 kB > 2023-11-02 23:09:49 Dirty:               804 kB > 2023-11-02 23:09:59 Dirty:                60 kB > > And iostat saw it too: >          Device             tps    kB_read/s    kB_wrtn/s > kB_dscd/s    kB_read    kB_wrtn    kB_dscd > 23:09:12 md127             2.80         0.00        40.40 > 0.00          0        404          0 > 23:09:22 md127          1372.33         0.80     47026.17 > 0.00          8     470732          0 > 23:09:32 md127            75.80         0.80     54763.20 > 0.00          8     547632          0 > 23:09:42 md127             0.00         0.00         0.00 > 0.00          0          0          0 it's pretty easy: RAID6 behaves terrible in degraded state especially *with rotating disks* and for the sake of god as long it is degraded and not fully rebuilt you should avoid any load which isn't strictly necessary the chance that another disk dies is increasing especially in the rebuild-phase and then start to pray becuase the next unrecoverable read error will kill the array a RAID10 couldn't care less at that point because it don't need to seek like crazy on the drives --------- what i don't understand is why people don't have replacement disks in the shelf for every array they operate, replace the drive and leave it in peace until the rebuild is finished i am responsible for 7 machines at 5 locations with mdadm RAID of different sizes and there is a replacement disk for each of them - if a disk dies or smartd complains it's replaced and the next drive will be ordered