linux-ext4.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: bugzilla-daemon@kernel.org
To: linux-ext4@vger.kernel.org
Subject: [Bug 217965] ext4(?) regression since 6.5.0 on sata hdd
Date: Tue, 14 Nov 2023 08:22:03 +0000	[thread overview]
Message-ID: <bug-217965-13602-Nv8wItrWv8@https.bugzilla.kernel.org/> (raw)
In-Reply-To: <bug-217965-13602@https.bugzilla.kernel.org/>

https://bugzilla.kernel.org/show_bug.cgi?id=217965

--- Comment #22 from Eyal Lebedinsky (bugzilla@eyal.emu.id.au) ---
I now ran a test on 6.4.15. I copied a segment of the tree I have issues with.
    7.2GB in 77,972 files.

It took just over 9 minutes to sync the drain the dirty cache, and the array
run like this
(I am watching the kB_wrtn/s column):

         Device             tps    kB_read/s    kB_wrtn/s    kB_dscd/s   
kB_read    kB_wrtn    kB_dscd
18:15:01 md127           423.00         4.00      7001.20         0.00        
40      70012          0
18:15:11 md127           112.30        14.80      9689.60         0.00       
148      96896          0
18:15:21 md127            28.70         3.60       964.80         0.00        
36       9648          0
18:15:31 md127           321.90         4.00      1340.40         0.00        
40      13404          0
18:15:41 md127            18.20         0.00       123.20         0.00         
0       1232          0
18:15:51 md127            26.80        10.00      2062.00         0.00       
100      20620          0
18:16:01 md127             2.60         0.00        56.40         0.00         
0        564          0
18:16:11 md127             2.80         0.00        82.40         0.00         
0        824          0
18:16:21 md127             6.10         0.00       150.80         0.00         
0       1508          0
18:16:31 md127            86.00        16.80      4978.00         0.00       
168      49780          0
18:16:41 md127            48.90        10.80      4505.60         0.00       
108      45056          0
18:16:51 md127            36.10         6.80      1498.00         0.00        
68      14980          0
18:17:01 md127             3.20         0.40        64.40         0.00         
4        644          0
18:17:11 md127             3.40         0.80        84.80         0.00         
8        848          0
18:17:21 md127             3.70         0.80       283.60         0.00         
8       2836          0
18:17:31 md127            32.90         6.00      1950.00         0.00        
60      19500          0
18:17:41 md127           907.50        24.00     15638.40         0.00       
240     156384          0
18:17:51 md127           698.00         9.60     10476.40         0.00        
96     104764          0
18:18:01 md127           146.80         0.40      4796.00         0.00         
4      47960          0
18:18:11 md127           163.00         0.80      1328.80         0.00         
8      13288          0
18:18:21 md127           149.50         1.20      1140.00         0.00        
12      11400          0
18:18:31 md127            46.50         1.60       545.20         0.00        
16       5452          0
18:18:41 md127           335.90        14.40      9770.00         0.00       
144      97700          0
18:18:51 md127           119.90         4.40      3868.80         0.00        
44      38688          0
18:19:01 md127           315.70        25.60     11422.80         0.00       
256     114228          0
18:19:11 md127           285.80         1.20      4142.40         0.00        
12      41424          0
18:19:21 md127           239.00         4.40      3888.00         0.00        
44      38880          0
18:19:31 md127           116.30         1.20      1752.80         0.00        
12      17528          0
18:19:41 md127           166.60         8.00      8886.00         0.00        
80      88860          0
18:19:51 md127           357.20         5.60      6146.80         0.00        
56      61468          0
18:20:01 md127           118.10         1.20      1670.40         0.00        
12      16704          0
18:20:11 md127            66.00         6.40       802.80         0.00        
64       8028          0
18:20:21 md127           139.40         4.40      1641.20         0.00        
44      16412          0
18:20:31 md127            44.40         2.40       632.40         0.00        
24       6324          0
18:20:41 md127           183.50        13.60      4048.40         0.00       
136      40484          0
18:20:51 md127           114.40        28.40      8346.40         0.00       
284      83464          0
18:21:01 md127           152.20        27.20     15576.00         0.00       
272     155760          0
18:21:11 md127            75.30         1.60      1146.40         0.00        
16      11464          0
18:21:21 md127           236.20        18.40     13491.20         0.00       
184     134912          0
18:21:31 md127           226.70         3.60      3237.60         0.00        
36      32376          0
18:21:41 md127           152.70         4.00      2048.00         0.00        
40      20480          0
18:21:51 md127            92.10         7.60      1907.20         0.00        
76      19072          0
18:22:01 md127           142.50         8.00      1921.60         0.00        
80      19216          0
18:22:11 md127           137.30         5.60      2307.60         0.00        
56      23076          0
18:22:21 md127           124.10         6.00      1511.20         0.00        
60      15112          0
18:22:31 md127           105.90         4.00      1888.80         0.00        
40      18888          0
18:22:41 md127           166.30         2.00      2073.20         0.00        
20      20732          0
18:22:51 md127           649.90         6.80     10615.20         0.00        
68     106152          0
18:23:01 md127          1253.70         8.80    175698.40         0.00        
88    1756984          0
18:23:11 md127            88.40         2.00     66840.40         0.00        
20     668404          0
18:23:21 md127             0.00         0.00         0.00         0.00         
0          0          0

Is writing at a few MB/s reasonable for an array with disks that can top
200MB/s?
Note the burst at the end when a significant chunk of the data was written out.

Now running on 6.5.10 I see a very different story:

         Device             tps    kB_read/s    kB_wrtn/s    kB_dscd/s   
kB_read    kB_wrtn    kB_dscd
18:45:53 md127             2.60         0.00        10.40         0.00         
0        104          0
18:46:03 md127             5.40         0.00        21.60         0.00         
0        216          0
18:46:13 md127             5.40         0.00        21.60         0.00         
0        216          0
18:46:23 md127             5.30         0.00        21.60         0.00         
0        216          0
18:46:33 md127             5.20         0.00        20.80         0.00         
0        208          0
18:46:43 md127             5.30         0.00        23.60         0.00         
0        236          0
18:46:53 md127             5.10         0.00        44.00         0.00         
0        440          0
18:47:03 md127             2.70         0.00        21.60         0.00         
0        216          0
18:47:13 md127             5.30         0.00        26.80         0.00         
0        268          0
18:47:23 md127             5.40         0.00        25.20         0.00         
0        252          0
18:47:33 md127             5.20         0.00        21.60         0.00         
0        216          0
18:47:43 md127             5.30         0.00        21.20         0.00         
0        212          0
18:47:53 md127             5.30         0.00        22.40         0.00         
0        224          0
18:48:03 md127             5.40         0.00        24.00         0.00         
0        240          0
18:48:13 md127             2.60         0.00        11.20         0.00         
0        112          0
18:48:23 md127             5.30         0.00        22.40         0.00         
0        224          0
18:48:33 md127             5.30         0.00        23.20         0.00         
0        232          0
18:48:43 md127             5.20         0.00        24.40         0.00         
0        244          0
18:48:53 md127             5.30         0.00        22.00         0.00         
0        220          0
18:49:03 md127             6.20         3.60        23.20         0.00        
36        232          0
18:49:13 md127             3.40         0.00        20.80         0.00         
0        208          0
18:49:23 md127             5.20         0.00        20.80         0.00         
0        208          0
18:49:33 md127             5.30         0.00        22.00         0.00         
0        220          0
18:49:43 md127             5.30         0.00        21.60         0.00         
0        216          0
18:49:53 md127             5.20         0.00        33.20         0.00         
0        332          0

I expect this to take much longer to complete, possibly hours (20% drained in
the last 30m).

In both cases the flusher thread was running at 100%CPU.

I do have the full logs though.

HTH

-- 
You may reply to this email to add a comment.

You are receiving this mail because:
You are watching the assignee of the bug.

  parent reply	other threads:[~2023-11-14  8:22 UTC|newest]

Thread overview: 75+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2023-10-02  8:10 [Bug 217965] New: ext4(?) regression since 6.5.0 on sata hdd bugzilla-daemon
2023-10-02  8:52 ` [Bug 217965] " bugzilla-daemon
2023-10-02  8:56 ` bugzilla-daemon
2023-10-02  8:57 ` bugzilla-daemon
2023-10-02 15:22 ` bugzilla-daemon
2023-10-02 15:55 ` bugzilla-daemon
2023-10-03  6:50 ` bugzilla-daemon
2023-10-03  6:57 ` bugzilla-daemon
2023-10-03 11:04 ` bugzilla-daemon
2023-10-03 13:42 ` bugzilla-daemon
2023-10-03 14:23 ` bugzilla-daemon
2023-10-04 12:44 ` bugzilla-daemon
2023-10-04 17:23 ` bugzilla-daemon
2023-10-11  7:53 ` bugzilla-daemon
2023-10-11 16:07 ` bugzilla-daemon
2023-10-11 22:23 ` bugzilla-daemon
2023-10-17 10:45 ` bugzilla-daemon
2023-10-17 10:52 ` bugzilla-daemon
2023-10-20 10:24 ` bugzilla-daemon
2023-10-21 10:07 ` bugzilla-daemon
2023-11-13 22:46 ` bugzilla-daemon
2023-11-14  5:55 ` bugzilla-daemon
2023-11-14  6:47 ` bugzilla-daemon
2023-11-14  8:22 ` bugzilla-daemon [this message]
2023-11-14 10:29 ` bugzilla-daemon
2023-11-15  4:06 ` bugzilla-daemon
2023-11-15 17:27 ` bugzilla-daemon
2023-11-15 22:39 ` bugzilla-daemon
2023-11-16  3:15 ` bugzilla-daemon
2023-11-16  4:05 ` bugzilla-daemon
2023-11-16  4:31 ` bugzilla-daemon
2023-11-16  4:33 ` bugzilla-daemon
2023-11-16 19:33 ` bugzilla-daemon
2023-11-17  0:01 ` bugzilla-daemon
2023-11-17  0:44 ` bugzilla-daemon
2023-11-17  1:39 ` bugzilla-daemon
2023-11-17  1:40 ` bugzilla-daemon
2023-11-17 15:39 ` bugzilla-daemon
2023-11-17 23:52 ` bugzilla-daemon
2023-11-17 23:53 ` bugzilla-daemon
2023-11-17 23:57 ` bugzilla-daemon
2023-11-18 12:10 ` bugzilla-daemon
2023-11-18 13:17 ` bugzilla-daemon
2023-11-20  6:11 ` bugzilla-daemon
2023-11-20  8:48 ` bugzilla-daemon
2023-11-27 17:31 ` bugzilla-daemon
2023-12-03  7:33 ` bugzilla-daemon
2023-12-15 11:27 ` bugzilla-daemon
2023-12-23  0:56 ` bugzilla-daemon
2023-12-23  1:48 ` bugzilla-daemon
2023-12-23 12:46 ` bugzilla-daemon
2023-12-23 14:22 ` bugzilla-daemon
2023-12-23 15:47 ` bugzilla-daemon
2023-12-29 20:35 ` bugzilla-daemon
2023-12-29 20:51 ` bugzilla-daemon
2023-12-29 21:05 ` bugzilla-daemon
2023-12-29 22:11 ` bugzilla-daemon
2023-12-29 22:13 ` bugzilla-daemon
2023-12-29 23:07 ` bugzilla-daemon
2023-12-29 23:22 ` bugzilla-daemon
2024-01-02  4:44 ` bugzilla-daemon
2024-01-02  6:44 ` bugzilla-daemon
2024-01-04  5:38 ` bugzilla-daemon
2024-01-04 22:20 ` bugzilla-daemon
2024-01-06  2:11 ` bugzilla-daemon
2024-01-06  3:18 ` bugzilla-daemon
2024-01-07  2:56 ` bugzilla-daemon
2024-02-07 11:44 ` bugzilla-daemon
2024-03-12 20:27 ` bugzilla-daemon
2024-03-17 11:58 ` bugzilla-daemon
2024-03-18  4:45 ` bugzilla-daemon
2024-03-20  6:46 ` bugzilla-daemon
2024-03-23  8:53 ` bugzilla-daemon
2025-08-18 13:48 ` bugzilla-daemon
2025-08-27 17:07 ` bugzilla-daemon

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=bug-217965-13602-Nv8wItrWv8@https.bugzilla.kernel.org/ \
    --to=bugzilla-daemon@kernel.org \
    --cc=linux-ext4@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).