All of lore.kernel.org
 help / color / mirror / Atom feed
From: bugzilla-daemon@bugzilla.kernel.org
To: linux-ext4@vger.kernel.org
Subject: [Bug 78651] Write performance of ext4 degrades linearly as volume fills
Date: Sat, 05 Jul 2014 17:14:07 +0000	[thread overview]
Message-ID: <bug-78651-13602-lhLQ8A0Chv@https.bugzilla.kernel.org/> (raw)
In-Reply-To: <bug-78651-13602@https.bugzilla.kernel.org/>

https://bugzilla.kernel.org/show_bug.cgi?id=78651

--- Comment #3 from Joseph D. Wagner <joe@josephdwagner.info> ---
To try to isolate the cause, I reformatted for EXT4 without a journal.  It took
4:57:08, which is 1:30:21 faster than journal=writeback.  The performance is
also in line with XFS -- solid performance until about 60%, then a slow loss.

I think it's reasonable to conclude that the problem is either 1) in the
journal, or 2) exasperated by the journal.  Full details below.

Joseph D. Wagner

####
#### Exhibit D
####
#### EXT4 without a journal
####
#  su -c 'cd /root; nice ionice -c3 /usr/local/bin/lvbackup /dev/data/home
/mnt/backup'
Password: 
  DUMP: mount: bad UUID
  DUMP: Date of this level 0 dump: Fri Jul  4 20:56:18 2014
  DUMP: Dumping /dev/data/backup-data-home (an unlisted file system) to
/mnt/backup/backup-data-home-20140704.205617-0.img
  DUMP: Label: none
  DUMP: Writing 64 Kilobyte records
  DUMP: mapping (Pass I) [regular files]
  DUMP: mapping (Pass II) [directories]
  DUMP: estimated 1683858285 blocks.
  DUMP: writing QFA positions to
/mnt/backup/backup-data-home-20140704.205617-0.qfa
  DUMP: Volume 1 started with block 1 at: Fri Jul  4 20:56:34 2014
  DUMP: dumping (Pass III) [directories]
  DUMP: dumping (Pass IV) [regular files]
  DUMP: 2.07% done at 115916 kB/s, finished in 3:57
  DUMP: 4.06% done at 113802 kB/s, finished in 3:56
  DUMP: 6.16% done at 115264 kB/s, finished in 3:48
  DUMP: 8.22% done at 115393 kB/s, finished in 3:43
  DUMP: 10.22% done at 114721 kB/s, finished in 3:39
  DUMP: 12.24% done at 114460 kB/s, finished in 3:35
  DUMP: 14.13% done at 113336 kB/s, finished in 3:32
  DUMP: 16.08% done at 112677 kB/s, finished in 3:29
  DUMP: 18.06% done at 112519 kB/s, finished in 3:24
  DUMP: 19.92% done at 111700 kB/s, finished in 3:21
  DUMP: 21.74% done at 110805 kB/s, finished in 3:18
  DUMP: 23.41% done at 109263 kB/s, finished in 3:16
  DUMP: 25.23% done at 108728 kB/s, finished in 3:12
  DUMP: 26.88% done at 107565 kB/s, finished in 3:10
  DUMP: 28.76% done at 107411 kB/s, finished in 3:06
  DUMP: 30.24% done at 105899 kB/s, finished in 3:04
  DUMP: 31.88% done at 105088 kB/s, finished in 3:01
  DUMP: 33.34% done at 103814 kB/s, finished in 3:00
  DUMP: 34.70% done at 102363 kB/s, finished in 2:59
  DUMP: 36.17% done at 101378 kB/s, finished in 2:56
  DUMP: 37.71% done at 100673 kB/s, finished in 2:53
  DUMP: 39.44% done at 100494 kB/s, finished in 2:49
  DUMP: 41.38% done at 100855 kB/s, finished in 2:43
  DUMP: 43.05% done at 100558 kB/s, finished in 2:38
  DUMP: 44.90% done at 100692 kB/s, finished in 2:33
  DUMP: 46.76% done at 100787 kB/s, finished in 2:28
  DUMP: 48.71% done at 101101 kB/s, finished in 2:22
  DUMP: 50.25% done at 100583 kB/s, finished in 2:18
  DUMP: 51.99% done at 100462 kB/s, finished in 2:14
  DUMP: 53.77% done at 100449 kB/s, finished in 2:09
  DUMP: 55.59% done at 100497 kB/s, finished in 2:04
  DUMP: 57.36% done at 100404 kB/s, finished in 1:59
  DUMP: 59.07% done at 100261 kB/s, finished in 1:54
  DUMP: 60.89% done at 100320 kB/s, finished in 1:49
  DUMP: 62.66% done at 100288 kB/s, finished in 1:44
  DUMP: 64.16% done at 99842 kB/s, finished in 1:40
  DUMP: 65.73% done at 99529 kB/s, finished in 1:36
  DUMP: 67.26% done at 99174 kB/s, finished in 1:32
  DUMP: 68.50% done at 98419 kB/s, finished in 1:29
  DUMP: 70.10% done at 98196 kB/s, finished in 1:25
  DUMP: 71.73% done at 97990 kB/s, finished in 1:20
  DUMP: 73.28% done at 97734 kB/s, finished in 1:16
  DUMP: 74.80% done at 97447 kB/s, finished in 1:12
  DUMP: 76.43% done at 97252 kB/s, finished in 1:08
  DUMP: 77.87% done at 96884 kB/s, finished in 1:04
  DUMP: 79.49% done at 96739 kB/s, finished in 0:59
  DUMP: 81.09% done at 96596 kB/s, finished in 0:54
  DUMP: 82.91% done at 96708 kB/s, finished in 0:49
  DUMP: 84.45% done at 96502 kB/s, finished in 0:45
  DUMP: 85.60% done at 95864 kB/s, finished in 0:42
  DUMP: 87.12% done at 95659 kB/s, finished in 0:37
  DUMP: 88.67% done at 95490 kB/s, finished in 0:33
  DUMP: 90.15% done at 95260 kB/s, finished in 0:29
  DUMP: 91.97% done at 95387 kB/s, finished in 0:23
  DUMP: 93.62% done at 95328 kB/s, finished in 0:18
  DUMP: 95.20% done at 95216 kB/s, finished in 0:14
  DUMP: 96.63% done at 94950 kB/s, finished in 0:09
  DUMP: 98.19% done at 94824 kB/s, finished in 0:05
  DUMP: 99.64% done at 94595 kB/s, finished in 0:01
  DUMP: Closing /mnt/backup/backup-data-home-20140704.205617-0.img
  DUMP: Volume 1 completed at: Sat Jul  5 01:53:42 2014
  DUMP: Volume 1 1683896576 blocks (1644430.25MB)
  DUMP: Volume 1 took 4:57:08
  DUMP: Volume 1 transfer rate: 94452 kB/s
  DUMP: 1683896576 blocks (1644430.25MB) on 1 volume(s)
  DUMP: finished in 17810 seconds, throughput 94547 kBytes/sec
  DUMP: Date of this level 0 dump: Fri Jul  4 20:56:18 2014
  DUMP: Date this dump completed:  Sat Jul  5 01:53:42 2014
  DUMP: Average transfer rate: 94452 kB/s
  DUMP: Archiving dump to /mnt/backup/backup-data-home-20140704.205617-0.toc
  DUMP: DUMP IS DONE
  Logical volume "backup-data-home" successfully removed

-- 
You are receiving this mail because:
You are watching the assignee of the bug.

  parent reply	other threads:[~2014-07-05 17:14 UTC|newest]

Thread overview: 17+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2014-06-22  5:44 [Bug 78651] New: Write performance of ext4 degrades linearly as volume fills bugzilla-daemon
2014-06-22  5:45 ` [Bug 78651] " bugzilla-daemon
2014-06-22 23:18 ` bugzilla-daemon
2014-07-05 17:14 ` bugzilla-daemon [this message]
2014-07-06 12:52 ` bugzilla-daemon
2014-07-06 17:57 ` bugzilla-daemon
2014-07-07  6:00 ` bugzilla-daemon
2014-07-07  6:53 ` bugzilla-daemon
2014-07-07 12:29 ` bugzilla-daemon
2014-07-08 13:42 ` bugzilla-daemon
2014-07-08 13:42 ` bugzilla-daemon
2014-07-08 13:43 ` bugzilla-daemon
2014-07-08 13:43 ` bugzilla-daemon
2014-07-08 13:43 ` bugzilla-daemon
2014-07-08 14:23 ` bugzilla-daemon
2014-07-09  3:27 ` bugzilla-daemon
2014-07-09  3:30 ` bugzilla-daemon

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=bug-78651-13602-lhLQ8A0Chv@https.bugzilla.kernel.org/ \
    --to=bugzilla-daemon@bugzilla.kernel.org \
    --cc=linux-ext4@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.