From: Thomas Lynema <lyz27@yahoo.com>
To: Dave Chinner <david@fromorbit.com>
Cc: xfs@oss.sgi.com
Subject: Re: Poor performance using discard
Date: Fri, 02 Mar 2012 09:57:00 -0500 [thread overview]
Message-ID: <1330700220.6438.31.camel@core24> (raw)
In-Reply-To: <1330658311.6438.24.camel@core24>
[-- Attachment #1.1.1: Type: text/plain, Size: 11148 bytes --]
> > Also, I think you need to provide a block trace (output of
> > blktrace/blkparse for the rm -rf workloads) for both the XFS and
> > ext4 cases so we can see what discards are actually being issued and
> > how long they take to complete....
>
Partial xfs results attached this was the overall summary with xfs.
The summary looks like this.
CPU0 (xfs.trace):
Reads Queued: 1,274, 9,216KiB Writes Queued: 9,981,
156,710KiB
Read Dispatches: 1,738, 8,656KiB Write Dispatches: 9,855,
157,818KiB
Reads Requeued: 495 Writes Requeued: 72
Reads Completed: 1,844, 12,916KiB Writes Completed: 15,486,
8,360KiB
Read Merges: 0, 0KiB Write Merges: 42,
364KiB
Read depth: 10 Write depth: 11
IO unplugs: 95 Timer unplugs: 3
CPU1 (xfs.trace):
Reads Queued: 153, 1,372KiB Writes Queued: 14,521,
183,608KiB
Read Dispatches: 235, 2,348KiB Write Dispatches: 15,246,
183,627KiB
Reads Requeued: 24 Writes Requeued: 748
Reads Completed: 197, 1,868KiB Writes Completed: 14,885,
11,825KiB
Read Merges: 0, 0KiB Write Merges: 19,
60KiB
Read depth: 10 Write depth: 11
IO unplugs: 39 Timer unplugs: 7
CPU2 (xfs.trace):
Reads Queued: 1,156, 7,520KiB Writes Queued: 10,873,
160,987KiB
Read Dispatches: 1,586, 7,416KiB Write Dispatches: 10,724,
160,687KiB
Reads Requeued: 446 Writes Requeued: 69
Reads Completed: 586, 3,820KiB Writes Completed: 5,310,
4,103KiB
Read Merges: 0, 0KiB Write Merges: 57,
664KiB
Read depth: 10 Write depth: 11
IO unplugs: 54 Timer unplugs: 8
CPU3 (xfs.trace):
Reads Queued: 126, 1,436KiB Writes Queued: 5,197,
47,004KiB
Read Dispatches: 135, 1,124KiB Write Dispatches: 5,388,
46,187KiB
Reads Requeued: 20 Writes Requeued: 333
Reads Completed: 82, 940KiB Writes Completed: 5,037,
1,551KiB
Read Merges: 0, 0KiB Write Merges: 91,
708KiB
Read depth: 10 Write depth: 11
IO unplugs: 50 Timer unplugs: 8
Total (xfs.trace):
Reads Queued: 2,709, 19,544KiB Writes Queued: 40,572,
548,309KiB
Read Dispatches: 3,694, 19,544KiB Write Dispatches: 41,213,
548,319KiB
Reads Requeued: 985 Writes Requeued: 1,222
Reads Completed: 2,709, 19,544KiB Writes Completed: 40,718,
25,839KiB
Read Merges: 0, 0KiB Write Merges: 209,
1,796KiB
IO unplugs: 238 Timer unplugs: 26
Throughput (R/W): 45KiB/s / 60KiB/s
Events (xfs.trace): 309,109 entries
Skips: 0 forward (0 - 0.0%)
CPU0 (xfs.trace):
Reads Queued: 1,274, 9,216KiB Writes Queued: 9,981,
156,710KiB
Read Dispatches: 1,738, 8,656KiB Write Dispatches: 9,855,
157,818KiB
Reads Requeued: 495 Writes Requeued: 72
Reads Completed: 1,844, 12,916KiB Writes Completed: 15,486,
8,360KiB
Read Merges: 0, 0KiB Write Merges: 42,
364KiB
Read depth: 10 Write depth: 11
IO unplugs: 95 Timer unplugs: 3
CPU1 (xfs.trace):
Reads Queued: 153, 1,372KiB Writes Queued: 14,521,
183,608KiB
Read Dispatches: 235, 2,348KiB Write Dispatches: 15,246,
183,627KiB
Reads Requeued: 24 Writes Requeued: 748
Reads Completed: 197, 1,868KiB Writes Completed: 14,885,
11,825KiB
Read Merges: 0, 0KiB Write Merges: 19,
60KiB
Read depth: 10 Write depth: 11
IO unplugs: 39 Timer unplugs: 7
CPU2 (xfs.trace):
Reads Queued: 1,156, 7,520KiB Writes Queued: 10,873,
160,987KiB
Read Dispatches: 1,586, 7,416KiB Write Dispatches: 10,724,
160,687KiB
Reads Requeued: 446 Writes Requeued: 69
Reads Completed: 586, 3,820KiB Writes Completed: 5,310,
4,103KiB
Read Merges: 0, 0KiB Write Merges: 57,
664KiB
Read depth: 10 Write depth: 11
IO unplugs: 54 Timer unplugs: 8
CPU3 (xfs.trace):
Reads Queued: 126, 1,436KiB Writes Queued: 5,197,
47,004KiB
Read Dispatches: 135, 1,124KiB Write Dispatches: 5,388,
46,187KiB
Reads Requeued: 20 Writes Requeued: 333
Reads Completed: 82, 940KiB Writes Completed: 5,037,
1,551KiB
Read Merges: 0, 0KiB Write Merges: 91,
708KiB
Read depth: 10 Write depth: 11
IO unplugs: 50 Timer unplugs: 8
Total (xfs.trace):
Reads Queued: 2,709, 19,544KiB Writes Queued: 40,572,
548,309KiB
Read Dispatches: 3,694, 19,544KiB Write Dispatches: 41,213,
548,319KiB
Reads Requeued: 985 Writes Requeued: 1,222
Reads Completed: 2,709, 19,544KiB Writes Completed: 40,718,
25,839KiB
Read Merges: 0, 0KiB Write Merges: 209,
1,796KiB
IO unplugs: 238 Timer unplugs: 26
Throughput (R/W): 45KiB/s / 60KiB/s
Events (xfs.trace): 309,109 entries
Skips: 0 forward (0 - 0.0%)
CPU0 (xfs.trace):
Reads Queued: 1,274, 9,216KiB Writes Queued: 9,981,
156,710KiB
Read Dispatches: 1,738, 8,656KiB Write Dispatches: 9,855,
157,818KiB
Reads Requeued: 495 Writes Requeued: 72
Reads Completed: 1,844, 12,916KiB Writes Completed: 15,486,
8,360KiB
Read Merges: 0, 0KiB Write Merges: 42,
364KiB
Read depth: 10 Write depth: 11
IO unplugs: 95 Timer unplugs: 3
CPU1 (xfs.trace):
Reads Queued: 153, 1,372KiB Writes Queued: 14,521,
183,608KiB
Read Dispatches: 235, 2,348KiB Write Dispatches: 15,246,
183,627KiB
Reads Requeued: 24 Writes Requeued: 748
Reads Completed: 197, 1,868KiB Writes Completed: 14,885,
11,825KiB
Read Merges: 0, 0KiB Write Merges: 19,
60KiB
Read depth: 10 Write depth: 11
IO unplugs: 39 Timer unplugs: 7
CPU2 (xfs.trace):
Reads Queued: 1,156, 7,520KiB Writes Queued: 10,873,
160,987KiB
Read Dispatches: 1,586, 7,416KiB Write Dispatches: 10,724,
160,687KiB
Reads Requeued: 446 Writes Requeued: 69
Reads Completed: 586, 3,820KiB Writes Completed: 5,310,
4,103KiB
Read Merges: 0, 0KiB Write Merges: 57,
664KiB
Read depth: 10 Write depth: 11
IO unplugs: 54 Timer unplugs: 8
CPU3 (xfs.trace):
Reads Queued: 126, 1,436KiB Writes Queued: 5,197,
47,004KiB
Read Dispatches: 135, 1,124KiB Write Dispatches: 5,388,
46,187KiB
Reads Requeued: 20 Writes Requeued: 333
Reads Completed: 82, 940KiB Writes Completed: 5,037,
1,551KiB
Read Merges: 0, 0KiB Write Merges: 91,
708KiB
Read depth: 10 Write depth: 11
IO unplugs: 50 Timer unplugs: 8
Total (xfs.trace):
Reads Queued: 2,709, 19,544KiB Writes Queued: 40,572,
548,309KiB
Read Dispatches: 3,694, 19,544KiB Write Dispatches: 41,213,
548,319KiB
Reads Requeued: 985 Writes Requeued: 1,222
Reads Completed: 2,709, 19,544KiB Writes Completed: 40,718,
25,839KiB
Read Merges: 0, 0KiB Write Merges: 209,
1,796KiB
IO unplugs: 238 Timer unplugs: 26
Throughput (R/W): 45KiB/s / 60KiB/s
Events (xfs.trace): 309,109 entries
Skips: 0 forward (0 - 0.0%)
CPU0 (xfs.trace):
Reads Queued: 1,274, 9,216KiB Writes Queued: 9,981,
156,710KiB
Read Dispatches: 1,738, 8,656KiB Write Dispatches: 9,855,
157,818KiB
Reads Requeued: 495 Writes Requeued: 72
Reads Completed: 1,844, 12,916KiB Writes Completed: 15,486,
8,360KiB
Read Merges: 0, 0KiB Write Merges: 42,
364KiB
Read depth: 10 Write depth: 11
IO unplugs: 95 Timer unplugs: 3
CPU1 (xfs.trace):
Reads Queued: 153, 1,372KiB Writes Queued: 14,521,
183,608KiB
Read Dispatches: 235, 2,348KiB Write Dispatches: 15,246,
183,627KiB
Reads Requeued: 24 Writes Requeued: 748
Reads Completed: 197, 1,868KiB Writes Completed: 14,885,
11,825KiB
Read Merges: 0, 0KiB Write Merges: 19,
60KiB
Read depth: 10 Write depth: 11
IO unplugs: 39 Timer unplugs: 7
CPU2 (xfs.trace):
Reads Queued: 1,156, 7,520KiB Writes Queued: 10,873,
160,987KiB
Read Dispatches: 1,586, 7,416KiB Write Dispatches: 10,724,
160,687KiB
Reads Requeued: 446 Writes Requeued: 69
Reads Completed: 586, 3,820KiB Writes Completed: 5,310,
4,103KiB
Read Merges: 0, 0KiB Write Merges: 57,
664KiB
Read depth: 10 Write depth: 11
IO unplugs: 54 Timer unplugs: 8
CPU3 (xfs.trace):
Reads Queued: 126, 1,436KiB Writes Queued: 5,197,
47,004KiB
Read Dispatches: 135, 1,124KiB Write Dispatches: 5,388,
46,187KiB
Reads Requeued: 20 Writes Requeued: 333
Reads Completed: 82, 940KiB Writes Completed: 5,037,
1,551KiB
Read Merges: 0, 0KiB Write Merges: 91,
708KiB
Read depth: 10 Write depth: 11
IO unplugs: 50 Timer unplugs: 8
Total (xfs.trace):
Reads Queued: 2,709, 19,544KiB Writes Queued: 40,572,
548,309KiB
Read Dispatches: 3,694, 19,544KiB Write Dispatches: 41,213,
548,319KiB
Reads Requeued: 985 Writes Requeued: 1,222
Reads Completed: 2,709, 19,544KiB Writes Completed: 40,718,
25,839KiB
Read Merges: 0, 0KiB Write Merges: 209,
1,796KiB
IO unplugs: 238 Timer unplugs: 26
Throughput (R/W): 45KiB/s / 60KiB/s
Events (xfs.trace): 309,109 entries
Skips: 0 forward (0 - 0.0%)
>
>
> Thanks for the input and patience.
>
> ~tom
>
>
[-- Attachment #1.1.2: xfs.trace.blktrace.3.bz2 --]
[-- Type: application/x-bzip, Size: 358698 bytes --]
[-- Attachment #1.2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 198 bytes --]
[-- Attachment #2: Type: text/plain, Size: 121 bytes --]
_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs
next prev parent reply other threads:[~2012-03-02 14:57 UTC|newest]
Thread overview: 14+ messages / expand[flat|nested] mbox.gz Atom feed top
2012-02-28 22:56 Poor performance using discard Thomas Lynema
2012-02-28 23:58 ` Peter Grandi
2012-02-29 1:22 ` Dave Chinner
2012-02-29 2:00 ` Thomas Lynema
2012-02-29 4:08 ` Dave Chinner
2012-02-29 10:38 ` Peter Grandi
2012-02-29 19:46 ` Eric Sandeen
2012-03-01 5:59 ` Christoph Hellwig
2012-03-01 6:27 ` Dave Chinner
2012-03-01 6:31 ` Christoph Hellwig
[not found] ` <1330658311.6438.24.camel@core24>
2012-03-02 14:57 ` Thomas Lynema [this message]
2012-03-02 15:41 ` Thomas Lynema
2012-03-05 3:02 ` Dave Chinner
2012-03-05 6:41 ` Jeffrey Hundstad
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1330700220.6438.31.camel@core24 \
--to=lyz27@yahoo.com \
--cc=david@fromorbit.com \
--cc=xfs@oss.sgi.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox