From: Shirley Ma <shirley.ma@oracle.com>
To: Chuck Lever <chuck.lever@oracle.com>,
linux-rdma <linux-rdma@vger.kernel.org>,
Linux NFS Mailing List <linux-nfs@vger.kernel.org>
Subject: Re: [PATCH v3 00/21] NFS/RDMA client patches for 3.17
Date: Wed, 16 Jul 2014 08:48:19 -0700 [thread overview]
Message-ID: <53C69EC3.1010208@oracle.com> (raw)
In-Reply-To: <59034BAD-306F-462F-A274-3EB06C0CBE47@oracle.com>
These two patches have been significant reduced interrupt rate by around 4 times.
xprtrdma: Disable completions for FAST_REG_MR Work Requests
xprtrdma: Disable completions for LOCAL_INV Work Requests
Same NFS read/write workload, here are interrupts rate irq/per sec report based upon /proc/interrupts:
w/o patches:
-----------
PCI-MSI-edge mlx4-ib (204): 105176
PCI-MSI-edge mlx4-ib (204): 123650
PCI-MSI-edge mlx4-ib (204): 123690
PCI-MSI-edge mlx4-ib (204): 116554
PCI-MSI-edge mlx4-ib (204): 122864
And perf stat irq report:
Performance counter stats for 'system wide':
2,131,870 irq:irq_handler_entry [100.00%]
2,131,870 irq:irq_handler_exit [100.00%]
635,587 irq:softirq_entry [100.00%]
635,597 irq:softirq_exit [100.00%]
636,155 irq:softirq_raise
25.422821792 seconds time elapsed
w/i patches:
-----------
PCI-MSI-edge mlx4-ib (204): 31131
PCI-MSI-edge mlx4-ib (204): 32958
PCI-MSI-edge mlx4-ib (204): 31068
PCI-MSI-edge mlx4-ib (204): 30236
PCI-MSI-edge mlx4-ib (204): 33041
And perf stat irq report:
Performance counter stats for 'system wide':
653,548 irq:irq_handler_entry [100.00%]
653,548 irq:irq_handler_exit [100.00%]
568,138 irq:softirq_entry [100.00%]
568,148 irq:softirq_exit [100.00%]
568,690 irq:softirq_raise
21.675597062 seconds time elapsed
Shirley
WARNING: multiple messages have this Message-ID (diff)
From: Shirley Ma <shirley.ma-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
To: Chuck Lever <chuck.lever-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>,
linux-rdma <linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org>,
Linux NFS Mailing List
<linux-nfs-u79uwXL29TY76Z2rM5mHXA@public.gmane.org>
Subject: Re: [PATCH v3 00/21] NFS/RDMA client patches for 3.17
Date: Wed, 16 Jul 2014 08:48:19 -0700 [thread overview]
Message-ID: <53C69EC3.1010208@oracle.com> (raw)
In-Reply-To: <59034BAD-306F-462F-A274-3EB06C0CBE47-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
These two patches have been significant reduced interrupt rate by around 4 times.
xprtrdma: Disable completions for FAST_REG_MR Work Requests
xprtrdma: Disable completions for LOCAL_INV Work Requests
Same NFS read/write workload, here are interrupts rate irq/per sec report based upon /proc/interrupts:
w/o patches:
-----------
PCI-MSI-edge mlx4-ib (204): 105176
PCI-MSI-edge mlx4-ib (204): 123650
PCI-MSI-edge mlx4-ib (204): 123690
PCI-MSI-edge mlx4-ib (204): 116554
PCI-MSI-edge mlx4-ib (204): 122864
And perf stat irq report:
Performance counter stats for 'system wide':
2,131,870 irq:irq_handler_entry [100.00%]
2,131,870 irq:irq_handler_exit [100.00%]
635,587 irq:softirq_entry [100.00%]
635,597 irq:softirq_exit [100.00%]
636,155 irq:softirq_raise
25.422821792 seconds time elapsed
w/i patches:
-----------
PCI-MSI-edge mlx4-ib (204): 31131
PCI-MSI-edge mlx4-ib (204): 32958
PCI-MSI-edge mlx4-ib (204): 31068
PCI-MSI-edge mlx4-ib (204): 30236
PCI-MSI-edge mlx4-ib (204): 33041
And perf stat irq report:
Performance counter stats for 'system wide':
653,548 irq:irq_handler_entry [100.00%]
653,548 irq:irq_handler_exit [100.00%]
568,138 irq:softirq_entry [100.00%]
568,148 irq:softirq_exit [100.00%]
568,690 irq:softirq_raise
21.675597062 seconds time elapsed
Shirley
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
next prev parent reply other threads:[~2014-07-16 15:48 UTC|newest]
Thread overview: 16+ messages / expand[flat|nested] mbox.gz Atom feed top
2014-07-15 14:24 [PATCH v3 00/21] NFS/RDMA client patches for 3.17 Chuck Lever
2014-07-15 14:24 ` Chuck Lever
2014-07-16 15:48 ` Shirley Ma [this message]
2014-07-16 15:48 ` Shirley Ma
2014-07-16 17:57 ` Chuck Lever
2014-07-16 17:57 ` Chuck Lever
2014-07-16 18:22 ` Shirley Ma
2014-07-16 18:22 ` Shirley Ma
2014-07-17 5:06 ` Devesh Sharma
2014-07-17 5:06 ` Devesh Sharma
2014-07-17 14:12 ` Devesh Sharma
2014-07-17 14:12 ` Devesh Sharma
2014-07-17 14:16 ` Chuck Lever
2014-07-17 14:16 ` Chuck Lever
2014-07-17 14:21 ` Devesh Sharma
2014-07-17 14:21 ` Devesh Sharma
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=53C69EC3.1010208@oracle.com \
--to=shirley.ma@oracle.com \
--cc=chuck.lever@oracle.com \
--cc=linux-nfs@vger.kernel.org \
--cc=linux-rdma@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.