public inbox for linux-rdma@vger.kernel.org
 help / color / mirror / Atom feed
From: Shirley Ma <shirley.ma-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
To: Chuck Lever <chuck.lever-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>,
	linux-rdma <linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org>,
	Linux NFS Mailing List
	<linux-nfs-u79uwXL29TY76Z2rM5mHXA@public.gmane.org>
Subject: Re: [PATCH v3 00/21] NFS/RDMA client patches for 3.17
Date: Wed, 16 Jul 2014 08:48:19 -0700	[thread overview]
Message-ID: <53C69EC3.1010208@oracle.com> (raw)
In-Reply-To: <59034BAD-306F-462F-A274-3EB06C0CBE47-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>

These two patches have been significant reduced interrupt rate by around 4 times.
 
     xprtrdma: Disable completions for FAST_REG_MR Work Requests
     xprtrdma: Disable completions for LOCAL_INV Work Requests 

Same NFS read/write workload, here are interrupts rate irq/per sec report based upon /proc/interrupts:

w/o patches:
-----------
PCI-MSI-edge mlx4-ib (204):  105176
PCI-MSI-edge mlx4-ib (204):  123650
PCI-MSI-edge mlx4-ib (204):  123690
PCI-MSI-edge mlx4-ib (204):  116554
PCI-MSI-edge mlx4-ib (204):  122864

And perf stat irq report: 
Performance counter stats for 'system wide':

         2,131,870      irq:irq_handler_entry                                        [100.00%]
         2,131,870      irq:irq_handler_exit                                         [100.00%]
           635,587      irq:softirq_entry                                            [100.00%]
           635,597      irq:softirq_exit                                             [100.00%]
           636,155      irq:softirq_raise

      25.422821792 seconds time elapsed

w/i patches:
-----------
PCI-MSI-edge mlx4-ib (204):  31131
PCI-MSI-edge mlx4-ib (204):  32958
PCI-MSI-edge mlx4-ib (204):  31068
PCI-MSI-edge mlx4-ib (204):  30236
PCI-MSI-edge mlx4-ib (204):  33041

And perf stat irq report:

Performance counter stats for 'system wide':

           653,548      irq:irq_handler_entry                                        [100.00%]
           653,548      irq:irq_handler_exit                                         [100.00%]
           568,138      irq:softirq_entry                                            [100.00%]
           568,148      irq:softirq_exit                                             [100.00%]
           568,690      irq:softirq_raise                                           

      21.675597062 seconds time elapsed

Shirley

--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

  parent reply	other threads:[~2014-07-16 15:48 UTC|newest]

Thread overview: 8+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2014-07-15 14:24 [PATCH v3 00/21] NFS/RDMA client patches for 3.17 Chuck Lever
     [not found] ` <59034BAD-306F-462F-A274-3EB06C0CBE47-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
2014-07-16 15:48   ` Shirley Ma [this message]
     [not found]     ` <53C69EC3.1010208-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
2014-07-16 17:57       ` Chuck Lever
     [not found]         ` <EB581A8B-097E-4C0F-97B3-D04B2B791A69-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
2014-07-16 18:22           ` Shirley Ma
2014-07-17  5:06   ` Devesh Sharma
     [not found]     ` <EE7902D3F51F404C82415C4803930ACD3FE10DE1-DWYeeINJQrxExQ8dmkPuX0M9+F4ksjoh@public.gmane.org>
2014-07-17 14:12       ` Devesh Sharma
     [not found]         ` <3cf9f937-4c1c-4a39-9fb8-aca5eea15880-3RiH6ntJJkOPfaB/Gd0HpljyZtpTMMwT@public.gmane.org>
2014-07-17 14:16           ` Chuck Lever
     [not found]             ` <5DD61444-DCBF-40B7-B246-6CAD450E7047-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org>
2014-07-17 14:21               ` Devesh Sharma

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=53C69EC3.1010208@oracle.com \
    --to=shirley.ma-qhclzuegtsvqt0dzr+alfa@public.gmane.org \
    --cc=chuck.lever-QHcLZuEGTsvQT0dZR+AlfA@public.gmane.org \
    --cc=linux-nfs-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
    --cc=linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox