From: Craig Hada <craig.hada@hp.com>
To: netdev@vger.kernel.org, craig.hada@hp.com
Cc: sathya.perla@emulex.com, subbu.seetharaman@emulex.com,
ajit.khaparde@emulex.com, linux-kernel@vger.kernel.org
Subject: [PATCH net-next] drivers/net: Enable IOMMU pass through for be2net
Date: Wed, 12 Sep 2012 10:58:53 -0700 [thread overview]
Message-ID: <1347472734-3196-1-git-send-email-craig.hada@hp.com> (raw)
This patch sets the coherent DMA mask to 64-bit after the be2net driver
has been acknowledged that the system is 64-bit DMA capable. The coherent
DMA mask is examined by the Intel IOMMU driver to determine whether to
allow pass through context mapping for all devices. With this patch, the
be2net driver combined with be2net compatible hardware provides
comparable performance to the case where vt-d is disabled. The main use
case for this change is to decrease the time necessary to copy virtual
machine memory during KVM live migration instantiations.
This patch was tested on a system that enables the IOMMU in non-coherent
mode. Two DMA remapper issues were encountered and both are in the Intel
IOMMU driver with the following patches submitted upstream but not yet
commited.
Patch 1 - DMAR:[fault reason 02] Present bit in context entry is clear
https://lkml.org/lkml/2012/6/15/20
Patch 2 - DMAR:[fault reason 02] Present bit in context entry is clear
https://lkml.org/lkml/2011/11/11/279
The performance of this patch was measured with netperf with vt-d
enabled and disabled along with kernel boot parameters intel_iommu
and iommu. Netperf was run 3 times and averaged for each configuration
of vt-d and boot parameters. The command and parameters used in the
netperf runs along with results are as follows:
# netperf -c -p 12865 -H 10.10.0.2 -t TCP_STREAM -l 60
Recv Send Send Utilization Service Demand
Socket Socket Message Elapsed Send Recv Send Recv
Size Size Size Time Throughput local remote local remote
bytes bytes bytes secs. 10^6bits/s % S % U us/KB us/KB
vt-d enabled and intel-iommu=on
87380 16384 16384 60.0 3634.29 16.76 -1.00 2.267 -1.000
vt-d enabled
87380 16384 16384 60.00 6779.01 6.77 -1.00 0.489 -1.000
vt-d disabled
87380 16384 16384 60.00 6807.70 7.00 -1.00 0.505 -1.000
vt-d enabled and intel_iommu=on and iommu=pt
87380 16384 16384 60.00 6849.93 7.19 -1.00 0.516 -1.000
Craig Hada (1):
drivers/net: Enable IOMMU pass through for be2net
drivers/net/ethernet/emulex/benet/be_main.c | 6 ++++++
1 files changed, 6 insertions(+), 0 deletions(-)
next reply other threads:[~2012-09-12 17:58 UTC|newest]
Thread overview: 4+ messages / expand[flat|nested] mbox.gz Atom feed top
2012-09-12 17:58 Craig Hada [this message]
2012-09-12 17:58 ` [PATCH net-next] drivers/net: Enable IOMMU pass through for be2net Craig Hada
[not found] ` <4988B24899FF4448BF3D99EFCD2A3562323AD5@G1W3785.americas.hpqcorp.net>
2012-09-13 17:06 ` Craig Hada
2012-09-13 21:09 ` David Miller
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1347472734-3196-1-git-send-email-craig.hada@hp.com \
--to=craig.hada@hp.com \
--cc=ajit.khaparde@emulex.com \
--cc=linux-kernel@vger.kernel.org \
--cc=netdev@vger.kernel.org \
--cc=sathya.perla@emulex.com \
--cc=subbu.seetharaman@emulex.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).