From: Scott <ph3lpz@gmail.com>
To: netdev@vger.kernel.org
Subject: iproute2 does not enumerate vf's properly (ixgbe)
Date: Sat, 24 Mar 2012 09:44:02 -0400 [thread overview]
Message-ID: <89EBE686-6625-428C-8CCB-6A8E8B8162A8@gmail.com> (raw)
When loading the module ixgbe with sr-iov enabled (max_vfs), enumeration of the interfaces' VFs is inconsistent using the iproute2 utility.
Server Information:HP Product Name: ProLiant DL165 G7
Ethernet Card Information: Intel 82599EB 10-Gigabit SFI/SFP+
uname: Linux 3.0.0-16-server x86_64 GNU/Linux
OS Release: Ubuntu 11.10
Using a freshly compiled git pull:
# ./ip -V
ip utility, iproute2-ss120319
Steps to reproduce:
1. Determine the ethernet interface IDs:
# dmesg |grep ixgbe\ 0000:05:00.[0-9].*detected|head -n 2
[ 8.448031] ixgbe 0000:05:00.0: eth4: detected SFP+: 5
[ 8.816035] ixgbe 0000:05:00.1: eth5: detected SFP+: 6
2. Load the module w/40 VFs:
# modprobe ixgbe max_vfs=40
3. Sanity checks:
# lsmod |grep ixgbe
ixgbe 206156 0
dca 15179 2 ixgbe,igb
# modinfo ixgbe|grep version
version: 3.6.7-NAPI
srcversion: 119ADBD2B16B0E40668FB9A
vermagic: 3.0.0-16-server SMP mod_unload modversions
(this is the latest too)
# lspci |grep 05:1[0-9]|perl -lane 'delete @F[1,2,3,4,10,11];print "@F"'
05:10.0 82599 Ethernet Controller Virtual Function
05:10.2 82599 Ethernet Controller Virtual Function
05:10.4 82599 Ethernet Controller Virtual Function
05:10.6 82599 Ethernet Controller Virtual Function
05:11.0 82599 Ethernet Controller Virtual Function
(suppressing output of all 40 VFs)
# lspci |grep 05:1[0-9]|wc -l
40
(showing that there are actually 40)
# ls -l /sys/class/net/eth4/device/|grep virt|awk '{print $10" "$8}'|sort|head -5
../0000:05:10.0 virtfn0
../0000:05:10.2 virtfn1
../0000:05:10.4 virtfn2
../0000:05:10.6 virtfn3
../0000:05:11.0 virtfn4
(suppressing output of all 40 VFs)
5. Run ip link show:
# ./ip link show|grep -e eth[45] -e vf
(null output!)
6. Load the module with fewer VFs
# rmmod ixgbe
# modprobe ixgbe max_vfs=5
# lspci |grep 05:1[0-9]|perl -lane 'delete @F[1,2,3,4,10,11];print "@F"'
05:10.0 82599 Ethernet Controller Virtual Function
05:10.2 82599 Ethernet Controller Virtual Function
05:10.4 82599 Ethernet Controller Virtual Function
05:10.6 82599 Ethernet Controller Virtual Function
05:11.0 82599 Ethernet Controller Virtual Function
# ls -l /sys/class/net/eth4/device/|grep virt|awk '{print $10" "$8}'|sort
../0000:05:10.0 virtfn0
../0000:05:10.2 virtfn1
../0000:05:10.4 virtfn2
../0000:05:10.6 virtfn3
../0000:05:11.0 virtfn4
7. Run ip link show
# ./ip link show|grep -e eth[45] -e vf
57: eth4: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT qlen 1000
vf 0 MAC 52:a0:59:03:20:a8
vf 1 MAC 82:5f:55:a5:1f:be
vf 2 MAC 0a:ab:86:0c:02:b3
vf 3 MAC 22:a7:28:ce:9c:23
vf 4 MAC 26:ea:6c:1b:ca:57
58: eth5: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT qlen 1000
(no vfs displayed for eth5!)
Patrick Kutch over at Intel suggested that there may be a patch to fix this problem, but I was not able to locate it.
http://communities.intel.com/thread/28411?tstart=0
There is also Launchpad bug #960497 for this issue.
Thanks in advance for any suggestions.
-SP
next reply other threads:[~2012-03-24 13:44 UTC|newest]
Thread overview: 4+ messages / expand[flat|nested] mbox.gz Atom feed top
2012-03-24 13:44 Scott [this message]
2012-03-26 15:56 ` iproute2 does not enumerate vf's properly (ixgbe) Rose, Gregory V
2012-03-26 18:01 ` Scott
2012-03-26 18:53 ` Rose, Gregory V
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=89EBE686-6625-428C-8CCB-6A8E8B8162A8@gmail.com \
--to=ph3lpz@gmail.com \
--cc=netdev@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox