Netdev List
 help / color / mirror / Atom feed
From: Scott <ph3lpz@gmail.com>
To: netdev@vger.kernel.org
Subject: iproute2 does not enumerate vf's properly (ixgbe)
Date: Sat, 24 Mar 2012 09:44:02 -0400	[thread overview]
Message-ID: <89EBE686-6625-428C-8CCB-6A8E8B8162A8@gmail.com> (raw)

When loading the module ixgbe with sr-iov enabled (max_vfs), enumeration of the interfaces' VFs is inconsistent using the iproute2 utility.
 
Server Information:HP Product Name: ProLiant DL165 G7
Ethernet Card Information: Intel 82599EB 10-Gigabit SFI/SFP+
uname: Linux 3.0.0-16-server x86_64 GNU/Linux
OS Release: Ubuntu 11.10
 

Using a freshly compiled git pull:
# ./ip -V
ip utility, iproute2-ss120319

Steps to reproduce:

1. Determine the ethernet interface IDs:
# dmesg |grep ixgbe\ 0000:05:00.[0-9].*detected|head -n 2
[    8.448031] ixgbe 0000:05:00.0: eth4: detected SFP+: 5
[    8.816035] ixgbe 0000:05:00.1: eth5: detected SFP+: 6

2. Load the module w/40 VFs:
# modprobe ixgbe max_vfs=40

3. Sanity checks:
# lsmod |grep ixgbe
ixgbe                 206156  0 
dca                    15179  2 ixgbe,igb

# modinfo ixgbe|grep version
version:        3.6.7-NAPI
srcversion:     119ADBD2B16B0E40668FB9A
vermagic:       3.0.0-16-server SMP mod_unload modversions 
(this is the latest too)

# lspci |grep 05:1[0-9]|perl -lane 'delete @F[1,2,3,4,10,11];print "@F"'
05:10.0     82599 Ethernet Controller Virtual Function
05:10.2     82599 Ethernet Controller Virtual Function
05:10.4     82599 Ethernet Controller Virtual Function
05:10.6     82599 Ethernet Controller Virtual Function
05:11.0     82599 Ethernet Controller Virtual Function
(suppressing output of all 40 VFs)

# lspci |grep 05:1[0-9]|wc -l
40
(showing that there are actually 40)

# ls -l /sys/class/net/eth4/device/|grep virt|awk '{print $10" "$8}'|sort|head -5
../0000:05:10.0 virtfn0
../0000:05:10.2 virtfn1
../0000:05:10.4 virtfn2
../0000:05:10.6 virtfn3
../0000:05:11.0 virtfn4
(suppressing output of all 40 VFs)

5. Run ip link show:
# ./ip link show|grep -e eth[45] -e vf
(null output!)

6. Load the module with fewer VFs
# rmmod ixgbe
# modprobe ixgbe max_vfs=5
# lspci |grep 05:1[0-9]|perl -lane 'delete @F[1,2,3,4,10,11];print "@F"'
05:10.0     82599 Ethernet Controller Virtual Function
05:10.2     82599 Ethernet Controller Virtual Function
05:10.4     82599 Ethernet Controller Virtual Function
05:10.6     82599 Ethernet Controller Virtual Function
05:11.0     82599 Ethernet Controller Virtual Function

# ls -l /sys/class/net/eth4/device/|grep virt|awk '{print $10" "$8}'|sort
../0000:05:10.0 virtfn0
../0000:05:10.2 virtfn1
../0000:05:10.4 virtfn2
../0000:05:10.6 virtfn3
../0000:05:11.0 virtfn4

7. Run ip link show
# ./ip link show|grep -e eth[45] -e vf
57: eth4: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT qlen 1000
    vf 0 MAC 52:a0:59:03:20:a8
    vf 1 MAC 82:5f:55:a5:1f:be
    vf 2 MAC 0a:ab:86:0c:02:b3
    vf 3 MAC 22:a7:28:ce:9c:23
    vf 4 MAC 26:ea:6c:1b:ca:57
58: eth5: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT qlen 1000
(no vfs displayed for eth5!)

Patrick Kutch over at Intel suggested that there may be a patch to fix this problem, but I was not able to locate it.
http://communities.intel.com/thread/28411?tstart=0

There is also Launchpad bug #960497 for this issue.

Thanks in advance for any suggestions.

-SP

             reply	other threads:[~2012-03-24 13:44 UTC|newest]

Thread overview: 4+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2012-03-24 13:44 Scott [this message]
2012-03-26 15:56 ` iproute2 does not enumerate vf's properly (ixgbe) Rose, Gregory V
2012-03-26 18:01   ` Scott
2012-03-26 18:53     ` Rose, Gregory V

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=89EBE686-6625-428C-8CCB-6A8E8B8162A8@gmail.com \
    --to=ph3lpz@gmail.com \
    --cc=netdev@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox