Re: Re: [Xen-users] wiki page on 10G SRIOV

[kishore kumar <bodkekumar@gmail.com>]

[-- Attachment #1.1: Type: text/plain, Size: 7151 bytes --]

I am using Ethernet Server Adapater X520 - DA2 (E10G42BTDA) Card.

For the Device Id 0x10FB, I was able to see all the 64 Virtual Functions,
when I run lspci command.
But when the Device ID started showing 0x10D8, I cannot see any Virtual
Functions, when I run lspci command.
On Mon, Jul 19, 2010 at 2:35 PM, Rose, Gregory V
<gregory.v.rose@intel.com>wrote:

>  If you have an 82599EB that is using 10D8h for the Virtual Function
> Device ID then the adapter is a very old, preproduction version or else the
> correct EEPROM image has been over-written with an invalid image.  The
> correct Device ID value for an 82599EB virtual function is 10EDh.
>
>
>
> - Greg
>
>
>
> *From:* xen-devel-bounces@lists.xensource.com [mailto:
> xen-devel-bounces@lists.xensource.com] *On Behalf Of *Byrne, John (HP
> Labs)
> *Sent:* Monday, July 19, 2010 2:22 PM
> *To:* kishore kumar
> *Cc:* xen-devel@lists.xensource.com; wangalalei;
> xen-users@lists.xensource.com
> *Subject:* RE: [Xen-devel] Re: [Xen-users] wiki page on 10G SRIOV
>
>
>
> I’m a bit confused with your device IDs. The 10fb device is the PCI id for
> the physical NIC; the 10d8 device is the SRIOV Virtual Function device
> created by the driver.  With the latest xen-unstable, I have successfully
> used this NIC to create and assign the VF devices to HVM guests. The ixgbevf
> driver, which binds to the VF devices, expects device id 0x10ed. I simply
> assumed that the driver was not quite up to date and tweaked things to work.
>  So, if you are just a bit confused, the following might help.
>
>
>
> I added the following in my modprobe.d directory to create four VF devices
> (ixgbe.conf, attached):
>
>
>
> options ixgbe max_vfs=4
>
>
>
> So, on my machine, I can see the physical NIC and the 4 VFs created.
>
>
>
> lspci –n | grep 0a:
>
> 0a:00.0 0200: 8086:10fb (rev 01)
>
> 0a:10.0 0200: 8086:10d8 (rev 01)
>
> 0a:10.2 0200: 8086:10d8 (rev 01)
>
> 0a:10.4 0200: 8086:10d8 (rev 01)
>
> 0a:10.6 0200: 8086:10d8 (rev 01)
>
>
>
> I added the ixgbevf driver to both my dom0 and domUs. While it is a simple
> tweak to add the device id to the driver, I decided to play with modprobe
> instead and added the following to my modprobe.d directory in both dom0 and
> domU (ixgbvevf.conf, attached):
>
>
>
> install ixgbevf /sbin/modprobe --ignore-install ixgbevf; echo "0x8086
> 0x10d8" >/
>
> sys/bus/pci/drivers/ixgbevf/new_id
>
>
>
> If you are working with HVM guests, there has to be a patch to  qemu as
> well. (Attached)  You also have to add “(pci-passthrough-strict-check no)”
> to your xend-config.sxp. (I don’t think you need the xend-config change for
> PV guests.)
>
>
>
> Then it is simply a matter of adding the VF PCI devices to your domU
> configurations and configuring the ixgbevf devices in the guests.
>
>
>
> Both the ixgbe and ixgbevf drivers will generate random MAC addresses for
> the devices. What  I wanted to do was to set the MAC addresses for the VF
> devices in dom0 and then my guests’ networking configuration was much
> easier. The physical NIC must be up. It doesn’t have to have an IP address,
> but if it isn’t up the MAC address set in dom0 will be lost. I’ve attached
> my dom0 rc.local where I set the MAC addresses and assign the devices to
> pciback.
>
>
>
> I can’t swear that this is the best way to do this, but this did work.
>
>
>
> John Byrne
>
>
>
>
>
> *From:* xen-devel-bounces@lists.xensource.com [mailto:
> xen-devel-bounces@lists.xensource.com] *On Behalf Of *kishore kumar
> *Sent:* Monday, July 19, 2010 10:16 AM
> *To:* Pasi Kärkkäinen; xen-devel@lists.xensource.com
> *Cc:* wangalalei; xen-users@lists.xensource.com
> *Subject:* [Xen-devel] Re: [Xen-users] wiki page on 10G SRIOV
>
>
>
>
> Hello Everyone,
>
>
>
> I am facing a strange issue with my 10G 82599 PCIe device.
>
>
>
> The Device Id has to be 0x10FB for SRIOV to function properly, But all of
> sudden the Device ID started showing me as 0x10D8, and because of this the
> SRIOV feature is not working and I cannot assign the Virtual Function to  my
> guest.
>
>
>
> When I did lspci command it is showing me as Intel Corporation Unknown
> device 10d8 (rev 01).  Previously it was showing me Intel Corporation
> 82599EB Gigabit Networking with 10FB, and I was able to assign the Virtual
> Function to my guest.
>
>
>
> I googled and found out that the device ID 0x10D8 is a 82599 Unprogrammed
> device.
>
>
>
> Can any one please let me know what is happening here and how to recover
> back from this?
>
> I am totally blocked for 2 days because of this issue.
>
>
>
> Thank You.
>
> On Fri, Jul 16, 2010 at 1:05 AM, Pasi Kärkkäinen <pasik@iki.fi> wrote:
>
> On Fri, Jul 16, 2010 at 02:17:30AM +0000, wangalalei wrote:
> >    hi all:
> >
> >       i read intel 82576 card datasheet,and finding it saying that the
> 82576
> >    can set the vf's bandwidth,
> >    but when i test this card,i can not find any parameter to it
> >       any one else notice this problem? or anyone knows whether the 82576
> >    card can control its vf's bandwidth?
> >
>
> I think bandwidth management is a work-in-progress by Intel..
>
> -- Pasi
>
>
> >    alaleiwang
> >
> >
>  --------------------------------------------------------------------------
> >
> >    Date: Thu, 15 Jul 2010 18:35:57 -0700
> >    Subject: Re: [Xen-users] wiki page on 10G SRIOV
> >    From: bodkekumar@gmail.com
> >    To: pasik@iki.fi
> >    CC: xen-users@lists.xensource.com
> >
> >    Yeah, I configured 64 Virtual Functions in DOM-0  and passthru 1 VF to
> >    assign it to the guest.  It worked for me.
> >
> >    I assign static IP to my guest and tried to ping the remote machine.
> It
> >    worked for me.
> >
> >    But I am wondering that ping to DOM-0 from guest makes any sense here?
> >    Can you let me know on this?  ping worked though from guest to DOM-0
> as
> >    well.
> >
>
> >    On Thu, Jul 15, 2010 at 1:11 PM, Pasi KÀrkkÀinen <[1]pasik@iki.fi>
>
> >    wrote:
> >
> >      On Thu, Jun 24, 2010 at 10:56:28AM -0700, kishore kumar wrote:
> >      >    Hi All,
> >      >
> >      >    Can any one please let me know if there is a WIKI page which
> talks
> >      about
> >      >    how to configure SRIOV in Xen and use Physical Functions  and
> >      Virtual
> >      >    Functions ?
> >      >
> >      >    I searched xen wiki, but could not find.
> >      >
> >
> >      Each virtual function should be a separate PCI device, so you can
> >      passthru
> >      them like any other normal PCI device.
> >
> >      Did you get it to work?
> >      -- Pasi
> >
>
> >
>  --------------------------------------------------------------------------
> >
> >    è**倩+æ**玢+é*®ç®± æ*³èŠ*蜻æ*Ÿå*ºæžž,æ**æ*ºMSNåž®äœ æ**å®*!
> >    [2]ç«*å*»äž*蜜ïŒ*
>
> >
> > References
> >
> >    Visible links
> >    1. mailto:pasik@iki.fi
>
> >    2. http://3g.msn.cn/
>
>
>

[-- Attachment #1.2: Type: text/html, Size: 13309 bytes --]

[-- Attachment #2: Type: text/plain, Size: 138 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel