about sr-iov

about sr-iov

[Zhuo Song]

[-- Attachment #1.1.1: Type: text/plain, Size: 1573 bytes --]

Hi,

 

I got a problem when prepared to pass-thru 82576 ethernet card with SR-IOV
support. 

 

The 82576 card is build-in on the board. When loading igb driver for the
card, dmesg show some errors like:

 

pci 0000:05:00.0: BAR 10: can't allocate mem resource
[0xfbf00000-0xfbefffff]

.

igb 0000:05:00.0: not enough MMIO resources for SR-IOV

igb 0000:05:00.0: Failed to initialize SR-IOV virtualization

 

Some system information from DMI as below:

 

XEN 4.0.0, DOM0 kernel 2.6.32, igb driver 2.2.9

 

System Information

        Manufacturer: HP

        Product Name: ProLiant DL160 G6  

 

BIOS Information

        Vendor: HP

        Version: O33

        Release Date: 06/10/2009

        Address: 0xF0000

        Runtime Size: 64 kB

        ROM Size: 2048 kB

        BIOS Revision: 8.15

 

LAN option rom, the version is intel agent boot GE 1.3.24, PXE2.1

 

Processor Information

        Socket Designation: Proc 2

        Type: Central Processor

        Family: Xeon

        Manufacturer: Intel            

        Signature: Type 0, Family 6, Model 26, Stepping 5

Version: Intel(R) Xeon(R) CPU           E5504  @ 2.00GHz

 

The same igb driver works well on a dell server with 82576 adapter. I
thought BIOS got some problem to assign right memory for VFs and I tried to
pass *pci=assign-busses* to kernel, but it still failed. Does the 82576 card
SR-IOV need a BIOS enable and a *REBOOT* to make the function active?  Can
anyone just give me some ideas? Thanks.

 

Best Regards

face

Zhuo Song

Gif me a visky, ginger ale on the side.

 


[-- Attachment #1.1.2: Type: text/html, Size: 9063 bytes --]

[-- Attachment #1.2: image001.jpg --]
[-- Type: image/jpeg, Size: 1068 bytes --]

[-- Attachment #2: Type: text/plain, Size: 138 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel

Re: about sr-iov

[Konrad Rzeszutek Wilk]

On Wed, Nov 24, 2010 at 09:16:50PM +0800, Zhuo Song wrote:
> Hi,
> 
>  
> 
> I got a problem when prepared to pass-thru 82576 ethernet card with SR-IOV
> support. 

To a PV guest? Or is this just when you were booting up the machine and tried
to initialize the card?
> 
>  
> 
> The 82576 card is build-in on the board. When loading igb driver for the
> card, dmesg show some errors like:
> 
>  
> 
> pci 0000:05:00.0: BAR 10: can't allocate mem resource
> [0xfbf00000-0xfbefffff]
> 
> .
> 
> igb 0000:05:00.0: not enough MMIO resources for SR-IOV
> 
> igb 0000:05:00.0: Failed to initialize SR-IOV virtualization
> 
>  
> 
> Some system information from DMI as below:
> 
>  
> 
> XEN 4.0.0, DOM0 kernel 2.6.32, igb driver 2.2.9
> 
>  
> 
> System Information
> 
>         Manufacturer: HP
> 
>         Product Name: ProLiant DL160 G6  
> 
>  
> 
> BIOS Information
> 
>         Vendor: HP
> 
>         Version: O33
> 
>         Release Date: 06/10/2009
> 
>         Address: 0xF0000
> 
>         Runtime Size: 64 kB
> 
>         ROM Size: 2048 kB
> 
>         BIOS Revision: 8.15
> 
>  
> 
> LAN option rom, the version is intel agent boot GE 1.3.24, PXE2.1
> 
>  
> 
> Processor Information
> 
>         Socket Designation: Proc 2
> 
>         Type: Central Processor
> 
>         Family: Xeon
> 
>         Manufacturer: Intel            
> 
>         Signature: Type 0, Family 6, Model 26, Stepping 5
> 
> Version: Intel(R) Xeon(R) CPU           E5504  @ 2.00GHz
> 
>  
> 
> The same igb driver works well on a dell server with 82576 adapter. I
> thought BIOS got some problem to assign right memory for VFs and I tried to
> pass *pci=assign-busses* to kernel, but it still failed. Does the 82576 card
> SR-IOV need a BIOS enable and a *REBOOT* to make the function active?  Can
> anyone just give me some ideas? Thanks.
> 
>  
> 
> Best Regards
> 
> face
> 
> Zhuo Song
> 
> Gif me a visky, ginger ale on the side.
> 
>  
> 



> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xensource.com
> http://lists.xensource.com/xen-devel

RE: about sr-iov

[Zhang, Yang Z]

[-- Attachment #1.1.1: Type: text/plain, Size: 1911 bytes --]

Try to add  pci=assign-busses in kernel cmd line.


best regards
yang

From: xen-devel-bounces@lists.xensource.com [mailto:xen-devel-bounces@lists.xensource.com] On Behalf Of Zhuo Song
Sent: Wednesday, November 24, 2010 9:17 PM
To: xen-devel@lists.xensource.com
Cc: yu.zhao@intel.com
Subject: [Xen-devel] about sr-iov

Hi,

I got a problem when prepared to pass-thru 82576 ethernet card with SR-IOV support.

The 82576 card is build-in on the board. When loading igb driver for the card, dmesg show some errors like:

pci 0000:05:00.0: BAR 10: can't allocate mem resource [0xfbf00000-0xfbefffff]
...
igb 0000:05:00.0: not enough MMIO resources for SR-IOV
igb 0000:05:00.0: Failed to initialize SR-IOV virtualization

Some system information from DMI as below:

XEN 4.0.0, DOM0 kernel 2.6.32, igb driver 2.2.9

System Information
        Manufacturer: HP
        Product Name: ProLiant DL160 G6

BIOS Information
        Vendor: HP
        Version: O33
        Release Date: 06/10/2009
        Address: 0xF0000
        Runtime Size: 64 kB
        ROM Size: 2048 kB
        BIOS Revision: 8.15

LAN option rom, the version is intel agent boot GE 1.3.24, PXE2.1

Processor Information
        Socket Designation: Proc 2
        Type: Central Processor
        Family: Xeon
        Manufacturer: Intel
        Signature: Type 0, Family 6, Model 26, Stepping 5
Version: Intel(R) Xeon(R) CPU           E5504  @ 2.00GHz

The same igb driver works well on a dell server with 82576 adapter. I thought BIOS got some problem to assign right memory for VFs and I tried to pass *pci=assign-busses* to kernel, but it still failed. Does the 82576 card SR-IOV need a BIOS enable and a *REBOOT* to make the function active?  Can anyone just give me some ideas? Thanks.

Best Regards
[cid:image001.jpg@01CB8C26.9B4E0AA0]
Zhuo Song
Gif me a visky, ginger ale on the side.


[-- Attachment #1.1.2: Type: text/html, Size: 11101 bytes --]

[-- Attachment #1.2: image001.jpg --]
[-- Type: image/jpeg, Size: 1068 bytes --]

[-- Attachment #2: Type: text/plain, Size: 138 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel

Re: about sr-iov

[Brian Johnson]

Konrad Rzeszutek Wilk <konrad.wilk <at> oracle.com> writes:

> 
> On Wed, Nov 24, 2010 at 09:16:50PM +0800, Zhuo Song wrote:
> > Hi,
> > I got a problem when prepared to pass-thru 82576 ethernet card with SR-IOV
> > support. 
> 

It sounds like the HP system does have VT-d enabled or it does not support SR-
IOV in the BIOS. I would check the HP support site or give them a call.

Take a look at either of these sites below for more information on SR-IOV.
http://www.youtube.com/watch?v=hRHsk8Nycdg 

http://community.citrix.com/display/ocb/2010/09/14/Citrix+Provisioning+Server+G
ets+Virtual+with+SR-IOV

http://communities.intel.com/community/wired/blog/2010/03/01/setting-up-red-
hat-54-xen-for-sr-iov-using-the-intel-82576-gbe 

Brian Johnson
LAN Access Division - Intel Corp
10Gb Ethernet and Virtualization Technologies

RE: about sr-iov

[Zhuo Song]

[-- Attachment #1.1.1: Type: text/plain, Size: 2524 bytes --]

Hi yang,

Thanks for your advice.

 

But I have tired that you said just like my old description, unfortunately,
it still failed. I will double check it again.

 

Best Regards

face

Zhuo Song

Gif me a visky, ginger ale on the side.

 

发件人: xen-devel-bounces@lists.xensource.com
[mailto:xen-devel-bounces@lists.xensource.com] 代表 Zhang, Yang Z
发送时间: 2010年11月24日 22:26
收件人: Zhuo Song; xen-devel@lists.xensource.com
主题: RE: [Xen-devel] about sr-iov

 

Try to add  pci=assign-busses in kernel cmd line.

 

 

best regards

yang

 

From: xen-devel-bounces@lists.xensource.com [mailto:xen-devel-bounces@lists.
xensource.com] On Behalf Of Zhuo Song
Sent: Wednesday, November 24, 2010 9:17 PM
To: xen-devel@lists.xensource.com
Cc: yu.zhao@intel.com
Subject: [Xen-devel] about sr-iov

 

Hi,

 

I got a problem when prepared to pass-thru 82576 ethernet card with SR-IOV
support. 

 

The 82576 card is build-in on the board. When loading igb driver for the
card, dmesg show some errors like:

 

pci 0000:05:00.0: BAR 10: can't allocate mem resource
[0xfbf00000-0xfbefffff]

…

igb 0000:05:00.0: not enough MMIO resources for SR-IOV

igb 0000:05:00.0: Failed to initialize SR-IOV virtualization

 

Some system information from DMI as below:

 

XEN 4.0.0, DOM0 kernel 2.6.32, igb driver 2.2.9

 

System Information

        Manufacturer: HP

        Product Name: ProLiant DL160 G6  

 

BIOS Information

        Vendor: HP

        Version: O33

        Release Date: 06/10/2009

        Address: 0xF0000

        Runtime Size: 64 kB

        ROM Size: 2048 kB

        BIOS Revision: 8.15

 

LAN option rom, the version is intel agent boot GE 1.3.24, PXE2.1

 

Processor Information

        Socket Designation: Proc 2

        Type: Central Processor

        Family: Xeon

        Manufacturer: Intel            

        Signature: Type 0, Family 6, Model 26, Stepping 5

Version: Intel(R) Xeon(R) CPU           E5504  @ 2.00GHz

 

The same igb driver works well on a dell server with 82576 adapter. I
thought BIOS got some problem to assign right memory for VFs and I tried to
pass *pci=assign-busses* to kernel, but it still failed. Does the 82576 card
SR-IOV need a BIOS enable and a *REBOOT* to make the function active?  Can
anyone just give me some ideas? Thanks.

 

Best Regards

face

Zhuo Song

Gif me a visky, ginger ale on the side.

 


[-- Attachment #1.1.2: Type: text/html, Size: 13896 bytes --]

[-- Attachment #1.2: image001.jpg --]
[-- Type: image/jpeg, Size: 1068 bytes --]

[-- Attachment #2: Type: text/plain, Size: 138 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel

RE: about sr-iov

[Zhuo Song]

Konrad,

Just when dom0 loading the igb driver and I had not created any guest.

Best Regards

Zhuo Song
Gif me a visky, ginger ale on the side.

On Wed, Nov 24, 2010 at 09:16:50PM +0800, Zhuo Song wrote:
> Hi,
> 
>  
> 
> I got a problem when prepared to pass-thru 82576 ethernet card with SR-IOV
> support. 

To a PV guest? Or is this just when you were booting up the machine and
tried
to initialize the card?
> 
>  
> 
> The 82576 card is build-in on the board. When loading igb driver for the
> card, dmesg show some errors like:
> 
>  
> 
> pci 0000:05:00.0: BAR 10: can't allocate mem resource
> [0xfbf00000-0xfbefffff]
> 
> .
> 
> igb 0000:05:00.0: not enough MMIO resources for SR-IOV
> 
> igb 0000:05:00.0: Failed to initialize SR-IOV virtualization
> 
>  
> 
> Some system information from DMI as below:
> 
>  
> 
> XEN 4.0.0, DOM0 kernel 2.6.32, igb driver 2.2.9
> 
>  
> 
> System Information
> 
>         Manufacturer: HP
> 
>         Product Name: ProLiant DL160 G6  
> 
>  
> 
> BIOS Information
> 
>         Vendor: HP
> 
>         Version: O33
> 
>         Release Date: 06/10/2009
> 
>         Address: 0xF0000
> 
>         Runtime Size: 64 kB
> 
>         ROM Size: 2048 kB
> 
>         BIOS Revision: 8.15
> 
>  
> 
> LAN option rom, the version is intel agent boot GE 1.3.24, PXE2.1
> 
>  
> 
> Processor Information
> 
>         Socket Designation: Proc 2
> 
>         Type: Central Processor
> 
>         Family: Xeon
> 
>         Manufacturer: Intel            
> 
>         Signature: Type 0, Family 6, Model 26, Stepping 5
> 
> Version: Intel(R) Xeon(R) CPU           E5504  @ 2.00GHz
> 
>  
> 
> The same igb driver works well on a dell server with 82576 adapter. I
> thought BIOS got some problem to assign right memory for VFs and I tried
to
> pass *pci=assign-busses* to kernel, but it still failed. Does the 82576
card
> SR-IOV need a BIOS enable and a *REBOOT* to make the function active?  Can
> anyone just give me some ideas? Thanks.
> 
>  
> 
> Best Regards
> 
> face
> 
> Zhuo Song
> 
> Gif me a visky, ginger ale on the side.
> 
>  
> 



> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xensource.com
> http://lists.xensource.com/xen-devel


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel

RE: Re: about sr-iov

[Zhuo Song]

Brian,

Thanks for your information and I'd like to give them a call. 
But I also concern that why it still failed when I tried to make os kernel
do allocation for the pci buses. 
It seems very interesting if it could be a work around for the BIOS with no
sr-iov enabled.

Best Regards

Zhuo Song
Gif me a visky, ginger ale on the side.

Konrad Rzeszutek Wilk <konrad.wilk <at> oracle.com> writes:

> 
> On Wed, Nov 24, 2010 at 09:16:50PM +0800, Zhuo Song wrote:
> > Hi,
> > I got a problem when prepared to pass-thru 82576 ethernet card with
SR-IOV
> > support. 
> 

It sounds like the HP system does have VT-d enabled or it does not support
SR-
IOV in the BIOS. I would check the HP support site or give them a call.

Take a look at either of these sites below for more information on SR-IOV.
http://www.youtube.com/watch?v=hRHsk8Nycdg 

http://community.citrix.com/display/ocb/2010/09/14/Citrix+Provisioning+Serve
r+G
ets+Virtual+with+SR-IOV

http://communities.intel.com/community/wired/blog/2010/03/01/setting-up-red-
hat-54-xen-for-sr-iov-using-the-intel-82576-gbe 

Brian Johnson
LAN Access Division - Intel Corp
10Gb Ethernet and Virtualization Technologies




_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel