Re: mellanox mlx4_core and SR-IOV

Yinghai Lu
2012-08-03T16:41:33Z

On Fri, Aug 3, 2012 at 1:33 AM, Lukas Hejtmanek <xhejtman@ics.muni.cz> wrote:
> On Wed, Aug 01, 2012 at 04:36:14PM -0700, Yinghai Lu wrote:
>> > so it seems, that pic=nocsr is a must now.
>>
>> yes. Or you have bios provide SRIOV support or 64 bit resource in _CRS.
>
> Well, I can use PCI passthrough in Xen now, however, it seems SR-IOV does not
> work in case of Mellanox mlx4 driver.
>
> With 3.5 stock kernel, I got this message in virtual domain:
> [ 2.666623] mlx4_core: Mellanox ConnectX core driver v1.1 (Dec, 2011)
> [ 2.666635] mlx4_core: Initializing 0000:00:00.1
> [ 2.666717] mlx4_core 0000:00:00.1: enabling device (0000 -> 0002)
> [ 2.666975] mlx4_core 0000:00:00.1: Xen PCI mapped GSI0 to IRQ168
> [ 2.667040] mlx4_core 0000:00:00.1: enabling bus mastering
> [ 2.667184] mlx4_core 0000:00:00.1: Detected virtual function - running in slave mode
> [ 2.667214] mlx4_core 0000:00:00.1: Sending reset
> [ 2.667319] mlx4_core 0000:00:00.1: Sending vhcr0
> [ 2.667886] mlx4_core 0000:00:00.1: HCA minimum page size:1
> [ 2.668067] mlx4_core 0000:00:00.1: The host doesn't support eth interface
> [ 2.668074] mlx4_core 0000:00:00.1: QUERY_FUNC_CAP command failed, aborting.
> [ 2.668079] mlx4_core 0000:00:00.1: Failed to obtain slave caps
> [ 2.668305] mlx4_core: probe of 0000:00:00.1 failed with error -93
>
> not sure what does it mean.

did you check if SRIOV bar for that card is assigned in DOM0 ?

can you kvm with pci pass through?

I only tried pci through with intel igb and ixgbe sriov device with
kvm recently.

please make sure you have intel_iommu=on ...

Thanks

Yinghai