Mellanox VPI

Mellanox VPI

[Vasiliy Tolstov]

Hi All.

I'm interesting of mellanox ConnectX-3 cards that support VPI.
As a read from
http://www.openfabrics.org/downloads/OFED/ofed-1.4/OFED-1.4-docs/mlx4_release_notes.txt
VPI provide ability to autodetect link type or control which type to
use. But does it possible to have on one port 10Gb ethernet and
infiniband together?


-- 
Vasiliy Tolstov,
e-mail: v.tolstov-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
jabber: vase-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Mellanox VPI

[Or Gerlitz]

On Fri, Oct 4, 2013 at 7:33 AM, Vasiliy Tolstov <v.tolstov-+9FY0jupvH6HXe+LvDLADg@public.gmane.org> wrote:
> Hi All.
>
> I'm interesting of mellanox ConnectX-3 cards that support VPI.
> As a read from
> http://www.openfabrics.org/downloads/OFED/ofed-1.4/OFED-1.4-docs/mlx4_release_notes.txt
> VPI provide ability to autodetect link type or control which type to
> use. But does it possible to have on one port 10Gb ethernet and
> infiniband together?

YES
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Mellanox VPI

[Vasiliy Tolstov]

2013/10/4 Or Gerlitz <or.gerlitz-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>:
>> I'm interesting of mellanox ConnectX-3 cards that support VPI.
>> As a read from
>> http://www.openfabrics.org/downloads/OFED/ofed-1.4/OFED-1.4-docs/mlx4_release_notes.txt
>> VPI provide ability to autodetect link type or control which type to
>> use. But does it possible to have on one port 10Gb ethernet and
>> infiniband together?
>
> YES


Where i can find docs about this or can somebody says me how can i do that?

-- 
Vasiliy Tolstov,
e-mail: v.tolstov-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
jabber: vase-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Mellanox VPI

[Or Gerlitz]

On 04/10/2013 09:21, Vasiliy Tolstov wrote:
> Where i can find docs about this or can somebody says me how can i do that?

# lspci | grep Mell

06:00.0 InfiniBand: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 
5GT/s - IB QDR / 10GigE] (rev b0)
07:00.0 Network controller: Mellanox Technologies MT27520 Family

# echo ib > /sys/bus/pci/devices/0000\:06\:00.0/mlx4_port1
# echo eth > /sys/bus/pci/devices/0000\:06\:00.0/mlx4_port2

--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Mellanox VPI

[Or Gerlitz]

On 06/10/2013 12:14, Vasiliy Tolstov wrote:
> As I see this card has two ports. How about eth and ib on the same 
> port in the same time?
not supported, to switch kind of switch you wanted to plug that creature?
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Mellanox VPI

[Vasiliy Tolstov]

2013/10/6 Or Gerlitz <ogerlitz-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>:
> # lspci | grep Mell
>
> 06:00.0 InfiniBand: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0
> 5GT/s - IB QDR / 10GigE] (rev b0)
> 07:00.0 Network controller: Mellanox Technologies MT27520 Family
>
> # echo ib > /sys/bus/pci/devices/0000\:06\:00.0/mlx4_port1
> # echo eth > /sys/bus/pci/devices/0000\:06\:00.0/mlx4_port2


Thanks, but as i see this car have two ports.
How about eth and ib on the same port in the same time?

-- 
Vasiliy Tolstov,
e-mail: v.tolstov-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
jabber: vase-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Mellanox VPI

[Jack Morgenstein]

On Sun, 6 Oct 2013 14:53:18 +0400
Vasiliy Tolstov <v.tolstov-+9FY0jupvH6HXe+LvDLADg@public.gmane.org> wrote:

> 2013/10/6 Or Gerlitz <ogerlitz-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>:
> > # lspci | grep Mell
> >
> > 06:00.0 InfiniBand: Mellanox Technologies MT26428 [ConnectX VPI
> > PCIe 2.0 5GT/s - IB QDR / 10GigE] (rev b0)
> > 07:00.0 Network controller: Mellanox Technologies MT27520 Family
> >
> > # echo ib > /sys/bus/pci/devices/0000\:06\:00.0/mlx4_port1
> > # echo eth > /sys/bus/pci/devices/0000\:06\:00.0/mlx4_port2
> 
> 
> Thanks, but as i see this car have two ports.
> How about eth and ib on the same port in the same time?
> 
You cannot have ETH and IB link layers existing on the same port at the
same time.

However, you can run IB applications over an ETH link layer by using
RoCE (RDMA over Converged Ethernet). If you do:

	ibv_devinfo

on a host where an HCA has a port configured to an ETH link layer,
you should see an entry for the ETH layer port.  Under that port
number, you will see:

	...
	link_layer:	Ethernet

-Jack

--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Mellanox VPI

[Vasiliy Tolstov]

2013/10/6 Jack Morgenstein <jackm-LDSdmyG8hGV8YrgS2mwiifqBs+8SCbDb@public.gmane.org>:
> You cannot have ETH and IB link layers existing on the same port at the
> same time.
>
> However, you can run IB applications over an ETH link layer by using
> RoCE (RDMA over Converged Ethernet). If you do:
>
>         ibv_devinfo
>
> on a host where an HCA has a port configured to an ETH link layer,
> you should see an entry for the ETH layer port.  Under that port
> number, you will see:
>
>         ...
>         link_layer:     Ethernet


Thanks, Jack, for answer.

-- 
Vasiliy Tolstov,
e-mail: v.tolstov-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
jabber: vase-+9FY0jupvH6HXe+LvDLADg@public.gmane.org
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html