* FDR HCA only doing QDR?
@ 2012-08-02 8:18 Albert Strasheim
[not found] ` <CALfB72AFcWfrvRHfh0fRu_0iLt0wdapgwPef6RFe3KockzxeEA-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
0 siblings, 1 reply; 3+ messages in thread
From: Albert Strasheim @ 2012-08-02 8:18 UTC (permalink / raw)
To: linux-rdma-u79uwXL29TY76Z2rM5mHXA
Hello all
I have a single machine setup with a dual port Mellanox FDR controller
with a cable marked "FDR" connected between the two ports.
OpenSM is running on the machine to make the ports active.
However, as far as I can read the ibv_devinfo output, it seems to
report that I'm only getting QDR speeds.
Software versions:
kernel-3.4.4-4.fc16.x86_64
libibverbs-1.1.6-1.fc16.x86_64
libibverbs-utils-1.1.6-1.fc16.x86_64
libmlx4-1.0.2-3.fc16.x86_64
libibumad-1.3.7-1.fc16.x86_64
opensm-3.3.13-2.fc16.x86_64
libibmad-1.3.8-1.fc16.x86_64
As far as I can tell from the changelogs, these versions should have
all the FDR bits. Any suggestions on how to debug this further?
Regards
Albert
hca_id: mlx4_0
transport: InfiniBand (0)
fw_ver: 2.10.600
node_guid: 0002:c903:00f9:ecc0
sys_image_guid: 0002:c903:00f9:ecc3
vendor_id: 0x02c9
vendor_part_id: 4099
hw_ver: 0x0
board_id: MT_1090120019
phys_port_cnt: 2
max_mr_size: 0xffffffffffffffff
page_size_cap: 0xfffffe00
max_qp: 131008
max_qp_wr: 16384
device_cap_flags: 0x007c9c76
max_sge: 32
max_sge_rd: 0
max_cq: 65408
max_cqe: 4194303
max_mr: 524272
max_pd: 32764
max_qp_rd_atom: 16
max_ee_rd_atom: 0
max_res_rd_atom: 2096128
max_qp_init_rd_atom: 128
max_ee_init_rd_atom: 0
atomic_cap: ATOMIC_HCA (1)
max_ee: 0
max_rdd: 0
max_mw: 0
max_raw_ipv6_qp: 0
max_raw_ethy_qp: 0
max_mcast_grp: 8192
max_mcast_qp_attach: 248
max_total_mcast_qp_attach: 2031616
max_ah: 0
max_fmr: 0
max_srq: 65472
max_srq_wr: 16383
max_srq_sge: 31
max_pkeys: 128
local_ca_ack_delay: 15
port: 1
state: PORT_ACTIVE (4)
max_mtu: 4096 (5)
active_mtu: 4096 (5)
sm_lid: 1
port_lid: 1
port_lmc: 0x00
link_layer: InfiniBand
max_msg_sz: 0x40000000
port_cap_flags: 0x0251486a
max_vl_num: 8 (4)
bad_pkey_cntr: 0x0
qkey_viol_cntr: 0x0
sm_sl: 0
pkey_tbl_len: 128
gid_tbl_len: 128
subnet_timeout: 18
init_type_reply: 0
active_width: 4X (2)
active_speed: 10.0 Gbps (8)
phys_state: LINK_UP (5)
GID[ 0]: fe80:0000:0000:0000:0002:c903:00f9:ecc1
port: 2
state: PORT_ACTIVE (4)
max_mtu: 4096 (5)
active_mtu: 4096 (5)
sm_lid: 1
port_lid: 2
port_lmc: 0x00
link_layer: InfiniBand
max_msg_sz: 0x40000000
port_cap_flags: 0x02514868
max_vl_num: 8 (4)
bad_pkey_cntr: 0x0
qkey_viol_cntr: 0x0
sm_sl: 0
pkey_tbl_len: 128
gid_tbl_len: 128
subnet_timeout: 18
init_type_reply: 0
active_width: 4X (2)
active_speed: 10.0 Gbps (8)
phys_state: LINK_UP (5)
GID[ 0]: fe80:0000:0000:0000:0002:c903:00f9:ecc2
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: FDR HCA only doing QDR?
[not found] ` <CALfB72AFcWfrvRHfh0fRu_0iLt0wdapgwPef6RFe3KockzxeEA-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2012-08-02 9:42 ` Roland Dreier
2012-08-02 10:19 ` Alex Netes
1 sibling, 0 replies; 3+ messages in thread
From: Roland Dreier @ 2012-08-02 9:42 UTC (permalink / raw)
To: Albert Strasheim; +Cc: linux-rdma-u79uwXL29TY76Z2rM5mHXA
On Thu, Aug 2, 2012 at 1:18 AM, Albert Strasheim <fullung-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> wrote:
> active_speed: 10.0 Gbps (8)
You actually seem to be getting FDR-10 (raw speed undecoded of 8
instead of QDR==4).
There may be some software/firmware issue but I would double check
that your physical layer is clean -- it may just be that the card is
legitimately deciding it can't do full FDR on the link you have.
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: FDR HCA only doing QDR?
[not found] ` <CALfB72AFcWfrvRHfh0fRu_0iLt0wdapgwPef6RFe3KockzxeEA-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2012-08-02 9:42 ` Roland Dreier
@ 2012-08-02 10:19 ` Alex Netes
1 sibling, 0 replies; 3+ messages in thread
From: Alex Netes @ 2012-08-02 10:19 UTC (permalink / raw)
To: Albert Strasheim; +Cc: linux-rdma-u79uwXL29TY76Z2rM5mHXA
Hi Albert,
On 10:18 Thu 02 Aug , Albert Strasheim wrote:
> Hello all
>
> I have a single machine setup with a dual port Mellanox FDR controller
> with a cable marked "FDR" connected between the two ports.
>
> OpenSM is running on the machine to make the ports active.
>
> However, as far as I can read the ibv_devinfo output, it seems to
> report that I'm only getting QDR speeds.
>
You can double check the speeds by running smpquery PortInfo/MlnxExtPortInfo
-- Alex
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 3+ messages in thread
end of thread, other threads:[~2012-08-02 10:19 UTC | newest]
Thread overview: 3+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2012-08-02 8:18 FDR HCA only doing QDR? Albert Strasheim
[not found] ` <CALfB72AFcWfrvRHfh0fRu_0iLt0wdapgwPef6RFe3KockzxeEA-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2012-08-02 9:42 ` Roland Dreier
2012-08-02 10:19 ` Alex Netes
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).