From mboxrd@z Thu Jan 1 00:00:00 1970 From: Jason Gunthorpe Subject: Re: Unable to Connect Using Active Speed 2.5 Gbps and Active Width of 1 Date: Mon, 28 Mar 2011 13:41:50 -0600 Message-ID: <20110328194150.GA6205@obsidianresearch.com> References: <4D90D9A2.7000107@dev.mellanox.co.il> <4D90DF38.1060407@dev.mellanox.co.il> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Return-path: Content-Disposition: inline In-Reply-To: Sender: linux-rdma-owner-u79uwXL29TY76Z2rM5mHXA@public.gmane.org To: Alan Cook Cc: linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org List-Id: linux-rdma@vger.kernel.org On Mon, Mar 28, 2011 at 07:26:46PM +0000, Alan Cook wrote: > Hal Rosenstock writes: > > > > LinkWidthEnabled is 1X or 4X and not just 1X. That's because there's no > > force_link_width option in OpenSM so I think the width you set is > > getting overwritten much like the speed was earlier until you discovered > > force_link_speed 0. > > But I see LinkWidthActive set to 1X, which as I understood denoted the width > currently being used. If I set LinkWidthActive to 4X, I am able to transfer > just fine. > > Also, I do see LinkWidthEnabled being changed from "1X" to "1X or 4X" (most > likely by OpenSM as you suggest), but only after the link is up and active. > > I am able to transfer at 5 Gbps 1X and 10 Gbps 1X, just not 2.5 Gbps 1X. Are you using IPoIB to test your ping? You might be having multicast group membership join problems due to a rate mismatch? Try one of the low level verbs only diags. Jason -- To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org More majordomo info at http://vger.kernel.org/majordomo-info.html