From: Joe Landman <landman-nyOC7EYE20mM0MU9lROt9DlRY1/6cnIP@public.gmane.org>
To: jeff-ruUnomVL5WBWk0Htik3J/w@public.gmane.org
Cc: linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
Subject: Re: rdma problems on Sun / ConnectX hardware
Date: Sun, 03 Jan 2010 15:19:47 -0500 [thread overview]
Message-ID: <4B40FBE3.3070306@scalableinformatics.com> (raw)
In-Reply-To: <20100103200023.169DF1D90008-uDbadAYOwZ9eoWH0uzbU5w@public.gmane.org>
Jeff Haferman wrote:
> I tried posting this to general-ZwoEplunGu1OwGhvXhtEPSCwEArCW2h5@public.gmane.org and got an auto-reply saying that
> list is no longer active and to instead post here... I posted here a few days ago but
> no response, so, my question is, does anyone have any ideas, or, is there a more
> appropriate place to post?
Hi Jeff
This should be fine.
[...]
>
> I've made a bit of progress, with the latest ibtools there is a "-F" option that can be
> passed to "ib_write_lat" to ignore cpufreq stuff, and I now get latencies returned.
>
> "rping" however always seems to fail with CQ errors.
>
> mvapich / openmpi over infiniband usually fails with CQ errors but sometimes my test
> programs run to completion.
[...]
>> lspci | grep -i infin
>> 0b:00.0 InfiniBand: Mellanox Technologies MT25418 [ConnectX IB DDR, PCIe 2.0 2.5GT/s] (rev a0)
>>
>> mstflint -d 0b:00.0 q
>> Image type: ConnectX
>> FW Version: 2.6.0
This is an old firmware. Can you update to 2.6.100 or 2.7.0?
[...]
>> Linux kernel = 2.6.18-92.1.26.el5_lustre.1.6.7.2smp
This also could be an issue ... the 2.6.18 kernel is ancient. Of course
with the Lustre patches, you might not be able to use a more modern
kernel. 1.8.x Lustre might allow you to update the kernel. I don't
know if 1.5 OFED works with Lustre just yet. Which OFED stack are you
using?
Joe
--
Joseph Landman, Ph.D
Founder and CEO
Scalable Informatics, Inc.
email: landman-nyOC7EYE20mM0MU9lROt9DlRY1/6cnIP@public.gmane.org
web : http://scalableinformatics.com
http://scalableinformatics.com/jackrabbit
phone: +1 734 786 8423 x121
fax : +1 866 888 3112
cell : +1 734 612 4615
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
next prev parent reply other threads:[~2010-01-03 20:19 UTC|newest]
Thread overview: 4+ messages / expand[flat|nested] mbox.gz Atom feed top
2010-01-03 20:00 rdma problems on Sun / ConnectX hardware Jeff Haferman
[not found] ` <20100103200023.169DF1D90008-uDbadAYOwZ9eoWH0uzbU5w@public.gmane.org>
2010-01-03 20:19 ` Joe Landman [this message]
-- strict thread matches above, loose matches on Subject: below --
2009-12-31 19:08 Jeff Haferman
[not found] ` <20091231190859.041281D90009-uDbadAYOwZ9eoWH0uzbU5w@public.gmane.org>
2010-01-04 2:36 ` Frank Leers
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=4B40FBE3.3070306@scalableinformatics.com \
--to=landman-nyoc7eye20mm0mu9lrot9dlry1/6cnip@public.gmane.org \
--cc=jeff-ruUnomVL5WBWk0Htik3J/w@public.gmane.org \
--cc=linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.