patch for non-ib network

patch for non-ib network

[javed-If5XQcfNmg0]

hello,

is it possible to add a patch in ofed release for non-ib networks? we've 
integrated ofed with 'paramnet-3' a 10Gbps system area network. currently 
IPoIB is working fine. more details can be provided if required.

thanks for your time.
javed


-- 
This message has been scanned for viruses and
dangerous content by MailScanner, and is
believed to be clean.

--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: patch for non-ib network

[Christoph Lameter]

On Fri, 20 Nov 2009, javed-If5XQcfNmg0@public.gmane.org wrote:

> is it possible to add a patch in ofed release for non-ib networks? we've
> integrated ofed with 'paramnet-3' a 10Gbps system area network. currently
> IPoIB is working fine. more details can be provided if required.

Sure. Mellanox is doing something similar right now. Just be sure to sync
code up.

--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: patch for non-ib network

[Roland Dreier]

 > is it possible to add a patch in ofed release for non-ib networks?
 > we've integrated ofed with 'paramnet-3' a 10Gbps system area
 > network. currently IPoIB is working fine. more details can be provided
 > if required.

I think rather than worrying about OFED, you're better off working on
getting your drivers integrated in the mainline kernel.

However if you just have IPoIB working, and your fabric is not IB, then
I think you might be better off implementing IP-over-paramnet-3 and
avoiding the complexity of the RDMA stack.  Unless paramnet-3 is RDMA-like?
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: patch for non-ib network

[javed-If5XQcfNmg0]

paramnet-3 supports RDMA. there's separate uDAPL interface for fast path 
specifically for MPI apps. tested with MVAPICH2 and intel mpi.

we've started with ofed/IPoIB for TCP/IP support. network is capable of 
exploiting the stack further.

mismatch between ofed requirements and paramnet-3 specs, are covered in 
the patch.

On Sun, 22 Nov 2009, Roland Dreier wrote:

> I think rather than worrying about OFED, you're better off working on 
> getting your drivers integrated in the mainline kernel.
>
> However if you just have IPoIB working, and your fabric is not IB, then 
> I think you might be better off implementing IP-over-paramnet-3 and 
> avoiding the complexity of the RDMA stack.  Unless paramnet-3 is 
> RDMA-like?

-- 
This message has been scanned for viruses and
dangerous content by MailScanner, and is
believed to be clean.

--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: patch for non-ib network

[Roland Dreier]

 > paramnet-3 supports RDMA. there's separate uDAPL interface for fast
 > path specifically for MPI apps. tested with MVAPICH2 and intel mpi.
 > 
 > we've started with ofed/IPoIB for TCP/IP support. network is capable
 > of exploiting the stack further.
 > 
 > mismatch between ofed requirements and paramnet-3 specs, are covered
 > in the patch.

Then I would suggest sending the patch for review and inclusion in the
kernel.  Documentation/SubmittingPatches and Documentation/SubmittingDrivers
in the kernel source tree may be helpful.

However I would still probably think that IPoIB for non-IB networks is
unnecessary complexity -- the mismatch of IB and traditional ethernet/IP
semantics makes even IPoIB a bit of a problem for some apps, and then
layering a not-IB network on top of that is probably not a good idea.

 - R.
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html