Software IB switch/router

Software IB switch/router

[Robert LeBlanc]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

If I wanted to do something stupid and create a white-box Infiniband
switch/router, is there some software that does that? Is it even
possible?

Thanks,
- ----------------
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904  C70E E654 3BB2 FA62 B9F1
-----BEGIN PGP SIGNATURE-----
Version: Mailvelope v1.3.6
Comment: https://www.mailvelope.com

wsFcBAEBCAAQBQJXDtGcCRDmVDuy+mK58QAArdQQALhcHFKODqo2Y8b4dnhQ
oQZr+DtFb3n45fRYahm1PrgaCwg9kOppGq6C0bK+utd+dvMftfM4AzJgYyFH
59Deg5DZZx5YANDJjzHT9TM7nIwEyH8hA7Wt2yyI1n2LTycJjBIHB0IOUank
E+ktBKcSPNfowETf6Tke+k6Aq4bEWcFNiVIFwhx8/xzfKdhYNuV60EpsrCRt
yCrQJvSRpq+ph5c25rhF/kfSe/k6o1ofw11mxv2FgFWlNdUU/uOMYW5v7+B/
JeeStY70Z1IFvWHkXt6TIavCO3zLJY+nfwZD/8+TmVc/Tzi+xSeINPyKnpki
ZcKo+yRTAgffBaHvzEWlu/9Squ3FA2WKDsLnzeSOV0k8HkgGKUIFErkP1c+Q
gc3FzzCus6qqX3NmivpJZpuE4qvT12vQPFq94drhnd+2D9fjkYE97hyk+MzR
fdVZh/eiTWHmM5I8Sp+ESdXVNpRBdgCo0LjROhhp1nqhC41XvN9jjTGJ+WxX
VrE4ccgKuoY1yvCPKzvo6Evf61PIWWCtJpyAsig20CBdp2VPJ9u/jXZlAnUG
bifz0HEqaM84jGbfTCP/zIANN79ojC9LMdH92UkxD38Q8oxULoY1KawyPbWF
gmvFJo5SOI+IYXgEU+Oiij5caDswuBanj8mIfSTAhQnZPxDvEcBeruEMul2d
rrLh
=n6Xf
-----END PGP SIGNATURE-----
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

RE: Software IB switch/router

[Hefty, Sean]

> If I wanted to do something stupid and create a white-box Infiniband
> switch/router, is there some software that does that? Is it even
> possible?

I'm not aware of any open source software to do this.

IB routers are not defined by the IB specification.  You may be able to cobble something together, but you would need to define much of the behavior yourself.

You might be able to create a switch, but you would need an HCA that can disable offloaded transport processing (e.g. Truescale HCAs handle transport processing on the host).

- Sean

Re: [Users] Software IB switch/router

[Kevin J Moran]

There were some presentations that discussed IB Routing and the 
challenges/availability at the recent Open Fabrics Workshop in 
Monterey.  Here is a link to a site that has both the slides and the 
videos (some chose not to allow video) from the workshop 
http://insidehpc.com/2016-open-fabrics-workshop-video-gallery/

Regards,

Kevin


On 4/13/16 6:18 PM, Hefty, Sean wrote:
>> If I wanted to do something stupid and create a white-box Infiniband
>> switch/router, is there some software that does that? Is it even
>> possible?
> I'm not aware of any open source software to do this.
>
> IB routers are not defined by the IB specification.  You may be able to cobble something together, but you would need to define much of the behavior yourself.
>
> You might be able to create a switch, but you would need an HCA that can disable offloaded transport processing (e.g. Truescale HCAs handle transport processing on the host).
>
> - Sean
> _______________________________________________
> Users mailing list
> Users-ZwoEplunGu1OwGhvXhtEPSCwEArCW2h5@public.gmane.org
> http://lists.openfabrics.org/mailman/listinfo/users

--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Software IB switch/router

[Leon Romanovsky]

[-- Attachment #1: Type: text/plain, Size: 488 bytes --]

On Wed, Apr 13, 2016 at 05:09:36PM -0600, Robert LeBlanc wrote:
> If I wanted to do something stupid and create a white-box Infiniband
> switch/router, is there some software that does that? Is it even
> possible?

As Kevin pointed below, Mellanox presented IB router [1] at the OFA16.
The product is totally open-source and the code will be posted on
linux-rdma list in the near future.

[1]
https://www.openfabrics.org/images/eventpresos/2016presentations/314IBRouterPrem.pdf

Thanks.


[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 819 bytes --]

Re: Software IB switch/router

[Robert LeBlanc]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

Thanks for the link. It looks like the routing is done by a Mellanox
device and not by a white-box device. I'm guessing the code would be
the enhancements to OpenSM to support IB routing.
-----BEGIN PGP SIGNATURE-----
Version: Mailvelope v1.3.6
Comment: https://www.mailvelope.com

wsFcBAEBCAAQBQJXETSMCRDmVDuy+mK58QAAZ7MQAMuLy6q4cYZLUKYQWHK1
UvTFUQJHsFCRZh+UN0lh05Z25OZihVAFj1dPOXS2kqyITjDntA5EvndSmGwT
Ey0xHVpnFan8s4qMEvLPtJ7fEsvamW0gh8wMAvgk42kW7c06M7bsMCESt57p
lf9t+hDD/WudOR1A+HUFmQXlqdC2GnPXCl9fKJAUmUBxZ1AzUvJNioe+QRWf
nnEyVY8Axqu9u8yJ42oxxy9bpMlFDCjRmgb9ZDiDo/aJmlcIcC+hAhA41x69
YqZQPxHsj0U8JKJ/U+KDoB/KWPSDXsouOcXe0aock3lgR4iyfUHGspgzby3F
n498AV2KTMUe2K2k8Clh+Bh6w3AsEgIqW/o3VXVaOLYxOOsNkHZXZXoEQLKX
1neJD54fVX3a62PSTjcU4UJlGtQSuW1QFt89qM/4Ko1yiaYCnRPL7qik/0Oa
sSigArOTusNe7XA8wd6cEaaUFxR0V7swIcwQC7LlcPaGhKWhUKWbR3oZsFV2
YEAOvGKFfTmFWjssj0R3dPmh/3zAOdGEq5SgFqLwul+DLoXnTKI9gvOWQADZ
1knUYPXPhBx/NMYQ5f9R4x61lrynLCbnBDie1lmASWnWpTNfVsNLCh1IoyTy
mo87poDyw4xLLfqkhM2XYskaPBRMG3a6pGpsbiltPjbv26VMchpAu0zK4Eco
Jue6
=WBYj
-----END PGP SIGNATURE-----
----------------
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904  C70E E654 3BB2 FA62 B9F1


On Wed, Apr 13, 2016 at 11:10 PM, Leon Romanovsky <leon-2ukJVAZIZ/Y@public.gmane.org> wrote:
> On Wed, Apr 13, 2016 at 05:09:36PM -0600, Robert LeBlanc wrote:
>> If I wanted to do something stupid and create a white-box Infiniband
>> switch/router, is there some software that does that? Is it even
>> possible?
>
> As Kevin pointed below, Mellanox presented IB router [1] at the OFA16.
> The product is totally open-source and the code will be posted on
> linux-rdma list in the near future.
>
> [1]
> https://www.openfabrics.org/images/eventpresos/2016presentations/314IBRouterPrem.pdf
>
> Thanks.
>
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html