Re: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCP portsfrom the host TCP port space.

From: ssufficool <ssufficool@roadrunner.com>
To: David Miller <davem@davemloft.net>
Cc: jeff@garzik.org, netdev@vger.kernel.org, rdreier@cisco.com,
	linux-kernel@vger.kernel.org, general@lists.openfabrics.org
Subject: Re: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCP portsfrom the host TCP port space.
Date: Sun, 19 Aug 2007 21:31:40 -0700	[thread overview]
Message-ID: <1187584300.26620.5.camel@gentoo-linux.localdomain> (raw)
In-Reply-To: <20070819.002337.06589160.davem@davemloft.net>

[-- Attachment #1.1: Type: text/plain, Size: 2478 bytes --]

We implemented a small office solution using Infiniband purely on a cost
per performance mark. We have a small cluster of 10 servers and for less
that 120K, all from HP. 

Pure and simple, Infiniband offers the best price per performance when
considering SAN and MPI consolidation vs F.C. + GbE. 

Not limited to top 500 HPC anymore, just those with common sense.

On Sun, 2007-08-19 at 00:23 -0700, David Miller wrote:

> From: "Sean Hefty" <sean.hefty@intel.com>
> Date: Sun, 19 Aug 2007 00:01:07 -0700
> 
> > Millions of Infiniband ports are in operation today.  Over 25% of the top 500
> > supercomputers use Infiniband.  The formation of the OpenFabrics Alliance was
> > pushed and has been continuously funded by an RDMA customer - the US National
> > Labs.  RDMA technologies are backed by Cisco, IBM, Intel, QLogic, Sun, Voltaire,
> > Mellanox, NetApp, AMD, Dell, HP, Oracle, Unisys, Emulex, Hitachi, NEC, Fujitsu,
> > LSI, SGI, Sandia, and at least two dozen other companies.  IDC expects
> > Infiniband adapter revenue to triple between 2006 and 2011, and switch revenue
> > to increase six-fold (combined revenues of 1 billion).
> 
> Scale these numbers with reality and usage.
> 
> These vendors pour in huge amounts of money into a relatively small
> number of extremely large cluster installations.  Besides the folks
> doing nuke and whole-earth simulations at some government lab, nobody
> cares.  And part of the investment is not being done wholly for smart
> economic reasons, but also largely publicity purposes.
> 
> So present your great Infiniband numbers with that being admitted up
> front, ok?
> 
> It's relevance to Linux as a general purpose operating system that
> should be "good enough" for %99 of the world is close to NIL.
> 
> People have been pouring tons of money and research into doing stupid
> things to make clusters go fast, and in such a way that make zero
> sense for general purpose operating systems, for ages.  RDMA is just
> one such example.
> 
> BTW, I find it ironic that you mention memory bandwidth as a retort,
> as Roland's favorite stateless offload devil, TSO, deals explicity
> with lowering the per-packet BUS bandwidth usage of TCP.  LRO
> offloading does likewise.
> _______________________________________________
> general mailing list
> general@lists.openfabrics.org
> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
> 
> To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general

[-- Attachment #1.2: Type: text/html, Size: 3938 bytes --]

[-- Attachment #2: Type: text/plain, Size: 0 bytes --]