[Beowulf] curiosity killed the cat

Christopher Samuel samuel at unimelb.edu.au
Thu Jun 2 16:28:19 PDT 2016

On 03/06/16 06:54, Douglas Eadline wrote:

> Many of the 10Gbe (and above) vendors seem to
> be paying more attention to performance than
> before. I like that for my small scale Limulus
> boxes I can get 8-9 usec latency using tcp,

Yeah, a small Haswell cluster on an untuned 100GigE switch that I'm
helping some folks out at the moment measures 6.12us for a zero byte MPI
ping over TCP/IP versus 1.28us measured on our own Haswell FDR14 IB
cluster (both Open-MPI).

If the people bringing up this 100gigE cluster can ever get RoCE to work
it'll be interesting to see how close to the IB numbers we can get.

 Christopher Samuel        Senior Systems Administrator
 VLSCI - Victorian Life Sciences Computation Initiative
 Email: samuel at unimelb.edu.au Phone: +61 (0)3 903 55545
 http://www.vlsci.org.au/      http://twitter.com/vlsci

More information about the Beowulf mailing list