[Beowulf] curiosity killed the cat

Christopher Samuel samuel at unimelb.edu.au
Thu Jun 2 16:28:19 PDT 2016


On 03/06/16 06:54, Douglas Eadline wrote:

> Many of the 10Gbe (and above) vendors seem to
> be paying more attention to performance than
> before. I like that for my small scale Limulus
> boxes I can get 8-9 usec latency using tcp,

Yeah, a small Haswell cluster on an untuned 100GigE switch that I'm
helping some folks out at the moment measures 6.12us for a zero byte MPI
ping over TCP/IP versus 1.28us measured on our own Haswell FDR14 IB
cluster (both Open-MPI).

If the people bringing up this 100gigE cluster can ever get RoCE to work
it'll be interesting to see how close to the IB numbers we can get.

cheers,
Chris
-- 
 Christopher Samuel        Senior Systems Administrator
 VLSCI - Victorian Life Sciences Computation Initiative
 Email: samuel at unimelb.edu.au Phone: +61 (0)3 903 55545
 http://www.vlsci.org.au/      http://twitter.com/vlsci


More information about the Beowulf mailing list