[Beowulf] Q: IB message rate & large core counts (per node)?

[Greg Lindahl]

> Mellanox latest message rate numbers with ConnectX-2 more than
> doubled versus the old cards, and are for real message rate -
> separate messages on the wire. The competitor numbers are with using
> message coalescing, so it is not real separate messages on the wire,
> or not really message rate.

Gilad,

I think you forgot which side you're supposed to be supporting.

The only people I have ever seen publish message rate with coalesced
messages are DK Panda (with Mellanox cards) and Mellanox.

QLogic always hated coalesced messages, and if you look back in the
archive for this mailing list, you'll see me denouncing coalesced
messages as meanless about 1 microsecond after the first result was
published by Prof. Panda.

Looking around the Internet, I don't see any numbers ever published by
PathScale/QLogic using coalesced messages.

At the end of the day, the only reason microbenchmarks are useful is
when they help explain why one interconnect does better than another
on real applications. No customer should ever choose which adapter to
buy based on microbenchmarks.

-- greg
(formerly employed by QLogic)