[Beowulf] MPI over RoCE?

Prentice Bisbal prentice at ucar.edu
Fri Mar 7 21:53:34 UTC 2025


On 3/7/25 1:14 AM, Greg Lindahl wrote:
> On Thu, Feb 27, 2025 at 12:28:11PM -0500, Prentice Bisbal wrote:
>
>> I hope this isn't a dumb question: Do the Ethernet switches you're
>> looking at have crossbar switches inside them?
> No modern switch chip has a crossbar. They're rings, and the ring has
> high enough capacity to work as well as a crossbar would.

I don't think this is true anymore. I've been looking into this myself 
recently, and from what I've been told, some high-end Ethernet switches 
do have crossbar chips inside them. Unfortunately, I haven't been able 
to identify any models that do, but I'm also not a network engineer, so 
I'm not up with the features of all the different models.

Of course if they're only in the "high-end" or "high-performance" 
Ethernet switches, they probably cost as much or more than an IB switch.


-- 
Prentice



More information about the Beowulf mailing list