[Beowulf] 10G networking?
Gavin W. Burris
bug at wharton.upenn.edu
Fri Jan 23 05:24:59 PST 2015
We just launched a new cluster, all with 10gigE. What kind of numbers
are you looking for? Most of our workload is data analysis or
iterations of a simulation with commercial software, though we do
validate and support Open MPI. We just opened the doors and are still
working the kinks out, but maybe I can find time to run a benchmark
sometime soon. My only benchmarks so far have been storage with IOzone
and single node with Intel LINPACK. What benchmark do you suggest?
On 01:36AM Fri 01/23/15 -0500, Mark Hahn wrote:
> Hi all,
> I'd appreciate any comments about the state of 10G as a reasonable
> cluster network. Have you done any recent work on 10G performance?
> shows some excellent evidence-based work on kernel paths, but it seems
> focused on bulk/saturation, rather than single-packet latency.
> (not that 10G MPI wouldn't be saturated in a lot of cases vs FDR!)
> I also read some comments recently about improvements that particularly
> benefit certain Intel adapters - anyone have comments on Intel vs Broadcom
> (vs Mellanox, I suppose).
> It seems like 10gT is on the cusp of real volume-type prices: I saw a quote
> today for a major-vendor 24pt switch for something like $140/port
> after educational discounts. I know 10gT is somewhat higher latency
> than other PHYs - or is it worth sticking to SFP+? Any comments on latency
> properties of various switches? Any nice results of recent hardware and
> much appreciated!
> -mark hahn
> Beowulf mailing list, Beowulf at beowulf.org sponsored by Penguin Computing
> To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf
Gavin W. Burris
Senior Project Leader for Research Computing
The Wharton School
University of Pennsylvania
More information about the Beowulf