[Beowulf] One network, or two?

[Buccaneer for Hire.]

--- On Tue, 9/23/08, Greg Lindahl <lindahl at pbm.com> wrote:

> From: Greg Lindahl <lindahl at pbm.com>
> Subject: Re: [Beowulf] One network, or two?
> To: beowulf at beowulf.org
> Date: Tuesday, September 23, 2008, 1:20 PM
> On Tue, Sep 23, 2008 at 03:21:55PM -0400, Joshua
> Baker-LePain wrote:
> 
> > In theory, it's a great idea.  In practice, wiring
> up an entire 2nd  
> > network gets to be a major PITA (as well as being
> uncheap) as your 
> > cluster size increases.  I've got ~350 nodes here,
> and a 2nd set of 
> > cabling is really, really low on the list of projects
> I'd like to tackle.
> 
> I can name a bunch of 350 node clusters that have multiple
> networks.
> So, obviously, YMMV.
> 
> -- greg

We are putting in a large cluster as I write this-1250 compute nodes (10,000 cores). We are using two networks-one for management and monitoring (Gb) and one for production (10G).  It works like a dream.