Archives


- Beowulf
- Beowulf Announce
- Scyld-users
- Beowulf on Debian

[Beowulf] using two separate networks for different data streams

Many of your questions may have already been answered in earlier discussions or in the FAQ. The search results page will indicate current discussions as well as past list serves, articles, and papers.

Search

Mark Hahn hahn at physics.mcmaster.ca
Fri Jan 27 08:51:24 PST 2006


>   I've seen architectures with two network switchs, one is used for I/O 
> (writing, reading, so on) and another for message passing (MPI). how is 
> this achieved? I get the idea, from one place, where the applications 
> running must be aware of this but I was thinking that for this to work it 
> must be transparent to the application. How can this be achieved?

in short: you assign a different IP to each interface (as normal).
it's convenient to use one non-low-order in the IP to distinguish,
and also nice to have separate hostnames like node1 and node1-mpi.

I wonder whether anyone has critically evaluated whether this is important.
cluster people I talk to like to say fuzzy things like "separate networks 
make the cluster breathe better".  

as much as I admire car analogies, I observe that when apps are doing IO,
they tend not to be doing MPI.  if your workload is like that, bonding
rather than partitioning would actually improve performance.  I wonder
whether the partitioning approach might actual reflect other constraints, 
such as using half-duplex hubs, or low-bisection networks.

regards, mark hahn.




More information about the Beowulf mailing list