[Beowulf] copying big files

Perry E. Metzger perry at piermont.com
Fri Aug 8 09:57:16 PDT 2008


Henning Fehrmann <henning.fehrmann at aei.mpg.de> writes:
> Coping a big file onto all nodes in a cluster is a rather common problem.
> I would have thought that there might be a standard tool for 
> distributing the files in an efficient way. So far, I haven't found one.

bittorrent works quite well, and is trivial to use. It will use all
your IO bandwidth between all nodes (which is what you want I
presume.)

Perry
-- 
Perry E. Metzger		perry at piermont.com



More information about the Beowulf mailing list