[Beowulf] copying big files
Perry E. Metzger
perry at piermont.com
Fri Aug 8 09:57:16 PDT 2008
Henning Fehrmann <henning.fehrmann at aei.mpg.de> writes:
> Coping a big file onto all nodes in a cluster is a rather common problem.
> I would have thought that there might be a standard tool for
> distributing the files in an efficient way. So far, I haven't found one.
bittorrent works quite well, and is trivial to use. It will use all
your IO bandwidth between all nodes (which is what you want I
presume.)
Perry
--
Perry E. Metzger perry at piermont.com
More information about the Beowulf
mailing list