Archives


- Beowulf
- Beowulf Announce
- Scyld-users
- Beowulf on Debian

[Beowulf] copying big files

Many of your questions may have already been answered in earlier discussions or in the FAQ. The search results page will indicate current discussions as well as past list serves, articles, and papers.

Search

Perry E. Metzger perry at piermont.com
Fri Aug 8 09:57:16 PDT 2008


Henning Fehrmann <henning.fehrmann at aei.mpg.de> writes:
> Coping a big file onto all nodes in a cluster is a rather common problem.
> I would have thought that there might be a standard tool for 
> distributing the files in an efficient way. So far, I haven't found one.

bittorrent works quite well, and is trivial to use. It will use all
your IO bandwidth between all nodes (which is what you want I
presume.)

Perry
-- 
Perry E. Metzger		perry at piermont.com



More information about the Beowulf mailing list