[Beowulf] copying big files (Henning Fehrmann)

[Perry E. Metzger]

"David Mathog" <mathog at caltech.edu> writes:
> The biggest problem with chain methods is that it is difficult to
> recover if something breaks in the middle during the transfer.  My
> cluster is only 20 nodes and it has not been an issue, but on a 2000
> node cluster it probably would be.  It is of course also important that
> all of the nodes in the distribution chain have sufficient free network
> and CPU resources.  If there are any slow nodes the whole chain will be
> slow since the slow nodes will be rate limiting.

Is there a reason bittorrent isn't suited to this application?

-- 
Perry E. Metzger		perry at piermont.com