[Beowulf] copying big files (Henning Fehrmann)

[Jason Clinton]

On Fri, Aug 8, 2008 at 11:11 AM, David Mathog <mathog at caltech.edu> wrote:
> Henning Fehrmann <henning.fehrmann at aei.mpg.de> wrote:
>
>> Coping a big file onto all nodes in a cluster is a rather
>> common problem. I would have thought that there might be a
>> standard tool for distributing the files in an efficient way.
>> So far, I haven't found one.

We have used udpcast successfully hundreds of times:
http://udpcast.linux.lu/

Only complaint would be that it doesn't handle a machine dropping out
on the receive side very well. With a little patch, it could be made
to be forgiving in that regard.

--
Jason D. Clinton
Advanced Clustering Technologies, Inc.