[Beowulf] copying big files (Henning Fehrmann)

Carsten Aulbert carsten.aulbert at aei.mpg.de
Fri Aug 8 23:50:31 PDT 2008


Perry E. Metzger wrote:

> Is there a reason bittorrent isn't suited to this application?

Our investigations so far showed that bittorrent is only good if the
files to be transferred fit well into main memory. If you exceed about
90-95% of the RAM your disks will be accessed a lot and the performance
breaks down a lot (we have seen close to wirespeed in the beginning and
in the end we were crawling with mere few 10 kByte/s).



Dr. Carsten Aulbert - Max Planck Institute for Gravitational Physics
Callinstrasse 38, 30167 Hannover, Germany
Phone/Fax: +49 511 762-17185 / -17193
http://www.top500.org/system/9234 | http://www.top500.org/connfam/6/list/31
-------------- next part --------------
A non-text attachment was scrubbed...
Name: carsten_aulbert.vcf
Type: text/x-vcard
Size: 414 bytes
Desc: not available
URL: <http://www.beowulf.org/pipermail/beowulf/attachments/20080809/54fb1cda/attachment.vcf>

More information about the Beowulf mailing list