[Beowulf] Announcing nettee 0.1.4
Many of your questions may have already been answered in earlier discussions or in the FAQ. The search results page will indicate current discussions as well as past list serves, articles, and papers.
David Mathog mathog at mendel.bio.caltech.eduTue May 3 13:35:32 PDT 2005
- Previous message: [Beowulf] Re: vectors vs. loops
- Next message: [Beowulf] Announcing nettee 0.1.4
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
nettee is a network "tee" program derived from Felix Rauch Valenti's dolly program. nettee can create a network daisychain which passes a data stream along at full network bandwidth while (optionally) writing the data to each local node. If your disks are slow and the data larger than disk cache then it will only move data as fast as the disks can be written. Otherwise speeds up up to 11.3 Mb/sec were observed (100baseT). So nettee is useful for distributing large files or in conjunction with SystemImager to clone nodes. Additionally nettee can be configured to create a command chain that lets the same command run on every node in the chain with only a .01s delay from the time it is issued to the time it runs on all nodes (chain of length 20, 100baseT switched network.) The downside - stdout and stderr are usually lost or unusable. Example scripts showing a few uses for the program are provided in the distribution. Instructions for using nettee with SystemImager are found in the README.TXT file. Look here for more info: http://saf.bio.caltech.edu/nettee.html The program is still in alpha. It has been pretty reliable for me so far but your mileage may vary. And yes, I did look at netcat. In simple tests nettee moves large blocks of data about 25% faster than netcat does. I have not attempted to figure out why nettee is faster. Regards, David Mathog mathog at caltech.edu Manager, Sequence Analysis Facility, Biology Division, Caltech
- Previous message: [Beowulf] Re: vectors vs. loops
- Next message: [Beowulf] Announcing nettee 0.1.4
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
More information about the Beowulf mailing list
