[Beowulf] Accelerator for data compressing

[Carsten Aulbert]

Hi all

Bill Broadley wrote:
> 
> Another example:
> http://bbs.archlinux.org/viewtopic.php?t=11670
> 
> 7zip compress: 19:41
> Bzip2 compress:  8:56
> Gzip compress:  3:00
> 
> Again 7zip is a factor of 6 and change slower than gzip.

Have you looked into threaded/parallel bzip2?

freshmeat has a few of those, e.g.

http://freshmeat.net/projects/bzip2smp/
http://freshmeat.net/projects/lbzip2/

(with the usual disclaimer that I haven't tested them myself).

HTH

carsten