[Beowulf] Accelerator for data compressing

Thu Oct 2 13:09:36 PDT 2008


 Currently I generate nearly one TB data every few days and I need to pass it
along enterprise network to the storage center attached to my HPC system, I am
thinking about compressing it (most tiff format image data) as much as I can, as
fast as I can before I send it crossing network ... So, I am wondering whether
anyone is familiar with any hardware based accelerator, which can dramatically
improve the compressing procedure.. suggestion for any file system architecture
will be appreciated too..  I have couple of contacts from some vendors but not
sure whether it works as I expected, so if anyone has experience about it and
want to share, it will be really appreciated !



Jerry  Xu  PhD
HPC Scientific Computing Specialist 
Enterprise Research Infrastructure Systems (ERIS) 
Partners Healthcare, Harvard Medical School

The information transmitted in this electronic communication is intended only
for the person or entity to whom it is addressed and may contain confidential
and/or privileged material. Any review, retransmission, dissemination or other
use of or taking of any action in reliance upon this information by persons or
entities other than the intended recipient is prohibited. If you received this
information in error, please contact the Compliance HelpLine at 800-856-1983 and
properly dispose of this information.

More information about the Beowulf mailing list