[Beowulf] Accelerator for data compressing

[Reuti]

Hi,

Am 02.10.2008 um 22:09 schrieb Xu, Jerry:

>  Currently I generate nearly one TB data every few days and I need  
> to pass it
> along enterprise network to the storage center attached to my HPC  
> system, I am
> thinking about compressing it (most tiff format image data)

is it plain tiff or already using any compression like RLE or LZW  
inside? Do you want or must stay with tiff?

-- Reuti

> as much as I can, as
> fast as I can before I send it crossing network ... So, I am  
> wondering whether
> anyone is familiar with any hardware based accelerator, which can  
> dramatically
> improve the compressing procedure.. suggestion for any file system  
> architecture
> will be appreciated too..  I have couple of contacts from some  
> vendors but not
> sure whether it works as I expected, so if anyone has experience  
> about it and
> want to share, it will be really appreciated !
>
>
>
> Thanks,
>
> Jerry
>
> Jerry  Xu  PhD
> HPC Scientific Computing Specialist
> Enterprise Research Infrastructure Systems (ERIS)
> Partners Healthcare, Harvard Medical School
> http://www.partners.org
>
> The information transmitted in this electronic communication is  
> intended only
> for the person or entity to whom it is addressed and may contain  
> confidential
> and/or privileged material. Any review, retransmission,  
> dissemination or other
> use of or taking of any action in reliance upon this information by  
> persons or
> entities other than the intended recipient is prohibited. If you  
> received this
> information in error, please contact the Compliance HelpLine at  
> 800-856-1983 and
> properly dispose of this information.
>
>
>
>
> _______________________________________________
> Beowulf mailing list, Beowulf at beowulf.org
> To change your subscription (digest mode or unsubscribe) visit  
> http://www.beowulf.org/mailman/listinfo/beowulf