[Beowulf] Accelerator for data compressing

[Rodrigo Grumiche Silva]

   Hi Jerry

   I think HDF5 can help you in some way... - http://www.hdfgroup.org/HDF5/

   Rodrigo

2008/10/2 Xu, Jerry <YXU11 at partners.org>

> Hello,
>
>  Currently I generate nearly one TB data every few days and I need to pass
> it
> along enterprise network to the storage center attached to my HPC system, I
> am
> thinking about compressing it (most tiff format image data) as much as I
> can, as
> fast as I can before I send it crossing network ... So, I am wondering
> whether
> anyone is familiar with any hardware based accelerator, which can
> dramatically
> improve the compressing procedure.. suggestion for any file system
> architecture
> will be appreciated too..  I have couple of contacts from some vendors but
> not
> sure whether it works as I expected, so if anyone has experience about it
> and
> want to share, it will be really appreciated !
>
>
>
> Thanks,
>
> Jerry
>
> Jerry  Xu  PhD
> HPC Scientific Computing Specialist
> Enterprise Research Infrastructure Systems (ERIS)
> Partners Healthcare, Harvard Medical School
> http://www.partners.org
>
> The information transmitted in this electronic communication is intended
> only
> for the person or entity to whom it is addressed and may contain
> confidential
> and/or privileged material. Any review, retransmission, dissemination or
> other
> use of or taking of any action in reliance upon this information by persons
> or
> entities other than the intended recipient is prohibited. If you received
> this
> information in error, please contact the Compliance HelpLine at
> 800-856-1983 and
> properly dispose of this information.
>
>
>
>
> _______________________________________________
> Beowulf mailing list, Beowulf at beowulf.org
> To change your subscription (digest mode or unsubscribe) visit
> http://www.beowulf.org/mailman/listinfo/beowulf
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://www.scyld.com/pipermail/beowulf/attachments/20081002/ca184f03/attachment.html