[Beowulf] Distributed FS (Was: copying big files)

[Marian Marinov]

On Thursday 14 August 2008 08:23:10 Carsten Aulbert wrote:
> Hi all
>
> Bernard Li wrote:
> > I'd like to add a comment -- is the reason why this "issue" hasn't
> > been brought up as frequently as I think it should be mainly because a
> > lot of folks use distributed FS that eliminates the need to do one to
> > many file transfers?
>
> Speaking of this, what do people use when they have say ~ 200 nodes with
>  an extra 1 TB drive in it. I know of glusterFS but very few others who
> will be able to utilize this in a somewhat efficient matter. Are the
> good/better alternatives out there?
>
> Extending your storage that way is just darn cheap.

Have you looked at GFarm and Hadoop ?

Marian

>
> Cheers
>
> Carsten