[Beowulf] Torrents for HPC

[Peter]

> What about an easy to setup cluster file system such as FhGFS? As one of
> its developers I'm a bit biased of course, but then I'm also familiar
> with Lustre, an I think FhGFS is far more easiy to setup. We also do not
> have the problem to run clients and servers on the same node and so of
> our customers make heavy use of that and use their compute nodes as
> storage servers. That should a provide the same or better throughput as
> your torrent system.
>
> Cheers,
> Bernd

An interesting idea. There is at least one storage vendor which has more 
cores on it's controllers than are required to provide access to the 
disk subsystems. They have made various inroads in placing a 
virtualisation layer over these and making them available for other 
tasks... compute, irods etc etc. Add this to something like the above or 
stork (http://stork.cse.buffalo.edu/) could be interesting.

Pete


-- 
 The Wellcome Trust Sanger Institute is operated by Genome Research 
 Limited, a charity registered in England with number 1021457 and a 
 company registered in England with number 2742969, whose registered 
 office is 215 Euston Road, London, NW1 2BE.