[Beowulf] distcc

[Christopher Samuel]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On 04/07/14 00:02, Jonathan Aquilina wrote:

> I know there has been discussion on the other thread that I started
> about different compilers etc. I am wondering has anyone tried to
> adapt distcc to distribute the code for compilation in addition to
> then once compiled on the compilation servers executed and
> reassembled on the master node?

I prefer Slurm's approach, they include a patch to GNU Make which
enables it to distribute tasks across a cluster from inside a Slurm
batch job.

Make is far more general purpose tool and so this is likely a more
useful way of attacking the problem.

It's also a surprisingly short and easy change and so could quite
likely be adapted to other queuing systems - say Torque with pbsdsh.
All it does is try and launch a bunch of single core tasks.

https://github.com/SchedMD/slurm/blob/master/contribs/make.slurm.patch

All the best,
Chris
- -- 
 Christopher Samuel        Senior Systems Administrator
 VLSCI - Victorian Life Sciences Computation Initiative
 Email: samuel at unimelb.edu.au Phone: +61 (0)3 903 55545
 http://www.vlsci.org.au/      http://twitter.com/vlsci

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iEYEARECAAYFAlO5494ACgkQO2KABBYQAh+noQCfYMtLWcoeGSfLlwc3Ktc+zOnS
58oAnReBpfnwT2MT14cJrosbWp6LsUi4
=q+EE
-----END PGP SIGNATURE-----