Compile farm?
Jakob Østergaard
jakob at unthought.net
Sun Nov 4 12:29:12 PST 2001
On Fri, Nov 02, 2001 at 04:42:07PM -0400, David Bremner wrote:
> Ron Chen writes:
> > What you need is a batch system.
> >
> > There are 2 free batch systems, SGE and PBS.
> >
> [good info snipped]
>
> It is not obvious that a batch system is the best answer to this
> particular problem.
>
> Mosix (www.mosix.org) may be more appropriate for providing a single
> system image.
I tried this with Mosix.
Problem is - mosix migrates jobs after a while. Initially a compiler
takes up a few megabytes of memory, but "after a while" it has grown
to hundreds of megabytes. When mosix decides to migrate the compiler
it will spend a long time on the netowrk to move the large process
image.
There's some patch to make that integrates it with Mosix, but I didn't
try that out.
Instead, I implemented http://unthought.net/antsd which will distribute your
compilers efficiently to the proper nodes. It's not very sophisticated, but
it does the job for me at least :)
--
................................................................
: jakob at unthought.net : And I see the elder races, :
:.........................: putrid forms of man :
: Jakob Østergaard : See him rise and claim the earth, :
: OZ9ABN : his downfall is at hand. :
:.........................:............{Konkhra}...............:
More information about the Beowulf
mailing list