[Beowulf] Create cluster : questions
mwill at penguincomputing.com
Thu Sep 7 08:48:10 PDT 2006
This would be if you had a dedicated beowulf style cluster rather than cyclescavenging style (seti at home). It would be a very ambitious project to do package compilation that way.
From: Ed Hill [mailto:ed at eh3.com]
Sent: Thu Sep 07 06:57:24 2006
To: Maxence Dunnewind
Cc: beowulf at beowulf.org
Subject: Re: [Beowulf] Create cluster : questions
On Mon, 4 Sep 2006 21:23:03 +0200
"Maxence Dunnewind" <maxenced at gmail.com> wrote:
> i'm a user of the Ubuntu Linux OS, and also a packager for this OS.
> As you may know , packaging can be take a lot of time, mainly
> during building process.
> I would create a public cluster for help packagers. All Ubuntu
> users can accept we use their computers on the cluster. But the
> cluster system MUST only use free ressource of this computers (and
> maybe user could set a quota)...
> i want people only have to install some software (no kernel
> compilation or other things).
> I want know if beowulf could works in this case ????
Have you looked at distcc? Its probably closest to what you're
I help out with Fedora Extras so I can certainly appreciate the time
that goes into compiling packages! It would be nice to have a
distributed build system with per-compilation-unit (eg. per-object-
file) granularity. But I'm afraid it may be a somewhat complicated
task for, for instance, Fedora Extras since the FE build system uses
a chroot-ed environment (the "mock" package) to ensure build
cleanliness and the presence of all the needed dependencies. Maybe
NFS-mounting the chroot would be sufficient...?
If you split up the work on a per-package and per-architecture basis
(i386, x86-64, ppc, etc.) then its relatively (!) straight-forward to
build a cluster with the necessary hardware and perform builds of
separate packages/arches on a simultaneous (each in different chroots
on potentially different machines) basis. Thats exactly what the
current Fedora Extras build system (called "plague") does. You can
see some details at:
And I only discuss Fedora Extras because its what I'm familiar with.
I'd be curious to hear how build systems work for other distros!
Edward H. Hill III, PhD | ed at eh3.com | http://eh3.com/
Beowulf mailing list, Beowulf at beowulf.org
To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the Beowulf