Minimal, fast single node queue software
lindahl at keyresearch.com
Mon Dec 16 13:21:35 PST 2002
On Mon, Dec 16, 2002 at 12:47:02PM -0800, David Mathog wrote:
> I have an application which is very simple and efficient
> so that the parallel compute node part can run in much less
> than 1 second. And therein lies the rub - nothing I've tried
> so far can handle job queues across 20 nodes nearly that fast.
"Doctor, it hurts when I do this."
What you want to do instead is write a "worker" which asks some server
for work units. You aren't going to get there with anything that opens
lots of sockets, generates lots of new processes, etc.
More information about the Beowulf