[Beowulf] Interactive vs batch, and schedulers

Chris Samuel chris at csamuel.org
Thu Jan 16 21:39:58 PST 2020


On 16/1/20 3:24 pm, Lux, Jim (US 337K) via Beowulf wrote:

> What I’m interested in is the idea of jobs that, if spread across many 
> nodes (dozens) can complete in seconds (<1 minute) providing essentially 
> “interactive” access, in the context of large jobs taking days to 
> complete.   It’s not clear to me that the current schedulers can 
> actually do this – rather, they allocate M of N nodes to a particular 
> job pulled out of a series of queues, and that job “owns” the nodes 
> until it completes.  Smaller jobs get run on (M-1) of the N nodes, and 
> presumably complete faster, so it works down through the queue quicker, 
> but ultimately, if you have a job that would take, say, 10 seconds on 
> 1000 nodes, it’s going to take 20 minutes on 10 nodes.

But doesn't that depend a lot on what the user asks for, or am I 
misunderstanding?

All the best,
Chris
-- 
  Chris Samuel  :  http://www.csamuel.org/  :  Berkeley, CA, USA


More information about the Beowulf mailing list