<div dir="ltr"><div class="gmail_default" style="font-family:monospace">I'll put in a plug for Slurm. I'd say it's got the features you need and it scales up really well.</div><div class="gmail_default" style="font-family:monospace"><br></div><div class="gmail_default" style="font-family:monospace">Accounting: it can write to file, but you're best off configuring the database backend (MySQL, Mariadb). Then there's both the built-in sacct tool and (if you're so inclined) queries directly against the database.</div><div class="gmail_default" style="font-family:monospace"><br></div><div class="gmail_default" style="font-family:monospace">It can also be set up to track job resource usage.</div><div class="gmail_default" style="font-family:monospace"><br></div><div class="gmail_default" style="font-family:monospace">CGROUPS: I've only used it in our test cluster, but I found it pretty straight forward. There's both cgroup limits and scheduler-enforced limits.</div><div class="gmail_default" style="font-family:monospace"><br></div><div class="gmail_default" style="font-family:monospace">As far a setting up easy shell access, we've written a wrapper that uses the "srun --pty /bin/bash" command to drop users into a shell on a compute node.</div><div class="gmail_default" style="font-family:monospace"><br></div><div class="gmail_default" style="font-family:monospace">If you've the budget, we've found the support offered by SchedMD to be a good value as well. The community is pretty helpful if that's sufficient for your environment.</div><div class="gmail_default" style="font-family:monospace"><br></div><div class="gmail_default" style="font-family:monospace">I'd used Torque/Moab as well as Slurm/Moab in past. Those worked well, but we've found that the pure Slurm answer has been more than satisfactory for our cluster (a smallish, ~2000 core capability compute system).</div><div class="gmail_default" style="font-family:monospace"><br></div><div class="gmail_default" style="font-family:monospace">Hope that helps.</div><div class="gmail_default" style="font-family:monospace"><br></div><div class="gmail_default" style="font-family:monospace">Michael</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Jul 14, 2015 at 2:40 PM, John Hearns <span dir="ltr"><<a href="mailto:John.Hearns@xma.co.uk" target="_blank">John.Hearns@xma.co.uk</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span class=""><br>
> We are investigating options for a cluster/cloud scenario where I need to keep track of CPU, > > >memory, disk used during the runs. This "keeping track" should be available via command line tools >(preferably in JSON/XML/CSV output that I can easily parse).<br>
<br>
</span>Does Apache Mesos suit your needs?<br>
<br>
<a href="http://opensource.com/business/14/9/open-source-datacenter-computing-apache-mesos" rel="noreferrer" target="_blank">http://opensource.com/business/14/9/open-source-datacenter-computing-apache-mesos</a><br>
<br>
I feel the days of us dinosaurs who write 'batch scripts' in shell and use qsub/bsub to submit them to the almighty 'batch scheduler' are numbered.<br>
The stateless mice with their http whiskers are running around our feet.<br>
#####################################################################################<br>
Scanned by MailMarshal - M86 Security's comprehensive email content security solution.<br>
#####################################################################################<br>
Any views or opinions presented in this email are solely those of the author and do not necessarily represent those of the company. Employees of XMA Ltd are expressly required not to make defamatory statements and not to infringe or authorise any infringement of copyright or any other legal right by email communications. Any such communication is contrary to company policy and outside the scope of the employment of the individual concerned. The company will not accept any liability in respect of such communication, and the employee responsible will be personally liable for any damages or other liability arising. XMA Limited is registered in England and Wales (registered no. 2051703). Registered Office: Wilford Industrial Estate, Ruddington Lane, Wilford, Nottingham, NG11 7EP<br>
<div class="HOEnZb"><div class="h5">_______________________________________________<br>
Beowulf mailing list, <a href="mailto:Beowulf@beowulf.org">Beowulf@beowulf.org</a> sponsored by Penguin Computing<br>
To change your subscription (digest mode or unsubscribe) visit <a href="http://www.beowulf.org/mailman/listinfo/beowulf" rel="noreferrer" target="_blank">http://www.beowulf.org/mailman/listinfo/beowulf</a><br>
</div></div></blockquote></div><br></div>