[Beowulf] Understanding environments and libraries caching on a beowulf cluster

[Tony Travis]

On 28/06/2022 10:32, leo camilo wrote:
> [...]
> # Question:
> 
> So here is the question, is there a way to cache the frontnode's 
> libraries and environment onto the computational nodes when a slurm job 
> is created?
> 
> Will environment modules do that? If so, how?

Hi, Leo.

Have you considered using Qlustar?

> https://www.qlustar.com/

This is now all open source and free for non-profit use, but you can buy 
a support licence if you need one (otherwise just support it yourself).

Qlustar uses "UnionFS" to share the a filesystem across all the nodes.

HTH,

   Tony.

-- 
Minke Informatics Limited, Registered in Scotland - Company No. SC419028
Registered Office: 3 Donview, Bridge of Alford, AB33 8QJ, Scotland (UK)
tel. +44(0)19755 63548                    http://minke-informatics.co.uk
mob. +44(0)7985 078324        mailto:tony.travis at minke-informatics.co.uk