[Beowulf] Understanding environments and libraries caching on a beowulf cluster
leo camilo
lhcamilo at gmail.com
Tue Jun 28 09:32:17 UTC 2022
# Background
So, I am building this small beowulf cluster for my department. I have it
running on ubuntu servers, a front node and at the moment 7 x 16 core
nodes. I have installed SLURM as the scheduler and I have been
procrastinating to setup environment modules.
In any case, I ran in this particular scenario where I was trying to
schedule a few jobs in slurm, but for some reason slurm would not find this
library (libgsl). But it was in fact installed in the frontnode, I checked
the path with ldd and I even exported the LD_LIBRARY_PATH .
Oddly, if I ran the application directly in the frontnode, it would work
fine.,
Though it occured to me that the computational nodes might not have this
library and surely once I installed this library in the nodes the problem
went away.
# Question:
So here is the question, is there a way to cache the frontnode's libraries
and environment onto the computational nodes when a slurm job is created?
Will environment modules do that? If so, how?
Thanks in advance,
Cheers
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://beowulf.org/pipermail/beowulf/attachments/20220628/b4628233/attachment.htm>
More information about the Beowulf
mailing list