<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
Hi Leo,</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
A bit more clarification on this cluster setup</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
You have 1 primary node and then the rest connect to it in a diskless fashion booting off the primary (front) node?</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
Regards,</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
Jonathan</div>
<div id="appendonsend"></div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> Beowulf <beowulf-bounces@beowulf.org> on behalf of leo camilo <lhcamilo@gmail.com><br>
<b>Sent:</b> 28 June 2022 11:32<br>
<b>To:</b> Beowulf@beowulf.org <Beowulf@beowulf.org><br>
<b>Subject:</b> [Beowulf] Understanding environments and libraries caching on a beowulf cluster</font>
<div> </div>
</div>
<div>
<div dir="ltr">
<div># Background</div>
<div><br>
</div>
So, I am building this small beowulf cluster for my department. I have it running on ubuntu servers, a front node and at the moment 7 x 16 core nodes. I have installed SLURM as the scheduler and I have been procrastinating to setup environment modules.<br>
<br>
In any case, I ran in this particular scenario where I was trying to schedule a few jobs in slurm, but for some reason slurm would not find this library (libgsl). But it was in fact installed in the frontnode, I checked the path with ldd and I even exported
the LD_LIBRARY_PATH .<br>
<br>
Oddly, if I ran the application directly in the frontnode, it would work fine.,<br>
<br>
Though it occured to me that the computational nodes might not have this library and surely once I installed this library in the nodes the problem went away.<br>
<br>
# Question:<br>
<br>
So here is the question, is there a way to cache the frontnode's libraries and environment onto the computational nodes when a slurm job is created?<br>
<br>
Will environment modules do that? If so, how?<br>
<br>
Thanks in advance,<br>
<br>
Cheers</div>
</div>
</body>
</html>