[Beowulf] Diskless Phi node installs?

Jason Stover jason at r-hpc.com
Mon May 6 07:45:48 PDT 2013

Argh... Seems this address wasn't subscribed previously.... So, we'll
try this one more time: :/


You can NFS mount /opt/intel without any issues. The problem comes
with the /opt/intel/mic/filesystems directory. That needs to be unique
on each Phi node. You can override MicDir and RootDevice on a per
device config:


See the file:

For an basic example of how it's implemented in Warewulf (Search for $MICPATH).

The MPSS does need to be installed in the RAM disk image (for micctrl,
mpssd, etc..), but the large directory:

Should also be able to be NFS mounted without to much issue since it's
just the cross-compiler, and k1om specific libs.


On Mon, May 6, 2013 at 12:11 AM, Christopher Samuel
<samuel at unimelb.edu.au> wrote:
> Hash: SHA1
> Hi folks,
> Our new diskless Intel cluster has 10 nodes with Xeon Phi's in them,
> and I'm wondering if anyone has had any luck with getting the extra
> bloat out of the RAM disk?   We're using xCAT to manage the cluster.
> Basic problem is none of them support relocation:
> [root at old-barcoo-m knc]# rpm -qip *.rpm | grep -i relocat
> Name        : intel-mic                    Relocations: (not relocatable)
> Name        : intel-mic-cdt                Relocations: (not relocatable)
> Name        : intel-mic-flash              Relocations: (not relocatable)
> Name        : intel-mic-gdb                Relocations: (not relocatable)
> Name        : intel-mic-gpl                Relocations: (not relocatable)
> Name        : intel-mic-kmod               Relocations: (not relocatable)
> Name        : intel-mic-kmod               Relocations: (not relocatable)
> Name        : intel-mic-micmgmt            Relocations: (not relocatable)
> Name        : intel-mic-mpm                Relocations: (not relocatable)
> Name        : intel-mic-sysmgmt            Relocations: (not relocatable)
> They chuck all their stuff onto the local filesystem so you get about
> 1GB of extra stuff on an image compared to a non-phi node (which only
> lacks the Phi related RPMs).
> The only one you need to deal with is the intel-mic-gpl RPM as that has
> the Linux distro for the Phi in it and so has the largest footprint (way
> over 700MB) and includes compilers, etc.
> All the best,
> Chris
> - --
>  Christopher Samuel        Senior Systems Administrator
>  VLSCI - Victorian Life Sciences Computation Initiative
>  Email: samuel at unimelb.edu.au Phone: +61 (0)3 903 55545
>  http://www.vlsci.org.au/      http://twitter.com/vlsci
> Version: GnuPG v1.4.11 (GNU/Linux)
> Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/
> 7kgAn1jyAg7PwNvMbXKK4H/SMhBbnskv
> =Crg5

More information about the Beowulf mailing list