[Beowulf] IB symbol error thresholds for health check scripts ?
samuel at unimelb.edu.au
Mon Dec 13 14:43:19 PST 2010
-----BEGIN PGP SIGNED MESSAGE-----
We run a bunch of health checks  on a compute node through
Torque  and if they fail the node gets knocked offline.
One of the checks we do is to check that there are no symbol
errors on the IB link. However, I'm wondering if simply saying
a single error is too brutal for this - what do other people do
about these ?
 - for the record we check things like - amount of RAM,
failed DIMMs (via IPMI on IBM or memlog on SGI), number of
cores, number and speed of CPUs, LDAP OK, home directories
 - checks run prior to a job start, after a job exits
and every 7.5 minutes (every 10 mom intervals).
Christopher Samuel - Senior Systems Administrator
VLSCI - Victorian Life Sciences Computational Initiative
Email: samuel at unimelb.edu.au Phone: +61 (0)3 903 55545
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
-----END PGP SIGNATURE-----
More information about the Beowulf