<html><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><br><div><div>On Jun 18, 2009, at 12:51 PM, <a href="mailto:beowulf-request@beowulf.org">beowulf-request@beowulf.org</a> wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0; ">Message: 4<br>Date: Thu, 18 Jun 2009 11:20:47 -0400<br>From: Prentice Bisbal <<a href="mailto:prentice@ias.edu">prentice@ias.edu</a>><br></span></blockquote><br><blockquote type="cite"><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0; ">One of my nodes has an IB problem:<br><br>--------------------------------------------------------------------------<br>WARNING: There is at least on IB HCA found on host 'node36.aurora', but<br>there is<br>no active ports detected. This is most certainly not what you wanted.<br>Check your cables and SM configuration.<br>--------------------------------------------------------------------------<br><br></span></blockquote><div><br></div><div>Does the output of vstat or ibstat show the port active and at the line rate you expect?</div><div>does perfquery show packet traffic?</div><div><br></div><div>This looks like a problem we saw when the software stack on one of our nodes was bad, any chance of "bit creep" in your environment where the installation is incomplete or are you confident it's identical to the working nodes?</div><div><br></div><div>Cheers!</div><div>Greg</div></div></body></html>