<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body style="overflow-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;">
Yeah, that’s the analogy I thought of after I asked.
<div><br>
</div>
<div>Have you checked smpquery? I’m not 100% sure that that’s it, but I think it was one of those commands that doesn’t start with ib* that could do this.
<div>
<div><br>
<div>
<div dir="auto" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; overflow-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;">
<div dir="auto" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; overflow-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;">
<div dir="auto" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; overflow-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;">
<div dir="auto" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; overflow-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;">
<div style="color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; overflow-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;">
--<br>
#BlackLivesMatter</div>
<div style="color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; overflow-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;">
____<br>
|| \\UTGERS, |---------------------------*O*---------------------------<br>
||_// the State<span class="Apple-tab-span" style="white-space: pre;"> </span> | Ryan Novosielski - novosirj@rutgers.edu<br>
|| \\ University | Sr. Technologist - 973/972.0922 (2x0922) ~*~ RBHS Campus<br>
|| \\ of NJ<span class="Apple-tab-span" style="white-space: pre;"> </span> | Office of Advanced Research Computing - MSB A555B, Newark<br>
`'</div>
</div>
</div>
</div>
</div>
</div>
<div><br>
<blockquote type="cite">
<div>On Sep 20, 2023, at 14:49, Michael DiDomenico <mdidomenico4@gmail.com> wrote:</div>
<br class="Apple-interchange-newline">
<div>
<div>meaning, when on a server, the CA port is connected to either a switch<br>
or another CA (back-to-back/netapp storage). i just need to see whats<br>
on the other side of the cable from the server i'm sitting on. i<br>
don't care about the rest of the fabric<br>
<br>
its analogous to asking what switch/port i'm connected to via cdp/lldp<br>
on ethernet<br>
<br>
On Wed, Sep 20, 2023 at 2:38 PM Ryan Novosielski <novosirj@rutgers.edu> wrote:<br>
<blockquote type="cite"><br>
Neighbor means what here, just one port over? Or the machine at the other end of the port, or…?<br>
<br>
Sent from my iPhone<br>
<br>
<blockquote type="cite">On Sep 20, 2023, at 14:22, Michael DiDomenico <mdidomenico4@gmail.com> wrote:<br>
<br>
thanks for the info. ibnetdiscover doesn't give me anymore then<br>
iblinkinfo does (and in just as bad a format), however, running<br>
ibnetdiscover on a network with +15k machines is unpleasant (so is<br>
iblinkinfo, but at least i can restrict the hops). especially since<br>
all i need to know is who my neighbor is on a compute node<br>
<br>
netloc looks interesting, it doesn't seem to be included with the<br>
rhel8 version of hwloc though. despite being v2.2, which according to<br>
openmpi says it's included by default. i'll have to look into it<br>
<br>
i did manage to hack up a python program to pull the data into form,<br>
its ugly, but it'll do for now. i'm sure this easily done with a<br>
short C program, but my C programming skills aren't up to the task.<br>
<br>
<br>
<blockquote type="cite">On Wed, Sep 20, 2023 at 9:07 AM John Hearns <hearnsj@gmail.com> wrote:<br>
<br>
netloc is the tool you want to use.<br>
Look in the latest hwloc dovumentation<br>
<br>
<blockquote type="cite">On Wed, 20 Sep 2023, 13:55 John Hearns, <hearnsj@gmail.com> wrote:<br>
<br>
I did manage to get the graphical netloc utility working once. Part of the hwloc/openmpi project.<br>
<br>
It produces a very pretty image of I topology. I think if you zoom in you can get neighbours.<br>
A few years since I used it.<br>
<br>
On Tue, 19 Sep 2023, 19:03 Michael DiDomenico, <mdidomenico4@gmail.com> wrote:<br>
<blockquote type="cite"><br>
does anyone know if there's a simple command to pull the neighbor of<br>
the an ib port? for instance, this horrible shell command line<br>
<br>
# for x in `ibstat | awk -F \' '/^CA/{print $2}'`; do iblinkinfo -C<br>
${x} -n 1 -l | grep `hostname -s`; done<br>
0x080069000000fbcc "SwitchX - Mellanox Technologies" 41134 29[ ]<br>
==( 4X 14.0625 Gbps Active/ LinkUp)==> 0x88e9a4ffff404704<br>
611 1[ ] "logs01 HCA-1" ( )<br>
0x88e9a4ffff404704 " logs01 HCA-1" 611 1[ ]<br>
==( 4X 14.0625 Gbps Active/ LinkUp)==> 0x080069000000fbcc<br>
41134 29[ ] "SwitchX - Mellanox Technologies" ( )<br>
0x080069000000fbdc "SwitchX - Mellanox Technologies" 41219 29[ ]<br>
==( 4X 14.0625 Gbps Active/ LinkUp)==> 0x88e9a4ffff404705<br>
10105 1[ ] "logs01 HCA-2" ( )<br>
0x88e9a4ffff404705 " logs01 HCA-2" 10105 1[ ]<br>
==( 4X 14.0625 Gbps Active/ LinkUp)==> 0x080069000000fbdc<br>
41219 29[ ] "SwitchX - Mellanox Technologies" ( )<br>
<br>
outputs what i need (though i only need the CA perspective), but it's<br>
going to be an atrocious effort in text parsing. would be nice if<br>
there was a nice simple command, preferably that outputs json, but<br>
that's likely wishful thinking<br>
_______________________________________________<br>
Beowulf mailing list, Beowulf@beowulf.org sponsored by Penguin Computing<br>
To change your subscription (digest mode or unsubscribe) visit https://beowulf.org/cgi-bin/mailman/listinfo/beowulf<br>
</blockquote>
</blockquote>
</blockquote>
_______________________________________________<br>
Beowulf mailing list, Beowulf@beowulf.org sponsored by Penguin Computing<br>
To change your subscription (digest mode or unsubscribe) visit https://beowulf.org/cgi-bin/mailman/listinfo/beowulf<br>
</blockquote>
</blockquote>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</body>
</html>