[Beowulf] How to know if infiniband network works?

Joe Landman joe.landman at gmail.com
Thu Aug 3 06:26:13 PDT 2017

On 08/03/2017 09:21 AM, Faraz Hussain wrote:
> I ran the qperf command between two compute nodes ( b4 and b5 ) and got:
> [hussaif1 at lustwzb5 ~]$ qperf lustwzb4 -t 30 rc_lat rc_bi_bw
> rc_lat:
> fd
>     latency  =  7.73 us
> rc_bi_bw:
>     bw  =  9.06 GB/sec
> If I understand correctly, I would need to enable ipoib and then rerun 
> test? It would then show ~40GB/sec I assume.

No.  9GB/s is about 80 Gb/s.  Infiniband is working.  Looks like you 
might have dual-rail IB setup, or you were doing a bidirectional/full 
duplex test.

Joe Landman
e: joe.landman at gmail.com
t: @hpcjoe
w: https://scalability.org
g: https://github.com/joelandman
l: https://www.linkedin.com/in/joelandman

More information about the Beowulf mailing list