[Beowulf] How to know if infiniband network works?

Faraz Hussain info at feacluster.com
Thu Aug 3 08:41:17 PDT 2017


Thanks for everyone's help. Using the Ohio State tests, qperf and  
perfquery I am convinced the IB network is working. The only thing  
that still bothers me is I can not get mpirun to use the tcp network.  
I tried all combinations of --mca btl to no avail. It is not  
important, more just curiosity.


Quoting Michael Di Domenico <mdidomenico4 at gmail.com>:

> On Thu, Aug 3, 2017 at 10:10 AM, Faraz Hussain <info at feacluster.com> wrote:
>> Thanks, I installed the MPI tests from Ohio State. I ran osu_bw and got the
>> results below. What is confusing is I get the same result if I use tcp or
>> openib ( by doing --mca btl openib|tcp,self with my mpirun command ). I also
>> tried changing the environment variable: export OMPI_MCA_btl=tcp,self,sm .
>> Results are the same regardless of tcp or openib..
>>
>> And when I do ifconfig -a I still see zero traffic reported for the ib0 and
>> ib1 network.
>
> if openmpi uses RDMA for the traffic ib0/ib1 will not show traffic,
> you have to use perfquery
> _______________________________________________
> Beowulf mailing list, Beowulf at beowulf.org sponsored by Penguin Computing
> To change your subscription (digest mode or unsubscribe) visit  
> http://www.beowulf.org/mailman/listinfo/beowulf





More information about the Beowulf mailing list