[Beowulf] How to know if infiniband network works?
hearnsj at googlemail.com
Thu Aug 3 07:33:28 PDT 2017
I think that you have got things sorted out.
However I think that the number of optiosn in OpenMPI is starting to
confuse you. But do not lose heart!
I have been in the same place myself many time. Specifically I am thinking
on one time when a customer asked me to benthmark the latency across 10Gbps
on a cluster where there was already a 1Gbps network and a Mellanox
Infiniband network. I had to be careful to exclude the networks I did NOT
I suggest that you set the verbose flag in mpirun and keep a copy of the
output. GO through that output line by line making sure you understand what
it is telling you.
I have done that many times!
Secondly you say " I also tried changing the environment variable: export
OMPI_MCA_btl=tcp,self,sm " - remember that you can switch OFF a transport
by using ^tcp
Please give that a try - ie I mean epxlicitly request openmpi transport and
On 3 August 2017 at 16:21, Michael Di Domenico <mdidomenico4 at gmail.com>
> On Thu, Aug 3, 2017 at 10:10 AM, Faraz Hussain <info at feacluster.com>
> > Thanks, I installed the MPI tests from Ohio State. I ran osu_bw and got
> > results below. What is confusing is I get the same result if I use tcp or
> > openib ( by doing --mca btl openib|tcp,self with my mpirun command ). I
> > tried changing the environment variable: export OMPI_MCA_btl=tcp,self,sm
> > Results are the same regardless of tcp or openib..
> > And when I do ifconfig -a I still see zero traffic reported for the ib0
> > ib1 network.
> if openmpi uses RDMA for the traffic ib0/ib1 will not show traffic,
> you have to use perfquery
> Beowulf mailing list, Beowulf at beowulf.org sponsored by Penguin Computing
> To change your subscription (digest mode or unsubscribe) visit
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the Beowulf