Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

Subject: [OMPI users] Running MPI apps (example apps in OpenMPI) on OFED stack without IPoIB
From: ramu (ramu.kavati_at_[hidden])
Date: 2011-10-13 13:53:45

I am trying to run various MPI apps (for e.g., example apps in OpenMPI, IMB etc)
on my OFED setup (two hosts with CentOS5.4 connected back to back using Mellanox
infiniband hardware). I want to run these MPI apps without IPoIB i.e, using
infiniband verbs.
Below is the command I have tried.
"mpirun --prefix /usr/local/ -np 2 --mca btl openib,self --mca
btl_openib_cpc_include rdmacm --mca btl_openib_if_include "mthca_0:1" -hostfile
tmp_host_file ring_c"
With this I am getting error as
"At least one pair of MPI processes are unable to reach each other for
MPI communications. This means that no Open MPI device has indicated
that it can be used to communicate between these processes. This is
an error; Open MPI requires that all MPI processes be able to reach
each other. This error can sometimes be the result of forgetting to
specify the "self" BTL."

I am using OpenMPI version 1.4.3

Is it possible to avoid IPoIB while running MPI app on top of OFED stack ? If
yes, what is that I am missing in the above command ? Pleas suggest me.