First, OMPI does -not- require you to use ipoib.
With that command line, both procs will be running on remotehostip. I don't believe openib has a loopback interface, so you'll need the shared memory btl so procs co-located on a node can talk to each other. In other words, you need
-mca btl sm,openib,self
Finally, have you checked your params? I'm unaware of any param btl_openib_if_include, though maybe I just missed it. Use
ompi_info --param btl openib
to see the supported values. Remember, we don't check your params for syntax errors - if it isn't recognized, we just ignore it.
On Oct 13, 2011, at 7:12 PM, bhimesh akula wrote:
> We have multi node set up and they are back to back connected.we are trying to run open MPI without using ipoib means not using normal ethernet interface instead it has to go through our uverbs interface.
> This is the command i tried ...
> "mpirun --prefix /usr/local/ -np 2 --mca btl openib,self --mca
> btl_openib_cpc_include rdmacm --mca btl_openib_if_include "mthca_0:1" -H remotehostip osu_bw .
> Here in above command i have given again IP only as no idea on what parameters has to be given to mention remote host(like IP any other parameter to identify remote host while running MPI without ipoib).
> And also please give me a way to run the open MPI without ipoib and using our ibverbs interface on multi node set up.please help me on this ASAP ...
> users mailing list