Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

Subject: Re: [OMPI users] OpenMPI without IPoIB
From: Bernardo F Costa (bfcta_at_[hidden])
Date: 2011-03-11 14:47:18

I have found this thread form two years ago. I am some kind of lost on
configuring an infiniband cluster for openmpi. What is best: use iboip
or use native infiniband ibverbs interface ? For now I am using native
infiniband withou ipoib. But I have lots of problems specially with
latency in the cluster. Which of these two ipoib or ibverbs is more
likely to be fault tolerant or stable ?

On Nov 25, 2009, at 1:03 PM, Don Kerr wrote:
> On 11/25/09 02:04, Vivek Satpute wrote:
>> Hi,
>> I tried to execute OpenMPI examples from OFED-1.4 stack and found
>> that all those
>> examples uses IPoIB.
> How are you determining that it is using IPoIB?
>> Is there any way to execute MPI applications on only Infiniband
>> stack i.e. without
>> using IPoIB module ?
>> Can we execute MPI applications using libibverbs, librdma, or some
>> other libraries ?
> OpenMPI by default will select and use the best available path. If
> the ibverbs interace is available and operational OpenMPI will use
> this for off-node MPI communication. If you are concerned that
> ibverbs is not in use specifically calling it out on the mpirun
> command line will assure you that it is being used, e.g. "mpirun --
> mca btl self,sm,openib .... ". This command will instruct OpenMPI to
> use shared memory for on node communication and openib (ibverbs),
> for off-node communication.
> -DON
>> Thanks,
>> Vivek
>> _______________________________________________
>> users mailing list
>> users_at_[hidden]
> _______________________________________________
> users mailing list
> users_at_[hidden]