Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

Subject: Re: [OMPI users] Role of ethernet interfaces of startup of openmpi job using IB
From: Prentice Bisbal (prentice_at_[hidden])
Date: 2011-09-28 13:20:26


On 09/27/2011 05:30 PM, Jeff Squyres wrote:
> On Sep 27, 2011, at 5:03 PM, Prentice Bisbal wrote:
>
>> To clarify, is IP/Ethernet required, or will IPoIB be used if it's
>> configured on the nodes? Would this make a difference.
>
> IPoIB is fine, although I've heard concerns about its stability at scale.
>
> The difference that it'll make is that it's generally faster than ethernet. It never runs at wire IB speed because of the overheads involved, but it's likely to be much faster than 1GB ethernet, for example.
>
> You can specify which interfaces Open MPI's OOB channel uses with the oob_tcp_if_include MCA parameter. For example:
>
> mpirun --mca oob_tcp_if_include ib0 ...
>

Jeff,

Thanks for the clarification. I was just checking. Earlier in this
thread you specifically said "ethernet". I suspected you meant "IP", and
just wanted to be sure.