Open MPI logo

Open MPI Development Mailing List Archives

  |   Home   |   Support   |   FAQ   |  

This web mail archive is frozen.

This page is part of a frozen web archive of this mailing list.

You can still navigate around this archive, but know that no new mails have been added to it since July of 2016.

Click here to be taken to the new web archives of this list; it includes all the mails that are in this frozen archive plus all new mails that have been sent to the list since it was migrated to the new archives.

From: Jeff Squyres (jsquyres_at_[hidden])
Date: 2007-05-10 09:11:38

On May 10, 2007, at 9:02 AM, Or Gerlitz wrote:

>>> A different approach which you might want to consider is to have
>>> at the btl level --two-- connections per <src,dst> ranks. so if A
>>> wants to send B it does so through the A --> B connection and if
>>> B wants to send A it does so through the B --> A connection. To
>>> some extent, this is the approach taken by IPoIB-CM (I am not
>>> enough into the RFC to understand the reasoning but i am quite
>>> sure this was the approach in the initial implementation). At
>>> first thought it mights seems not very elegant, but taking it
>>> into the details (projected on the ompi env) you might find it
>>> even nice.
>> What is the advantage of this approach?
> To start with, my hope here is at least to be able play defensive
> here, that is convince you that the disadvantages are minor, where
> only if this fails, would schedule myself some reading into the
> ipoib-cm rfc to dig the advantages.

I ask about the advantages because OMPI currently treats QP's as bi-
directional. Having OMPI treat them at unidirectional would be a
change. I'm not against such a change, but I think we'd need to be
convinced that there are good reasons to do so. For example, on the
surface, it seems like this scheme would simply consume more QPs and
potentially more registered memory (and is therefore unattractive).

Jeff Squyres
Cisco Systems