Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

Subject: Re: [OMPI users] [EXTERNAL] Re: Configuration for rendezvous and eager protocols: two-sided comm
From: Barrett, Brian W (bwbarre_at_[hidden])
Date: 2013-12-16 15:19:13

Siddhartha -

Christoph mentioned how to change the cross-over for shared memory, but it's really per-transport (so you'd have to change it for your off-node transport as well). That's all in the FAQ you mentioned, so hopefully you can take it from there. Note that, in general, moving the eager limits has some unintended side effects. For example, it can cause more / less copies. It can also greatly increase memory usage.

Good luck,


On 12/16/13 1:49 AM, "Siddhartha Jana" <siddharthajana24_at_[hidden]<mailto:siddharthajana24_at_[hidden]>> wrote:

Thanks Christoph.
I should have looked into the FAQ section on MCA params setting @ :

Thanks again,
-- Siddhartha

On 16 December 2013 02:41, Christoph Niethammer <niethammer_at_[hidden]<mailto:niethammer_at_[hidden]>> wrote:
Hi Siddhartha,

MPI_Send/Recv in Open MPI implements both protocols and chooses based on the message size which one to use.
You can use the mca parameter "btl_sm_eager_limit" to modify the behaviour.

Here the corresponding info obtained from the ompi_info tool:

"btl_sm_eager_limit" (current value: <4096>, data source: default value)
Maximum size (in bytes) of "short" messages (must be >= 1)

Christoph Niethammer

Christoph Niethammer
High Performance Computing Center Stuttgart (HLRS)
Nobelstrasse 19
70569 Stuttgart
Tel: ++49(0)711-685-87203<tel:%2B%2B49%280%29711-685-87203>
email: niethammer_at_[hidden]<mailto:niethammer_at_[hidden]>
----- Ursprüngliche Mail -----
Von: "Siddhartha Jana" <siddharthajana24_at_[hidden]<mailto:siddharthajana24_at_[hidden]>>
An: "OpenMPI users mailing list" <users_at_[hidden]<mailto:users_at_[hidden]>>
Gesendet: Samstag, 14. Dezember 2013 13:44:12
Betreff: [OMPI users] Configuration for rendezvous and eager protocols: two-sided comm
In OpenMPI, are MPI_Send, MPI_Recv (and friends) implemented using rendezvous protocol or eager protocol?
If both, is there a way to choose one or the other during runtime or while building the library?
If there is a threshold of the message size that dictates the protocol to be used, is there a way I can alter that threshold value?
If different protocols were used for different versions of the library in the past, could someone please direct me to the exact version numbers of the implementations that used one or the other protocol?
Thanks a lot,
users mailing list
users mailing list
  Brian W. Barrett
  Scalable System Software Group
  Sandia National Laboratories