NOTE: This will involve a change to the MPI-RTE interface
WHAT: Modify modex_recv to add a callback function that will return the requested data when it is available
WHY: Enable faster startup on large scale systems by eliminating the current mandatory modex barrier during MPI_Init
HOW: The ompi_modex_recv functions will have callback function and (void*)cbdata arguments added to them.
An ompi_modex_recv_t struct will be defined that includes a pointer to the returned data plus a "bool active"
that can be used to detect when the data has been returned if blocking is required.
When a modex_recv is issued, ORTE will check for the presence of the requested data and immediately
issue a callback if the data is available. If the data is not available, then ORTE will request the data from
the remote process, and execute the callback when the remote process returns it.
The current behavior of a blocking modex barrier will remain the default - the new behavior will only take affect
if specifically requested by the user via MCA param. With this new behavior, the current call to "modex" in
MPI_Init will become a "no-op" when the processes are launched via mpirun - this will be executed in ORTE
so that other RTEs that do not wish to support async modex behavior are not impacted.
WHEN: No hurry on this as it is intended for 1.9, so let's say mid Feb. Info on a branch will be made available in
the near future.