No there would be no overlap.
We run a large legacy condo, with several islands of Infiniband of different ages and types. Users run within their condo/ib island. So PSM users only run on PSM nodes they own, and there is no overlap.
Our jobs range from 4 cores to 1000 cores, looking at the FAQ page it states that MXM was used in the past only for >128 ranks, but is in 1.6 used for rank counts of any size.
I think we will do some testing, we never even heard of MXM before,
CAEN Advanced Computing
On Jan 22, 2013, at 2:58 PM, Shamis, Pavel wrote:
>> We just learned about MXM, and given most our cards are Mellonox ConnectX cards (though not all, have have islands of previous to ConnectX and Qlogic supported in the same OpenMPI environment),
>> Will MXM correctly fail though to PSM if on qlogic gear and fail though to OpenIB if on previous to connectX cards?
> Do you want to run MXM and PSM in the same MPI session ? You can't do it. MXM and PSM use different network protocols.
> If you want to use MXM in your MPI job, all nodes should be configured to use MXM.
> On the other hand, OpenIB btl should support mixed environments out of the box.
> - Pasha
> users mailing list