I am trying to use Totalview with srun and hit interesting problem. Looks like if OMPI is started by "srun -mpi=ompi ", mpi job is hang in ompi_wait_for_debugger() subroutine. What happen, I think is ompi was compiled without ORTE_DISABLE_FULL_SUPPORT and as result rank 0 is waiting for message from HNP (by the way what is HNP?) that was supposed to be send by orterun. The problem is that orterun was never invoked because MPI was initiated by srun, not orterun. So what is the solution? Should we always compile OMPI with ORTE_DISABLE_FULL_SUPPORT=true for anything that uses different starters like srun from SLURM?
Nikolay Piskun | Director of Continuing Engineering | Totalview Technologies |
Rogue Wave Software Inc | 24 Prime Parkway, Natick, MA 01760 | p 508-652-7739|