Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

Subject: [OMPI users] running openmpi with specified lib path
From: Duke Nguyen (duke.lists_at_[hidden])
Date: 2013-05-07 07:36:39


Hi folks,

I am testing our cluster with module environment, and am having a
headache to understand openmpi 1.7.2!!! So our system currently has
openmpi 1.6.3 (at default location /usr/local), 1.6.4 and 1.7.2 compiled
with intel compilers (installed at /opt/apps). In order to use openmpi
1.7.2 for example, I tried:

$ module load mpi/openmpi-1.7.2_composer_xe_2013.3.163
$ module load
apps/abinit-7.2.1_composer_xe_2013.3.163_openmpi-1.7.2_intel_fftw3-mkl
$ mpirun ./mpihello_intel
mca: base: component_find: unable to open
/usr/local/lib/openmpi/mca_ess_hnp:
/usr/local/lib/openmpi/mca_ess_hnp.so: undefined symbol:
orte_local_jobdata (ignored)
mca: base: component_find: unable to open
/usr/local/lib/openmpi/mca_ess_slurm:
/usr/local/lib/openmpi/mca_ess_slurm.so: undefined symbol:
orte_orted_exit_with_barrier (ignored)
mca: base: component_find: unable to open
/usr/local/lib/openmpi/mca_ess_slurmd:
/usr/local/lib/openmpi/mca_ess_slurmd.so: undefined symbol:
orte_pmap_t_class (ignored)
mpirun: symbol lookup error:
/usr/local/lib/openmpi/mca_ess_singleton.so: undefined symbol:
orte_util_setup_local_nidmap_entries

To investigate the error, I tried:

$ echo $LD_LIBRARY_PATH
/opt/apps/abinit/abinit-7.2.1_composer_xe_2013.3.163_openmpi-1.7.2_intel_fftw3-mkl/usr/local/lib:/opt/apps/openmpi/openmpi-1.7.2r28341_composer_xe_2013.3.163/usr/local/lib/openmpi:/opt/apps/openmpi/openmpi-1.7.2r28341_composer_xe_2013.3.163/usr/local/lib:/usr/local/lib:/opt/intel/lib/intel64:/opt/intel/mkl/lib/intel64
$ ls
/opt/apps/openmpi/openmpi-1.7.2r28341_composer_xe_2013.3.163/usr/local/lib/openmpi
| grep mca_ess
mca_ess_env.la
mca_ess_env.so
mca_ess_hnp.la
mca_ess_hnp.so
mca_ess_singleton.la
mca_ess_singleton.so
mca_ess_slurm.la
mca_ess_slurm.so
mca_ess_tm.la
mca_ess_tm.so
mca_ess_tool.la
mca_ess_tool.so

So apparently openmpi 1.7.2 looks for the old library at
/usr/loca/lib/openmpi for 1.6.3 instead of at
/opt/apps/openmpi/openmpi-1.7.2r28341_composer_xe_2013.3.163/usr/local/lib/openmpi.
Is there away to force openmpi 1.7.2 look at
/opt/apps/openmpi/openmpi-1.7.2r28341_composer_xe_2013.3.163/usr/local/lib/openmpi
first before looking at other locations?

Thanks,

D.