Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

Subject: Re: [OMPI users] Compiling Open MPI 1.7.4 using PGI 14.2 and Mellanox HCOLL enabled
From: Åke Sandgren (ake.sandgren_at_[hidden])
Date: 2014-03-11 11:22:01


On 03/11/2014 04:12 PM, Jeff Squyres (jsquyres) wrote:
> I don't see the config.log and make.log attached - can you send all the info requested here (including config.log and config.out):
>
> http://www.open-mpi.org/community/help/
>
> Can you also send "make V=1" output as well?
>
>
> On Feb 25, 2014, at 6:22 PM, Filippo Spiga <spiga.filippo_at_[hidden]> wrote:
>
>> Dear all,
>>
>> I came across another small issue while I was compiling Open MPI 1.7.4 using PGI 14.2 and building the support for Mellanox Hierarchical Collectives (--with-hcoll). Here you how configure Open MPI:
>>
>> export MXM_DIR=/opt/mellanox/mxm
>> export KNEM_DIR=$(find /opt -maxdepth 1 -type d -name "knem*" -print0)
>> export FCA_DIR=/opt/mellanox/fca
>> export HCOLL_DIR=/opt/mellanox/hcoll
>>
>> ../configure CC=pgcc CXX=pgCC FC=pgf90 F90=pgf90 --prefix=/usr/local/Cluster-Users/fs395/openmpi-1.7.4/pgi-14.2_cuda-6.0RC --enable-mpirun-prefix-by-default --with-hcoll=$HCOLL_DIR --with-fca=$FCA_DIR --with-mxm=$MXM_DIR --with-knem=$KNEM_DIR --with-slurm=/usr/local/Cluster-Apps/slurm --with-cuda=$CUDA_INSTALL_PATH
>>
>>
>> At some point the compile process fails with this error:
>>
>> make[2]: Leaving directory `/home/fs395/archive/openmpi-1.7.4/build/ompi/mca/coll/hierarch'
>> Making all in mca/coll/hcoll
>> make[2]: Entering directory `/home/fs395/archive/openmpi-1.7.4/build/ompi/mca/coll/hcoll'
>> CC coll_hcoll_module.lo
>> CC coll_hcoll_component.lo
>> CC coll_hcoll_rte.lo
>> CC coll_hcoll_ops.lo
>> CCLD mca_coll_hcoll.la
>> pgcc-Error-Unknown switch: -pthread

You have to remove the -pthread from inherited_linker_flags=
in libpmi.la libslurm.la from your slurm build.
pgi doesn't under stand it and the default slurm build (with gcc at
least) adds that causing the problem.

-- 
Ake Sandgren, HPC2N, Umea University, S-90187 Umea, Sweden
Internet: ake_at_[hidden]   Phone: +46 90 7866134 Fax: +46 90-580 14
Mobile: +46 70 7716134 WWW: http://www.hpc2n.umu.se