Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

From: Jeff Squyres (jsquyres_at_[hidden])
Date: 2007-11-05 17:43:44


Is there any chance that you can upgrade to the OFED IB stack? Cisco
is recommending OFED to all of its customers who are able to upgrade:

     http://www.open-mpi.org/faq/?category=openfabrics#vapi-support

If you can't upgrade, we'll continue to diagnose (please see http://www.open-mpi.org/community/help/)
, but I thought I'd at least ask...

On Nov 5, 2007, at 5:39 PM, Mike Hanby wrote:

> Howdy,
>
> I'm attempting to compile OpenMPI using Intel compilers (9.1.047)
> with Topspin Infiniband support (on CentOS 4.4 64bit).
>
> Configuring:
>
> ./configure CC=icc CXX=icpc FC=ifort F77=ifort F90=ifort --with-
> mvapi=/usr/local/topspin --with-mvapi-libdir=/usr/local/topspin/
> lib64 --enable-static --prefix=/share/apps/openmpi/intel/
> openmpi-1.2.4-64
>
> make runs for 5 minutes or so and errors with:
>
> IPO link: can not find -lvapi
> icc: error: problem during multi-file optimization compilation (code
> 1)
> make[2]: *** [libmpi.la] Error 1
> make[2]: Leaving directory `/home/makeuser/tmp/openmpi/
> openmpi-1.2.4_64/openmpi-1.2.4/ompi'
> make[1]: *** [install-recursive] Error 1
> make[1]: Leaving directory `/home/makeuser/tmp/openmpi/
> openmpi-1.2.4_64/openmpi-1.2.4/ompi'
>
> I used the same configuration for OpenMPI 1.1.2 and it compiled and
> installed successfully.
>
> Any suggestions?
>
> The following are the last several lines in the make log file:
> ====================================================================
> libtool: compile: /share/apps/intel/cce/9.1.047/bin/icc -
> DHAVE_CONFIG_H -I. -I../opal/include -I../orte/include -I../ompi/
> include -I.. -I/share/apps/intel/cce/9.1.047/include -O3 -DNDEBUG -
> finline-functions -fno-strict-aliasing -restrict -pthread -MT
> runtime/ompi_mpi_params.lo -MD -MP -MF runtime/.deps/
> ompi_mpi_params.Tpo -c runtime/ompi_mpi_params.c -o runtime/
> ompi_mpi_params.o >/dev/null 2>&1
> depbase=`echo runtime/ompi_mpi_preconnect.lo | sed 's|[^/]*$|.deps/
> &|;s|\.lo$||'`;\
> /bin/sh ../libtool --tag=CC --mode=compile /share/apps/intel/cce/
> 9.1.047/bin/icc -DHAVE_CONFIG_H -I. -I../opal/include -I../orte/
> include -I../ompi/include -I.. -I/share/apps/intel/cce/9.1.047/
> include -O3 -DNDEBUG -finline-functions -fno-strict-aliasing -
> restrict -pthread -MT runtime/ompi_mpi_preconnect.lo -MD -MP -MF
> $depbase.Tpo -c -o runtime/ompi_mpi_preconnect.lo runtime/
> ompi_mpi_preconnect.c &&\
> mv -f $depbase.Tpo $depbase.Plo
> libtool: compile: /share/apps/intel/cce/9.1.047/bin/icc -
> DHAVE_CONFIG_H -I. -I../opal/include -I../orte/include -I../ompi/
> include -I.. -I/share/apps/intel/cce/9.1.047/include -O3 -DNDEBUG -
> finline-functions -fno-strict-aliasing -restrict -pthread -MT
> runtime/ompi_mpi_preconnect.lo -MD -MP -MF runtime/.deps/
> ompi_mpi_preconnect.Tpo -c runtime/ompi_mpi_preconnect.c -fPIC -
> DPIC -o runtime/.libs/ompi_mpi_preconnect.o
> libtool: compile: /share/apps/intel/cce/9.1.047/bin/icc -
> DHAVE_CONFIG_H -I. -I../opal/include -I../orte/include -I../ompi/
> include -I.. -I/share/apps/intel/cce/9.1.047/include -O3 -DNDEBUG -
> finline-functions -fno-strict-aliasing -restrict -pthread -MT
> runtime/ompi_mpi_preconnect.lo -MD -MP -MF runtime/.deps/
> ompi_mpi_preconnect.Tpo -c runtime/ompi_mpi_preconnect.c -o runtime/
> ompi_mpi_preconnect.o >/dev/null 2>&1
> depbase=`echo win/win.lo | sed 's|[^/]*$|.deps/&|;s|\.lo$||'`;\
> /bin/sh ../libtool --tag=CC --mode=compile /share/apps/intel/cce/
> 9.1.047/bin/icc -DHAVE_CONFIG_H -I. -I../opal/include -I../orte/
> include -I../ompi/include -I.. -I/share/apps/intel/cce/9.1.047/
> include -O3 -DNDEBUG -finline-functions -fno-strict-aliasing -
> restrict -pthread -MT win/win.lo -MD -MP -MF $depbase.Tpo -c -o win/
> win.lo win/win.c &&\
> mv -f $depbase.Tpo $depbase.Plo
> libtool: compile: /share/apps/intel/cce/9.1.047/bin/icc -
> DHAVE_CONFIG_H -I. -I../opal/include -I../orte/include -I../ompi/
> include -I.. -I/share/apps/intel/cce/9.1.047/include -O3 -DNDEBUG -
> finline-functions -fno-strict-aliasing -restrict -pthread -MT win/
> win.lo -MD -MP -MF win/.deps/win.Tpo -c win/win.c -fPIC -DPIC -o
> win/.libs/win.o
> libtool: compile: /share/apps/intel/cce/9.1.047/bin/icc -
> DHAVE_CONFIG_H -I. -I../opal/include -I../orte/include -I../ompi/
> include -I.. -I/share/apps/intel/cce/9.1.047/include -O3 -DNDEBUG -
> finline-functions -fno-strict-aliasing -restrict -pthread -MT win/
> win.lo -MD -MP -MF win/.deps/win.Tpo -c win/win.c -o win/win.o >/dev/
> null 2>&1
> /bin/sh ../libtool --tag=CC --mode=link /share/apps/intel/cce/
> 9.1.047/bin/icc -O3 -DNDEBUG -finline-functions -fno-strict-
> aliasing -restrict -pthread -export-dynamic -L/share/apps/intel/cce/
> 9.1.047/lib -o libmpi.la -rpath /share/apps/openmpi/intel/
> openmpi-1.2.4-64/lib class/ompi_bitmap.lo class/ompi_free_list.lo
> class/ompi_pointer_array.lo class/ompi_rb_tree.lo class/
> ompi_seq_tracker.lo attribute/attribute.lo attribute/
> attribute_predefined.lo communicator/comm_init.lo communicator/
> comm.lo communicator/comm_cid.lo communicator/comm_dyn.lo
> communicator/comm_publish.lo errhandler/errhandler.lo errhandler/
> errhandler_invoke.lo errhandler/errhandler_predefined.lo errhandler/
> errcode.lo errhandler/errcode-internal.lo file/file.lo group/
> group.lo group/group_init.lo group/group_set_rank.lo info/info.lo op/
> op.lo op/op_predefined.lo proc/proc.lo request/grequest.lo request/
> request.lo request/req_test.lo request/req_wait.lo runtime/
> ompi_mpi_abort.lo runtime/ompi_mpi_init.lo runtime/
> ompi_mpi_finalize.lo runtime/ompi_mpi_params.lo runtime/
> ompi_mpi_preconnect.lo win/win.lo datatype/libdatatype.la debuggers/
> libdebuggers.la mpi/c/libmpi_c.la mpi/c/profile/libmpi_c_pmpi.la
> mpi/f77/libmpi_f77_base.la mca/allocator/libmca_allocator.la mca/
> allocator/bucket/libmca_allocator_bucket.la mca/allocator/basic/
> libmca_allocator_basic.la mca/bml/libmca_bml.la mca/bml/r2/
> libmca_bml_r2.la mca/btl/libmca_btl.la mca/btl/tcp/
> libmca_btl_tcp.la mca/btl/mvapi/libmca_btl_mvapi.la mca/btl/sm/
> libmca_btl_sm.la mca/btl/self/libmca_btl_self.la mca/coll/
> libmca_coll.la mca/coll/tuned/libmca_coll_tuned.la mca/coll/sm/
> libmca_coll_sm.la mca/coll/self/libmca_coll_self.la mca/coll/basic/
> libmca_coll_basic.la mca/common/sm/libmca_common_sm.la mca/io/
> libmca_io.la mca/io/romio/libmca_io_romio.la mca/mpool/
> libmca_mpool.la mca/mpool/sm/libmca_mpool_sm.la mca/mpool/rdma/
> libmca_mpool_rdma.la mca/mtl/libmca_mtl.la mca/osc/libmca_osc.la
> mca/osc/pt2pt/libmca_osc_pt2pt.la mca/pml/libmca_pml.la mca/pml/ob1/
> libmca_pml_ob1.la mca/pml/cm/libmca_pml_cm.la mca/rcache/
> libmca_rcache.la mca/rcache/vma/libmca_rcache_vma.la mca/topo/
> libmca_topo.la mca/topo/unity/libmca_topo_unity.la /home/makeuser/
> tmp/openmpi/openmpi-1.2.4_64/openmpi-1.2.4/orte/libopen-rte.la -lnsl
> -lutil
> libtool: link: /share/apps/intel/cce/9.1.047/bin/icc -shared
> class/.libs/ompi_bitmap.o class/.libs/ompi_free_list.o class/.libs/
> ompi_pointer_array.o class/.libs/ompi_rb_tree.o class/.libs/
> ompi_seq_tracker.o attribute/.libs/attribute.o attribute/.libs/
> attribute_predefined.o communicator/.libs/comm_init.o
> communicator/.libs/comm.o communicator/.libs/comm_cid.o
> communicator/.libs/comm_dyn.o communicator/.libs/comm_publish.o
> errhandler/.libs/errhandler.o errhandler/.libs/errhandler_invoke.o
> errhandler/.libs/errhandler_predefined.o errhandler/.libs/errcode.o
> errhandler/.libs/errcode-internal.o file/.libs/file.o group/.libs/
> group.o group/.libs/group_init.o group/.libs/group_set_rank.o
> info/.libs/info.o op/.libs/op.o op/.libs/op_predefined.o proc/.libs/
> proc.o request/.libs/grequest.o request/.libs/request.o
> request/.libs/req_test.o request/.libs/req_wait.o runtime/.libs/
> ompi_mpi_abort.o runtime/.libs/ompi_mpi_init.o runtime/.libs/
> ompi_mpi_finalize.o runtime/.libs/ompi_mpi_params.o runtime/.libs/
> ompi_mpi_preconnect.o win/.libs/win.o -Wl,--whole-archive
> datatype/.libs/libdatatype.a debuggers/.libs/libdebuggers.a mpi/
> c/.libs/libmpi_c.a mpi/c/profile/.libs/libmpi_c_pmpi.a mpi/f77/.libs/
> libmpi_f77_base.a mca/allocator/.libs/libmca_allocator.a mca/
> allocator/bucket/.libs/libmca_allocator_bucket.a mca/allocator/
> basic/.libs/libmca_allocator_basic.a mca/bml/.libs/libmca_bml.a mca/
> bml/r2/.libs/libmca_bml_r2.a mca/btl/.libs/libmca_btl.a mca/btl/
> tcp/.libs/libmca_btl_tcp.a mca/btl/mvapi/.libs/libmca_btl_mvapi.a
> mca/btl/sm/.libs/libmca_btl_sm.a mca/btl/self/.libs/
> libmca_btl_self.a mca/coll/.libs/libmca_coll.a mca/coll/tuned/.libs/
> libmca_coll_tuned.a mca/coll/sm/.libs/libmca_coll_sm.a mca/coll/
> self/.libs/libmca_coll_self.a mca/coll/basic/.libs/
> libmca_coll_basic.a mca/common/sm/.libs/libmca_common_sm_noinst.a
> mca/io/.libs/libmca_io.a mca/io/romio/.libs/libmca_io_romio.a mca/
> mpool/.libs/libmca_mpool.a mca/mpool/sm/.libs/libmca_mpool_sm.a mca/
> mpool/rdma/.libs/libmca_mpool_rdma.a mca/mtl/.libs/libmca_mtl.a mca/
> osc/.libs/libmca_osc.a mca/osc/pt2pt/.libs/libmca_osc_pt2pt.a mca/
> pml/.libs/libmca_pml.a mca/pml/ob1/.libs/libmca_pml_ob1.a mca/pml/
> cm/.libs/libmca_pml_cm.a mca/rcache/.libs/libmca_rcache.a mca/rcache/
> vma/.libs/libmca_rcache_vma.a mca/topo/.libs/libmca_topo.a mca/topo/
> unity/.libs/libmca_topo_unity.a -Wl,--no-whole-archive -Wl,-rpath -
> Wl,/home/makeuser/tmp/openmpi/openmpi-1.2.4_64/openmpi-1.2.4/
> orte/.libs -Wl,-rpath -Wl,/home/makeuser/tmp/openmpi/
> openmpi-1.2.4_64/openmpi-1.2.4/opal/.libs -Wl,-rpath -Wl,/share/apps/
> openmpi/intel/openmpi-1.2.4-64/lib -L/home/makeuser/tmp/openmpi/
> openmpi-1.2.4_64/openmpi-1.2.4/opal/.libs -L/share/apps/intel/cce/
> 9.1.047/lib -lvapi -lmosal -lrt /home/makeuser/tmp/openmpi/
> openmpi-1.2.4_64/openmpi-1.2.4/orte/.libs/libopen-rte.so /home/
> makeuser/tmp/openmpi/openmpi-1.2.4_64/openmpi-1.2.4/opal/.libs/
> libopen-pal.so -lnuma -ldl -lnsl -lutil -pthread -pthread -Wl,-
> soname -Wl,libmpi.so.0 -o .libs/libmpi.so.0.0.0
> IPO link: can not find -lvapi
> icc: error: problem during multi-file optimization compilation (code
> 1)
> make[2]: *** [libmpi.la] Error 1
> make[2]: Leaving directory `/home/makeuser/tmp/openmpi/
> openmpi-1.2.4_64/openmpi-1.2.4/ompi'
> make[1]: *** [all-recursive] Error 1
> make[1]: Leaving directory `/home/makeuser/tmp/openmpi/
> openmpi-1.2.4_64/openmpi-1.2.4/ompi'
> make: *** [all-recursive] Error 1
>
> -----
> Mike Hanby
> Information Systems Specialist II
> School of Engineering Dean's Office
> University of Alabama at Birmingham
>
> _______________________________________________
> users mailing list
> users_at_[hidden]
> http://www.open-mpi.org/mailman/listinfo.cgi/users

-- 
Jeff Squyres
Cisco Systems