Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

Subject: [OMPI users] OpenMPI-ROMIO-OrangeFS
From: vithanousek (vithanousek_at_[hidden])
Date: 2014-02-26 12:27:00


Hello, I have still problems with compiling OpenMPI 1.6.5 with OrangeFS 2.8.7 support. I compiled OrangeFS by this:  ./configure --prefix=/usr/local/orangefs2 --with-kernel=/usr/src/kernels/ 2.6.32-431.5.1.el6.x86_64 --with-openib=/usr --without-bmi-tcp make -j 32 make -j 32 kmod make install make kmod_install this works. than I tried to compile OpenMPI (with fixed convert_named function in ad_ pvfs2_io_dtype.c)  by this: ./configure --prefix=/usr/local/openmpi_1.6.5_romio2 --with-io-romio-flags=' --with-pvfs2=/usr/local/orangefs2' (...) make -j32 (...) CCLD mca_io_romio.la /usr/bin/ld: /usr/local/orangefs2/lib/libpvfs2.a(errno-mapping.o): relocation R_X86_64_32S against `PINT_errno_mapping' can not be used when making a shared object; recompile with -fPIC /usr/local/orangefs2/lib/libpvfs2.a: could not read symbols: Bad value collect2: ld returned 1 exit status make[3]: *** [mca_io_romio.la] Error 1 So I tried recompile OrangeFS by this: export CFLAGS="-fPIC" ./configure --prefix=/usr/local/orangefs2 --with-kernel=/usr/src/kernels/ 2.6.32-431.5.1.el6.x86_64 --with-openib=/usr --without-bmi-tcp make -j 32 make -j 32 kmod make install make kmod_install (there was errors with current->fsuid => current->cred->fsuid, in multiple files. I hardcoded this in files, bad idea I know ) Then compilation of OpenMPI works. ./configure --prefix=/usr/local/openmpi_1.6.5_romio2 --with-io-romio-flags=' --with-pvfs2=/usr/local/orangefs2' make -j32 make install but when i created simple program which is using MPIIO, it failed when i run it: mpirun -np 1 -host node18 mpiio [node18:01696] mca: base: component_find: unable to open /usr/local/openmpi_ 1.6.5_romio/lib/openmpi/mca_io_romio: /usr/local/openmpi_1.6.5_romio/lib/ openmpi/mca_io_romio.so: undefined symbol: ADIOI_PVFS2_IReadContig (ignored) Because I got message form OrangeFS mailing list about -fPIC errors, i tryed to recompile OrangeFS withou this flag and compile OpenMPI (static linked) by this:  ./congure --prefix=/usr/local/openmpi_1.6.5_romio2 --with-io-romio-flags='-- with-pvfs2=/usr/local/orangefs2' --enable-static --disable-shared (...) make -j 32 (...)   CCLD   otfmerge-mpi /root/openmpi-1.6.5/ompi/contrib/vt/vt/../../../.libs/libmpi.a(ad_pvfs2.o):( .data+0x60): undefined reference to `ADIOI_PVFS2_IReadContig' /root/openmpi-1.6.5/ompi/contrib/vt/vt/../../../.libs/libmpi.a(ad_pvfs2.o):( .data+0x68): undefined reference to `ADIOI_PVFS2_IWriteContig' collect2: ld returned 1 exit status make[10]: *** [otfmerge-mpi] Error 1 (...) Now I realy dont know, what is wrong. Is there Anybody ho has OpenMPI working with OrangeFS? Thanks for replies HanousekVít --=_262aac836333492541370ae6ª8dba96-fcaa-5da1-a4d4-c455285ba8e2_Content-Type: text/html;
        charset=utf-8
Content-Transfer-Encoding: quoted-printable

<html><body>Hello,<br><br>I have still problems with compiling OpenMPI 1.6.5 with OrangeFS 2.8.7 support.<br><br>I compiled OrangeFS by this:<br><br>&nbsp;./configure --prefix=/usr/local/orangefs2 --with-kernel=/usr/src/kernels/2.6.32-431.5.1.el6.x86_64 --with-openib=/usr --without-bmi-tcp<br>make -j 32<br>make -j 32 kmod<br>make install<br>make kmod_install<br><br>this works.<br>than I tried to compile OpenMPI (with fixed convert_named function in ad_pvfs2_io_dtype.c)&nbsp; by this:<br><br>./configure --prefix=/usr/local/openmpi_1.6.5_romio2 --with-io-romio-flags='--with-pvfs2=/usr/local/orangefs2'<br>(...)<br>make -j32<br>(...)<br> CCLD mca_io_romio.la<br>/usr/bin/ld: /usr/local/orangefs2/lib/libpvfs2.a(errno-mapping.o): relocation R_X86_64_32S against `PINT_errno_mapping' can not be used when making a shared object; recompile with -fPIC<br>/usr/local/orangefs2/lib/libpvfs2.a: could not read symbols: Bad value<br>collect2: ld returned 1 exit status<br>make[3]: *** [mca_io_romio.la] Error 1<br><br>So I tried recompile OrangeFS by this:<br><br>export CFLAGS="-fPIC"<br>./configure --prefix=/usr/local/orangefs2 --with-kernel=/usr/src/kernels/2.6.32-431.5.1.el6.x86_64 --with-openib=/usr --without-bmi-tcp<br>make -j 32<br>make -j 32 kmod<br>make install<br>make kmod_install<br><br>(there was errors with current-&gt;fsuid =&gt; current-&gt;cred-&gt;fsuid, in multiple files. I hardcoded this in files, bad idea I know )<br>Then compilation of OpenMPI works.<br><br>./configure --prefix=/usr/local/openmpi_1.6.5_romio2 --with-io-romio-flags='--with-pvfs2=/usr/local/orangefs2'<br>make -j32<br>make install<br><br>but when i created simple program which is using MPIIO, it failed when i run it:<br><br>mpirun -np 1 -host node18 mpiio <br>[node18:01696] mca: base: component_find: unable to open /usr/local/openmpi_1.6.5_romio/lib/openmpi/mca_io_romio: /usr/local/openmpi_1.6.5_romio/lib/openmpi/mca_io_romio.so: undefined symbol: ADIOI_PVFS2_IReadContig (ignored)<br><br>Because I got message form OrangeFS mailing list about -fPIC errors, i tryed to recompile OrangeFS withou this flag and compile OpenMPI (static linked) by this:&nbsp; <br><br>./congure --prefix=/usr/local/openmpi_1.6.5_romio2 --with-io-romio-flags='--with-pvfs2=/usr/local/orangefs2' --enable-static --disable-shared<br>(...)<br>make -j 32<br>(...)<br>&nbsp; CCLD&nbsp;&nbsp; otfmerge-mpi<br>/root/openmpi-1.6.5/ompi/contrib/vt/vt/../../../.libs/libmpi.a(ad_pvfs2.o):(.data+0x60): undefined reference to `ADIOI_PVFS2_IReadContig'<br>/root/openmpi-1.6.5/ompi/contrib/vt/vt/../../../.libs/libmpi.a(ad_pvfs2.o):(.data+0x68): undefined reference to `ADIOI_PVFS2_IWriteContig'<br>collect2: ld returned 1 exit status<br>make[10]: *** [otfmerge-mpi] Error 1<br>(...)<br><br>Now I realy dont know, what is wrong. <br>Is there Anybody ho has OpenMPI working with OrangeFS?<br><br>Thanks for replies<br>HanousekVít<br></body></html>--=_262aac836333492541370ae6ª8dba96-fcaa-5da1-a4d4-c455285ba8e2_=--