Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

Subject: Re: [OMPI users] OpenMPI-ROMIO-OrangeFS
From: Ralph Castain (rhc_at_[hidden])
Date: 2014-02-26 13:14:37


Edgar hasn't had a chance to find the necessary patch - he was on travel, returning soon.

On Feb 26, 2014, at 9:27 AM, vithanousek <vithanousek_at_[hidden]> wrote:

> Hello,
>
> I have still problems with compiling OpenMPI 1.6.5 with OrangeFS 2.8.7 support.
>
> I compiled OrangeFS by this:
>
> ./configure --prefix=/usr/local/orangefs2 --with-kernel=/usr/src/kernels/2.6.32-431.5.1.el6.x86_64 --with-openib=/usr --without-bmi-tcp
> make -j 32
> make -j 32 kmod
> make install
> make kmod_install
>
> this works.
> than I tried to compile OpenMPI (with fixed convert_named function in ad_pvfs2_io_dtype.c) by this:
>
> ./configure --prefix=/usr/local/openmpi_1.6.5_romio2 --with-io-romio-flags='--with-pvfs2=/usr/local/orangefs2'
> (...)
> make -j32
> (...)
> CCLD mca_io_romio.la
> /usr/bin/ld: /usr/local/orangefs2/lib/libpvfs2.a(errno-mapping.o): relocation R_X86_64_32S against `PINT_errno_mapping' can not be used when making a shared object; recompile with -fPIC
> /usr/local/orangefs2/lib/libpvfs2.a: could not read symbols: Bad value
> collect2: ld returned 1 exit status
> make[3]: *** [mca_io_romio.la] Error 1
>
> So I tried recompile OrangeFS by this:
>
> export CFLAGS="-fPIC"
> ./configure --prefix=/usr/local/orangefs2 --with-kernel=/usr/src/kernels/2.6.32-431.5.1.el6.x86_64 --with-openib=/usr --without-bmi-tcp
> make -j 32
> make -j 32 kmod
> make install
> make kmod_install
>
> (there was errors with current->fsuid => current->cred->fsuid, in multiple files. I hardcoded this in files, bad idea I know )
> Then compilation of OpenMPI works.
>
> ./configure --prefix=/usr/local/openmpi_1.6.5_romio2 --with-io-romio-flags='--with-pvfs2=/usr/local/orangefs2'
> make -j32
> make install
>
> but when i created simple program which is using MPIIO, it failed when i run it:
>
> mpirun -np 1 -host node18 mpiio
> [node18:01696] mca: base: component_find: unable to open /usr/local/openmpi_1.6.5_romio/lib/openmpi/mca_io_romio: /usr/local/openmpi_1.6.5_romio/lib/openmpi/mca_io_romio.so: undefined symbol: ADIOI_PVFS2_IReadContig (ignored)
>
> Because I got message form OrangeFS mailing list about -fPIC errors, i tryed to recompile OrangeFS withou this flag and compile OpenMPI (static linked) by this:
>
> ./congure --prefix=/usr/local/openmpi_1.6.5_romio2 --with-io-romio-flags='--with-pvfs2=/usr/local/orangefs2' --enable-static --disable-shared
> (...)
> make -j 32
> (...)
> CCLD otfmerge-mpi
> /root/openmpi-1.6.5/ompi/contrib/vt/vt/../../../.libs/libmpi.a(ad_pvfs2.o):(.data+0x60): undefined reference to `ADIOI_PVFS2_IReadContig'
> /root/openmpi-1.6.5/ompi/contrib/vt/vt/../../../.libs/libmpi.a(ad_pvfs2.o):(.data+0x68): undefined reference to `ADIOI_PVFS2_IWriteContig'
> collect2: ld returned 1 exit status
> make[10]: *** [otfmerge-mpi] Error 1
> (...)
>
> Now I realy dont know, what is wrong.
> Is there Anybody ho has OpenMPI working with OrangeFS?
>
> Thanks for replies
> HanousekVít
> _______________________________________________
> users mailing list
> users_at_[hidden]
> http://www.open-mpi.org/mailman/listinfo.cgi/users