Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

Subject: Re: [OMPI users] openmpi multi-lib torque support
From: Jeff Squyres (jsquyres_at_[hidden])
Date: 2008-05-15 21:40:48


Sorry, my mailer incorrectly classified this message as spam (gotta
love Outlook!) and I didn't see this message until today.

On May 12, 2008, at 5:24 AM, Karolis Eigelis wrote:

> ello,
> I have Rocks 4.3 installed. Frontend 32bit and nodes with 64bit.
> Traying to run openmpi with torque support using multilib.
>
> /usr/local shared among nodes
>
> CONFIGURING and INSTALL
>
> [from frontend 32bit]
> ./configure --with-tm=/opt/torque/ --prefix=/usr/local/openmpi-1.2.6
> --
> includedir='${prefix}/include/32' --libdir='${prefix}/lib32' && make
> && make install && make check
>
> /usr/local/openmpi-1.2.6/bin/ompi_info |grep tm
> MCA memory: ptmalloc2 (MCA v1.0, API v1.0, Component
> v1.2.6)
> MCA ras: tm (MCA v1.0, API v1.3, Component v1.2.6)
> MCA pls: tm (MCA v1.0, API v1.3, Component v1.2.6)
>
>
> [form node 64bit]
> ./configure --disable-binaries --with-tm=/opt/torque/ --prefix=/usr/
> local/openmpi-1.2.6 --includedir='${prefix}/include/64' --libdir='$
> {prefix}/lib64' && make && make install && make check

Note OMPI doesn't directly support being installed this way -- you
effectively replaced your 32 bit build with a 64 bit build because
the /usr/local/openmpi-1.2.6/bin/<ompi_tools> will be looking in the
64 bit directories for their support. I don't think you'll get what
you want this way (both a 32 and 64 bit build).

Maybe one of the Sun guys can chime in here -- they make 32+64 bit Sun
builds with a little trickery after the build (e.g., frob our wrapper
compiler scripts, etc.)...

But a better / easier solution would be just to have 2 different
installs for OMPI. Or just abandon the 32 bit version (unless you
really, really need it). In a perfect world, "mpicc -32 ..." (or
something like that) would Just Work. But we honestly haven't had
enough demand from users to spend the time to make it so for general /
community Linux builds.

> /usr/local/openmpi-1.2.6/bin/ompi_info |grep tm
> [compute-0-16.local:18284] mca: base: component_find: unable to open
> ras tm: file not found (ignored)
> [compute-0-16.local:18284] mca: base: component_find: unable to open
> pls tm: file not found (ignored)
> MCA memory: ptmalloc2 (MCA v1.0, API v1.0, Component
> v1.2.6)

It's likely that you don't have the torque support library installed
on the back-end ROCKS nodes.

There could be some 32/64 funkyness going on here with your install
form above, but the lack of libtm on the compute nodes is the first
thing I'd check.

-- 
Jeff Squyres
Cisco Systems