Sorry, my mailer incorrectly classified this message as spam (gotta
love Outlook!) and I didn't see this message until today.
On May 12, 2008, at 5:24 AM, Karolis Eigelis wrote:
> ello,
> I have Rocks 4.3 installed. Frontend 32bit and nodes with 64bit.
> Traying to run openmpi with torque support using multilib.
>
> /usr/local shared among nodes
>
> CONFIGURING and INSTALL
>
> [from frontend 32bit]
> ./configure --with-tm=/opt/torque/ --prefix=/usr/local/openmpi-1.2.6
> --
> includedir='${prefix}/include/32' --libdir='${prefix}/lib32' && make
> && make install && make check
>
> /usr/local/openmpi-1.2.6/bin/ompi_info |grep tm
> MCA memory: ptmalloc2 (MCA v1.0, API v1.0, Component
> v1.2.6)
> MCA ras: tm (MCA v1.0, API v1.3, Component v1.2.6)
> MCA pls: tm (MCA v1.0, API v1.3, Component v1.2.6)
>
>
> [form node 64bit]
> ./configure --disable-binaries --with-tm=/opt/torque/ --prefix=/usr/
> local/openmpi-1.2.6 --includedir='${prefix}/include/64' --libdir='$
> {prefix}/lib64' && make && make install && make check
Note OMPI doesn't directly support being installed this way -- you
effectively replaced your 32 bit build with a 64 bit build because
the /usr/local/openmpi-1.2.6/bin/<ompi_tools> will be looking in the
64 bit directories for their support. I don't think you'll get what
you want this way (both a 32 and 64 bit build).
Maybe one of the Sun guys can chime in here -- they make 32+64 bit Sun
builds with a little trickery after the build (e.g., frob our wrapper
compiler scripts, etc.)...
But a better / easier solution would be just to have 2 different
installs for OMPI. Or just abandon the 32 bit version (unless you
really, really need it). In a perfect world, "mpicc -32 ..." (or
something like that) would Just Work. But we honestly haven't had
enough demand from users to spend the time to make it so for general /
community Linux builds.
> /usr/local/openmpi-1.2.6/bin/ompi_info |grep tm
> [compute-0-16.local:18284] mca: base: component_find: unable to open
> ras tm: file not found (ignored)
> [compute-0-16.local:18284] mca: base: component_find: unable to open
> pls tm: file not found (ignored)
> MCA memory: ptmalloc2 (MCA v1.0, API v1.0, Component
> v1.2.6)
It's likely that you don't have the torque support library installed
on the back-end ROCKS nodes.
There could be some 32/64 funkyness going on here with your install
form above, but the lack of libtm on the compute nodes is the first
thing I'd check.
--
Jeff Squyres
Cisco Systems
|
![[Flag]](../../../../../community/mirrors/flag-us.gif){kind=small}