On Jun 24, 2008, at 9:13 PM, Joshua Bernstein wrote:
> Exactly, but for now, if I make sure the NODES envar is setup
> correctly and make sure the OpenMPI is NFS mounted, and I actually
> have to copy out the mca libraries (libcache doesn't seem to work),
> I actually end up with something running!
FWIW, you might be getting tripped up on the fact that OMPI uses
dlopen to find all of its DSO's (i.e., the stuff in $libdir/openmpi).
If scyld proxies dlopen back to the head node, it could work, but if
not, you might want to build OMPI with the "--disable-dlopen"
configure option. This puts all the plugins inside libmpi.so (and
friends), and disables the use of dlopen. This might make operation
via your magic .so transporting to back-end nodes work properly.