Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

Subject: Re: [OMPI users] Absolute/relative paths of orted
From: McGehee, Robert (Robert.McGehee_at_[hidden])
Date: 2012-04-22 15:53:28

Thanks for the reply. You solved my problem!

You are correct about the configure command containing "--enable-orterun-prefix-by-default". I used the Gentoo Portage build script to compile which appended that option by default.

Here's the configure call Gentoo used:
./configure --prefix=/data/gentoo/usr --build=x86_64-pc-linux-gnu --host=x86_64-pc-linux-gnu --mandir=/data/gentoo/usr/share/man --infodir=/data/gentoo/usr/share/info --datadir=/data/gentoo/usr/share --sysconfdir=/data/gentoo/etc --localstatedir=/data/gentoo/var/lib --libdir=/data/gentoo/usr/lib --disable-dependency-tracking --sysconfdir=/data/gentoo/etc/openmpi --enable-pretty-print-stacktrace --enable-orterun-prefix-by-default --with-hwloc=/data/gentoo/usr --enable-mpi-thread-multiple --enable-opal-multi-threads --enable-contrib-no-build=vt --enable-mpi-cxx --disable-io-romio --enable-heterogeneous --enable-ipv6 --without-udapl --without-openib --without-knem --without-mx --without-psm --disable-openib-control-hdr-padding --disable-openib-connectx-xrc --disable-openib-rdmacm --disable-openib-dynamic-sl --disable-btl-openib-failover --without-sctp --without-tm --without-slurm --enable-shared --enable-static

To your other question, neither OpenMPI installation is on our NFS filesystem (and thus not visible from the other computer).

Both servers get the correct location of mpirun (after creating an orted symlink on the Mac):

[Mac or Linux]~> mpirun -n 2 -H linuxserver,macserver which mpirun

Anyway, I edited the build script to remove the configure option --enable-orterun-prefix-by-default and the linuxserver was able to communicate with the macserver without any problems. Please let me know if you think there will be any undesirable side effect from this change (or any of the other arguments), as I'm not sure why the Gentoo developers added this argument in the first place.

Thanks, Robert

-----Original Message-----
From: users-bounces_at_[hidden] [mailto:users-bounces_at_[hidden]] On Behalf Of Ralph Castain
Sent: Sunday, April 22, 2012 2:51 PM
To: Open MPI Users
Subject: Re: [OMPI users] Absolute/relative paths of orted

How did you configure OMPI on your servers? By default, ORTE should be using strictly a relative path name - the only times it doesn't are when you configure --enable-orterun-prefix-by-default, or have an environ param that indicates we should apply the prefix.

I'm also a little surprised to see the Mac's path being picked up by the Linux mpirun command. Any chance you have an NSF mounted directory across the two, and that the "mpirun" being picked up by your linuxserver cmd is actuality the Mac version?

You might try doing a "which mpirun" to ensure you are getting the one you thought on linuxserver.

On Apr 22, 2012, at 12:11 PM, McGehee, Robert wrote:

> Hello,
> I've installed openmpi 1.5.5 on both my Mac and Linux servers using the ssh/rsh process manager. I can successfully run a program across both servers from my Mac, but not from my Linux server as the Linux server seems to be trying to run orted using an absolute path rather than a relative one. Quick question is: how can I get my Linux server to use a relative path, rather than absolute path, for orted?
> First, let's verify that orted can be found in each computer's path in a remote login:
> [macserver]~> ssh linuxserver which orted
> /opt/local/lib/openmpi/bin/orted
> [linuxserver]~> ssh macserver which orted
> /data/gentoo/usr/bin/orted
> Initiating mpirun from the Mac works fine:
> [macserver]~> mpirun -n 2 -H macserver,linuxserver hostname
> macserver
> linuxserver
> But not from Linux:
> [linuxserver]~> mpirun -n 2 -H macserver,linuxserver hostname
> bash: /data/gentoo/usr/bin/orted: No such file or directory
> <snip>
> Also, the launch-agent argument doesn't help any as the launch-agent is still expected in the /data/... path:
> [linuxserver]~> mpirun -launch-agent XYZ -n 2 -H macserver,linuxserver hostname
> bash: /data/gentoo/usr/bin/XYZ: No such file or directory
> <snip>
> If I create a /data/gentoo/usr/bin directory on the Mac with an orted symlink to the correct location, mpi will run correctly when started from Linux. However, (aside from being inelegant) I intend to use openmpi on a heterogeneous cluster in which orted may be installed in multiple non-standard locations. I will neither have root access to all computers nor do I want to manage a network of symlinks on every computer in the cluster.
> So, my simple question is, how can I get my Linux server to look for orted in the Mac's PATH, rather than it specifying an absolute path that isn't there?
> Thanks, Robert
> _______________________________________________
> users mailing list
> users_at_[hidden]

users mailing list