Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

Subject: Re: [OMPI users] torque integration when tm ras/plm isn't compiled in.
From: Ralph Castain (rhc_at_[hidden])
Date: 2009-10-22 18:50:00


Why not just

setenv OMPI_MCA_orte_default_hostfile $PBS_NODEFILE

assuming you are using 1.3.x, of course.

If not, then you can use the equivalent for 1.2 - ompi_info would tell
you the name of it.

On Oct 22, 2009, at 4:29 PM, Roy Dragseth wrote:

> Hi all.
>
> I'm trying to create a tight integration between torque and openmpi
> for cases
> where the tm ras and plm isn't compiled into openmpi. This
> scenario is
> common for linux distros that ship openmpi. Of course the ideal
> solution is
> to recompile openmpi with torque support, but this isn't always
> feasible since
> I do not want to support my own version of openmpi on the stuff I'm
> distributing to others.
>
> We also see some proprietary applications shipping their own
> embedded openmpi
> libraries where either tm plm/ras is missing or non-functional with
> the torque
> installation on our system.
>
> So, I've come so far as to create a pbsdshwrapper.py that mimics ssh
> behaviour
> very closely so that starting the orteds on all the hosts works as
> expected
> and the application starts correctly when I use
>
> setenv OMPI_MCA_plm_rsh_agent "pbsdshwrapper.py"
> mpirun --hostfile $PBS_NODEFILE ........
>
> What I want now is a way to get rid of the --hostfile $PBS_NODEFILE
> in the
> mpirun command. Is there an environment variable that I can set so
> that
> mpirun grabs the right nodelist?
>
> By spelunking the code I find that the rsh plm has support for SGE
> where it
> automatically picks up the PE_NODEFILE if it detects that it is
> launched
> within an SGE job. Would it be possible to have the same
> functionality for
> torque? The code looks a bit too complex at first sight for me to
> fix this
> myself.
>
> Best regards,
> Roy.
>
> --
> The Computer Center, University of Tromsø, N-9037 TROMSØ Norway.
> phone:+47 77 64 41 07, fax:+47 77 64 41 00
> Roy Dragseth, Team Leader, High Performance Computing
> Direct call: +47 77 64 62 56. email: roy.dragseth_at_[hidden]
>
> _______________________________________________
> users mailing list
> users_at_[hidden]
> http://www.open-mpi.org/mailman/listinfo.cgi/users