Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

Subject: Re: [OMPI users] OpenMPI-1.2.7 + SGE
From: Reuti (reuti_at_[hidden])
Date: 2008-11-04 11:39:43


Hi,

Am 04.11.2008 um 16:54 schrieb Sangamesh B:

> Hi all,
>
> In Rocks-5.0 cluster, OpenMPI-1.2.6 comes by default. I guess it
> gets installed through rpm.
>
> # /opt/openmpi/bin/ompi_info | grep gridengine
> MCA ras: gridengine (MCA v1.0, API v1.3, Component
> v1.2.6)
> MCA pls: gridengine (MCA v1.0, API v1.3, Component
> v1.2.6)
>
> Now I've to install OpenMPI-1.2.7. The "./configure --help | grep
> gridengine" - doesn't show anything.
>
> In such scenario how OpenMPI-1.2.7 can be integrated to SGE?

only for 1.3 it must be compiled with --with-sge, not in 1.2.x

> After achieving this integration:
>
> 1. Is it possible to use -machinefile option in the SGE script?
>
> Eg:
> #$ -pe orte 4
>
> /opt/openmpi/bin/mpirun -machinefile $TMPDIR/machines -np
> 4 <executable>

You don't need this. Open MPI with use the correct cores on its own.
Just specify: mpirun -np $NSLOTS mypgm

>
> 2. If "qstat -f" is showing 2 slots on node1 and 2 slots on node2
> for a 4 process openmpi job, then will these processes run exactly on
> those nodes?

qstat is only an output of what is granted to the job. With a bad
configuration you could start all forks on the master node of the
parallel job and leave the slaves idling. Open MPI will do the right
thing on its own.

-- Reuti

>
> # qconf -sp orte
> pe_name orte
> slots 999
> user_lists NONE
> xuser_lists NONE
> start_proc_args /bin/true
> stop_proc_args /bin/true
> allocation_rule $fill_up
> control_slaves TRUE
> job_is_first_task FALSE
> urgency_slots min
>
>
> Thank you,
> Sangamesh
> Consultant - HPC
> _______________________________________________
> users mailing list
> users_at_[hidden]
> http://www.open-mpi.org/mailman/listinfo.cgi/users