Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

Subject: Re: [OMPI users] Spawn_multiple with tight integration to SGE grid engine
From: Rayson Ho (raysonlogin_at_[hidden])
Date: 2012-01-31 00:33:14

On Mon, Jan 30, 2012 at 11:33 PM, Tom Bryan <tombry_at_[hidden]> wrote:
> For our use, yes, spawn_multiple makes sense.  We won't be spawning lots and
> lots of jobs in quick succession.  We're using MPI as an robust way to get
> IPC as we spawn multiple child processes while using SGE to help us with
> load balancing our compute nodes.

Note that spawn_multiple is not going to buy you anything as SGE and
Open Grid Scheduler (and most other batch systems) do not handle
dynamic slot allocation. There is no way to change the number of slots
that are used by a job once it's running.

For this reason, I don't recall seeing any users using spawn_multiple
(and also, IIRC, the call was introduced in MPI-2)... and you might
want to make sure that normal MPI jobs work before debuging a
spawn_multiple() job.


Grid Engine / Open Grid Scheduler

Scalable Grid Engine Support Program

>> Anyway:
>> do you see on the master node of the parallel job in:
> Yes, I should have included that kind of output.  I'll have to run it again
> with the cols option, but I used pstree to see that I have mpitest --child
> processes as children of orted by way of sge_shepherd and sge_execd.
> Thanks,
> ---Tom
> _______________________________________________
> users mailing list
> users_at_[hidden]

Open Grid Scheduler - The Official Open Source Grid Engine