Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

Subject: Re: [OMPI users] Mixed Threaded MPI code, how to launch?
From: Brock Palen (brockp_at_[hidden])
Date: 2008-10-30 09:46:49


Any thoughts on this?

We are looking writing a script that parses $PBS_NODEFILE to create a
machinefile and using -machinefile

When we do that though we have to disable tm to avoid an error (-mca
pls ^tm) this is far from preferable.

Any ideas to tell mpirun to only launch on half the cpus given to it
by PBS, but each cpu must have adjacent to it another cpu in the same
node?

Brock Palen
www.umich.edu/~brockp
Center for Advanced Computing
brockp_at_[hidden]
(734)936-1985

On Oct 25, 2008, at 5:36 PM, Brock Palen wrote:

> We have a user with a code that uses threaded solvers inside each
> MPI rank. They would like to run two threads per process.
>
> The question is how to launch this? The default -byslot puts all
> the processes on the first sets of cpus not leaving any cpus for
> the second thread for each process. And half the cpus are wasted.
>
> The -bynode option works in theory, if all our nodes had the same
> number of core (they do not).
>
> So right now the user did:
>
> #PBS -l nodes=22:ppn=2
> export OMP_NUM_THREADS=2
> mpirun -np 22 app
>
> Which made me aware of the problem.
>
> How can I basically tell OMPI that a 'slot' is two cores on the
> same machine? This needs to work inside out torque based
> queueing system.
>
> Sorry If I was not clear about my goal.
>
>
> Brock Palen
> www.umich.edu/~brockp
> Center for Advanced Computing
> brockp_at_[hidden]
> (734)936-1985
>
>
>
> _______________________________________________
> users mailing list
> users_at_[hidden]
> http://www.open-mpi.org/mailman/listinfo.cgi/users
>
>