Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

Subject: Re: [OMPI users] EXTERNAL: Re: Can you set the gid of the processes created by mpirun?
From: Ralph Castain (rhc_at_[hidden])
Date: 2011-09-14 09:14:51


The attached should set the gid of the remote daemons (and their children) to the gid of mpirun. No cmd line option or anything is required - it will just always do it.

Would you mind giving it a try?

Please let me know if/how it works.


On Sep 8, 2011, at 7:52 AM, Blosch, Edwin L wrote:

> Yes, we build OpenMPI --without-torque.
>
> -----Original Message-----
> From: users-bounces_at_[hidden] [mailto:users-bounces_at_[hidden]] On Behalf Of Reuti
> Sent: Thursday, September 08, 2011 4:33 AM
> To: Open MPI Users
> Subject: EXTERNAL: Re: [OMPI users] Can you set the gid of the processes created by mpirun?
>
> Am 08.09.2011 um 04:04 schrieb Ed Blosch:
>
>> Typically it is something like 'qsub -W group_list=groupB <other options>
>> myjob.sh'. Ultimately myjob.sh runs with gid groupB on some host in the
>> cluster. When that script reaches the mpirun command, then mpirun and the
>> processes started on the same host all run with gid groupB, but any of the
>> spawned processes that start on other hosts run with the user's default
>> group, say groupA.
>>
>> It did occur to me that the launching technique might have some ability to
>> influence this behavior as you indicated. I don't know what launcher is
>> being used in our cases, I guess it's rsh/ssh.
>
> I can only make a statement for SGE that it would honor the group id for the "built-in method" or "rsh startup method" with SGE's patched rshd, not for ssh.
>
> But you are using Torque I assume, as there is no -W switch in SGE. How did you build Open MPI then? I thought the support for Torque is available by default without any special switch to configure in Open MPI.
>
> So, if the slave tasks are started by the pbs_mom, then it should also get the set group id. As I don't use Torque I can't make any definite statement for it.
>
> Are you resetting inside the job script some variables to let it run outside Torque, i.e. without tight integration?
>
> -- Reuti
>
>
>> -----Original Message-----
>> From: users-bounces_at_[hidden] [mailto:users-bounces_at_[hidden]] On
>> Behalf Of Reuti
>> Sent: Wednesday, September 07, 2011 12:24 PM
>> To: Open MPI Users
>> Subject: Re: [OMPI users] Can you set the gid of the processes created by
>> mpirun?
>>
>> Hi,
>>
>> you mean you change the group id of the user before you submit the job? In
>> GridEngine you can specify whether the actual group id should be used for
>> the job, or the default login id.
>>
>> Having a tight integration, also the slave processes will run with the same
>> group id.
>>
>> -- Reuti
>>
>>
>>> Ed
>>>
>>> From: Ralph Castain [mailto:rhc_at_[hidden]]
>>> Sent: Wednesday, September 07, 2011 8:53 AM
>>> To: Open MPI Users
>>> Subject: Re: [OMPI users] Can you set the gid of the processes created by
>> mpirun?
>>>
>>> On Sep 7, 2011, at 7:38 AM, Blosch, Edwin L wrote:
>>>
>>>
>>> The mpirun command is invoked when the user's group is 'set group' to
>> group 650. When the rank 0 process creates files, they have group ownership
>> 650. But the user's login group is group 1040. The child processes that get
>> started on other nodes run with group 1040, and the files they create have
>> group ownership 1040.
>>>
>>> Is there a way to tell mpirun to start the child processes with the same
>> uid and gid as the rank 0 process?
>>>
>>> I'm afraid not - never came up before. Could be done, but probably not
>> right away. What version are you using?
>>>
>>>
>>>
>>> Thanks
>>> _______________________________________________
>>> users mailing list
>>> users_at_[hidden]
>>> http://www.open-mpi.org/mailman/listinfo.cgi/users
>>>
>>> _______________________________________________
>>> users mailing list
>>> users_at_[hidden]
>>> http://www.open-mpi.org/mailman/listinfo.cgi/users
>>
>>
>> _______________________________________________
>> users mailing list
>> users_at_[hidden]
>> http://www.open-mpi.org/mailman/listinfo.cgi/users
>>
>> _______________________________________________
>> users mailing list
>> users_at_[hidden]
>> http://www.open-mpi.org/mailman/listinfo.cgi/users
>
>
> _______________________________________________
> users mailing list
> users_at_[hidden]
> http://www.open-mpi.org/mailman/listinfo.cgi/users
> _______________________________________________
> users mailing list
> users_at_[hidden]
> http://www.open-mpi.org/mailman/listinfo.cgi/users