Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

Subject: Re: [OMPI users] /dev/shm
From: Ray Muno (muno_at_[hidden])
Date: 2008-11-20 16:22:32


John Hearns wrote:
> 2008/11/19 Ray Muno <muno_at_[hidden]>
>
>> Thought I would revisit this one.
>>
>> We are still having issues with this. It is not clear to me what is leaving
>> the user files behind in /dev/shm.
>>
>> This is not something users are doing directly, they are just compiling
>> their code directly with mpif90 (from OpenMPI), using various compilers.
>> Compilers in use are PGI, Intel, SunStudio and Pathscale.
>>
>> It looks like every job run leaves something behind in /dev/shm and it
>> slowly fills up. We are just clearing these out at this point.
>>
>
> Could you not run ipcs with the -p flag every few minutes and try to figure
> out what the processes are which are leaving these?
> (by that I mean catch them when they are live, and the creating process is
> still on the system)
>

OK, what should I be seeing when I run "ipcs -p"?

I have a set of nodes that has a user job running on it. It wrote a file
in /dev/shm when it started. The job is still running.

I see....

# ipcs -p

------ Shared Memory Creator/Last-op --------
shmid owner cpid lpid

------ Message Queues PIDs --------
msqid owner lspid lrpid

-- 
  Ray Muno