Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

Subject: Re: [OMPI users] Shared-memory problems
From: Ralph Castain (rhc_at_[hidden])
Date: 2011-11-03 11:01:26


On Nov 3, 2011, at 8:54 AM, Blosch, Edwin L wrote:

> Can anyone guess what the problem is here? I was under the impression that OpenMPI (1.4.4) would look for /tmp and would create its shared-memory backing file there, i.e. if you don’t set orte_tmpdir_base to anything.

That is correct

>
> Well, there IS a /tmp and yet it appears that OpenMPI has chosen to use /dev/shm. Why?

Looks like a bug to me - it shouldn't be doing that. Will have to take a look - first I've heard of that behavior.

>
> And, next question, why doesn’t it work? Here are the oddities of this cluster:
> - the cluster is ‘diskless’
> - /tmp is an NFS mount
> - /dev/shm is 12 GB and has 755 permissions
>
> Filesystem Size Used Avail Use% Mounted on
> tmpfs 12G 164K 12G 1% /dev/shm
>
> % ls –l output:
> drwxr-xr-x 2 root root 40 Oct 28 09:14 shm
>
>
> The error message below suggests that OpenMPI (1.4.4) has somehow auto-magically decided to use /dev/shm and is failing to be able to us e it, for some reason.
>
> Thanks for whatever help you can offer,
>
> Ed
>
>
> e8315:02942] opal_os_dirpath_create: Error: Unable to create the sub-directory (/dev/shm/openmpi-sessions-estenfte_at_e8315_0) of (/dev/shm/openmpi-sessions-estenfte_at_e8315_0/8474/0/1), mkdir failed [1]
> [e8315:02942] [[8474,0],1] ORTE_ERROR_LOG: Error in file util/session_dir.c at line 106
> [e8315:02942] [[8474,0],1] ORTE_ERROR_LOG: Error in file util/session_dir.c at line 399
> [e8315:02942] [[8474,0],1] ORTE_ERROR_LOG: Error in file base/ess_base_std_orted.c at line 206
> --------------------------------------------------------------------------
> It looks like orte_init failed for some reason; your parallel process is
>
> likely to abort. There are many reasons that a parallel process can
> fail during orte_init; some of which are due to configuration or
> environment problems. This failure appears to be an internal failure;
> here's some additional information (which may only be relevant to an
> Open MPI developer):
>
> orte_session_dir failed
> --> Returned value Error (-1) instead of ORTE_SUCCESS
> --------------------------------------------------------------------------
> [e8315:02942] [[8474,0],1] ORTE_ERROR_LOG: Error in file ess_env_module.c at line 136
> [e8315:02942] [[8474,0],1] ORTE_ERROR_LOG: Error in file runtime/orte_init.c at line 132
> --------------------------------------------------------------------------
> It looks like orte_init failed for some reason; your parallel process is
> likely to abort. There are many reasons that a parallel process can
> fail during orte_init; some of which are due to configuration or
> environment problems. This failure appears to be an internal failure;
> here's some additional information (which may only be relevant to an
> Open MPI developer):
>
> orte_ess_set_name failed
> --> Returned value Error (-1) instead of ORTE_SUCCESS
> --------------------------------------------------------------------------
> [e8315:02942] [[8474,0],1] ORTE_ERROR_LOG: Error in file orted/orted_main.c at line 325
>
>
>
> _______________________________________________
> users mailing list
> users_at_[hidden]
> http://www.open-mpi.org/mailman/listinfo.cgi/users