Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

From: Galen M. Shipman (gshipman_at_[hidden])
Date: 2005-11-21 13:34:34


Bernard,

This code is using MPI_Alloc_mem, which is good. Do you have an idea of
approx. how much memory has been allocated via MPI_Alloc_mem at the time
of failure?

Thanks,

Galen

On Mon, 21 Nov 2005, Borenstein, Bernard S wrote:

> Things have improved alot since I ran the code using the earlier betas,
> but it still fails near the end of the run.
>
>
> <<ompi-output.tar.gz>>
>
> The error messages are :
>
>
> FOR GRID 4 AT STEP 466 L2NORM = 0.74601987E-09
> FOR GRID 5 AT STEP 466 L2NORM = 0.86085437E-08
> FOR GRID 6 AT STEP 466 L2NORM = 0.17810240E-07
> FOR GRID 7 AT STEP 466 L2NORM = 0.14586522E-07
> [v057:31700] [mpool_gm_module.c:100] error(8) registering gm memory
> [v057:31700] *** An error occurred in MPI_Alloc_mem
> [v057:31700] *** on communicator MPI_COMM_WORLD
> [v057:31700] *** MPI_ERR_NO_MEM: out of memory
> [v057:31700] *** MPI_ERRORS_ARE_FATAL (goodbye)
> [v120:05052] spawn: in job_state_callback(jobid = 1, state = 0xa)
> [v120:05052] spawn: in job_state_callback(jobid = 1, state = 0x9)
> 20 processes killed (possibly by Open MPI)
> [v120:05052] sess_dir_finalize: found proc session dir empty - deleting
> [v120:05052] sess_dir_finalize: found job session dir empty - deleting
> [v120:05052] sess_dir_finalize: found univ session dir empty - deleting
> [v120:05052] sess_dir_finalize: found top session dir empty - deleting
> Command exited with non-zero status 9
> 0.06user 0.18system 10:32.68elapsed 0%CPU (0avgtext+0avgdata
> 0maxresident)k
> 0inputs+0outputs (18major+782minor)pagefaults 0swaps
>
> Hope you can help me out with this one.
>
> Bernie Borenstein
> The Boeing Company
>