Open MPI User's Mailing List Archives

| Home | Support | FAQ | all Open MPI User's mailing list

About

Publications

Open MPI Team

FAQ

Videos

Open MPI Software

Download

Documentation

Source Code Access

Bug Tracking

Regression Testing

Version Information

Sub-Projects

Hardware Locality

MPI Testing Tool

Portable Linux Processor Affinity

Open MPI User Docs

Open Tool for Parameter Optimization

Community

Mailing Lists

OMPI announce archives

OMPI users archives

OMPI devel archives

OMPI docs archives

hwloc announce archives

hwloc users archives

hwloc devel archives

MTT announce archives

MTT users archives

MTT developers archives

ORCM users archives

ORCM devel archives

Getting Help/Support

Contribute

Mirrors

Contact

License

Date view	Thread view	Subject view	Author view

Subject: Re: [OMPI users] v1.3: mca_common_sm_mmap_init error
From: Eugene Loh (Eugene.Loh_at_[hidden])
Date: 2009-02-03 13:30:58

Next message: Ralph Castain: "Re: [OMPI users] Handling output of processes"
Previous message: Jeff Squyres: "Re: [OMPI users] v1.3: mca_common_sm_mmap_init error"
In reply to: Prentice Bisbal: "Re: [OMPI users] v1.3: mca_common_sm_mmap_init error"
Next in thread: Dave Love: "Re: [OMPI users] v1.3: mca_common_sm_mmap_init error"

Prentice Bisbal wrote:

Jeff Squyres wrote:

On Feb 2, 2009, at 4:48 PM, Prentice Bisbal wrote

No. I was running just a simple "Hello, world" program to test v1.3 when
these errors occured. And as soon as I reverted to 1.2.8, the errors
disappeared.

FWIW, OMPI allocates shared memory based on the number of peers on the
host.  This allocation is during MPI_INIT, not during the first
MPI_SEND/MPI_RECV call.  So even if you're running "hello world", you
could still be running out of shared memory space.

Thanks for the info. Can you define peers for me?

The number of MPI processes running on a shared-memory node.

Let's say the number of MPI processes in your job on a shared-memory node is n. If n=1, there is no use for shared memory and no file will be created. But if n>2, then the formula for the file size depends on some MCA parameters. The size is something like

size = mpool_sm_per_peer_size * n
if ( size < mpool_sm_min_size ) size = mpool_sm_min_size
if ( size < mpool_sm_max_size ) size = mpool_sm_max_size

The defaults are per_peer=32MB, min=128MB, and max=512 MB (I think).

I guess the question is whether a file of at least 100s of MB can be created in /tmp on the nodes where you're running.

Next message: Ralph Castain: "Re: [OMPI users] Handling output of processes"
Previous message: Jeff Squyres: "Re: [OMPI users] v1.3: mca_common_sm_mmap_init error"
In reply to: Prentice Bisbal: "Re: [OMPI users] v1.3: mca_common_sm_mmap_init error"
Next in thread: Dave Love: "Re: [OMPI users] v1.3: mca_common_sm_mmap_init error"

Date view	Thread view	Subject view	Author view