Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

Subject: Re: [OMPI users] ipath_userinit: userinit command failed: Cannot allocate memory
From: Avneesh Pant (avneesh.pant_at_[hidden])
Date: 2010-07-08 14:04:09

On the node that you saw the failure (u02n065) can you verify what the max locked memory limit is set to? In a bash shell you can do this with ulimit -l. It should be set to at least 128K. Also please verify that the available memory on the node (/proc/meminfo shows this) is sufficient as it may be possible that some zombie processes on that node are consuming memory.


-----Original Message-----
From: users-bounces_at_[hidden] [mailto:users-bounces_at_[hidden]] On Behalf Of Anton Shterenlikht
Sent: Thursday, July 08, 2010 9:07 AM
To: users_at_[hidden]
Subject: [OMPI users] ipath_userinit: userinit command failed: Cannot allocate memory

I'm trying to use MPI with fortran on Linux 2.6.18-164.6.1.el5 x86_64 I compiled this trivial code with mpif90:

     program simple
     include 'mpif.h'

     integer numtasks, rank, ierr, rc


     call MPI_INIT(ierr)
     if (ierr .ne. 0) then
        print *,'Error starting MPI program. Terminating.'
        call MPI_ABORT(MPI_COMM_WORLD, rc, ierr)
     end if

     call MPI_COMM_RANK(MPI_COMM_WORLD, rank, ierr)
     call MPI_COMM_SIZE(MPI_COMM_WORLD, numtasks, ierr)
     print *, 'Number of tasks=',numtasks,' My rank=',rank

! ****** do some work ******

     call MPI_FINALIZE(ierr)


I run it with mpirun.

When I use 2 cpus or less, all is fine.

When I try to specify more than 2 cpus I get this error:

u02n065:0.ipath_userinit: userinit command failed: Cannot allocate memory u02n065:0.Driver initialization failure on /dev/ipath

where u02n065 is the node name.

Please advise

many thanks

Anton Shterenlikht
Room 2.6, Queen's Building
Mech Eng Dept
Bristol University
University Walk, Bristol BS8 1TR, UK
Tel: +44 (0)117 331 5944
Fax: +44 (0)117 929 4423
users mailing list