Anton,
On the node that you saw the failure (u02n065) can you verify what the max locked memory limit is set to? In a bash shell you can do this with ulimit -l. It should be set to at least 128K. Also please verify that the available memory on the node (/proc/meminfo shows this) is sufficient as it may be possible that some zombie processes on that node are consuming memory.
Avneesh
-----Original Message-----
From: users-bounces_at_[hidden] [mailto:users-bounces_at_[hidden]] On Behalf Of Anton Shterenlikht
Sent: Thursday, July 08, 2010 9:07 AM
To: users_at_[hidden]
Subject: [OMPI users] ipath_userinit: userinit command failed: Cannot allocate memory
I'm trying to use MPI with fortran on Linux 2.6.18-164.6.1.el5 x86_64 I compiled this trivial code with mpif90:
program simple
include 'mpif.h'
integer numtasks, rank, ierr, rc
rc=1
call MPI_INIT(ierr)
if (ierr .ne. 0) then
print *,'Error starting MPI program. Terminating.'
call MPI_ABORT(MPI_COMM_WORLD, rc, ierr)
end if
call MPI_COMM_RANK(MPI_COMM_WORLD, rank, ierr)
call MPI_COMM_SIZE(MPI_COMM_WORLD, numtasks, ierr)
print *, 'Number of tasks=',numtasks,' My rank=',rank
! ****** do some work ******
call MPI_FINALIZE(ierr)
end
I run it with mpirun.
When I use 2 cpus or less, all is fine.
When I try to specify more than 2 cpus I get this error:
u02n065:0.ipath_userinit: userinit command failed: Cannot allocate memory u02n065:0.Driver initialization failure on /dev/ipath
where u02n065 is the node name.
Please advise
many thanks
anton
--
Anton Shterenlikht
Room 2.6, Queen's Building
Mech Eng Dept
Bristol University
University Walk, Bristol BS8 1TR, UK
Tel: +44 (0)117 331 5944
Fax: +44 (0)117 929 4423
_______________________________________________
users mailing list
users_at_[hidden]
http://www.open-mpi.org/mailman/listinfo.cgi/users
|
![[Flag]](../../../../../community/mirrors/flag-us.gif){kind=small}