Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

Subject: [OMPI users] ADIOI Lock problems on NFS and Panasas with OpenMPI
From: Mehmet Belgin (mehmet.belgin_at_[hidden])
Date: 2013-04-26 11:21:29

Hello everyone,

OpenMPI crashes when doing parallel HDF5 on both NFS and Panasas systems:

On NFS, we are getting:

ADIOI_Set_lock:: No locks available
ADIOI_Set_lock:offset 69744, length 256
application called MPI_Abort(MPI_COMM_WORLD, 1) - process 124
File locking failed in ADIOI_Set_lock(fd 25,cmd F_SETLKW/7,type F_WRLCK/1,whence 0) with return value FFFFFFFF and errno 25.
If the file system is NFS, you need to use NFS version 3, ensure that the lockd daemon is running on all the machines, and mount the directory with the 'noac' option (no attribute caching).

On Panasas:

ADIOI_PANFS_RESIZE: Rank 13: Resize failed: requested=46996328 actual=9187464.

We are using intel 12.1.4, openMPI (tried all new versions) and HDF5 1.8.10.

I searched the forum archives and found two identical questions from 2008. One was left unanswered, and the other answered by Jeff (Squyres) suggesting checking with ROMIO maintainers. So, I went ahead and recompiled everything without romio, but I am still seeing the same errors.

Any suggestions will be very much appreciated!