Dear all,

First of all, all my apologies because I post this message to both the bug and user mailing list. But for the moment, I do not know if it is a bug!

I am running a CFD structured flow solver at ORNL, and I have an access to a small cluster (Smoky) using OpenMPI-1.4.2 with Infiniband by default. Recently we increased the size of our models, and since that time we have run into many infiniband related problems.  The most serious problem is a hard crash with the following error message:

[smoky45][[60998,1],32][/sw/sources/ompi/1.4.2/ompi/mca/btl/openib/connect/btl_openib_connect_oob.c:464:qp_create_one] error creating qp errno says Cannot allocate memory

If we force the solver to use ethernet (mpirun -mca btl ^openib) the computations works correctly, although very slowly (a single iteration take ages). Do you have any idea what could be causing these problems?

If it is due to a bug or a limitation into OpenMPI, do you think the version 1.4.3, the coming 1.4.4 or any 1.5 version could solve the problem? I read the release notes, but I did not read any obvious patch which could fix my problem. The system administrator is ready to compile a new package for us, but I do not want to ask to install to many of them.
  
Thanks.
--

Mathieu Gontier
skype: mathieu_gontier