Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

Subject: [OMPI users] Infiniband problem, kernel mismatch
From: HeeJin Kim (biduri_at_[hidden])
Date: 2010-11-18 19:03:35


I'm using Mellanox infiniband network card and trying to run it with
The problem is that I can connect and communicate between nodes, but I'm not
sure whether it is in a correct state or not.

I have two version of openmpi, one is compiled with mca-btl-openib and the
other is without btl-openib.(I checked it in ompi_info)
And my jobs are running well using the openmpi without btl-openib,
but when I run the exactly same job using openmpi with btl-openmpi, I meet
the following error.

* mlx4: There is a mismatch between the kernel and the userspace
libraries: Kernel does not support XRC. Exiting.*

and the following is written in another log file
* CMA: unable to open RDMA device*

What I'm thinking is that the infiniband card is installed but it doesn't
work in correct mode.
My linux kernel version is *2.6.18-164.el5*, and installed ofed
version is *kernel-ib-pp-1.4.1-ofed20090528r1.4.1sgi605r1.rhel5