Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

From: Jeff Squyres (jsquyres_at_[hidden])
Date: 2007-10-24 21:31:13


On Oct 24, 2007, at 9:23 PM, Dirk Eddelbuettel wrote:

> | If I had to guess, the systems where you don't see the warning are
> | systems that have OFED loaded.
>
> I am pretty sure that none of the systems (at work) have IB
> hardware. I am
> very sure that my home systems do not, and there the 'btl = ^openib'
> successfully suppresses the warning --- whereas at work it doesn't.

Note that you don't need to have IB hardware -- all you need is the
OFED software loaded. I don't know if Debian ships the OFED
libraries by default...? In particular, look for libibverbs:

[18:28] svbu-mpi:~/svn/ompi % ldd $bogus/lib/openmpi/mca_btl_openib.so
         libibverbs.so.1 => /usr/lib64/libibverbs.so.1
(0x0000002a956c2000)
         libnsl.so.1 => /lib64/libnsl.so.1 (0x0000002a957cd000)
         libutil.so.1 => /lib64/libutil.so.1 (0x0000002a958e4000)
         libm.so.6 => /lib64/tls/libm.so.6 (0x0000002a959e8000)
         libpthread.so.0 => /lib64/tls/libpthread.so.0
(0x0000002a95b6e000)
         libc.so.6 => /lib64/tls/libc.so.6 (0x0000002a95c83000)
         libdl.so.2 => /lib64/libdl.so.2 (0x0000002a95eb8000)
         /lib64/ld-linux-x86-64.so.2 (0x000000552aaaa000)

However, I note something in your last reply that I may have missed
before -- can you clarify a point for me: are you saying that on your
home machine, this generates the openib "file not found" warning:

     mpirun -np 2 hello

but this does not:

     mpirun -np 2 --mca btl ^openib hello

If so, can you confirm which version of Open MPI you are running?
The only reason that I can think that that would happen is if you are
running a trunk nightly download of Open MPI... If not, then there's
something else going on that would be worth understanding.

-- 
Jeff Squyres
Cisco Systems