|
|
Hello,
I built OpenMPI-1.4.1 without openib support with the following
configuration options:
./configure
--prefix=/develop/libs/OpenMPI/openmpi-1.4.1/LINUX_GCC_4_1_tcp_mach
--enable-static --enable-shared --enable-cxx-exceptions
--enable-mpi-f77 --disable-mpi-f90 --enable-mpi-cxx
--disable-mpi-cxx-seek --enable-dist --enable-mpi-profile
--enable-binaries --enable-mpi-threads --enable-memchecker
--disable-debug --with-pic --with-threads --with-sge
On my cluster, I run a small test (a broadcast on a 100 integer array)
on 12 processes balanced on 3 nodes, but I asked for using openib. It
works with the following messages:
mpirun -np 12 -hostfile
/tmp/72936.1.64.q/machines --mca btl openib,sm,self
/home/numeca/tmp/gontier/bcast/exe_ompi_cluster -nloop 2 -nbuff 100
libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes.
This will severely limit memory registrations.
libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes.
This will severely limit memory registrations.
--------------------------------------------------------------------------
WARNING: There was an error initializing an OpenFabrics device.
Local host: node005
Local device: mthca0
--------------------------------------------------------------------------
libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes.
This will severely limit memory registrations.
libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes.
This will severely limit memory registrations.
libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes.
This will severely limit memory registrations.
libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes.
This will severely limit memory registrations.
libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes.
This will severely limit memory registrations.
libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes.
This will severely limit memory registrations.
libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes.
This will severely limit memory registrations.
libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes.
This will severely limit memory registrations.
libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes.
This will severely limit memory registrations.
libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes.
This will severely limit memory registrations.
processing...
done
[node005:04791] 11 more processes have sent help message
help-mpi-btl-openib.txt / error in device init
[node005:04791] Set MCA parameter "orte_base_help_aggregate" to 0 to
see all help / error messages
I finally run ompi_info:
./ompi_info | grep openib
MCA btl: openib (MCA v2.0, API v2.0, Component v1.4.1)
Openib seems to be supported. That is weird because I did not ask for...
So, assuming the compilation of OpenMPI which does not support openib
here, what happened? Was tcp selected? How can I check which device has
been used (or force an explicit message)?
By the way, what is the meaning of this message in my case?
By the way, another different think: does OpenMPI must be compiled with
gcc-4.1 or later, or gcc-3.4 (for example) can be used?
Thank you for your help,
Mathieu.
|
|
|
![[Flag]](../../../../../community/mirrors/flag-us.gif){kind=small}