Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

From: Adams, Brian M (briadam_at_[hidden])
Date: 2007-04-16 18:48:51


Hello,

I am attempting to port Sandia's DAKOTA code from MVAPICH to the default
OpenMPI/Intel environment on Sandia's thunderbird cluster. I can
successfully build DAKOTA in the default tbird software environment, but
I'm having runtime problems when DAKOTA attempts to make a system call.
Typical output looks like:

[0,1,1][btl_openib_component.c:897:mca_btl_openib_component_progress]
from an64 to: an64 error polling HP CQ with status LOCAL LENGTH ERROR
status number 1 for wr_id 5714048 opcode 0

I'm attaching a tarball containing output from `ompi_info --all` as well
as two simple sample programs with output to demonstrate the problem
behavior. I built them in the default tbird MPI environment
(openmpi-1.1.2-ofed-intel-9.1) with

  mpicc mpi_syscall.c -i_dynamic -o mpi_syscall
  mpicc mpi_nosyscall.c -i_dynamic -o mpi_nosyscall

where `which mpicc` =
/apps/x86_64/mpi/openmpi/intel-9.1/openmpi-1.1.2-ofed/bin/mpicc The
latter has no system call and runs fine on two processors, whereas the
former gives the openib error (not in the attached output, though dumped
to the screen). The problem exists regardless of whether -i_dynamic is
included. I am executing from within an interactive 2 processor job
using

  /apps/x86_64/mpi/openmpi/intel-9.1/openmpi-1.1.2-ofed/bin/mpiexec ->
orterun

I know some OpenMPI developers have access to thunderbird for testing,
but if you require additional information on the build or runtime
environment, please advise and I will attempt to send it along.

Note: Both programs run fine with MVAPICH on tbird, and with OpenMPI or
MPICH on my Linux x86_64 SMP workstation.

Thanks,
Brian
----------------------------------------
Brian M. Adams, PhD (briadam_at_[hidden])
Optimization and Uncertainty Estimation
Sandia National Laboratories
P.O. Box 5800, Mail Stop 1318
Albuquerque, NM 87185-1318
Voice: 505-284-8845, FAX: 505-284-2518