Thanks for your reply Eugene.

Here is the result of the mpif90 -showme

/state/partition1/apps/intel/fce/10.1.015/bin/ifort -I/share/apps/openmpi-1.2.6-intel/include -pthread -I/share/apps/openmpi-1.2.6-intel/lib -L/usr/pbs/lib -L/share/apps/openmpi-1.2.6-intel/lib -lmpi_f90 -lmpi_f77 -lmpi -lopen-rte -lopen-pal -lrt -lpbs -lnuma -ldl -Wl,--export-dynamic -lnsl -lutil

The mpif.h file I got off the site. I used the Google "site:  mpif.h" search and placed it into the same directory as the main program.

So if it is the correct one, I am not sure.


Date: Tue, 26 May 2009 16:54:02 -0700
From: Eugene.Loh@Sun.COM
Subject: Re: [OMPI users] MPI_COMM_WORLD Error wrote:

I and new to OpenMPI and  have looked for this, but not getting anywhere.

I got an example program off this site:

The compute PI in Fortran example.

Compiled it with "mpif90" and no errors.
Then used the qsub -I and tried both executing directly and "mpirun" and still receive these errors:

[MGT-2-1:02994] *** An error occurred in MPI_Comm_rank
[MGT-2-1:02994] *** on communicator MPI_COMM_WORLD
[MGT-2-1:02994] *** MPI_ERR_COMM: invalid communicator
[MGT-2-1:02994] *** MPI_ERRORS_ARE_FATAL (goodbye)

Any guidance in the right direction would be appreciated.
First, the example works fine for me.

You seem to be bombing in MPI_Comm_rank and before it asks you for any input.  I guess it's having problems with the MPI_COMM_WORLD communicator being passed to MPI_Comm_rank?  Maybe it's having problems finding the mpif.h include file?  It's finding *some* mpif.h include file, but presumably not the right one.  Make sure the mpif90 and mpirun commands are the ones you think you should be getting and, if they are, try adding -showme to the mpif90 line to see where it's looking for the mpif.h include file.