I had sent a message two weeks ago about this problem and talked with
jeff at SC06 about how it might not be a OMPI problem. But it
appears now working with myricom that it is a problem in both
lam-7.1.2 and openmpi-1.1.2/1.1.1. Basically the results from a HPL
run are wrong, Also causes a large number of packets to be dropped
by the fabric.
This problem does not happen when using mpichgm. The number of
dropped packets does not go up. There is a ticket open with myircom
on this. They are a member of the group working on OMPI but i sent
this out just to bring the list uptodate.
If you have any questions feel free to ask me. The details are in
Center for Advanced Computing