Dear all

I tried to increase speed of a program with openmpi-1.1.3 by adding following 4 parameters into openmpi-mca-params.conf file.

mpi_leave_pinned=1
btl_openib_eager_rdma_num=128
btl_openib_max_eager_rdma=128
btl_openib_eager_limit=1024

and then, I ran my program twice(124 processes on 31 nodes). one with "mpi_leave_pinned=1", another with "mpi_leave_pinned=0".
All of them were stopped abnormally with "ctrl+c" and "killall -9 <program>".
After that, I couldn't start to run that program again.
I checked every nodes with "free -m" and I found that huge amount of cached memory were used in each nodes.
Could this situation be caused by those 4 parameters? IS there anyway to free theme?

Best regard

T. H. Hsieh
MS. Student, NTU, Taiwan.