I had my first contact with parallel programming ages ago in
Edinburgh where i did some projects on the transputers.
When i started using MPI i got most of what i need
from "The Complete MPI Reference" by Marc Snir and William Gropp.
My first MPI implementation was LAM MPI.