I am very new to the concept of MPI, and have only recently begun
researching it. I have a very basic question about the way MPI works.
How exactly does MPI distribute user-created applications (binary code) over
a network? Does it actually copy the binary into the local memory of each
node, and execute it? If so, doesn't this put serious restrictions on the
heterogeneity of the network? For example, in order to run a distributed
application (compiled with gcc) over a typical Linux cluster, you'd need to
make sure that each node has the same version of glibc, or there could be
issues running the binary.
Any information would be greatly appreciated.