Open MPI logo

Open MPI Development Mailing List Archives

  |   Home   |   Support   |   FAQ   |  

This web mail archive is frozen.

This page is part of a frozen web archive of this mailing list.

You can still navigate around this archive, but know that no new mails have been added to it since July of 2016.

Click here to be taken to the new web archives of this list; it includes all the mails that are in this frozen archive plus all new mails that have been sent to the list since it was migrated to the new archives.

Subject: [OMPI devel] Memory accounting issues with mpirun (was Re: [slurm-dev] Open-MPI build of NAMD launched from srun over 20% slowed than with mpirun)
From: Christopher Samuel (samuel_at_[hidden])
Date: 2013-08-07 02:18:41

Hash: SHA1

On 23/07/13 17:06, Christopher Samuel wrote:

> Bringing up a new IBM SandyBridge cluster I'm running a NAMD test
> case and noticed that if I run it with srun rather than mpirun it
> goes over 20% slower.

Following on from this issue, we've found that whilst mpirun gives
acceptable performance the memory accounting doesn't appear to be correct.

Anyone seen anything similar, or any ideas on what could be going on?

Here are two identical NAMD jobs running over 69 nodes using 16 nodes
per core, this one launched with mpirun (Open-MPI 1.6.5):

==> slurm-94491.out <==
WallClock: 101.176193 CPUTime: 101.176193 Memory: 1268.554688 MB
End of program

[samuel_at_barcoo-test Mem]$ sacct -j 94491 -o JobID,MaxRSS,MaxVMSize
       JobID MaxRSS MaxVMSize
- ------------ ---------- ----------
94491.batch 6504068K 11167820K
94491.0 5952048K 9028060K

This one launched with srun (about 60% slower):

==> slurm-94505.out <==
WallClock: 163.314163 CPUTime: 163.314163 Memory: 1253.511719 MB
End of program

[samuel_at_barcoo-test Mem]$ sacct -j 94505 -o JobID,MaxRSS,MaxVMSize
       JobID MaxRSS MaxVMSize
- ------------ ---------- ----------
94505.batch 7248K 1582692K
94505.0 1022744K 1307112K

- --
 Christopher Samuel Senior Systems Administrator
 VLSCI - Victorian Life Sciences Computation Initiative
 Email: samuel_at_[hidden] Phone: +61 (0)3 903 55545

Version: GnuPG v1.4.11 (GNU/Linux)
Comment: Using GnuPG with Thunderbird -