Open MPI User's Mailing List Archives

Subject: Re: [OMPI users] openmpi, 1.6.3, mlx4_core, log_num_mtt and Debian/vanilla kernel
From: Paul Kapinos (kapinos_at_[hidden])
Date: 2013-02-21 06:23:14

• Next message: Stefan Friedel: "Re: [OMPI users] openmpi, 1.6.3, mlx4_core, log_num_mtt and Debian/vanilla kernel"
• Previous message: Stefan Friedel: "[OMPI users] openmpi, 1.6.3, mlx4_core, log_num_mtt and Debian/vanilla kernel"
• In reply to: Stefan Friedel: "[OMPI users] openmpi, 1.6.3, mlx4_core, log_num_mtt and Debian/vanilla kernel"
• Next in thread: Stefan Friedel: "Re: [OMPI users] openmpi, 1.6.3, mlx4_core, log_num_mtt and Debian/vanilla kernel"
• Reply: Stefan Friedel: "Re: [OMPI users] openmpi, 1.6.3, mlx4_core, log_num_mtt and Debian/vanilla kernel"

The MTT-Parameter mess is well-known and the good solution is to set the MTT
parameter high. In other case you never know what you will get - your
application may hang, block the IB interface, run bit slower, run very slow...

http://www.open-mpi.org/faq/?category=openfabrics#ib-low-reg-mem
http://www.open-mpi.org/community/lists/devel/2012/08/11417.php
http://montecarlo.vtt.fi/mtg/2012_Madrid/Hans_Hammer2.pdf

On 02/21/13 11:53, Stefan Friedel wrote:
> Is there a way to tell openmpi-1.6.3 to use the ofed-module from vanilla
> kernel and not to rely on log_num_mtt for
> "do-we-have-enough-registred-mem" computation for Mellanox HCAs? Any
> other idea/hint?

-- 
Dipl.-Inform. Paul Kapinos   -   High Performance Computing,
RWTH Aachen University, Center for Computing and Communication
Seffenter Weg 23,  D 52074  Aachen (Germany)
Tel: +49 241/80-24915

• application/pkcs7-signature attachment: S/MIME Cryptographic Signature

• Next message: Stefan Friedel: "Re: [OMPI users] openmpi, 1.6.3, mlx4_core, log_num_mtt and Debian/vanilla kernel"
• Previous message: Stefan Friedel: "[OMPI users] openmpi, 1.6.3, mlx4_core, log_num_mtt and Debian/vanilla kernel"
• In reply to: Stefan Friedel: "[OMPI users] openmpi, 1.6.3, mlx4_core, log_num_mtt and Debian/vanilla kernel"
• Next in thread: Stefan Friedel: "Re: [OMPI users] openmpi, 1.6.3, mlx4_core, log_num_mtt and Debian/vanilla kernel"
• Reply: Stefan Friedel: "Re: [OMPI users] openmpi, 1.6.3, mlx4_core, log_num_mtt and Debian/vanilla kernel"