Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

Subject: Re: [OMPI users] anybody tried OMPI with gpudirect?
From: Rolf vandeVaart (rvandevaart_at_[hidden])
Date: 2011-02-28 14:22:50

-----Original Message-----
From: users-bounces_at_[hidden] [mailto:users-bounces_at_[hidden]] On Behalf Of Brice Goglin
Sent: Monday, February 28, 2011 2:14 PM
To: Open MPI Users
Subject: Re: [OMPI users] anybody tried OMPI with gpudirect?

Le 28/02/2011 19:49, Rolf vandeVaart a écrit :
> For the GPU Direct to work with Infiniband, you need to get some updated OFED bits from your Infiniband vendor.
> In terms of checking the driver updates, you can do a grep on the string get_driver_pages in the file/proc/kallsyms. If it is there, then the Linux kernel is updated correctly.

The kernel looks ok then. But I couldn't find any kernel modules (tried nvidia.ko and all ib modules) which references this symbol. So I guess my OFED kernel modules aren't ok. I'll check on Mellanox website (we have some very recent Mellanox ConnectX QDR boards).


I have since learned that you can check /sys/module/ib_core/parameters/* which will list a couple of GPU direct files if the driver is installed correctly and loaded.


This email message is for the sole use of the intended recipient(s) and may contain
confidential information. Any unauthorized review, use, disclosure or distribution
is prohibited. If you are not the intended recipient, please contact the sender by
reply email and destroy all copies of the original message.