Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

Subject: Re: [OMPI users] OpenMPI with Gemini Interconnect
From: Nathan Hjelm (hjelmn_at_[hidden])
Date: 2014-04-16 17:19:09

You do not need CCM to use Open MPI on with Gemini and Aries. Open MPI
has natively supported both networks since 1.7.0. Please take a look at
the platform files in contrib/platform/lanl/cray_xe6 for CLE 4.1
support. You should be able to just build using:

configure --with-platform=contrib/platform/lanl/cray_xe6/optimized-lustre

If you also enable the Java interfaces you should be up and running with
Gemini. Keep in mind you can use either mpirun or aprun to launch. You
will get a warning message from PMI (there is an open bug on this) when
using mpirun but it is harmless.

If you want more info on the XE, XK, and XC support feel free to ask on
this list and I will try to get an answer back quickly.

-Nathan Hjelm

On Wed, Apr 16, 2014 at 05:01:37PM -0400, Ray Sheppard wrote:
> Hello,
> Big Red 2 provides its own MPICH based MPI. The only case where the
> provided OpenMPI module becomes relevant is when you create a CCMLogin
> instance in Cluster Compatibility Mode (CCM). For most practical uses,
> those sorts of needs are better addressed on the Quarry or Mason
> machines.
> When in CCM, the Gemini network is not directly accessible. The
> proposed idea is for middleware to present an interface resembling an IB
> interface and use it to create a subset of the Gemini network for the CCM
> virtual cluster. Unfortunately, due to a Cray bug, case 80503, that has
> not yet worked.
> Ray
> On 4/16/2014 4:44 PM, Saliya Ekanayake wrote:
> Hi,
> We have a Cray XE6/XK7 supercomputer (BigRed II) and I was trying to get
> OpenMPI Java binding working on it. I couldn't find a way to utilize its
> Gemini interconnect, instead was running on TCP, which is inefficient.
> I see some work has been done along these lines in [1] and wonder if you
> could give some suggestions on how to build OpenMPI with Gemini support.
> [1]
> Thank you,
> Saliya
> --
> Saliya Ekanayake esaliya_at_[hidden]
> _______________________________________________
> users mailing list
> users_at_[hidden]

> _______________________________________________
> users mailing list
> users_at_[hidden]

  • application/pgp-signature attachment: stored