Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

Subject: Re: [OMPI users] OpenMPI with Gemini Interconnect
From: Saliya Ekanayake (esaliya_at_[hidden])
Date: 2014-04-16 17:27:07


Thank you Nathan, this is what I was looking for. I'll try to build OpenMPI
1.8 and get back to this thread if I run into issues.

Saliya

On Wed, Apr 16, 2014 at 5:19 PM, Nathan Hjelm <hjelmn_at_[hidden]> wrote:

> You do not need CCM to use Open MPI on with Gemini and Aries. Open MPI
> has natively supported both networks since 1.7.0. Please take a look at
> the platform files in contrib/platform/lanl/cray_xe6 for CLE 4.1
> support. You should be able to just build using:
>
> configure --with-platform=contrib/platform/lanl/cray_xe6/optimized-lustre
>
> If you also enable the Java interfaces you should be up and running with
> Gemini. Keep in mind you can use either mpirun or aprun to launch. You
> will get a warning message from PMI (there is an open bug on this) when
> using mpirun but it is harmless.
>
> If you want more info on the XE, XK, and XC support feel free to ask on
> this list and I will try to get an answer back quickly.
>
> -Nathan Hjelm
> HPC-5, LANL
>
>
> On Wed, Apr 16, 2014 at 05:01:37PM -0400, Ray Sheppard wrote:
> > Hello,
> > Big Red 2 provides its own MPICH based MPI. The only case where the
> > provided OpenMPI module becomes relevant is when you create a CCMLogin
> > instance in Cluster Compatibility Mode (CCM). For most practical
> uses,
> > those sorts of needs are better addressed on the Quarry or Mason
> > machines.
> > When in CCM, the Gemini network is not directly accessible. The
> > proposed idea is for middleware to present an interface resembling an
> IB
> > interface and use it to create a subset of the Gemini network for the
> CCM
> > virtual cluster. Unfortunately, due to a Cray bug, case 80503, that
> has
> > not yet worked.
> > Ray
> >
> > On 4/16/2014 4:44 PM, Saliya Ekanayake wrote:
> >
> > Hi,
> > We have a Cray XE6/XK7 supercomputer (BigRed II) and I was trying
> to get
> > OpenMPI Java binding working on it. I couldn't find a way to
> utilize its
> > Gemini interconnect, instead was running on TCP, which is
> inefficient.
> > I see some work has been done along these lines in [1] and wonder
> if you
> > could give some suggestions on how to build OpenMPI with Gemini
> support.
> > [1]
> https://www.open-mpi.org/papers/cug-2012/cug_2012_open_mpi_for_cray_xe_xk.pdf
> > Thank you,
> > Saliya
> > --
> > Saliya Ekanayake esaliya_at_[hidden]
> > http://saliya.org
> >
> > _______________________________________________
> > users mailing list
> > users_at_[hidden]
> > http://www.open-mpi.org/mailman/listinfo.cgi/users
>
> > _______________________________________________
> > users mailing list
> > users_at_[hidden]
> > http://www.open-mpi.org/mailman/listinfo.cgi/users
>
>
> _______________________________________________
> users mailing list
> users_at_[hidden]
> http://www.open-mpi.org/mailman/listinfo.cgi/users
>

-- 
Saliya Ekanayake esaliya_at_[hidden]
Cell 812-391-4914 Home 812-961-6383
http://saliya.org