Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

Subject: Re: [OMPI users] which ofed rpms for openmpi
From: Jeff Squyres (jsquyres_at_[hidden])
Date: 2010-01-23 08:36:17


I can't speak to a specific RPM list (Cisco's out of the IB business these days...), but maybe this will help:

1. To build OMPI, all you need is the verbs library and devel headers.

2. To run OMPI, all OMPI needs is the verb library. You probably also need the relevant verbs library plugin for your IB HCAs (e.g., libmlx4 if you have ConnectX HCAs).

I'll make a few notes below in your list.

> compat-dapl-1.2.14-1.x86_64.rpm
> compat-dapl-debuginfo-1.2.14-1.x86_64.rpm
> compat-dapl-devel-1.2.14-1.x86_64.rpm
> compat-dapl-devel-static-1.2.14-1.x86_64.rpm
> compat-dapl-utils-1.2.14-1.x86_64.rpm
> dapl-2.0.19-1.x86_64.rpm
> dapl-debuginfo-2.0.19-1.x86_64.rpm
> dapl-devel-2.0.19-1.x86_64.rpm
> dapl-devel-static-2.0.19-1.x86_64.rpm
> dapl-utils-2.0.19-1.x86_64.rpm

You definitely do not need any DAPL RPMs for OMPI.

> ib-bonding-0.9.0-2.6.18_164.9.1.el5n.x86_64.rpm
> ib-bonding-debuginfo-0.9.0-2.6.18_164.9.1.el5n.x86_64.rpm

I doubt you need the bonding RPMs; OMPI does its own multi-device stuff.

> ibsim-0.5-1.ofed1.4.2.x86_64.rpm
> ibsim-debuginfo-0.5-1.ofed1.4.2.x86_64.rpm

I don't know what ibsim is.

> ibutils-1.2-1.ofed1.4.2.x86_64.rpm
> ibutils-debuginfo-1.2-1.ofed1.4.2.x86_64.rpm
> ibvexdmtools-0.0.1-1.ofed1.4.2.x86_64.rpm
> infiniband-diags-1.4.4_20090314-1.ofed1.4.2.x86_64.rpm
> infiniband-diags-debuginfo-1.4.4_20090314-1.ofed1.4.2.x86_64.rpm

I don't know specifics of these, but you might want that to have some on-node diagnostics?

> kernel-ib-1.4.2-2.6.18_164.9.1.el5n.x86_64.rpm
> kernel-ib-devel-1.4.2-2.6.18_164.9.1.el5n.x86_64.rpm

I'm assuming you need at least kernel-ib.

> libcxgb3-1.2.2-1.ofed1.4.2.x86_64.rpm
> libcxgb3-debuginfo-1.2.2-1.ofed1.4.2.x86_64.rpm
> libcxgb3-devel-1.2.2-1.ofed1.4.2.x86_64.rpm

This is the Chelsio T3 RNIC plugin for verbs.

> libibcm-1.0.4-1.ofed1.4.2.x86_64.rpm
> libibcm-debuginfo-1.0.4-1.ofed1.4.2.x86_64.rpm
> libibcm-devel-1.0.4-1.ofed1.4.2.x86_64.rpm

You don't need the IB CM; OMPI doesn't support it (yet).

> libibcommon-1.1.2_20090314-1.ofed1.4.2.x86_64.rpm
> libibcommon-debuginfo-1.1.2_20090314-1.ofed1.4.2.x86_64.rpm
> libibcommon-devel-1.1.2_20090314-1.ofed1.4.2.x86_64.rpm
> libibcommon-static-1.1.2_20090314-1.ofed1.4.2.x86_64.rpm

I assume you need libibcommon.

> libibmad-1.2.3_20090314-1.ofed1.4.2.x86_64.rpm
> libibmad-debuginfo-1.2.3_20090314-1.ofed1.4.2.x86_64.rpm
> libibmad-devel-1.2.3_20090314-1.ofed1.4.2.x86_64.rpm
> libibmad-static-1.2.3_20090314-1.ofed1.4.2.x86_64.rpm
> libibumad-1.2.3_20090314-1.ofed1.4.2.x86_64.rpm
> libibumad-debuginfo-1.2.3_20090314-1.ofed1.4.2.x86_64.rpm
> libibumad-devel-1.2.3_20090314-1.ofed1.4.2.x86_64.rpm
> libibumad-static-1.2.3_20090314-1.ofed1.4.2.x86_64.rpm

These are IB management things; you might need them...?

> libibverbs-1.1.2-1.ofed1.4.2.x86_64.rpm
> libibverbs-debuginfo-1.1.2-1.ofed1.4.2.x86_64.rpm
> libibverbs-devel-1.1.2-1.ofed1.4.2.x86_64.rpm
> libibverbs-devel-static-1.1.2-1.ofed1.4.2.x86_64.rpm
> libibverbs-utils-1.1.2-1.ofed1.4.2.x86_64.rpm

This is the main verbs library; you need it.

> libipathverbs-1.1-1.ofed1.4.2.x86_64.rpm
> libipathverbs-debuginfo-1.1-1.ofed1.4.2.x86_64.rpm
> libipathverbs-devel-1.1-1.ofed1.4.2.x86_64.rpm

Verbs plugin for QLogic HCAs.

> libmlx4-1.0-1.ofed1.4.2.x86_64.rpm
> libmlx4-debuginfo-1.0-1.ofed1.4.2.x86_64.rpm
> libmlx4-devel-1.0-1.ofed1.4.2.x86_64.rpm

Verbs plugin for ConnectX HCAs.

> libmthca-1.0.5-1.ofed1.4.2.x86_64.rpm
> libmthca-debuginfo-1.0.5-1.ofed1.4.2.x86_64.rpm
> libmthca-devel-static-1.0.5-1.ofed1.4.2.x86_64.rpm

Verbs plugin for older Mellanox HCAs.

> libnes-0.6-1.ofed1.4.2.x86_64.rpm
> libnes-debuginfo-0.6-1.ofed1.4.2.x86_64.rpm
> libnes-devel-static-0.6-1.ofed1.4.2.x86_64.rpm

Verbs plugin for Intel/NetEffect RNICs.

> librdmacm-1.0.8-1.ofed1.4.2.x86_64.rpm
> librdmacm-debuginfo-1.0.8-1.ofed1.4.2.x86_64.rpm
> librdmacm-devel-1.0.8-1.ofed1.4.2.x86_64.rpm
> librdmacm-utils-1.0.8-1.ofed1.4.2.x86_64.rpm

OMPI supports the RDMA CM, but you may or may not need (or want) it.

> libsdp-1.1.99-1.ofed1.4.2.x86_64.rpm
> libsdp-debuginfo-1.1.99-1.ofed1.4.2.x86_64.rpm
> libsdp-devel-1.1.99-1.ofed1.4.2.x86_64.rpm

I'm guessing you won't be using SDP.

> mpi-selector-1.0.3-1.x86_64.rpm

I'm guessing NERSC doesn't need mpi-selector (you use shell modules, right?).

> mstflint-1.4-1.ofed1.4.2.x86_64.rpm
> mstflint-debuginfo-1.4-1.ofed1.4.2.x86_64.rpm

I believe this is a firmware burner...?

> mvapich2_gcc-1.2p1-1.x86_64.rpm
> mvapich_gcc-1.1.0-3355.x86_64.rpm
> ofed-docs-1.4.2-0.x86_64.rpm
> ofed-scripts-1.4.2-0.x86_64.rpm
> opensm-3.2.6_20090317-1.ofed1.4.2.x86_64.rpm
> opensm-debuginfo-3.2.6_20090317-1.ofed1.4.2.x86_64.rpm
> opensm-devel-3.2.6_20090317-1.ofed1.4.2.x86_64.rpm
> opensm-libs-3.2.6_20090317-1.ofed1.4.2.x86_64.rpm
> opensm-static-3.2.6_20090317-1.ofed1.4.2.x86_64.rpm

You only need opensm installed on 1 node.

> perftest-1.2-1.ofed1.4.2.x86_64.rpm
> perftest-debuginfo-1.2-1.ofed1.4.2.x86_64.rpm

Various diag / perf tests.

> qlgc_vnic_daemon-0.0.1-1.ofed1.4.2.x86_64.rpm
> qlvnictools-0.0.1-1.ofed1.4.2.x86_64.rpm
> qlvnictools-debuginfo-0.0.1-1.ofed1.4.2.x86_64.rpm
> qperf-0.4.6-1.ofed1.4.2.x86_64.rpm
> qperf-debuginfo-0.4.6-1.ofed1.4.2.x86_64.rpm

Not 100% sure what these are.

> rds-tools-1.4-1.x86_64.rpm
> rds-tools-debuginfo-1.4-1.x86_64.rpm

RDS; you probably don't need it.

> rnfs-utils-1.1.5-2.OFED.x86_64.rpm
> rnfs-utils-debuginfo-1.1.5-2.OFED.x86_64.rpm

I assume this is RDMA NFS...?

> scsi-target-utils-0.1-20080828.x86_64.rpm
> sdpnetstat-1.60-1.ofed1.4.2.x86_64.rpm
> sdpnetstat-debuginfo-1.60-1.ofed1.4.2.x86_64.rpm
> srptools-0.0.4-1.ofed1.4.2.x86_64.rpm
> srptools-debuginfo-0.0.4-1.ofed1.4.2.x86_64.rpm
> tgt-0.1-20080828.x86_64.rpm
> tgt-generic-debuginfo-0.1-20080828.x86_64.rpm

SDP, SRP, SCSI tools -- I assume you don't need these.

> tvflash-0.9.0-1.ofed1.4.2.x86_64.rpm
> tvflash-debuginfo-0.9.0-1.ofed1.4.2.x86_64.rpm

I believe that this is another firmware burner.

-- 
Jeff Squyres
jsquyres_at_[hidden]