Open MPI logo

Open MPI Development Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Development mailing list

Subject: Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC
From: Steve Wise (swise_at_[hidden])
Date: 2013-08-19 16:24:59


> -----Original Message-----
> From: Jeff Squyres (jsquyres) [mailto:jsquyres_at_[hidden]]
> Sent: Monday, August 19, 2013 3:23 PM
> To: Steve Wise
> Cc: Open MPI Developers; Indranil Choudhury
> Subject: Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC
>
> No need to both post to the ticket and to devel -- just pick one. :-)
>

Mkay.

> Can you send a patch/fix?
>

I could if I had a patch/fix. :) I don't (yet) understand why HAVE_IBV_LINK_LAYER_ETHERNET was
added. Can the developer who made these changes explain the intent? I think it might have to do
with RoCE support.
 
>
> On Aug 19, 2013, at 4:17 PM, Steve Wise <swise_at_[hidden]> wrote:
>
> >> -----Original Message-----
> >> From: devel [mailto:devel-bounces_at_[hidden]] On Behalf Of Steve Wise
> >> Sent: Monday, August 19, 2013 2:42 PM
> >> To: 'Open MPI Developers'; 'Jeff Squyres (jsquyres)'
> >> Cc: 'Indranil Choudhury'
> >> Subject: Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC
> >>
> >> I confirmed that this is a regression from 1.7.1...
> >>
> >> I'll see if I can figure out what's going on...
> >>
> >
> >
> > Looks like this is not defined anywhere: HAVE_IBV_LINK_LAYER_ETHERNET, which causes
> > btl_openib_connect_oob.c:oob_component_query() to falsely claim oob support for iwarp devices.
> >
> > In 1.7.1 we see this in oob_component_query():
> >
> > #if defined(HAVE_STRUCT_IBV_DEVICE_TRANSPORT_TYPE)
> > if (BTL_OPENIB_CONNECT_BASE_CHECK_IF_NOT_IB(btl)) {
> > opal_output_verbose(5, mca_btl_base_output,
> > "openib BTL: oob CPC only supported on InfiniBand; skipped on
%s:%d",
> > ibv_get_device_name(btl->device->ib_dev),
> > btl->port_num);
> > return OMPI_ERR_NOT_SUPPORTED;
> > }
> > #endif
> >
> > In 1.7.2, it adds the HAVE_IBV_LINK_LAYER_ETHERNET define:
> >
> > #if defined(HAVE_STRUCT_IBV_DEVICE_TRANSPORT_TYPE) &&
> defined(HAVE_IBV_LINK_LAYER_ETHERNET)
> > if (BTL_OPENIB_CONNECT_BASE_CHECK_IF_NOT_IB(btl)) {
> > opal_output_verbose(5, mca_btl_base_output,
> > "openib BTL: oob CPC only supported on InfiniBand; skipped on
%s:%d",
> > ibv_get_device_name(btl->device->ib_dev),
> > btl->port_num);
> > return OMPI_ERR_NOT_SUPPORTED;
> > }
> > #endif
> >
> >
>
>
> --
> Jeff Squyres
> jsquyres_at_[hidden]
> For corporate legal information go to: http://www.cisco.com/web/about/doing_business/legal/cri/