Open MPI logo

Open MPI Development Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Development mailing list

Subject: Re: [OMPI devel] OpenSHMEM up on bitbucket
From: Nathan Hjelm (hjelmn_at_[hidden])
Date: 2013-07-24 14:27:38


Its MAP_ANON on OS X... It works on Linux as well but it is marked deprecated.

-Nathan

On Wed, Jul 24, 2013 at 01:10:38PM +0000, Joshua Ladd wrote:
> Great feedback. Thanks, Jeff. We always compile on IB machines (in fact, no one in MLNX has a Mac to test on OSX.) We appreciate the help!! We will iterate on this.
>
> Josh
>
> -----Original Message-----
> From: devel-bounces_at_[hidden] [mailto:devel-bounces_at_[hidden]] On Behalf Of Jeff Squyres (jsquyres)
> Sent: Wednesday, July 24, 2013 8:31 AM
> To: Open MPI Developers
> Subject: Re: [OMPI devel] OpenSHMEM up on bitbucket
>
> In addition to the I-don't-have-verbs compile errors on my Mac, I also get these:
>
> base/memheap_base_alloc.c: In function '__shm_attach':
> base/memheap_base_alloc.c:216: error: 'SHM_HUGETLB' undeclared (first use in this function)
> base/memheap_base_alloc.c:216: error: (Each undeclared identifier is reported only once
> base/memheap_base_alloc.c:216: error: for each function it appears in.)
> base/memheap_base_alloc.c: In function '__mmap_attach':
> base/memheap_base_alloc.c:275: error: 'MAP_ANONYMOUS' undeclared (first use in this function)
> make[2]: *** [base/memheap_base_alloc.lo] Error 1
>
>
>
> On Jul 24, 2013, at 8:03 AM, Ralph Castain <rhc_at_[hidden]>
> wrote:
>
> > Hmmmm....I'm afraid this doesn't build for us folks that don't have IB on their system. From what I can see, it looks like you broke a fundamental abstraction layer rule by including a header from a component into a completely different component. That is definitely *not* allowed for precisely this reason.
> >
> > In file included from ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:32,
> > from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
> > from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
> > from base/spml_base.c:19:
> > ../../../ompi/mca/btl/openib/btl_openib.h:34:30: error:
> > infiniband/verbs.h: No such file or directory In file included from ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:32,
> > from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
> > from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
> > from base/spml_base.c:19:
> > ../../../ompi/mca/btl/openib/btl_openib.h:374: error: field
> > 'ib_dev_attr' has incomplete type In file included from ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:32,
> > from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
> > from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
> > from base/spml_base.c:19:
> > ../../../ompi/mca/btl/openib/btl_openib.h:470: error: field
> > 'ib_port_attr' has incomplete type In file included from ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:33,
> > from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
> > from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
> > from base/spml_base.c:19:
> > ../../../ompi/mca/btl/openib/btl_openib_frag.h:306: error: field
> > 'sg_entry' has incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_frag.h:318: error: field
> > 'sr_desc' has incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_frag.h:345: error: field
> > 'rd_desc' has incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_frag.h:359: error: field
> > 'sr_desc' has incomplete type In file included from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
> > from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
> > from base/spml_base.c:19:
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h: In function 'post_recvs':
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:367: error:
> > dereferencing pointer to incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error:
> > dereferencing pointer to incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error:
> > dereferencing pointer to incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error:
> > dereferencing pointer to incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error:
> > dereferencing pointer to incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error:
> > dereferencing pointer to incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:376: error:
> > dereferencing pointer to incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:378: error: implicit declaration of function 'ibv_post_recv'
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h: In function 'ib_send_flags':
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:515: error:
> > 'IBV_SEND_SIGNALED' undeclared (first use in this function)
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:515: error: (Each
> > undeclared identifier is reported only once
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:515: error: for
> > each function it appears in.)
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:516: error:
> > 'IBV_SEND_INLINE' undeclared (first use in this function)
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h: In function 'post_send':
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:543: error:
> > dereferencing pointer to incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:546: error:
> > dereferencing pointer to incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:546: error:
> > dereferencing pointer to incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:554: error:
> > dereferencing pointer to incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:556: error:
> > dereferencing pointer to incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:556: error:
> > 'IBV_WR_RDMA_WRITE' undeclared (first use in this function)
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:557: error:
> > dereferencing pointer to incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:569: error:
> > dereferencing pointer to incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:578: error:
> > dereferencing pointer to incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:584: error:
> > dereferencing pointer to incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:584: error:
> > dereferencing pointer to incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:587: error:
> > dereferencing pointer to incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:587: error:
> > 'IBV_WR_SEND' undeclared (first use in this function)
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:589: error:
> > dereferencing pointer to incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:589: error:
> > 'IBV_WR_SEND_WITH_IMM' undeclared (first use in this function)
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:593: error:
> > dereferencing pointer to incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:602: error:
> > dereferencing pointer to incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:604: error:
> > dereferencing pointer to incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:604: error:
> > 'IBV_SEND_SIGNALED' undeclared (first use in this function)
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:610: error: implicit declaration of function 'ibv_post_send'
> > make[2]: *** [base/spml_base.lo] Error 1
> > make[2]: *** Waiting for unfinished jobs....
> > make[1]: *** [all-recursive] Error 1
> > make: *** [all-recursive] Error 1
> >
> >
> >
> > On Jul 24, 2013, at 4:51 AM, Ralph Castain <rhc_at_[hidden]> wrote:
> >
> >> I'm afraid Josh got bit by grabbing the wrong URL - here's the correct clone command for anyone not Josh:
> >>
> >> git clone https://bitbucket.org/jladd_math/mlnx-oshmem.git
> >>
> >>
> >> On Jul 23, 2013, at 6:43 AM, Joshua Ladd <joshual_at_[hidden]> wrote:
> >>
> >>> Dear OMPI Developers,
> >>>
> >>> I have put Mellanox OpenSHMEM up for review on my Bitbucket. Please "git" and test at your leisure. Questions, comments, and critiques are most welcome.
> >>>
> >>> git clone
> >>> https://jladd_math@bitbucket.org/jladd_math/mlnx-oshmem.git
> >>>
> >>> To build with OSHMEM support, build as you would OMPI but simply include '--with-oshmem' on your configure line. This will get you started.
> >>>
> >>> Best regards,
> >>>
> >>> Josh
> >>>
> >>>
> >>>
> >>> Joshua S. Ladd, PhD
> >>> HPC Algorithms Engineer
> >>> Mellanox Technologies
> >>>
> >>> Email: joshual_at_[hidden]
> >>> Cell: +1 (865) 258 - 8898
> >>>
> >>>
> >>> _______________________________________________
> >>> devel mailing list
> >>> devel_at_[hidden]
> >>> http://www.open-mpi.org/mailman/listinfo.cgi/devel
> >>
> >
> > _______________________________________________
> > devel mailing list
> > devel_at_[hidden]
> > http://www.open-mpi.org/mailman/listinfo.cgi/devel
>
>
> --
> Jeff Squyres
> jsquyres_at_[hidden]
> For corporate legal information go to: http://www.cisco.com/web/about/doing_business/legal/cri/
>
>
> _______________________________________________
> devel mailing list
> devel_at_[hidden]
> http://www.open-mpi.org/mailman/listinfo.cgi/devel
>
> _______________________________________________
> devel mailing list
> devel_at_[hidden]
> http://www.open-mpi.org/mailman/listinfo.cgi/devel