Hmmmm....I'm afraid this doesn't build for us folks that don't have IB on their system. From what I can see, it looks like you broke a fundamental abstraction layer rule by including a header from a component into a completely different component. That is definitely *not* allowed for precisely this reason.

In file included from ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:32,
                 from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
                 from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
                 from base/spml_base.c:19:
../../../ompi/mca/btl/openib/btl_openib.h:34:30: error: infiniband/verbs.h: No such file or directory
In file included from ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:32,
                 from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
                 from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
                 from base/spml_base.c:19:
../../../ompi/mca/btl/openib/btl_openib.h:374: error: field 'ib_dev_attr' has incomplete type
In file included from ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:32,
                 from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
                 from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
                 from base/spml_base.c:19:
../../../ompi/mca/btl/openib/btl_openib.h:470: error: field 'ib_port_attr' has incomplete type
In file included from ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:33,
                 from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
                 from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
                 from base/spml_base.c:19:
../../../ompi/mca/btl/openib/btl_openib_frag.h:306: error: field 'sg_entry' has incomplete type
../../../ompi/mca/btl/openib/btl_openib_frag.h:318: error: field 'sr_desc' has incomplete type
../../../ompi/mca/btl/openib/btl_openib_frag.h:345: error: field 'rd_desc' has incomplete type
../../../ompi/mca/btl/openib/btl_openib_frag.h:359: error: field 'sr_desc' has incomplete type
In file included from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
                 from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
                 from base/spml_base.c:19:
../../../ompi/mca/btl/openib/btl_openib_endpoint.h: In function 'post_recvs':
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:367: error: dereferencing pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error: dereferencing pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error: dereferencing pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error: dereferencing pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error: dereferencing pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error: dereferencing pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:376: error: dereferencing pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:378: error: implicit declaration of function 'ibv_post_recv'
../../../ompi/mca/btl/openib/btl_openib_endpoint.h: In function 'ib_send_flags':
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:515: error: 'IBV_SEND_SIGNALED' undeclared (first use in this function)
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:515: error: (Each undeclared identifier is reported only once
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:515: error: for each function it appears in.)
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:516: error: 'IBV_SEND_INLINE' undeclared (first use in this function)
../../../ompi/mca/btl/openib/btl_openib_endpoint.h: In function 'post_send':
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:543: error: dereferencing pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:546: error: dereferencing pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:546: error: dereferencing pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:554: error: dereferencing pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:556: error: dereferencing pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:556: error: 'IBV_WR_RDMA_WRITE' undeclared (first use in this function)
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:557: error: dereferencing pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:569: error: dereferencing pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:578: error: dereferencing pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:584: error: dereferencing pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:584: error: dereferencing pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:587: error: dereferencing pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:587: error: 'IBV_WR_SEND' undeclared (first use in this function)
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:589: error: dereferencing pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:589: error: 'IBV_WR_SEND_WITH_IMM' undeclared (first use in this function)
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:593: error: dereferencing pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:602: error: dereferencing pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:604: error: dereferencing pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:604: error: 'IBV_SEND_SIGNALED' undeclared (first use in this function)
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:610: error: implicit declaration of function 'ibv_post_send'
make[2]: *** [base/spml_base.lo] Error 1
make[2]: *** Waiting for unfinished jobs....
make[1]: *** [all-recursive] Error 1
make: *** [all-recursive] Error 1



On Jul 24, 2013, at 4:51 AM, Ralph Castain <rhc@open-mpi.org> wrote:

I'm afraid Josh got bit by grabbing the wrong URL - here's the correct clone command for anyone not Josh:



On Jul 23, 2013, at 6:43 AM, Joshua Ladd <joshual@mellanox.com> wrote:

Dear OMPI Developers,
 
I have put Mellanox OpenSHMEM up for review on my Bitbucket. Please “git” and test at your leisure. Questions, comments, and critiques are most welcome.
 
 
To build with OSHMEM support, build as you would OMPI but simply include ‘--with-oshmem’ on your configure line. This will get you started.
 
Best regards,
 
Josh
 
 
 
Joshua S. Ladd, PhD
HPC Algorithms Engineer
Mellanox Technologies
 
Cell: +1 (865) 258 - 8898
 
 
_______________________________________________
devel mailing list
devel@open-mpi.org
http://www.open-mpi.org/mailman/listinfo.cgi/devel