Open MPI logo

Open MPI Development Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Development mailing list

Subject: Re: [OMPI devel] [OMPI svn-full] svn:open-mpi r24830
From: Terry Dontje (terry.dontje_at_[hidden])
Date: 2011-07-14 09:38:51

On 7/14/2011 9:17 AM, Yevgeny Kliteynik wrote:
> On 14-Jul-11 3:30 PM, Jeff Squyres wrote:
>> The real question is: does Solaris have the same data structures required for Linux's dynamic SL support? If so, this header file inquiry is worthwhile. If not, then perhaps a separate port will be required for Solaris to support the dynamic SL functionality.
> I know for sure that at some point OpenFabrics OpenSM has forked
> and was used as a basis for *some* Solaris SM, which possibly
> will preserve the same headers. The MAD format has to stay the
> same to provide interoperability, and I doubt that someone renamed
> MAD fields just for fun.
> So the questions is, what header and what package contain there
> structures.
Note there is no SM delivered with Solaris specifically. So there are
no SM specific header files.
AFAIK, we rely on remote SM's whether it is one running on a switch or
on another node (like OpenSM running on Linux).
So relying on OpenSM source headers existing on Solaris is probably a
bad plan.

However, it sounds like the existance of ib_types.h might help us which
I have answered in a previous email that it does exist.
> I'm checking this offline with Oracle IB people.
> Other question is do Oracle folks care about IB QoS and torus/mesh
> topologies w.r.t. OMPI, because otherwise the dynamic SL is irrelevant.
It is not an extreme priority of ours but we would like to support it.

> -- YK
>> On Jul 14, 2011, at 7:24 AM, Terry Dontje wrote:
>>> I do but my machine room's power is down so I don't have access to it right now. I will grope around once it comes up to see what it has. I also have sent email to our IB team for some direction.
>>> --td
>>> On 7/14/2011 2:42 AM, Yevgeny Kliteynik wrote:
>>>> [adding Terry]
>>>> On 14-Jul-11 2:49 AM, Eugene Loh wrote:
>>>>> On 7/13/2011 4:31 PM, Paul H. Hargrove wrote:
>>>>>> On 7/13/2011 4:20 PM, Yevgeny Kliteynik wrote:
>>>>>>>>> Finally, are you sure that infiniband/complib/cl_types_osd.h exists on all platforms? (e.g., Solaris) I know you said you don't have any Solaris machines to test with, but you should ping Oracle directly for some testing -- Terry might not be paying attention to this specific thread...
>>>>>>> I'll check it, but my guess would be that Solaris doesn't have it.
>>>>>>> AFAIK Solaris doesn't use OpenFabrics OpenSM - it has a separate
>>>>>>> subnet manager, so I can't assume that it has.
>>>>>>> So right now the dynamic SL will probably not work on Solaris
>>>>>>> (though it won't break the compilation).
>>>>>> I have a pair of old machines running Solaris 11 Express (aka "SunOS 5.11 snv_151a November 2010").
>>>>>> These have IB Verbs support, but there is no such header. In fact, /usr/include/inifiband has no sub-directories.
>>>>> +1
>>>>> (That is, no such header and not even any subdirectories on a very recent version of Solaris 11: snv_168.)
>>>> Makes sense. But I believe that these Solaris installations
>>>> just don't have Subnet Manager, so they are not supposed to
>>>> have these headers anyway. What I don't know is what headers
>>>> are installed as part of the SM installation.
>>>> Does anybody have a Solaris machine with Subnet Manager?
>>>> -- YK
>>>>>> I may be able to do some testing eventually, but now is not a good time.
>>>>> _______________________________________________
>>>>> devel mailing list
>>>>> devel_at_[hidden]
>>> --
>>> <Mail Attachment.gif>
>>> Terry D. Dontje | Principal Software Engineer
>>> Developer Tools Engineering | +1.781.442.2631
>>> Oracle - Performance Technologies
>>> 95 Network Drive, Burlington, MA 01803
>>> Email terry.dontje_at_[hidden]
>>> _______________________________________________
>>> devel mailing list
>>> devel_at_[hidden]
> _______________________________________________
> devel mailing list
> devel_at_[hidden]

Terry D. Dontje | Principal Software Engineer
Developer Tools Engineering | +1.781.442.2631
Oracle *- Performance Technologies*
95 Network Drive, Burlington, MA 01803
Email terry.dontje_at_[hidden] <mailto:terry.dontje_at_[hidden]>