Open MPI logo

Open MPI Development Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Development mailing list

Subject: Re: [OMPI devel] ROMIO code in OMPI
From: Rayson Ho (raysonlogin_at_[hidden])
Date: 2012-11-08 15:08:49


Vishwanath,

Can you point me to the two_phase module code? (I just wanted to make
sure that we are looking at the same problem.)

Rayson

==================================================
Open Grid Scheduler - The Official Open Source Grid Engine
http://gridscheduler.sourceforge.net/

On Thu, Nov 8, 2012 at 1:58 PM, Vishwanath Venkatesan
<venkates_at_[hidden]> wrote:
> I just checked the code for testing 2GB limitation in OMPIO. The code works
> with OMPIO's " fcoll dynamic" module. Although it does have the same 2GB
> limitation with the two_phase module which is based on ROMIO's
> implementation and the static module. I have a fix for both these modules I
> will commit them to trunk shortly.
>
>
> Thanks
> Vish
>
> Vishwanath Venkatesan
> Graduate Research Assistant
> Parallel Software Technologies Lab
> Department of Computer Science
> University of Houston
> TX, USA
> www.cs.uh.edu/~venkates
>
>
> On Nov 7, 2012, at 3:47 AM, Ralph Castain wrote:
>
> Hi Rayson
>
> We take snapshots from time to time. We debated whether or not to update
> again for the 1.7 release, but ultimately decided not to do so - IIRC, none
> of our developers had the time.
>
> If you are interested and willing to do the update, and perhaps look at
> removing the limit, that is fine with me! You might check to see if the
> latest ROMIO can go past 2GB - could be that an update is all that is
> required.
>
> Alternatively, you might check with Edgar Gabriel about the ompio component
> and see if it either supports > 2GB sizes or can also be extended to do so.
> Might be that a simple change to select that module instead of ROMIO would
> meet the need.
>
> Appreciate your interest in contributing!
> Ralph
>
>
> On Tue, Nov 6, 2012 at 11:55 AM, Rayson Ho <raysonlogin_at_[hidden]> wrote:
>>
>> How is the ROMIO code in Open MPI developed & maintained? Do Open MPI
>> releases take snapshots of the ROMIO code from time to time from the
>> ROMIO project, or was the ROMIO code forked a while ago and maintained
>> separately in Open MPI??
>>
>> I would like to fix the 2GB limit in the ROMIO code... and that's why
>> I am asking! :-D
>>
>> Rayson
>>
>> ==================================================
>> Open Grid Scheduler - The Official Open Source Grid Engine
>> http://gridscheduler.sourceforge.net/
>>
>>
>> On Thu, Nov 1, 2012 at 6:21 PM, Richard Shaw <jrs65_at_[hidden]>
>> wrote:
>> > Hi Rayson,
>> >
>> > Just seen this.
>> >
>> > In the end we've worked around it, by creating successive views of the
>> > file
>> > that are all else than 2GB and then offsetting them to eventually read
>> > in
>> > everything. It's a bit of a pain to keep track of, but it works at the
>> > moment.
>> >
>> > I was intending on following your hints and trying to fix the bug
>> > myself,
>> > but I've been short on time so haven't gotten around to it yet.
>> >
>> > Richard
>> >
>> > On Saturday, 20 October, 2012 at 10:12 AM, Rayson Ho wrote:
>> >
>> > Hi Eric,
>> >
>> > Sounds like it's also related to this problem reported by Scinet back in
>> > July:
>> >
>> > http://www.open-mpi.org/community/lists/users/2012/07/19762.php
>> >
>> > And I think I found the issue, but I still have not followed up with
>> > the ROMIO guys yet. And I was not sure if Scinet was waiting for the
>> > fix or not - next time I visit U of Toronto, I will see if I can visit
>> > the Scinet office and meet with the Scinet guys!
>> >
>> >
>> >
>> >
>> > _______________________________________________
>> > users mailing list
>> > users_at_[hidden]
>> > http://www.open-mpi.org/mailman/listinfo.cgi/users
>> _______________________________________________
>> devel mailing list
>> devel_at_[hidden]
>> http://www.open-mpi.org/mailman/listinfo.cgi/devel
>
>
> _______________________________________________
> devel mailing list
> devel_at_[hidden]
> http://www.open-mpi.org/mailman/listinfo.cgi/devel
>
>
>
> _______________________________________________
> devel mailing list
> devel_at_[hidden]
> http://www.open-mpi.org/mailman/listinfo.cgi/devel