Open MPI logo

Open MPI Development Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Development mailing list

Subject: [OMPI devel] Slowly moving to git
From: Jeff Squyres (jsquyres) (jsquyres_at_[hidden])
Date: 2014-04-09 11:45:44

As many of you have noticed, we've been moving more repositories from SVN to git. This email is a summary of where we are and what the (current) overall plan is.

So far, the following repos are hosted in the Open MPI community at github:

1. hwloc (integrated with Trac at IU)
2. hwloc-debian
3. netloc (integrated with Trac at IU)
4. OMPI user-level documentation
5. ompi-www

The last one was just moved yesterday. All have diff emails sent from IU (because github will not send diff emails).

In short: we are slowly moving all of our SVN repos to git because git has some nicer features than SVN (we've discussed these reasons ad nauseam; I won't repeat them here).

We're moving them to github instead of hosting them at IU because github *focuses* on git hosting. They have far more resources dedicated to making slick git/web collaboration tools than IU. IU has actually been pretty awesome to the Open MPI community over the years, but asking them to build up an entirely new git-hosting/collaboration infrastructure seems like asking for too much. Github already exists and is pretty good.

Keep in mind that we're doing this migration fairly slowly. We're trying to learn with the smaller sub-projects first. ***Remember that it's not just about migrating from SVN to git, but also migrating a fair amount of infrastructure, too: SVN history, Trac data, automated tarball building, ...etc. And don't forget that the repo history and Trac data all needs to be selectively edited during the conversion to replace things like "r1234" in commit messages and trac comments to a git hash.

The hwloc SVN->git conversion was a major learning point; we have a bunch of conversion scripts that resulted from that effort. Those scripts will play a large part in converting the remaining SVN repos to git.

As part of this overall effort, I've listed all the parts of infrastructure that the overall Open MPI project uses on a wiki page:

Upcoming plans:

1. IU is working to upgrade the Trac/Github integration (probably next week).

2. Ralph is going to populate an orcm github repo in the Open MPI github community (later this week/next week); that will be repo #6.

3. IU is also working to upgrade the Github diff email integration (probably next week).

4. The MTT SVN repo is probably the next target for conversion. The ompi-www repo didn't have a Trac, and we didn't bother to import any of the SVN history, so the conversion was "relatively simple". But MTT will be another full-blown conversion (history and Trac and all), and will help us refine the scripts / procedures we used from the hwloc conversion.

5. After that, the ompi-tests SVN repo is a good target for conversion. This repo has the property of being private, however, and private repos cost money on github ($300/year is the lowest tier). We'll have to talk about/figure out who is going to pay for that.

6. Perhaps by this summer we'll be able to start talking about converting the main OMPI SVN to git. This repo is, by far, the biggest of the OMPI repos (in terms of number of commits), and will likely take the most time/effort to convert. We'll also need to talk about:

- how to handle permissions on release branches (git doesn't have the same kind of directory-based permissions that we do in SVN)
- end-of-life the bitbucket/hg mirror

Hope this helps explain the current direction. Please feel free to reply with questions / comments / offers to help. :-)

Jeff Squyres
For corporate legal information go to: