Subject: Re: [MTT users] ssh tunnel and wget
From: Jeff Squyres (jsquyres) (jsquyres_at_[hidden])
Date: 2013-10-02 10:27:16
Sorry for the giant delay in replying to this...
I think there's 2 options here:
1. Modify MTT to let you pass something like "ompi_snapshot_wget_header=Host: www.open-mpi.org" in the INI file. This is certainly do-able; I don't have the time to do it, but I'd be happy to look at a patch if you submit one.
2. Split your "get" into 2 phases: have some server that has direct access to the internet do the wget on a regular basis, and put the resulting files in a directory that can be accessed by your back-end cluster (i.e., you'll need to write a script to do this). Then you can have MTT look in that directory for new tarballs (you might need to write this, too? I don't think MTT does that functionality right now, but it wouldn't be hard to add).
On Sep 25, 2013, at 7:53 AM, Christoph Niethammer <niethammer_at_[hidden]> wrote:
> Hello,
>
> Thanks for the replay.
> My configure section looks nearly the same.
>
> [MPI get: ompi-nightly-trunk]
> module = OMPI_Snapshot
> mpi_details = Open MPI
> ompi_snapshot_url = http://localhost:PORT/nightly/trunk
>
> Only www.open-mpi.org is replaced by localhost:PORT which corresponds to a ssh tunnel to outer world open-mpi.org. (PORT is a number in the config)
>
> As of HTTP/1.0 wget sends a Host header entry - in this case localhost - which is denied by the open-mpi website.
> I would like to overwrite this in the mtt settings instead of using a wget wrapper if possible.
>
> Regards
> Christoph
>
> ----- Ursprüngliche Mail -----
> Von: "Ralph Castain" <rhc_at_[hidden]>
> An: "General user list for the MPI Testing Tool" <mtt-users_at_[hidden]>
> Gesendet: Freitag, 20. September 2013 15:40:30
> Betreff: Re: [MTT users] ssh tunnel and wget
>
> I always do it within MTT - here is the relevant block in the MTT .ini file:
>
> #======================================================================
> # MPI get phase
> #======================================================================
>
> [MPI get: ompi-nightly-trunk]
> mpi_details = Open MPI
>
> module = OMPI_Snapshot
> ompi_snapshot_url = http://www.open-mpi.org/nightly/trunk
> ompi_snapshot_version_file = /home/common/mtt-versions/trunk&getenv("MTT_VERSION_FILE_SUFFIX").txt
>
>
> On Sep 20, 2013, at 1:56 AM, Christoph Niethammer <niethammer_at_[hidden]> wrote:
>
>> Hello,
>>
>> I have to go through ssh tunnels to fetch Open MPI snapshots/svn and report results.
>> Unfortunately there is a problem with wget, as the Hostname requesting does not fit.
>> I can solve this by using a wget wrapper including the --header="Host: www.open-mpi.org" option
>> which is far from optimal, as this does only work for open-mpi downloads then...
>>
>> My question now: Is there a better/more elegant way to do this, maybe in MTT itself?
>>
>> Regards
>> Christoph
>> _______________________________________________
>> mtt-users mailing list
>> mtt-users_at_[hidden]
>> http://www.open-mpi.org/mailman/listinfo.cgi/mtt-users
>
> _______________________________________________
> mtt-users mailing list
> mtt-users_at_[hidden]
> http://www.open-mpi.org/mailman/listinfo.cgi/mtt-users
> _______________________________________________
> mtt-users mailing list
> mtt-users_at_[hidden]
> http://www.open-mpi.org/mailman/listinfo.cgi/mtt-users
-- Jeff Squyres jsquyres_at_[hidden] For corporate legal information go to: http://www.cisco.com/web/about/doing_business/legal/cri/