Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |  

This web mail archive is frozen.

This page is part of a frozen web archive of this mailing list.

You can still navigate around this archive, but know that no new mails have been added to it since July of 2016.

Click here to be taken to the new web archives of this list; it includes all the mails that are in this frozen archive plus all new mails that have been sent to the list since it was migrated to the new archives.

Subject: Re: [OMPI users] TCP Bandwidth
From: Steve Wise (swise_at_[hidden])
Date: 2008-08-18 15:36:07


Andy Georgi wrote:
> Steve Wise wrote:
>> Are you using Chelsio's TOE drivers? Or just a driver from the distro?
>
> We use the Chelsio TOE drivers.
>
>
> Steve Wise wrote:
>> Ok. Did you run their perftune.sh script?
>
> Yes, if not we wouldn't get the 1.15 GB/s on the TCP level. We had
> ~800 MB/s before
> primarily because of too small TCP buffers.
>
> The difference of more than 200 MB/s between 1.15 GB/s we get with
> iperf and the 930 MB/s we
> measured with a MPI-Ping-Pong test is too large, i think. Something in
> Open MPI seems to slow it down.
>
Sounds like the TOE setup is tweaked to get decent sockets performance.

So OMPI experts, what is the overhead you see on other TCP links for
OMPI BW tests vs native sockets TCP BW tests?