We manage to get 900+ Mbps on a broadcom, 570x chip. We run jumbo
frames and use a force10 switch. This is with also openmpi-1.0.2
(have not tried rebuilding netpipe with 1.1.2) Also see great
results with netpipe (mpi) on infiniband. Great work so far guys.
120: 6291459 bytes 3 times --> 930.47 Mbps in 51586.67 usec
121: 8388605 bytes 3 times --> 932.60 Mbps in 68625.17 usec
122: 8388608 bytes 3 times --> 932.65 Mbps in 68621.83 usec
123: 8388611 bytes 3 times --> 932.59 Mbps in 68625.85 usec
Center for Advanced Computing
On Oct 23, 2006, at 1:57 PM, George Bosilca wrote:
> I don't know what your bandwidth tester look like, but 140MB/s it's
> way too much for a single Gige card, except if it's a bidirectional
> bandwidth. Usually, on a new generation Gige card (Broadcom
> Corporation NetXtreme BCM5751 Gigabit Ethernet PCI Express) with a
> AMD processor (AMD Athlon(tm) 64 Processor 3500+) I only manage to
> get around 800Mb/s out of a point-to-point transfer. With an external
> card not on the OCI-express bus I barely get 600Mb/s...
> Why you don't use a real network performance tool such as Netpipe. At
> least it will insure you that the bandwidth is the one you expect.
> On Oct 23, 2006, at 4:56 AM, Jayanta Roy wrote:
>> Sometime before I have posted doubts about using dual gigabit support
>> fully. See I get ~140MB/s full duplex transfer rate in each of
>> mpirun --mca btl_tcp_if_include eth0 -n 4 -bynode -hostfile host
>> mpirun --mca btl_tcp_if_include eth1 -n 4 -bynode -hostfile host
>> How to combine these two port or use a proper routing table in
>> place host
>> file? I am using openmpi-1.1 version.
>> users mailing list
> users mailing list