Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

Subject: Re: [OMPI users] IMB-MPI broadcast test stalls for large core counts: debug ideas?
From: Rahul Nabar (rpnabar_at_[hidden])
Date: 2010-08-24 18:26:47


On Tue, Aug 24, 2010 at 4:58 PM, Jeff Squyres <jsquyres_at_[hidden]> wrote:
> Are all the eth0's on one subnet and all the eth2's on a different subnet?
>
> Or are all eth0's and eth2's all on the same subnet?

Thanks Jeff! Different subnets. All 10GigE's are on 192.168.x.x and
all 1GigE's are on 10.0.x.x

e.g.
-----------------------------------------------------------------------------------------------------------
[root_at_eu001 ~]# ifconfig
eth0 Link encap:Ethernet HWaddr 00:07:43:06:8A:AD
          inet addr:192.168.0.1 Bcast:192.168.255.255 Mask:255.255.0.0
          inet6 addr: fe80::207:43ff:fe06:8aad/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST MTU:9000 Metric:1
          RX packets:14006831847 errors:0 dropped:0 overruns:0 frame:0
          TX packets:13992321851 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:28141492607776 (25.5 TiB) TX bytes:27292126228190 (24.8 TiB)
          Interrupt:66 Memory:dc7fe000-dc7fefff

eth1 Link encap:Ethernet HWaddr 00:26:B9:58:EB:A9
          inet addr:10.0.0.1 Bcast:10.0.255.255 Mask:255.255.0.0
          inet6 addr: fe80::226:b9ff:fe58:eba9/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:4914337 errors:0 dropped:0 overruns:0 frame:0
          TX packets:1977325 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:717996253 (684.7 MiB) TX bytes:990857609 (944.9 MiB)
          Interrupt:146 Memory:d8000000-d8012800
-----------------------------------------------------------------------------------------------------------
[root_at_eu002 ~]# ifconfig
eth0 Link encap:Ethernet HWaddr 00:26:B9:58:E6:31
          inet addr:10.0.0.2 Bcast:10.0.255.255 Mask:255.255.0.0
          inet6 addr: fe80::226:b9ff:fe58:e631/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:4006992 errors:0 dropped:0 overruns:0 frame:0
          TX packets:721867 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:719897096 (686.5 MiB) TX bytes:259700556 (247.6 MiB)
          Interrupt:66 Memory:d8000000-d8012800

eth2 Link encap:Ethernet HWaddr 00:07:43:06:8A:AA
          inet addr:192.168.0.2 Bcast:192.168.255.255 Mask:255.255.0.0
          inet6 addr: fe80::207:43ff:fe06:8aaa/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST MTU:9000 Metric:1
          RX packets:24801953915 errors:0 dropped:0 overruns:0 frame:0
          TX packets:24800442434 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:28062814732532 (25.5 TiB) TX bytes:28037415369837 (25.4 TiB)
          Interrupt:82 Memory:dc7fe000-dc7fefff
-----------------------------------------------------------------------------------------------------------