Open MPI logo

Open MPI Development Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Development mailing list

Subject: Re: [OMPI devel] OpenMPI, PLPA and Linux cpuset/cgroup support
From: Chris Samuel (csamuel_at_[hidden])
Date: 2009-07-16 00:24:38


----- "Ralph Castain" <rhc_at_[hidden]> wrote:

> Looking at your command line, did you remember to set -mca
> mpi_paffinity_alone 1?

Ahh, no, sorry, still feeling my way with this..

> If not, we won't set affinity on the processes.

Now it fails immediately with:

  Setting processor affinity failed
  --> Returned "Invalid argument" (-11) instead of "Success" (0)

wrapped in a bunch of OpenMPI messages explaining that it
failed on start.

The strace looks much the same as before.

[csamuel_at_tango047 CPI]$ fgrep affinity cpi-trace.txt
10853 execve("/usr/local/openmpi/1.3.3-gcc/bin/mpiexec", ["mpiexec", "-mca", "mpi_paffinity_alone", "1", "-npernode", "4", "/home/csamuel/Sources/Tests/CPI/"...], [/* 56 vars */]) = 0
10853 sched_getaffinity(0, 128, { 3c }) = 8
10853 sched_setaffinity(0, 8, { 0 }) = -1 EFAULT (Bad address)
10854 sched_getaffinity(0, 128, <unfinished ...>
10854 <... sched_getaffinity resumed> { 3c }) = 8
10854 sched_setaffinity(0, 8, { 0 } <unfinished ...>
10854 <... sched_setaffinity resumed> ) = -1 EFAULT (Bad address)
10857 sched_getaffinity(0, 128, <unfinished ...>
10857 <... sched_getaffinity resumed> { 3c }) = 8
10857 sched_setaffinity(0, 8, { 0 } <unfinished ...>
10857 <... sched_setaffinity resumed> ) = -1 EFAULT (Bad address)
10856 sched_getaffinity(0, 128, <unfinished ...>
10856 <... sched_getaffinity resumed> { 3c }) = 8
10856 sched_setaffinity(0, 8, { 0 } <unfinished ...>
10856 <... sched_setaffinity resumed> ) = -1 EFAULT (Bad address)
10855 sched_getaffinity(0, 128, <unfinished ...>
10855 <... sched_getaffinity resumed> { 3c }) = 8
10855 sched_setaffinity(0, 8, { 0 } <unfinished ...>
10855 <... sched_setaffinity resumed> ) = -1 EFAULT (Bad address)
10857 sched_setaffinity(10857, 8, { 8 } <unfinished ...>
10857 <... sched_setaffinity resumed> ) = 0
10856 sched_setaffinity(10856, 8, { 4 } <unfinished ...>
10856 <... sched_setaffinity resumed> ) = 0
10854 sched_setaffinity(10854, 8, { 1 } <unfinished ...>
10854 <... sched_setaffinity resumed> ) = -1 EINVAL (Invalid argument)

cheers,
Chris

-- 
Christopher Samuel - (03) 9925 4751 - Systems Manager
 The Victorian Partnership for Advanced Computing
 P.O. Box 201, Carlton South, VIC 3053, Australia
VPAC is a not-for-profit Registered Research Agency