Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

From: Tim Prins (tprins_at_[hidden])
Date: 2007-09-18 16:56:00


Hi Murat,

If the process is being spawned onto a node that you are already running
on there should not be a problem with ssh-sessions, since if there is
already a daemon running on the node we do not ssh into it again.

Can you try running again with --debug-daemons added to the mpirun
command line? This may (or may not) print out some information that
would be useful.

Also, what does the spawn call look like? What is the mpirun command you
are using (and the contents of any hostfiles)?

Unfortunately, besides these stabs there is really no way to debug it
without gdb. Once I get the spawn call and command line you are using I
will see if I can replicate it.

Thanks,

Tim

Murat Knecht wrote:
> Hi all,
>
> I get a segmentation fault when trying to spawn a single process on the
> localhost (127.0.0.1).
> I tried both the current stable 1.2.3 and the beta 1.2.4, both ended up the
> same way.
>>From the stack trace, i know it's the spawn call.
> Is it possible that there is an error with authentification? (I accepted
> the localhost certificates manually by opening up ssh-sessions.)
>
>
> [loud2:15472] *** Process received signal ***
> [loud2:15472] Signal: Segmentation fault (11)
> [loud2:15472] Signal code: Address not mapped (1)
> [loud2:15472] Failing at address: 0x2b7182ea7fe0
> [loud2:15472] [ 0] /lib64/libpthread.so.0 [0x2b6983637c10]
> [loud2:15472] [ 1] /usr/local/lib/libopen-pal.so.0(_int_free+0x26d)
> [0x2b6982d75fdd]
> [loud2:15472] [ 2] /usr/local/lib/libopen-pal.so.0(free+0xbd)
> [0x2b6982d762fd]
> [loud2:15472] [ 3] /usr/local/lib/libopen-rte.so.0 [0x2b6982c33146]
> [loud2:15472] [ 4]
> /usr/local/lib/libmpi.so.0(ompi_comm_start_processes+0xe61)
> [0x2b6982a8a3a1]
> [loud2:15472] [ 5] /usr/local/lib/libmpi.so.0(PMPI_Comm_spawn+0x13a)
> [0x2b6982aaedfa]
> [loud2:15472] [ 6]
> queen(_ZNK3MPI9Intracomm5SpawnEPKcPS2_iRKNS_4InfoEi+0x5e) [0x41f64a]
> [loud2:15472] [ 7]
> queen(_ZN5blink5queen5Queen16startupLandscapeERKSsRSt4listINS0_4HostESaIS5_EE+0x9e2)
> [0x4222ae]
> [loud2:15472] [ 8] queen(main+0x936) [0x428c4c]
> [loud2:15472] [ 9] /lib64/libc.so.6(__libc_start_main+0xf4)
> [0x2b698375e154]
> [loud2:15472] [10] queen(__gxx_personality_v0+0xa9) [0x4183f9]
> [loud2:15472] *** End of error message ***
>
>
> All parameters are being checked for correctness, MPI::ARGV_NULL is used
> for argv.
> Is there a way to enable detailed logging, or are the mpirun - arguments
> all there is? (In the FAQ and /var/log/ i did not find logs.)
> Us there maybe a suggested solution to this problem, or do I have to debug
> OpenMPI with gdb now?
> Are there secret assumptions regarding the system this is running on? I had
> a version of the program running on another machine already (no changes to
> MPI related parts) ...
> Btw, I very much welcome the recent thoughts about establishing a
> documentation project. :)
>
> Thanks for any hint!
> Best regards
> Murat
>
>
>
>
>
>
>
> mkne_at_loud2:~/rep/DWA/queen> ompi_info -a
> Open MPI: 1.2.4b0
> Open MPI SVN revision: r15441
> Open RTE: 1.2.4b0
> Open RTE SVN revision: r15441
> OPAL: 1.2.4b0
> OPAL SVN revision: r15441
> MCA backtrace: execinfo (MCA v1.0, API v1.0, Component v1.2.4)
> MCA memory: ptmalloc2 (MCA v1.0, API v1.0, Component v1.2.4)
> MCA paffinity: linux (MCA v1.0, API v1.0, Component v1.2.4)
> MCA maffinity: first_use (MCA v1.0, API v1.0, Component v1.2.4)
> MCA maffinity: libnuma (MCA v1.0, API v1.0, Component v1.2.4)
> MCA timer: linux (MCA v1.0, API v1.0, Component v1.2.4)
> MCA installdirs: env (MCA v1.0, API v1.0, Component v1.2.4)
> MCA installdirs: config (MCA v1.0, API v1.0, Component v1.2.4)
> MCA allocator: basic (MCA v1.0, API v1.0, Component v1.0)
> MCA allocator: bucket (MCA v1.0, API v1.0, Component v1.0)
> MCA coll: basic (MCA v1.0, API v1.0, Component v1.2.4)
> MCA coll: self (MCA v1.0, API v1.0, Component v1.2.4)
> MCA coll: sm (MCA v1.0, API v1.0, Component v1.2.4)
> MCA coll: tuned (MCA v1.0, API v1.0, Component v1.2.4)
> MCA io: romio (MCA v1.0, API v1.0, Component v1.2.4)
> MCA mpool: rdma (MCA v1.0, API v1.0, Component v1.2.4)
> MCA mpool: sm (MCA v1.0, API v1.0, Component v1.2.4)
> MCA pml: cm (MCA v1.0, API v1.0, Component v1.2.4)
> MCA pml: ob1 (MCA v1.0, API v1.0, Component v1.2.4)
> MCA bml: r2 (MCA v1.0, API v1.0, Component v1.2.4)
> MCA rcache: vma (MCA v1.0, API v1.0, Component v1.2.4)
> MCA btl: self (MCA v1.0, API v1.0.1, Component v1.2.4)
> MCA btl: sm (MCA v1.0, API v1.0.1, Component v1.2.4)
> MCA btl: tcp (MCA v1.0, API v1.0.1, Component v1.0)
> MCA topo: unity (MCA v1.0, API v1.0, Component v1.2.4)
> MCA osc: pt2pt (MCA v1.0, API v1.0, Component v1.2.4)
> MCA errmgr: hnp (MCA v1.0, API v1.3, Component v1.2.4)
> MCA errmgr: orted (MCA v1.0, API v1.3, Component v1.2.4)
> MCA errmgr: proxy (MCA v1.0, API v1.3, Component v1.2.4)
> MCA gpr: null (MCA v1.0, API v1.0, Component v1.2.4)
> MCA gpr: proxy (MCA v1.0, API v1.0, Component v1.2.4)
> MCA gpr: replica (MCA v1.0, API v1.0, Component v1.2.4)
> MCA iof: proxy (MCA v1.0, API v1.0, Component v1.2.4)
> MCA iof: svc (MCA v1.0, API v1.0, Component v1.2.4)
> MCA ns: proxy (MCA v1.0, API v2.0, Component v1.2.4)
> MCA ns: replica (MCA v1.0, API v2.0, Component v1.2.4)
> MCA oob: tcp (MCA v1.0, API v1.0, Component v1.0)
> MCA ras: dash_host (MCA v1.0, API v1.3, Component v1.2.4)
> MCA ras: gridengine (MCA v1.0, API v1.3, Component v1.2.4)
> MCA ras: localhost (MCA v1.0, API v1.3, Component v1.2.4)
> MCA ras: slurm (MCA v1.0, API v1.3, Component v1.2.4)
> MCA rds: hostfile (MCA v1.0, API v1.3, Component v1.2.4)
> MCA rds: proxy (MCA v1.0, API v1.3, Component v1.2.4)
> MCA rds: resfile (MCA v1.0, API v1.3, Component v1.2.4)
> MCA rmaps: round_robin (MCA v1.0, API v1.3, Component
> v1.2.4)
> MCA rmgr: proxy (MCA v1.0, API v2.0, Component v1.2.4)
> MCA rmgr: urm (MCA v1.0, API v2.0, Component v1.2.4)
> MCA rml: oob (MCA v1.0, API v1.0, Component v1.2.4)
> MCA pls: gridengine (MCA v1.0, API v1.3, Component v1.2.4)
> MCA pls: proxy (MCA v1.0, API v1.3, Component v1.2.4)
> MCA pls: rsh (MCA v1.0, API v1.3, Component v1.2.4)
> MCA pls: slurm (MCA v1.0, API v1.3, Component v1.2.4)
> MCA sds: env (MCA v1.0, API v1.0, Component v1.2.4)
> MCA sds: pipe (MCA v1.0, API v1.0, Component v1.2.4)
> MCA sds: seed (MCA v1.0, API v1.0, Component v1.2.4)
> MCA sds: singleton (MCA v1.0, API v1.0, Component v1.2.4)
> MCA sds: slurm (MCA v1.0, API v1.0, Component v1.2.4)
> Prefix: /usr/local
> Bindir: /usr/local/bin
> Libdir: /usr/local/lib
> Incdir: /usr/local/include
> Pkglibdir: /usr/local/lib/openmpi
> Sysconfdir: /usr/local/etc
> Configured architecture: x86_64-unknown-linux-gnu
> Configured by: root
> Configured on: Fri Sep 14 13:19:22 PDT 2007
> Configure host: loud2
> Built by: mkne
> Built on: Fri Sep 14 13:24:21 PDT 2007
> Built host: loud2
> C bindings: yes
> C++ bindings: yes
> Fortran77 bindings: no
> Fortran90 bindings: no
> Fortran90 bindings size: na
> C compiler: gcc
> C compiler absolute: /usr/bin/gcc
> C char size: 1
> C bool size: 1
> C short size: 2
> C int size: 4
> C long size: 8
> C float size: 4
> C double size: 8
> C pointer size: 8
> C char align: 1
> C bool align: 1
> C int align: 4
> C float align: 4
> C double align: 8
> C++ compiler: g++
> C++ compiler absolute: /usr/bin/g++
> Fortran77 compiler: gfortran
> Fortran77 compiler abs: /usr/bin/gfortran
> Fortran90 compiler: none
> Fortran90 compiler abs: none
> Fort integer size: 4
> Fort logical size: 4
> Fort logical value true: 0
> Fort real size: skipped
> Fort dbl prec size: skipped
> Fort cplx size: skipped
> Fort dbl cplx size: skipped
> Fort integer align: skipped
> Fort real align: skipped
> Fort dbl prec align: skipped
> Fort cplx align: skipped
> Fort dbl cplx align: skipped
> C profiling: yes
> C++ profiling: yes
> Fortran77 profiling: no
> Fortran90 profiling: no
> C++ exceptions: yes
> Thread support: posix (mpi: no, progress: no)
> Build CFLAGS: -O3 -DNDEBUG -finline-functions
> -fno-strict-aliasing -pthread
> Build CXXFLAGS: -O3 -DNDEBUG -finline-functions -fexceptions
> -pthread
> Build FFLAGS:
> Build FCFLAGS: -g -O2
> Build LDFLAGS: -export-dynamic -fexceptions
> Build LIBS: -lnsl -lutil -lm
> Wrapper extra CFLAGS: -pthread
> Wrapper extra CXXFLAGS: -fexceptions -pthread
> Wrapper extra FFLAGS:
> Wrapper extra FCFLAGS:
> Wrapper extra LDFLAGS:
> Wrapper extra LIBS: -ldl -Wl,--export-dynamic -lnsl -lutil -lm
> -ldl
> Internal debug support: no
> MPI parameter check: runtime
> Memory profiling support: no
> Memory debugging support: no
> libltdl support: yes
> Heterogeneous support: yes
> mpirun default --prefix: no
> MCA mca: parameter "mca_param_files" (current value:
> "/home/mkne/.openmpi/mca-params.conf:/usr/local/etc/openmpi-mca-params.conf")
> Path for MCA configuration files containing
> default parameter values
> MCA mca: parameter "mca_component_path" (current value:
> "/usr/local/lib/openmpi:/home/mkne/.openmpi/components")
> Path where to look for Open MPI and ORTE
> components
> MCA mca: parameter "mca_verbose" (current value: <none>)
> Top-level verbosity parameter
> MCA mca: parameter "mca_component_show_load_errors"
> (current value: "1")
> Whether to show errors for components that failed
> to load or not
> MCA mca: parameter "mca_component_disable_dlopen" (current
> value: "0")
> Whether to attempt to disable opening dynamic
> components or not
> MCA mpi: parameter "mpi_param_check" (current value: "1")
> Whether you want MPI API parameters checked at
> run-time or not. Possible values are 0 (no checking) and 1 (perform
> checking at
> run-time)
> MCA mpi: parameter "mpi_yield_when_idle" (current value:
> "0")
> Yield the processor when waiting for MPI
> communication (for MPI processes, will default to 1 when oversubscribing
> nodes)
> MCA mpi: parameter "mpi_event_tick_rate" (current value:
> "-1")
> How often to progress TCP communications (0 =
> never, otherwise specified in microseconds)
> MCA mpi: parameter "mpi_show_handle_leaks" (current value:
> "0")
> Whether MPI_FINALIZE shows all MPI handles that
> were not freed or not
> MCA mpi: parameter "mpi_no_free_handles" (current value:
> "0")
> Whether to actually free MPI objects when their
> handles are freed
> MCA mpi: parameter "mpi_show_mca_params" (current value:
> "0")
> Whether to show all MCA parameter value during
> MPI_INIT or not (good for reproducability of MPI jobs)
> MCA mpi: parameter "mpi_show_mca_params_file" (current
> value: <none>)
> If mpi_show_mca_params is true, setting this
> string to a valid filename tells Open MPI to dump all the MCA parameter
> values into a
> file suitable for reading via the mca_param_files
> parameter (good for reproducability of MPI jobs)
> MCA mpi: parameter "mpi_paffinity_alone" (current value:
> "0")
> If nonzero, assume that this job is the only (set
> of) process(es) running on each node and bind processes to processors,
> starting
> with processor ID 0
> MCA mpi: parameter "mpi_keep_peer_hostnames" (current
> value: "1")
> If nonzero, save the string hostnames of all MPI
> peer processes (mostly for error / debugging output messages). This can
> add quite
> a bit of memory usage to each MPI process.
> MCA mpi: parameter "mpi_abort_delay" (current value: "0")
> If nonzero, print out an identifying message when
> MPI_ABORT is invoked (hostname, PID of the process that called MPI_ABORT)
> and
> delay for that many seconds before exiting (a
> negative delay value means to never abort). This allows attaching of a
> debugger
> before quitting the job.
> MCA mpi: parameter "mpi_abort_print_stack" (current value:
> "0")
> If nonzero, print out a stack trace when
> MPI_ABORT is invoked
> MCA mpi: parameter "mpi_preconnect_all" (current value:
> "0")
> Whether to force MPI processes to create
> connections / warmup with *all* peers during MPI_INIT (vs. making
> connections lazily --
> upon the first MPI traffic between each process
> peer pair)
> MCA mpi: parameter "mpi_preconnect_oob" (current value:
> "0")
> Whether to force MPI processes to fully wire-up
> the OOB system between MPI processes.
> MCA mpi: parameter "mpi_leave_pinned" (current value: "0")
> Whether to use the "leave pinned" protocol or
> not. Enabling this setting can help bandwidth performance when repeatedly
> sending
> and receiving large messages with the same
> buffers over RDMA-based networks.
> MCA mpi: parameter "mpi_leave_pinned_pipeline" (current
> value: "0")
> Whether to use the "leave pinned pipeline"
> protocol or not.
> MCA orte: parameter "orte_debug" (current value: "0")
> Top-level ORTE debug switch
> MCA orte: parameter "orte_no_daemonize" (current value:
> "0")
> Whether to properly daemonize the ORTE daemons or
> not
> MCA orte: parameter "orte_base_user_debugger" (current
> value: "totalview @mpirun@ -a @mpirun_args@ : fxp @mpirun@ -a
> @mpirun_args@")
> Sequence of user-level debuggers to search for in
> orterun
> MCA orte: parameter "orte_abort_timeout" (current value:
> "10")
> Time to wait [in seconds] before giving up on
> aborting an ORTE operation
> MCA orte: parameter "orte_timing" (current value: "0")
> Request that critical timing loops be measured
> MCA opal: parameter "opal_signal" (current value:
> "6,7,8,11")
> If a signal is received, display the stack trace
> frame
> MCA backtrace: parameter "backtrace" (current value: <none>)
> Default selection set of components for the
> backtrace framework (<none> means "use all components that can be found")
> MCA backtrace: parameter "backtrace_base_verbose" (current
> value: "0")
> Verbosity level for the backtrace framework (0 =
> no verbosity)
> MCA backtrace: parameter "backtrace_execinfo_priority" (current
> value: "0")
> MCA memory: parameter "memory" (current value: <none>)
> Default selection set of components for the
> memory framework (<none> means "use all components that can be found")
> MCA memory: parameter "memory_base_verbose" (current value:
> "0")
> Verbosity level for the memory framework (0 = no
> verbosity)
> MCA memory: parameter "memory_ptmalloc2_priority" (current
> value: "0")
> MCA paffinity: parameter "paffinity" (current value: <none>)
> Default selection set of components for the
> paffinity framework (<none> means "use all components that can be found")
> MCA paffinity: parameter "paffinity_linux_priority" (current
> value: "10")
> Priority of the linux paffinity component
> MCA paffinity: information "paffinity_linux_have_cpu_set_t"
> (value: "1")
> Whether this component was compiled on a system
> with the type cpu_set_t or not (1 = yes, 0 = no)
> MCA paffinity: information "paffinity_linux_CPU_ZERO_ok" (value:
> "1")
> Whether this component was compiled on a system
> where CPU_ZERO() is functional or broken (1 = functional, 0 = broken/not
> available)
> MCA paffinity: information
> "paffinity_linux_sched_setaffinity_num_params" (value: "3")
> The number of parameters that
> sched_set_affinity() takes on the machine where this component was compiled
> MCA maffinity: parameter "maffinity" (current value: <none>)
> Default selection set of components for the
> maffinity framework (<none> means "use all components that can be found")
> MCA maffinity: parameter "maffinity_first_use_priority" (current
> value: "10")
> Priority of the first_use maffinity component
> MCA maffinity: parameter "maffinity_libnuma_priority" (current
> value: "25")
> Priority of the libnuma maffinity component
> MCA timer: parameter "timer" (current value: <none>)
> Default selection set of components for the timer
> framework (<none> means "use all components that can be found")
> MCA timer: parameter "timer_base_verbose" (current value:
> "0")
> Verbosity level for the timer framework (0 = no
> verbosity)
> MCA timer: parameter "timer_linux_priority" (current value:
> "0")
> MCA allocator: parameter "allocator" (current value: <none>)
> Default selection set of components for the
> allocator framework (<none> means "use all components that can be found")
> MCA allocator: parameter "allocator_base_verbose" (current
> value: "0")
> Verbosity level for the allocator framework (0 =
> no verbosity)
> MCA allocator: parameter "allocator_basic_priority" (current
> value: "0")
> MCA allocator: parameter "allocator_bucket_num_buckets" (current
> value: "30")
> MCA allocator: parameter "allocator_bucket_priority" (current
> value: "0")
> MCA coll: parameter "coll" (current value: <none>)
> Default selection set of components for the coll
> framework (<none> means "use all components that can be found")
> MCA coll: parameter "coll_base_verbose" (current value:
> "0")
> Verbosity level for the coll framework (0 = no
> verbosity)
> MCA coll: parameter "coll_basic_priority" (current value:
> "10")
> Priority of the basic coll component
> MCA coll: parameter "coll_basic_crossover" (current value:
> "4")
> Minimum number of processes in a communicator
> before using the logarithmic algorithms
> MCA coll: parameter "coll_self_priority" (current value:
> "75")
> MCA coll: parameter "coll_sm_priority" (current value: "0")
> Priority of the sm coll component
> MCA coll: parameter "coll_sm_control_size" (current value:
> "4096")
> Length of the control data -- should usually be
> either the length of a cache line on most SMPs, or the size of a page on
> machines
> that support direct memory affinity page
> placement (in bytes)
> MCA coll: parameter "coll_sm_bootstrap_filename" (current
> value: "shared_mem_sm_bootstrap")
> Filename (in the Open MPI session directory) of
> the coll sm component bootstrap rendezvous mmap file
> MCA coll: parameter "coll_sm_bootstrap_num_segments"
> (current value: "8")
> Number of segments in the bootstrap file
> MCA coll: parameter "coll_sm_fragment_size" (current value:
> "8192")
> Fragment size (in bytes) used for passing data
> through shared memory (will be rounded up to the nearest control_size size)
> MCA coll: parameter "coll_sm_mpool" (current value: "sm")
> Name of the mpool component to use
> MCA coll: parameter "coll_sm_comm_in_use_flags" (current
> value: "2")
> Number of "in use" flags, used to mark a message
> passing area segment as currently being used or not (must be >= 2 and <=
> comm_num_segments)
> MCA coll: parameter "coll_sm_comm_num_segments" (current
> value: "8")
> Number of segments in each communicator's shared
> memory message passing area (must be >= 2, and must be a multiple of
> comm_in_use_flags)
> MCA coll: parameter "coll_sm_tree_degree" (current value:
> "4")
> Degree of the tree for tree-based operations
> (must be => 1 and <= min(control_size, 255))
> MCA coll: information "coll_sm_shared_mem_used_bootstrap"
> (value: "216")
> Amount of shared memory used in the shared memory
> bootstrap area (in bytes)
> MCA coll: parameter "coll_sm_info_num_procs" (current
> value: "4")
> Number of processes to use for the calculation of
> the shared_mem_size MCA information parameter (must be => 2)
> MCA coll: information "coll_sm_shared_mem_used_data"
> (value: "548864")
> Amount of shared memory used in the shared memory
> data area for info_num_procs processes (in bytes)
> MCA coll: parameter "coll_tuned_priority" (current value:
> "30")
> Priority of the tuned coll component
> MCA coll: parameter
> "coll_tuned_pre_allocate_memory_comm_size_limit" (current value: "32768")
> Size of communicator were we stop pre-allocating
> memory for the fixed internal buffer used for message requests etc that is
> hung
> off the communicator data segment. I.e. if you
> have a 100'000 nodes you might not want to pre-allocate 200'000 request
> handle slots
> per communicator instance!
> MCA coll: parameter "coll_tuned_init_tree_fanout" (current
> value: "4")
> Inital fanout used in the tree topologies for
> each communicator. This is only an initial guess, if a tuned collective
> needs a
> different fanout for an operation, it build it
> dynamically. This parameter is only for the first guess and might save a
> little
> time
> MCA coll: parameter "coll_tuned_init_chain_fanout" (current
> value: "4")
> Inital fanout used in the chain (fanout followed
> by pipeline) topologies for each communicator. This is only an initial
> guess, if a
> tuned collective needs a different fanout for an
> operation, it build it dynamically. This parameter is only for the first
> guess and
> might save a little time
> MCA coll: parameter "coll_tuned_use_dynamic_rules" (current
> value: "0")
> Switch used to decide if we use static
> (compiled/if statements) or dynamic (built at runtime) decision function
> rules
> MCA io: parameter "io_base_freelist_initial_size"
> (current value: "16")
> Initial MPI-2 IO request freelist size
> MCA io: parameter "io_base_freelist_max_size" (current
> value: "64")
> Max size of the MPI-2 IO request freelist
> MCA io: parameter "io_base_freelist_increment" (current
> value: "16")
> Increment size of the MPI-2 IO request freelist
> MCA io: parameter "io" (current value: <none>)
> Default selection set of components for the io
> framework (<none> means "use all components that can be found")
> MCA io: parameter "io_base_verbose" (current value: "0")
> Verbosity level for the io framework (0 = no
> verbosity)
> MCA io: parameter "io_romio_priority" (current value:
> "10")
> Priority of the io romio component
> MCA io: parameter "io_romio_delete_priority" (current
> value: "10")
> Delete priority of the io romio component
> MCA io: parameter
> "io_romio_enable_parallel_optimizations" (current value: "0")
> Enable set of Open MPI-added options to improve
> collective file i/o performance
> MCA mpool: parameter "mpool" (current value: <none>)
> Default selection set of components for the mpool
> framework (<none> means "use all components that can be found")
> MCA mpool: parameter "mpool_base_verbose" (current value:
> "0")
> Verbosity level for the mpool framework (0 = no
> verbosity)
> MCA mpool: parameter "mpool_rdma_rcache_name" (current
> value: "vma")
> The name of the registration cache the mpool
> should use
> MCA mpool: parameter "mpool_rdma_rcache_size_limit" (current
> value: "0")
> the maximum size of registration cache in bytes.
> 0 is unlimited (default 0)
> MCA mpool: parameter "mpool_rdma_print_stats" (current
> value: "0")
> print pool usage statistics at the end of the run
> MCA mpool: parameter "mpool_rdma_priority" (current value:
> "0")
> MCA mpool: parameter "mpool_sm_allocator" (current value:
> "bucket")
> Name of allocator component to use with sm mpool
> MCA mpool: parameter "mpool_sm_max_size" (current value:
> "536870912")
> Maximum size of the sm mpool shared memory file
> MCA mpool: parameter "mpool_sm_min_size" (current value:
> "134217728")
> Minimum size of the sm mpool shared memory file
> MCA mpool: parameter "mpool_sm_per_peer_size" (current
> value: "33554432")
> Size (in bytes) to allocate per local peer in the
> sm mpool shared memory file, bounded by min_size and max_size
> MCA mpool: parameter "mpool_sm_priority" (current value:
> "0")
> MCA mpool: parameter "mpool_base_use_mem_hooks" (current
> value: "0")
> use memory hooks for deregistering freed memory
> MCA mpool: parameter "mpool_use_mem_hooks" (current value:
> "0")
> (deprecated, use mpool_base_use_mem_hooks)
> MCA mpool: parameter "mpool_base_disable_sbrk" (current
> value: "0")
> use mallopt to override calling sbrk (doesn't
> return memory to OS!)
> MCA mpool: parameter "mpool_disable_sbrk" (current value:
> "0")
> (deprecated, use mca_mpool_base_disable_sbrk)
> MCA pml: parameter "pml" (current value: <none>)
> Default selection set of components for the pml
> framework (<none> means "use all components that can be found")
> MCA pml: parameter "pml_base_verbose" (current value: "0")
> Verbosity level for the pml framework (0 = no
> verbosity)
> MCA pml: parameter "pml_cm_free_list_num" (current value:
> "4")
> Initial size of request free lists
> MCA pml: parameter "pml_cm_free_list_max" (current value:
> "-1")
> Maximum size of request free lists
> MCA pml: parameter "pml_cm_free_list_inc" (current value:
> "64")
> Number of elements to add when growing request
> free lists
> MCA pml: parameter "pml_cm_priority" (current value: "30")
> CM PML selection priority
> MCA pml: parameter "pml_ob1_free_list_num" (current value:
> "4")
> MCA pml: parameter "pml_ob1_free_list_max" (current value:
> "-1")
> MCA pml: parameter "pml_ob1_free_list_inc" (current value:
> "64")
> MCA pml: parameter "pml_ob1_priority" (current value:
> "20")
> MCA pml: parameter "pml_ob1_eager_limit" (current value:
> "131072")
> MCA pml: parameter "pml_ob1_send_pipeline_depth" (current
> value: "3")
> MCA pml: parameter "pml_ob1_recv_pipeline_depth" (current
> value: "4")
> MCA bml: parameter "bml" (current value: <none>)
> Default selection set of components for the bml
> framework (<none> means "use all components that can be found")
> MCA bml: parameter "bml_base_verbose" (current value: "0")
> Verbosity level for the bml framework (0 = no
> verbosity)
> MCA bml: parameter "bml_r2_show_unreach_errors" (current
> value: "1")
> Show error message when procs are unreachable
> MCA bml: parameter "bml_r2_priority" (current value: "0")
> MCA rcache: parameter "rcache" (current value: <none>)
> Default selection set of components for the
> rcache framework (<none> means "use all components that can be found")
> MCA rcache: parameter "rcache_base_verbose" (current value:
> "0")
> Verbosity level for the rcache framework (0 = no
> verbosity)
> MCA rcache: parameter "rcache_vma_priority" (current value:
> "0")
> MCA btl: parameter "btl_base_debug" (current value: "0")
> If btl_base_debug is 1 standard debug is output,
> if > 1 verbose debug is output
> MCA btl: parameter "btl" (current value: <none>)
> Default selection set of components for the btl
> framework (<none> means "use all components that can be found")
> MCA btl: parameter "btl_base_verbose" (current value: "0")
> Verbosity level for the btl framework (0 = no
> verbosity)
> MCA btl: parameter "btl_self_free_list_num" (current
> value: "0")
> Number of fragments by default
> MCA btl: parameter "btl_self_free_list_max" (current
> value: "-1")
> Maximum number of fragments
> MCA btl: parameter "btl_self_free_list_inc" (current
> value: "32")
> Increment by this number of fragments
> MCA btl: parameter "btl_self_eager_limit" (current value:
> "131072")
> Eager size fragmeng (before the rendez-vous
> ptotocol)
> MCA btl: parameter "btl_self_min_send_size" (current
> value: "262144")
> Minimum fragment size after the rendez-vous
> MCA btl: parameter "btl_self_max_send_size" (current
> value: "262144")
> Maximum fragment size after the rendez-vous
> MCA btl: parameter "btl_self_min_rdma_size" (current
> value: "2147483647")
> Maximum fragment size for the RDMA transfer
> MCA btl: parameter "btl_self_max_rdma_size" (current
> value: "2147483647")
> Maximum fragment size for the RDMA transfer
> MCA btl: parameter "btl_self_exclusivity" (current value:
> "65536")
> Device exclusivity
> MCA btl: parameter "btl_self_flags" (current value: "10")
> Active behavior flags
> MCA btl: parameter "btl_self_priority" (current value:
> "0")
> MCA btl: parameter "btl_sm_free_list_num" (current value:
> "8")
> MCA btl: parameter "btl_sm_free_list_max" (current value:
> "-1")
> MCA btl: parameter "btl_sm_free_list_inc" (current value:
> "64")
> MCA btl: parameter "btl_sm_exclusivity" (current value:
> "65535")
> MCA btl: parameter "btl_sm_latency" (current value: "100")
> MCA btl: parameter "btl_sm_max_procs" (current value:
> "-1")
> MCA btl: parameter "btl_sm_sm_extra_procs" (current value:
> "2")
> MCA btl: parameter "btl_sm_mpool" (current value: "sm")
> MCA btl: parameter "btl_sm_eager_limit" (current value:
> "4096")
> MCA btl: parameter "btl_sm_max_frag_size" (current value:
> "32768")
> MCA btl: parameter "btl_sm_size_of_cb_queue" (current
> value: "128")
> MCA btl: parameter "btl_sm_cb_lazy_free_freq" (current
> value: "120")
> MCA btl: parameter "btl_sm_priority" (current value: "0")
> MCA btl: parameter "btl_tcp_if_include" (current value:
> <none>)
> MCA btl: parameter "btl_tcp_if_exclude" (current value:
> "lo")
> MCA btl: parameter "btl_tcp_free_list_num" (current value:
> "8")
> MCA btl: parameter "btl_tcp_free_list_max" (current value:
> "-1")
> MCA btl: parameter "btl_tcp_free_list_inc" (current value:
> "32")
> MCA btl: parameter "btl_tcp_sndbuf" (current value:
> "131072")
> MCA btl: parameter "btl_tcp_rcvbuf" (current value:
> "131072")
> MCA btl: parameter "btl_tcp_endpoint_cache" (current
> value: "30720")
> MCA btl: parameter "btl_tcp_exclusivity" (current value:
> "0")
> MCA btl: parameter "btl_tcp_eager_limit" (current value:
> "65536")
> MCA btl: parameter "btl_tcp_min_send_size" (current value:
> "65536")
> MCA btl: parameter "btl_tcp_max_send_size" (current value:
> "131072")
> MCA btl: parameter "btl_tcp_min_rdma_size" (current value:
> "131072")
> MCA btl: parameter "btl_tcp_max_rdma_size" (current value:
> "2147483647")
> MCA btl: parameter "btl_tcp_flags" (current value: "122")
> MCA btl: parameter "btl_tcp_priority" (current value: "0")
> MCA btl: parameter "btl_base_include" (current value:
> <none>)
> MCA btl: parameter "btl_base_exclude" (current value:
> <none>)
> MCA btl: parameter "btl_base_warn_component_unused"
> (current value: "1")
> This parameter is used to turn on warning
> messages when certain NICs are not used
> MCA mtl: parameter "mtl" (current value: <none>)
> Default selection set of components for the mtl
> framework (<none> means "use all components that can be found")
> MCA mtl: parameter "mtl_base_verbose" (current value: "0")
> Verbosity level for the mtl framework (0 = no
> verbosity)
> MCA topo: parameter "topo" (current value: <none>)
> Default selection set of components for the topo
> framework (<none> means "use all components that can be found")
> MCA topo: parameter "topo_base_verbose" (current value:
> "0")
> Verbosity level for the topo framework (0 = no
> verbosity)
> MCA osc: parameter "osc" (current value: <none>)
> Default selection set of components for the osc
> framework (<none> means "use all components that can be found")
> MCA osc: parameter "osc_base_verbose" (current value: "0")
> Verbosity level for the osc framework (0 = no
> verbosity)
> MCA osc: parameter "osc_pt2pt_no_locks" (current value:
> "0")
> Enable optimizations available only if MPI_LOCK
> is not used.
> MCA osc: parameter "osc_pt2pt_eager_limit" (current value:
> "16384")
> Max size of eagerly sent data
> MCA osc: parameter "osc_pt2pt_priority" (current value:
> "0")
> MCA errmgr: parameter "errmgr" (current value: <none>)
> Default selection set of components for the
> errmgr framework (<none> means "use all components that can be found")
> MCA errmgr: parameter "errmgr_hnp_debug" (current value: "0")
> MCA errmgr: parameter "errmgr_hnp_priority" (current value:
> "0")
> MCA errmgr: parameter "errmgr_orted_debug" (current value:
> "0")
> MCA errmgr: parameter "errmgr_orted_priority" (current value:
> "0")
> MCA errmgr: parameter "errmgr_proxy_debug" (current value:
> "0")
> MCA errmgr: parameter "errmgr_proxy_priority" (current value:
> "0")
> MCA gpr: parameter "gpr_base_maxsize" (current value:
> "2147483647")
> MCA gpr: parameter "gpr_base_blocksize" (current value:
> "512")
> MCA gpr: parameter "gpr" (current value: <none>)
> Default selection set of components for the gpr
> framework (<none> means "use all components that can be found")
> MCA gpr: parameter "gpr_null_priority" (current value:
> "0")
> MCA gpr: parameter "gpr_proxy_debug" (current value: "0")
> MCA gpr: parameter "gpr_proxy_priority" (current value:
> "0")
> MCA gpr: parameter "gpr_replica_debug" (current value:
> "0")
> MCA gpr: parameter "gpr_replica_isolate" (current value:
> "0")
> MCA gpr: parameter "gpr_replica_priority" (current value:
> "0")
> MCA iof: parameter "iof_base_window_size" (current value:
> "4096")
> MCA iof: parameter "iof_base_service" (current value:
> "0.0.0")
> MCA iof: parameter "iof" (current value: <none>)
> Default selection set of components for the iof
> framework (<none> means "use all components that can be found")
> MCA iof: parameter "iof_proxy_debug" (current value: "1")
> MCA iof: parameter "iof_proxy_priority" (current value:
> "0")
> MCA iof: parameter "iof_svc_debug" (current value: "1")
> MCA iof: parameter "iof_svc_priority" (current value: "0")
> MCA ns: parameter "ns" (current value: <none>)
> Default selection set of components for the ns
> framework (<none> means "use all components that can be found")
> MCA ns: parameter "ns_proxy_debug" (current value: "0")
> MCA ns: parameter "ns_proxy_maxsize" (current value:
> "2147483647")
> MCA ns: parameter "ns_proxy_blocksize" (current value:
> "512")
> MCA ns: parameter "ns_proxy_priority" (current value:
> "0")
> MCA ns: parameter "ns_replica_debug" (current value: "0")
> MCA ns: parameter "ns_replica_isolate" (current value:
> "0")
> MCA ns: parameter "ns_replica_maxsize" (current value:
> "2147483647")
> MCA ns: parameter "ns_replica_blocksize" (current value:
> "512")
> MCA ns: parameter "ns_replica_priority" (current value:
> "0")
> MCA oob: parameter "oob" (current value: <none>)
> Default selection set of components for the oob
> framework (<none> means "use all components that can be found")
> MCA oob: parameter "oob_base_verbose" (current value: "0")
> Verbosity level for the oob framework (0 = no
> verbosity)
> MCA oob: parameter "oob_tcp_peer_limit" (current value:
> "-1")
> MCA oob: parameter "oob_tcp_peer_retries" (current value:
> "60")
> MCA oob: parameter "oob_tcp_debug" (current value: "0")
> MCA oob: parameter "oob_tcp_sndbuf" (current value:
> "131072")
> MCA oob: parameter "oob_tcp_rcvbuf" (current value:
> "131072")
> MCA oob: parameter "oob_tcp_if_include" (current value:
> <none>)
> Comma-delimited list of TCP interfaces to use
> MCA oob: parameter "oob_tcp_if_exclude" (current value:
> <none>)
> Comma-delimited list of TCP interfaces to exclude
> MCA oob: parameter "oob_tcp_connect_sleep" (current value:
> "1")
> Enable (1) / disable (0) random sleep for
> connection wireup
> MCA oob: parameter "oob_tcp_listen_mode" (current value:
> "event")
> Mode for HNP to accept incoming connections:
> event, listen_thread
> MCA oob: parameter "oob_tcp_listen_thread_max_queue"
> (current value: "10")
> High water mark for queued accepted socket list
> size
> MCA oob: parameter "oob_tcp_listen_thread_max_time"
> (current value: "10")
> Maximum amount of time (in milliseconds) to wait
> between processing accepted socket list
> MCA oob: parameter "oob_tcp_accept_spin_count" (current
> value: "10")
> Number of times to let accept return EWOULDBLOCK
> before updating accepted socket list
> MCA oob: parameter "oob_tcp_priority" (current value: "0")
> MCA ras: parameter "ras" (current value: <none>)
> MCA ras: parameter "ras_dash_host_priority" (current
> value: "5")
> Selection priority for the dash_host RAS
> component
> MCA ras: parameter "ras_gridengine_debug" (current value:
> "0")
> Enable debugging output for the gridengine ras
> component
> MCA ras: parameter "ras_gridengine_priority" (current
> value: "100")
> Priority of the gridengine ras component
> MCA ras: parameter "ras_gridengine_verbose" (current
> value: "0")
> Enable verbose output for the gridengine ras
> component
> MCA ras: parameter "ras_gridengine_show_jobid" (current
> value: "0")
> Show the JOB_ID of the Grid Engine job
> MCA ras: parameter "ras_localhost_priority" (current
> value: "0")
> Selection priority for the localhost RAS
> component
> MCA ras: parameter "ras_slurm_priority" (current value:
> "75")
> Priority of the slurm ras component
> MCA rds: parameter "rds" (current value: <none>)
> MCA rds: parameter "rds_hostfile_debug" (current value:
> "0")
> Toggle debug output for hostfile RDS component
> MCA rds: parameter "rds_hostfile_path" (current value:
> "/usr/local/etc/openmpi-default-hostfile")
> ORTE Host filename
> MCA rds: parameter "rds_hostfile_priority" (current value:
> "0")
> MCA rds: parameter "rds_proxy_priority" (current value:
> "0")
> MCA rds: parameter "rds_resfile_debug" (current value:
> "0")
> Toggle debug output for resfile RDS component
> MCA rds: parameter "rds_resfile_name" (current value:
> <none>)
> ORTE Resource filename
> MCA rds: parameter "rds_resfile_priority" (current value:
> "0")
> MCA rmaps: parameter "rmaps_base_verbose" (current value:
> "0")
> Verbosity level for the rmaps framework
> MCA rmaps: parameter "rmaps_base_schedule_policy" (current
> value: "unspec")
> Scheduling Policy for RMAPS. [slot | node]
> MCA rmaps: parameter "rmaps_base_pernode" (current value:
> "0")
> Launch one ppn as directed
> MCA rmaps: parameter "rmaps_base_n_pernode" (current value:
> "-1")
> Launch n procs/node
> MCA rmaps: parameter "rmaps_base_no_schedule_local" (current
> value: "0")
> If false, allow scheduling MPI applications on
> the same node as mpirun (default). If true, do not schedule any MPI
> applications on
> the same node as mpirun
> MCA rmaps: parameter "rmaps_base_no_oversubscribe" (current
> value: "0")
> If true, then do not allow oversubscription of
> nodes - mpirun will return an error if there aren't enough nodes to launch
> all
> processes without oversubscribing
> MCA rmaps: parameter "rmaps" (current value: <none>)
> Default selection set of components for the rmaps
> framework (<none> means "use all components that can be found")
> MCA rmaps: parameter "rmaps_round_robin_debug" (current
> value: "1")
> Toggle debug output for Round Robin RMAPS
> component
> MCA rmaps: parameter "rmaps_round_robin_priority" (current
> value: "1")
> Selection priority for Round Robin RMAPS
> component
> MCA rmgr: parameter "rmgr" (current value: <none>)
> Default selection set of components for the rmgr
> framework (<none> means "use all components that can be found")
> MCA rmgr: parameter "rmgr_proxy_priority" (current value:
> "0")
> MCA rmgr: parameter "rmgr_urm_priority" (current value:
> "0")
> MCA rml: parameter "rml" (current value: <none>)
> Default selection set of components for the rml
> framework (<none> means "use all components that can be found")
> MCA rml: parameter "rml_base_verbose" (current value: "0")
> Verbosity level for the rml framework (0 = no
> verbosity)
> MCA rml: parameter "rml_oob_priority" (current value: "0")
> MCA pls: parameter "pls_base_reuse_daemons" (current
> value: "0")
> If nonzero, reuse daemons to launch dynamically
> spawned processes. If zero, do not reuse daemons (default)
> MCA pls: parameter "pls" (current value: <none>)
> Default selection set of components for the pls
> framework (<none> means "use all components that can be found")
> MCA pls: parameter "pls_base_verbose" (current value: "0")
> Verbosity level for the pls framework (0 = no
> verbosity)
> MCA pls: parameter "pls_gridengine_debug" (current value:
> "0")
> Enable debugging of gridengine pls component
> MCA pls: parameter "pls_gridengine_verbose" (current
> value: "0")
> Enable verbose output of the gridengine qrsh
> -inherit command
> MCA pls: parameter "pls_gridengine_priority" (current
> value: "100")
> Priority of the gridengine pls component
> MCA pls: parameter "pls_gridengine_orted" (current value:
> "orted")
> The command name that the gridengine pls
> component will invoke for the ORTE daemon
> MCA pls: parameter "pls_proxy_priority" (current value:
> "0")
> MCA pls: parameter "pls_rsh_debug" (current value: "0")
> Whether or not to enable debugging output for the
> rsh pls component (0 or 1)
> MCA pls: parameter "pls_rsh_num_concurrent" (current
> value: "128")
> How many pls_rsh_agent instances to invoke
> concurrently (must be > 0)
> MCA pls: parameter "pls_rsh_force_rsh" (current value:
> "0")
> Force the launcher to always use rsh, even for
> local daemons
> MCA pls: parameter "pls_rsh_orted" (current value:
> "orted")
> The command name that the rsh pls component will
> invoke for the ORTE daemon
> MCA pls: parameter "pls_rsh_priority" (current value:
> "10")
> Priority of the rsh pls component
> MCA pls: parameter "pls_rsh_delay" (current value: "1")
> Delay (in seconds) between invocations of the
> remote agent, but only used when the "debug" MCA parameter is true, or the
> top-level
> MCA debugging is enabled (otherwise this value is
> ignored)
> MCA pls: parameter "pls_rsh_reap" (current value: "1")
> If set to 1, wait for all the processes to
> complete before exiting. Otherwise, quit immediately -- without waiting
> for
> confirmation that all other processes in the job
> have completed.
> MCA pls: parameter "pls_rsh_assume_same_shell" (current
> value: "1")
> If set to 1, assume that the shell on the remote
> node is the same as the shell on the local node. Otherwise, probe for what
> the
> remote shell.
> MCA pls: parameter "pls_rsh_agent" (current value: "ssh :
> rsh")
> The command used to launch executables on remote
> nodes (typically either "ssh" or "rsh")
> MCA pls: parameter "pls_slurm_debug" (current value: "0")
> Enable debugging of slurm pls
> MCA pls: parameter "pls_slurm_priority" (current value:
> "75")
> Default selection priority
> MCA pls: parameter "pls_slurm_orted" (current value:
> "orted")
> Command to use to start proxy orted
> MCA pls: parameter "pls_slurm_args" (current value:
> <none>)
> Custom arguments to srun
> MCA sds: parameter "sds" (current value: <none>)
> Default selection set of components for the sds
> framework (<none> means "use all components that can be found")
> MCA sds: parameter "sds_base_verbose" (current value: "0")
> Verbosity level for the sds framework (0 = no
> verbosity)
> MCA sds: parameter "sds_env_priority" (current value: "0")
> MCA sds: parameter "sds_pipe_priority" (current value:
> "0")
> MCA sds: parameter "sds_seed_priority" (current value:
> "0")
> MCA sds: parameter "sds_singleton_priority" (current
> value: "0")
> MCA sds: parameter "sds_slurm_priority" (current value:
> "0")
>
> _______________________________________________
> users mailing list
> users_at_[hidden]
> http://www.open-mpi.org/mailman/listinfo.cgi/users