Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |  

This web mail archive is frozen.

This page is part of a frozen web archive of this mailing list.

You can still navigate around this archive, but know that no new mails have been added to it since July of 2016.

Click here to be taken to the new web archives of this list; it includes all the mails that are in this frozen archive plus all new mails that have been sent to the list since it was migrated to the new archives.

Subject: Re: [OMPI users] [warn] Epoll ADD(1) on fd 0 failed
From: Timur Ismagilov (tismagilov_at_[hidden])
Date: 2014-06-06 03:16:45


 Sometimes,  after termination of the program, launched with the command "sbatch ... -o myprogram.out .....",  no file "myprogram.out"  is being produced. Could this be due to the above mentioned problem?

Thu, 5 Jun 2014 07:45:01 -0700 от Ralph Castain <rhc_at_[hidden]>:
>FWIW: support for the --resv-ports option was deprecated and removed on the OMPI side a long time ago.
>
>I'm not familiar enough with "oshrun" to know if it is doing anything unusual - I believe it is just a renaming of our usual "mpirun". I suspect this is some interaction with sbatch, but I'll take a look. I haven't see that warning. Mike indicated he thought it is due to both slurm and OMPI trying to control stdin/stdout, in which case it shouldn't be happening but you can safely ignore it
>
>
>On Jun 5, 2014, at 3:04 AM, Timur Ismagilov < tismagilov_at_[hidden] > wrote:
>>I use cmd line
>>$sbatch -p test --exclusive -N 2 -o hello_oshmem.out -e hello_oshmem.err shrun_mxm3.0 ./hello_oshmem
>>
>>where script shrun_mxm3.0:
>>$cat shrun_mxm3.0
>>  #!/bin/sh
>>  #srun --resv-ports "$@"
>>  #exit $?
>>  [ x"$TMPDIR" == x"" ] && TMPDIR=/tmp
>>  HOSTFILE=${TMPDIR}/hostfile.${SLURM_JOB_ID}
>>  srun hostname -s|sort|uniq -c|awk '{print $2" slots="$1}' > $HOSTFILE || { rm -f $HOSTFILE; exit 255; }
>>  LD_PRELOAD=/mnt/data/users/dm2/vol3/semenov/_scratch/mxm/mxm-3.0/lib/libmxm.so oshrun -x LD_PRELOAD -x MXM_SHM_KCOPY_MODE=off --hostfile $HOSTFILE "$@"
>>
>>  rc=$?
>>  rm -f $HOSTFILE
>>  exit $rc
>>I configured openmpi using
>>./configure CC=icc CXX=icpc F77=ifort FC=ifort --prefix=/mnt/data/users/dm2/vol3/semenov/_scratch/openmpi-1.8.1_mxm-3.0 --with-mxm=/mnt/data/users/dm2/vol3/semenov/_scratch/mxm/mxm-3.0/ --with-              slurm --with-platform=contrib/platform/mellanox/optimized
>>
>>
>>Fri, 30 May 2014 07:09:54 -0700 от Ralph Castain < rhc_at_[hidden] >:
>>>Can you pass along the cmd line that generated that output, and how OMPI was configured?
>>>
>>>On May 30, 2014, at 5:11 AM, Тимур Исмагилов < tismagilov_at_[hidden] > wrote:
>>>>Hello!
>>>>I am using Open MPI v1.8.1 and slurm 2.5.6.
>>>>I got this messages when i try to run example (hello_oshmem.cpp) program:
>>>>[warn] Epoll ADD(1) on fd 0 failed. Old events were 0; read change was 1 (add); write change was 0 (none): Operation not permitted
>>>>[warn] Epoll ADD(4) on fd 1 failed. Old events were 0; read change was 0 (none); write change was 1 (add): Operation not permitted
>>>>Hello, world, I am 0 of 2
>>>>Hello, world, I am 1 of 2
>>>>What does this warnings mean?
>>>>I lunch this job using sbatch and mpirun with hostfile (got it from :  $srun hostname -s|sort|uniq -c|awk '{print $2" slots="$1}' > $HOSTFILE)
>>>>Regards,
>>>>Timur
>>>>_______________________________________________
>>>>users mailing list
>>>>users_at_[hidden]
>>>>http://www.open-mpi.org/mailman/listinfo.cgi/users
>>
>>
>>
>_______________________________________________
>users mailing list
>users_at_[hidden]
>http://www.open-mpi.org/mailman/listinfo.cgi/users