Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |  

This web mail archive is frozen.

This page is part of a frozen web archive of this mailing list.

You can still navigate around this archive, but know that no new mails have been added to it since July of 2016.

Click here to be taken to the new web archives of this list; it includes all the mails that are in this frozen archive plus all new mails that have been sent to the list since it was migrated to the new archives.

Subject: Re: [OMPI users] LSF launch with OpenMPI
From: Matthieu Brucher (matthieu.brucher_at_[hidden])
Date: 2009-05-07 10:39:57


Hi,

Thank you for the tip, this seems to be what I was looking for.

Matthieu

2009/5/7 Mehdi Bozzo-Rey <mbozzore_at_[hidden]>:
> Hello Jeroen,
>
>
>
> There are 2 ways of launching OpenMPI jobs (using a recent version of LSF):
>
> 1.       The one you have just described; it uses the generic PJL (Parallel
> Job Launcher) framework. You can easily recognise it because of the use of
> the –a openmpi flag and mpirun.lsf
>
> 2.       In recent versions of LSF, another framework is also available, and
> it permits a tight (native) integration with the MPIs (this is why there is
> the OpenMPI integration)
>
>
>
> So, for 1., a typical command line would be, as you mentioned, something
> like:
>
>
>
> bsub -o %J.out -e %J.err -n 4 -R "span[ptile=1]" -a openmpi mpirun.lsf
> ./test
>
>
>
> And for 2., you would use something like:
>
>
>
> bsub -o %J.out -e %J.err -n 4 -R "span[ptile=1]" mpirun ./test
>
>
>
> Cheers,
>
>
>
> Mehdi
>
>
>
>
>
>
>
> From: users-bounces_at_[hidden] [mailto:users-bounces_at_[hidden]] On
> Behalf Of Jeroen Kleijer
> Sent: May-05-09 9:26 AM
> To: Open MPI Users
> Subject: Re: [OMPI users] LSF launch with OpenMPI
>
>
>
> If you wish to submit to lsf using its native commands (bsub) you can do the
> following:
>
>
>
> bsub -q ${QUEUE} -a openmpi -n ${CPUS} "mpirun.lsf  -x PATH -x
> LD_LIBRARY_PATH -x MPI_BUFFER_SIZE ${COMMAND} ${OPTIONS}"
>
>
>
> It should be noted that in this case you don't call OpenMPI's mpirun
> directly but use the mpirun.lsf, a wrapper script provided by LSF. This
> wrapper script takes care of setting the necessary environment variables and
> eventually calls the correct mpirun. (the option "-a openmpi" tells LSF that
> we're using OpenMPI so don't try to autodetect)
>
>
>
> Regards,
>
>
>
> Jeroen Kleijer
>
> On Tue, May 5, 2009 at 2:23 PM, Jeff Squyres <jsquyres_at_[hidden]> wrote:
>
> On May 5, 2009, at 6:10 AM, Matthieu Brucher wrote:
>
> The first is what the support of LSF by OpenMPI means. When mpirun is
> executed, it is an LSF job that is actually ran? Or what does it
> imply? I've tried to search on the openmpi website as well as on the
> internet, but I couldn't find a clear answer/use case.
>
>
>
> What Terry said is correct.  It means that "mpirun" will use, under the
> covers, the "native" launching mechanism of LSF to launch jobs (vs., say,
> rsh or ssh).  It'll also discover the hosts to use for this job without the
> use of a hostfile -- it'll query LSF directly to see what hosts it should
> use.
>
> My second question is about the LSF detection. lsf.h is detected, but
> when lsb_launch is searched for ion libbat.so, it fails because
> parse_time and parse_time_ex are not found. Is there a way to add
> additional lsf libraries so that the search can be done?
>
> Can you send all the data shown here:
>
>    http://www.open-mpi.org/community/help/
>
> --
> Jeff Squyres
> Cisco Systems
>
> _______________________________________________
> users mailing list
> users_at_[hidden]
> http://www.open-mpi.org/mailman/listinfo.cgi/users
>
>
>
> _______________________________________________
> users mailing list
> users_at_[hidden]
> http://www.open-mpi.org/mailman/listinfo.cgi/users
>

-- 
Information System Engineer, Ph.D.
Website: http://matthieu-brucher.developpez.com/
Blogs: http://matt.eifelle.com and http://blog.developpez.com/?blog=92
LinkedIn: http://www.linkedin.com/in/matthieubrucher