Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

Subject: Re: [OMPI users] max. message size
From: mohammad assadsolimani (m.assadsolimani_at_[hidden])
Date: 2013-07-18 04:42:52


Dear Changsheng,

thank you very much for your help.
Since I did not the code, and use it I have to see more precise in the code.
But your code can help me definitely.
Thank you again

Zitat von users-request_at_[hidden]:

> ------------------------------
>
> Message: 3
> Date: Wed, 17 Jul 2013 16:58:56 +0800
> From: "jiangzuoyan_at_[hidden]" <jiangzuoyan_at_[hidden]>
> Subject: Re: [OMPI users] max. message size
> To: Open MPI Users <users_at_[hidden]>
> Message-ID:
> <CAAmZbPNqC17JGGH5vaXhb-6B6dnyzoOfeqZY0S_ypzPWyMgaWQ_at_[hidden]>
> Content-Type: text/plain; charset="utf-8"
>
> I did this too, FYI.
>
> template<class T>
> tmp::enable_if<is_builtin<T>::value>
> send(
> const T *buf, size_t count, int dest, int tag, MPI_Comm comm) {
> int imax = std::numeric_limits<int>::max();
> MPI_Datatype dtype = datatype<T>();
> while (count > 0) {
> int c = imax;
> if ((size_t)c > count) c = count;
> count -= c;
> MPI_Send((void*)buf, c, dtype, dest, tag, comm);
> buf += c;
> }
> }
>
> template <class T>
> tmp::enable_if<is_builtin<T>::value>
> recv(
> T *buf, size_t count, int source, int tag, MPI_Comm comm,
> MPI_Status *status=MPI_STATUS_IGNORE) {
> int imax = std::numeric_limits<int>::max();
> MPI_Datatype dtype = datatype<T>();
> if (count > (size_t)imax && status == MPI_STATUS_IGNORE
> && (source == MPI_ANY_SOURCE || tag == MPI_ANY_TAG)) {
> MPI_Status t[1];
> return recv(buf, count, source, tag, comm, t);
> }
> while (count > 0) {
> int c = imax;
> if ((size_t)c > count) c = count;
> count -= c;
> MPI_Recv((void*)buf, c, dtype, source, tag, comm, status);
> if (count > 0) {
> if (source == MPI_ANY_SOURCE) source = status->MPI_SOURCE;
> if (tag == MPI_ANY_TAG) tag = status->MPI_TAG;
> }
> buf += c;
> }
> }
>
>
> Changsheng Jiang
>
>
> On Wed, Jul 17, 2013 at 4:51 PM, mohammad assadsolimani <
> m.assadsolimani_at_[hidden]> wrote:
>
>>
>> Dear all,
>>
>> I do my PhD in physics and use a program, which uses openmpi for
>> a sophisticated calculation.
>> But there is a Problem with "max. message size ". That is limited to ~2GB.
>> Someone suggested that I have to use chunks i.e. I have to disassemble
>> the massages
>> in smaller massages. That might be nice, but I do not know how?
>> I often was searching the last time in internet however I did not get an
>> example.
>> Is there any other possibility to increase this volume without
>> manipulation of
>> the code?
>>
>> The version of my ompi: mpirun (Open MPI) 1.5.5
>>
>>
>> I am very grateful for all of your help and thank you in advanced
>> Mohammad
>>
>> ------------------------------**------------------------------**--
>> Webmail: http://mail.livenet.ch
>> Glauben entdecken: http://www.jesus.ch
>> Christliches Webportal: http://www.livenet.ch
>>
>>
>>
>> ______________________________**_________________
>> users mailing list
>> users_at_[hidden]
>> http://www.open-mpi.org/**mailman/listinfo.cgi/users>
>>
> -------------- next part --------------
> HTML attachment scrubbed and removed
>
> ------------------------------
>
> Message: 4
> Date: Wed, 17 Jul 2013 11:03:06 +0100 (BST)
> From: Mark Dixon <m.c.dixon_at_[hidden]>
> Subject: Re: [OMPI users] knem/openmpi performance?
> To: Open MPI Users <users_at_[hidden]>
> Message-ID: <alpine.GSO.2.00.1307171058430.20734_at_sunserv3>
> Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed
>
> On Mon, 15 Jul 2013, Elken, Tom wrote:
> ...
>> Hope these anecdotes are relevant to Open MPI users considering knem.
> ...
>
> Brilliantly useful, thanks! It certainly looks like it may be greatly
> significant for some applications. Worth looking into.
>
> All the best,
>
> Mark
> --
> -----------------------------------------------------------------
> Mark Dixon Email : m.c.dixon_at_[hidden]
> HPC/Grid Systems Support Tel (int): 35429
> Information Systems Services Tel (ext): +44(0)113 343 5429
> University of Leeds, LS2 9JT, UK
> -----------------------------------------------------------------
>
>
> ------------------------------
>
> Message: 5
> Date: Wed, 17 Jul 2013 16:15:41 +0300
> From: Mike Dubman <miked_at_[hidden]>
> Subject: Re: [OMPI users] max. message size
> To: Open MPI Users <users_at_[hidden]>
> Message-ID:
> <CAAO1KyakymR7wqOMwW31ntZrbYShMzkhh9Wvm7yy1Swofmh=1w_at_[hidden]>
> Content-Type: text/plain; charset="iso-8859-1"
>
> do you use IB as a transport? max message size in IB/RDMA is limited to
> 2G, but OMPI 1.7 splits large buffers during RDMA into 2G chunks.
>
>
>
> On Wed, Jul 17, 2013 at 11:51 AM, mohammad assadsolimani <
> m.assadsolimani_at_[hidden]> wrote:
>
>>
>> Dear all,
>>
>> I do my PhD in physics and use a program, which uses openmpi for
>> a sophisticated calculation.
>> But there is a Problem with "max. message size ". That is limited to ~2GB.
>> Someone suggested that I have to use chunks i.e. I have to disassemble
>> the massages
>> in smaller massages. That might be nice, but I do not know how?
>> I often was searching the last time in internet however I did not get an
>> example.
>> Is there any other possibility to increase this volume without
>> manipulation of
>> the code?
>>
>> The version of my ompi: mpirun (Open MPI) 1.5.5
>>
>>
>> I am very grateful for all of your help and thank you in advanced
>> Mohammad
>>
>> ------------------------------**------------------------------**--
>> Webmail:
http://mail.livenet.ch
>> Glauben entdecken: http://www.jesus.ch
>> Christliches Webportal: http://www.livenet.ch
>>
>>
>>
>> ______________________________**_________________
>> users mailing list
>> users_at_[hidden]
>> http://www.open-mpi.org/**mailman/listinfo.cgi/users>
>>
> -------------- next part --------------
> HTML attachment scrubbed and removed
>
> ------------------------------
>
> _______________________________________________
> users mailing list
> users_at_[hidden]
>
http://www.open-mpi.org/mailman/listinfo.cgi/users
>
> End of users Digest, Vol 2631, Issue 1
> **************************************
>

--------------------------------------------------------------
Webmail: http://mail.livenet.ch
Glauben entdecken: http://www.jesus.ch
Christliches Webportal: http://www.livenet.ch