Open MPI logo

Open MPI User's Mailing List Archives

  |   Home   |   Support   |   FAQ   |   all Open MPI User's mailing list

Subject: Re: [OMPI users] Problems with "error polling LP CQ with status RNR"
From: Pavel Shamis (Pasha) (pashash_at_[hidden])
Date: 2009-05-14 10:39:54


RNR , receive is not ready - It means that on recv side MPI don't have
buffers to get the data.
It may point to some broken configuration in MPI/ofud or credit leak in
OFUD code.

Åke Sandgren wrote:
> Hi!
>
> I'm having problem with getting the "error polling LP CQ with status
> RNR..." on an otherwise completely empty system.
> There are no errors visible in the error counters in any of the HCAs or
> switches or anywhere else.
>
> I'm running OMPI 1.3.2 built with pathscale 3.2
>
> If i add -mca btl 'ofud,self,sm' the same code works ok.
>
> It usually only shows up on runs with nodes=16:ppn=8 or higher, i.e. 8x8
> works ok.
>
> This might very well be a pathscale problem since when running with the
> debug version of ompi 1.3.2 the problem goes away.
>
> Complete error is:
> error polling LP CQ with status RECEIVER NOT READY RETRY EXCEEDED ERROR
> status number 13 for wr_id 465284992 opcode -1 vendor error 135 qp_idx
> 0
>
> Any ideas to where in the ompi code i should start reducing optimization
> levels to pinpoint this?
>
> I'll try some more tests tomorrow with a hopefully fresh mind...
>
>