> So if I do a run of -np 2 across two separate node than the use of the max_cqe of my ib device (4194303) is ok. Once I go beyond 1 process on the node I start getting the memlocked limits message. So how much memory does a cqe take? Is it 1k by any chance? I ask this because the machine I am running on has 4GB of memory and so I am wondering if I just don't have enough backing memory and if that is so I am wondering how commone of a case this may be?
I mentioned on the call that for Mellanox devices (+OFA verbs) this resource is really cheap. Do you run mellanox hca + OFA verbs ?
Regards,
Pasha
|
![[Flag]](../../../../../community/mirrors/flag-us.gif){kind=small}