OpenFabrics failed

sirius · September 15, 2014, 08:34

I am trying to submit a SU2 parallel MPI run using the job scheduler PBS Pro. I get the following error

libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes.
This will severely limit memory registrations.
--------------------------------------------------------------------------
The OpenFabrics (openib) BTL failed to initialize while trying to
allocate some locked memory. This typically can indicate that the
memlock limits are set too low. For most HPC installations, the
memlock limits should be set to "unlimited".

I don't get this error for other codes requiring large memory. Also if I run SU2 with MPI directly (i.e. without PBS), I don't face this problem. I am already setting ulimit to unlimited. If anybody has faced a similar issue and/or has a solution, please let me know. Thanks.

fpalacios · September 21, 2014, 22:22

Interesting problem, what case are your running? Have you tried with a really small simulation (e.g. quick start tutorial).

Best,
Francisco

September 15, 2014, 08:34	OpenFabrics failed	#1
sirius New Member Sirius Join Date: Jun 2014 Posts: 4 Rep Power: 12	I am trying to submit a SU2 parallel MPI run using the job scheduler PBS Pro. I get the following error libibverbs: Warning: RLIMIT_MEMLOCK is 32768 bytes. This will severely limit memory registrations. -------------------------------------------------------------------------- The OpenFabrics (openib) BTL failed to initialize while trying to allocate some locked memory. This typically can indicate that the memlock limits are set too low. For most HPC installations, the memlock limits should be set to "unlimited". I don't get this error for other codes requiring large memory. Also if I run SU2 with MPI directly (i.e. without PBS), I don't face this problem. I am already setting ulimit to unlimited. If anybody has faced a similar issue and/or has a solution, please let me know. Thanks.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Foam::error::printStack(Foam::Ostream&) with simpleFoam -parallel	U.Golling	OpenFOAM Running, Solving & CFD	52	September 23, 2023 04:35
Initial conditions for uniform flow	andreas	OpenFOAM	5	November 16, 2012 16:00
[OpenFOAM] ParaView/Parafoam error when making animation	Disco_Caine	ParaView	6	September 28, 2010 10:54
user subroutine error	CFDUSER	CFX	2	December 9, 2006 07:31
user defined function	cfduser	CFX	0	April 29, 2006 11:58

September 21, 2014, 22:22		#2
fpalacios Super Moderator Francisco Palacios Join Date: Jan 2013 Location: Long Beach, CA Posts: 404 Rep Power: 15	Interesting problem, what case are your running? Have you tried with a really small simulation (e.g. quick start tutorial). Best, Francisco