[greg.cfd]

Hello Bruno,

Sorry for the late reply. Actually the link that you provided solved the problem for my case.

More specific I followed the instructions in the last post of the thread and then the instructions in the second post of the following thread:

http://www.cfd-online.com/Forums/ope...e-openmpi.html

Now I can run OpenFoam 2.3.0 in parallel, however I can not use decomposePar. So for now I use decomposePar from OpenFoam 2.1.1

Thanks a lot for the help!

Best regards,
Greg

[makaveli_lcf]

Hi guys!

For me the tip from linnemann

Originally Posted by linnemann

Hi

I installed a virtual machine and found the same problem with mpirun.

To fix it you need to have the system gcc and gcc-c++ installed.
Otherwise you will get a compile error.

So here comes the fix

rm -rf $FOAM_EXT_LIBBIN/../../linux64Gcc/openmpi-1.6.3
cd $FOAM_INST_DIR/ThirdParty-2.2.x
./Allwmake

cd $FOAM_SRC/Pstream/dummy
wclean
cd ../mpi
wclean
cd ..
./Allwmake

After that it was working for me.

I will have a centFoam version up with the fixes, but it will take some time to upload etc.

worked well to:

1. build and run OF2.2.x on CentOS 5.9 (final)
2. build but NOT TO RUN OF2.3.x on RHEL Server 6.4 cluster

Surprisly the solver runs well on the login node of the RHEL Server in parallel mode, but when I start it via the queueing system I get the following error message in a log file:

interFoam: relocation error: /home/avakhrushev/OpenFOAM/ThirdParty-2.3.x/platforms/linux64Gcc/openmpi-1.6.5/lib64/openmpi/mca_btl_openib.so: symbol rdma_get_src_port, version RDMACM_1.0 not defined in file librdmacm.so.1 with link time reference
interFoam: relocation error: /home/avakhrushev/OpenFOAM/ThirdParty-2.3.x/platforms/linux64Gcc/openmpi-1.6.5/lib64/openmpi/mca_btl_openib.so: symbol rdma_get_src_port, version RDMACM_1.0 not defined in file librdmacm.so.1 with link time reference
interFoam: relocation error: /home/avakhrushev/OpenFOAM/ThirdParty-2.3.x/platforms/linux64Gcc/openmpi-1.6.5/lib64/openmpi/mca_btl_openib.so: symbol rdma_get_src_port, version RDMACM_1.0 not defined in file librdmacm.so.1 with link time reference
interFoam: relocation error: /home/avakhrushev/OpenFOAM/ThirdParty-2.3.x/platforms/linux64Gcc/openmpi-1.6.5/lib64/openmpi/mca_btl_openib.so: symbol rdma_get_src_port, version RDMACM_1.0 not defined in file librdmacm.so.1 with link time reference
interFoam: relocation error: /home/avakhrushev/OpenFOAM/ThirdParty-2.3.x/platforms/linux64Gcc/openmpi-1.6.5/lib64/openmpi/mca_btl_openib.so: symbol rdma_get_src_port, version RDMACM_1.0 not defined in file librdmacm.so.1 with link time reference
--------------------------------------------------------------------------
mpirun has exited due to process rank 0 with PID 120795 on
node n009 exiting improperly. There are two reasons this could occur:

1. this process did not call "init" before exiting, but others in
the job did. This can cause a job to hang indefinitely while it waits
for all processes to call "init". By rule, if one process calls "init",
then ALL processes must call "init" prior to termination.

2. this process called "init", but exited without calling "finalize".
By rule, all processes that call "init" MUST call "finalize" prior to
exiting or it will be considered an "abnormal termination"

This may have caused other processes in the application to be
terminated by signals sent by mpirun (as reported here).
--------------------------------------------------------------------------

I also tried the options suggested by the wyldckat

mpirun --mca btl tcp -np 12 interFoam -parallel

mpirun --mca btl openib -np 12 interFoam -parallel

but that does not help.

So, would you be so kind to make your suggestions, what is the reason and how can I fix this issue?

Cheers,
Alex

[yejungong]

I met the same problem before. And it is solved by recompiling the ThirdParty (Allwclean, and then Allwmake).

[stater]

Hi Alexander,

Did you find the solution about your issue? I have the same problem and i tried to resolve by the manner proposed by linnemann but i didn't succeed
I need help please,

Thanks

[makaveli_lcf]

Dear stater,

I've just solved a problem in my case. It was:

1. Rebuilding the ThirParty with system gcc

2. Running my tasks with the mpirun options:

mpirun --mca btl ^openib --mca btl_tcp_if_include eth0 -np 12 interFoam -parallel

[makaveli_lcf]

I also successfully installed 2.3.x git version on CentOS 5.9 just following instructions:

https://openfoamwiki.net/index.php/I...CentOS_SL_RHEL

Thank you, Bruno! )))

[jiaojiao]

Originally Posted by linnemann

Hi

I installed a virtual machine and found the same problem with mpirun.

To fix it you need to have the system gcc and gcc-c++ installed.
Otherwise you will get a compile error.

So here comes the fix

rm -rf $FOAM_EXT_LIBBIN/../../linux64Gcc/openmpi-1.6.3
cd $FOAM_INST_DIR/ThirdParty-2.2.x
./Allwmake

cd $FOAM_SRC/Pstream/dummy
wclean
cd ../mpi
wclean
cd ..
./Allwmake

After that it was working for me.

I will have a centFoam version up with the fixes, but it will take some time to upload etc.

I follow the steps to fix the same problem,but I can't finish the last Allwmake process. It shows cannot find the mpi.h file.I don't kown what to do.Could you give me some ideas?Thanks!

[wyldckat]

Originally Posted by jiaojiao

I follow the steps to fix the same problem,but I can't finish the last Allwmake process. It shows cannot find the mpi.h file.I don't kown what to do.Could you give me some ideas?Thanks!

Quick answer: Please provide more specific details. For example:

1. Which exact Linux Distribution and version are you using?
2. Which OpenFOAM version are you trying to install?
3. Which installation instructions did you follow for installing OpenFOAM?

[jiaojiao]

Originally Posted by wyldckat

Quick answer: Please provide more specific details. For example:

1. Which exact Linux Distribution and version are you using?
2. Which OpenFOAM version are you trying to install?
3. Which installation instructions did you follow for installing OpenFOAM?

Thank you for your quick answer, Bruno. The version of OpenFOAM I am trying to install is 2.2.2 with Red Hat 4.8.I post a new thread,
http://www.cfd-online.com/Forums/ope...tml#post599384. I pasted some information in it.
Thank you for your help,
best regards,
Jiaojiao

[philocfd]

Originally Posted by linnemann

Hi

I installed a virtual machine and found the same problem with mpirun.

To fix it you need to have the system gcc and gcc-c++ installed.
Otherwise you will get a compile error.

So here comes the fix

rm -rf $FOAM_EXT_LIBBIN/../../linux64Gcc/openmpi-1.6.3
cd $FOAM_INST_DIR/ThirdParty-2.2.x
./Allwmake

cd $FOAM_SRC/Pstream/dummy
wclean
cd ../mpi
wclean
cd ..
./Allwmake

After that it was working for me.

I will have a centFoam version up with the fixes, but it will take some time to upload etc.

This worked well and fixed my problem, Thank you!

[kebsiali]

Dear all,

I have the same problem with the new OF1606+
I tried which mpirun and it is the one included with the OF1606+
I can't wclean and allwmake the mpi becuase of permissions under docker containers

Any ideas please

[Saleh Abuhanieh]

Originally Posted by PeterX30

@ Bruno,

thank`s a lot for your suggestion. Obviously Debian Wheezy has problems with openmpi 1.6.3 or viceversa. Following your proposal, to use Wheezy`s own openmpi (1.4.5), fixed the problem. I changed to:

"export WM_MPLIB= SYSTEMOPENMPI"

in "OpenFOAM-2.2.x/etc/bashrc", recompiled and after that it worked.

Best Regards,
Peter

Hi Foamers,


I just wanted to highlight that the above solution is still valid.
I had the same problem with foam-extend 4.0, I think due to have more than one version of mpi in my machine.
I've changed the WM_MPLIB for SYSTEMOPENMPI
then recompiled foam
and it works!

[amuzeshi]

Originally Posted by linnemann

Hi

I installed a virtual machine and found the same problem with mpirun.

To fix it you need to have the system gcc and gcc-c++ installed.
Otherwise you will get a compile error.

So here comes the fix

rm -rf $FOAM_EXT_LIBBIN/../../linux64Gcc/openmpi-1.6.3
cd $FOAM_INST_DIR/ThirdParty-2.2.x
./Allwmake

cd $FOAM_SRC/Pstream/dummy
wclean
cd ../mpi
wclean
cd ..
./Allwmake

After that it was working for me.

I will have a centFoam version up with the fixes, but it will take some time to upload etc.

Hi,
I use foam-extend-4.0. There is no 'PStream' directory under $FOAM_SRC in order to make the changes that you've mentioned.

[safranyikf]

Hi linnemann,


I faced with exactly the same problem on Ubuntu 20.04 with HELYX-OS 2.4 and OpenFoam 4.1.
I found your solutions which was worked for others as well, however in case of my setup there are no directories as you mentioned hence I am not able to run the suggested commands. Do you have any idea how should I modify your code?


Thanks in advance, Feri