[Lisandro Maders]

Hello,

I am trying to compile OpenFOAM 1806+ with the following setup:

• INTEL MPI - Intel(R) MPI Library for Linux* OS, Version 2019 Update 7 Build 20200312 (id: 5dc2dd3e9)
• Gcc 8.4
• scotch 6.0.3
• Linux distro - Ubuntu 18.04 LTS

I will attach the output log from Allwmake - a few Paraview libraries didn't compile but I am fine with that.

After compilation apparently successfull, I try to run any tutorial in parallel and it fails. I attached a failed snappyHexMesh.log as example as well.

The step-by-step I have done to compile INTEL MPI was:

1. Download INTEL MPI libraries and install it
2. change WM_MPLIB=INTELMPI at .../OpenFOAM-v1806/etc/bashrc
3. checked if the following paths were correct in etc/config.sh/mpi (they are):
   _foamAddPath $MPI_ARCH_PATH/intel64/bin
   _foamAddLib $MPI_ARCH_PATH/intel64/lib
4. checked the files at wmake/rules/*/mplibINTELMPI to see if they were pointing to the correct paths (they are)
5. source ~/intel/impi/2019.7.217/intel64/bin/mpivars.sh
6. source .../OpenFOAM-v1806/etc/bashrc

After sourcing it, I checked the output of which mpirun --version, and it was pointing to the INTEL MPI (good).
I checked the output of which mpicc --version, and it was pointing to gcc-8.4.0 (good).

I run some tutorials in parallel - all of them crashed.

Some important info: the output of ldd $(which snappyHexMesh) shows to me that there are 2 mpi libraries set:
libmpi.so.20 => /usr/lib/x86_64-linux-gnu/libmpi.so.20 (0x00007f2ef5dfc000)
libmpi.so.12 => /home/lmaders/intel/compilers_and_libraries_2020.1.217/linux/mpi/intel64/lib/release/libmpi.so.12 (0x00007f2ef4c79000)

I think it should be only setting the intel one here. If this is probably the issue, how can I ensure the OF solvers are sourcing/setting only the INTEL MPI?

Hopefully I have been clear enough. Thanks in advance

Lisandro

[HPE]

Hi,

- I would either go for an older IntelMPI version down to OF1806, or a newer OpenFOAM version up to IMPI-2019. Is there any chance for that?

[bestucan]

Originally Posted by Lisandro Maders

_foamAddPath $MPI_ARCH_PATH/intel64/bin
_foamAddLib $MPI_ARCH_PATH/intel64/lib

compare with

Originally Posted by Lisandro Maders

libmpi.so.12 => /home/lmaders/intel/compilers_and_libraries_2020.1.217/linux/mpi/intel64/lib/release/libmpi.so.12 (0x00007f2ef4c79000)

Just a guess. Is _foamAddPath add path recursively?


the libmpi.so.12 is under "lib/release" and you add "lib". Seems likes OpenFOAM missing some .so.

[Lisandro Maders]

That was it! I thought it would look for it recursivelly inside "lib" (shouldn't it be recursive?)

I explicitly set the release path and worked..

Thanks!