[Regis_]

Hi all,

I just built OpenFOAM 2.4.0 but I’m having issues setting up the OpenMPI (1.8.5). I have an old working version of OpenFOAM installed as well so I’m able to compare some directories more easily.

I executed OpenFOAM’s Allwmake which calls ThirdParty’s Allwmake which “build the MPI libraries if required”. At first, nothing related to OpenMPI had been built, because I didn’t fall into any of the cases for building OpenMPI specified at ThirdParty’s Allwmake. Then, I changed WM_MPILIB to OPENMPI instead of SYSTEMOPENMPI in $WM_PROJECT_DIR/etc/bashrc in order to fall into the “if required”. I haven’t changed anything with respect to MPI in settings.sh. The logfile for the ThirdParty’s Allwmake is attached.

Looking at the openmpi makefile, I can see that, in fact, the prefix path appears to be correct: $WM_THIRD_PARTY_DIR/platforms/linux64Gcc/openmpi-1.8.5.

My problem is that I cannot use mpirun to run OpenFOAM’s applications in parallel. The directory ThirdParty-2.4.0/platforms/linux64Gcc/openmpi-1.8.5 still doesn’t exist after the compilation; ThirdParty-2.4.0/platforms/linux64GccDPOpt/lib/openmpi-1.8.5 exists, but it is empty. Comparing with the old OpenFOAM I have installed, the first folder I mentioned is populated with bin, lib, include and others.

I tried compiling again just the openMPI (not using ThirdParty’s Allwmake, but rather configure and make from ThirdParty/openmpi-1.8.5), specifying a different path, like $HOME/foo, and the directories bin, lib and so on were created, but not populated as I was expecting (again, comparing with the old OpenFOAM installation).

All the paths in $PATH and $LD_LIBRARY_PATH seems to be correct, that is, they are pointing to the directories that should exist inside ThirdParty/platforms.

Before posting, I looked for similar problems and tried to follow whatever people replied, but I haven’t been successful. Any help or suggestion is greatly appreciated.

Regis


PS.: I’m not having any issues regarding having more than one installation of OpenFOAM (I actually have 3). All the paths were correctly adjusted and I’m sourcing the bashrc’s I need to.

[Linse]

I am on too slow a machine, thus not reading the log. But: Did you already try with compiling the OpenMPI into the ThirdParty folder?
Nevertheless there might be a real bug in the software, with my approach being just a workaround.
Please feel free to recheck what you have installed and issuing a bug report afterwards via the mantis bugtracker. The last times the people at OpenCFD seemed to react quickly there...

[Regis_]

Bernhard,

The ThirdParty’s Allwmake tries to compile it within the ThirdParty directory:

./configure \
            --prefix=$MPI_ARCH_PATH \
# […]

and $MPI_ARCH_PATH is $WM_THIRD_PARTY/platforms/linux64Gcc/openmpi-1.8.5.

So I’m not sure if it is valid to try to recompile it again specifying similar paths, but I don’t think this will work. Just as a side note, comparing with the old installation I have, openMPI files were created inside both platforms/linux64Gcc/openmpi-x.y.z (lib, bin, include…) and platforms/linux64GccDPOpt/lib/openmpi-x.y.z (shared objects).

I don’t want to submit a bug yet because the probability of me doing something wrong is higher than this being a real bug. I appreciate if you or someone else could take a look at the logfile.

[wyldckat]

Greetings to all!

@Regis: Since you've opened a bug report, I'll answer there, since it does seem to be a bug: http://www.openfoam.org/mantisbt/view.php?id=1770

edit: I've also provided the bug fix there, namely that the "openmpi-1.8.5" folder that is in "ThirdParty-2.4.0" is missing a few files.

Best regards,
Bruno

[Regis_]

Thanks Bruno. I'll reply there as well, but just for the sake of organization: Your suggestion worked.

[buffi]

I had exactly the same problem and the suggested fix worked for me. I also had to recompile Pstream, though.