[francesco_capuano]

Hi everybody,

I'm having some problems running OpenFOAM v 2.1.0 in parallel mode. In particular, I need to update the PStream library to switch from OpenMPI to Intel MPI, which is actually installed on the cluster I'm using.

I have followed the instructions in

http://openfoamwiki.net/index.php/HowTo_Pstream

but they refer to old versions of OpenFOAM (v. 1.XXX) and I cannot figure out what's the problem.

Is there anyone who has successfully switched from OpenMPI to other MPI implementations?

[wyldckat]

Greetings Francesco,

The wiki page isn't very out of date, the instructions there still apply to the latest versions of OpenFOAM... with a few minor adjustments...

Basically, there are 3 places that need attention (OpenFOAM version number is just a reference):

1. "OpenFOAM-2.1.0/etc/bashrc" - check where it says:

   #- MPI implementation:
   #    WM_MPLIB = SYSTEMOPENMPI | OPENMPI | MPICH | MPICH-GM | HPMPI
   #               | GAMMA | MPI | QSMPI
   export WM_MPLIB=OPENMPI

   Change "WM_MPLIB=OPENMPI" to "WM_MPLIB=INTELMPI"
2. "OpenFOAM-2.1.0/etc/config/settings.sh" - search for the code that starts with:

   # Communications library
   # ~~~~~~~~~~~~~~~~~~~~~~
   
   unset MPI_ARCH_PATH MPI_HOME FOAM_MPI_LIBBIN
   
   case "$WM_MPLIB" in
   OPENMPI)

   Wait... you will find in 2.1.0 on this file, near the end, the entry for "INTELMPI)". It assumes that "MPI_ROOT" is properly defined before you source "OpenFOAM-2.1.0/etc/bashrc".
3. "OpenFOAM-2.1.0/wmake/rules/linux64Gcc/mplibINTELMPI" - this is the rules file for the "INTELMPI" option.

And that's pretty much it!

Best regards,
Bruno

[francesco_capuano]

Thanks Bruno for your quick and clear reply!

As soon as I get back to work I will try and let you know!

Regards,
Francesco

[francesco_capuano]

Dear Bruno,

I get the following message:


Warning in /u2/capuanf/OpenFOAM/OpenFOAM-2.0.1/etc/config/settings.csh:
MPI_ROOT not a valid mpt installation directory.
Please set MPI_ROOT to the mpt installation directory.
(usually done by loading the mpt module)
MPI_ROOT currently set to '/dummy'

MPI_ROOT is not properly set! How can I fix this?

Problem solved! I just defined the MPI_ROOT variable properly in my .bashrc file and it worked!

Thanks in advance!

[sandy]

Hi Francesco,

I met the same problem. Could you give a detailed list how to set the MPI_ROOT variable in .bashrc ?? Thanks

[francesco_capuano]

Originally Posted by sandy

Hi Francesco,

I met the same problem. Could you give a detailed list how to set the MPI_ROOT variable in .bashrc ?? Thanks

Hi Sandy,

you can define the MPI_ROOT variable by adding the line

export MPI_ROOT=mpipath

at the end of the your .bashrc file. mpipath is the mpi installation path of your computer/cluster. You can either try to find it yourself or ask it to your cluster technician. Just to give you a clue, in my case the installation path is

/cm/shared/apps/intel/ics/impi/4.0.3.008/

In case you have further questions, please don't hesitate to ask.

Regards,
Francesco

[hawkeye321]

Hi FOAMERS
I am using OpenFOAM 2.1,and have LAM/MPI already installed (LAM 7.1.4/MPI 2 C++/ROMIO - Indiana University). When I am trying to rum icofoam on 3 processors I get this error

------------
It seems that [at least] one of the processes that was started with
mpirun did not invoke MPI_INIT before quitting (it is possible that
more than one process did not invoke MPI_INIT -- mpirun was only
notified of the first one, which was on node n0).

mpirun can *only* be used with MPI programs (i.e., programs that
invoke MPI_INIT and MPI_FINALIZE). You can use the "lamexec" program
to run non-MPI programs over the lambooted nodes.
------------
Any idea why i get this error?
I have already run some cases on parallel with OpenFOAM 1.7 and mpirun (Open MPI) 1.3.2. Can I used LAM/MPI instead of OpenMPI? If yes, is there a certain version of LAM/MPI which is compatible with OpenFOAM 2.1?

[nimasam]

i dont know what the error is, but there is a suggestion in error line

You can use the "lamexec" program

did you try this program?