[otsuki]

Hi,

We modified lesInterFoam with adding energy equation. A Class for temperature-dependent thermophysical properties was also added. New solver works in serial. Parallel execution works only if we put our executable and runtime library (*.so) into $FOAM_APPBIN and $FOAM_LIBBIN.
If we put them into $FOAM_USER_APPBIN and $FOAM_USER_LIBBIN, we can't execute new solver
in parallel and get the following error message.

-----------------------------------------------------------------------------
It seems that [at least] one of the processes that was started with
mpirun did not invoke MPI_INIT before quitting (it is possible that
more than one process did not invoke MPI_INIT -- mpirun was only
notified of the first one, which was on node n0).

mpirun can *only* be used with MPI programs (i.e., programs that
invoke MPI_INIT and MPI_FINALIZE). You can use the "lamexec" program
to run non-MPI programs over the lambooted nodes.
-----------------------------------------------------------------------------

Does anyone explain why ?

Masato Otsuki

[eugene]

Parallel error messages are notoriously unhelpfull.

First thing to check is whether $FOAM_USER_APPBIN points at the same location on all the nodes and the compile machine.

[ishimotoj]

The environmental values $FOAM_USER_APPBIN and $FOAM_USER_LIBBIN are in the same location in the master and slave machines.
---------
[jun@injector jun]$ echo $FOAM_USER_APPBIN
/home/jun/OpenFOAM/jun-1.2/applications/bin/linuxGcc4Opt
[jun@injector jun]$ echo $FOAM_USER_LIBBIN
/home/jun/OpenFOAM/jun-1.2/lib/linuxGcc4Opt
[jun@hpc5 jun]$ echo $FOAM_USER_APPBIN
/home/jun/OpenFOAM/jun-1.2/applications/bin/linuxGcc4Opt
[jun@hpc5 jun]$ echo $FOAM_USER_LIBBIN
/home/jun/OpenFOAM/jun-1.2/lib/linuxGcc4Opt
.
.
.
---------------------------------