[vishal3]

Hi
I have installed OF220 with ICC Compiler. I have compiled openFoam, Thirdparty and openmpi successfully. It works perfectly for all tutorials.

The problem is that, I can not run the job in parrallel. When i submit the job in parallel, it creates a JOB ID but exits immediately. Can anyone tell me the solution?

Plzzzzz suggest somethin as i am very much in need.

Thanking you,

[wyldckat]

Greetings Vishal,

Sorry, but you're not providing enough information for us to help you. Therefore, a few questions:

1. How exactly are you submitting the job?
2. What job scheduler are you using?
3. Have you tried building OpenFOAM with GCC first?
4. Are ICC's libraries installed on all of the machines that you are trying to run OpenFOAM on?
5. Are you certain that Open-MPI is compatible with your job scheduler?

Best regards,
Bruno

[vishal3]

I am not able to run the binaries in parallel even with directly login.

I checked the binaries using strings command but unable to find any MPI calls in that. InFact none of the binaries are linked to MPI libraries.

I didn't tried with GCC because system GCC is very old (4.2, 4.4). And requirement is version 4.6.

OpenMPI and JOb system are compatible and ICC compiler is also present on all nodes.

Regards,
Vishal

[wyldckat]

Hi Vishal,

OK, try the following command on the machine that works and the machine that doesn't:

ldd $(which simpleFoam)

It will list the dependencies on libraries that this binary has got. For example, for me it gave:

$ ldd $(which simpleFoam)

  linux-vdso.so.1 =>  (0x00007fffc29ff000)
  libincompressibleTurbulenceModel.so => /home/user/OpenFOAM/OpenFOAM-2.1.x/platforms/linux64GccDPOpt/lib/libincompressibleTurbulenceModel.so (0x00007f5bb4c9e000)
  libincompressibleRASModels.so => /home/user/OpenFOAM/OpenFOAM-2.1.x/platforms/linux64GccDPOpt/lib/libincompressibleRASModels.so (0x00007f5bb47aa000)
  libincompressibleTransportModels.so => /home/user/OpenFOAM/OpenFOAM-2.1.x/platforms/linux64GccDPOpt/lib/libincompressibleTransportModels.so (0x00007f5bb453c000)
  libfiniteVolume.so => /home/user/OpenFOAM/OpenFOAM-2.1.x/platforms/linux64GccDPOpt/lib/libfiniteVolume.so (0x00007f5bb333e000)
  libmeshTools.so => /home/user/OpenFOAM/OpenFOAM-2.1.x/platforms/linux64GccDPOpt/lib/libmeshTools.so (0x00007f5bb2ea3000)
  libOpenFOAM.so => /home/user/OpenFOAM/OpenFOAM-2.1.x/platforms/linux64GccDPOpt/lib/libOpenFOAM.so (0x00007f5bb2747000)
  libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f5bb251c000)
  libstdc++.so.6 => /usr/lib/x86_64-linux-gnu/libstdc++.so.6 (0x00007f5bb221b000)
  libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f5bb1f1f000)
  libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x00007f5bb1d09000)
  libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f5bb1949000)
  libPstream.so => /home/user/OpenFOAM/OpenFOAM-2.1.x/platforms/linux64GccDPOpt/lib/openmpi-1.5.3/libPstream.so (0x00007f5bb173f000)
  libtriSurface.so => /home/user/OpenFOAM/OpenFOAM-2.1.x/platforms/linux64GccDPOpt/lib/libtriSurface.so (0x00007f5bb14cc000)
  libz.so.1 => /lib/x86_64-linux-gnu/libz.so.1 (0x00007f5bb12b5000)
  /lib64/ld-linux-x86-64.so.2 (0x00007f5bb4ef2000)
  libmpi.so.1 => /home/user/OpenFOAM/ThirdParty-2.1.x/platforms/linux64Gcc/openmpi-1.5.3/lib/libmpi.so.1 (0x00007f5bb0f4a000)
  libfileFormats.so => /home/user/OpenFOAM/OpenFOAM-2.1.x/platforms/linux64GccDPOpt/lib/libfileFormats.so (0x00007f5bb0d40000)
  libutil.so.1 => /lib/x86_64-linux-gnu/libutil.so.1 (0x00007f5bb0b3c000)
  libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f5bb091f000)

On the machine where it doesn't work, check if the paths for the libraries are the same as on the main machine.

If they are, check what the following commands give you on each machine:

echo $PATH
echo $LD_LIBRARY_PATH

1. The first shows the list of paths that are looked at when you want to run an application by simply stating it's name.
2. The second one is the list of paths that are searched when looking for libraries by name.

Best regards,
Bruno