CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > Software User Forums > OpenFOAM > OpenFOAM Running, Solving & CFD

Problem with running foam-extend 4.0 in parallel in Ubuntu 18.04

Register Blogs Community New Posts Updated Threads Search

Like Tree2Likes
  • 1 Post By amuzeshi
  • 1 Post By courant_numero_uno

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
Old   September 22, 2019, 04:07
Default Problem with running foam-extend 4.0 in parallel in Ubuntu 18.04
  #1
Senior Member
 
Ali Shayegh
Join Date: Oct 2015
Posts: 131
Rep Power: 11
amuzeshi is on a distinguished road
1- Running a solver under foam-extend 4.0 on Ubuntu 18.04 returns this error:
Code:
mpirun -np <N> <solver> -parallel
--------------------------------------------------------------------------
It looks like opal_init failed for some reason; your parallel process is
likely to abort.  There are many reasons that a parallel process can
fail during opal_init; some of which are due to configuration or
environment problems.  This failure appears to be an internal failure;
here's some additional information (which may only be relevant to an
Open MPI developer):

  opal_shmem_base_select failed
  --> Returned value -1 instead of OPAL_SUCCESS
--------------------------------------------------------------------------
2- I tried to change this line in <foam installation dir>/etc/bashrc:
Code:
# WM_MPLIB = SYSTEMOPENMPI | OPENMPI | MPICH | MPICH-GM | HPMPI | GAMMA | MPI | QSMPI | MVAPICH2
: ${WM_MPLIB:=OPENMPI}; export WM_MPLIB
to
Code:
# WM_MPLIB = SYSTEMOPENMPI | OPENMPI | MPICH | MPICH-GM | HPMPI | GAMMA | MPI | QSMPI | MVAPICH2
: ${WM_MPLIB:=SYSTEMOPENMPI}; export WM_MPLIB
and then re-compiled. It makes the whole of the openFoam corrupted, because, after this change, blockMesh even was not known to terminal with this error
Code:
error while loading shared libraries: libmpi.so.1
3- I recompiled foam by the script Allwmake.firstInstall; everything went smoothly. However it showed this:
Code:
Note: ignore spurious warnings about missing mpicxx.h headers
4- The problem still persists!

What do you think can help? Does re-cloning from github and re-installing help?
rezaeimahdi likes this.
amuzeshi is offline   Reply With Quote

Old   September 22, 2019, 11:36
Default
  #2
New Member
 
Join Date: Sep 2019
Posts: 17
Rep Power: 7
courant_numero_uno is on a distinguished road
I recently had a bunch of problems installing Foam-Extend 4.0. Eventually, adding this line to my ~/.bashrc file fixed them.


export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/lib64/mpi/gcc/openmpi/lib64/
amuzeshi likes this.
courant_numero_uno is offline   Reply With Quote

Old   September 23, 2019, 02:26
Default
  #3
Senior Member
 
Ali Shayegh
Join Date: Oct 2015
Posts: 131
Rep Power: 11
amuzeshi is on a distinguished road
Quote:
Originally Posted by courant_numero_uno View Post
I recently had a bunch of problems installing Foam-Extend 4.0. Eventually, adding this line to my ~/.bashrc file fixed them.


export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/lib64/mpi/gcc/openmpi/lib64/
Hi courant_numero_uno,
Can you mention what does this directory include? Can you post 'ls' command output?
I don't have this directory. The most similar one is
Code:
/usr/lib/x86_64-linux-gnu/openmpi/lib
and its contents are:
Code:
libmca_common_libfabric.so           libompitrace.so.20.10.0
libmca_common_libfabric.so.20.10.0   libopen-pal.so
libmca_common_sm.so                  libopen-pal.so.20.10.1
libmca_common_sm.so.20.10.1          libopen-rte.so
libmca_common_verbs.so               libopen-rte.so.20.10.1
libmca_common_verbs.so.20.10.0       liboshmem.so
libmpi_cxx.so                        liboshmem.so.20.10.1
libmpi_cxx.so.20.10.0                mpi_ext.mod
libmpi_java.so                       mpi_f08_callbacks.mod
libmpi_java.so.20.10.0               mpi_f08_ext.mod
libmpi_mpifh.so                      mpi_f08_interfaces_callbacks.mod
libmpi_mpifh.so.20.11.0              mpi_f08_interfaces.mod
libmpi.so                            mpi_f08.mod
libmpi.so.20.10.1                    mpi_f08_types.mod
libmpi_usempif08.so                  mpi.mod
libmpi_usempif08.so.20.10.0          openmpi
libmpi_usempi_ignore_tkr.so          pkgconfig
libmpi_usempi_ignore_tkr.so.20.10.0  pmpi_f08_interfaces.mod
libompitrace.so
but doing export using this path at the end of ~/.bashrc did not solve the problem!
amuzeshi is offline   Reply With Quote

Old   September 23, 2019, 03:23
Default
  #4
Senior Member
 
Ali Shayegh
Join Date: Oct 2015
Posts: 131
Rep Power: 11
amuzeshi is on a distinguished road
I also went thru these steps:

1- The method mentioned here; The problem was not solved.

2- The first method mentioned here; The problem was not solved.

3- In the directory of
Code:
/home/lian/foam/foam-extend-4.0/ThirdParty
I added the following line to AllClean.stage2
Code:
uninstallPackage openmpi-1.8.8 $1
Then I executed :
Code:
./AllClean.stage2
./AllMake.stage2
And the problem persists!

4- I tried to do this solution. But, there is this problem regarding foam-extend-4.0

5- I did not understand the 2nd method that @wyldckat has mentioned here.
amuzeshi is offline   Reply With Quote

Old   September 27, 2019, 10:16
Default
  #5
Senior Member
 
Ali Shayegh
Join Date: Oct 2015
Posts: 131
Rep Power: 11
amuzeshi is on a distinguished road
Quote:
Originally Posted by amuzeshi View Post
1- Running a solver under foam-extend 4.0 on Ubuntu 18.04 returns this error:
Code:
mpirun -np <N> <solver> -parallel
--------------------------------------------------------------------------
It looks like opal_init failed for some reason; your parallel process is
likely to abort.  There are many reasons that a parallel process can
fail during opal_init; some of which are due to configuration or
environment problems.  This failure appears to be an internal failure;
here's some additional information (which may only be relevant to an
Open MPI developer):

  opal_shmem_base_select failed
  --> Returned value -1 instead of OPAL_SUCCESS
--------------------------------------------------------------------------
2- I tried to change this line in <foam installation dir>/etc/bashrc:
Code:
# WM_MPLIB = SYSTEMOPENMPI | OPENMPI | MPICH | MPICH-GM | HPMPI | GAMMA | MPI | QSMPI | MVAPICH2
: ${WM_MPLIB:=OPENMPI}; export WM_MPLIB
to ...
Solution:
Using 'tar -c' command on my laptop where I had compiled foam extend before, I generated a compressed version of foam-extend 4.0 (Here is more information to do it). Then, using ' tar -x ' I extracted it on a node.
I did so in order to save time of re-compiling. But, actually it was the origin of the problem. I just removed and re-compiled foam-extend 4.0 and after that, it works fine.
amuzeshi is offline   Reply With Quote

Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
"Failed Starting Thread 0" ebringley OpenFOAM Running, Solving & CFD 2 April 26, 2019 06:45
Possible Memory problem with foam extend 4.0 HenrikJohansson OpenFOAM Running, Solving & CFD 1 April 19, 2018 09:07
error with reactingFoam BakedAlmonds OpenFOAM Running, Solving & CFD 4 June 22, 2016 03:21
[mesh manipulation] Importing Multiple Meshes thomasnwalshiii OpenFOAM Meshing & Mesh Conversion 18 December 19, 2015 19:57
simpleFoam parallel AndrewMortimer OpenFOAM Running, Solving & CFD 12 August 7, 2015 19:45


All times are GMT -4. The time now is 21:16.