CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > Software User Forums > OpenFOAM

MPI parallel meet problems

Register Blogs Community New Posts Updated Threads Search

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
Old   May 9, 2016, 22:56
Question MPI parallel meet problems
  #1
Member
 
Fengjiao Bian
Join Date: Nov 2013
Location: beijing
Posts: 30
Rep Power: 12
jiaojiao is on a distinguished road
Dear foamers,
I use the AWS cloud platform and the version of system is Red Hat 4.8. I didn't insatll OpenFOAM one step by one step. I just copy all the install packages from another cloud platform (Red Hat 5.6,gcc-4.6.1) and change the enviroment. I run the cavity tutorial with allrun script, it works well.But this case runs without parallel. So when I run another case with parallel, I meet a parallel problem when I run the mpirun command on one node and the error message shows as follow:
************************************************** **********
It looks like opal_init failed for some reason; your parallel process is
likely to abort. There are many reasons that a parallel process can
fail during opal_init; some of which are due to configuration or
environment problems. This failure appears to be an internal failure;
here's some additional information (which may only be relevant to an
Open MPI developer):

opal_shmem_base_select failed
--> Returned value -1 instead of OPAL_SUCCESS
--------------------------------------------------------------------------
[ip-****10724] [[INVALID],INVALID] ORTE_ERROR_LOG: Error in file runtime/orte_init.c at line 79
[ip-10-32-4-117:10724] [[INVALID],INVALID] ORTE_ERROR_LOG: Error in file orterun.c at line 694
************************************************** ****

The mpirun and icoFoam,fastPisoSolver is in this file
************************************************** ********
[ec2-user@******]$ which mpirun
~/OpenFOAM/ThirdParty-2.2.2/platforms/linux64Gcc/openmpi-1.6.3/bin/mpirun
[ec2-user@******]$ which icoFoam
~/OpenFOAM/OpenFOAM-2.2.2/platforms/linux64GccDPOpt/bin/icoFoam
[ec2-user@******]$ which fastPisoSolver
~/OpenFOAM/ec2-user-2.2.2/platforms/linux64GccDPOpt/bin/fastPisoSolver
[ec2-user@******]$ echo $FOAM_MPI
openmpi-1.6.3/
************************************************** **************
I run command
# ldd $(which icoFoam)#
and it shows:
************************************************** **************
linux-vdso.so.1 => (0x00007fff137f6000)
libfiniteVolume.so => /home/ec2-user/OpenFOAM/OpenFOAM-2.2.2/platforms/linux64GccDPOpt/lib/libfiniteVolume.so (0x00007f33c037e000)
libsampling.so => /home/ec2-user/OpenFOAM/OpenFOAM-2.2.2/platforms/linux64GccDPOpt/lib/libsampling.so (0x00007f33bfe44000)
libOpenFOAM.so => /home/ec2-user/OpenFOAM/OpenFOAM-2.2.2/platforms/linux64GccDPOpt/lib/libOpenFOAM.so (0x00007f33bf5b9000)
libdl.so.2 => /lib64/libdl.so.2 (0x00007f33bf3a7000)
libstdc++.so.6 => /home/ec2-user/OpenFOAM/ThirdParty-2.2.2/platforms/linux64/gcc-4.6.1/lib64/libstdc++.so.6 (0x00007f33bf0a3000)
libm.so.6 => /lib64/libm.so.6 (0x00007f33beda1000)
libgcc_s.so.1 => /home/ec2-user/OpenFOAM/ThirdParty-2.2.2/platforms/linux64/gcc-4.6.1/lib64/libgcc_s.so.1 (0x00007f33beb8b000)
libc.so.6 => /lib64/libc.so.6 (0x00007f33be7c9000)
libPstream.so => /home/ec2-user/OpenFOAM/OpenFOAM-2.2.2/platforms/linux64GccDPOpt/lib/openmpi-1.6.3/libPstream.so (0x00007f33be5bf000)
libtriSurface.so => /home/ec2-user/OpenFOAM/OpenFOAM-2.2.2/platforms/linux64GccDPOpt/lib/libtriSurface.so (0x00007f33be329000)
libmeshTools.so => /home/ec2-user/OpenFOAM/OpenFOAM-2.2.2/platforms/linux64GccDPOpt/lib/libmeshTools.so (0x00007f33bddf5000)
libsurfMesh.so => /home/ec2-user/OpenFOAM/OpenFOAM-2.2.2/platforms/linux64GccDPOpt/lib/libsurfMesh.so (0x00007f33bdae8000)
libfileFormats.so => /home/ec2-user/OpenFOAM/OpenFOAM-2.2.2/platforms/linux64GccDPOpt/lib/libfileFormats.so (0x00007f33bd876000)
liblagrangian.so => /home/ec2-user/OpenFOAM/OpenFOAM-2.2.2/platforms/linux64GccDPOpt/lib/liblagrangian.so (0x00007f33bd657000)
libconversion.so => /home/ec2-user/OpenFOAM/OpenFOAM-2.2.2/platforms/linux64GccDPOpt/lib/libconversion.so (0x00007f33bd3e1000)
libz.so.1 => /lib64/libz.so.1 (0x00007f33bd1cb000)
/lib64/ld-linux-x86-64.so.2 (0x000055bb661d6000)
libmpi.so.1 => /home/ec2-user/OpenFOAM/ThirdParty-2.2.2/platforms/linux64Gcc/openmpi-1.6.3/lib64/libmpi.so.1 (0x00007f33bce30000)
librt.so.1 => /lib64/librt.so.1 (0x00007f33bcc27000)
libnsl.so.1 => /lib64/libnsl.so.1 (0x00007f33bca0e000)
libutil.so.1 => /lib64/libutil.so.1 (0x00007f33bc80b000)
libpthread.so.0 => /lib64/libpthread.so.0 (0x00007f33bc5ee000)
************************************************** **************
and this simple command mpirun -np 2 ls will show the same error. I try to fix this problem with the idea suggested here: Problem running OpenFOAM 2.2.x in parallel in Centos 5 post #6 ,but I can't finish the last Allwmake process. It shows cannot find the mpi.h file.I don't kown what to do.Could anyone give me some ideas?Thanks!

this follow is my bashrc file
****************************
# .bashrc

# Source global definitions
if [ -f /etc/bashrc ]; then
. /etc/bashrc
fi

# User specific aliases and functions
source /home/ec2-user/OpenFOAM/OpenFOAM-2.2.2/etc/bashrc
export PATH=/home/ec2-user/OpenFOAM/ThirdParty-2.2.2/platforms/linux64Gcc/qt-4.7.3/bin:$PATH
export LD_LIBRARY_PATH=/home/ec2-user/OpenFOAM/ThirdParty-2.2.2/platforms/linux64Gcc/qt-4.7.3/lib:$LD_LIBRARY_PATH

#added
export WM_PROJECT_USER_DIR=/home/ec2-user/OpenFOAM
export FOAM_MPI=openmpi-1.6.3/

Last edited by jiaojiao; May 10, 2016 at 01:56.
jiaojiao is offline   Reply With Quote

Old   May 10, 2016, 02:30
Default
  #2
Member
 
Fengjiao Bian
Join Date: Nov 2013
Location: beijing
Posts: 30
Rep Power: 12
jiaojiao is on a distinguished road
[ec2-user@*****]$ foamJob -p -s Test-parallel
Parallel processing using OPENMPI with 4 processors
Executing: /home/ec2-user/OpenFOAM/ThirdParty-2.2.2/platforms/linux64Gcc/openmpi-1.6.3/bin/mpirun -np 4 /home/ec2-user/OpenFOAM/OpenFOAM-2.2.2/bin/foamExec -prefix /home/ec2-user/OpenFOAM Test-parallel -parallel | tee log
--------------------------------------------------------------------------
It looks like opal_init failed for some reason; your parallel process is
likely to abort. There are many reasons that a parallel process can
fail during opal_init; some of which are due to configuration or
environment problems. This failure appears to be an internal failure;
here's some additional information (which may only be relevant to an
Open MPI developer):

opal_shmem_base_select failed
--> Returned value -1 instead of OPAL_SUCCESS
--------------------------------------------------------------------------
[*****] [[INVALID],INVALID] ORTE_ERROR_LOG: Error in file runtime/orte_init.c at line 79
[*****] [[INVALID],INVALID] ORTE_ERROR_LOG: Error in file orterun.c at line 694
jiaojiao is offline   Reply With Quote

Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Problems running a customized solver in parallel RaghavendraRohith OpenFOAM Programming & Development 3 April 30, 2018 17:44
Parallel Running With Problems guilha OpenFOAM Running, Solving & CFD 1 July 26, 2014 10:55
A question about HP MPI Local Parallel nucfusion CFX 2 March 15, 2013 02:07
HP MPI warning...Distributed parallel processing Peter CFX 10 May 14, 2011 06:17
Fluent PARALLEL & MPI Luca FLUENT 0 May 13, 2006 03:04


All times are GMT -4. The time now is 22:12.