|
[Sponsors] |
May 9, 2016, 23:56 |
MPI parallel meet problems
|
#1 |
Member
Fengjiao Bian
Join Date: Nov 2013
Location: beijing
Posts: 30
Rep Power: 13 |
Dear foamers,
I use the AWS cloud platform and the version of system is Red Hat 4.8. I didn't insatll OpenFOAM one step by one step. I just copy all the install packages from another cloud platform (Red Hat 5.6,gcc-4.6.1) and change the enviroment. I run the cavity tutorial with allrun script, it works well.But this case runs without parallel. So when I run another case with parallel, I meet a parallel problem when I run the mpirun command on one node and the error message shows as follow: ************************************************** ********** It looks like opal_init failed for some reason; your parallel process is likely to abort. There are many reasons that a parallel process can fail during opal_init; some of which are due to configuration or environment problems. This failure appears to be an internal failure; here's some additional information (which may only be relevant to an Open MPI developer): opal_shmem_base_select failed --> Returned value -1 instead of OPAL_SUCCESS -------------------------------------------------------------------------- [ip-****10724] [[INVALID],INVALID] ORTE_ERROR_LOG: Error in file runtime/orte_init.c at line 79 [ip-10-32-4-117:10724] [[INVALID],INVALID] ORTE_ERROR_LOG: Error in file orterun.c at line 694 ************************************************** **** The mpirun and icoFoam,fastPisoSolver is in this file ************************************************** ******** [ec2-user@******]$ which mpirun ~/OpenFOAM/ThirdParty-2.2.2/platforms/linux64Gcc/openmpi-1.6.3/bin/mpirun [ec2-user@******]$ which icoFoam ~/OpenFOAM/OpenFOAM-2.2.2/platforms/linux64GccDPOpt/bin/icoFoam [ec2-user@******]$ which fastPisoSolver ~/OpenFOAM/ec2-user-2.2.2/platforms/linux64GccDPOpt/bin/fastPisoSolver [ec2-user@******]$ echo $FOAM_MPI openmpi-1.6.3/ ************************************************** ************** I run command # ldd $(which icoFoam)# and it shows: ************************************************** ************** linux-vdso.so.1 => (0x00007fff137f6000) libfiniteVolume.so => /home/ec2-user/OpenFOAM/OpenFOAM-2.2.2/platforms/linux64GccDPOpt/lib/libfiniteVolume.so (0x00007f33c037e000) libsampling.so => /home/ec2-user/OpenFOAM/OpenFOAM-2.2.2/platforms/linux64GccDPOpt/lib/libsampling.so (0x00007f33bfe44000) libOpenFOAM.so => /home/ec2-user/OpenFOAM/OpenFOAM-2.2.2/platforms/linux64GccDPOpt/lib/libOpenFOAM.so (0x00007f33bf5b9000) libdl.so.2 => /lib64/libdl.so.2 (0x00007f33bf3a7000) libstdc++.so.6 => /home/ec2-user/OpenFOAM/ThirdParty-2.2.2/platforms/linux64/gcc-4.6.1/lib64/libstdc++.so.6 (0x00007f33bf0a3000) libm.so.6 => /lib64/libm.so.6 (0x00007f33beda1000) libgcc_s.so.1 => /home/ec2-user/OpenFOAM/ThirdParty-2.2.2/platforms/linux64/gcc-4.6.1/lib64/libgcc_s.so.1 (0x00007f33beb8b000) libc.so.6 => /lib64/libc.so.6 (0x00007f33be7c9000) libPstream.so => /home/ec2-user/OpenFOAM/OpenFOAM-2.2.2/platforms/linux64GccDPOpt/lib/openmpi-1.6.3/libPstream.so (0x00007f33be5bf000) libtriSurface.so => /home/ec2-user/OpenFOAM/OpenFOAM-2.2.2/platforms/linux64GccDPOpt/lib/libtriSurface.so (0x00007f33be329000) libmeshTools.so => /home/ec2-user/OpenFOAM/OpenFOAM-2.2.2/platforms/linux64GccDPOpt/lib/libmeshTools.so (0x00007f33bddf5000) libsurfMesh.so => /home/ec2-user/OpenFOAM/OpenFOAM-2.2.2/platforms/linux64GccDPOpt/lib/libsurfMesh.so (0x00007f33bdae8000) libfileFormats.so => /home/ec2-user/OpenFOAM/OpenFOAM-2.2.2/platforms/linux64GccDPOpt/lib/libfileFormats.so (0x00007f33bd876000) liblagrangian.so => /home/ec2-user/OpenFOAM/OpenFOAM-2.2.2/platforms/linux64GccDPOpt/lib/liblagrangian.so (0x00007f33bd657000) libconversion.so => /home/ec2-user/OpenFOAM/OpenFOAM-2.2.2/platforms/linux64GccDPOpt/lib/libconversion.so (0x00007f33bd3e1000) libz.so.1 => /lib64/libz.so.1 (0x00007f33bd1cb000) /lib64/ld-linux-x86-64.so.2 (0x000055bb661d6000) libmpi.so.1 => /home/ec2-user/OpenFOAM/ThirdParty-2.2.2/platforms/linux64Gcc/openmpi-1.6.3/lib64/libmpi.so.1 (0x00007f33bce30000) librt.so.1 => /lib64/librt.so.1 (0x00007f33bcc27000) libnsl.so.1 => /lib64/libnsl.so.1 (0x00007f33bca0e000) libutil.so.1 => /lib64/libutil.so.1 (0x00007f33bc80b000) libpthread.so.0 => /lib64/libpthread.so.0 (0x00007f33bc5ee000) ************************************************** ************** and this simple command mpirun -np 2 ls will show the same error. I try to fix this problem with the idea suggested here: Problem running OpenFOAM 2.2.x in parallel in Centos 5 post #6 ,but I can't finish the last Allwmake process. It shows cannot find the mpi.h file.I don't kown what to do.Could anyone give me some ideas?Thanks! this follow is my bashrc file **************************** # .bashrc # Source global definitions if [ -f /etc/bashrc ]; then . /etc/bashrc fi # User specific aliases and functions source /home/ec2-user/OpenFOAM/OpenFOAM-2.2.2/etc/bashrc export PATH=/home/ec2-user/OpenFOAM/ThirdParty-2.2.2/platforms/linux64Gcc/qt-4.7.3/bin:$PATH export LD_LIBRARY_PATH=/home/ec2-user/OpenFOAM/ThirdParty-2.2.2/platforms/linux64Gcc/qt-4.7.3/lib:$LD_LIBRARY_PATH #added export WM_PROJECT_USER_DIR=/home/ec2-user/OpenFOAM export FOAM_MPI=openmpi-1.6.3/ Last edited by jiaojiao; May 10, 2016 at 02:56. |
|
May 10, 2016, 03:30 |
|
#2 |
Member
Fengjiao Bian
Join Date: Nov 2013
Location: beijing
Posts: 30
Rep Power: 13 |
[ec2-user@*****]$ foamJob -p -s Test-parallel
Parallel processing using OPENMPI with 4 processors Executing: /home/ec2-user/OpenFOAM/ThirdParty-2.2.2/platforms/linux64Gcc/openmpi-1.6.3/bin/mpirun -np 4 /home/ec2-user/OpenFOAM/OpenFOAM-2.2.2/bin/foamExec -prefix /home/ec2-user/OpenFOAM Test-parallel -parallel | tee log -------------------------------------------------------------------------- It looks like opal_init failed for some reason; your parallel process is likely to abort. There are many reasons that a parallel process can fail during opal_init; some of which are due to configuration or environment problems. This failure appears to be an internal failure; here's some additional information (which may only be relevant to an Open MPI developer): opal_shmem_base_select failed --> Returned value -1 instead of OPAL_SUCCESS -------------------------------------------------------------------------- [*****] [[INVALID],INVALID] ORTE_ERROR_LOG: Error in file runtime/orte_init.c at line 79 [*****] [[INVALID],INVALID] ORTE_ERROR_LOG: Error in file orterun.c at line 694 |
|
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
Problems running a customized solver in parallel | RaghavendraRohith | OpenFOAM Programming & Development | 3 | April 30, 2018 18:44 |
Parallel Running With Problems | guilha | OpenFOAM Running, Solving & CFD | 1 | July 26, 2014 11:55 |
A question about HP MPI Local Parallel | nucfusion | CFX | 2 | March 15, 2013 03:07 |
HP MPI warning...Distributed parallel processing | Peter | CFX | 10 | May 14, 2011 07:17 |
Fluent PARALLEL & MPI | Luca | FLUENT | 0 | May 13, 2006 04:04 |