[drmichaelt7777]

I am building OpenFOAM-v1806 with OpenMPI 3.1 (from Mellanox HPC-X v2.2) Intel compilers 2018.01 (icpc version 18.0.1 (gcc version 4.8.5 compatibility) and C/CXX FLAGS
"-O3 -g -debug extended -xAVX -axCORE-AVX2,CORE-AVX512 "

I am trying to run icoFoam -parallel on the Cavity input case but I am receiving Floating-point exceptions that crash the runs.



## MPIRUN= [/hpc/local/commercial/intel/parallel_studio_xe_2018_update1/compilers_and_libraries_2018.1.163/linux/mpi/bin64/mpiexec.hydra]
## MPIRUNOPTS= [ -np 288 -ppn -print-rank-map -genv I_MPI_PIN_ORDER compact -genv I_MPI_FABRICS shmfa -genv I_MPI_OFA_ADAPTER_NAME mlx5_0:1 -genv I_MPI_DEBUG 5 ]
## APP= [icoFoam] APPOPTS= [ -parallel ]
## -------------------------------------------------------------------------- #
# bash : Initializing env modules
# bash : Initializing env modules
# bash : Initializing env modules
# bash : Initializing env modules
# bash : Initializing env modules
# bash : Initializing env modules
# bash : Initializing env modules
/*---------------------------------------------------------------------------*\
| ========= | |
| \\ / F ield | OpenFOAM: The Open Source CFD Toolbox |
| \\ / O peration | Version: v1806 |
| \\ / A nd | Web: www.OpenFOAM.com |
| \\/ M anipulation | |
\*---------------------------------------------------------------------------*/
Build : v1806
Arch : "LSB;label=32;scalar=64"
Exec : icoFoam -parallel
Date : Sep 02 2018
Time : 22:25:48
Host : "clx-vega-018"
PID : 22274
I/O : uncollated
Case : /labhome/michaelth/cs691_home/performance/analysis/HPCC/OpenFOAM-v1806/input
nProcs : 288
Hosts :
(
(clx-vega-018 36)
(clx-vega-019 36)
(clx-vega-020 36)
(clx-vega-021 36)
(clx-vega-022 36)
(clx-vega-023 36)
(clx-vega-024 36)
(clx-vega-025 36)
)
Pstream initialized with:
floatTransfer : 0
nProcsSimpleSum : 0
commsType : nonBlocking
polling iterations : 0
trapFpe: Floating point exception trapping enabled (FOAM_SIGFPE).
fileModificationChecking : Monitoring run-time modified files using timeStampMaster (fileModificationSkew 10)
allowSystemOperations : Allowing user-supplied system call operations

// * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * //
Create time

Create mesh for time = 0


PISO: Operating solver in PISO mode

Reading transportProperties

Reading field p

Reading field U

Reading/calculating face flux field phi

[39] #0 Foam::error:rintStack(Foam::Ostream&)[40] #0 ...
...




I am also receiving many Floating Point exceptions running the tutorials, eg. :
...
Running blockMesh on /labhome/michaelth/cs691/performance/analysis/HPCC/OpenFOAM-v1806/tutorials/compressible/sonicLiquidFoam/decompressionTank
Running sonicLiquidFoam on /labhome/michaelth/cs691/performance/analysis/HPCC/OpenFOAM-v1806/tutorials/compressible/sonicLiquidFoam/decompressionTank
/labhome/michaelth/software/x86_64/RHEL7/OpenFOAM/v1806/hpcx_2.3-ompi_3.1/mkl-intel_2018.01/OpenFOAM-v1806/bin/tools/RunFunctions: line 109: 8126 Floating point exception(core dumped) $appRun $appArgs "$@" > $logFile 2>&1
...

Is this compiler version and these CXXFLAGS known to generate FP exceptions with the tutorials?




Thank you!
Michael