[RussellHolt]

Hi Everyone

I'm running a CFDEM simulation coupling OpenFOAM and LIGGGHTs using the CFDEM software package and am running into some sigFpe errors. I'm looking for a bit of guidance on how to understand how this error is pointing me to the source as I am finding it a little unclear due to the ?:?? symbols. To me it looks as though the error is in the cfdemSolverPiso module [#18], however is the below telling me that there are errors in all the lines leading up to #18? Reading through the forums most examples I have seen of these errors have been a bit more clear on the source, (but I am a rookie so this could be on me!)

The simulation appears to run fine in debug mode using valgrind and doesn't throw up any errors. I am also able to solve both the CFD (using pisoFOAM) and DEM simulations separately so the issue looks to be during the coupling.

//   run_parallel_cfdemSolverPiso_settlingTestMPI_CFDDEM   //

/home/holt/Final/ExpTest/CFD

/*---------------------------------------------------------------------------*\
| =========                 |                                                 |
| \\      /  F ield         | OpenFOAM: The Open Source CFD Toolbox           |
|  \\    /   O peration     | Version:  5.x                                   |
|   \\  /    A nd           | Web:      www.OpenFOAM.org                      |
|    \\/     M anipulation  |                                                 |
\*---------------------------------------------------------------------------*/
Build  : 5.x-538044ac05c4
Exec   : cfdemSolverPiso -parallel
Date   : Mar 07 2022
Time   : 01:47:29
Host   : "DESKTOP-77FGJ18"
PID    : 24221
I/O    : uncollated
Case   : /home/holt/Final/ExpTest/CFD
nProcs : 4
Slaves : 
3
(
"DESKTOP-77FGJ18.24222"
"DESKTOP-77FGJ18.24223"
"DESKTOP-77FGJ18.24224"
)

Pstream initialized with:
    floatTransfer      : 0
    nProcsSimpleSum    : 0
    commsType          : nonBlocking
    polling iterations : 0
sigFpe : Enabling floating point exception trapping (FOAM_SIGFPE).
fileModificationChecking : Monitoring run-time modified files using timeStampMaster (fileModificationSkew 10)
allowSystemOperations : Allowing user-supplied system call operations

// * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * //
Create time

Overriding DimensionedConstants according to controlDict
    c [0 1 -1 0 0 0 0] 2.99792e+08
    G [-1 3 -2 0 0 0 0] 6.67429e-11
    h [1 2 -1 0 0 0 0] 6.62607e-34
    e [0 0 1 0 0 1 0] 1.60218e-19
    me [1 0 0 0 0 0 0] 9.10938e-31
    mp [1 0 0 0 0 0 0] 1.67262e-27
    mu [1 0 0 0 0 0 0] 1.66054e-27
    NA [0 0 0 0 -1 0 0] 6.02214e+23
    k [1 2 -2 -1 0 0 0] 1.38065e-23
    Pstd [1 -1 -2 0 0 0 0] 100000
    Tstd [0 0 0 1 0 0 0] 298.15
    hr [1 2 -1 0 0 0 0] 1.05457e-34
    mu0 [1 1 -2 0 0 -2 0] 1.25664e-06
    epsilon0 [-1 -3 4 0 0 2 0] 8.85421e-12
    Z0 [1 2 -3 0 0 -2 0] 376.73
    kappa [1 3 -4 0 0 -2 0] 8.98752e+09
    G0 [-1 -2 3 0 0 2 0] 7.74812e-05
    KJ [-1 -2 2 0 0 1 0] 4.83599e+14
    phi0 [1 2 -2 0 0 -1 0] 2.06783e-15
    RK [1 2 -3 0 0 -2 0] 25812.7
    alpha [0 0 0 0 0 0 0] 0.00729737
    Rinf [0 -1 0 0 0 0 0] 1.09738e+07
    a0 [0 1 0 0 0 0 0] 5.29177e-11
    re [0 1 0 0 0 0 0] 2.81795e-15
    Eh [1 2 -2 0 0 0 0] 4.35975e-18
    R [1 2 -2 -1 -1 0 0] 8.31447
    F [0 0 1 0 -1 1 0] 96485.6
    sigma [1 0 -3 -4 0 0 0] 5.67041e-08
    b [0 1 0 1 0 0 0] 0.00289777
    c1 [1 4 -3 0 0 0 0] 3.74176e-16
    c2 [0 1 0 1 0 0 0] 0.0143877
Create mesh for time = 0


PISO: Operating solver in PISO mode

Reading field p

Reading physical velocity field U
Note: only if voidfraction at boundary is 1, U is superficial velocity!!!


Reading momentum exchange field Ksl


Reading voidfraction field voidfraction = (Vgas/Vparticle)


Creating density field rho

Reading particle velocity field Us

Reading/calculating face flux field phi

AMI: Creating addressing and weights between 630 source faces and 630 target faces
AMI: Patch source sum(weights) min/max/average = 1, 1, 1
AMI: Patch target sum(weights) min/max/average = 1, 1, 1
Generating interstitial face flux field phiByVoidfraction

Selecting incompressible transport model Newtonian
Selecting turbulence model type laminar
Selecting laminar stress model Stokes
Creating finite volume options from "system/fvOptions"


Reading g
Selecting locateModel engine
Selecting dataExchangeModel twoWayMPI
Starting up LIGGGHTS for first time execution
Executing input script '../DEM/in.Test'
LIGGGHTS (Version LIGGGHTS-PUBLIC 3.8.0, compiled 2022-02-11-21:54:15 by holt, git commit 86544c3f1215bc9744d7929e3eacf53ba086af9e)
Reading restart file ...
WARNING: Restart file version does not match LIGGGHTS version (../read_restart.cpp:507)
   --> restart file = Version LIGGGHTS-PUBLIC 3.8.0, compiled 2022-02-11-21:49:46 by holt, git commit 86544c3f1215bc9744d7929e3eacf53ba086af9e
   --> LIGGGHTS = Version LIGGGHTS-PUBLIC 3.8.0, compiled 2022-02-11-21:54:15 by holt, git commit 86544c3f1215bc9744d7929e3eacf53ba086af9e
version 3 8
version 3 8
version 3 8
version 3 8
  orthogonal box = (-200 -6372 -485) to (2870 6372 485)
  1 by 4 by 1 MPI processor grid
  9620 atoms
10 atoms in group flow
9610 atoms in group walls
couple_every as specified in LIGGGHTS is overriden by calling external program (../fix_cfd_coupling.cpp:114)
Resetting global state of Fix contacthistory Style contacthistory from restart file info
Resetting per-atom state of Fix contacthistory Style contacthistory from restart file info
Setting up run at Mon Mar  7 01:47:29 2022

[0] #0  Foam::error::printStack(Foam::Ostream&)[3] #0  Foam::error::printStack(Foam::Ostream&) at ??:?
[0] #1  Foam::sigFpe::sigHandler(int) at ??:?
[3] #1  Foam::sigFpe::sigHandler(int) at ??:?
[0] #2  ? at ??:?
[3] #2  ? in "/lib/x86_64-linux-gnu/libpthread.so.0"
[0] #3  LIGGGHTS::PairStyles::Granular<LIGGGHTS::ContactModels::ContactModel<LIGGGHTS::ContactModels::GranStyle<3, 2, 0, 0, 0> > >::compute_force(LAMMPS_NS::PairGran*, int, int, int) in "/lib/x86_64-linux-gnu/libpthread.so.0"
[3] #3  LIGGGHTS::PairStyles::Granular<LIGGGHTS::ContactModels::ContactModel<LIGGGHTS::ContactModels::GranStyle<3, 2, 0, 0, 0> > >::compute_force(LAMMPS_NS::PairGran*, int, int, int) at ??:?
[0] #4  LAMMPS_NS::PairGran::compute(int, int) at ??:?
[3] #4  LAMMPS_NS::PairGran::compute(int, int) at ??:?
[0] #5  LAMMPS_NS::PairHybrid::compute(int, int) at ??:?
[3] #5  LAMMPS_NS::PairHybrid::compute(int, int) at ??:?
[0] #6  LAMMPS_NS::Verlet::setup() at ??:?
[3] #6  LAMMPS_NS::Verlet::setup() at ??:?
[0] #7  LAMMPS_NS::Run::command(int, char**, long) at ??:?
[3] #7  LAMMPS_NS::Run::command(int, char**, long) at ??:?
[0] #8  void LAMMPS_NS::Input::command_creator<LAMMPS_NS::Run>(LAMMPS_NS::LAMMPS*, int, char**) at ??:?
[3] #8  void LAMMPS_NS::Input::command_creator<LAMMPS_NS::Run>(LAMMPS_NS::LAMMPS*, int, char**) at ??:?
[0] #9  LAMMPS_NS::Input::execute_command() at ??:?
[3] #9  LAMMPS_NS::Input::execute_command() at ??:?
[0] #10  LAMMPS_NS::Input::file() at ??:?
[3] #10  LAMMPS_NS::Input::file() at ??:?
[0] #11  LAMMPS_NS::Input::file(char const*) at ??:?
 at ??:?
[0] #12  Foam::twoWayMPI::twoWayMPI(Foam::dictionary const&, Foam::cfdemCloud&)[3] #11  LAMMPS_NS::Input::file(char const*) at ??:?
[0] #13  Foam::dataExchangeModel::adddictionaryConstructorToTable<Foam::twoWayMPI>::New(Foam::dictionary const&, Foam::cfdemCloud&) at ??:?
[3] #12  Foam::twoWayMPI::twoWayMPI(Foam::dictionary const&, Foam::cfdemCloud&) at ??:?
[0] #14  Foam::dataExchangeModel::New(Foam::dictionary const&, Foam::cfdemCloud&) at ??:?
[3] #13  Foam::dataExchangeModel::adddictionaryConstructorToTable<Foam::twoWayMPI>::New(Foam::dictionary const&, Foam::cfdemCloud&) at ??:?
[0] #15  Foam::cfdemCloud::cfdemCloud(Foam::fvMesh const&) at ??:?
[3] #14  Foam::dataExchangeModel::New(Foam::dictionary const&, Foam::cfdemCloud&) at ??:?
[0] #16   at ??:?
[3] #15  Foam::cfdemCloud::cfdemCloud(Foam::fvMesh const&)? at ??:?
[3] #16   in "/home/holt/CFDEM/CFDEMcoupling-PUBLIC-5.x/platforms/linux64GccDPInt32Opt/bin/cfdemSolverPiso"
[0] #17  __libc_start_main? in "/lib/x86_64-linux-gnu/libc.so.6"
[0] #18   in "/home/holt/CFDEM/CFDEMcoupling-PUBLIC-5.x/platforms/linux64GccDPInt32Opt/bin/cfdemSolverPiso"
[3] #17  __libc_start_main? in "/lib/x86_64-linux-gnu/libc.so.6"
[3] #18   in "/home/holt/CFDEM/CFDEMcoupling-PUBLIC-5.x/platforms/linux64GccDPInt32Opt/bin/cfdemSolverPiso"
[DESKTOP-77FGJ18:24221] *** Process received signal ***
[DESKTOP-77FGJ18:24221] Signal: Floating point exception (8)
[DESKTOP-77FGJ18:24221] Signal code:  (-6)
[DESKTOP-77FGJ18:24221] Failing at address: 0x3e800005e9d
[DESKTOP-77FGJ18:24221] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x153c0)[0x7efde058e3c0]
[DESKTOP-77FGJ18:24221] [ 1] /lib/x86_64-linux-gnu/libpthread.so.0(raise+0xcb)[0x7efde058e24b]
[DESKTOP-77FGJ18:24221] [ 2] /lib/x86_64-linux-gnu/libpthread.so.0(+0x153c0)[0x7efde058e3c0]
[DESKTOP-77FGJ18:24221] [ 3] /home/holt/CFDEM/CFDEMcoupling-PUBLIC-5.x/platforms/linux64GccDPInt32Opt/lib/liblmp_auto.so(_ZN8LIGGGHTS10PairStyles8GranularINS_13ContactModels12ContactModelINS2_9GranStyleILi3ELi2ELi0ELi0ELi0EEEEEE13compute_forceEPN9LAMMPS_NS8PairGranEiii+0xcd3)[0x7efddf1ea4c3]
[DESKTOP-77FGJ18:24221] [ 4] /home/holt/CFDEM/CFDEMcoupling-PUBLIC-5.x/platforms/linux64GccDPInt32Opt/lib/liblmp_auto.so(_ZN9LAMMPS_NS8PairGran7computeEii+0x93)[0x7efddee836d3]
[DESKTOP-77FGJ18:24221] [ 5] /home/holt/CFDEM/CFDEMcoupling-PUBLIC-5.x/platforms/linux64GccDPInt32Opt/lib/liblmp_auto.so(_ZN9LAMMPS_NS10PairHybrid7computeEii+0xe4)[0x7efddeddc4b4]
[DESKTOP-77FGJ18:24221] [ 6] /home/holt/CFDEM/CFDEMcoupling-PUBLIC-5.x/platforms/linux64GccDPInt32Opt/lib/liblmp_auto.so(_ZN9LAMMPS_NS6Verlet5setupEv+0x3e2)[0x7efddf34a182]
[DESKTOP-77FGJ18:24221] [ 7] ?/home/holt/CFDEM/CFDEMcoupling-PUBLIC-5.x/platforms/linux64GccDPInt32Opt/lib/liblmp_auto.so(_ZN9LAMMPS_NS3Run7commandEiPPcl+0x74e)[0x7efddef862be]
[DESKTOP-77FGJ18:24221] [ 8] /home/holt/CFDEM/CFDEMcoupling-PUBLIC-5.x/platforms/linux64GccDPInt32Opt/lib/liblmp_auto.so(_ZN9LAMMPS_NS5Input15command_creatorINS_3RunEEEvPNS_6LAMMPSEiPPc+0x45)[0x7efddedfb5d5]
[DESKTOP-77FGJ18:24221] [ 9] /home/holt/CFDEM/CFDEMcoupling-PUBLIC-5.x/platforms/linux64GccDPInt32Opt/lib/liblmp_auto.so(_ZN9LAMMPS_NS5Input15execute_commandEv+0x849)[0x7efddedf9259]
[DESKTOP-77FGJ18:24221] [10] /home/holt/CFDEM/CFDEMcoupling-PUBLIC-5.x/platforms/linux64GccDPInt32Opt/lib/liblmp_auto.so(_ZN9LAMMPS_NS5Input4fileEv+0x466)[0x7efddedf9ab6]
[DESKTOP-77FGJ18:24221] [11] /home/holt/CFDEM/CFDEMcoupling-PUBLIC-5.x/platforms/linux64GccDPInt32Opt/lib/liblmp_auto.so(_ZN9LAMMPS_NS5Input4fileEPKc+0x7c)[0x7efddedf9cdc]
[DESKTOP-77FGJ18:24221] [12] /home/holt/CFDEM/CFDEMcoupling-PUBLIC-5.x/platforms/linux64GccDPInt32Opt/lib/liblagrangianCFDEM-PUBLIC-5.x.so(_ZN4Foam9twoWayMPIC1ERKNS_10dictionaryERNS_10cfdemCloudE+0x296)[0x7efde13c2476]
[DESKTOP-77FGJ18:24221] [13] /home/holt/CFDEM/CFDEMcoupling-PUBLIC-5.x/platforms/linux64GccDPInt32Opt/lib/liblagrangianCFDEM-PUBLIC-5.x.so(_ZN4Foam17dataExchangeModel31adddictionaryConstructorToTableINS_9twoWayMPIEE3NewERKNS_10dictionaryERNS_10cfdemCloudE+0x2e)[0x7efde13c354e]
[DESKTOP-77FGJ18:24221] [14] /home/holt/CFDEM/CFDEMcoupling-PUBLIC-5.x/platforms/linux64GccDPInt32Opt/lib/liblagrangianCFDEM-PUBLIC-5.x.so(_ZN4Foam17dataExchangeModel3NewERKNS_10dictionaryERNS_10cfdemCloudE+0x22c)[0x7efde13b666c]
[DESKTOP-77FGJ18:24221] [15] /home/holt/CFDEM/CFDEMcoupling-PUBLIC-5.x/platforms/linux64GccDPInt32Opt/lib/liblagrangianCFDEM-PUBLIC-5.x.so(_ZN4Foam10cfdemCloudC1ERKNS_6fvMeshE+0xa08)[0x7efde1340738]
[DESKTOP-77FGJ18:24221] [16] cfdemSolverPiso(+0x2968f)[0x5639dc0bf68f]
[DESKTOP-77FGJ18:24221] [17] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7efde03ae0b3]
[DESKTOP-77FGJ18:24221] [18] cfdemSolverPiso(+0x2e62e)[0x5639dc0c462e]
[DESKTOP-77FGJ18:24221] *** End of error message ***
 in "/home/holt/CFDEM/CFDEMcoupling-PUBLIC-5.x/platforms/linux64GccDPInt32Opt/bin/cfdemSolverPiso"
--------------------------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
[DESKTOP-77FGJ18:24224] *** Process received signal ***
[DESKTOP-77FGJ18:24224] Signal: Floating point exception (8)
[DESKTOP-77FGJ18:24224] Signal code:  (-6)
[DESKTOP-77FGJ18:24224] Failing at address: 0x3e800005ea0
[DESKTOP-77FGJ18:24224] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x153c0)[0x7f4669e793c0]
[DESKTOP-77FGJ18:24224] [ 1] /lib/x86_64-linux-gnu/libpthread.so.0(raise+0xcb)[0x7f4669e7924b]
[DESKTOP-77FGJ18:24224] [ 2] /lib/x86_64-linux-gnu/libpthread.so.0(+0x153c0)[0x7f4669e793c0]
[DESKTOP-77FGJ18:24224] [ 3] /home/holt/CFDEM/CFDEMcoupling-PUBLIC-5.x/platforms/linux64GccDPInt32Opt/lib/liblmp_auto.so(_ZN8LIGGGHTS10PairStyles8GranularINS_13ContactModels12ContactModelINS2_9GranStyleILi3ELi2ELi0ELi0ELi0EEEEEE13compute_forceEPN9LAMMPS_NS8PairGranEiii+0xcd3)[0x7f4668ad54c3]
[DESKTOP-77FGJ18:24224] [ 4] /home/holt/CFDEM/CFDEMcoupling-PUBLIC-5.x/platforms/linux64GccDPInt32Opt/lib/liblmp_auto.so(_ZN9LAMMPS_NS8PairGran7computeEii+0x93)[0x7f466876e6d3]
[DESKTOP-77FGJ18:24224] [ 5] /home/holt/CFDEM/CFDEMcoupling-PUBLIC-5.x/platforms/linux64GccDPInt32Opt/lib/liblmp_auto.so(_ZN9LAMMPS_NS10PairHybrid7computeEii+0xe4)[0x7f46686c74b4]
[DESKTOP-77FGJ18:24224] [ 6] /home/holt/CFDEM/CFDEMcoupling-PUBLIC-5.x/platforms/linux64GccDPInt32Opt/lib/liblmp_auto.so(_ZN9LAMMPS_NS6Verlet5setupEv+0x3e2)[0x7f4668c35182]
[DESKTOP-77FGJ18:24224] [ 7] /home/holt/CFDEM/CFDEMcoupling-PUBLIC-5.x/platforms/linux64GccDPInt32Opt/lib/liblmp_auto.so(_ZN9LAMMPS_NS3Run7commandEiPPcl+0x74e)[0x7f46688712be]
[DESKTOP-77FGJ18:24224] [ 8] /home/holt/CFDEM/CFDEMcoupling-PUBLIC-5.x/platforms/linux64GccDPInt32Opt/lib/liblmp_auto.so(_ZN9LAMMPS_NS5Input15command_creatorINS_3RunEEEvPNS_6LAMMPSEiPPc+0x45)[0x7f46686e65d5]
[DESKTOP-77FGJ18:24224] [ 9] /home/holt/CFDEM/CFDEMcoupling-PUBLIC-5.x/platforms/linux64GccDPInt32Opt/lib/liblmp_auto.so(_ZN9LAMMPS_NS5Input15execute_commandEv+0x849)[0x7f46686e4259]
[DESKTOP-77FGJ18:24224] [10] /home/holt/CFDEM/CFDEMcoupling-PUBLIC-5.x/platforms/linux64GccDPInt32Opt/lib/liblmp_auto.so(_ZN9LAMMPS_NS5Input4fileEv+0x466)[0x7f46686e4ab6]
[DESKTOP-77FGJ18:24224] [11] /home/holt/CFDEM/CFDEMcoupling-PUBLIC-5.x/platforms/linux64GccDPInt32Opt/lib/liblmp_auto.so(_ZN9LAMMPS_NS5Input4fileEPKc+0x7c)[0x7f46686e4cdc]
[DESKTOP-77FGJ18:24224] [12] /home/holt/CFDEM/CFDEMcoupling-PUBLIC-5.x/platforms/linux64GccDPInt32Opt/lib/liblagrangianCFDEM-PUBLIC-5.x.so(_ZN4Foam9twoWayMPIC1ERKNS_10dictionaryERNS_10cfdemCloudE+0x296)[0x7f466acad476]
[DESKTOP-77FGJ18:24224] [13] /home/holt/CFDEM/CFDEMcoupling-PUBLIC-5.x/platforms/linux64GccDPInt32Opt/lib/liblagrangianCFDEM-PUBLIC-5.x.so(_ZN4Foam17dataExchangeModel31adddictionaryConstructorToTableINS_9twoWayMPIEE3NewERKNS_10dictionaryERNS_10cfdemCloudE+0x2e)[0x7f466acae54e]
[DESKTOP-77FGJ18:24224] [14] /home/holt/CFDEM/CFDEMcoupling-PUBLIC-5.x/platforms/linux64GccDPInt32Opt/lib/liblagrangianCFDEM-PUBLIC-5.x.so(_ZN4Foam17dataExchangeModel3NewERKNS_10dictionaryERNS_10cfdemCloudE+0x22c)[0x7f466aca166c]
[DESKTOP-77FGJ18:24224] [15] /home/holt/CFDEM/CFDEMcoupling-PUBLIC-5.x/platforms/linux64GccDPInt32Opt/lib/liblagrangianCFDEM-PUBLIC-5.x.so(_ZN4Foam10cfdemCloudC1ERKNS_6fvMeshE+0xa08)[0x7f466ac2b738]
[DESKTOP-77FGJ18:24224] [16] cfdemSolverPiso(+0x2968f)[0x55b523ed668f]
[DESKTOP-77FGJ18:24224] [17] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7f4669c990b3]
[DESKTOP-77FGJ18:24224] [18] cfdemSolverPiso(+0x2e62e)[0x55b523edb62e]
[DESKTOP-77FGJ18:24224] *** End of error message ***
--------------------------------------------------------------------------
mpirun noticed that process rank 0 with PID 0 on node DESKTOP-77FGJ18 exited on signal 8 (Floating point exception).
--------------------------------------------------------------------------

For a bit more context I am simulating a pressure driven suspension flow through a rectangular channel. I have successfully run a few similar simulations however for some reason after changing the channel geometry the below error has cropped up. If it will be helpful I can share the input files for this simulation tomorrow.

Thank you for any help you can provide!

Regards,

Russell

[RussellHolt]

UPDATE

After some digging through all my Boundary & initial conditions in both the DEM & CFD code I still haven't found any issues. I have run the simulation with the added line below in my "Allrun" file and the simulation does seem to run fine and give results that make sense (I still need to finalise my validation).

unset FOAM_SIGFPE

I'm a bit concerned about running simulations without acknowledging floating point errors, so I would still like to understand how to trace where the errors are originating in my original post. It looks to me as though the error is in the coupling when exchanging the information between the CFD and DEM in the very first step.

Regards,
Russell

[red4star]

Hi Russell

hope all is well

would you be so kind and share your input files of your pressure driven suspension flow through a rectangular channel simulation? I am new trying to couple CFD & DEM and I am not able to make it work.


Thanks


Red