|
[Sponsors] |
![]() |
![]() |
#1 |
New Member
Owen Jones
Join Date: Aug 2017
Location: Martinique
Posts: 2
Rep Power: 0 ![]() |
I'm currently working on a 3D overset-grid hydrodynamic simulation with overInterDyMFoam from OpenFOAM v1706. I have the mesh set up, and the simulation runs, but I'm having problems figuring out a 'recipe' for parallel decomposition.
Each time I try a different decomposition method/number of processes, the stability and speed of the calculation seem to change pretty much at random. I've found a 12-processor hierarchical decomposition which runs reasonably well, but I'd really like to use more of the computational resources at my disposal (up to 64 cores per node with 2 nodes available)!. I tried a Scotch decomposition into 24 processes, which also seemed to start running well enough, but the overset analysis/mesh.update() stage took a painfully long time (well over 200 s, as opposed to 93 s with the 12-process hierarchical decomposition). A 16-process hierarchical decomposition was catastrophically unstable, and various other combinations have either been too unstable or run too slowly. Are there any rules of thumb for effective decomposition of overset cases? |
|
![]() |
![]() |
![]() |
![]() |
#2 |
Senior Member
Yann
Join Date: Apr 2012
Location: France
Posts: 1,169
Rep Power: 27 ![]() |
Have you tried a scotch decomposition on 12 processors?
You can't compare a 12 processors hierarchical decomposition with a 24 proc scotch one because you have no idea if the speedup/slowdown is due to the decomposition method or something related to your hardware. |
|
![]() |
![]() |
![]() |
![]() |
#3 |
New Member
Hussam
Join Date: Feb 2022
Posts: 4
Rep Power: 4 ![]() |
Scotch is often not recommended in overset mesh. I'd recommend heirechal
|
|
![]() |
![]() |
![]() |
Tags |
decomposepar, multiphase flow, overset mesh, parallel calculation |
|
|
![]() |
||||
Thread | Thread Starter | Forum | Replies | Last Post |
decomposition of multi domain cases for large simulations | romant | OpenFOAM Pre-Processing | 6 | May 10, 2023 21:27 |
potential flows, helmholtz decomposition and other stuffs | pigna | Main CFD Forum | 1 | October 26, 2017 08:34 |
bubbleFoam - Simple case, Large bubble, closed domain | darai | OpenFOAM Running, Solving & CFD | 9 | October 12, 2015 05:40 |
injection problem | Mark New | FLUENT | 0 | August 4, 2013 01:30 |
how to get rid of skipping thread 5 of domain field-1 (not referenced by grid) | smkhan | FLUENT | 0 | November 16, 2009 04:20 |