CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > Software User Forums > OpenFOAM > OpenFOAM Pre-Processing

Threaded decomposepar

Register Blogs Community New Posts Updated Threads Search

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
Old   October 8, 2021, 14:31
Default Threaded decomposepar
  #1
Member
 
Join Date: May 2017
Posts: 31
Rep Power: 9
sqek is on a distinguished road
Hello all,
I've got a case that's large enough that running decomposePar takes quite some time (millions of cells, hundreds of processors), which is getting inconvenient.
Especially as I'd like to try different hierarchical settings to find something optimal (I'm using sprayfoam, so there's lagrangian fields that I'm trying to split nicely as well as the normal mesh)

Is there a way to run decomposePar itself run faster by running in parallel, or using multiple threads?

I'm thinking I could, for example, do the first level of decomposition, then run decomposePar with a different decomposePardict in a different thread in each processor directory
( so something like, in bash:
Code:
decomposePar -dict system/decomposeParDict1
for i in processor*; do
    pushd "$i"
    ln -s ../system .
    decomposePar -dict system/decomposeParDict2 &
    popd
done
But I'm not sure if it would then be possible to move the sub-processor directories around to make a single decomposed case.
Also that would stop me using the collated file handler, which I'd quite like to use as my case is unsteady and produces enough timestep files that, when multiplied by a large number of processor directories, reaches the limit on the supercomputer I have access to's filesystem quite quickly.

I'm using OpenFOAM-8

Grateful for any suggestions! (Or any tricks for decomposing faster that I've missed)
sqek is offline   Reply With Quote

Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Problem with decomposePar (and mapFields) for large problem quarkz OpenFOAM Pre-Processing 2 February 21, 2019 10:51
decomposePar error chia87 OpenFOAM Pre-Processing 1 May 28, 2017 16:23
decomposePar for custom solvers and boundary conditions cfdopenfoam OpenFOAM Programming & Development 4 October 31, 2015 10:05
decomposePar 4-core warning/error? Boloar OpenFOAM Bugs 23 April 8, 2014 09:57
decomposePar gives errors of_user_ OpenFOAM 1 July 4, 2011 06:27


All times are GMT -4. The time now is 01:16.