CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > Software User Forums > OpenFOAM > OpenFOAM Running, Solving & CFD

First Step Parallel Simulation and HPC

Register Blogs Community New Posts Updated Threads Search

Like Tree1Likes
  • 1 Post By Svensen

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
Old   July 13, 2017, 17:32
Exclamation First Step Parallel Simulation and HPC
  #1
Senior Member
 
FlyBob91's Avatar
 
Join Date: Mar 2016
Location: Bergamo
Posts: 157
Rep Power: 10
FlyBob91 is on a distinguished road
Hello to all,
I'm moving my first steps in the world of parallel simulation and HPC. If i understood corectly, with parallel simulation i can divide my domain and let the single core of my CPU solve that part of domain assigned. So, if i had a quad core CPU, i could divide the domain in 4 part, and not more. Is it right?
I run the pitzDailyExptInlet case, with my own PC, in the normal and parallel way but i didn't notice a substantial difference of velocity. Is my sensation wrong?

Now a question for people who have already worked with HPC system.
It is the first time i work with HPC system and i'm not sure about the structure of the system. To submit a job i have to specify:
1- The number of node NN
2- The number of CPUs (ncpus) max 16 in my case
3 -The number of MPI tasks per node (mpiprocs)

I don't understand the meaning of 1 and 3.
Suppose to choose these numbers (1,16,1) for the three value, this means that i have to decompose my domain in 16 regions, is it right?

Last question: how does decomposePar work? Which criterion i should use to divide my domain? Which directions i should choose?


Thanks for help.
FlyBob91 is offline   Reply With Quote

Old   July 14, 2017, 05:17
Default
  #2
Senior Member
 
Join Date: Jan 2015
Posts: 150
Rep Power: 11
Svensen is on a distinguished road
Quote:
Originally Posted by FlyBob91 View Post
Hello to all,
Last question: how does decomposePar work? Which criterion i should use to divide my domain? Which directions i should choose?
decomposePar subdivides your computational domain on subdomains according to system/decomposeParDict.
I suggest you to use 'scotch' method, which will do subdivision automatically without any extra input data.

The number of subdomains in system/decomposeParDict could be arbitrary, but normally it is N or 2*N, where N is a total number of cores.

Also, in HPC system you don't need to specify all (1)-(3) parameters. You should know which management system runs on your HPC station. If it is SLURM, then you can type 'sbatch -n 16 icoFoam -parallel', for example, where '16' is a number of threads (it should be equal to a number of subdomains (system/decomposeParDict)).
FlyBob91 likes this.
Svensen is offline   Reply With Quote

Old   July 14, 2017, 09:29
Default
  #3
Senior Member
 
FlyBob91's Avatar
 
Join Date: Mar 2016
Location: Bergamo
Posts: 157
Rep Power: 10
FlyBob91 is on a distinguished road
Thank you Svensen, you clarified me some doubts.
To be precise my scheduling system is PBS.

Best Regards,
Roberto
FlyBob91 is offline   Reply With Quote

Old   July 14, 2017, 10:05
Default
  #4
Senior Member
 
Join Date: Jan 2015
Posts: 150
Rep Power: 11
Svensen is on a distinguished road
Normally for every HPC cluster there are some scripts, which used to submit a task for computing. The scripts generally are prepared by cluster administrators.
Svensen is offline   Reply With Quote

Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Error while running a Fluent Simulation in Hpc cluster averageindianjoe FLUENT 0 February 7, 2017 06:10
help to run CFX simulation via HPC, please happy CFX 19 February 28, 2016 18:18
Job submit code in HPC for Workbench beyonder1 CFX 0 January 6, 2016 12:18
Ansys HPC licensing policy assafwei ANSYS 0 June 29, 2014 17:00
massive parallel run messed up lustre file system matthias OpenFOAM 1 May 28, 2011 17:18


All times are GMT -4. The time now is 18:53.