Parallel running needs more iterations?

zhernadi · March 26, 2011, 08:09

Dear OpenFOAM community,

I am testing parallel scalability on different machines and I found that sub-linear scaling may be caused by an increase of iterations.

In the attachments you can find my study based on 'cavity' case:
- iterations.png: Comparison of number of iterations: single/parallel
- iterations-case.zip: OpenFOAM 1.7.1 case (If you want to repeat my test, you will need gnuplot for plotting. Calculation should take less than 2 minutes.)

Questions:
1. Why does the solver need more iterations when solving a case in parallel?
2. Do you experience the same behavior in your CFD problems?
3. How can we change convergence criteria in order to have the same (or approx. same) number of iterations for the parallel run as we had for the single run?
4. Are there other possibilities to reduce this undesirable effect?

Thanks,
Zoltan

alberto · March 27, 2011, 05:19

Does "pIters" refer to the iterations on the pressure equation?

lohasz · March 27, 2011, 08:01

Yes "pIters" refers to the number of iterations on the pressure equation.

Máté (a colleague of Zoltán, this is the reason I know the answer as well)

arjun · March 27, 2011, 22:38

with assumption that program has no bugs related to parallel programing.

Questions:
1. Why does the solver need more iterations when solving a case in parallel?

It depends on your matrix solver for pressure correction equation. Some matrix solvers require more iterations in parallel mode.

2. Do you experience the same behavior in your CFD problems?

It is known problem.

3. How can we change convergence criteria in order to have the same (or approx. same) number of iterations for the parallel run as we had for the single run?

Again it all depends on what matrix solver you are using. In some cases , it is not possible to change this behaviour. You have to increase iterations in matrix solver.

4. Are there other possibilities to reduce this undesirable effect?

yes, www.columbia.edu/~ma2325/poly.ps

March 27, 2011, 05:19		#2
alberto Senior Member Alberto Passalacqua Join Date: Mar 2009 Location: Ames, Iowa, United States Posts: 1,912 Rep Power: 36	Does "pIters" refer to the iterations on the pressure equation? __________________ Alberto Passalacqua GeekoCFD - A free distribution based on openSUSE 64 bit with CFD tools, including OpenFOAM. Available as in both physical and virtual formats (current status: http://albertopassalacqua.com/?p=1541) OpenQBMM - An open-source implementation of quadrature-based moment methods. To obtain more accurate answers, please specify the version of OpenFOAM you are using.

March 27, 2011, 22:38		#4
arjun Senior Member Arjun Join Date: Mar 2009 Location: Nurenberg, Germany Posts: 1,290 Rep Power: 34	with assumption that program has no bugs related to parallel programing. Questions: 1. Why does the solver need more iterations when solving a case in parallel? It depends on your matrix solver for pressure correction equation. Some matrix solvers require more iterations in parallel mode. 2. Do you experience the same behavior in your CFD problems? It is known problem. 3. How can we change convergence criteria in order to have the same (or approx. same) number of iterations for the parallel run as we had for the single run? Again it all depends on what matrix solver you are using. In some cases , it is not possible to change this behaviour. You have to increase iterations in matrix solver. 4. Are there other possibilities to reduce this undesirable effect? yes, www.columbia.edu/~ma2325/poly.ps lakeat, akidess, miladrakhsha and 1 others like this.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Velocity blows up suddenly after 30,000+ iterations	lordvon	OpenFOAM Running, Solving & CFD	15	October 19, 2015 14:52
Moving mesh	Niklas Wikstrom (Wikstrom)	OpenFOAM Running, Solving & CFD	122	June 15, 2014 07:20
reactingFoam: adiabatic flame temperature	rFkhemek	OpenFOAM	2	July 31, 2009 07:42
IcoFoam parallel woes	msrinath80	OpenFOAM Running, Solving & CFD	9	July 22, 2007 03:58
Automatic Mesh Motion solver	michele	OpenFOAM Running, Solving & CFD	10	September 26, 2005 09:21

March 27, 2011, 08:01		#3
lohasz New Member Máté Márton LOHÁSZ Join Date: Jul 2010 Posts: 5 Rep Power: 16	Yes "pIters" refers to the number of iterations on the pressure equation. Máté (a colleague of Zoltán, this is the reason I know the answer as well)