CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > Software User Forums > OpenFOAM

scotch or ptscotch?

Register Blogs Community New Posts Updated Threads Search

Like Tree17Likes
  • 2 Post By cfdonline2mohsen
  • 1 Post By cfdonline2mohsen
  • 5 Post By wyldckat
  • 1 Post By cfdonline2mohsen
  • 2 Post By wyldckat
  • 4 Post By nsf
  • 2 Post By cfdonline2mohsen

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
Old   June 20, 2013, 11:24
Default scotch or ptscotch?
  #1
Senior Member
 
cfdonline2mohsen's Avatar
 
Mohsen KiaMansouri
Join Date: Jan 2010
Location: CFD Lab
Posts: 118
Rep Power: 16
cfdonline2mohsen is on a distinguished road
Dear All

After reviewing all the posts regarding decomposition methods in the forums, I realized that: (Please Correct me if I'm wrong)

1. Metis method has some restrictions about licensing problems.
2. scotch encounters some problems with snappyHexMesh, so ptscotch must be used at first for decomposition and after that scotch must be used for running the case.

I did not generate my mesh with snappyHexMesh (Fluent2Foam) so either scotch or ptscotch can be used. Here are my questions:

1. which Method (scotch or ptscotch) is better from the viewpoint of accuracy and speed? Please share your experiences about this 2 methods in here.
2. How much my running time will be shortened using either of these 2 methods in comparison with Simple decomposition method? Please Share your experience?
3. I don't know the differences between scotch and ptscotch methods so can anybody introduce some fundamental references about these methods (Thesis, books or papers)?

Thanks in Advance
ScarFace and Makkus like this.
__________________
“If you have an apple and I have an apple and we exchange these apples then you and I will still each have one apple. But if you have an idea and I have an idea and we exchange these ideas, then each of us will have two ideas.”
cfdonline2mohsen is offline   Reply With Quote

Old   June 26, 2013, 06:24
Default
  #2
Senior Member
 
cfdonline2mohsen's Avatar
 
Mohsen KiaMansouri
Join Date: Jan 2010
Location: CFD Lab
Posts: 118
Rep Power: 16
cfdonline2mohsen is on a distinguished road
Please Some body help!
ScarFace likes this.
__________________
“If you have an apple and I have an apple and we exchange these apples then you and I will still each have one apple. But if you have an idea and I have an idea and we exchange these ideas, then each of us will have two ideas.”
cfdonline2mohsen is offline   Reply With Quote

Old   June 30, 2013, 09:02
Default
  #3
Retired Super Moderator
 
Bruno Santos
Join Date: Mar 2009
Location: Lisbon, Portugal
Posts: 10,981
Blog Entries: 45
Rep Power: 128
wyldckat is a name known to allwyldckat is a name known to allwyldckat is a name known to allwyldckat is a name known to allwyldckat is a name known to allwyldckat is a name known to all
Greetings Kia,

I've got the feeling that you did very little research into this forum on this topic.

In a nutshell:
  • "scotch" is used in serial/sequential mode.
  • "ptscotch" can only be used in parallel, namely when the domain is already decomposed.
As of OpenFOAM 2.2, the two decomposition algorithms share the same name in the "decomposeParDict", i.e. they both are called "scotch". Which one is used depends on whether the application is executed in parallel or serial/sequential mode.


Many have shared their experience with "simple", "hierarchical", "metis" and "scotch" here on the forum. Feel free to search for the information

But again, in a nutshell:
  • Use the simpler algorithms for when you have a simpler mesh.
  • Use the complex algorithms when you have a complex mesh.
Best regards,
Bruno
__________________
wyldckat is offline   Reply With Quote

Old   June 30, 2013, 11:21
Default
  #4
Senior Member
 
cfdonline2mohsen's Avatar
 
Mohsen KiaMansouri
Join Date: Jan 2010
Location: CFD Lab
Posts: 118
Rep Power: 16
cfdonline2mohsen is on a distinguished road
Thanks Bruno,
I used the scotch method but neither my run time nor the results did not change significantly in comparison with the simple method. (for the flow around a cube)
but for more complex geometries (film cooling of turbine blades) our run time reduced to 1/3 using scotch method. isn't that strange?
ScarFace likes this.
__________________
“If you have an apple and I have an apple and we exchange these apples then you and I will still each have one apple. But if you have an idea and I have an idea and we exchange these ideas, then each of us will have two ideas.”
cfdonline2mohsen is offline   Reply With Quote

Old   June 30, 2013, 18:47
Default
  #5
Retired Super Moderator
 
Bruno Santos
Join Date: Mar 2009
Location: Lisbon, Portugal
Posts: 10,981
Blog Entries: 45
Rep Power: 128
wyldckat is a name known to allwyldckat is a name known to allwyldckat is a name known to allwyldckat is a name known to allwyldckat is a name known to allwyldckat is a name known to all
Like I said: simple meshes only need simple algorithms. Complex meshes, need complex algorithms. Scotch is a complex algorithm.

And since you didn't specify the number of cells on your meshes, nor the number of sub-domains (aka number of cores) in those cases, my guess is that: no, it's not strange, not strange at all.
cfdonline2mohsen and ScarFace like this.
__________________
wyldckat is offline   Reply With Quote

Old   July 1, 2013, 15:23
Default I prefer scotch over metis
  #6
nsf
Senior Member
 
Nicolas Edh
Join Date: Mar 2010
Location: Uppsala, Sweden
Posts: 123
Rep Power: 18
nsf is on a distinguished road
Hi,

This might be covered better in other parts of the forum. In my experience metis might yield really bad decompositions. At work we saw a drastic decrease in performance with metis (using fluent) on more than 64 domains. When we changed the decomposition method we saw good speed up until 224 domains so it was not due to too small case. Since then we stopped using metis so I have no more experience of it.

I've seen others having problems with metis and OpenFOAM though, there is an article on this here
http://link.springer.com/chapter/10....642-24669-2_12. (I'm not affiliated with any of the authors).

Their main conclusion is not that metis is to be blamed but they did notice that the domains was not continuous on some processors. I.e. one processor was handling two separate domains.

If you know of an extensive study the please let me know.
Best
Nicolas
nsf is offline   Reply With Quote

Old   July 3, 2013, 14:17
Smile
  #7
Senior Member
 
cfdonline2mohsen's Avatar
 
Mohsen KiaMansouri
Join Date: Jan 2010
Location: CFD Lab
Posts: 118
Rep Power: 16
cfdonline2mohsen is on a distinguished road
Thanks Nicolas for sharing your experiences and also for introducing the article.
nsf and ScarFace like this.
__________________
“If you have an apple and I have an apple and we exchange these apples then you and I will still each have one apple. But if you have an idea and I have an idea and we exchange these ideas, then each of us will have two ideas.”
cfdonline2mohsen is offline   Reply With Quote

Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
[snappyHexMesh] scotch error on motorbike on 16p dkokron OpenFOAM Meshing & Mesh Conversion 1 December 27, 2012 07:01
interFoam & decomposition method: scotch MacGyver OpenFOAM Running, Solving & CFD 2 May 23, 2012 08:00
decomposePar with scotch exits with : ERROR: graphCheck: duplicate arc ancsa OpenFOAM 3 July 11, 2011 06:02
Problem with Scotch in 1.7.x? dancfd OpenFOAM Running, Solving & CFD 0 June 15, 2011 22:52
Error by compiling scotch for OpenFOAM-1.6-ext Vitus OpenFOAM 1 November 29, 2010 13:28


All times are GMT -4. The time now is 03:17.