CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > Software User Forums > FLOW-3D

Scalability of FLOW-3D

Register Blogs Community New Posts Updated Threads Search

Like Tree2Likes
  • 1 Post By flotus1
  • 1 Post By Habib-CFD

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
Old   July 15, 2020, 18:55
Default Scalability of FLOW-3D
  #1
New Member
 
toboto
Join Date: Jun 2016
Posts: 20
Rep Power: 10
toboto is on a distinguished road
Dear All,

Is there any benchmarks for the scalability of Flow3d v11.2 (NOT MP version) on clusters.

I am asking since I got very disappointing results myself. I tried identical model on two machines:
  • 1st (laptop) with Intel Core i7 8th Gen (4 cores - 8 threads) + 16 GB ram
  • 2nd (Workstation) with dual Intel Xeon E5-2690 V3 (24 cores - 48 threads) + 32 GB ram

I only gained about 10% acceleration with the workstation.

Is that normal with the non-MP version of Flow3d?

Is there any way to improve the performance on the workstation without the need to buy Flow3d/MP license?

Best regards
toboto is offline   Reply With Quote

Old   July 16, 2020, 10:02
Default
  #2
Member
 
nazrin
Join Date: Apr 2016
Posts: 35
Rep Power: 10
M.Nazrin is on a distinguished road
Hi Toboto,

For workstation, how many ram slot does the motherboard have and how many are populated with ram?
M.Nazrin is offline   Reply With Quote

Old   July 17, 2020, 15:40
Default
  #3
New Member
 
toboto
Join Date: Jun 2016
Posts: 20
Rep Power: 10
toboto is on a distinguished road
Quote:
Originally Posted by M.Nazrin View Post
Hi Toboto,

For workstation, how many ram slot does the motherboard have and how many are populated with ram?

There are 4 ram slots for each processor. So the workstation have 8 ram slots. Currently it has 4 slots (2 per processor) occupied with 4x 8 GB ram.
toboto is offline   Reply With Quote

Old   July 21, 2020, 05:25
Default
  #4
Super Moderator
 
flotus1's Avatar
 
Alex
Join Date: Jun 2012
Location: Germany
Posts: 3,428
Rep Power: 49
flotus1 has a spectacular aura aboutflotus1 has a spectacular aura about
I guess the non-MP version still runs in parallel, just with OpenMP instead of a hybrid OpenMP/MPI parallelization. So my advice will be based on that assumption.
In this case, you could first try to pin the simulation to one of the two CPUs. This will prevent high memory latency from from NUMA. How to do this depends on the operating system. "taskset" is commonly used in linux. And of course, only use 12 threads for this simulation. Additionally, disable hyperthreading in the bios, which is a good idea for CFD workstations anyway.
If this does not speed things up, you can try to play around with core binding options, to prevent the OS from shuffling around threads to different cores every few seconds. Contact support to check how it could be done.
If that still doesn't work, your case might just be too small to scale on many cores. Or so large that both machines run out of memory.
Edit: or some other bottleneck, like file I/O. Or your time measurement might include a lot of single-threaded setup time...
toboto likes this.

Last edited by flotus1; July 21, 2020 at 11:16.
flotus1 is offline   Reply With Quote

Old   July 22, 2020, 04:22
Default
  #5
Member
 
Join Date: Oct 2019
Posts: 65
Rep Power: 7
Habib-CFD is on a distinguished road
Flow 3D software in non-HPC version 11.2 is somehow optimized for 8 cores. The performance acceleration falls drastically after 8 cores even using single EPYC 7302P occupied by 8 channel memory.

This is off topic but for your information and comparison: I had a very nice experience using 2920x in 8 cores, frequency limited to 3.8 GHz, vcore 1.08v, 4x8gx3200MHz of RAM. The simulation time was about 15 percent slower than EPYC 7302p by 16 cores.

In my opinion, a new PC like an Intel 9800X light workstation will provide much more performance than paying for the HPC license in your old machine (with lower memory frequency) unless you plan for a large model.
toboto likes this.
Habib-CFD is offline   Reply With Quote

Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
mass flow in is not equal to mass flow out saii CFX 12 March 19, 2018 06:21
Different flow patterns in CFX and Fluent avi@lpsc FLUENT 4 April 8, 2012 07:12
Flow meter Design CD adapco Group Marketing Siemens 3 June 21, 2011 09:33
potential flow vs. Euler flow curious ... Main CFD Forum 23 July 21, 2006 08:40
Plug Flow Franck Main CFD Forum 3 September 4, 2003 06:57


All times are GMT -4. The time now is 07:38.