|
[Sponsors] |
March 1, 2010, 07:12 |
CFX and HPC
|
#1 |
Senior Member
George
Join Date: Mar 2009
Location: Birmingham, UK
Posts: 257
Rep Power: 18 |
Right,
Been looking on the performance of my machine at work and its.. well pretty crap. I've defraged the thing and cleared all clutter but I also get no effective change of speedup after using 6 cores. This is by using a Dell PowerEdge 2900 server using 8 cores (2 Intel quad core X3350 cpu’s - E5430 @ 2.66 GHz) with 25 GB RAM on an MS windows server 2003 R2 SP2 64 bit. I'm not an expert on cpu's so I'd appreciate if someone can write a possible explanation why old type cpu's are not working as efficient with cfx, whats different with the Nehalem microarchitecture and why cfx can utilize Nehalem cpu's better? Many thanks for your help
__________________
Top 4 tips 1. Knowledge is everything and Ignorance is dangerous. 2. Understand your limitations and try to eliminate them. 3. Get yerself a bike and hoon the chuffer. You will soon learn why dogs like to hang their heads out the car window. 4. Please before asking any questions on how to run simulations in CFX, go though all the tutorials |
|
March 1, 2010, 17:35 |
|
#2 |
Super Moderator
Glenn Horrocks
Join Date: Mar 2009
Location: Sydney, Australia
Posts: 17,870
Rep Power: 144 |
The Nehalem CPUs have a memory controller on the chip. This means the CPU communicates directly with the memory. In older style Intel chips the CPU goes through the Northbridge chip for all memory IO and that was a bottleneck, especially for larger numbers of cores. Lots of other improvements also but this is the biggest one.
http://en.wikipedia.org/wiki/Northbr...28computing%29 Disk fragmentation will make little difference to CFD benchmarks. The biggest thing for CFD is fast CPUs and disk speed makes little difference. |
|
March 1, 2010, 18:39 |
|
#3 |
Senior Member
George
Join Date: Mar 2009
Location: Birmingham, UK
Posts: 257
Rep Power: 18 |
edit of my previous post: should had mentioned it before but I'm running cfx local parallel on this machine hence the results. (the good thing about it is that I haven't specked the machine but should had picked the performance problem up much earlier ) oh well..
cheers glenn for the answer I have a few more if you dont mind, do amd chips suffer in a similar way? and does it make any difference speedwise if running windows server or linux apart that in windows you have a limit of 2GB on the results file? the last question is regarding the Nehalem cpu, in your experience should I be looking on a cluster setup or could I run cfx efficiently on a single server local parallel? cheers
__________________
Top 4 tips 1. Knowledge is everything and Ignorance is dangerous. 2. Understand your limitations and try to eliminate them. 3. Get yerself a bike and hoon the chuffer. You will soon learn why dogs like to hang their heads out the car window. 4. Please before asking any questions on how to run simulations in CFX, go though all the tutorials |
|
March 1, 2010, 20:30 |
|
#4 |
Super Moderator
Glenn Horrocks
Join Date: Mar 2009
Location: Sydney, Australia
Posts: 17,870
Rep Power: 144 |
I guessed you were running local parallel.
AMD has for living memory had the memory controller on the chip. AMD devices scale much better than the old style Intel chips, but about the same as the newer Nehalem chips. The problem with AMD is that the serial performance of their CPUs has not kept up with Intel recently. Intel has always been faster in serial, and now with the Nehalem architecture the multi-core disadvantage has gone. The Nehalem CPUs does change the equation a little for people on commercial licenses on CFX. It runs pretty well multi-processor so it is often now worth running small clusters with 4 or 8 cores per node. Note that 8 cores on a node may require a good network if you are clustering these machines. You might need to go to Infiniband networks, although you may be able to get away with 10GB ethernet - you would need to benchmark it as it would be borderline. |
|
March 1, 2010, 20:49 |
|
#5 |
Senior Member
George
Join Date: Mar 2009
Location: Birmingham, UK
Posts: 257
Rep Power: 18 |
there is no option to buy more cfx HPC lisences so I'm trying to spec someting near the entry level page 3 dell setup
http://www.ansys.com/corporate/partners/company/Dell_ANSYS_Spec1_R1.pdf with the nehalem I might try and lease one machine that I can run all 8 cores localy (if its cost effictive compared to a cluster setup) and if cfx will work properly.
__________________
Top 4 tips 1. Knowledge is everything and Ignorance is dangerous. 2. Understand your limitations and try to eliminate them. 3. Get yerself a bike and hoon the chuffer. You will soon learn why dogs like to hang their heads out the car window. 4. Please before asking any questions on how to run simulations in CFX, go though all the tutorials |
|
March 1, 2010, 20:53 |
|
#6 |
Super Moderator
Glenn Horrocks
Join Date: Mar 2009
Location: Sydney, Australia
Posts: 17,870
Rep Power: 144 |
I can't see that document... I think my web connection is dodgy at the moment.
You will loose some parallel performance at 8 cores local, but that is weighed against the fact that the alternative for 8 processes is to go distributed parallel and that requires more hardware, software, maintenance etc. Do the benchmarks to be sure, but local parallel is lots simpler and more reliable than distributed parallel so has a lot going for it. |
|
March 1, 2010, 20:56 |
|
#7 |
Senior Member
George
Join Date: Mar 2009
Location: Birmingham, UK
Posts: 257
Rep Power: 18 |
cheers mate, I owe ya some beer once I visit Sydney
ta
__________________
Top 4 tips 1. Knowledge is everything and Ignorance is dangerous. 2. Understand your limitations and try to eliminate them. 3. Get yerself a bike and hoon the chuffer. You will soon learn why dogs like to hang their heads out the car window. 4. Please before asking any questions on how to run simulations in CFX, go though all the tutorials |
|
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
CFX in Windows HPC 2008 | Srikanth | CFX | 5 | February 15, 2010 04:42 |