|
[Sponsors] |
Pre- and Post workstation - need inputs |
|
LinkBack | Thread Tools | Search this Thread | Display Modes |
January 5, 2013, 08:27 |
Pre- and Post workstation - need inputs
|
#1 |
New Member
Martin Larsen
Join Date: Nov 2012
Location: Middelfart, Denmark
Posts: 9
Rep Power: 14 |
Hi all
I am searching for inputs on how to build a strong workstation for Pre and Post-processing. Below is described the software/hardware used, how I work and what I work on and lastly what hardware I have been considering. All the solving is going to be running on a small 32 core cluster (Bought at the same time as this workstation). Software is ANSYS and SpaceClaim. More specifically I clean-up the CAD's in SpaceClaim (imported from Solid works), import it to workbench, Mesh using ANSYS Meshing, setup the simulation in CFX-Pre, solve using the ANSYS Solver Manager (on cluster) and Post process using CFD-Post. The cases as far as i know are located locally on the workstation when Pre-and Post-processing. The hardware I use currently is primarily a HP Probook 6360b laptop, i5 2520, 16Gb of memory, on-board graphics, 120 Gb SSD, and my simulations are running(solved) on an old HP Z600 with two Xeons E5520, 12 GB of memory, a ATI FirePro V7750 (FireGL) and one 2 TB SATA hard drive. As the laptop is faster for Pre and post, I use that most of the time. The cases I run is multiphase simulations of Diesel after treatment systems where focus at the moment is on optimisation of the Adblue injection upstream of the SCR catalyst. This includes multiple phases, water evaporation, chemical reactions and off course particle tracking. Due to the complex CAD geometries I use tet cells for all the complex parts. Else I try to have as much quad-mesh as possible. Mesh counts on the cases i run at the moment are in the range of 3-9 mio cells. I often find myself sitting and waiting for the computer to finish loading, meshing, Post processing which is quite irritating. To put numbers on, loading a typical CAD from SpaceClaim to ANSYS Meshing takes 1-4 min, Meshing takes from 5-60 mins, loading a already processed file in CFD-Post takes 3-15 mins. It all adds up and it slows my work down, I try to switch between several tasks/assignments to utilise my waiting time as good as possible and that is not ideal. In general it is the waiting time and the bad graphical performance that bothers me the most. As a side note, I am currently limited to smaller cases and lower mesh counts due to the hardware i currently work on. As soon as the cluster and my new workstation is up and running, case sizes can be expected to increase somewhat. At the moment I am limited to HP as the supplier, as that is what our company uses. I have a meeting with out IT department in the middle of January, to discuss or tell them what I want. Budget: Need as much Bang-for-the-buck This is what I have been looking at until now: CPU: Xeon E3-1290v2, Quad core, 3.7 Ghz (turbo speed up to 4.1) or an i7-3770, Quad core, 3.4 Ghz (up to 3.9)
MEMORY: 32 Gb (or maybe even 64) of memory
GRAPHICS: AMD FirePro v5900 2Gb
HARD DRIVES: 1x128 Gb HP SSD for software install, and 2x256 HP SSD in RAID1 for working directory.
I really need some inputs here, all suggestions and your personal experiences are more that welcome. I am quite new in the industry (finished my masters this summer), so all constructive comments are welcome. I am especially interested in the choosing of the hard drives: Are SSDs the way to go or is SAS 10k or 15k drivers better, would another raid solution be better bang-for-the-buck (RAID5/10) ? Thank you very much in advance. Feel free to link to other posts/forum discussion which might have interest. Last edited by larsenmm; January 5, 2013 at 09:43. |
|
January 5, 2013, 19:37 |
|
#2 |
Senior Member
Join Date: Oct 2009
Location: Germany
Posts: 636
Rep Power: 22 |
HDD:
I think most of the loading times is not the "reading from HDD" but more processing of the loaded data in the current session. I'm having a 10k rpm SAS HDD in my workstation and never had HDD related issues with loading times (in STAR-CCM+). This HDD is fast enough to read even big files with let's say up to 15Gb in 1.5 minutes, so I'm not sure if it's worth to spend the money for a SSD - especially when you're running a RAID 1. Just a side note, even the HDD in my private PC, which is a 7200 rpm SATA WD black series, needs less than 3 minutes to load a file of up to 4GB. It reads more than 90 MB/s which is ~5.4GB / min. The performance NEVER dropped so low that it would take just 3 minutes to load a 4GB file. Please note, a RAID 1 will increase only read performance. Write performance will be as good as a single disk. When there's another backup solution available at your company, I would not go for a RAID 1. Just buy a single disk then, that should be enough. I had no sudden disk failure so far since I've used my first PC 20 years ago. CPU: Right. Single core performance will be the most important point. Nothing to add here. Memory: When money is an issue, get non-ECC RAM since it's cheaper. Maybe you can get a faster CPU instead... Graphics: I don't have any experience with Ansys products and graphics performance is pretty much related to the software. So I'm sorry, I can't give any advice here. And please don't forget, it's CFD. You're handling more or less big models. That takes some time, and sometimes you have to wait. Even with a fast CPU, you won't be able to shortcut the meshing time from 60 min to 10 min. So be patient and try to use your time as efficient as possible - there will be no miracle even with a new machine...
__________________
We do three types of jobs here: GOOD, FAST AND CHEAP You may choose any two! |
|
January 6, 2013, 08:53 |
|
#3 | |||||
New Member
Martin Larsen
Join Date: Nov 2012
Location: Middelfart, Denmark
Posts: 9
Rep Power: 14 |
Quote:
Quote:
Quote:
Quote:
Quote:
|
||||||
January 6, 2013, 16:40 |
|
#4 | ||||
Senior Member
|
Quote:
Quote:
Since you're not footing the bill, just get the biggest one you can. However, the reasons you list are invalid. The paging file is only "needed" if you plan on experiencing very frequent system crashes as the memory contents gets dumped there. The first thing I do after installing Windows is to disable the hybernation (and that deletes the huge hybernation file from C:\ root) and decrease the page file size to 64-128 mb. Otherwise nearly 40 gb are gone from the SSD right after installing Windows (and I have 32 gb of RAM). My OS disk is a 128 gb OCZ Vertex4 and even with EVERYTHING installed (Windows, Office, Workbench 14.5, Corel Technical, full Acrobat and Photoshop, Mathcad, Tecplot, SolidWorks, Rhinoceros and other small miscellaneous programs) there is still 66 gb of free space (119 gb recognized size of the SSD), so it's about 45 % full. Plenty of space left to keep the "work in progress" working directories on the SSD, too. I move them to a 7200 rpm disk once everything is done. Quote:
Quote:
P.S. Nice to see someone who understands quoting and uses it. It's a nice change from the norm. :P |
|||||
January 8, 2013, 02:09 |
|
#5 | ||
New Member
Martin Larsen
Join Date: Nov 2012
Location: Middelfart, Denmark
Posts: 9
Rep Power: 14 |
scipy: Thank you for your reply, very informative.
Your points about the SSD and memory sounds as they make good sense, so I will try to follow those. Do you (or anyone else) have any inputs regarding SSD's and raid (0, 1 or 10).
Quote:
Quote:
And thanks all in advance for your inputs Last edited by larsenmm; January 22, 2013 at 02:08. Reason: misspellings |
|||
January 8, 2013, 03:47 |
|
#6 | |
Senior Member
|
TRIM will not work in RAID for SSDs.
Quote:
In any case, most of the ANSYS software compresses the case and data files within Workbench by default (via gzip or 7zip), so the bottleneck for reads/writes is not the hard drive anyway (it hasn't been even on SATA 2 SSDs). |
||
January 16, 2013, 02:20 |
|
#7 | ||
New Member
Martin Larsen
Join Date: Nov 2012
Location: Middelfart, Denmark
Posts: 9
Rep Power: 14 |
Quote:
Instead of two SSD's in raid what would be alternative ? Could one install a regular HDD or SSD (on non-raid config) which then mirrors the primary SSD once in a while. Like once a day or maybe twice depending how much load that would be put on the workstation and if it would slow down my work. This would be setup using some kind of software is my guess. Anyone ? Quote:
|
|||
January 16, 2013, 09:14 |
|
#8 |
Senior Member
Robert
Join Date: Jun 2010
Posts: 117
Rep Power: 17 |
One interesting thing about SSDs is that they have a life (as opposed to a MTBF). As the devices are becoming denser/smaller sized it is dropping. The article below discusses the issue for an Intel drive.
http://www.anandtech.com/show/6462/i...on-the-ssd-335 While the life is very high for normal usage, the big files and potentially frequent writes in analysis usage may cause them to wear out relatively rapidly. |
|
January 16, 2013, 15:15 |
|
#9 |
Senior Member
|
These concerns were mostly aimed at SSD usage in data centers with REALLY high frequency of writes to the drive. The data industry as such pressured the SSD makers to make drives that would survive for 5 years in such operating conditions - and this is why I recommended a synchronous (not asynchronous) MLC NAND SSDs. The mentioned Vertex 4 (and/or Corsair's Force GT and Intel's 520 series of drives) comes with 5 years warranty just to soothe concerns from users like yourself, who were worried about life expectancy of a SSD.
So, with CFD usage, even if it was fully transient running 100 % of the time, saving .cas and .dat files every few iterations, these SSDs should not lose any noticable amount of data storage/space on them nor performance. In other words, don't worry. In less than 5 years these are going to be as outdate as SATA-150 drives are today and we will all move to SATA5 and unbelivable transfer speeds, before your current SSD dies of repeated read-writes. |
|
January 16, 2013, 17:38 |
|
#10 | |
New Member
Frederik
Join Date: Apr 2010
Posts: 18
Rep Power: 16 |
Quote:
|
||
January 18, 2013, 17:53 |
|
#11 | |
Senior Member
Join Date: Oct 2009
Location: Germany
Posts: 636
Rep Power: 22 |
Quote:
For most simulations run out there in the wilderness of the CFD-world, disk write speed is not the issue slowing down the simulations. When I run a case on my desktop at home and I save a 1Gb sim-file file every 500 iterations, it would take less than 10 seconds with my HDD and maybe 4 seconds with a SSD. This would occur once every 8 hours. So I save a horrible amount of time, right? Since it would take only 7:59:54 instead of taking 8:00:00. Sure, it would become more important when the frequency of writing data to the hard disk increases, but I'm a consultant running CFD simulations since several years, for all kind of industries - and disk speed was NEVER an issue although I've never in my life used a SSD. So as a conclusion, I would say: SSD's make sense for the system disk, since program startup will be accelerated a lot (less than 10 seconds, since this is how much it takes with my HDD). Once a day, before I start the simulation. And people having too much money also might use them for the main data storage (although they could also transfer the excess money to me, I'll appreciate it ). But having a SAS HDD, or for a home workstation even a fast SATA HDD, should be more than sufficient. Up to you what you choose, I'll spend the money to get more beer for applied fluid dynamics
__________________
We do three types of jobs here: GOOD, FAST AND CHEAP You may choose any two! |
||
January 22, 2013, 02:14 |
|
#12 | |
New Member
Martin Larsen
Join Date: Nov 2012
Location: Middelfart, Denmark
Posts: 9
Rep Power: 14 |
Quote:
Kind regards Martin |
||
February 6, 2013, 10:36 |
|
#13 |
Member
Kim Bindesbøll Andersen
Join Date: Oct 2010
Location: Aalborg, Denmark
Posts: 39
Rep Power: 16 |
My system (used for SpaceClaim, ANSYS CFX Pre, Post and Solver):
Dell T5500, Xeon 5687 3.6 GHz (quad-core), 24 GB 1333 MHz non-ECE Ram, 2 x 250 GB SSD, ATI FirePro V7900. Meshing: I have tried nVidia QuadroPro 2000 graphics card with meshing and wanted something faster, as rotating and similar could be with several seconds of delay, when showing a very fine mesh. However, I think that my present FirePro V7900 is not that much better in this regard, even though it should be much faster. So I think that graphic issues might depend more on the processor and RAM speed as the graphics card does not seem to do it all. Meshing of 6 mio. cells takes 3-5 min. Meshing is not that good to utilise multiple cores. Only two cores show more than 50% load when meshing. So I think that bandwith between CPU and RAM is limiting. CFX Pre: Loading a single phase, multi species, 11 mio. cells case takes 5-10 min. CPU loading is low during loading, so I would guess that it is SSD bandwidth limited. My recommendations: Go for high single core performance as multiple cores are not utilised efficiently. Go for high memory bandwidth. Go for SSD. Dont dont spend all the money on graphics card. Best regards Kim |
|
February 6, 2013, 12:30 |
|
#14 | ||||
New Member
Martin Larsen
Join Date: Nov 2012
Location: Middelfart, Denmark
Posts: 9
Rep Power: 14 |
Quote:
Quote:
Regarding cells, we are talking number of cells not nodes, correct ? That would make a huge difference, and I was told to use the number of nodes if I was comparing with Fluent or AVL Fire as there is a difference in the solvers. As far as I remember, CFX is a node based solver, where Fluent and AVL Fire are cell centered. Quote:
Quote:
The workstation is a HP Z220. - HP Core i7-3770 3.4GHz 4C (highest clocked i7 available, Turboboost to 3.9Ghz) - HP 32GB DDR3-1600 (4x8GB) nECC (maximum amount possible, 2 memory channels, 2 sockets per channel. Is this a major issue, if I am not running simulations myself ?) - HP 256GB SATA 1st SSD (main OS disk, programs, user files) - HP 256GB SATA 2nd SSD (Raid 1, disk 1, project files for running project, Raid 1 and 0 officially supported by HP) - HP 256GB SATA 3rd SSD (Raid 1, disk 2, project files for running project, Raid 1 and 0 officially supported by HP) - HP AMD FirePro V5900 2GB Graphics - HP Z220 CMT 400W 90% Efficient - HP 3y 4h 13x5 Onsite Only HW (so i can blame HP if something does not work) Some of my colleges have bought their own consumer hardware, and assembled a workstation from that. This can be done for maybe half the price as a HP Workstation, but with the amount of errors/problems seen on consumer SSDs, too hot CPU's and the like, getting the responsibility off my back is relatively important. I do not mind working with hardware, but If I am on a strict deadline at work, I would rather do my work than trying to fix my computer! Please again feel free to comment, the workstation have not been purchased yet but hopefully will be within a short time. Thanks in advance Best regards Martin Last edited by larsenmm; February 6, 2013 at 12:49. Reason: Realised that the Z220 only support dual channel memory and not 4 channels as the Z420! |
|||||
February 12, 2013, 09:46 |
|
#15 | ||||
Member
Kim Bindesbøll Andersen
Join Date: Oct 2010
Location: Aalborg, Denmark
Posts: 39
Rep Power: 16 |
Quote:
Quote:
My point is that what-ever graphics card you choose, Meshing graphics can still be heavy, as (apparently) it does not all depend on the graphics card. However, I dont experience it as a big problem. Only when showing large dimensions of a fine mesh, and rotating or similar. Nothing that obstructs my work at all. Quote:
Quote:
Best regards Kim Bindesbøll |
|||||
February 12, 2013, 10:49 |
|
#16 |
Senior Member
Joern Beilke
Join Date: Mar 2009
Location: Dresden
Posts: 540
Rep Power: 20 |
Memory bandwidth becomes important when you use more than one core. For pre and post it should not matter.
The i7 can use faster memory than the Xeons. |
|
February 12, 2013, 11:28 |
|
#17 | |
New Member
Martin Larsen
Join Date: Nov 2012
Location: Middelfart, Denmark
Posts: 9
Rep Power: 14 |
Thanks for your replies bindesboll and JBeilke
Quote:
bindesboll, you say critical but critical for what work exactly? I agree to your statement when we are talking about running the actual solving on the specific workstation. But is it also critical for Post/Pre work ? The reason why I am so interested in this, is that i need to go from a HP Z220 to a Z420 to get 4 channel memory, and i need to get an idea of the performance gain compared to the extra cost... |
||
February 13, 2013, 05:16 |
|
#18 |
Member
Kim Bindesbøll Andersen
Join Date: Oct 2010
Location: Aalborg, Denmark
Posts: 39
Rep Power: 16 |
I was wrong regarding Pre and Post being memory bandwidth critical. I agree with JBeilke, that most Pre and Post operations are not multi-core heavy to that high degree. I guess operations are typically disc speed or single-core-performance critical instead.
|
|
Tags |
hardware, post procesing, pre-processing, ssd |
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
different CFX Pre and Post mesh region | mactech001 | CFX | 9 | April 11, 2010 22:08 |
Objects in PRE and POST ? | Felix | CFX | 0 | January 16, 2008 16:53 |
clarification in LS Pre post | David | Main CFD Forum | 0 | July 19, 2007 14:02 |
Instable Post, Pre and Build | Pascale Fonteijn | CFX | 5 | December 23, 2003 07:31 |
PRE and POST processing package | Astrid Barros | Main CFD Forum | 6 | November 16, 2000 11:31 |