ANSYS13 on a cluster

guido.bonalumi · October 27, 2014, 06:28

Hi everyone,
I need to run some simulations with ANSYS13, but I am worried about my computational power. I am considering the idea of creating a cluster with all my computers, but I need your opinion.
I have 3 PCs and these are their specs:
1) CPU: Intel® Core™ i5 CPU 750 @ 2.67GHz × 4
RAM: 4x2GB DDR3, 1333 MHz
OS: Ubuntu 12.04 LTS 64 bit

2) CPU: Intel® Core™ 2 Duo CPU E8200 @ 2.66GHz × 2
RAM: 2x2GB DDR1 (not sure), 800 MHz
OS: Debian 7.6 wheezy 64 bit

3) CPU: Intel® Core™ 2 Duo CPU T7300 @ 2.00GHz × 2
RAM: 2x2GB DDR2 (not sure), 667 MHz
OS: Ubuntu 12.04 LTS 64 bit

The 3 PCs are connected to my home network through a 100Mbit router (I am considering the upgrade with a 1Gbit router), PCs number 1 and 2 connected by ethernet, PC number 3 using wi-fi (but I can connect even this by ethernet if necessary). The 3 PCs share through NFS a folder with all my works, the folder is located on PC number 2, which I use as a server.
At the moment ANSYS13 is installed only on PCs number 1 and 3, but, if necessary, I can install it even on PC number 2.

Do you think is possible to create a cluster with these 3 machines? And more important, do you think is worthed?

ghost82 · October 28, 2014, 14:08

This could be usefull to setup the cluster:
http://www.cfd-online.com/Forums/sho...d.php?p=505595

I suggest to use only ethernet.
The 3 pcs are not too much different: it should take not so much time to setup the cluster, you can try and see performances.
As you may know the most important difference is ram frequency..the pc with 1333 MHz compared to 667 MHz will probably slow down..

Daniele

guido.bonalumi · October 29, 2014, 05:42

Grazie per la risposta Daniele!

Is this configuration specific for ANSYS? I am using OpenFOAM and I was thinking to improve the same solution.

ghost82 · October 29, 2014, 05:46

Yes, this is specific to have a cluster of 2 nodes to run ansys fluent.
Little modifications are needed to add more than 2 nodes (+switch, straight cables, etc).
I never used openfoam, so I don't know how the setup for a cluster is, maybe it's similar.

guido.bonalumi · October 29, 2014, 06:50

I have a question...
As I wrote previously, PC number 1 and 2 already share a folder through NFS. The fact is that the folder is located on PC number 2, but ANSYS in installed on PC number 1. Do you think this could be a problem? I think not because both the PCs have access to the same file, but I am not so expert.

ghost82 · October 29, 2014, 06:56

I always installed ansys on every pc in the cluster and share only the working dir, but I know it is possible to install it on a single pc and share the folder through nfs.
I think it could be something like:
ansys in stalled on pc 1 in /usr/ansys_inc/.....
Share the /usr/ansys_inc folder and mount on pc 2 in /usr/ansys_inc/

Same for the working directory:
share /home/user/Desktop/working_dir created on pc 1
mount on pc 2 in /home/user/Desktop/working_dir

I think absolute paths are important and should be the same on every pc in the cluster.

Also user/password for login must be the same.

guido.bonalumi · October 29, 2014, 07:23

Sorry I explained myself wrong, but you suggested me something clever!
What I was asking is this: is it a problem if the folder shared by NFS is located on PC number 2 while I run ANSYS from PC number 1?
For semplicity I will install ANSYS on both machines but I already have the NFS connection between the 2 pc and I would like to keep it as it is.
I do not think it should be a problem, what matter is that the 2 PCs have both access at the simulation's files and they have it.

ghost82 · October 29, 2014, 07:39

Ok, I understand; I think that shouldn't be a problem, but I'm not 100% sure.

guido.bonalumi · October 29, 2014, 07:46

Anyway I have a doubt about your solution regarding the installation of ANSYS only on one PC. I understand that sharing the installation folder you do not need to install ANSYS on the second PC but the license is specific for the mainboard of the PC where ANSYS is installed. For what I know this is done through the FLEXID number.
How do you solve this problem?

ghost82 · October 29, 2014, 08:42

If you want to run on 8 cores you need 1 hpc license and you have to setup a license server.

October 27, 2014, 06:28	ANSYS13 on a cluster	#1
guido.bonalumi New Member Guido Bonalumi Join Date: Dec 2013 Posts: 16 Rep Power: 13	Hi everyone, I need to run some simulations with ANSYS13, but I am worried about my computational power. I am considering the idea of creating a cluster with all my computers, but I need your opinion. I have 3 PCs and these are their specs: 1) CPU: Intel® Core™ i5 CPU 750 @ 2.67GHz × 4 RAM: 4x2GB DDR3, 1333 MHz OS: Ubuntu 12.04 LTS 64 bit 2) CPU: Intel® Core™ 2 Duo CPU E8200 @ 2.66GHz × 2 RAM: 2x2GB DDR1 (not sure), 800 MHz OS: Debian 7.6 wheezy 64 bit 3) CPU: Intel® Core™ 2 Duo CPU T7300 @ 2.00GHz × 2 RAM: 2x2GB DDR2 (not sure), 667 MHz OS: Ubuntu 12.04 LTS 64 bit The 3 PCs are connected to my home network through a 100Mbit router (I am considering the upgrade with a 1Gbit router), PCs number 1 and 2 connected by ethernet, PC number 3 using wi-fi (but I can connect even this by ethernet if necessary). The 3 PCs share through NFS a folder with all my works, the folder is located on PC number 2, which I use as a server. At the moment ANSYS13 is installed only on PCs number 1 and 3, but, if necessary, I can install it even on PC number 2. Do you think is possible to create a cluster with these 3 machines? And more important, do you think is worthed?

October 28, 2014, 14:08		#2
ghost82 Senior Member Rick Join Date: Oct 2010 Posts: 1,016 Rep Power: 27	This could be usefull to setup the cluster: http://www.cfd-online.com/Forums/sho...d.php?p=505595 I suggest to use only ethernet. The 3 pcs are not too much different: it should take not so much time to setup the cluster, you can try and see performances. As you may know the most important difference is ram frequency..the pc with 1333 MHz compared to 667 MHz will probably slow down.. Daniele __________________ Google is your friend and the same for the search button!

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
[OpenFOAM.org] OpenFOAM Cluster Setup for Beginners	Ruli	OpenFOAM Installation	7	July 22, 2016 05:14
Improper data to cluster through .cas and .dat files	kaeran	FLUENT	0	October 24, 2014 05:10
OF211 with mvapich2 on redhat cluster, error when using more than 64 cores?	ripperjack	OpenFOAM Installation	4	August 30, 2014 04:47
Why not install cluster by connecting workstations together for CFD application?	Anna Tian	Hardware	5	July 18, 2014 15:32
Parallel cluster solving with OpenFoam? P2P Cluster?	hornig	OpenFOAM Programming & Development	8	December 5, 2010 17:06

October 29, 2014, 05:42		#3
guido.bonalumi New Member Guido Bonalumi Join Date: Dec 2013 Posts: 16 Rep Power: 13	Grazie per la risposta Daniele! Is this configuration specific for ANSYS? I am using OpenFOAM and I was thinking to improve the same solution.

October 29, 2014, 05:46		#4
ghost82 Senior Member Rick Join Date: Oct 2010 Posts: 1,016 Rep Power: 27	Yes, this is specific to have a cluster of 2 nodes to run ansys fluent. Little modifications are needed to add more than 2 nodes (+switch, straight cables, etc). I never used openfoam, so I don't know how the setup for a cluster is, maybe it's similar.

October 29, 2014, 06:50		#5
guido.bonalumi New Member Guido Bonalumi Join Date: Dec 2013 Posts: 16 Rep Power: 13	I have a question... As I wrote previously, PC number 1 and 2 already share a folder through NFS. The fact is that the folder is located on PC number 2, but ANSYS in installed on PC number 1. Do you think this could be a problem? I think not because both the PCs have access to the same file, but I am not so expert.

October 29, 2014, 06:56		#6
ghost82 Senior Member Rick Join Date: Oct 2010 Posts: 1,016 Rep Power: 27	I always installed ansys on every pc in the cluster and share only the working dir, but I know it is possible to install it on a single pc and share the folder through nfs. I think it could be something like: ansys in stalled on pc 1 in /usr/ansys_inc/..... Share the /usr/ansys_inc folder and mount on pc 2 in /usr/ansys_inc/ Same for the working directory: share /home/user/Desktop/working_dir created on pc 1 mount on pc 2 in /home/user/Desktop/working_dir I think absolute paths are important and should be the same on every pc in the cluster. Also user/password for login must be the same.

October 29, 2014, 07:23		#7
guido.bonalumi New Member Guido Bonalumi Join Date: Dec 2013 Posts: 16 Rep Power: 13	Sorry I explained myself wrong, but you suggested me something clever! What I was asking is this: is it a problem if the folder shared by NFS is located on PC number 2 while I run ANSYS from PC number 1? For semplicity I will install ANSYS on both machines but I already have the NFS connection between the 2 pc and I would like to keep it as it is. I do not think it should be a problem, what matter is that the 2 PCs have both access at the simulation's files and they have it.

October 29, 2014, 07:39		#8
ghost82 Senior Member Rick Join Date: Oct 2010 Posts: 1,016 Rep Power: 27	Ok, I understand; I think that shouldn't be a problem, but I'm not 100% sure.

October 29, 2014, 07:46		#9
guido.bonalumi New Member Guido Bonalumi Join Date: Dec 2013 Posts: 16 Rep Power: 13	Anyway I have a doubt about your solution regarding the installation of ANSYS only on one PC. I understand that sharing the installation folder you do not need to install ANSYS on the second PC but the license is specific for the mainboard of the PC where ANSYS is installed. For what I know this is done through the FLEXID number. How do you solve this problem?

October 29, 2014, 08:42		#10
ghost82 Senior Member Rick Join Date: Oct 2010 Posts: 1,016 Rep Power: 27	If you want to run on 8 cores you need 1 hpc license and you have to setup a license server.