[amirmasoud_akhyani]

Originally Posted by LuckyTran

Are you running a distributed system with more than 1 machine or is this an error you receive in parallel mode on a single machine?

This error occurs when a different version of the Intel MPI is installed on each machine. Another way, is for the MPI to be incorrectly installed. Are you running windows 8 or 10? Check to make sure your version of the MPI is supported by your OS. You might be able to find some answers on the Intel developer zone.

yes i'm running distributed system with more than 1 machine.
i use intel MPI library 5.0 update 3 (version 5.0.3.048) on both machine on windows 7.
i can run distributed system on 1 machine without no problem.

[ettore]

Hi,
Have you installed Ansys on both machines on the default partition (C: )?
Have you shared in your network as instructed both C: partitions? Have you accessed each computer from the other one? Did you use the same account name and password (and of corse check the box that the username and password remain saved). Do your simulation spread across the second computer as well? How did you spawn the simulation, is it with list of ip adresses? Did you assigned as instructed the IP Adresses manually or are they automatically assigned?
You are using the same ANSYS on both machines, right? Or should i say the same installation kitt?

[amirmasoud_akhyani]

Originally Posted by ettore

Hi,
Have you installed Ansys on both machines on the default partition (C: )?
Have you shared in your network as instructed both C: partitions? Have you accessed each computer from the other one? Did you use the same account name and password (and of corse check the box that the username and password remain saved). Do your simulation spread across the second computer as well? How did you spawn the simulation, is it with list of ip adresses? Did you assigned as instructed the IP Adresses manually or are they automatically assigned?
You are using the same ANSYS on both machines, right? Or should i say the same installation kitt?

Hi
yes. i do all of those.
i think maybe it's depend on my intel mpi version.
could you send me your intel mpi links for download?

[ettore]

Well, i used the Version that came with the instalation package. It was the 4.1 Version of Intel MPI. Can you check if the instalation package that you use came with the Intel MPI software? I would advie generally to use the one that came with the Ansys package.
Therefore i cannot send you any link but only to adive to look it in the installation package (see descreption send via PM on where is located).

Best of luck

[Dvocvet]

Hi all,

please, i have two questions:
1. Can I join AMD and Intel?
2. Can I join win7 32 and win7 64 bit?

Thanks

[Dvocvet]

Ok, so I installed win7 64b on both of my machines, setup same passwords, connected them with cable, setup IP, subnet and gateway, etc.
Now I want to run both machines as cluster in Workbench (static structural) through RSM solver.
I managed to run only one of two machines - when i choose "Distribute solution (if possible)" , the second machine run on 100%, first machine not run.
The command "-dis -machines machine1:n:machine2:n" in textbox "Additional command line argument" did not help. Should i put this command somewhere else? Or what i am missing?

[Dvocvet]

Finally, all cores on both machines run on 100%.
The thing was in command:
-dis -mpi intelmpi -machines machine1:n:machine2:n (-mpi intelmpi was missing)

Also RSM Solve manager should be setup on the right way.

Great thing is that solving is slower Probably I have slow ethernet connection (1Gbps)

[HyperNova]

Originally Posted by ettore

Helo Daniele,
Have you tried to spawn a computation over more than 32 nodes?
I have a 4 X CPU machine with 64Cores but the computation wont spawn on more than 32 nodes. It will only use 2 CPUs no mather what i chose in the Computation setup (32 - 64 Cores). I get no limitation regarding cores in console. I am usig Fluent v16.

Thank you first for this tutorial, helped me setup a "cluster farm'' out of 4 computers that worked flawlesly!
Trying to extend the performance a came across the 4XCPU mainboard solution (to avoid the latency and communication lag), but as describet above a came across an unexpeted limitation.

Thank you in advance for a reply.

Hello ettore,
I have the same problem. I am using a pc that has 2 Intel Xeon CPU and each CPU has 18 cores and 36 thread. When I want to solve a huge problem I set number of processors to 72 (I know already that Hyper threading would not accelerate the simulation) , but when I check the CPU load in task manager I see only 1 CPU is doing the whole stuff and another CPU is actually resting! I decided to install Intel MPI but there is massage shown when installing saying that if you are working only with one computer, there is no need to install intel MPI. Now I am confused how I can solve my problem. I asking if you have managed to solve yours or not and if you were successful please share the procedure. Thank you in advance.

[HyperNova]

Originally Posted by ghost82

Do you have hyperthreading active?

Hello Daniel,
I have the same problem as ettore in this forum and in the former quote i have explained that. I think in my case installing intel mpi wont help because I have 2 CPUs in one motherboard. these 2 CPUs can not join each other during solving a huge problem. any suggestion or advice will be appreciated. Thank you very much in advance.

[ettore]

Hy,
Well i found out that on a local machine the maximum number of threads is limited to 32 (or 30). In your case 18 Cores x HT = 36 Threads per CPU. This is the reason why only 1 CPU is active.
I have used 2 x 16 Core CPU's on a machine and worked fine and hyper threading off. HT can only be disabled in Bios. You can also disable Cores, but just start with HT off.
You don't need the MPI platform for a local machine. The settings for the parallel processing are ok? (only pick the number of cores, i suggest a max of 30, without touching the settings on the lower side of the Window).
For me it did scale up to some 150% compared to a single CPU.
Let me know how it turns out. Best of luck!

[HyperNova]

hi ettore, thanks for your quick reply
I have the same problem as yours, the system I am working with it has 4 Xeon CPU and each has 18 cores and 36 threads and as you mentioned earlier there is no limitation in setting number of cores (for example setting to 144 cores) but still fluent use 2 CPU out of 4. I am solving a problem with 200M cells and certainly need to use the whole system power
Do you still believe in what you have posted earlier :""""In fluent i can setup any number of cores without any problem. In console i get the info that the simulation is spawn an all set nodes (CPUs) but when i look in task manager only 50% of them are used (CPU1 and CPU2). I read some ANSYS documentation on scaling and i have seen that after 32 Cores on a machine they don't get any benefit."""" ???
any suggestion will be appreciated.
regards

[ettore]

I am sure that it only uses 32 Cores regardless of the number that i set. Yes the benefit reason is why it only scales up to 32 nodes on a local machine.
But in your case i would disable th HT and up to 10 cores per CPU. This way when setting up 32 nodes in Ansys it will spread across all 4xCPU's that will definitely bring an advantage. This was how a got the most of my 4xCPU (64Cores) machine.

[Kimican]

hi guys,

where can i get the Intel MPI? Can I use the another MPI's (e.g Microsoft MPI, etc)?

thx.

[chaitanyaarige]

You can install directly from the Ansys setup. Fourth option here in the installation.
I dont know about another MPI. But I guess the version you install should be same on all the PC's. and it should be available in the Fluent GUI(distributed memory)

Originally Posted by Kimican

hi guys,

where can i get the Intel MPI? Can I use the another MPI's (e.g Microsoft MPI, etc)?

thx.

[Kimican]

Hi

First of all thank you very much. I have made it done. I have achieved building a cluster with 8 computers. Everything goes on with no problem.

thx.

[aozorainsankamil]

Hi all,

i've been trying to run fluent on 2 machine:
Machine 1:
A gaming PC
Intel Core i5 7600 (quad core)
16 Gb of RAM
1 TB hdd
Windows 10 pro

Machine 2:
Lenovo y50-70 laptop
Intel Core i7-4710hq (quad core)
16 gb of RAM
1 TB
Windows 10 Home

i'm using straight ethernet cables and a router to connect both of them

i have set everything according to the tutorial, but it just doesn't work. everytime i run it there is always these message on the console windows (picture attached)

any help would be appreciated

i'm using ansys 17

[Spanner]

Originally Posted by ghost82

Hi all,
this is a small tutorial to have the smallest cluster of 2 machines up and running with fluent.
The following setup is only a demo setup to show how 2 windows machines can be connected; more into details this tutorial will show you how to connect 2 machines running windows 7 64 bit to run jobs on distributed memory, without a switch, but directly connecting the 2 machines.

My demo setup is:

MACHINE 1 (this machine will be the host + 16 nodes)
Homemade workstation
Windows 7 64 bit Professional
2x intel xeon e5-2687w
64 gb ecc ram ddr3 at 1600 Mhz
250 gb ssd
2 TB hard drive for data storage
Wifi adapter Edimax Ralink EW-7318usg

MACHINE 2 (this machine will be 2 nodes)
Macbook pro late 2008 (laptop)
Bootcamp installed with windows 7 64 bit Ultimate
1x 2,5 Ghz intel core 2 duo
4 gb non ecc ram ddr2 at 667 Mhz
40 gb hard drive
Internal wifi N adapter


Since this is only a demo setup and since I haven't a cross cable to connect the machines through the gigabit ethernet, I was going to connect the 2 machines by wifi at 54 mbps (very slow); in a real setup, the 2 machines should be connected at least with a cross cable cat. 5E (Gbit ethernet), or better with infiniband.

First of all I need to create a lan to connect the 2 machines.
Edimax provides an access point software, so machine 1 will be the access point.
Machine 2 is the wifi client which will connect to machine 1.

Let's assign static ips and subnet masks to the machines.

On machine 1 (which will be the gateway):
Control panel->network and internet->network and sharing server->change adapter settings (on the left)
Right click on the network adapter (in my case the Edimax Ralink EW-7318usg) and click properties: highlight "internet protocol version 4 (tcp/ipv4)" and click properties
Check "use the following ip address" and "use the following DNS server addresses"
Ip address: 192.168.1.1 (I chose the standard home network 192.168.xxx.xxx)
Subnet mask: 255.255.255.0
Default gateway: 192.168.1.1

Click ok and exit

On machine 2:
Control panel->network and internet->network and sharing server->change adapter settings (on the left)
Right click on the network adapter (in my case the internal wifi adapter) and click properties: highlight "internet protocol version 4 (tcp/ipv4)" and click properties
Check "use the following ip address" and "use the following DNS server addresses"
Ip address: write 192.168.1.2
Subnet mask: 255.255.255.0
Default gateway: 192.168.1.1

Click ok and exit

Disable firewalls and UAC on machine 1 and 2 to prevent errors in communication (you can activate them later once all is working)

Test the ping command
To see if the machines are seeing each other open on each machine the command prompt (cmd).
On machine 1 type: ping 192.168.1.2
and click enter
On machine 2 type: ping 192.168.1.1
and click enter

4 packets will be sent by machine 1 to machine 2 and to machine 2 to machine 1 and you must see that all packets reach destination.

VERY IMPORTANT
The 2 machines must have fluent installed in the same directory;
The 2 machines must have intel mpi installed in the same directory;
The 2 machines must have the same username and password to login in windows (so you must assign the same password to the usernames, you cannot have a blank password).


Test usernames/password

On both machines 1 and 2 share a directory, for example the C:\ directory
Go to Start->Computer
Right click on C:\ then click on properties
Click on sharing tab->advanced sharing
Check Share this folder, click apply and click on permissions
Highlight Everyone in users and groups and assign full control (all checks under "Allow")
Click apply, ok, ok

From machine 1 go to Start->Computer and click on network on the left to see machine 2
Double click on it and access the shared folder C:\ on machine 2
You will be prompted for a username and a password
Type the windows username and password and see if you can access the shared folder

From machine 2, do the same

Usernames and passwords must be the same!

On machine 1 create a new .txt file with notepad and write the hostnames of the network: the format of the file is:

ipmachine1
ipmachine1
ipmachine1
ipmachine1
ipmachine2
ipmachine2

This is a 4 cores machine 1 + 2 cores machine 2; under the last line a blank line must be present.
This is my hostnames.txt file (16 cores on machine 1 and 2 cores on machine 2)

192.168.1.1
192.168.1.1
192.168.1.1
192.168.1.1
192.168.1.1
192.168.1.1
192.168.1.1
192.168.1.1
192.168.1.1
192.168.1.1
192.168.1.1
192.168.1.1
192.168.1.1
192.168.1.1
192.168.1.1
192.168.1.1
192.168.1.2
192.168.1.2

Save the hostnames.txt file on machine 1, on your desktop.

Start fluent on machine 1
Choose the working directory on machine 1 (cas and dat files are on machine 1)
Processing options: check parallel and type the number of processes, in my case 18
Click on parallel settings tab: under interconnects set defaults, under MPI types set Intel (do not leave defaults)
Check Distributed memory on a cluster and check File containing machine names: point to hostnames.txt on the desktop on machine 1
Click ok to start fluent
Skip the warning and info messages

I'm attaching some pictures: 'alicegate' is the macbook pro (2 cores); 'Workstation' is the workstation with 16 cores.
The other pictures show: on the macbook pro 100% cpu usage and network addresses; on the workstation 100% cpu usage and fluent running



I hope it's clear enough for all.

Daniele

PS: the only thing I cannot understand is why I have access denied ('Accesso negato') when I stop the simulation and save the cas and dat files on C:\ on machine 1.
As you can see in the picture I have access denied in the command window, however files are written (this happens with both C:\ folder shared and not shared).

Sir, can i set two computers with different processors and different ram but same operatin system

[ghost82]

Of course!

[Spanner]

Thanks Sir

[aural]

Originally Posted by ghost82

Of course!

Dear Daniele,
I have two win10 PCs, connected by a router. I set the same user name and password for both PCs, but intel mpi wouldn't run. I wonder if the two PCs have to be in the same domain (they are currently in the same workgroup) to make it work. Thank you for your help,