OpenFOAM on SiCortex

egp · April 1, 2009, 10:25

FoamHeads,

Does anyone have experience running OpenFOAM on a SiCortex machines (http://sicortex.com/) that they would be willing to share? I'm particularly looking for:

1. performance metrics
2. installation & optimization

I've noticed that 1.5-dev has an entry in the wmake directory, $WM_PROJECT_DIR/wmake/rules/SiCortex64Gcc. Therefore, someone is using a SiCortex machine in the OpenFOAM world.

Thanks,

Eric

mattijs · April 6, 2009, 15:24

2. We did the port a little while ago. Since it is based on Linux it was quite easy - the only major change we had to make was in enforcing 4 byte alignment for mpi transfers. It should just compile/run out of the box. We just linked in their native mpi - didn't do any specific optimisation.

1. We only ran some tiny testcases to make sure it was running. I'd be interested in seeing some performance metrics as well - especially scaling on lots of processors.

egp · April 6, 2009, 16:09

Hi Mattijs,

Yeah, the wmake/rules looked pretty straight forward, so I expected it to compile without much problem.

I have access to a SiCortex SC1458 which has 1458 cores (http://sicortex.com/products/entry_m..._system_sc1458). Once I have some scaling performance numbers, I'll post them.

Eric

mattijs · April 7, 2009, 05:51

We found a big benefit from turning off runTimeModifiable (checks all registered dictionaries for change every time step). The nfs performance is not spectacular.

kwardle · July 15, 2009, 11:14

I have access to a SiCortex with 5832 cores. I will try to compile and runs some tests on this one too.

April 1, 2009, 10:25	OpenFOAM on SiCortex	#1
egp Senior Member Eric Paterson Join Date: Mar 2009 Location: Blacksburg, VA Posts: 197 Blog Entries: 1 Rep Power: 18	FoamHeads, Does anyone have experience running OpenFOAM on a SiCortex machines (http://sicortex.com/) that they would be willing to share? I'm particularly looking for: 1. performance metrics 2. installation & optimization I've noticed that 1.5-dev has an entry in the wmake directory, $WM_PROJECT_DIR/wmake/rules/SiCortex64Gcc. Therefore, someone is using a SiCortex machine in the OpenFOAM world. Thanks, Eric

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Superlinear speedup in OpenFOAM 13	msrinath80	OpenFOAM Running, Solving & CFD	18	March 3, 2015 06:36
64bitrhel5 OF installation instructions	mirko	OpenFOAM Installation	2	August 12, 2008 19:07
Adventure of fisrst openfoam installation on Ubuntu 710	jussi	OpenFOAM Installation	0	April 24, 2008 15:25
The OpenFOAM extensions project	mbeaudoin	OpenFOAM	16	October 9, 2007 10:33
OpenFOAM Debian packaging current status problems and TODOs	oseen	OpenFOAM Installation	9	August 26, 2007 14:50

April 6, 2009, 15:24		#2
mattijs Senior Member Mattijs Janssens Join Date: Mar 2009 Posts: 1,419 Rep Power: 26	2. We did the port a little while ago. Since it is based on Linux it was quite easy - the only major change we had to make was in enforcing 4 byte alignment for mpi transfers. It should just compile/run out of the box. We just linked in their native mpi - didn't do any specific optimisation. 1. We only ran some tiny testcases to make sure it was running. I'd be interested in seeing some performance metrics as well - especially scaling on lots of processors.

April 6, 2009, 16:09		#3
egp Senior Member Eric Paterson Join Date: Mar 2009 Location: Blacksburg, VA Posts: 197 Blog Entries: 1 Rep Power: 18	Hi Mattijs, Yeah, the wmake/rules looked pretty straight forward, so I expected it to compile without much problem. I have access to a SiCortex SC1458 which has 1458 cores (http://sicortex.com/products/entry_m..._system_sc1458). Once I have some scaling performance numbers, I'll post them. Eric

April 7, 2009, 05:51		#4
mattijs Senior Member Mattijs Janssens Join Date: Mar 2009 Posts: 1,419 Rep Power: 26	We found a big benefit from turning off runTimeModifiable (checks all registered dictionaries for change every time step). The nfs performance is not spectacular.

July 15, 2009, 11:14		#5
kwardle Senior Member Kent Wardle Join Date: Mar 2009 Location: Illinois, USA Posts: 219 Rep Power: 21	I have access to a SiCortex with 5832 cores. I will try to compile and runs some tests on this one too.