CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > Software User Forums > OpenFOAM > OpenFOAM Running, Solving & CFD

OpenFOAM file management (on Server)

Register Blogs Community New Posts Updated Threads Search

Like Tree1Likes
  • 1 Post By olesen

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
Old   January 2, 2017, 13:16
Default OpenFOAM file management (on Server)
  #1
New Member
 
Han Li
Join Date: Jul 2015
Location: College Station
Posts: 16
Rep Power: 11
lifeinhand is on a distinguished road
Hi All,

I am running a transient case using LES on a computer server. The server in our school has a file number quota (limit) for each user. But when I use OpenFOAM in parallel, OpenFOAM will have a large number of files for each time step. (e.g. if I use 100 cores, OpenFOAM will have 100 folders, processor0, processor1...., in each folder contains multiple files, U, p, k....). The files limit the number of time step I can run/store at once.

Do you guys have any suggestions?

Any suggestion is appreciated!
lifeinhand is offline   Reply With Quote

Old   January 3, 2017, 11:40
Default use purgeWrite
  #2
Member
 
Arvind Jay
Join Date: Sep 2012
Posts: 97
Rep Power: 15
arvindpj is on a distinguished road
You can use purgeWrite option in the controlDict file. Depending on the number, you could overwrite and save only the latest data.
Code:
 
purgeWrite      3;
or use post processing function objects like probe and sample data.

Cheers,


Edit:
If you need a more advanced solution check out the adiosWrite add-on to openfoam+.
arvindpj is offline   Reply With Quote

Old   January 4, 2017, 16:51
Default
  #3
New Member
 
Han Li
Join Date: Jul 2015
Location: College Station
Posts: 16
Rep Power: 11
lifeinhand is on a distinguished road
Thank you!

So far what I do is using sample method to sample a plane into a VTK file for prescribed time steps. And using Purge option only store solution for recent time steps.
The downside is I can only have the sample plane data for the whole run. I wish there is some sample method to extract certain 3D region into a VTK file.

PS: The adiosWrite slides was fascinating. I am thinking of using that.
lifeinhand is offline   Reply With Quote

Old   January 5, 2017, 10:59
Default
  #4
Senior Member
 
Mark Olesen
Join Date: Mar 2009
Location: https://olesenm.github.io/
Posts: 1,714
Rep Power: 40
olesen has a spectacular aura aboutolesen has a spectacular aura about
Quote:
Originally Posted by lifeinhand View Post
PS: The adiosWrite slides was fascinating. I am thinking of using that.
If you are interested in using the adios writing, I would suggest using the latest updated version from the OpenFOAM community repository announced here:

http://openfoam.com/version-v1612+/c...ty-parallel-io

https://develop.openfoam.com/Communi...rite/README.md

It compiles smoothly with the 1612 release.
There is some background information as a http://openfoam.com/documentation/fi...ios-201610.pdf but is slightly out-of-date.
arvindpj likes this.

Last edited by olesen; January 5, 2017 at 11:31. Reason: added link to pdf
olesen is offline   Reply With Quote

Old   January 5, 2017, 12:29
Default
  #5
New Member
 
Han Li
Join Date: Jul 2015
Location: College Station
Posts: 16
Rep Power: 11
lifeinhand is on a distinguished road
Quote:
Originally Posted by olesen View Post

It compiles smoothly with the 1612 release.
There is some background information as a http://openfoam.com/documentation/fi...ios-201610.pdf but is slightly out-of-date.
The OpenFOAM versions on our Server are 4.0 / 3.0.1 / 3.0.0 / 2.4 .....
So the closest comparable version is 4.0 (I assume ) ?
lifeinhand is offline   Reply With Quote

Old   January 5, 2017, 13:39
Default
  #6
Senior Member
 
Mark Olesen
Join Date: Mar 2009
Location: https://olesenm.github.io/
Posts: 1,714
Rep Power: 40
olesen has a spectacular aura aboutolesen has a spectacular aura about
Quote:
Originally Posted by lifeinhand View Post
The OpenFOAM versions on our Server are 4.0 / 3.0.1 / 3.0.0 / 2.4 .....
So the closest comparable version is 4.0 (I assume ) ?
These versions are unfortunately too old - you won't have any fun trying to get it working with them.
For what it is worth, with 1612 compiling OpenFOAM should be a much smoother experience.
But if you need some really easy to handle (eg, for your IT people), you might also take a look at the additional build script in the community repository. With this it is possible to provide a bundle of openfoam and third-party packages along with the configuration information (currently embedded as a table of information inside the script). It is not quite one-click, but getting much closer.

/mark
olesen is offline   Reply With Quote

Old   January 5, 2017, 13:48
Default
  #7
New Member
 
Han Li
Join Date: Jul 2015
Location: College Station
Posts: 16
Rep Power: 11
lifeinhand is on a distinguished road
Thank you, Mark!

I will try the 1612 Version on my computer and request our Supercomputing Staff add the newer version.

It seems our OpenFOAM version is following CFD Direct (openfoam.org) instead of ESI's OpenFOAM version.
lifeinhand is offline   Reply With Quote

Old   January 10, 2017, 03:51
Default
  #8
Senior Member
 
Mark Olesen
Join Date: Mar 2009
Location: https://olesenm.github.io/
Posts: 1,714
Rep Power: 40
olesen has a spectacular aura aboutolesen has a spectacular aura about
Quote:
Originally Posted by lifeinhand View Post
Thank you, Mark!

I will try the 1612 Version on my computer and request our Supercomputing Staff add the newer version.

It seems our OpenFOAM version is following CFD Direct (openfoam.org) instead of ESI's OpenFOAM version.
Let me know how you get on. If there are specific issues/improvements for the adiosWrite, it would be nice if you used the gitlab tracker. This makes it easier to follow for the development process.
olesen is offline   Reply With Quote

Reply

Tags
parallel calculation, servers


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
[swak4Foam] groovyBC in openFOAM-2.0 for parabolic velocity bc ofslcm OpenFOAM Community Contributions 25 March 6, 2017 11:03
centOS 5.6 : paraFoam not working yossi OpenFOAM Installation 2 October 9, 2013 02:41
[swak4Foam] build problem swak4Foam OF 2.2.0 mcathela OpenFOAM Community Contributions 14 April 23, 2013 14:59
pisoFoam compiling error with OF 1.7.1 on MAC OSX Greg Givogue OpenFOAM Programming & Development 3 March 4, 2011 18:18
DxFoam reader update hjasak OpenFOAM Post-Processing 69 April 24, 2008 02:24


All times are GMT -4. The time now is 08:19.