CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Forums > General Forums > Main CFD Forum

ParMETIS

Register Blogs Community New Posts Updated Threads Search

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
Old   November 20, 2008, 13:12
Default ParMETIS
  #1
Rob Kunz
Guest
 
Posts: n/a
I have been using METIS for years in the front end of my face based cell centered unstructured CFD code. The front end reads the grid gereator file, builds the global vertex and adjacency list and runs METIS_PartGraph_Kway.

I have a large model now and METIS is exceeding the 32GB ram I have on our "fat" serial node, so I think I need to use ParMETIS.

Question is how does one "easily" build a starting graph for each processor? Simple spatial splitting? Put a edges each on n-1 procs and the rest on one proc?

Thanks! Rob
  Reply With Quote

Old   November 20, 2008, 14:42
Default Re: ParMETIS
  #2
Jed
Guest
 
Posts: n/a
How do you generate your huge meshes? Ideally the mesh generator provides a preliminary partition and you distribute parts based on that. If you can't have a preliminary partition, you can just assign a contiguous block of <code>n/p</code> elements to each process as a preliminary partition. Of course, this requires that your file format gives you a way to determine connectivity for the elements in a part without reading the entire thing. You can use MPI-IO (perhaps through an interface like HDF5), read sequentially from the first node, or read separate files on each node. Which is fastest depends on the filesystem and network of your cluster.
  Reply With Quote

Old   November 20, 2008, 17:20
Default Re: ParMETIS
  #3
Rob Kunz
Guest
 
Posts: n/a
Thanks Jed: I use ICEM which will not partition the mesh. Whatever my solution I qwill be faced with the I/O issue you mention and I will take your advise and look into MPI-IO Thank you Rob
  Reply With Quote

Reply


Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
GPL license compatible with ParMetis guillaume OpenFOAM 3 August 8, 2018 05:48
decomposePare error with parMetis tonyuprm OpenFOAM 7 July 5, 2011 16:49
ParMETIS with Fortran whumber Main CFD Forum 0 November 20, 2009 14:06
ParMetis for parallel decomposing bastil OpenFOAM Running, Solving & CFD 0 May 12, 2008 10:54
BuildingLinking of ParMETIS and metis50pre2 mwild OpenFOAM Installation 0 January 28, 2008 05:55


All times are GMT -4. The time now is 16:25.