|
[Sponsors] |
November 20, 2008, 13:12 |
ParMETIS
|
#1 |
Guest
Posts: n/a
|
I have been using METIS for years in the front end of my face based cell centered unstructured CFD code. The front end reads the grid gereator file, builds the global vertex and adjacency list and runs METIS_PartGraph_Kway.
I have a large model now and METIS is exceeding the 32GB ram I have on our "fat" serial node, so I think I need to use ParMETIS. Question is how does one "easily" build a starting graph for each processor? Simple spatial splitting? Put a edges each on n-1 procs and the rest on one proc? Thanks! Rob |
|
November 20, 2008, 14:42 |
Re: ParMETIS
|
#2 |
Guest
Posts: n/a
|
How do you generate your huge meshes? Ideally the mesh generator provides a preliminary partition and you distribute parts based on that. If you can't have a preliminary partition, you can just assign a contiguous block of <code>n/p</code> elements to each process as a preliminary partition. Of course, this requires that your file format gives you a way to determine connectivity for the elements in a part without reading the entire thing. You can use MPI-IO (perhaps through an interface like HDF5), read sequentially from the first node, or read separate files on each node. Which is fastest depends on the filesystem and network of your cluster.
|
|
November 20, 2008, 17:20 |
Re: ParMETIS
|
#3 |
Guest
Posts: n/a
|
Thanks Jed: I use ICEM which will not partition the mesh. Whatever my solution I qwill be faced with the I/O issue you mention and I will take your advise and look into MPI-IO Thank you Rob
|
|
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
GPL license compatible with ParMetis | guillaume | OpenFOAM | 3 | August 8, 2018 05:48 |
decomposePare error with parMetis | tonyuprm | OpenFOAM | 7 | July 5, 2011 16:49 |
ParMETIS with Fortran | whumber | Main CFD Forum | 0 | November 20, 2009 14:06 |
ParMetis for parallel decomposing | bastil | OpenFOAM Running, Solving & CFD | 0 | May 12, 2008 10:54 |
BuildingLinking of ParMETIS and metis50pre2 | mwild | OpenFOAM Installation | 0 | January 28, 2008 05:55 |