|
[Sponsors] |
February 24, 2019, 20:38 |
parallel run OpenFoam
|
#1 |
New Member
|
Hello everyone, I am trying to solve the "Propeller" problem and having this error when I am trying to run in parallel. The patch names in '0' and pollyMesh are same. I am not understanding where I am doing it wrong!!!
could anyone help me out with this!!! Thank you!!! Error Message srinath@srinath:~/OpenFOAM/srinath-6/run/propeller/stator$ decomposePar /*---------------------------------------------------------------------------*\ ========= | \\ / F ield | OpenFOAM: The Open Source CFD Toolbox \\ / O peration | Website: https://openfoam.org \\ / A nd | Version: 6 \\/ M anipulation | \*---------------------------------------------------------------------------*/ Build : 6-d3fd147e6c65 Exec : decomposePar Date : Feb 25 2019 Time : 01:25:54 Host : "srinath" PID : 25205 I/O : uncollated Case : /home/srinath/OpenFOAM/srinath-6/run/propeller/stator nProcs : 1 sigFpe : Enabling floating point exception trapping (FOAM_SIGFPE). fileModificationChecking : Monitoring run-time modified files using timeStampMaster (fileModificationSkew 10) allowSystemOperations : Allowing user-supplied system call operations // * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * // Create time Decomposing mesh region0 Create mesh Calculating distribution of cells Selecting decompositionMethod scotch Finished decomposition in 4.79 s Calculating original mesh data Distributing cells to processors Distributing faces to processors Distributing points to processors Constructing processor meshes Processor 0 Number of cells = 194200 Number of faces shared with processor 1 = 2412 Number of faces shared with processor 4 = 378 Number of faces shared with processor 6 = 1620 Number of processor patches = 3 Number of processor faces = 4410 Number of boundary faces = 9097 Processor 1 Number of cells = 194087 Number of faces shared with processor 0 = 2412 Number of faces shared with processor 2 = 2147 Number of faces shared with processor 4 = 1388 Number of faces shared with processor 5 = 348 Number of faces shared with processor 6 = 347 Number of processor patches = 5 Number of processor faces = 6642 Number of boundary faces = 11959 Processor 2 Number of cells = 191701 Number of faces shared with processor 1 = 2147 Number of faces shared with processor 3 = 2157 Number of processor patches = 2 Number of processor faces = 4304 Number of boundary faces = 10968 Processor 3 Number of cells = 192067 Number of faces shared with processor 2 = 2157 Number of processor patches = 1 Number of processor faces = 2157 Number of boundary faces = 18989 Processor 4 Number of cells = 195083 Number of faces shared with processor 0 = 378 Number of faces shared with processor 1 = 1388 Number of faces shared with processor 5 = 2681 Number of faces shared with processor 6 = 728 Number of faces shared with processor 7 = 1418 Number of processor patches = 5 Number of processor faces = 6593 Number of boundary faces = 10813 Processor 5 Number of cells = 194813 Number of faces shared with processor 1 = 348 Number of faces shared with processor 4 = 2681 Number of faces shared with processor 7 = 1071 Number of processor patches = 3 Number of processor faces = 4100 Number of boundary faces = 8777 Processor 6 Number of cells = 192577 Number of faces shared with processor 0 = 1620 Number of faces shared with processor 1 = 347 Number of faces shared with processor 4 = 728 Number of faces shared with processor 7 = 3015 Number of processor patches = 4 Number of processor faces = 5710 Number of boundary faces = 8392 Processor 7 Number of cells = 192527 Number of faces shared with processor 4 = 1418 Number of faces shared with processor 5 = 1071 Number of faces shared with processor 6 = 3015 Number of processor patches = 3 Number of processor faces = 5504 Number of boundary faces = 8727 Number of processor faces = 19710 Max number of cells = 195083 (0.879671% above average 193382) Max number of processor patches = 5 (53.8462% above average 3.25) Max number of faces between processors = 6642 (34.7945% above average 4927.5) Time = 0 --> FOAM FATAL ERROR: Attempt to cast type patch to type lduInterface From function To& Foam::refCast(From&) [with To = const Foam::lduInterface; From = const Foam::fvPatch] in file /home/ubuntu/OpenFOAM/OpenFOAM-6/src/OpenFOAM/lnInclude/typeInfo.H at line 114. FOAM aborting #0 Foam::error:rintStack(Foam::Ostream&) at ??:? #1 Foam::error::abort() at ??:? #2 Foam::lduInterface const& Foam::refCast<Foam::lduInterface const, Foam::fvPatch const>(Foam::fvPatch const&) in "/home/srinath/OpenFOAM/srinath-6/platforms/linux64GccDPInt32Opt/bin/decomposePar" #3 Foam::cyclicAMIFvPatchField<double>::cyclicAMIFvPa tchField(Foam::fvPatch const&, Foam:imensionedField<double, Foam::volMesh> const&, Foam::dictionary const&) at ??:? #4 Foam::fvPatchField<double>::adddictionaryConstruct orToTable<Foam::cyclicAMIFvPatchField<double> >::New(Foam::fvPatch const&, Foam:imensionedField<double, Foam::volMesh> const&, Foam::dictionary const&) at ??:? #5 Foam::fvPatchField<double>::New(Foam::fvPatch const&, Foam:imensionedField<double, Foam::volMesh> const&, Foam::dictionary const&) in "/home/srinath/OpenFOAM/srinath-6/platforms/linux64GccDPInt32Opt/bin/decomposePar" #6 Foam::GeometricField<double, Foam::fvPatchField, Foam::volMesh>::Boundary::readField(Foam:imensio nedField<double, Foam::volMesh> const&, Foam::dictionary const&) in "/home/srinath/OpenFOAM/srinath-6/platforms/linux64GccDPInt32Opt/bin/decomposePar" #7 Foam::GeometricField<double, Foam::fvPatchField, Foam::volMesh>::readFields(Foam::dictionary const&) in "/home/srinath/OpenFOAM/srinath-6/platforms/linux64GccDPInt32Opt/bin/decomposePar" #8 Foam::GeometricField<double, Foam::fvPatchField, Foam::volMesh>::readFields() in "/home/srinath/OpenFOAM/srinath-6/platforms/linux64GccDPInt32Opt/bin/decomposePar" #9 Foam::GeometricField<double, Foam::fvPatchField, Foam::volMesh>::GeometricField(Foam::IOobject const&, Foam::fvMesh const&) in "/home/srinath/OpenFOAM/srinath-6/platforms/linux64GccDPInt32Opt/bin/decomposePar" #10 ? in "/home/srinath/OpenFOAM/srinath-6/platforms/linux64GccDPInt32Opt/bin/decomposePar" #11 ? in "/home/srinath/OpenFOAM/srinath-6/platforms/linux64GccDPInt32Opt/bin/decomposePar" #12 __libc_start_main in "/lib/x86_64-linux-gnu/libc.so.6" #13 ? in "/home/srinath/OpenFOAM/srinath-6/platforms/linux64GccDPInt32Opt/bin/decomposePar" Aborted (core dumped) * * * * * * * * * * * * * * * * * * * * * // object decomposeParDict; } numberOfSubdomains 6; method scotch; simpleCoeffs { n (2 1 1); delta 0.001; hierarchicalCoeffs { n (1 1 1); delta 0.001; order xyz; } metisCoeffs { } manualCoeffs { dataFile ""; } distributed no; roots ( ); // ************************************************** *********************** // Epsilon FoamFile { version 2.0; format ascii; class volScalarField; location "0"; object epsilon; } // * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * // dimensions [0 2 -3 0 0 0 0]; internalField uniform 0.0495; boundaryField { //- Set patchGroups for constraint patches //#includeEtc "caseDicts/setConstraintTypes" inlet { type inletOutlet; inletValue $internalField; value $internalField; } Outlet { type inletOutlet; inletValue $internalField; value $internalField; } side { type epsilonWallFunction; value $internalField; } propeller { type epsilonWallFunction; value $internalField; } AMI2 { type cyclicAMI; value $internalField; } AMI1 { type cyclicAMI; value $internalField; } } // ************************************************** *********************** // object boundary; } // * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * // 7 ( side { type patch; nFaces 21884; startFace 3110207; } inlet { type patch; nFaces 2758; startFace 3132091; } Outlet { type patch; nFaces 2966; startFace 3134849; } AMI2 { type patch; nFaces 9950; startFace 3137815; } AMI1 { type patch; nFaces 9064; startFace 3147765; } propeller { type patch; nFaces 39972; startFace 3156829; } defaultFaces { type patch; nFaces 1128; startFace 3196801; } ) |
|
February 25, 2019, 06:30 |
|
#2 |
Member
Os
Join Date: Jun 2017
Posts: 80
Rep Power: 9 |
Hello
the problelm is with your settings to the parallel solving 1/-if you want to use 6 core you have to change DecoposeParDict as follow: object decomposeParDict; } numberOfSubdomains 6; method scotch; simpleCoeffs { n (3 2 1); delta 0.001; hierarchicalCoeffs { n (3 2 1); delta 0.001; order xyz; } metisCoeffs { } manualCoeffs { dataFile ""; } distributed no; roots ( ); Once you save the file you have to redecompose your case so you have to delete all the processor* files from your case .After that in the terminal run the command : decomposPar than you can run your solver like this : mpirun -np 6 -yoursolver -parallel >log hope this helps |
|
February 25, 2019, 08:54 |
|
#3 | |
New Member
|
Quote:
so the values have to change according to the no of a core? if it I use 4 core the values should be (2 1 1) is that right? simpleCoeffs { n (3 2 1); delta 0.001; hierarchicalCoeffs { n (3 2 1); delta 0.001; order xyz; } |
||
February 25, 2019, 09:52 |
|
#4 | |
Member
Os
Join Date: Jun 2017
Posts: 80
Rep Power: 9 |
Quote:
Hello, you are welcome , In case you want to use 4 core you have to set : numberOfSubdomains to be 4 like this : numberOfSubdomains 4; and for the simpleCoeffs (i j 1) : the product of i and j must =4 ( i x j = numberof cores) and also please note that i and j must take integer values. so it gonna be (2 2 1) or (4 1 1) as you like: simpleCoeffs { n (2 2 1); delta 0.001; for the hierarchicalCoeffs you can leave it the way it is but me personally i always make it the same as simpleCoeff hierarchicalCoeffs { n (2 2 1); delta 0.001; order xyz; and to run in parallel you have to use : mpirun -np 4 yoursolver -parallel >log Hope this helps you Take Care |
||
February 25, 2019, 09:57 |
|
#5 |
New Member
|
Thank you so much!! It helps me a lot!!
One more error! While I'm running pimpleFoam solver to propeller Geo, the error displayed as Unable to set source and traget faces? What that mean have you come across such errors?? Thank you |
|
February 25, 2019, 10:10 |
|
#6 | |
Member
Os
Join Date: Jun 2017
Posts: 80
Rep Power: 9 |
Quote:
Not Really and without detailed error message i cant help that much but i guess you need to : 1/-check your position (where you are launching the command in terminal) make sure that your case is in the run directory and that you are in your case folder 2/-check that your case folders are with there right names and that you didnt change anyof them by accident 0, constant, system .... 3/-other than that you can check your mesh i.e that you generated your mesh and that all of your files are there .and that you didnt modify anything bymistake and than i guess you should be okk |
||
February 25, 2019, 10:13 |
|
#7 | |
New Member
|
Quote:
srinath@srinath:~/OpenFOAM/srinath-6/run/propeller/stator$ mpirun -np 6 pimpleFoam -parallel >log.pimpleFoam [1] [1] [1] --> FOAM FATAL ERROR: [1] Unable to set source and target faces [1] [1] From function void Foam::faceAreaWeightAMI<SourcePatch, TargetPatch>::setNextFaces(Foam::label&, Foam::label&, Foam::label&, const boolList&, Foam::labelList&, const Foam:ynamicList<int>&, bool) const [with SourcePatch = Foam::PrimitivePatch<Foam::face, Foam::SubList, const Foam::Field<Foam::Vector<double> >&>; TargetPatch = Foam::PrimitivePatch<Foam::face, Foam::SubList, const Foam::Field<Foam::Vector<double> >&>; Foam::label = int; Foam::boolList = Foam::List<bool>; Foam::labelList = Foam::List<int>] [1] in file lnInclude/faceAreaWeightAMI.C at line 292. [1] FOAM parallel run aborting [1] [1] #0 Foam::error:rintStack(Foam::Ostream&) at ??:? [1] #1 Foam::error::abort() at ??:? [1] #2 Foam::faceAreaWeightAMI<Foam::PrimitivePatch<Foam: :face, Foam::SubList, Foam::Field<Foam::Vector<double> > const&, Foam::Vector<double> >, Foam::PrimitivePatch<Foam::face, Foam::SubList, Foam::Field<Foam::Vector<double> > const&, Foam::Vector<double> > >::calcAddressing(Foam::List<Foam:ynamicList<int , 0u, 2u, 1u> >&, Foam::List<Foam:ynamicList<double, 0u, 2u, 1u> >&, Foam::List<Foam:ynamicList<int, 0u, 2u, 1u> >&, Foam::List<Foam:ynamicList<double, 0u, 2u, 1u> >&, int, int) at ??:? [1] #3 Foam::faceAreaWeightAMI<Foam::PrimitivePatch<Foam: :face, Foam::SubList, Foam::Field<Foam::Vector<double> > const&, Foam::Vector<double> >, Foam::PrimitivePatch<Foam::face, Foam::SubList, Foam::Field<Foam::Vector<double> > const&, Foam::Vector<double> > >::calculate(Foam::List<Foam::List<int> >&, Foam::List<Foam::List<double> >&, Foam::List<Foam::List<int> >&, Foam::List<Foam::List<double> >&, int, int) at ??:? [1] #4 Foam::AMIInterpolation<Foam::PrimitivePatch<Foam:: face, Foam::SubList, Foam::Field<Foam::Vector<double> > const&, Foam::Vector<double> >, Foam::PrimitivePatch<Foam::face, Foam::SubList, Foam::Field<Foam::Vector<double> > const&, Foam::Vector<double> > >::update(Foam::PrimitivePatch<Foam::face, Foam::SubList, Foam::Field<Foam::Vector<double> > const&, Foam::Vector<double> > const&, Foam::PrimitivePatch<Foam::face, Foam::SubList, Foam::Field<Foam::Vector<double> > const&, Foam::Vector<double> > const&, bool) at ??:? [1] #5 Foam::AMIInterpolation<Foam::PrimitivePatch<Foam:: face, Foam::SubList, Foam::Field<Foam::Vector<double> > const&, Foam::Vector<double> >, Foam::PrimitivePatch<Foam::face, Foam::SubList, Foam::Field<Foam::Vector<double> > const&, Foam::Vector<double> > >::constructFromSurface(Foam::PrimitivePatch<Foam: :face, Foam::SubList, Foam::Field<Foam::Vector<double> > const&, Foam::Vector<double> > const&, Foam::PrimitivePatch<Foam::face, Foam::SubList, Foam::Field<Foam::Vector<double> > const&, Foam::Vector<double> > const&, Foam::autoPtr<Foam::searchableSurface> const&, bool) at ??:? [1] #6 Foam::cyclicAMIPolyPatch::resetAMI() const at ??:? [1] #7 Foam::cyclicAMIPolyPatch::AMIs() const at ??:? [1] #8 Foam::tmp<Foam::Field<double> > Foam::cyclicAMIPolyPatch::interpolate<double>(Foam ::Field<double> const&, Foam::UList<double> const&) const at ??:? [1] #9 Foam::cyclicAMIFvPatch::nbrDeltan() const at ??:? [1] #10 Foam::cyclicAMIFvPatch::makeWeights(Foam::Field<do uble>&) const at ??:? [1] #11 Foam::surfaceInterpolation::makeWeights() const at ??:? [1] #12 Foam::surfaceInterpolation::weights() const at ??:? [1] #13 Foam::surfaceInterpolationScheme<Foam::Vector<doub le> >::dotInterpolate(Foam::GeometricField<Foam::Vecto r<double>, Foam::fvsPatchField, Foam::surfaceMesh> const&, Foam::GeometricField<Foam::Vector<double>, Foam::fvPatchField, Foam::volMesh> const&) const at ??:? [1] #14 Foam::fvc::flux(Foam::GeometricField<Foam::Vector< double>, Foam::fvPatchField, Foam::volMesh> const&) at ??:? [1] #15 ? in "/home/srinath/OpenFOAM/srinath-6/platforms/linux64GccDPInt32Opt/bin/pimpleFoam" [1] #16 __libc_start_main in "/lib/x86_64-linux-gnu/libc.so.6" [1] #17 ? in "/home/srinath/OpenFOAM/srinath-6/platforms/linux64GccDPInt32Opt/bin/pimpleFoam" |
||
February 25, 2019, 10:25 |
|
#8 | |
Member
Os
Join Date: Jun 2017
Posts: 80
Rep Power: 9 |
Quote:
Can you please go to this directory srinath@srinath:~/OpenFOAM/srinath-6/run/propeller/stator use the command ls * (there is blank space between ls and the * sign) and send me see the results also go the the directory constant/polyMesh and send me the list of the files in there |
||
February 25, 2019, 11:10 |
|
#9 | |
New Member
|
Quote:
Allclean Allrun Allrun.pre log log.pimpleFoam paraview.foam stator.unv 0: epsilon k nut p U 0.orig: cellToRegion constant: dynamicMeshDict polyMesh transportProperties triSurface turbulenceProperties processor0: 0 constant processor1: 0 constant processor2: 0 constant processor3: 0 constant processor4: 0 constant processor5: 0 constant system: controlDict decomposeParDict forces fvSchemes fvSolution topoSetDict VTK: rotor srinath@srinath:~/OpenFOAM/srinath-6/run/propeller/stator/constant$ ls * dynamicMeshDict transportProperties turbulenceProperties polyMesh: boundary cellZones faces faceZones neighbour owner points pointZones sets triSurface: innerCylinder.obj innerCylinderSmall.obj outerCylinder.obj propellerStem1.obj propellerStem2.obj propellerStem3.obj |
||
February 26, 2019, 09:47 |
|
#10 | |
Member
Os
Join Date: Jun 2017
Posts: 80
Rep Power: 9 |
Quote:
From what i see it seem like all the files are there , i ve looked on the net for the same problem you can check this topic maybe it gonna help you "Unable to set source and target faces" in pimpleDyMFoam Hope this helps |
||
February 26, 2019, 14:40 |
|
#11 | |
New Member
|
Quote:
I have seen this post earlier but the thing is I did not understand the comment on that!! Does the comment mean I have to change the axis of rotation? I have tried that option also but it did not work!!! I will do it again and I will post the comment!! Can you please comment on my Geometry that I am currently working on, which is similar to this geo!!! my geometry has a rotating impeller which is used to mix the fluids(to get an idea it like a mixing tank but on the scale, it is small in size(7mm)). here the thing, I do not have any inlets or outlets to my Geo, all are considered as walls. when I am setting up the case file to this Geo! the patches which I have mentioned while I am meshing are(top, bottom, side and rotor). in the "0" folder the boundary conditions to my patches should be the same right. I am confused about what boundary condition should I used to those patches!! it is "NoSlip" or Wall condition. I am even more confused about the rotor patch!!! could you please comment on it?? I tried to add an image of my Geo but it is asking the Url. Thank you so much for your help. |
||
February 27, 2019, 06:49 |
|
#12 | |
Member
Os
Join Date: Jun 2017
Posts: 80
Rep Power: 9 |
Quote:
I believe that from that post you need to check your Axe of rotation and that the center or rotation is well positionned ( maybe you changed that and forget about it or used a differetn geometry and kept the same for the previous Geometry ) 2/-At this point i feel kinda going blind and i may not help you that much. Even though am really busy but i guess it would be better if you can send me your case file i'll try to have a look at it on Saturday and let you know what i find (i ll do my best to help you ). Hope this helps Kind regards |
||
February 27, 2019, 06:56 |
|
#13 | |
New Member
|
Quote:
Can I have your Email address so that I can send my files!! My Geo and the model what I want to implement I will clearly explain that to you!! Thanks |
||
February 27, 2019, 10:15 |
|
#14 |
Member
Os
Join Date: Jun 2017
Posts: 80
Rep Power: 9 |
||
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
OpenFoam Parallel run on in docker container | shang | OpenFOAM Running, Solving & CFD | 0 | September 8, 2016 15:54 |
unable to run in parallel with OpenFOAM 2.2 on CentOS | einatlev | OpenFOAM Running, Solving & CFD | 9 | June 26, 2014 01:24 |
[mesh manipulation] Cannot get refineMesh to run in parallel | smschnob | OpenFOAM Meshing & Mesh Conversion | 2 | June 3, 2014 12:20 |
New OpenFOAM Forum Structure | jola | OpenFOAM | 2 | October 19, 2011 07:55 |
Parallel run of OpenFOAM in linux and windows side by side | m2montazari | OpenFOAM Running, Solving & CFD | 5 | June 24, 2011 04:26 |