[jnanabrao]

OpenFOAM details
OpenFOAM-6, 64 bit installation on Xeon cluster using Compiler: intel-oneapi-compilers-2022.1.0-gcc-11.2.0-iesppt2 MPI:intel-oneapi-mpi-2021.5.1-oneapi-2022.0.0-6gejcyq loaded through 'module load' command



When does the error occur?
On using scotch decomposition method. Other decomposition methods (simple, hierarchical) work fine, indicating it is a problem with scotch libraries. (I don't have metis)



Which Scotch version and how was it compiled.
scotch_6.0.6 was compiled with the attached Makefile and scotch.h files.


Scotch compilation throws following warning:

gotst.c(229): warning #63: shift count is too large
    statdat.heigmin = SCOTCH_NUMMAX;

but compiles successfully.


Compilation of $FOAM_SRC/parallel folder is successful but on trying to decompose the case, error is shown as follows

ERROR: graphCheck: arc data do not match

Note:Compilation of 32 bit for the same versions of scotch and OpenFOAM was successful and scotch decomposition works fine for it. The scotch.h for that has

typedef int SCOTCH_Num;

and

#define SCOTCH_NUMMAX               ((int) (((unsigned int) 1 << ((sizeof (int) << 3) - 1)) - 1))

Other things tried: I have tried to link Gcc compiled 64 bit library for Scotch during compilation of $FOAM_SRC/parallel but the icc/icpc compiler does not read the ptscotch.h file and quits compilation.


I looked for the graphCheck error online and found it was a bug way back in the time of OF2 but could not find the commit.



Any help is deeply appreciated.

JBR