diff --git a/README.md b/README.md index 8d69d3fecf94937cae3d5e9640a05a68da9ee6d3..76b8316fd214865e252b672438a09daa79ed181c 100644 --- a/README.md +++ b/README.md @@ -46,11 +46,10 @@ The application codes that constitute the UEABS are: The Alya System is a Computational Mechanics code capable of solving different physics, each one with its own modelization characteristics, in a coupled way. Among the problems it solves are: convection-diffusion reactions, incompressible flows, compressible flows, turbulence, bi-phasic flows and free surface, excitable media, acoustics, thermal flow, quantum mechanics (DFT) and solid mechanics (large strain). ALYA is written in Fortran 90/95 and parallelized using MPI and OpenMP. - Web site: https://www.bsc.es/computer-applications/alya-system -- Code download: https://repository.prace-ri.eu/ueabs/ALYA/2.1/Alya.tar.gz -- Build instructions: https://repository.prace-ri.eu/git/UEABS/ueabs/blob/r2.1/alya/ALYA_Build_README.txt -- Test Case A: https://repository.prace-ri.eu/ueabs/ALYA/2.1/TestCaseA.tar.gz -- Test Case B: https://repository.prace-ri.eu/ueabs/ALYA/2.1/TestCaseB.tar.gz -- Run instructions: https://repository.prace-ri.eu/git/UEABS/ueabs/blob/r2.1/alya/ALYA_Run_README.txt +- Code download: https://gitlab.com/bsc-alya/open-alya +- Build and run instructions: https://repository.prace-ri.eu/git/UEABS/ueabs/-/blob/r2.2-dev/alya/README.md +- Test Case A: https://gitlab.com/bsc-alya/benchmarks/sphere-16M +- Test Case B: https://gitlab.com/bsc-alya/benchmarks/sphere-132M # Code_Saturne diff --git a/alya/README.md b/alya/README.md index e18a3aa42d764bedd29ea076c3073277495df397..17edf4e3e48ef9b034f93729b48b545e8ec4ace6 100644 --- a/alya/README.md +++ b/alya/README.md @@ -11,45 +11,43 @@ The Alya System is a Computational Mechanics code capable of solving different p * Web site: https://www.bsc.es/computer-applications/alya-system -* Code download: https://repository.prace-ri.eu/ueabs/ALYA/2.1/Alya.tar.gz +* Code download: https://gitlab.com/bsc-alya/open-alya -* Test Case A: https://repository.prace-ri.eu/ueabs/ALYA/2.1/TestCaseA.tar.gz +* Test Case A: https://gitlab.com/bsc-alya/benchmarks/sphere-16M -* Test Case B: https://repository.prace-ri.eu/ueabs/ALYA/2.1/TestCaseB.tar.gz +* Test Case B: https://gitlab.com/bsc-alya/benchmarks/sphere-132M ## Mechanics of Building Benchmark -Alya builds the makefile from the compilation options defined in config.in. In order to build ALYA (Alya.x), please follow these steps after unpack the tar.gz: +You can compile alya using CMake. It follows the classic CMake configuration, except for the compiler management that has been customized by the developers. + +### Creation of the build directory + +In your alya directory, create a new build directory: -Go to to directory: Executables/unix ``` -cd Executables/unix +mkdir build +cd build ``` -Edit config.in (some default config.in files can be found in directory configure.in): +### Configuration -* Select your own MPI wrappers and paths -* Select size of integers. Default is 4 bytes, For 8 bytes, select -DI8 -* Choose your metis version, metis-4.0 or metis-5.1.0_i8 for 8-bytes integers +To configure cmake using the command line, type the following: -Configure Alya: + cmake .. - ./configure -x nastin parall +If you want to customize the build options, use -DOPTION=value. For example, to enable GPU as it follows: -Compile metis: + cmake .. -DWITH_GPU=ON - make metis4 +### Compilation -or - - make metis5 - -Finally, compile Alya: - make -j 8 + make -j 8 +For more information: https://gitlab.com/bsc-alya/alya/-/wikis/Documentation/Installation ## Mechanics of Running Benchmark diff --git a/alya/configure.in/config.in.amd b/alya/configure.in/config.in.amd deleted file mode 100644 index 6e4076164bd0bc69962fdbc9935d35795464c905..0000000000000000000000000000000000000000 --- a/alya/configure.in/config.in.amd +++ /dev/null @@ -1,416 +0,0 @@ -################################################################### -# IFORT CONFIGURE # -#MN4 RECOMENDED MODULE: # -#module load intel/2017.4 impi/2017.4 # -################################################################### - -#@Compiler: Using Intel Fortran Compiler ifort. -F77 = mpif90 -F90 = mpif90 -FCOCC = mpicc -c -FCFLAGS = -module $O -c -FPPFLAGS = -fpp -EXTRALIB = -EXTRAINC = -fa2p = mpif90 -module ../../Utils/user/alya2pos -c -fpp -fa2plk = mpif90 - -################################################################### -# PERFORMANCE FLAGS # -################################################################### - -#@Optimization: O3 -FOPT = -O3 - -#Compilation flags applied only to the Source/modules folder -#@Special flags only for Souce/modules folder activaded. -#MODULEFLAGS = - -#Uncomment the following line to enable NDIME as a parameter (OPTIMIZATION FOR 3D PROBLEMS) -#@Optimization for 3D PROBLEMS activated. -CSALYA := $(CSALYA) -DNDIMEPAR - -#Uncomment the following line for DEBUG AND CHECKING FLAGS -#@Debug flags activated. -#CSALYA := $(CSALYA) -ftrapuv -check all,noarg_temp_created -traceback -debug full -warn all,nodec,nointerfaces -fp-stack-check -ansi-alias - -#Vectorization: put vector size (in principle=4 for MN) -#@Vectorization activated. -CSALYA := $(CSALYA) -DVECTOR_SIZE=16 - -#@Marenostrum IV Optimizations -CSALYA := $(CSALYA) -mavx2 -axCORE-AVX2,CORE-AVX512,MIC-AVX512 - -################################################################### -# PROFILING FLAGS # -################################################################### - -# Uncomment the following line to generate profiling info files -#@Profiling info files will be generated. -#CSALYA := $(CSALYA) -profile-loops=all -profile-loops-report=2 - -################################################################### -# EXTRAE FLAGS # -################################################################### - -# Uncomment the following line to compile Alya using extrae -# 1. Define EXTRAE_HOME -# 2. Add xml file. See e.g. in /apps/BSCTOOLS/extrae/latest/impi_2017_4/share/example/*/extrae.xml -# 3. In batch file, use: srun ./trace.sh Alya.x xxx - -#@Linking with Extrae -#EXTRAE_HOME =/apps/BSCTOOLS/extrae/latest/impi_2017_4 -#EXTRALIB := $(EXTRALIB) -L${EXTRAE_HOME}/lib/ -lmpitracef -#@Enabling Extrae user calls (normal) -#CSALYA := $(CSALYA) -DEXTRAE - -################################################################### -# METIS LIBRARY # -################################################################### - -#@Using Metis 4.0 -EXTRALIB := $(EXTRALIB) -L../../Thirdparties/metis-4.0 -lmetis -CSALYA := $(CSALYA) -DMETIS - -#@Using Metis 5.0.2 or metis 5.1.0 -#CSALYA := $(CSALYA) -DV5METIS -#CSALYA := $(CSALYA) -DV51METIS -#@Using Metis 5.0.2 or metis 5.1.0 for MAC -#EXTRALIB := $(EXTRALIB) -L../../Thirdparties/metis-5.0.2_i8/build/Darwin-x86_64/libmetis -lmetis -#EXTRALIB := $(EXTRALIB) -L../../Thirdparties/metis-5.1.2_i8/build/Darwin-x86_64/libmetis -lmetis -#@Using Metis 5.0.2 or metis 5.1.0 for Linux -#EXTRALIB := $(EXTRALIB) -L../../Thirdparties/metis-5.0.2_i8/build/Linux-x86_64/libmetis -lmetis -#EXTRALIB := $(EXTRALIB) -L../../Thirdparties/metis-5.1.0_i8/build/Linux-x86_64/libmetis -lmetis - -#@Using parametis. -#CSALYA := $(CSALYA) -DPARMETIS -#EXTRALIB := $(EXTRALIB) -L../../Thirdparties/ - -################################################################### -# ZOLTAN LIBRARY # -################################################################### - -#EXTRALIB := $(EXTRALIB) -L/gpfs/projects/bsc21/bsc21499/Zoltan_v3.83/Build/lib -lzoltan -#CSALYA := $(CSALYA) -I/gpfs/projects/bsc21/bsc21499/Zoltan_v3.83/Build/include -#CSALYA := $(CSALYA) -DZOLTAN - -################################################################### -# BLAS LIBRARY # -################################################################### - -# Uncomment the following lines for using blas -#@BLAS Activated -#EXTRALIB := $(EXTRALIB) -lblas -#CSALYA := $(CSALYA) -DBLAS - -################################################################### -# MPI/THREADS/TASKS # -################################################################### - -# Uncomment the following lines for sequential (NOMPI) version -#@Sequential ALYA. -#VERSIONMPI = nompi -#CSALYA := $(CSALYA) -DMPI_OFF - -# Uncomment the following lines for OPENMP version -#@OpenMP Activated. heap-arrays option may be used to stack overflow and have Alya crash -#CSALYA := $(CSALYA) -qopenmp -#CSALYA := $(CSALYA) -heap-arrays -#EXTRALIB := $(EXTRALIB) -qopenmp - -# Uncomment the following line to disable OPENMP coloring -#@OpenMP Coloring Activated. -#CSALYA := $(CSALYA) -DNO_COLORING - -# Uncomment the following line to enable OMPSS in order to activate -# loops with multidependencies whenever we have a race condition -#@OMPPS Activated. -#CSALYA := $(CSALYA) -DALYA_OMPSS - -# To activate MPI3 (non-blocking MPI_Allreduce) -#@MPI3 activated. -#CSALYA := $(CSALYA) -DMPI3 - -################################################################### -# DLB # -# To use DLB with OMPSS: Define -DALYA_DLB -DALYA_OMPSS # -# To use DLB barrier: Define -DALYA_DLB_BARRIER # -# If we compile with mercurium, there is no need to link # -# with DLB # -# # -################################################################### - -#@DLB Activated. -#CSALYA := $(CSALYA) -DALYA_DLB -#FCFLAGS := $(FCFLAGS) --dlb -#FPPFLAGS := $(FPPFLAGS) --dlb - -################################################################### -# TALP # -# In the batcj script, run the following way: # -# export DLB_ARGS=--talp # -# module load dlb/git # -# srun env LD_PRELOAD=$DLB_HOME/lib/libdlb_mpi.so ./Alya.x xxx # -# # -################################################################### - -#@DLB_TALP Activated. -#CSALYA := $(CSALYA) -DALYA_TALP -#CSALYA := $(CSALYA) -I$(DLB_HOME)/include -#EXTRALIB := $(EXTRALIB) -L$(DLB_HOME)/lib -ldlb -Wl,-rpath,$(DLB_HOME)/lib - -################################################################### -# INTEGER TYPE # -################################################################### -# Uncomment the following lines for 8 byte integers -#@Integers size: 8 -#CSALYA := $(CSALYA) -DI8 -m64 - - -################################################################### -# CANTERA # -################################################################### -# Uncomment the following lines for Cantera -#@Using Cantera -#CANTERA=1 -#@ Marenostrum 4 -#ROOT_BOOST=/gpfs/projects/bsc21/Cantera-Alya/boost_1_68_0/ -#ROOT_CANTERA=/gpfs/projects/bsc21/Cantera-Alya/cantera/INTEL/ -#@ Nord3 -#ROOT_BOOST=/apps/BOOST/1_53_0/IMPI/include/ -#ROOT_CANTERA=/gpfs/projects/bsc21/Cantera-Alya/cantera/INTEL_NORD3/ -################################################################### -# HDF5 # -# # -#MANDATORY MODULES TO LOAD ON MN3 FOR 4 BYTE INTEGERS VERSION # -#module load HDF5/1.8.14 SZIP # -# # -#MANDATORY MODULES TO LOAD ON MN3 FOR 8 BYTE INTEGERS VERSION # -#module load SZIP/2.1 HDF5/1.8.15p1_static # -# # -#MANDATORY SERVICES TO COMPILE # -#hdfpos # -#MORE INFO:bsccase02.bsc.es/alya/tutorial/hdf5_output.html # -################################################################### - -# Uncomment the following lines for using HDF5 IN 4 BYTE INTEGER VERSION -#@HDF5 4 Bytes integer Activated please load the module HDF5/1.8.14 SZIP -#CSALYA := $(CSALYA) -I/apps/HDF5/1.8.14/INTEL/IMPI/include -#EXTRALIB := $(EXTRALIB) /apps/HDF5/1.8.14/INTEL/IMPI/lib/libhdf5_fortran.a /apps/HDF5/1.8.14/INTEL/IMPI/lib/libhdf5.a -#EXTRALIB := $(EXTRALIB) /apps/HDF5/1.8.14/INTEL/IMPI/lib/libhdf5hl_fortran.a /apps/HDF5/1.8.14/INTEL/IMPI/lib/libhdf5_hl.a -#EXTRALIB := $(EXTRALIB) -L/apps/SZIP/2.1/lib -lsz -L/usr/lib64 -lz -lgpfs - -# Uncomment the following lines for using HDF5 IN 8 BYTE INTEGER VERSION -#@HDF5 8 Bytes integer Activated please load the module SZIP/2.1 HDF5/1.8.15p1_static -#CSALYA := $(CSALYA) -I/apps/HDF5/1.8.15p1/static/include -#EXTRALIB := $(EXTRALIB) /gpfs/apps/MN3/HDF5/1.8.15p1/static/lib/libhdf5_fortran.a /gpfs/apps/MN3/HDF5/1.8.15p1/static/lib/libhdf5_f90cstub.a -#EXTRALIB := $(EXTRALIB) /gpfs/apps/MN3/HDF5/1.8.15p1/static/lib/libhdf5.a /gpfs/apps/MN3/HDF5/1.8.15p1/static/lib/libhdf5_tools.a -#EXTRALIB := $(EXTRALIB) -L/apps/SZIP/2.1/lib -lsz -L/usr/lib64 -lz -lgpfs - -# latest Hdf5 (1.8.16) to be used with latest impi (5.1.2.150) and intel(16.0.1) -# there is module load HDF5/1.8.16-mpi for integers 4 but I have seen it is not necesary to call it -# Toni should clean up this - my reconmendation is to only leave this last version -# moreover there seems to be no need for module load hdf5 (in the i8 case there exists no module load) - -# Uncomment the following lines for using HDF5 IN 4 BYTE INTEGER VERSION -#@HDF5 1.8.16 - 4 Bytes integer Activated -#CSALYA := $(CSALYA) -I/apps/HDF5/1.8.16/INTEL/IMPI/include -#EXTRALIB := $(EXTRALIB) /apps/HDF5/1.8.16/INTEL/IMPI/lib/libhdf5_fortran.a /apps/HDF5/1.8.16/INTEL/IMPI/lib/libhdf5hl_fortran.a -#EXTRALIB := $(EXTRALIB) /apps/HDF5/1.8.16/INTEL/IMPI/lib/libhdf5.a /apps/HDF5/1.8.16/INTEL/IMPI/lib/libhdf5_hl.a -#EXTRALIB := $(EXTRALIB) -L/apps/SZIP/2.1/lib -lsz -L/usr/lib64 -lz -lgpfs - -# Uncomment the following lines for using HDF5 IN 8 BYTE INTEGER VERSION -#@HDF5 1.8.16 - 8 Bytes integer Activated -#CSALYA := $(CSALYA) -I/apps/HDF5/1.8.16/INTEL/IMPI/int8/include -#EXTRALIB := $(EXTRALIB) /apps/HDF5/1.8.16/INTEL/IMPI/int8/lib/libhdf5_fortran.a /apps/HDF5/1.8.16/INTEL/IMPI/int8/lib/libhdf5hl_fortran.a -#EXTRALIB := $(EXTRALIB) /apps/HDF5/1.8.16/INTEL/IMPI/int8/lib/libhdf5.a /apps/HDF5/1.8.16/INTEL/IMPI/int8/lib/libhdf5_hl.a -#EXTRALIB := $(EXTRALIB) -L/apps/SZIP/2.1/lib -lsz -L/usr/lib64 -lz -lgpfs - -################################################################### -# VTK # -# # -#MANDATORY THIRDPARTY COMPILATION # -#Go to Alya/Thirdparties/VTK # -# # -#MORE INFO:bsccase02.bsc.es/alya/tutorial/vtk_output.html # -################################################################### - -# Uncomment the following lines for using VTK as output -#@VTK Output Activated -#CSALYA := $(CSALYA) -DVTK -#EXTRALIB := $(EXTRALIB) ../../Thirdparties/VTK/vtkXMLWriterF.o -L/apps/VTK/6.1.0_patched/lib -lvtkIOXML-6.1 -lvtkIOGeometry-6.1 -#EXTRALIB := $(EXTRALIB) -lvtkIOXMLParser-6.1 -lvtksys-6.1 -lvtkIOCore-6.1 -lvtkCommonExecutionModel-6.1 -lvtkCommonDataModel-6.1 -lvtkCommonMisc-6.1 -#EXTRALIB := $(EXTRALIB) -lvtkCommonSystem-6.1 -lvtkCommonTransforms-6.1 -lvtkCommonMath-6.1 -lvtkCommonCore-6.1 -lvtkzlib-6.1 -#EXTRALIB := $(EXTRALIB) -lvtkjsoncpp-6.1 -lvtkexpat-6.1 -L/gpfs/apps/MN3/INTEL/tbb/lib/intel64/ -ltbb - -################################################################### -# MUMPS # -# in MN4 use module load mkl intel impi mumps/5.1.2_metis4 -# if you just put mumps it loads mumps/5.1.2 that is with metis 5 -################################################################### - -#to automatically switch between metis 4 or 5 -choose one option -- for the moment I have only used metis4 -# because metis 5 was having problems with alya but guillaume seems to have solved that -# metis 5 just leave empty -#MUM_METV := -# metis 4 -#MUM_METV := _metis4 - -#@MUMPS Activated -#CSALYA := $(CSALYA) -DMUMPS -I/apps/MUMPS/5.1.2$(MUM_METV)/INTEL/IMPI/include/ -I${MKLROOT}/include - -#EXTRALIB := $(EXTRALIB) -L/apps/PARMETIS/4.0.3/INTEL/IMPI/lib/ -lparmetis -# you also need to do export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/apps/PARMETIS/4.0.3/INTEL/IMPI/lib/ or put it in your bashrc -# since there is no module load for parmetis - -#EXTRALIB := $(EXTRALIB) -L/apps/MUMPS/5.1.2$(MUM_METV)/INTEL/IMPI/lib -ldmumps -lmumps_common -lpord - -#EXTRALIB := $(EXTRALIB) -L${MKLROOT}/lib/intel64 -lmkl_scalapack_lp64 -lmkl_intel_lp64 -lmkl_sequential -lmkl_core -lmkl_blacs_intelmpi_lp64 -lpthread -lm -ldl - -# en la parte de openmp descomento EXTRALIB := $(EXTRALIB) -qopenmp que MUMPS necesita (ojo agrego la q creo me lo dijo ifort) - -#EXTRALIB := $(EXTRALIB) -L${MKLROOT}/lib/intel64 -lmkl_intel_lp64 -lmkl_core -lmkl_sequential -lpthread -lm -lmkl_blacs_intelmpi_ilp64 -lmkl_blacs_intelmpi_lp64 -lmkl_scalapack_ilp64 -lmkl_scalapack_lp64 - - -################################################################### -# NINJA # -#GPU based solvers : GMRES,DEFLATED_CG,CG # -#Specify solver in configuration as: # -#GMRES -------------> GGMR # -#CG ----------------> GCG # -#DEFLATED_CG -------> GDECG # -#GPU Multi Grid-----> GAMGX(Requires CONFIGURATION_FILE in solver)# -#export CUDA_HOME to CUDA version to be used # -################################################################### -# Uncomment the following lines to enable NINJA -#@NINJA Activated (Alya With GPU) -#GPU_HOME := ${CUDA_HOME}/ -#CSALYA := $(CSALYA) -DNINJA -#EXTRALIB := $(EXTRALIB) -L../../Thirdparties/ninja -L${GPU_HOME}lib64/ -lninja -lcublas_static -lcusparse_static -lculibos -lcudart -lpthread -lstdc++ -ldl -lcusolver - -# NINJA also support AMGX. Uncomment the following lines and set AMGX_HOME -#AMGX_HOME := -#CSALYA := $(CSALYA) -DAMGX -#EXTRALIB := $(EXTRALIB) -L${AMGX_HOME}/lib -lamgxsh - -################################################################### -# INVIZ # -#IN situ Visulization, using NVIDIA INDEX (GPUs only) # -#export CUDA_HOME to CUDA version to be used # -#export MPI_HOME to MPI version under use # -#export NVINDEX_ROOT to NVIDIA INDEX suite # -################################################################### -#Uncomment the following lines -#@ INVIZ Activated. -#CSALYA := $(CSALYA) -DINVIZ -#EXTRALIB := $(EXTRALIB) -L../../Thirdparties/inviz -linviz -lviewer -lz -lm -lHalf -llog4cplus -lrt -pthread -lstdc++ -ldl -lmpi_cxx -lcudart - -################################################################### -# CATALYST # -# # -#MANDATORY THIRDPARTY COMPILATION # -#Go to Alya/Thirdparties/Catalyst # -# # -#MORE INFO:hadrien.calmet at bsc.es # -################################################################### -# Uncomment the following lines for using CATALYST as output -#@CATALYST Activated. -#CSALYA := $(CSALYA) -DVTK -DCATA -mt_mpi -I../../Thirdparties/Catalyst -#EXTRALIB := $(EXTRALIB) ../../Thirdparties/VTK/vtkXMLWriterF.o ../../Thirdparties/Catalyst/FEFortranAdaptor.o ../../Thirdparties/Catalyst/FECxxAdaptor.o -#EXTRALIB := $(EXTRALIB) -L/apps/PARAVIEW/4.2.0/lib/paraview-4.2/ -lvtkIOXML-pv4.2 -lvtkIOGeometry-pv4.2 -#EXTRALIB := $(EXTRALIB) -lvtkIOXMLParser-pv4.2 -lvtksys-pv4.2 -lvtkIOCore-pv4.2 -lvtkCommonExecutionModel-pv4.2 -lvtkCommonDataModel-pv4.2 -#EXTRALIB := $(EXTRALIB) -lvtkCommonMisc-pv4.2 -lvtkCommonSystem-pv4.2 -lvtkCommonTransforms-pv4.2 -lvtkCommonMath-pv4.2 -lvtkCommonCore-pv4.2 -#EXTRALIB := $(EXTRALIB) -lvtkzlib-pv4.2 -lvtkjsoncpp-pv4.2 -lvtkexpat-pv4.2 -lvtkPVPythonCatalyst-pv4.2 -lvtkPVCatalyst-pv4.2 -lvtkPythonInterpreter-pv4.2 -#EXTRALIB := $(EXTRALIB) -lvtkUtilitiesPythonInitializer-pv4.2 -lvtkPVServerManagerCore-pv4.2 -lvtkPVServerImplementationCore-pv4.2 -lvtkPVClientServerCoreCore-pv4.2 -#EXTRALIB := $(EXTRALIB) -lvtkFiltersParallel-pv4.2 -lvtkFiltersModeling-pv4.2 -lvtkRenderingCore-pv4.2 -lvtkFiltersExtraction-pv4.2 -lvtkFiltersStatistics-pv4.2 -#EXTRALIB := $(EXTRALIB) -lvtkImagingFourier-pv4.2 -lvtkImagingCore-pv4.2 -lvtkalglib-pv4.2 -lvtkFiltersGeometry-pv4.2 -lvtkFiltersSources-pv4.2 -#EXTRALIB := $(EXTRALIB) -lvtkFiltersGeneral-pv4.2 -lvtkCommonComputationalGeometry-pv4.2 -lvtkFiltersProgrammable-pv4.2 -lvtkPVVTKExtensionsCore-pv4.2 -#EXTRALIB := $(EXTRALIB) -lvtkPVCommon-pv4.2 -lvtkClientServer-pv4.2 -lvtkFiltersCore-pv4.2 -lvtkParallelMPI-pv4.2 -lvtkParallelCore-pv4.2 -lvtkIOLegacy-pv4.2 -#EXTRALIB := $(EXTRALIB) -lprotobuf -lvtkWrappingPython27Core-pv4.2 -lvtkpugixml-pv4.2 -lvtkPVServerManagerApplication-pv4.2 -L/gpfs/apps/MN3/INTEL/tbb/lib/intel64/ -ltbb - - -################################################################### -# PSBLAS & MLD2P4 # -################################################################### -# goes first else problem at link time -# for use with ./configure --with-psblas=/gpfs/projects/bsc21/WORK-HERBERT/svn/solvers-herbert/Thirdparties/psblas3-development -#CSALYA := $(CSALYA) -I../../Thirdparties/mld2p4-2-development/modules -#EXTRALIB := $(EXTRALIB) -L../../Thirdparties/mld2p4-2-development/lib -lmld_prec - -# for use with ./configure --with-blas=" -L${MKLROOT}/lib/intel64 -lmkl_intel_lp64 -lmkl_sequential -lmkl_core -lmkl_blacs_intelmpi_lp64 -lpthread -lm -ldl" --with-include-path =" -I${MKLROOT}/include" in psblas -#CSALYA := $(CSALYA) -DINC_PSBLAS -I${MKLROOT}/include -I../../Thirdparties/psblas3-development/modules -#EXTRALIB := $(EXTRALIB) -L${MKLROOT}/lib/intel64 -lmkl_intel_lp64 -lmkl_sequential -lmkl_core -lmkl_blacs_intelmpi_lp64 -lpthread -lm -ldl -L../../Thirdparties/psblas3-development/lib -lpsb_krylov -lpsb_prec -lpsb_util -lpsb_base - - -# solo cambio para que use la psblas ya compilado por salvatore -#CSALYA := $(CSALYA) -DINC_PSBLAS -I${MKLROOT}/include -I/gpfs/scratch/bsc21/bsc21495/NUMERICAL/PSBLAS/Intel/modules -#EXTRALIB := $(EXTRALIB) -L${MKLROOT}/lib/intel64 -lmkl_intel_lp64 -lmkl_sequential -lmkl_core -lmkl_blacs_intelmpi_lp64 -lpthread -lm -ldl -L/gpfs/scratch/bsc21/bsc21495/NUMERICAL/PSBLAS/Intel/lib -lmld_prec -lpsb_krylov -lpsb_prec -lpsb_util -lpsb_base - - -################################################################### -# AGMG Flags # -################################################################### -# the library yvan had sent me expired I created a new one with his object files using 'ar cr libdagmg_par.a dagmg_mpi.o' - -# parallel version prof (copy dagmg_par.o from Thirdparties/agmg) -#CSALYA := $(CSALYA) -DPARAL_AGMG -Duse_dagmg_mumps -I${MKLROOT}/include -#EXTRALIB := $(EXTRALIB) -L${MKLROOT}/lib/intel64 -lmkl_intel_lp64 -lmkl_core -lmkl_sequential -lpthread -lm -lmkl_blacs_intelmpi_lp64 -lmkl_scalapack_lp64 -L../../Thirdparties/agmg/ -ldagmg_par - -################################################################### -# SUNDIALS CVODE # -################################################################### - -# Uncomment the following lines for using Sundials CVode -#@Sundials CVode Activated -#EXTRALIB := $(EXTRALIB) ../../Thirdparties/sundials/sundials-install/lib/*.a ../../Thirdparties/sundials/sundials-install/lib/libsundials_cvode.a - -################################################################### -# DBParicles LIBRARY # -################################################################### - -# Uncomment the following lines for using DBParticles library -#@DBParicles Activated -#CSALYA := $(CSALYA) -DDBPARTICLES -#--FOR THRIFT connector-- -#@DBParicles THRIFT connector ON -#EXTRALIB := $(EXTRALIB) -L../../Thirdparties/dbparticles -ldbparticles -I/usr/local/include/thrift/ -I/usr/local/include -L/usr/local/lib -lm -lstdc++ -#EXTRALIB := $(EXTRALIB) -lthrift -lthriftnb -lthriftqt -lthriftz -#--FOR CASSANDRA connector-- -#@DBParicles CASSANDRA ON -#EXTRALIB := $(EXTRALIB) ../../Thirdparties/dbparticles/MurmurHash3.o -L../../Thirdparties/dbparticles -ldbparticles -I/usr/lib/x86_64-linux-gnu/include -L/usr/lib/x86_64-linux-gnu -luv -lcassandra -I/usr/local/include -L/usr/local/lib -lm -lstdc++ - -################################################################### -# WSMP SOLVER ILLINOIS # -################################################################### - -# Uncomment the following lines to use WSMP library -#@WSMP SOLVER ILLINOIS Activated -#CSALYA := $(CSALYA) -DWSMP -#EXTRALIB := $(EXTRALIB) /gpfs/projects/bsc21/bsc21103/wsmpint/wsmp-Linux64-Intel/lib/ -lwsmp64 -lpthread /apps/LAPACK/3.5.0/lib -mkl - -################################################################### -# MPI-IO # -# # -#MORE INFO:damien.dosimont at bsc.es # -################################################################### -# Uncomment the following lines to generate I/O log files -#@I/O log files will be generated. -#CSALYA := $(CSALYA) -DMPIOLOG - -################################################################### -# BOAST # -# # -#MORE INFO:damien.dosimont at bsc.es # -################################################################### - -# This section will be filled automatically by BOAST. -# Don't add or touch anything - -#START_SECTION_BOAST -#END_SECTION_BOAST - -################################################################### -# DO NOT TOUCH # -################################################################### -FCFLAGS := $(FCFLAGS) $(CSALYA) $(EXTRAINC) - diff --git a/alya/configure.in/config.in.gpu b/alya/configure.in/config.in.gpu deleted file mode 100644 index 8ea0a93525831210d5334bcb9426eefbfd08c130..0000000000000000000000000000000000000000 --- a/alya/configure.in/config.in.gpu +++ /dev/null @@ -1,292 +0,0 @@ -################################################################### -# PGI CONFIGURE # -#POWER9 RECOMENDED MODULE: # -#module load ompi/3.0.0 pgi/18.4 # -################################################################### - -F77 = OMPI_FC=pgfortran mpif90 -F90 = OMPI_FC=pgfortran mpif90 -FCOCC = cc -c -FCFLAGS = -c -fast -Minfo=all -acc -ta=tesla:cuda10.1 -Mpreprocess -I./Objects_x/ -Mbackslash -Mextend -Mnoopenmp -Munroll -Mnoidiom -module $O -FPPFLAGS = -EXTRALIB = -lc -EXTRAINC = -fa2p = pgfortran -c -x f95-cpp-input -DMPI_OFF -J../../Utils/user/alya2pos -I../../Utils/user/alya2pos -fa2plk = pgfortran - -################################################################### -# PERFORMANCE FLAGS # -################################################################### -#MINUM -#FOPT = -O1 -#MAXIMUM (I have elimated -xHost due to observations by Yacine) -FOPT = -O3 - -#Compilation flags applied only to the Source/modules folder -#MODULEFLAGS = -ipo - -# Uncomment the following line to enable NDIME as a parameter (OPTIMIZATION FOR 3D PROBLEMS) -CSALYA := $(CSALYA) -DNDIMEPAR -DOPENACCHHH -DSUPER_FAST -DDETAILED_TIMES - -# Uncomment the following line for DEBUG AND CHECKING FLAGS -#CSALYA := $(CSALYA) -C -Ktrap=fp -Minform=inform - -# Vectorization: put vector size (in principle=4 for MN) -CSALYA := $(CSALYA) -DVECTOR_SIZE=32768 - -################################################################### -# USER SPECIFIC FLAGS # -################################################################### -# HERBERT -#CSALYA := $(CSALYA) -DDETAILS_ORTHOMIN - -################################################################### -# PROFILING FLAGS # -################################################################### -# Uncomment the following line to generate profiling info files -#CSALYA := $(CSALYA) -profile-loops=all -profile-loops-report=2 - -################################################################### -# EXTRAE FLAGS # -################################################################### -# Uncomment the following line to compile Alya using extrae -# Compiler used to compile extrae module (make extrae) -EXTRAE_FC=pgfortran -# Extrae installation directory (for linking) (not necessary if loading extrae using module load extrae) -#EXTRAE_HOME= -#@Linking with Extrae -#EXTRALIB := $(EXTRALIB) -L${EXTRAE_HOME}/lib/ -lmpitracef extrae_module.o -#@Enabling Extrae user calls (normal) -#CSALYA := $(CSALYA) -DEXTRAE - -################################################################### -# METIS LIBRARY # -################################################################### - -# Uncomment the following lines for using metis 4.0 (default) -EXTRALIB := $(EXTRALIB) -L../../Thirdparties/metis-4.0 -lmetis -acc -ta=tesla:cuda10.1 -CSALYA := $(CSALYA) -DMETIS - -# Uncomment the following lines for using metis 5.0 -#CSALYA := $(CSALYA) -DV5METIS -# uncoment FOR MAC -#EXTRALIB := $(EXTRALIB) -L../../Thirdparties/metis-5.0.2_i8/build/Darwin-i386/libmetis -lmetis -# uncoment FOR LINUX -#EXTRALIB := $(EXTRALIB) -L../../Thirdparties/metis-5.0.2_i8/build/Linux-x86_64/libmetis -lmetis - -# Uncomment the following lines for using parmetis -#CSALYA := $(CSALYA) -DPARMETIS -#EXTRALIB := $(EXTRALIB) -L../../Thirdparties/ - -################################################################### -# BLAS LIBRARY # -################################################################### - -# Uncomment the following lines for using blas -#EXTRALIB := $(EXTRALIB) -lblas -#CSALYA := $(CSALYA) -DBLAS - -################################################################### -# MPI/THREADS/TASKS # -################################################################### - -# Uncomment the following lines for sequential (NOMPI) version -#VERSIONMPI = nompi -#CSALYA := $(CSALYA) -DMPI_OFF - -# Uncomment the following lines for OPENMP version -#CSALYA := $(CSALYA) -openmp -#EXTRALIB := $(EXTRALIB) -openmp - -# Uncomment the following line to disable OPENMP coloring -#CSALYA := $(CSALYA) -DNO_COLORING - -# Uncomment the following line to enable OMPSS in order to activate -# loops with multidependencies whenever we have a race condition -#CSALYA := $(CSALYA) -DALYA_OMPSS - -################################################################### -# DLB # -# To use DLB with OMPSS: Define -DALYA_DLB -DALYA_OMPSS # -# To use DLB barrier: Define -DALYA_DLB_BARRIER # -# If we compile with mercurium, there is no need to link # -# with DLB # -# # -################################################################### - -#CSALYA := $(CSALYA) -DALYA_DLB -#FCFLAGS := $(FCFLAGS) --dlb -#FPPFLAGS := $(FPPFLAGS) --dlb - -################################################################### -# INTEGER TYPE # -################################################################### -# Uncomment the following lines for 8 byte integers -#CSALYA := $(CSALYA) -DI8 -m64 -# Uncomment the following line for 8 byte integers ONLY in Metis -# In this mode Alya can work in I4 and Metis in I8 (mixed mode) -# For this option the use of Metis v5 library is mandatory -#CSALYA := $(CSALYA) -DMETISI8 - - -################################################################### -# HDF5 # -# # -#MANDATORY MODULES TO LOAD ON MN3 FOR 4 BYTE INTEGERS VERSION # -#module load HDF5/1.8.14 SZIP # -# # -#MANDATORY MODULES TO LOAD ON MN3 FOR 8 BYTE INTEGERS VERSION # -#module load SZIP/2.1 HDF5/1.8.15p1_static # -# # -#MANDATORY SERVICES TO COMPILE # -#hdfpos # -#MORE INFO:bsccase02.bsc.es/alya/tutorial/hdf5_output.html # -################################################################### - -# Uncomment the following lines for using HDF5 IN 4 BYTE INTEGER VERSION -#CSALYA := $(CSALYA) -I/apps/HDF5/1.8.14/INTEL/IMPI/include -#EXTRALIB := $(EXTRALIB) /apps/HDF5/1.8.14/INTEL/IMPI/lib/libhdf5_fortran.a /apps/HDF5/1.8.14/INTEL/IMPI/lib/libhdf5.a -#EXTRALIB := $(EXTRALIB) /apps/HDF5/1.8.14/INTEL/IMPI/lib/libhdf5hl_fortran.a /apps/HDF5/1.8.14/INTEL/IMPI/lib/libhdf5_hl.a -#EXTRALIB := $(EXTRALIB) -L/apps/SZIP/2.1/lib -lsz -L/usr/lib64 -lz -lgpfs - -# Uncomment the following lines for using HDF5 IN 8 BYTE INTEGER VERSION -#CSALYA := $(CSALYA) -I/apps/HDF5/1.8.15p1/static/include -#EXTRALIB := $(EXTRALIB) /gpfs/apps/MN3/HDF5/1.8.15p1/static/lib/libhdf5_fortran.a /gpfs/apps/MN3/HDF5/1.8.15p1/static/lib/libhdf5_f90cstub.a -#EXTRALIB := $(EXTRALIB) /gpfs/apps/MN3/HDF5/1.8.15p1/static/lib/libhdf5.a /gpfs/apps/MN3/HDF5/1.8.15p1/static/lib/libhdf5_tools.a -#EXTRALIB := $(EXTRALIB) -L/apps/SZIP/2.1/lib -lsz -L/usr/lib64 -lz -lgpfs - -# latest Hdf5 (1.8.16) to be used with latest impi (5.1.2.150) and intel(16.0.1) -# there is module load HDF5/1.8.16-mpi for integers 4 but I have seen it is not necesary to call it -# Toni should clean up this - my reconmendation is to only leave this last version -# moreover there seems to be no need for module load hdf5 (in the i8 case there exists no module load) - -# Uncomment the following lines for using HDF5 IN 4 BYTE INTEGER VERSION -#CSALYA := $(CSALYA) -I/apps/HDF5/1.8.16/INTEL/IMPI/include -#EXTRALIB := $(EXTRALIB) /apps/HDF5/1.8.16/INTEL/IMPI/lib/libhdf5_fortran.a /apps/HDF5/1.8.16/INTEL/IMPI/lib/libhdf5hl_fortran.a -#EXTRALIB := $(EXTRALIB) /apps/HDF5/1.8.16/INTEL/IMPI/lib/libhdf5.a /apps/HDF5/1.8.16/INTEL/IMPI/lib/libhdf5_hl.a -#EXTRALIB := $(EXTRALIB) -L/apps/SZIP/2.1/lib -lsz -L/usr/lib64 -lz -lgpfs - -# Uncomment the following lines for using HDF5 IN 8 BYTE INTEGER VERSION -#CSALYA := $(CSALYA) -I/apps/HDF5/1.8.16/INTEL/IMPI/int8/include -#EXTRALIB := $(EXTRALIB) /apps/HDF5/1.8.16/INTEL/IMPI/int8/lib/libhdf5_fortran.a /apps/HDF5/1.8.16/INTEL/IMPI/int8/lib/libhdf5hl_fortran.a -#EXTRALIB := $(EXTRALIB) /apps/HDF5/1.8.16/INTEL/IMPI/int8/lib/libhdf5.a /apps/HDF5/1.8.16/INTEL/IMPI/int8/lib/libhdf5_hl.a -#EXTRALIB := $(EXTRALIB) -L/apps/SZIP/2.1/lib -lsz -L/usr/lib64 -lz -lgpfs - -################################################################### -# VTK # -# # -#MANDATORY THIRDPARTY COMPILATION # -#Go to Alya/Thirdparties/VTK # -# # -#MORE INFO:bsccase02.bsc.es/alya/tutorial/vtk_output.html # -################################################################### - -# Uncomment the following lines for using VTK as output -#CSALYA := $(CSALYA) -DVTK -#EXTRALIB := $(EXTRALIB) ../../Thirdparties/VTK/vtkXMLWriterF.o -L/apps/VTK/6.1.0_patched/lib -lvtkIOXML-6.1 -lvtkIOGeometry-6.1 -#EXTRALIB := $(EXTRALIB) -lvtkIOXMLParser-6.1 -lvtksys-6.1 -lvtkIOCore-6.1 -lvtkCommonExecutionModel-6.1 -lvtkCommonDataModel-6.1 -lvtkCommonMisc-6.1 -#EXTRALIB := $(EXTRALIB) -lvtkCommonSystem-6.1 -lvtkCommonTransforms-6.1 -lvtkCommonMath-6.1 -lvtkCommonCore-6.1 -lvtkzlib-6.1 -#EXTRALIB := $(EXTRALIB) -lvtkjsoncpp-6.1 -lvtkexpat-6.1 -L/gpfs/apps/MN3/INTEL/tbb/lib/intel64/ -ltbb - -################################################################### -# NINJA # -#GPU based solvers : GMRES,DEFLATED_CG,CG # -#Specify solver in configuration as: # -#GMRES -------------> GGMR # -#CG ----------------> GCG # -#DEFLATED_CG -------> GDECG # -#GPU Multi Grid-----> GAMGX(Requires CONFIGURATION_FILE in solver)# -#export CUDA_HOME to CUDA version to be used # -################################################################### -# Uncomment the following lines to enable NINJA -#GPU_HOME := ${CUDA_HOME}/ -#CSALYA := $(CSALYA) -DNINJA -#EXTRALIB := $(EXTRALIB) -L../../Thirdparties/ninja -L${GPU_HOME}lib64/ -L/lib64 -lninja -lcublas_static -lcublasLt -lcusparse_static -lculibos -lcudart -lpthread -lstdc++ -ldl -lcusolver - -# NINJA also support AMGX. Uncomment the following lines and set AMGX_HOME -#AMGX_HOME := -#CSALYA := $(CSALYA) -DAMGX -#EXTRALIB := $(EXTRALIB) -L${AMGX_HOME}/lib -lamgxsh - -################################################################### -# CATALYST # -# # -#MANDATORY THIRDPARTY COMPILATION # -#Go to Alya/Thirdparties/Catalyst # -# # -#MORE INFO:hadrien.calmet at bsc.es # -################################################################### -# Uncomment the following lines for using CATALYST as output -#CSALYA := $(CSALYA) -DVTK -DCATA -mt_mpi -I../../Thirdparties/Catalyst -#EXTRALIB := $(EXTRALIB) ../../Thirdparties/VTK/vtkXMLWriterF.o ../../Thirdparties/Catalyst/FEFortranAdaptor.o ../../Thirdparties/Catalyst/FECxxAdaptor.o -#EXTRALIB := $(EXTRALIB) -L/apps/PARAVIEW/4.2.0/lib/paraview-4.2/ -lvtkIOXML-pv4.2 -lvtkIOGeometry-pv4.2 -#EXTRALIB := $(EXTRALIB) -lvtkIOXMLParser-pv4.2 -lvtksys-pv4.2 -lvtkIOCore-pv4.2 -lvtkCommonExecutionModel-pv4.2 -lvtkCommonDataModel-pv4.2 -#EXTRALIB := $(EXTRALIB) -lvtkCommonMisc-pv4.2 -lvtkCommonSystem-pv4.2 -lvtkCommonTransforms-pv4.2 -lvtkCommonMath-pv4.2 -lvtkCommonCore-pv4.2 -#EXTRALIB := $(EXTRALIB) -lvtkzlib-pv4.2 -lvtkjsoncpp-pv4.2 -lvtkexpat-pv4.2 -lvtkPVPythonCatalyst-pv4.2 -lvtkPVCatalyst-pv4.2 -lvtkPythonInterpreter-pv4.2 -#EXTRALIB := $(EXTRALIB) -lvtkUtilitiesPythonInitializer-pv4.2 -lvtkPVServerManagerCore-pv4.2 -lvtkPVServerImplementationCore-pv4.2 -lvtkPVClientServerCoreCore-pv4.2 -#EXTRALIB := $(EXTRALIB) -lvtkFiltersParallel-pv4.2 -lvtkFiltersModeling-pv4.2 -lvtkRenderingCore-pv4.2 -lvtkFiltersExtraction-pv4.2 -lvtkFiltersStatistics-pv4.2 -#EXTRALIB := $(EXTRALIB) -lvtkImagingFourier-pv4.2 -lvtkImagingCore-pv4.2 -lvtkalglib-pv4.2 -lvtkFiltersGeometry-pv4.2 -lvtkFiltersSources-pv4.2 -#EXTRALIB := $(EXTRALIB) -lvtkFiltersGeneral-pv4.2 -lvtkCommonComputationalGeometry-pv4.2 -lvtkFiltersProgrammable-pv4.2 -lvtkPVVTKExtensionsCore-pv4.2 -#EXTRALIB := $(EXTRALIB) -lvtkPVCommon-pv4.2 -lvtkClientServer-pv4.2 -lvtkFiltersCore-pv4.2 -lvtkParallelMPI-pv4.2 -lvtkParallelCore-pv4.2 -lvtkIOLegacy-pv4.2 -#EXTRALIB := $(EXTRALIB) -lprotobuf -lvtkWrappingPython27Core-pv4.2 -lvtkpugixml-pv4.2 -lvtkPVServerManagerApplication-pv4.2 -L/gpfs/apps/MN3/INTEL/tbb/lib/intel64/ -ltbb - -################################################################### -# EoCoE Flags # -################################################################### - -# Uncomment the following lines to output matrices # -#CSALYA := $(CSALYA) -Doutmateocoe -# Uncomment the following lines to solve with AGMG # -#MANDATORY MODULES TO LOAD ON MN3 -#module load MKL/11.3 -# serial version -- this is obsolete actually for it to work you need to touch the ifdef in dagmg.f90 -#CSALYA := $(CSALYA) -Dsolve_w_agmg -I${MKLROOT}/include -#EXTRALIB := $(EXTRALIB) -L${MKLROOT}/lib/intel64 -lmkl_intel_lp64 -lmkl_core -lmkl_sequential -# -# -# parallel version academic -#CSALYA := $(CSALYA) -DPARAL_AGMG -DPARAL_AGMG_ACAD -I${MKLROOT}/include -I/gpfs/projects/bsc21/WORK-HERBERT/svnmn3/MUMPS_5.0.1/include -#For Mumps -#EXTRALIB := $(EXTRALIB) -L/gpfs/projects/bsc21/WORK-HERBERT/svnmn3/MUMPS_5.0.1/lib -ldmumps -lmumps_common -lpord -#For agmg -#EXTRALIB := $(EXTRALIB) -L${MKLROOT}/lib/intel64 -lmkl_intel_lp64 -lmkl_core -lmkl_sequential -lpthread -lm -lmkl_blacs_intelmpi_ilp64 -lmkl_blacs_intelmpi_lp64 -lmkl_scalapack_ilp64 -lmkl_scalapack_lp64 -# -# parallel version prof (copy dagmg_par.o from Thirdparties/agmg) -#CSALYA := $(CSALYA) -DPARAL_AGMG -Duse_dagmg_mumps -I${MKLROOT}/include -#For agmg -#EXTRALIB := $(EXTRALIB) -L${MKLROOT}/lib/intel64 -lmkl_intel_lp64 -lmkl_core -lmkl_sequential -lpthread -lm -lmkl_blacs_intelmpi_ilp64 -lmkl_blacs_intelmpi_lp64 -lmkl_scalapack_ilp64 -lmkl_scalapack_lp64 -L../../Thirdparties/agmg/ -ldagmg_par - -################################################################### -# SUNDIALS CVODE # -################################################################### - -# Uncomment the following lines for using Sundials CVode -#EXTRALIB := $(EXTRALIB) ../../Thirdparties/sundials/sundials-install/lib/*.a ../../Thirdparties/sundials/sundials-install/lib/libsundials_cvode.a - - - -################################################################### -# DBParicles LIBRARY # -################################################################### - -# Uncomment the following lines for using DBParticles library -#CSALYA := $(CSALYA) -DDBPARTICLES -#--FOR THRIFT connector-- -#EXTRALIB := $(EXTRALIB) -L../../Thirdparties/dbparticles -ldbparticles -I/usr/local/include/thrift/ -I/usr/local/include -L/usr/local/lib -lm -lstdc++ -#EXTRALIB := $(EXTRALIB) -lthrift -lthriftnb -lthriftqt -lthriftz -#--FOR CASSANDRA connector-- -#EXTRALIB := $(EXTRALIB) ../../Thirdparties/dbparticles/MurmurHash3.o -L../../Thirdparties/dbparticles -ldbparticles -I/usr/lib/x86_64-linux-gnu/include -L/usr/lib/x86_64-linux-gnu -luv -lcassandra -I/usr/local/include -L/usr/local/lib -lm -lstdc++ - -################################################################### -# WSMP SOLVER ILLINOIS # -################################################################### - -# Uncomment the following lines to use WSMP library -#CSALYA := $(CSALYA) -DWSMP -#EXTRALIB := $(EXTRALIB) /gpfs/projects/bsc21/bsc21103/wsmpint/wsmp-Linux64-Intel/lib/ -lwsmp64 -lpthread /apps/LAPACK/3.5.0/lib -mkl - -################################################################### -# DO NOT TOUCH # -################################################################### -FCFLAGS := $(FCFLAGS) $(CSALYA) $(EXTRAINC) - diff --git a/alya/configure.in/config.in.skylake b/alya/configure.in/config.in.skylake deleted file mode 100644 index 920a83d18e4edbac8584fc09020c4ac415528500..0000000000000000000000000000000000000000 --- a/alya/configure.in/config.in.skylake +++ /dev/null @@ -1,416 +0,0 @@ -################################################################### -# IFORT CONFIGURE # -#MN4 RECOMENDED MODULE: # -#module load intel impi # -################################################################### - -#@Compiler: Using Intel Fortran Compiler ifort. -F77 = mpif90 -F90 = mpif90 -FCOCC = mpicc -c -FCFLAGS = -module $O -c -FPPFLAGS = -fpp -EXTRALIB = -EXTRAINC = -fa2p = mpif90 -module ../../Utils/user/alya2pos -c -fpp -fa2plk = mpif90 - -################################################################### -# PERFORMANCE FLAGS # -################################################################### - -#@Optimization: O3 -FOPT = -O3 - -#Compilation flags applied only to the Source/modules folder -#@Special flags only for Souce/modules folder activaded. -#MODULEFLAGS = - -#Uncomment the following line to enable NDIME as a parameter (OPTIMIZATION FOR 3D PROBLEMS) -#@Optimization for 3D PROBLEMS activated. -CSALYA := $(CSALYA) -DNDIMEPAR - -#Uncomment the following line for DEBUG AND CHECKING FLAGS -#@Debug flags activated. -#CSALYA := $(CSALYA) -ftrapuv -check all,noarg_temp_created -traceback -debug full -warn all,nodec,nointerfaces -fp-stack-check -ansi-alias - -#Vectorization: put vector size (in principle=4 for MN) -#@Vectorization activated. -CSALYA := $(CSALYA) -DVECTOR_SIZE=16 - -#@Marenostrum IV Optimizations -CSALYA := $(CSALYA) -xCORE-AVX512 -mtune=skylake -ipo - -################################################################### -# PROFILING FLAGS # -################################################################### - -# Uncomment the following line to generate profiling info files -#@Profiling info files will be generated. -#CSALYA := $(CSALYA) -profile-loops=all -profile-loops-report=2 - -################################################################### -# EXTRAE FLAGS # -################################################################### - -# Uncomment the following line to compile Alya using extrae -# 1. Define EXTRAE_HOME -# 2. Add xml file. See e.g. in /apps/BSCTOOLS/extrae/latest/impi_2017_4/share/example/*/extrae.xml -# 3. In batch file, use: srun ./trace.sh Alya.x xxx - -#@Linking with Extrae -#EXTRAE_HOME =/apps/BSCTOOLS/extrae/latest/impi_2017_4 -#EXTRALIB := $(EXTRALIB) -L${EXTRAE_HOME}/lib/ -lmpitracef -#@Enabling Extrae user calls (normal) -#CSALYA := $(CSALYA) -DEXTRAE - -################################################################### -# METIS LIBRARY # -################################################################### - -#@Using Metis 4.0 -EXTRALIB := $(EXTRALIB) -L../../Thirdparties/metis-4.0 -lmetis -CSALYA := $(CSALYA) -DMETIS - -#@Using Metis 5.0.2 or metis 5.1.0 -#CSALYA := $(CSALYA) -DV5METIS -#CSALYA := $(CSALYA) -DV51METIS -#@Using Metis 5.0.2 or metis 5.1.0 for MAC -#EXTRALIB := $(EXTRALIB) -L../../Thirdparties/metis-5.0.2_i8/build/Darwin-x86_64/libmetis -lmetis -#EXTRALIB := $(EXTRALIB) -L../../Thirdparties/metis-5.1.2_i8/build/Darwin-x86_64/libmetis -lmetis -#@Using Metis 5.0.2 or metis 5.1.0 for Linux -#EXTRALIB := $(EXTRALIB) -L../../Thirdparties/metis-5.0.2_i8/build/Linux-x86_64/libmetis -lmetis -#EXTRALIB := $(EXTRALIB) -L../../Thirdparties/metis-5.1.0_i8/build/Linux-x86_64/libmetis -lmetis - -#@Using parametis. -#CSALYA := $(CSALYA) -DPARMETIS -#EXTRALIB := $(EXTRALIB) -L../../Thirdparties/ - -################################################################### -# ZOLTAN LIBRARY # -################################################################### - -#EXTRALIB := $(EXTRALIB) -L/gpfs/projects/bsc21/bsc21499/Zoltan_v3.83/Build/lib -lzoltan -#CSALYA := $(CSALYA) -I/gpfs/projects/bsc21/bsc21499/Zoltan_v3.83/Build/include -#CSALYA := $(CSALYA) -DZOLTAN - -################################################################### -# BLAS LIBRARY # -################################################################### - -# Uncomment the following lines for using blas -#@BLAS Activated -#EXTRALIB := $(EXTRALIB) -lblas -#CSALYA := $(CSALYA) -DBLAS - -################################################################### -# MPI/THREADS/TASKS # -################################################################### - -# Uncomment the following lines for sequential (NOMPI) version -#@Sequential ALYA. -#VERSIONMPI = nompi -#CSALYA := $(CSALYA) -DMPI_OFF - -# Uncomment the following lines for OPENMP version -#@OpenMP Activated. heap-arrays option may be used to stack overflow and have Alya crash -#CSALYA := $(CSALYA) -qopenmp -#CSALYA := $(CSALYA) -heap-arrays -#EXTRALIB := $(EXTRALIB) -qopenmp - -# Uncomment the following line to disable OPENMP coloring -#@OpenMP Coloring Activated. -#CSALYA := $(CSALYA) -DNO_COLORING - -# Uncomment the following line to enable OMPSS in order to activate -# loops with multidependencies whenever we have a race condition -#@OMPPS Activated. -#CSALYA := $(CSALYA) -DALYA_OMPSS - -# To activate MPI3 (non-blocking MPI_Allreduce) -#@MPI3 activated. -#CSALYA := $(CSALYA) -DMPI3 - -################################################################### -# DLB # -# To use DLB with OMPSS: Define -DALYA_DLB -DALYA_OMPSS # -# To use DLB barrier: Define -DALYA_DLB_BARRIER # -# If we compile with mercurium, there is no need to link # -# with DLB # -# # -################################################################### - -#@DLB Activated. -#CSALYA := $(CSALYA) -DALYA_DLB -#FCFLAGS := $(FCFLAGS) --dlb -#FPPFLAGS := $(FPPFLAGS) --dlb - -################################################################### -# TALP # -# In the batcj script, run the following way: # -# export DLB_ARGS=--talp # -# module load dlb/git # -# srun env LD_PRELOAD=$DLB_HOME/lib/libdlb_mpi.so ./Alya.x xxx # -# # -################################################################### - -#@DLB_TALP Activated. -#CSALYA := $(CSALYA) -DALYA_TALP -#CSALYA := $(CSALYA) -I$(DLB_HOME)/include -#EXTRALIB := $(EXTRALIB) -L$(DLB_HOME)/lib -ldlb -Wl,-rpath,$(DLB_HOME)/lib - -################################################################### -# INTEGER TYPE # -################################################################### -# Uncomment the following lines for 8 byte integers -#@Integers size: 8 -#CSALYA := $(CSALYA) -DI8 -m64 - - -################################################################### -# CANTERA # -################################################################### -# Uncomment the following lines for Cantera -#@Using Cantera -#CANTERA=1 -#@ Marenostrum 4 -#ROOT_BOOST=/gpfs/projects/bsc21/Cantera-Alya/boost_1_68_0/ -#ROOT_CANTERA=/gpfs/projects/bsc21/Cantera-Alya/cantera/INTEL/ -#@ Nord3 -#ROOT_BOOST=/apps/BOOST/1_53_0/IMPI/include/ -#ROOT_CANTERA=/gpfs/projects/bsc21/Cantera-Alya/cantera/INTEL_NORD3/ -################################################################### -# HDF5 # -# # -#MANDATORY MODULES TO LOAD ON MN3 FOR 4 BYTE INTEGERS VERSION # -#module load HDF5/1.8.14 SZIP # -# # -#MANDATORY MODULES TO LOAD ON MN3 FOR 8 BYTE INTEGERS VERSION # -#module load SZIP/2.1 HDF5/1.8.15p1_static # -# # -#MANDATORY SERVICES TO COMPILE # -#hdfpos # -#MORE INFO:bsccase02.bsc.es/alya/tutorial/hdf5_output.html # -################################################################### - -# Uncomment the following lines for using HDF5 IN 4 BYTE INTEGER VERSION -#@HDF5 4 Bytes integer Activated please load the module HDF5/1.8.14 SZIP -#CSALYA := $(CSALYA) -I/apps/HDF5/1.8.14/INTEL/IMPI/include -#EXTRALIB := $(EXTRALIB) /apps/HDF5/1.8.14/INTEL/IMPI/lib/libhdf5_fortran.a /apps/HDF5/1.8.14/INTEL/IMPI/lib/libhdf5.a -#EXTRALIB := $(EXTRALIB) /apps/HDF5/1.8.14/INTEL/IMPI/lib/libhdf5hl_fortran.a /apps/HDF5/1.8.14/INTEL/IMPI/lib/libhdf5_hl.a -#EXTRALIB := $(EXTRALIB) -L/apps/SZIP/2.1/lib -lsz -L/usr/lib64 -lz -lgpfs - -# Uncomment the following lines for using HDF5 IN 8 BYTE INTEGER VERSION -#@HDF5 8 Bytes integer Activated please load the module SZIP/2.1 HDF5/1.8.15p1_static -#CSALYA := $(CSALYA) -I/apps/HDF5/1.8.15p1/static/include -#EXTRALIB := $(EXTRALIB) /gpfs/apps/MN3/HDF5/1.8.15p1/static/lib/libhdf5_fortran.a /gpfs/apps/MN3/HDF5/1.8.15p1/static/lib/libhdf5_f90cstub.a -#EXTRALIB := $(EXTRALIB) /gpfs/apps/MN3/HDF5/1.8.15p1/static/lib/libhdf5.a /gpfs/apps/MN3/HDF5/1.8.15p1/static/lib/libhdf5_tools.a -#EXTRALIB := $(EXTRALIB) -L/apps/SZIP/2.1/lib -lsz -L/usr/lib64 -lz -lgpfs - -# latest Hdf5 (1.8.16) to be used with latest impi (5.1.2.150) and intel(16.0.1) -# there is module load HDF5/1.8.16-mpi for integers 4 but I have seen it is not necesary to call it -# Toni should clean up this - my reconmendation is to only leave this last version -# moreover there seems to be no need for module load hdf5 (in the i8 case there exists no module load) - -# Uncomment the following lines for using HDF5 IN 4 BYTE INTEGER VERSION -#@HDF5 1.8.16 - 4 Bytes integer Activated -#CSALYA := $(CSALYA) -I/apps/HDF5/1.8.16/INTEL/IMPI/include -#EXTRALIB := $(EXTRALIB) /apps/HDF5/1.8.16/INTEL/IMPI/lib/libhdf5_fortran.a /apps/HDF5/1.8.16/INTEL/IMPI/lib/libhdf5hl_fortran.a -#EXTRALIB := $(EXTRALIB) /apps/HDF5/1.8.16/INTEL/IMPI/lib/libhdf5.a /apps/HDF5/1.8.16/INTEL/IMPI/lib/libhdf5_hl.a -#EXTRALIB := $(EXTRALIB) -L/apps/SZIP/2.1/lib -lsz -L/usr/lib64 -lz -lgpfs - -# Uncomment the following lines for using HDF5 IN 8 BYTE INTEGER VERSION -#@HDF5 1.8.16 - 8 Bytes integer Activated -#CSALYA := $(CSALYA) -I/apps/HDF5/1.8.16/INTEL/IMPI/int8/include -#EXTRALIB := $(EXTRALIB) /apps/HDF5/1.8.16/INTEL/IMPI/int8/lib/libhdf5_fortran.a /apps/HDF5/1.8.16/INTEL/IMPI/int8/lib/libhdf5hl_fortran.a -#EXTRALIB := $(EXTRALIB) /apps/HDF5/1.8.16/INTEL/IMPI/int8/lib/libhdf5.a /apps/HDF5/1.8.16/INTEL/IMPI/int8/lib/libhdf5_hl.a -#EXTRALIB := $(EXTRALIB) -L/apps/SZIP/2.1/lib -lsz -L/usr/lib64 -lz -lgpfs - -################################################################### -# VTK # -# # -#MANDATORY THIRDPARTY COMPILATION # -#Go to Alya/Thirdparties/VTK # -# # -#MORE INFO:bsccase02.bsc.es/alya/tutorial/vtk_output.html # -################################################################### - -# Uncomment the following lines for using VTK as output -#@VTK Output Activated -#CSALYA := $(CSALYA) -DVTK -#EXTRALIB := $(EXTRALIB) ../../Thirdparties/VTK/vtkXMLWriterF.o -L/apps/VTK/6.1.0_patched/lib -lvtkIOXML-6.1 -lvtkIOGeometry-6.1 -#EXTRALIB := $(EXTRALIB) -lvtkIOXMLParser-6.1 -lvtksys-6.1 -lvtkIOCore-6.1 -lvtkCommonExecutionModel-6.1 -lvtkCommonDataModel-6.1 -lvtkCommonMisc-6.1 -#EXTRALIB := $(EXTRALIB) -lvtkCommonSystem-6.1 -lvtkCommonTransforms-6.1 -lvtkCommonMath-6.1 -lvtkCommonCore-6.1 -lvtkzlib-6.1 -#EXTRALIB := $(EXTRALIB) -lvtkjsoncpp-6.1 -lvtkexpat-6.1 -L/gpfs/apps/MN3/INTEL/tbb/lib/intel64/ -ltbb - -################################################################### -# MUMPS # -# in MN4 use module load mkl intel impi mumps/5.1.2_metis4 -# if you just put mumps it loads mumps/5.1.2 that is with metis 5 -################################################################### - -#to automatically switch between metis 4 or 5 -choose one option -- for the moment I have only used metis4 -# because metis 5 was having problems with alya but guillaume seems to have solved that -# metis 5 just leave empty -#MUM_METV := -# metis 4 -#MUM_METV := _metis4 - -#@MUMPS Activated -#CSALYA := $(CSALYA) -DMUMPS -I/apps/MUMPS/5.1.2$(MUM_METV)/INTEL/IMPI/include/ -I${MKLROOT}/include - -#EXTRALIB := $(EXTRALIB) -L/apps/PARMETIS/4.0.3/INTEL/IMPI/lib/ -lparmetis -# you also need to do export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/apps/PARMETIS/4.0.3/INTEL/IMPI/lib/ or put it in your bashrc -# since there is no module load for parmetis - -#EXTRALIB := $(EXTRALIB) -L/apps/MUMPS/5.1.2$(MUM_METV)/INTEL/IMPI/lib -ldmumps -lmumps_common -lpord - -#EXTRALIB := $(EXTRALIB) -L${MKLROOT}/lib/intel64 -lmkl_scalapack_lp64 -lmkl_intel_lp64 -lmkl_sequential -lmkl_core -lmkl_blacs_intelmpi_lp64 -lpthread -lm -ldl - -# en la parte de openmp descomento EXTRALIB := $(EXTRALIB) -qopenmp que MUMPS necesita (ojo agrego la q creo me lo dijo ifort) - -#EXTRALIB := $(EXTRALIB) -L${MKLROOT}/lib/intel64 -lmkl_intel_lp64 -lmkl_core -lmkl_sequential -lpthread -lm -lmkl_blacs_intelmpi_ilp64 -lmkl_blacs_intelmpi_lp64 -lmkl_scalapack_ilp64 -lmkl_scalapack_lp64 - - -################################################################### -# NINJA # -#GPU based solvers : GMRES,DEFLATED_CG,CG # -#Specify solver in configuration as: # -#GMRES -------------> GGMR # -#CG ----------------> GCG # -#DEFLATED_CG -------> GDECG # -#GPU Multi Grid-----> GAMGX(Requires CONFIGURATION_FILE in solver)# -#export CUDA_HOME to CUDA version to be used # -################################################################### -# Uncomment the following lines to enable NINJA -#@NINJA Activated (Alya With GPU) -#GPU_HOME := ${CUDA_HOME}/ -#CSALYA := $(CSALYA) -DNINJA -#EXTRALIB := $(EXTRALIB) -L../../Thirdparties/ninja -L${GPU_HOME}lib64/ -lninja -lcublas_static -lcusparse_static -lculibos -lcudart -lpthread -lstdc++ -ldl -lcusolver - -# NINJA also support AMGX. Uncomment the following lines and set AMGX_HOME -#AMGX_HOME := -#CSALYA := $(CSALYA) -DAMGX -#EXTRALIB := $(EXTRALIB) -L${AMGX_HOME}/lib -lamgxsh - -################################################################### -# INVIZ # -#IN situ Visulization, using NVIDIA INDEX (GPUs only) # -#export CUDA_HOME to CUDA version to be used # -#export MPI_HOME to MPI version under use # -#export NVINDEX_ROOT to NVIDIA INDEX suite # -################################################################### -#Uncomment the following lines -#@ INVIZ Activated. -#CSALYA := $(CSALYA) -DINVIZ -#EXTRALIB := $(EXTRALIB) -L../../Thirdparties/inviz -linviz -lviewer -lz -lm -lHalf -llog4cplus -lrt -pthread -lstdc++ -ldl -lmpi_cxx -lcudart - -################################################################### -# CATALYST # -# # -#MANDATORY THIRDPARTY COMPILATION # -#Go to Alya/Thirdparties/Catalyst # -# # -#MORE INFO:hadrien.calmet at bsc.es # -################################################################### -# Uncomment the following lines for using CATALYST as output -#@CATALYST Activated. -#CSALYA := $(CSALYA) -DVTK -DCATA -mt_mpi -I../../Thirdparties/Catalyst -#EXTRALIB := $(EXTRALIB) ../../Thirdparties/VTK/vtkXMLWriterF.o ../../Thirdparties/Catalyst/FEFortranAdaptor.o ../../Thirdparties/Catalyst/FECxxAdaptor.o -#EXTRALIB := $(EXTRALIB) -L/apps/PARAVIEW/4.2.0/lib/paraview-4.2/ -lvtkIOXML-pv4.2 -lvtkIOGeometry-pv4.2 -#EXTRALIB := $(EXTRALIB) -lvtkIOXMLParser-pv4.2 -lvtksys-pv4.2 -lvtkIOCore-pv4.2 -lvtkCommonExecutionModel-pv4.2 -lvtkCommonDataModel-pv4.2 -#EXTRALIB := $(EXTRALIB) -lvtkCommonMisc-pv4.2 -lvtkCommonSystem-pv4.2 -lvtkCommonTransforms-pv4.2 -lvtkCommonMath-pv4.2 -lvtkCommonCore-pv4.2 -#EXTRALIB := $(EXTRALIB) -lvtkzlib-pv4.2 -lvtkjsoncpp-pv4.2 -lvtkexpat-pv4.2 -lvtkPVPythonCatalyst-pv4.2 -lvtkPVCatalyst-pv4.2 -lvtkPythonInterpreter-pv4.2 -#EXTRALIB := $(EXTRALIB) -lvtkUtilitiesPythonInitializer-pv4.2 -lvtkPVServerManagerCore-pv4.2 -lvtkPVServerImplementationCore-pv4.2 -lvtkPVClientServerCoreCore-pv4.2 -#EXTRALIB := $(EXTRALIB) -lvtkFiltersParallel-pv4.2 -lvtkFiltersModeling-pv4.2 -lvtkRenderingCore-pv4.2 -lvtkFiltersExtraction-pv4.2 -lvtkFiltersStatistics-pv4.2 -#EXTRALIB := $(EXTRALIB) -lvtkImagingFourier-pv4.2 -lvtkImagingCore-pv4.2 -lvtkalglib-pv4.2 -lvtkFiltersGeometry-pv4.2 -lvtkFiltersSources-pv4.2 -#EXTRALIB := $(EXTRALIB) -lvtkFiltersGeneral-pv4.2 -lvtkCommonComputationalGeometry-pv4.2 -lvtkFiltersProgrammable-pv4.2 -lvtkPVVTKExtensionsCore-pv4.2 -#EXTRALIB := $(EXTRALIB) -lvtkPVCommon-pv4.2 -lvtkClientServer-pv4.2 -lvtkFiltersCore-pv4.2 -lvtkParallelMPI-pv4.2 -lvtkParallelCore-pv4.2 -lvtkIOLegacy-pv4.2 -#EXTRALIB := $(EXTRALIB) -lprotobuf -lvtkWrappingPython27Core-pv4.2 -lvtkpugixml-pv4.2 -lvtkPVServerManagerApplication-pv4.2 -L/gpfs/apps/MN3/INTEL/tbb/lib/intel64/ -ltbb - - -################################################################### -# PSBLAS & MLD2P4 # -################################################################### -# goes first else problem at link time -# for use with ./configure --with-psblas=/gpfs/projects/bsc21/WORK-HERBERT/svn/solvers-herbert/Thirdparties/psblas3-development -#CSALYA := $(CSALYA) -I../../Thirdparties/mld2p4-2-development/modules -#EXTRALIB := $(EXTRALIB) -L../../Thirdparties/mld2p4-2-development/lib -lmld_prec - -# for use with ./configure --with-blas=" -L${MKLROOT}/lib/intel64 -lmkl_intel_lp64 -lmkl_sequential -lmkl_core -lmkl_blacs_intelmpi_lp64 -lpthread -lm -ldl" --with-include-path =" -I${MKLROOT}/include" in psblas -#CSALYA := $(CSALYA) -DINC_PSBLAS -I${MKLROOT}/include -I../../Thirdparties/psblas3-development/modules -#EXTRALIB := $(EXTRALIB) -L${MKLROOT}/lib/intel64 -lmkl_intel_lp64 -lmkl_sequential -lmkl_core -lmkl_blacs_intelmpi_lp64 -lpthread -lm -ldl -L../../Thirdparties/psblas3-development/lib -lpsb_krylov -lpsb_prec -lpsb_util -lpsb_base - - -# solo cambio para que use la psblas ya compilado por salvatore -#CSALYA := $(CSALYA) -DINC_PSBLAS -I${MKLROOT}/include -I/gpfs/scratch/bsc21/bsc21495/NUMERICAL/PSBLAS/Intel/modules -#EXTRALIB := $(EXTRALIB) -L${MKLROOT}/lib/intel64 -lmkl_intel_lp64 -lmkl_sequential -lmkl_core -lmkl_blacs_intelmpi_lp64 -lpthread -lm -ldl -L/gpfs/scratch/bsc21/bsc21495/NUMERICAL/PSBLAS/Intel/lib -lmld_prec -lpsb_krylov -lpsb_prec -lpsb_util -lpsb_base - - -################################################################### -# AGMG Flags # -################################################################### -# the library yvan had sent me expired I created a new one with his object files using 'ar cr libdagmg_par.a dagmg_mpi.o' - -# parallel version prof (copy dagmg_par.o from Thirdparties/agmg) -#CSALYA := $(CSALYA) -DPARAL_AGMG -Duse_dagmg_mumps -I${MKLROOT}/include -#EXTRALIB := $(EXTRALIB) -L${MKLROOT}/lib/intel64 -lmkl_intel_lp64 -lmkl_core -lmkl_sequential -lpthread -lm -lmkl_blacs_intelmpi_lp64 -lmkl_scalapack_lp64 -L../../Thirdparties/agmg/ -ldagmg_par - -################################################################### -# SUNDIALS CVODE # -################################################################### - -# Uncomment the following lines for using Sundials CVode -#@Sundials CVode Activated -#EXTRALIB := $(EXTRALIB) ../../Thirdparties/sundials/sundials-install/lib/*.a ../../Thirdparties/sundials/sundials-install/lib/libsundials_cvode.a - -################################################################### -# DBParicles LIBRARY # -################################################################### - -# Uncomment the following lines for using DBParticles library -#@DBParicles Activated -#CSALYA := $(CSALYA) -DDBPARTICLES -#--FOR THRIFT connector-- -#@DBParicles THRIFT connector ON -#EXTRALIB := $(EXTRALIB) -L../../Thirdparties/dbparticles -ldbparticles -I/usr/local/include/thrift/ -I/usr/local/include -L/usr/local/lib -lm -lstdc++ -#EXTRALIB := $(EXTRALIB) -lthrift -lthriftnb -lthriftqt -lthriftz -#--FOR CASSANDRA connector-- -#@DBParicles CASSANDRA ON -#EXTRALIB := $(EXTRALIB) ../../Thirdparties/dbparticles/MurmurHash3.o -L../../Thirdparties/dbparticles -ldbparticles -I/usr/lib/x86_64-linux-gnu/include -L/usr/lib/x86_64-linux-gnu -luv -lcassandra -I/usr/local/include -L/usr/local/lib -lm -lstdc++ - -################################################################### -# WSMP SOLVER ILLINOIS # -################################################################### - -# Uncomment the following lines to use WSMP library -#@WSMP SOLVER ILLINOIS Activated -#CSALYA := $(CSALYA) -DWSMP -#EXTRALIB := $(EXTRALIB) /gpfs/projects/bsc21/bsc21103/wsmpint/wsmp-Linux64-Intel/lib/ -lwsmp64 -lpthread /apps/LAPACK/3.5.0/lib -mkl - -################################################################### -# MPI-IO # -# # -#MORE INFO:damien.dosimont at bsc.es # -################################################################### -# Uncomment the following lines to generate I/O log files -#@I/O log files will be generated. -#CSALYA := $(CSALYA) -DMPIOLOG - -################################################################### -# BOAST # -# # -#MORE INFO:damien.dosimont at bsc.es # -################################################################### - -# This section will be filled automatically by BOAST. -# Don't add or touch anything - -#START_SECTION_BOAST -#END_SECTION_BOAST - -################################################################### -# DO NOT TOUCH # -################################################################### -FCFLAGS := $(FCFLAGS) $(CSALYA) $(EXTRAINC) -