Changeset b1674ed in flex_extract.git for For_developers/Sphinx/source/Documentation/Input
- Timestamp:
- Apr 1, 2020, 5:03:13 PM (4 years ago)
- Branches:
- master, ctbto, dev
- Children:
- d78851d, e0005c9
- Parents:
- 50f9ca6
- Location:
- For_developers/Sphinx/source/Documentation/Input
- Files:
-
- 10 edited
Legend:
- Unmodified
- Added
- Removed
-
For_developers/Sphinx/source/Documentation/Input/compilejob.rst
rba99230 rb1674ed 74 74 module load emos/455-r64 75 75 export FLEXPART_ROOT_SCRIPTS=${HOME} 76 export MAKEFILE= Makefile.gfortran76 export MAKEFILE=makefile_ecgate 77 77 ;; 78 78 *cca*) … … 88 88 export SCRATCH=/scratch/ms/${GROUP}/${USER} 89 89 export FLEXPART_ROOT_SCRIPTS=${HOME} 90 export MAKEFILE= Makefile.gfortran90 export MAKEFILE=makefile_ecgate 91 91 ;; 92 92 esac … … 95 95 cd ${FLEXPART_ROOT_SCRIPTS}/flex_extract_v${VERSION} # if FLEXPART_ROOT is not set this means cd to the home directory 96 96 tar -xvf ${HOME}/flex_extract_v${VERSION}.tar 97 cd source/fortran98 \rm *.o *.mod CONVERT297 cd Source/Fortran 98 \rm *.o *.mod calc_etadot 99 99 make -f ${MAKEFILE} >flexcompile 2>flexcompile 100 100 101 ls -l CONVERT2>>flexcompile101 ls -l calc_etadot >>flexcompile 102 102 if [ $? -eq 0 ]; then 103 103 echo 'SUCCESS!' >>flexcompile -
For_developers/Sphinx/source/Documentation/Input/control.rst
rd9abaac rb1674ed 34 34 -------------------------------- 35 35 36 A number of example files can be found in the directory :literal:`flex_extract_vX.X/ run/control/`.36 A number of example files can be found in the directory :literal:`flex_extract_vX.X/Run/Control/`. 37 37 They can be used as a template for adaptations and understand what's possible to 38 38 retrieve from ECMWF's archive. -
For_developers/Sphinx/source/Documentation/Input/control_params.rst
rba99230 rb1674ed 4 4 5 5 6 6 7 7 8 .. _ref-control-user: -
For_developers/Sphinx/source/Documentation/Input/ecmwf_env.rst
r30f7911 rb1674ed 3 3 **************************************** 4 4 5 This file contains the user credentials for working on ECMWF servers and transferring files between the ECMWF servers and the local gateway server. It is located in the ``flex_extract_vX.X/ run`` directory and will be created in the installation process for the application modes **remote** and **gateway**.5 This file contains the user credentials for working on ECMWF servers and transferring files between the ECMWF servers and the local gateway server. It is located in the ``flex_extract_vX.X/Run`` directory and will be created in the installation process for the application modes **remote** and **gateway**. 6 6 7 7 This file is based on the template ``ECMWF_ENV.template`` which is located in the ``templates`` directory. … … 9 9 .. note:: 10 10 11 In the **local** mode itis not present.11 In the **local** mode this file is not present. 12 12 13 13 -
For_developers/Sphinx/source/Documentation/Input/examples.rst
rba99230 rb1674ed 3 3 ********************** 4 4 5 ``Flex_extract`` has a couple of example ``CONTROL`` files for a number of different data set constellations in the directory path ``flex_extract_vX.X/ run/control``.5 ``Flex_extract`` has a couple of example ``CONTROL`` files for a number of different data set constellations in the directory path ``flex_extract_vX.X/Run/Control``. 6 6 7 7 Here is a list of the example files and a description of the data set: … … 10 10 This file is not intended to be used with ``flex_extract``. It has a list of all possible parameters and their default values for a quick overview. 11 11 12 CONTROL_CERA 13 CONTROL_CERA.global 14 CONTROL_CERA.public 15 CONTROL_EA5 16 CONTROL_EA5.global 17 CONTROL_EA5.public 18 CONTROL_EI 19 CONTROL_EI.global 20 CONTROL_EI.public 21 CONTROL_OD.ELDA.FC.eta.ens.double 22 CONTROL_OD.ENFO.CF 23 CONTROL_OD.ENFO.CV 24 CONTROL_OD.ENFO.PF 25 CONTROL_OD.ENFO.PF.36hours 26 CONTROL_OD.ENFO.PF.ens 27 CONTROL_OD.OPER.4V.operational 28 CONTROL_OD.OPER.FC.36hours 29 CONTROL_OD.OPER.FC.eta.global 30 CONTROL_OD.OPER.FC.eta.highres 31 CONTROL_OD.OPER.FC.gauss.highres 32 CONTROL_OD.OPER.FC.operational 33 CONTROL_OD.OPER.FC.twiceaday.1hourly 34 CONTROL_OD.OPER.FC.twiceaday.3hourly 12 .. code-block:: bash 13 14 CONTROL_CERA 15 CONTROL_CERA.global 16 CONTROL_CERA.public 17 CONTROL_EA5 18 CONTROL_EA5.global 19 CONTROL_EA5.public 20 CONTROL_EI 21 CONTROL_EI.global 22 CONTROL_EI.public 23 CONTROL_OD.ELDA.FC.eta.ens.double 24 CONTROL_OD.ENFO.CF 25 CONTROL_OD.ENFO.CV 26 CONTROL_OD.ENFO.PF 27 CONTROL_OD.ENFO.PF.36hours 28 CONTROL_OD.ENFO.PF.ens 29 CONTROL_OD.OPER.4V.operational 30 CONTROL_OD.OPER.FC.36hours 31 CONTROL_OD.OPER.FC.eta.global 32 CONTROL_OD.OPER.FC.eta.highres 33 CONTROL_OD.OPER.FC.gauss.highres 34 CONTROL_OD.OPER.FC.operational 35 CONTROL_OD.OPER.FC.twiceaday.1hourly 36 CONTROL_OD.OPER.FC.twiceaday.3hourly 35 37 36 38 -
For_developers/Sphinx/source/Documentation/Input/fortran_makefile.rst
rba99230 rb1674ed 1 *********************************** 2 The Fortran Makefile - `` CONVERT2``3 *********************************** 1 ************************************** 2 The Fortran Makefile - ``calc_etadot`` 3 ************************************** 4 4 5 5 .. _ref-convert: 6 6 7 7 ``Flex_extract``'s Fortran program will be compiled during 8 the installation process to get the executable named `` CONVERT2``.8 the installation process to get the executable named ``calc_etadot``. 9 9 10 `` flex_extract`` has a couple of ``Makefiles`` prepared which can be found in the directory11 ``flex_extract_vX.X/ source/fortran``, where ``vX.X`` should be substituted with the current version number.12 A list of these `` Makefiles`` are shown below:10 ``Flex_extract`` has a couple of ``makefiles`` prepared which can be found in the directory 11 ``flex_extract_vX.X/Source/Fortran``, where ``vX.X`` should be substituted with the current version number. 12 A list of these ``makefiles`` are shown below: 13 13 14 14 … … 16 16 | Files to be used as they are! 17 17 18 | ** Makefile.gfortran**18 | **makefile_ecgate** 19 19 | For the use on ECMWF's server **ecgate**. 20 20 21 | ** Makefile.CRAY**21 | **makefile_cray** 22 22 | For the use on ECMWF's server **cca/ccb**. 23 23 … … 25 25 | It is necessary to adapt **ECCODES_INCLUDE_DIR** and **ECCODES_LIB** 26 26 27 | ** Makefile.local.gfortran**28 | For the use with gfortran compiler .27 | **makefile_fast** 28 | For the use with gfortran compiler and optimization mode. 29 29 30 | ** Makefile.local.ifort**31 | For the use with ifort compiler.30 | **makefile_debug** 31 | For the use with gfortran compiler in debugging mode. 32 32 33 33 34 For instructions on how to adapt the `` Makefiles`` for the local application mode34 For instructions on how to adapt the ``makefiles`` for the local application mode 35 35 please see :ref:`ref-install-local`. 36 36 -
For_developers/Sphinx/source/Documentation/Input/jobscript.rst
rba99230 rb1674ed 5 5 The jobscript is a Korn-shell script which will be created at runtime for each ``flex_extract`` execution in the application modes **remote** and **gateway**. 6 6 7 It is based on the ``job.temp`` template file which is stored in the `` templates`` directory.8 This template is by itself generated in the installation process from a ``job script.template`` template file.7 It is based on the ``job.temp`` template file which is stored in the ``Templates`` directory. 8 This template is by itself generated in the installation process from a ``job.template`` template file. 9 9 10 10 ``Flex_extract`` uses the python package `genshi <https://genshi.edgewall.org/>`_ to generate … … 74 74 module load eccodes/2.12.0 75 75 module load emos/455-r64 76 export PATH=${PATH}:${HOME}/flex_extract_v7.1/ source/python76 export PATH=${PATH}:${HOME}/flex_extract_v7.1/Source/Python 77 77 ;; 78 78 *cca*) … … 83 83 module load emos 84 84 export SCRATCH=${TMPDIR} 85 export PATH=${PATH}:${HOME}/flex_extract_v7.1/ source/python85 export PATH=${PATH}:${HOME}/flex_extract_v7.1/Source/Python 86 86 ;; 87 87 esac -
For_developers/Sphinx/source/Documentation/Input/run.rst
rba99230 rb1674ed 11 11 Based on these input information ``flex_extract`` applies one of the application modes to either retrieve the ECMWF data via a Web API on a local maschine or submit a jobscript to ECMWF servers and retrieve the data there with sending the files to the local system eventually. 12 12 13 14 15 PUT IN HERE A BLOCKDIAGRAM OF RAW PROGRAM FLOW16 13 17 14 … … 43 40 44 41 It is also possible to start ``flex_extract`` directly from command line by using the ``submit.py`` script instead of the wrapping Shell script ``run.sh``. This top-level script is located in 45 ``flex_extract_vX.X/ source/python`` and is executable. With the ``help`` parameter we see again all possible42 ``flex_extract_vX.X/Source/Python`` and is executable. With the ``help`` parameter we see again all possible 46 43 command line parameter. 47 44 -
For_developers/Sphinx/source/Documentation/Input/setup.rst
rba99230 rb1674ed 13 13 - copying tar-ball to target location (depending on application mode and installation path) 14 14 - submit compilation script to batch queue at ECMWF servers (in **remote** and **gateway** mode) or just untar tar-ball at target location (**local mode**) 15 - compilation of the FORTRAN90 program `` CONVERT2``15 - compilation of the FORTRAN90 program ``calc_etadot`` 16 16 17 17 … … 156 156 157 157 It is also possible to start the installation process of ``flex_extract`` directly from command line by using the ``install.py`` script instead of the wrapping Shell script ``setup.sh``. This top-level script is located in 158 ``flex_extract_vX.X/ source/python`` and is executable. With the ``help`` parameter we see again all possible158 ``flex_extract_vX.X/Source/Python`` and is executable. With the ``help`` parameter we see again all possible 159 159 command line parameter. 160 160 -
For_developers/Sphinx/source/Documentation/Input/templates.rst
rba99230 rb1674ed 3 3 ********* 4 4 5 In ``flex_extract`` we use the Python package ` `genshi`` (`ref <https://genshi.edgewall.org/>`_)to create specific files from templates. It is the most efficient way to be able to quickly adapt e.g. the job scripts send to the ECMWF batch queue system or the namelist file für the Fortran program without the need to change the program code.5 In ``flex_extract`` we use the Python package `genshi <https://genshi.edgewall.org/>`_ to create specific files from templates. It is the most efficient way to be able to quickly adapt e.g. the job scripts send to the ECMWF batch queue system or the namelist file für the Fortran program without the need to change the program code. 6 6 7 7 .. note:: … … 15 15 ---------- 16 16 17 This is the template for a Fortran namelist file called ``fort.4`` which will be read by `` CONVERT2``.18 It contains all the parameters `` CONVERT2`` needs.17 This is the template for a Fortran namelist file called ``fort.4`` which will be read by ``calc_etadot``. 18 It contains all the parameters ``calc_etadot`` needs. 19 19 20 20 .. code-block:: fortran … … 125 125 cd $${FLEXPART_ROOT_SCRIPTS}/flex_extract_v$${VERSION} # if FLEXPART_ROOT is not set this means cd to the home directory 126 126 tar -xvf $${HOME}/flex_extract_v$${VERSION}.tar 127 cd source/fortran127 cd Source/Fortran 128 128 \rm *.o *.mod $fortran_program 129 129 make -f $${MAKEFILE} >flexcompile 2>flexcompile … … 191 191 module load eccodes/2.12.0 192 192 module load emos/455-r64 193 export PATH=$${PATH}:$${HOME}/flex_extract_v7.1/ source/python193 export PATH=$${PATH}:$${HOME}/flex_extract_v7.1/Source/Python 194 194 ;; 195 195 *cca*) … … 200 200 module load emos 201 201 export SCRATCH=$${TMPDIR} 202 export PATH=$${PATH}:$${HOME}/flex_extract_v7.1/ source/python202 export PATH=$${PATH}:$${HOME}/flex_extract_v7.1/Source/Python 203 203 ;; 204 204 esac
Note: See TracChangeset
for help on using the changeset viewer.