The CONTROL file

This file is an input file for flex_extract's main script submit.py. It contains the controlling parameters which flex_extract needs to decide on data set specifications, handling of the data retrieved, and general behaviour. The naming convention is usually (but not necessarily):

CONTROL_<Dataset>[.optionalIndications]

There are a number of data sets for which the procedures have been tested, the operational data and the re-analysis datasets CERA-20C, ERA5, and ERA-Interim. The optional indications for the re-analysis data sets mark the files for public users and global domain. For the operational data sets (OD), the file names contain also information of the stream, the field type for forecasts, the method for extracting the vertical wind, and other information such as temporal or horizontal resolution.

Format of CONTROL files

The first string of each line is the parameter name, the following string(s) (separated by spaces) is (are) the parameter values. The parameters can be listed in any order with one parameter per line. Comments are started with a ‘#’ - sign. Some of these parameters can be overruled by the command line parameters given to the submit.py script. All parameters have default values; only those parameters which deviate from default have be listed in the CONTROL files.

Example CONTROL files

A number of example files can be found in the directory flex_extract_vX.X/Run/Control/. They can be used as a template for adaptation, and to understand what can be retrievee from ECMWF’s archives. There is an example for each main data set, and in addition, some more varied with respect to resolution, type of field, or way of retrieving the vertical wind.

CONTROL file

The file CONTROL.documentation documents the available parameters in grouped sections together with their default values. In The CONTROL parameters, you can find a more detailed description with additional hints, possible values, and further information about the setting of these parameters.

CONTROL.documentation
################################################################################
# Comprehensive list of relevant CONTROL file parameters with
# short descriptions and default values. 
#
# For more details on how to select and define parameters 
# please see Table of CONTROLparameters. 
#
# AUTHOR: Anne Philipp
# DATE:   05. February 2019
################################################################################

#===============================================================================
# USER SECTION:
# User specific information for ECMWF server.
# Information are needed for storage or data transfer to local gateway server.
# (OPTIONAL: INFORMATION ARE KNOWN THROUGH EXTRA FILE AFTER INSTALLATION)
#-------------------------------------------------------------------------------
ECUID None
ECGID None
DESTINATION None
GATEWAY None

#===============================================================================
# GENERAL SECTION:
# Specific storage, notification and data transfer settings.
# Selection of ECMWF access interface and extra output options. 
#-------------------------------------------------------------------------------
DEBUG 0
REQUEST 0
PUBLIC 0
OPER 0
ECSTORAGE 0
ECTRANS 0
PREFIX 'EN'
ECFSDIR 'ectmp:/${USER}/econdemand/'
MAILFAIL ['${USER}']
MAILOPS ['${USER}']

#===============================================================================
# TIME SECTION:
# Selection of time period and temporal resolution for extraction period.
#-------------------------------------------------------------------------------
START_DATE 
END_DATE
DATE_CHUNK 3
DTIME None
BASETIME None

#===============================================================================
# DATA SECTION:
# General description of data set.
#-------------------------------------------------------------------------------
CLASS None
DATASET None
STREAM None
NUMBER 'OFF'
EXPVER '1'
FORMAT 'GRIB1'

#===============================================================================
# DATA FIELDS SECTION:
# Specific selection of field composition regarding type, analysis or forecast 
# time and the forecast time step.
#-------------------------------------------------------------------------------
TYPE None
TIME None
STEP None
MAXSTEP None

#===============================================================================
# FLUX DATA FIELDS SECTION:
# Specific selection of flux field composition regarding forecast field type
# the forecast start times and the maximum forecast step per start time.
# Specification of disaggregation method of precipitation data.
#-------------------------------------------------------------------------------
ACCTYPE None
ACCTIME None
ACCMAXSTEP None
RRINT 0

#===============================================================================
# DOMAIN SECTION: 
# Definition of horizontal area, spatial resolution and vertical levels. 
#-------------------------------------------------------------------------------
GRID None
RESOL None
SMOOTH 0
LEFT None
LOWER None
UPPER None
RIGHT None
LEVEL None
LEVELIST None

#===============================================================================
# VERTICAL WIND SECTION:
# Selection of vertical wind calculation method.
#-------------------------------------------------------------------------------
GAUSS 0
ACCURACY 24
OMEGA 0
OMEGADIFF 0
ETA 0
ETADIFF 0
DPDETA 1
ETAPAR 77

#===============================================================================
# ADDITIONAL DATA SECTION:
# Specification of extra data fields to be extracted.
#-------------------------------------------------------------------------------
CWC 0
WRF 0
DOUBLEELDA 0 
ADDPAR None