Changeset f20342a in flex_extract.git for For_developers/Sphinx/source/Ecmwf
- Timestamp:
- May 27, 2020, 8:01:54 PM (4 years ago)
- Branches:
- master, ctbto, dev
- Children:
- 550435b
- Parents:
- a14839a
- Location:
- For_developers/Sphinx/source/Ecmwf
- Files:
-
- 5 edited
Legend:
- Unmodified
- Added
- Removed
-
For_developers/Sphinx/source/Ecmwf/access.rst
rba99230 rf20342a 1 1 ************ 2 Access Modes2 Access modes 3 3 ************ 4 4 … … 8 8 .. _CDS API: https://cds.climate.copernicus.eu/api-how-to 9 9 10 Access to the ECMWF M arsarchive is divided into two groups: **member state** users and **public** users.10 Access to the ECMWF MARS archive is divided into two groups: **member state** users and **public** users. 11 11 12 **Member 13 This access mode allows the user to work directly on the ECMWF Linux Member State Servers or via a Web Access Toolkit ``ecaccess`` through a local Member State Gateway Server. This enables the user to have direct and full access to the Mars archive. There might be some limitations in user rights such as the declined access to the latest forecasts. This has to be discussed with the `Computing Representative`_. This user group is also able to work from their local facilities without a gateway server in the same way a **public** user would. The only difference is the connection with the Web API. However, thisis automatically selected by ``flex_extract``.12 **Member-state user**: 13 This access mode allows the user to work directly on a ECMWF member-state Linux server or via the ``ecaccess`` Web-Access Toolkit through a local member-state Gateway server. This enables the user to have direct and full access to the MARS archive. There might be some limitations in user rights, such as no access to the latest forecasts. In case such data are needed, this has to be agreed upon with the national `Computing Representative`_. This user group is also able to work from their local facilities without a gateway server in the same way a **public** user would. The only difference is the connection with the Web API, which, however, is automatically selected by ``flex_extract``. 14 14 15 15 16 16 **Public user**: 17 This access mode allows every user to access the ECMWF `public datasets`_ from their local facilities. ``Flex_extract`` is able (tested for the use with ``FLEXPART``) to extract the re-analysis datasets such as ERA-Interim and CERA-20C. The main difference to the **member state user** is the method of access with the Web API and the availability of data. For example, in ERA-Interim there is only a 6-hourly temporal resolution instead of 3 hours. The access method is selected by providing the command line argument "public=1" and providing the MARS keyword "dataset" in the ``CONTROL`` file. Also, the user has to explicitly accept the license of the dataset to be retrieved. This can be done as described in the installation process at section :ref:`ref-licence`.17 This access mode allows every user to access the ECMWF `public datasets`_ from their local facilities. ``Flex_extract`` is able to extract the re-analysis datasets such as ERA-Interim and CERA-20C for use with ``FLEXPART`` (tested). The main difference to the **member-state user** is the method of access with the Web API and the availability of data. For example, in ERA-Interim, only a 6-hourly temporal resolution is available instead of 3 hours. The access method is selected by providing the command line argument "public=1" and providing the MARS keyword "dataset" in the ``CONTROL`` file. Also, the user has to explicitly accept the license of the data set to be retrieved. This can be done as described in the installation process at section :ref:`ref-licence`. 18 18 19 19 .. note:: 20 20 21 The availability of the public dataset *ERA5* with the ECMWF Web API was cancelled in March 2019. The oportunity of local retrieval of this dataset was moved to the `Climate Data Store`_ which uses another Web API named `CDS API`_. This Data Store stores the data on explicit webservers for faster and easier access. Unfortunately, for *ERA5* there are only surface level and pressure level data available for *public users*. In the case of a *member user* it is possible to bypass the request to the MARS archive from ECMWF to retrieve the data. ``Flex_extract`` is already modified to use this API so *member user* can already retrieve *ERA5* data while *public users* have to wait until model level are available.21 The availability of the public dataset *ERA5* with the ECMWF Web API was cancelled by ECWMF in March 2019. Local retrieval of this dataset now has to use the `Climate Data Store`_ (CDS) with a different Web API called `CDS API`_. CDS stores the data on dedicated web servers for faster and easier access. Unfortunately, for *ERA5*, only surface level and pressure level data are available for *public users* which is not enough to run FLEXPART. For a *member user*, it is possible to pass the request to the MARS archive to retrieve the data. ``Flex_extract`` is already modified to use this API so a *member user* can already retrieve *ERA5* data for FLEXPART while *public users* have to wait until model level are made available. 22 22 23 23 For information on how to register see :ref:`ref-registration`. -
For_developers/Sphinx/source/Ecmwf/ec-links.rst
rba99230 rf20342a 1 1 ################################ 2 Link Collection for Quick finder2 Link collection 3 3 ################################ 4 4 5 5 6 ECMWF - General Overview6 ECMWF - General overview 7 7 `ECMWF Home <https://www.ecmwf.int/>`_ 8 8 9 `ECMWF Training <https://www.ecmwf.int/en/learning>`_9 `ECMWF training <https://www.ecmwf.int/en/learning>`_ 10 10 11 `General User Documentation <https://software.ecmwf.int/wiki/display/UDOC/User+Documentation>`_11 `General user documentation <https://software.ecmwf.int/wiki/display/UDOC/User+Documentation>`_ 12 12 13 `Software Support <https://confluence.ecmwf.int/display/SUP>`_13 `Software support <https://confluence.ecmwf.int/display/SUP>`_ 14 14 15 15 MARS 16 16 `MARS user documentation <https://confluence.ecmwf.int//display/UDOC/MARS+user+documentation>`_ 17 17 18 `MARS Keywords <https://software.ecmwf.int/wiki/display/UDOC/MARS+keywords>`_18 `MARS keywords <https://software.ecmwf.int/wiki/display/UDOC/MARS+keywords>`_ 19 19 20 `MARS Content <https://confluence.ecmwf.int/display/UDOC/MARS+content>`_20 `MARS content <https://confluence.ecmwf.int/display/UDOC/MARS+content>`_ 21 21 22 `MARS Actions <https://confluence.ecmwf.int/display/UDOC/MARS+actions>`_22 `MARS actions <https://confluence.ecmwf.int/display/UDOC/MARS+actions>`_ 23 23 24 `Parameter Database <https://apps.ecmwf.int/codes/grib/param-db>`_24 `Parameter database <https://apps.ecmwf.int/codes/grib/param-db>`_ 25 25 26 26 Registration 27 `Contact of Computing Representative's <https://www.ecmwf.int/en/about/contact-us/computing-representatives>`_27 `Contacts of Computing Representatives <https://www.ecmwf.int/en/about/contact-us/computing-representatives>`_ 28 28 29 29 `Public registration for ECMWF Web API <https://software.ecmwf.int/wiki/display/WEBAPI/Access+MARS>`_ 30 30 31 `CDS Registration <https://cds.climate.copernicus.eu/user/register>`_31 `CDS registration <https://cds.climate.copernicus.eu/user/register>`_ 32 32 33 Available Member State Datasets 34 `Web Interface for accessing member state datasets <http://apps.ecmwf.int/archive-catalogue/>`_33 Member-State data sets available 34 `Web interface for accessing member-state data sets <http://apps.ecmwf.int/archive-catalogue/>`_ 35 35 36 ` Available datasetsfor member state users <https://www.ecmwf.int/en/forecasts/datasets>`_36 `Data sets available for member state users <https://www.ecmwf.int/en/forecasts/datasets>`_ 37 37 38 Available Public Datasets 39 `Web Interface for accessing public datasets <http://apps.ecmwf.int/datasets/>`_38 Public data sets available 39 `Web interface for accessing public data sets <http://apps.ecmwf.int/datasets/>`_ 40 40 41 `ECMWF's public data sets <https://confluence.ecmwf.int/display/WEBAPI/Available+ECMWF+Public+Datasets>`_41 `ECMWF's public data sets <https://confluence.ecmwf.int/display/WEBAPI/Available+ECMWF+Public+Datasets>`_ 42 42 43 `Public data set Licences <https://software.ecmwf.int/wiki/display/WEBAPI/Available+ECMWF+Public+Datasets>`_43 `Public data set licences <https://software.ecmwf.int/wiki/display/WEBAPI/Available+ECMWF+Public+Datasets>`_ 44 44 45 `ERA5 public dataset Licence <https://cds.climate.copernicus.eu/cdsapp#!/search?type=dataset>`_45 `ERA5 public dataset licence <https://cds.climate.copernicus.eu/cdsapp#!/search?type=dataset>`_ 46 46 47 47 48 48 Datasets 49 49 Overview 50 `Complete list of data sets <https://www.ecmwf.int/en/forecasts/datasets>`_50 `Complete list of data sets <https://www.ecmwf.int/en/forecasts/datasets>`_ 51 51 52 52 `What is climate reanalysis <https://www.ecmwf.int/en/research/climate-reanalysis>`_ … … 57 57 `List of real_time datasets <https://www.ecmwf.int/en/forecasts/datasets/catalogue-ecmwf-real-time-products>`_ 58 58 59 `Atmospheric model - HRES ( ourtypical operational dataset) <https://www.ecmwf.int/en/forecasts/datasets/set-i>`_59 `Atmospheric model - HRES (typical operational dataset) <https://www.ecmwf.int/en/forecasts/datasets/set-i>`_ 60 60 61 61 `Atmospheric model - ENS (15-day ensemble forecast) <https://www.ecmwf.int/en/forecasts/datasets/set-iii>`_ … … 66 66 `ERA-Interim documentation <https://www.ecmwf.int/en/elibrary/8174-era-interim-archive-version-20>`_ 67 67 68 `ERA-Interim data set <https://www.ecmwf.int/en/forecasts/datasets/archive-datasets/reanalysis-datasets/era-interim>`_68 `ERA-Interim data set <https://www.ecmwf.int/en/forecasts/datasets/archive-datasets/reanalysis-datasets/era-interim>`_ 69 69 70 70 CERA-20C 71 71 `What is CERA-20C <https://software.ecmwf.int/wiki/display/CKB/What+is+CERA-20C>`_ 72 72 73 `CERA-20C data set <https://www.ecmwf.int/en/forecasts/datasets/archive-datasets/reanalysis-datasets/cera-20c>`_73 `CERA-20C data set <https://www.ecmwf.int/en/forecasts/datasets/archive-datasets/reanalysis-datasets/cera-20c>`_ 74 74 75 75 ERA5 … … 84 84 `ERA5 Documentation <https://software.ecmwf.int/wiki/display/CKB/ERA5+data+documentation>`_ 85 85 86 Third Party Libraries87 `ECMWF Web API Home <https://software.ecmwf.int/wiki/display/WEBAPI/ECMWF+Web+API+Home>`_86 Third-party libraries 87 `ECMWF Web API home <https://software.ecmwf.int/wiki/display/WEBAPI/ECMWF+Web+API+Home>`_ 88 88 89 89 `Building ECMWF software with gfortran <https://software.ecmwf.int/wiki/display/SUP/2015/05/11/Building+ECMWF+software+with+gfortran>`_ … … 103 103 104 104 105 Scientific Information106 `Octahedral reduced Gaussian Grid <https://confluence.ecmwf.int/display/FCST/Introducing+the+octahedral+reduced+Gaussian+grid>`_105 Scientific information 106 `Octahedral reduced Gaussian grid <https://confluence.ecmwf.int/display/FCST/Introducing+the+octahedral+reduced+Gaussian+grid>`_ 107 107 108 108 `Precipitation <https://www.ecmwf.int/en/newsletter/147/meteorology/use-high-density-observations-precipitation-verification>`_ 109 109 110 110 111 Technical Information of ECMWF serves111 Technical information for ECMWF servers 112 112 113 `Introduct ion presentation toSLURM <https://confluence.ecmwf.int/download/attachments/73008494/intro-slurm-2017.pdf?version=1&modificationDate=1488574096323&api=v2>`_113 `Introductary presentation of SLURM <https://confluence.ecmwf.int/download/attachments/73008494/intro-slurm-2017.pdf?version=1&modificationDate=1488574096323&api=v2>`_ 114 114 115 Trouble shooting116 `ECMWF Web API Troubleshooting <https://confluence.ecmwf.int/display/WEBAPI/Web-API+Troubleshooting>`_115 Trouble-shooting 116 `ECMWF Web API trouble-shooting <https://confluence.ecmwf.int/display/WEBAPI/Web-API+Troubleshooting>`_ 117 117 118 118 -
For_developers/Sphinx/source/Ecmwf/hintsecmwf.rst
rba99230 rf20342a 1 1 ################################## 2 Hints to specify dataset retrieval2 Hints for data set selection 3 3 ################################## 4 4 … … 8 8 9 9 10 How can I find out what data isavailable?10 How can I find out what data are available? 11 11 ========================================== 12 12 13 Go to the `Web Interface for accessing member state datasets <http://apps.ecmwf.int/archive-catalogue/>`_13 Go to the `Web Interface for accessing member-state data sets <http://apps.ecmwf.int/archive-catalogue/>`_ 14 14 and click yourself through the steps to define your set of data and see what is available to you. 15 15 16 For public users there is the `Web Interface for accessing public data sets <http://apps.ecmwf.int/datasets/>`_.16 For public users there is the `Web Interface for accessing public data sets <http://apps.ecmwf.int/datasets/>`_. 17 17 18 18 -
For_developers/Sphinx/source/Ecmwf/msdata.rst
rba99230 rf20342a 1 ######################################### 2 Available Datasets for Member State users3 ######################################### 1 ########################################## 2 Available data sets for member-state users 3 ########################################## 4 4 5 5 6 6 7 Model 7 Model-level data 8 8 ================ 9 9 … … 11 11 12 12 13 Surface leveldata13 Surface data 14 14 ================== 15 15 -
For_developers/Sphinx/source/Ecmwf/pubdata.rst
rba99230 rf20342a 1 Available Datasets for Public users2 *********************************** 1 Available data sets for public users 2 ************************************ 3 3 4 INPREPARATION4 UNDER PREPARATION 5 5 6 6
Note: See TracChangeset
for help on using the changeset viewer.