Custom Query (210 matches)

With the end of February 2019, ECMWF will terminate their ECMWF Web API access to ERA5 data.

This is because the C3S (Copernicus Climate Change Service) has build a new service, the Climate Data Store (CDS)​https://cds.climate.copernicus.eu/. Up to now, they provide online access to a limited set of ERA5 pressure and single level data. The rest is still archived in MARS on ECMWF servers. At some point in time, they will move all ERA5 data to the CDS.

Therefore a new feature for flex_extract have to be added to support ERA5 data download with the new CDS API​https://pypi.org/project/cdsapi/.

I've installed flex_extract in version 7.0.4, following the instructions given in the SIP.pdf file, section 3.2.2, "Installation using a gateway server".

This works fine, I can submit jobs by running submit.py on my local machine, so far so good.

However, I noted that in order to run submit.py on my local machine, I need to have *grib_api* installed locally, which doesn't seem to make sense, as all the computations are being carried out on ECMWF servers.

I would suggest to modify submit.py so that the from GribTools import GribTools comes inside the if args.queue==None block.

Actually, now that I look at the code, it seems to me that GribTools is not used at all in submit.py, so one should be able to just delete that line.

I'm having trouble retrieving hemispheric (i.e., northern hemisphere) ERA5 data using flex_extract version 7.0.4. I'm using the GATEWAY mode, i.e., I have flex_extract installed on my local system to submit jobs to the ECGATE queue.

Installation works fine, and I can retrieve non-hemispheric ERA5 data just fine. E.g., this COMMAND file works fine:

DAY1
DAY2
DTIME 1
TYPE AN AN AN AN AN AN AN AN AN AN AN AN AN AN AN AN AN AN AN AN AN AN AN AN
TIME 00 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23
STEP 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
ACCTYPE FC
ACCTIME 06/18
ACCMAXSTEP 12
M_CLASS EA
M_STREAM OPER
M_NUMBER OFF
M_EXPVER 1
M_GRID 250  
M_LEFT -170000
M_LOWER 10000
M_UPPER 80000
M_RIGHT 170000
M_LEVELIST 1/to/137
M_RESOL 799
M_GAUSS 0
M_ACCURACY 24
M_OMEGA 0
M_OMEGADIFF 0
M_ETA 1
M_ETADIFF 0
M_DPDETA 1
M_SMOOTH 0
M_FORMAT GRIB2
M_ADDPAR /186/187/188/235/139/39
PREFIX EA
ECSTORAGE 0
ECTRANS 1
ECFSDIR ectmp:/${USER}/econdemand/
MAILOPS hilboll@uni-bremen.de
MAILFAIL hilboll@uni-bremen.de
EOF

However, this here does *not* work:

DAY1
DAY2
DTIME 1
TYPE AN AN AN AN AN AN AN AN AN AN AN AN AN AN AN AN AN AN AN AN AN AN AN AN
TIME 00 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23
STEP 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
ACCTYPE FC
ACCTIME 06/18
ACCMAXSTEP 12
M_CLASS EA
M_STREAM OPER
M_NUMBER OFF
M_EXPVER 1
M_GRID 250  
M_LEFT -180000
M_LOWER 00000
M_UPPER 90000
M_RIGHT 180000
M_LEVELIST 1/to/137
M_RESOL 799
M_GAUSS 0
M_ACCURACY 24
M_OMEGA 0
M_OMEGADIFF 0
M_ETA 1
M_ETADIFF 0
M_DPDETA 1
M_SMOOTH 0
M_FORMAT GRIB2
M_ADDPAR /186/187/188/235/139/39
PREFIX EA
ECSTORAGE 0
ECTRANS 1
ECFSDIR ectmp:/${USER}/econdemand/
MAILOPS hilboll@uni-bremen.de
MAILFAIL hilboll@uni-bremen.de
EOF

I tried already different left/right combinations, like -180/180, -179750/180, -180/179750, -179875/179875, and the like.

The error message I'm getting is this:

Program received signal SIGSEGV: Segmentation fault - invalid memory reference.

Backtrace for this error:
#0  0x3dd543250f in ???
#1  0x3dd54896f6 in ???
#2  0x40a1c5 in __rwgrib2_MOD_readlatlon
	at /home/ms/datex/gdmv/flexpart/scripts_gateway/flex_extract_v7.0.4/src/rwGRIB2.f90:72
#3  0x41240b in preconvert
	at /home/ms/datex/gdmv/flexpart/scripts_gateway/flex_extract_v7.0.4/src/preconvert.f90:402
#4  0x418c6d in main
	at /home/ms/datex/gdmv/flexpart/scripts_gateway/flex_extract_v7.0.4/src/preconvert.f90:53