Error when downloading 2023 ERA5 data with dev branch of flex_extract

[jpianezze]

Hi all,

I tried to download ERA5 data for January 2023 using dev branch of flex_extract :

git clone https://www.flexpart.eu/gitmob/flex_extract
cd flex_extract
git checkout dev

and I have this error :

marsclass: EA
dataset: None
type: AN
levtype: ML
levelist: 90/to/137
repres: 
date: 20230111/to/20230111
resol: 255
stream: OPER
area: -10.125/0.0/-70.3125/100.125
time: 00/01/02/03/04/05/06/07/08/09/10/11/12/13/14/15/16/17/18/19/20/21/22/23
step: 00
expver: 1
number: OFF
accuracy: 24
grid: 0.28125/0.28125
gaussian: 
target: /home/piaj/03_workdir/2F_devel_FLEXPART/test_flex_extract/flex_extract/Run/Workspace/EA5_MAPIO_20230111_20230116/ANOG__ML.20230111.12834.12835.grb
param: 130.128/133.128/131.128/132.128/077.128/246.128/247.128
target: /home/piaj/03_workdir/2F_devel_FLEXPART/test_flex_extract/flex_extract/Run/Workspace/EA5_MAPIO_20230111_20230116/ANOG__ML.20230111.12834.12835.grb
RETRIEVE ERA5 WITH CDS API!
2023-04-04 16:18:57,268 INFO Welcome to the CDS
2023-04-04 16:18:57,268 INFO Sending request to https://cds.climate.copernicus.eu/api/v2/resources/reanalysis-era5-complete
2023-04-04 16:18:57,306 INFO Request is queued
ll
2023-04-04 16:21:48,674 INFO Request is running
2023-04-04 16:25:15,525 INFO Request is failed
2023-04-04 16:25:15,525 ERROR Message: the request you have submitted is not valid
2023-04-04 16:25:15,525 ERROR Reason:  Last error is -43; Expected 8064, got 5760.; Request failed; Some errors reported (last error -1)
2023-04-04 16:25:15,525 ERROR   Traceback (most recent call last):
2023-04-04 16:25:15,525 ERROR     File "/opt/cdstoolbox/cdscompute/cdscompute/cdshandlers/services/handler.py", line 59, in handle_request
2023-04-04 16:25:15,525 ERROR       result = cached(context.method, proc, context, context.args, context.kwargs)
2023-04-04 16:25:15,525 ERROR     File "/opt/cdstoolbox/cdscompute/cdscompute/caching.py", line 108, in cached
2023-04-04 16:25:15,525 ERROR       result = proc(context, *context.args, **context.kwargs)
2023-04-04 16:25:15,525 ERROR     File "/opt/cdstoolbox/cdscompute/cdscompute/services.py", line 124, in __call__
2023-04-04 16:25:15,525 ERROR       return p(*args, **kwargs)
2023-04-04 16:25:15,525 ERROR     File "/opt/cdstoolbox/cdscompute/cdscompute/services.py", line 60, in __call__
2023-04-04 16:25:15,526 ERROR       return self.proc(context, *args, **kwargs)
2023-04-04 16:25:15,526 ERROR     File "/home/cds/cdsservices/services/mars/mars.py", line 53, in external
2023-04-04 16:25:15,526 ERROR       return mars(context, request, **kwargs)
2023-04-04 16:25:15,526 ERROR     File "/home/cds/cdsservices/services/mars/mars.py", line 20, in mars
2023-04-04 16:25:15,526 ERROR       execute_mars(context, requests, info)
2023-04-04 16:25:15,526 ERROR     File "/home/cds/cdsservices/services/mars/execute_mars.py", line 20, in execute_mars
2023-04-04 16:25:15,526 ERROR       exception=MarsException)
2023-04-04 16:25:15,526 ERROR     File "/opt/cdstoolbox/cdscompute/cdscompute/context.py", line 209, in run_command
2023-04-04 16:25:15,526 ERROR       raise exception(call, proc.returncode, output)
2023-04-04 16:25:15,526 ERROR   home.cds.cdsservices.services.mars.__init__.py.exceptions.MarsException: Last error is -43; Expected 8064, got 5760.; Request failed; Some errors reported (last error -1)

Previous extractions for OG_OROLSM_SL.20230111.12834.12835.grb and FCOG_acc_SL.20230110.12834.12835.grb are ok. It's only for the model levels that the extraction crashes ...

Is the flex_extract tool is not yet adapted for recent (2023) ERA5 data ?

I managed to retrieve the ERA5 data for this date using a classic CDS API query successfully.

Thanks in advance for your help.

[xu_ru]

i am wonder which version of flex_extract you use, i noticed 7.1.2? may be suitable for download ERA5 data, i also struggling to download ERA5 data in 2023, but failed.

[jpianezze]

Hi Xu_ru,

I used the dev Git branch from 7.1.2 version.

For your information, extraction of ERA5 data for January 2023 now works, but I've tried to download ERA5 data for April 2023 and it failed with the same error mentioned in this ticket.

So, I guess we can only extract ERA5 data 3 months before the current date using flex_extract tools from local computer. By example, in June 2023, we can extract up to March 2023, in July it will be April, etc...

This ticket can be closed because there's no issue with flex_extract tools, finally.