source: flex_extract.git/Testing/Regression/Mars_request/README.md @ be6c0a2

ctbtodev
Last change on this file since be6c0a2 was be6c0a2, checked in by Anne Philipp <anne.philipp@…>, 4 years ago

added Readme to tests; changed directory structure; added recent test results;

  • Property mode set to 100644
File size: 2.2 KB
Line 
1# Testcase - Mars request comparison
2
3This testcase is composed of a number of comparisons of mars requests from two different flex_extract versions.
4
5## Description
6
7A single test compares the content of mars requests from two flex_extract versions. It checks for equal number of columns in the requests, if both versions have the same number of requests and the same request content.
8
9The CONTROL files to be tested are stored in the CONTROL - directory. The corresponding mars request files of the previous version are stored in the directory 7.0.4. These are the references for version 7.1. During the execution of this test, the mars request files for version 7.1 are created and stored ( overwritten ) in directory 7.1. Results of the tests are stored in log files in the Log dir. Some extra output is printed on standard output.
10
11A log message could look like:
12
13Compare mars requests between version 7.0.4 and version 7.1 :
14... CONTROL_OD.OPER.highres.gauss_mr ... OK!
15... CONTROL_OD.OPER.highres.eta_mr ... OK!
16... CONTROL_OD.OPER.global.025_mr ... OK!
17... CONTROL_OD.OPER.FC.twiceaday_mr ... OK!
18... CONTROL_OD.OPER.FC.36hours_mr ... OK!
19... CONTROL_OD.OPER.4V.operational_mr ... OK!
20... CONTROL_OD.ENFO.PF_mr ... FAILED!
21...     Unconsistency happend to be in column: step
22
23... CONTROL_OD.ENFO.CF_mr ... FAILED!
24...     Unconsistency happend to be in column: step
25
26... CONTROL_OD.ELDA.FC.eta.ens.double_mr ... FAILED!
27...     Unconsistency happend to be in column: date
28
29... CONTROL_EI_mr ... OK!
30... CONTROL_EI.public_mr ... OK!
31... CONTROL_EA5_mr ... OK!
32... CONTROL_EA5.public_mr ... OK!
33... CONTROL_EA5.highres_mr ... OK!
34... CONTROL_CV_mr ... OK!
35... CONTROL_CF_mr ... OK!
36... CONTROL_CERA_mr ... OK!
37... CONTROL_CERA.public_mr ... OK!
38
39
40
41
42## Usage
43
44python test_cmp_mars_requests.py <previous-version> <version-to-be-tested>
45
46e.g. python test_cmp_mars_requests.py 7.0.4 7.1
47
48## Author
49 Anne Philipp
50
51
52## License
53    (C) Copyright 2014-2019.
54
55    SPDX-License-Identifier: CC-BY-4.0
56
57    This work is licensed under the Creative Commons Attribution 4.0
58    International License. To view a copy of this license, visit
59    http://creativecommons.org/licenses/by/4.0/ or send a letter to
60    Creative Commons, PO Box 1866, Mountain View, CA 94042, USA.
Note: See TracBrowser for help on using the repository browser.
hosted by ZAMG