Description
At the moment all the config evaluation handling is done in a single file. Functionality needs to be separated out into multiple modules for easier integration into other components. At the moment there are three main categories that the code falls into (relevant methods are listed below).
Configuration Parsing
- is_config_valid
- _config_is_well_formed
- _valid_minimal_config
- _contains_unary_metric
- _contains_binary_metric
- _valid_dataset_config_data
- _fetch_built_in_metrics
Evaluation Create
- generate_evaluation_from_config
- _load_dataset
- _prepare_datasets_for_evaluation
- _load_metric
Plot Handling
- plot_from_config
- _draw_contour_plot
Tests
The relevant tests should be factored to match the new code layout as well.
Attachments
Issue Links
- Is contained by
-
CLIMATE-580 Config Based Evaluation Improvements
-
- Resolved
-