[FLINK-2108] Add score function for Predictors

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Won't Do
• Component/s: Library / Machine Learning
• Labels: ML pull-request-available
• Assignee: Theodore Vasiloudis
• Reporter: Theodore Vasiloudis
• Created: 28/May/15 15:38
• Updated: 28/Feb/19 22:52
• Resolved: 28/Feb/19 22:52

Description

A score function for Predictor implementations should take a DataSet[(I, O)] and an (optional) scoring measure and return a score.

The DataSet[(I, O)] would probably be the output of the predict function.

For example in MultipleLinearRegression, we can call predict on a labeled dataset, get back predictions for each item in the data, and then call score with the resulting dataset as an argument and we should get back a score for the prediction quality, such as the R^2 score.

Issue Links

• relates to: FLINK-2157 Create evaluation framework for ML library
• requires: FLINK-2297 Add threshold setting for SVM binary predictions
• links to: GitHub Pull Request #902