[SPARK-8468] Cross-validation with RegressionEvaluator prefers higher RMSE

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.4.0
• Fix Version/s: 1.4.1, 1.5.0
• Component/s: ML
• Target Version/s: 1.4.1, 1.5.0
• Assignee: L. C. Hsieh
• Reporter: Chelsea Zhang
• Created: 19/Jun/15 00:46
• Updated: 20/Jun/15 20:02
• Resolved: 20/Jun/15 20:02

Description

Please correct me if I'm wrong, but RegressionEvaluator seems to implement the evaluate() method backwards. The interface expects higher return values from evaluate() to indicate better models. RegressionEvaluator returns RMSE by default - a value we should try to minimize.

Issue Links

• links to: [Github] Pull Request #6905 (viirya)