Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-10097

ML Evaluator should indicate if metric should be maximized or minimized

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.5.0
    • Component/s: ML
    • Labels:
      None
    • Target Version/s:

      Description

      ML Evaluator currently requires that metrics be maximized (bigger is better). That is counterintuitive for some metrics. Currently, we hackily negate some metrics in RegressionEvaluator, which is weird. Instead, we should:

      • Return the metric as expected (e.g., "rmse" should return RMSE, not its negation).
      • Provide an indicator of whether the metric should be maximized or minimized.

      Model selection algorithms can use the indicator as needed.

        Attachments

          Activity

            People

            • Assignee:
              fliang Feynman Liang
              Reporter:
              josephkb Joseph K. Bradley
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: