Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-10097

ML Evaluator should indicate if metric should be maximized or minimized

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.5.0
    • ML
    • None

    Description

      ML Evaluator currently requires that metrics be maximized (bigger is better). That is counterintuitive for some metrics. Currently, we hackily negate some metrics in RegressionEvaluator, which is weird. Instead, we should:

      • Return the metric as expected (e.g., "rmse" should return RMSE, not its negation).
      • Provide an indicator of whether the metric should be maximized or minimized.

      Model selection algorithms can use the indicator as needed.

      Attachments

        Activity

          People

            fliang Feynman Liang
            josephkb Joseph K. Bradley
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: