Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Incomplete
-
2.1.1
-
None
Description
This JIRA is a request to bring in PySparks MLLib evaluation metrics to parity with the Scala API. For example in BinaryClassificationMetrics there are only two eval metrics exposed to pyspark, areaUnderROC and areaUnderPR while scala has support for a much wider set of eval metrics including precision recall curves and the ability to set thresholds for recall and precision values. These evaluation metrics are critical for understanding and seeing the performance of trained models and should be available to those using the pyspak api's.