[SPARK-23824] Make inpurityStats publicly accessible in ml.tree.Node

• Type: Wish
• Status: Resolved
• Priority: Minor
• Resolution: Duplicate
• Affects Version/s: 2.1.1
• Component/s: ML
• Assignee: Unassigned
• Reporter: Barry Becker
• Created: 29/Mar/18 19:54
• Updated: 25/Apr/18 21:57
• Resolved: 25/Apr/18 21:57

Description

This is minor, but it is also a very easy fix.

I would like to visualize the structure of a decision tree model, but currently the only means of obtaining the label distribution data at each node of the tree is hidden within each ml.tree.Node inside the impurityStats.

I'm pretty sure that the fix for this is as easy as removing the private[ml] qualifier from occurrences of

private[ml] def impurityStats: ImpurityCalculator
and
override private[ml] val impurityStats: ImpurityCalculator

 

As a workaround, I've put my class that needs access into a  org.apache.spark.ml.tree package in my own repository, but I would really like to not have to do that.

Issue Links

• duplicates: SPARK-14681 Provide label/impurity stats for spark.ml decision tree nodes