[SPARK-3723] DecisionTree, RandomForest: Add more instrumentation

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Incomplete
• Component/s: ML
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: Joseph K. Bradley
• Created: 29/Sep/14 18:27
• Updated: 10/Apr/22 12:49
• Resolved: 08/Oct/19 05:44

Description

Some simple instrumentation would help advanced users understand performance, and to check whether parameters (such as maxMemoryInMB) need to be tuned.

Most important instrumentation (simple):

• min, avg, max nodes per group
• number of groups (passes over data)

More advanced instrumentation:

• For each tree (or averaged over trees), training set accuracy after training each level. This would be useful for visualizing learning behavior (to convince oneself that model selection was being done correctly).

Issue Links

• Is contained by: SPARK-14045 DecisionTree improvement umbrella
• Is contained by: SPARK-14046 RandomForest improvement umbrella
• links to: [Github] Pull Request #13881 (smurching)
• links to: [Github] Pull Request #36130 (zero323)
• links to: [Github] Pull Request #36130 (zero323)