[SPARK-24608] report number of iteration/progress for ML training

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Affects Version/s: 2.3.1
• Component/s: ML, MLlib
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: R
• Created: 20/Jun/18 13:43
• Updated: 08/Oct/19 05:44
• Resolved: 08/Oct/19 05:44

Description

Debugging big ML models requires careful control of resources (memory, storage, CPU, progress, etc). Current ML training reports no progress. It would be ideal to be more verbose during training