[SPARK-17731] Metrics for Structured Streaming

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.2, 2.1.0
• Component/s: Structured Streaming
• Target Version/s: 2.0.2, 2.1.0
• Assignee: Tathagata Das
• Reporter: Tathagata Das
• Created: 29/Sep/16 19:37
• Updated: 01/Nov/16 22:15
• Resolved: 13/Oct/16 20:38

Description

Metrics are needed for monitoring structured streaming apps. Here is the design doc for implementing the necessary metrics.
https://docs.google.com/document/d/1NIdcGuR1B3WIe8t7VxLrt58TJB4DtipWEbj5I_mzJys/edit?usp=sharing

Issue Links

• links to: [Github] Pull Request #15307 (tdas)
• links to: [Github] Pull Request #15472 (tdas)
• links to: [Github] Pull Request #15530 (tdas)
• links to: [Github] Pull Request #15535 (tdas)