[SPARK-11574] Spark should support StatsD sink out of box

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.6.0, 1.6.1
• Fix Version/s: 2.3.0
• Component/s: Spark Core
• Assignee: Xiaofeng Lin
• Reporter: Xiaofeng Lin
• Created: 08/Nov/15 19:06
• Updated: 12/Dec/22 18:10
• Resolved: 31/Aug/17 00:58

Description

In order to run spark in production, monitoring is essential. StatsD is such a common metric reporting mechanism that it should be supported out of the box. This will enable publishing metrics to monitoring services like datadog, etc.

Issue Links

• is related to: SPARK-14151 Propose to refactor and expose Metrics Sink and Source interface
• links to: [Github] Pull Request #9518 (xflin)