[SPARK-16405] Add metrics and source for external shuffle service

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.1.0
• Component/s: Shuffle, Spark Core
• Labels: Metrics Monitoring features
• Assignee: YangyangLiu
• Reporter: YangyangLiu
• Created: 06/Jul/16 22:22
• Updated: 17/May/20 18:31
• Resolved: 12/Jul/16 17:14

Description

ExternalShuffleService is essential for spark. In order to better monitor shuffle service, we added various metrics in shuffle service and ExternalShuffleServiceSource for metric system.

Issue Links

• is related to: SPARK-18364 Expose metrics for YarnShuffleService
• links to: [Github] Pull Request #14080 (lovexi)