[STORM-1723] Introduce ClusterMetricsConsumer

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0, 1.0.1
• Fix Version/s: 2.0.0, 1.1.0
• Component/s: storm-core
• Epic Link: Release Apache Storm 1.1.0
• Assignee: Jungtaek Lim
• Reporter: Jungtaek Lim
• Created: 21/Apr/16 11:39
• Updated: 13/Jun/16 05:04
• Resolved: 13/Jun/16 05:04

Description

NOTE: This issue is already discussed shortly. Please refer here for details.

This issue focuses to introduce ClusterMetricsConsumer and provide interface to let users plugin their consumers.

ClusterMetricsConsumers will be attached to Nimbus, and leader of Nimbus will push cluster related metrics to ClusterMetricsConsumer.

Requirements of ClusterMetricsConsumer are here:

• Only leader of Nimbus should publish cluster metrics to consumer.
• Nimbus shouldn't be affected by crashing or heavy latency on consumer.
• Consumer should have resilient when crashing or Nimbus should take care of.

Issue Links

• links to: GitHub Pull Request #1352
• links to: GitHub Pull Request #1460