[STORM-1700] Introduce 'whitelist' / 'blacklist' option to MetricsConsumer

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.0.0, 2.0.0
• Fix Version/s: 2.0.0, 1.1.0
• Component/s: storm-core
• Assignee: Jungtaek Lim
• Reporter: Jungtaek Lim
• Created: 08/Apr/16 07:20
• Updated: 13/Jun/16 04:21
• Resolved: 13/Jun/16 04:21

Description

Storm provides various metrics by default, and so on some external modules (storm-kafka).

When we register MetricsConsumer, MetricsConsumer should handle all of metrics. If MetricsConsumer cannot keep up with these metrics, only way to keep up is increasing parallelism, which seems limited. Furthermore, some users don't want to care about some metrics since unintended metrics will fill external storage.

Though MetricsConsumer itself can filter metrics by name, it would be better to support filter by Storm side. It will reduce the redundant works for Storm community.

If we provide filter options, it would be great.

Issue Links

• contains: STORM-1698 Asynchronous MetricsConsumerBolt
• links to: GitHub Pull Request #1324
• links to: GitHub Pull Request #1325