[STORM-1832] Consistently slow metrics consumer triggers backpressure which will be never back to normal

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.0.0, 2.0.0, 1.0.1
• Fix Version/s: 2.0.0, 1.1.0
• Component/s: storm-core
• Epic Link: Release Apache Storm 1.1.0
• Assignee: Jungtaek Lim
• Reporter: Jungtaek Lim
• Created: 13/May/16 06:47
• Updated: 14/Jul/16 14:40
• Resolved: 04/Jul/16 11:51

Description

If metrics consumer is too slow to keep up processing received messages, eventually backpressure is triggered. Spout throttles, but metrics messages are not throttled so it could be chance for topology to be never back to normal.

While STORM-1698 can resolve this issue, I made this issue to clarify this behavior and mark this as 'bug'.

If you'd like to see its symptom, please refer here: https://github.com/apache/storm/pull/1324#issuecomment-218962460

Issue Links

• is required by: STORM-1698 Asynchronous MetricsConsumerBolt