[STORM-1539] Improve Storm ACK-ing performance

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Resolved
• Fix Version/s: 1.0.0
• Epic Link: Release Apache Storm 1.0.0
• Assignee: Roshan Naik
• Reporter: Roshan Naik
• Created: 11/Feb/16 22:36
• Updated: 18/Feb/16 02:19
• Resolved: 18/Feb/16 02:19

Description

Profiling a simple speed of light topology, shows that a good chunk of time of the SpoutOutputCollector.emit() is spent in the clojure reduce() function.. which is part of the ACK-ing logic.

Re-implementing this reduce() logic in java gives a big performance boost in both in the Spout.nextTuple() and Bolt.execute()