[STORM-277] Kafka-Spout does not support parallelism(unpredictable behaviour)

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.9.2-incubating
• Component/s: storm-kafka
• Labels: kafka-0.8
• Assignee: Amol Fasale
• Reporter: Amol Fasale
• Created: 05/Apr/14 10:17
• Updated: 09/Nov/15 12:39
• Resolved: 08/Aug/14 18:19

Description

I'm using storm-kafka-0.8-plus for storm and kafka integration, storm spout works fine when parallelism is set to 1, but when to support increased event load, kafka-spout is set to parallelism > 1, but it seems to be kafka-spout does not distribute the load across the workers(some times, cases like higher parallelism, kafka-spout distribute the load on 3/4 workers but unpredictable distribution of tuples)

Issue Links

• is related to: STORM-208 Add storm-kafka as a module