[STORM-1848] NotSerializableException when using storm-kafka spout with event logging

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.0.0, 1.0.1
• Fix Version/s: 2.0.0, 1.0.2, 1.1.0
• Component/s: storm-kafka
• Epic Link: Release Apache Storm 1.0.2
• Assignee: Stig Rohde Døssing
• Reporter: Stig Rohde Døssing
• Created: 18/May/16 11:11
• Updated: 24/May/16 20:39
• Resolved: 24/May/16 20:39

Description

We deployed a topology to multiple workers and set topology.eventlogger.executors to be identical to the number of workers. When the debug button in Storm UI is pressed, the spout will start throwing NotSerializableExceptions.

java.lang.RuntimeException: java.lang.RuntimeException: java.io.NotSerializableException: org.apache.storm.kafka.PartitionManager$KafkaMessageId at org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:452) at (snip)

KafkaMessageId should be made serializable.

Issue Links

• links to: GitHub Pull Request #1428