Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-1848

NotSerializableException when using storm-kafka spout with event logging

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.0.0, 1.0.1
    • Fix Version/s: 2.0.0, 1.0.2, 1.1.0
    • Component/s: storm-kafka
    • Labels:
      None

      Description

      We deployed a topology to multiple workers and set topology.eventlogger.executors to be identical to the number of workers. When the debug button in Storm UI is pressed, the spout will start throwing NotSerializableExceptions.

      java.lang.RuntimeException: java.lang.RuntimeException: java.io.NotSerializableException: org.apache.storm.kafka.PartitionManager$KafkaMessageId at org.apache.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:452) at (snip)

      KafkaMessageId should be made serializable.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Srdo Stig Rohde Døssing
                Reporter:
                Srdo Stig Rohde Døssing
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: