Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-2365 Copycat checklist
  3. KAFKA-2626

Null offsets in copycat causes exception in OffsetStorageWriter

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.9.0.0
    • Component/s: KafkaConnect
    • Labels:
      None

      Description

      [2015-10-07 16:20:39,052] ERROR CRITICAL: Failed to serialize offset data, making it impossible to commit offsets under namespace wikipedia-irc-source. This likely won't recover unless the unserializable partition or offset information is overwritten. (org.apache.kafka.copycat.storage.OffsetStorageWriter:152)
      [2015-10-07 16:20:39,053] ERROR Cause of serialization failure: (org.apache.kafka.copycat.storage.OffsetStorageWriter:155)
      java.lang.NullPointerException
          at org.apache.kafka.copycat.storage.OffsetUtils.validateFormat(OffsetUtils.java:34)
          at org.apache.kafka.copycat.storage.OffsetStorageWriter.doFlush(OffsetStorageWriter.java:141)
          at org.apache.kafka.copycat.runtime.WorkerSourceTask.commitOffsets(WorkerSourceTask.java:223)
          at org.apache.kafka.copycat.runtime.WorkerSqourceTask.stop(WorkerSourceTask.java:100)
          at org.apache.kafka.copycat.runtime.Worker.stopTask(Worker.java:188)
          at org.apache.kafka.copycat.runtime.standalone.StandaloneHerder.removeConnectorTasks(StandaloneHerder.java:210)
          at org.apache.kafka.copycat.runtime.standalone.StandaloneHerder.stopConnector(StandaloneHerder.java:155)
          at org.apache.kafka.copycat.runtime.standalone.StandaloneHerder.stop(StandaloneHerder.java:60)
          at org.apache.kafka.copycat.runtime.Copycat.stop(Copycat.java:66)
          at org.apache.kafka.copycat.runtime.Copycat$ShutdownHook.run(Copycat.java:88)
      [2015-10-07 16:20:39,055] ERROR Failed to flush org.apache.kafka.copycat.runtime.WorkerSourceTask$2@12782f6 offsets to storage:  (org.apache.kafka.copycat.runtime.WorkerSourceTask:227)
      java.lang.NullPointerException
          at org.apache.kafka.copycat.storage.OffsetUtils.validateFormat(OffsetUtils.java:34)
          at org.apache.kafka.copycat.storage.OffsetStorageWriter.doFlush(OffsetStorageWriter.java:141)
          at org.apache.kafka.copycat.runtime.WorkerSourceTask.commitOffsets(WorkerSourceTask.java:223)
          at org.apache.kafka.copycat.runtime.WorkerSourceTask.stop(WorkerSourceTask.java:100)
          at org.apache.kafka.copycat.runtime.Worker.stopTask(Worker.java:188)
          at org.apache.kafka.copycat.runtime.standalone.StandaloneHerder.removeConnectorTasks(StandaloneHerder.java:210)
          at org.apache.kafka.copycat.runtime.standalone.StandaloneHerder.stopConnector(StandaloneHerder.java:155)
          at org.apache.kafka.copycat.runtime.standalone.StandaloneHerder.stop(StandaloneHerder.java:60)
          at org.apache.kafka.copycat.runtime.Copycat.stop(Copycat.java:66)
          at org.apache.kafka.copycat.runtime.Copycat$ShutdownHook.run(Copycat.java:88)
      [2015-10-07 16:20:39,055] INFO Starting graceful shutdown of thread WorkerSourceTask-wikipedia-irc-source-0 (org.apache.kafka.copycat.util.ShutdownableThread:119)
      [2015-10-07 16:20:39,056] INFO Herder stopped (org.apache.kafka.copycat.runtime.standalone.StandaloneHerder:64)
      [2015-10-07 16:20:39,056] INFO Worker stopping (org.apache.kafka.copycat.runtime.Worker:104)
      [2015-10-07 16:20:39,056] INFO Stopped FileOffsetBackingStore (org.apache.kafka.copycat.storage.FileOffsetBackingStore:61)
      [2015-10-07 16:20:39,056] INFO Worker stopped (org.apache.kafka.copycat.runtime.Worker:133)
      [2015-10-07 16:20:39,057] INFO Copycat stopped (org.apache.kafka.copycat.runtime.Copycat:69)

        Attachments

          Activity

            People

            • Assignee:
              ewencp Ewen Cheslack-Postava
              Reporter:
              ewencp Ewen Cheslack-Postava
              Reviewer:
              Guozhang Wang
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: