Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-1531

Custom Kryo Serializer fails in itertation scenario

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 0.9
    • 0.9, 0.8.1
    • Runtime / Task
    • None

    Description

      When using iterations with a custom serializer for a domain object, the iteration will fail.

      org.apache.flink.runtime.client.JobExecutionException: com.esotericsoftware.kryo.KryoException: Buffer underflow
      	at org.apache.flink.api.java.typeutils.runtime.NoFetchingInput.require(NoFetchingInput.java:76)
      	at com.esotericsoftware.kryo.io.Input.readVarInt(Input.java:355)
      	at com.esotericsoftware.kryo.util.DefaultClassResolver.readClass(DefaultClassResolver.java:109)
      	at com.esotericsoftware.kryo.Kryo.readClass(Kryo.java:641)
      	at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:752)
      	at org.apache.flink.api.java.typeutils.runtime.KryoSerializer.deserialize(KryoSerializer.java:198)
      	at org.apache.flink.api.java.typeutils.runtime.KryoSerializer.deserialize(KryoSerializer.java:203)
      	at org.apache.flink.runtime.io.disk.InputViewIterator.next(InputViewIterator.java:43)
      	at org.apache.flink.runtime.iterative.task.IterationHeadPactTask.streamOutFinalOutputBulk(IterationHeadPactTask.java:404)
      	at org.apache.flink.runtime.iterative.task.IterationHeadPactTask.run(IterationHeadPactTask.java:377)
      	at org.apache.flink.runtime.operators.RegularPactTask.invoke(RegularPactTask.java:360)
      	at org.apache.flink.runtime.execution.RuntimeEnvironment.run(RuntimeEnvironment.java:204)
      	at java.lang.Thread.run(Thread.java:745)
      

      Attachments

        Activity

          People

            Unassigned Unassigned
            jkirsch Johannes
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: