Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-2089

"Buffer recycled" IllegalStateException during cancelling

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.10.0
    • Fix Version/s: 0.9.1, 0.10.0
    • Component/s: Runtime / Coordination
    • Labels:
      None

      Description

      Robert Metzger reported the following stack trace during cancelling of high parallelism jobs:

      Error: java.lang.IllegalStateException: Buffer has already been recycled.
      at org.apache.flink.shaded.com.google.common.base.Preconditions.checkState(Preconditions.java:173)
      at org.apache.flink.runtime.io.network.buffer.Buffer.ensureNotRecycled(Buffer.java:142)
      at org.apache.flink.runtime.io.network.buffer.Buffer.getMemorySegment(Buffer.java:78)
      at org.apache.flink.runtime.io.network.api.serialization.SpillingAdaptiveSpanningRecordDeserializer.setNextBuffer(SpillingAdaptiveSpanningRecordDeserializer.java:72)
      at org.apache.flink.runtime.io.network.api.reader.AbstractRecordReader.getNextRecord(AbstractRecordReader.java:80)
      at org.apache.flink.runtime.io.network.api.reader.MutableRecordReader.next(MutableRecordReader.java:34)
      at org.apache.flink.runtime.operators.util.ReaderIterator.next(ReaderIterator.java:73)
      at org.apache.flink.runtime.operators.MapDriver.run(MapDriver.java:96)
      at org.apache.flink.runtime.operators.RegularPactTask.run(RegularPactTask.java:496)
      at org.apache.flink.runtime.operators.RegularPactTask.invoke(RegularPactTask.java:362)
      at org.apache.flink.runtime.taskmanager.Task.run(Task.java:559)
      at java.lang.Thread.run(Thread.java:745)
      

      This looks like a concurrent buffer pool release/buffer usage error. I'm investing this today.

        Attachments

        1. mvnlog.rar
          8 kB
          Min Jiang

          Activity

            People

            • Assignee:
              uce Ufuk Celebi
              Reporter:
              uce Ufuk Celebi
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: