Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-2540

LocalBufferPool.requestBuffer gets into infinite loop

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Cannot Reproduce
    • Affects Version/s: None
    • Fix Version/s: 0.9.1, 0.10.0
    • Component/s: None
    • Labels:
      None

      Description

      I'm trying to run a complicated computation that looks like this: [1].
      One of the DataSource->Filter->Map chains finishes fine, but the other one freezes. Debugging shows that it is spinning in the while loop in LocalBufferPool.requestBuffer.

      askToRecycle is false. Both numberOfRequestedMemorySegments and currentPoolSize is 128, so it never goes into that if either.

      This is a stack trace: [2]

      And here is the code, if you would like to run it: [3]. Unfortunately, I can't make it more minimal, becuase if I remove some operators, the problem disappears. The class to start is malom.Solver. (On first run, it calculates some lookuptables for a few minutes, and puts them into /tmp/movegen)

      [1] http://compalg.inf.elte.hu/~ggevay/flink/plan.txt
      [2] http://compalg.inf.elte.hu/~ggevay/flink/stacktrace.txt
      [3] https://github.com/ggevay/flink/tree/deadlock-malom

        Attachments

          Activity

            People

            • Assignee:
              uce Ufuk Celebi
              Reporter:
              ggevay Gabor Gevay
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: