Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-3627

Task stuck on lock in StreamSource when cancelling

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: API / DataStream
    • Labels:

      Description

      I've seen this occur a couple of times when the # of network buffers is set too low. The job fails with the an appropriate message indicating that the user should increase the # of network buffers. However, some of the task threads then hang with a stack trace similar to the following.

      2016-03-16 13:38:54,017 WARN org.apache.flink.runtime.taskmanager.Task - Task 'Source: EventGenerator -> (Flat Map, blah -> Filter -> Projection -> Flat Map -> Timestamps/Watermarks -> Map) (46/144)' did not react to cancelling signal, but is stuck in method:
      org.apache.flink.streaming.api.operators.StreamSource$ManualWatermarkContext.collect(StreamSource.java:317)
      flink.benchmark.generator.LoadGeneratorSource.run(LoadGeneratorSource.java:38)
      org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:78)
      org.apache.flink.streaming.runtime.tasks.SourceStreamTask.run(SourceStreamTask.java:56)
      org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:224)
      org.apache.flink.runtime.taskmanager.Task.run(Task.java:559)
      java.lang.Thread.run(Thread.java:745)

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              jgrier Jamie Grier
            • Votes:
              1 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated: