Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-2491 Support Checkpoints After Tasks Finished
  3. FLINK-23698

Pass watermarks in finishedOnRestore tasks

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 1.14.0
    • 1.14.0
    • Runtime / Task
    • None

    Description

      After merging FLINK-23541 there is a bug on restore finished tasks that we are loosing an information that max watermark has been already emitted. As task is finished, it means no new watermark will be ever emitted, while downstream tasks (for example two/multiple input tasks) would be deadlocked waiting for a watermark from an already finished input.

      Attachments

        Issue Links

          relates to

          Sub-task - The sub-task of the issue FLINK-23708 When task is finishedOnRestore Operators shouldn't be used

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Activity

            People

              pnowojski Piotr Nowojski
              pnowojski Piotr Nowojski
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: