Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-2491 Support Checkpoints After Tasks Finished
  3. FLINK-23808

Bypass operators when advanceToEndOfEventTime for both legacy and new source tasks

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.14.0
    • 1.14.0
    • None

    Description

      Currently when end of data processing, the sources would advance to max watermark and emit MAX_WATERMARK. However, currently the output used is the mainOperatorOutput, namely the output of the source operator. If the source operator is chained with other operators and the tasks are finished on restore, there would be problems since the following operators should be skipped, but some operators still have actions when the watermark is advanced, like WatermarkAssignerOperator, which might cause problems.

      Attachments

        Issue Links

          blocks

          Sub-task - The sub-task of the issue FLINK-21090 Add E2E/ITCase test for checkpoints after tasks finished

          • Major - Major loss of function.
          • Closed
          links to

          Web Link GitHub Pull Request #16861

          Activity

            People

              gaoyunhaii Yun Gao
              gaoyunhaii Yun Gao
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: