Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-2491 Support Checkpoints After Tasks Finished
  3. FLINK-24065

Upgrade the TwoPhaseCommitSink to support empty transaction after finished

Attach filesAttach ScreenshotVotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      In https://issues.apache.org/jira/browse/FLINK-23473 for the TwoPhaseCommitSink, we would not create new transactions after finished to avoid we have transactions left after job finished. However, since with the current implementation of the TwoPhaseCommitSink, we would have to write the transactions into the state for each checkpoint, and the state does not support null transaction now, thus there would be NullPointerException in this case.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            gaoyunhaii Yun Gao
            gaoyunhaii Yun Gao
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment