Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-34652

Use CheckpointStreamFactory for StateChangeFsUploader

Attach filesAttach ScreenshotAdd voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Runtime / Checkpointing
    • None

    Description

      As discussed before, we may consider supporting CheckpointStreamFactory for StateChangeFsUploader:

      • need for checkpointId in the current API to resolve the location
      • different settings for materialized/changelog (e.g. timeouts)
      • re-use closeAndGetHandle
      • re-use in-memory handles (.metadata)
      • handle in-memory handles duplication

      It could be considered together with FLINK-32085

      Attachments

        Issue Links

        relates to

        Sub-task - The sub-task of the issue FLINK-32085 Implement and migrate batch uploading in changelog files into the file merging framework

        • Major - Major loss of function.
        • Open

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            masteryhx Hangxiang Yu
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:

              Slack

                Issue deployment