Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-19799 Make FileSource extensible
  3. FLINK-19800

Make FileSourceSplit / FileSourceSplitState interaction extensible.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.12.0
    • None

    Description

      We should add a method FileSourceSplit.updateWithCheckpointedPosition(CheckpointedPosition) that creates a new FileSourceSplit of the same type with an updated position.

      Subclasses can override that method. The FileSourceSplitState uses that method to create the splits that are stored in the checkpoint.

      Attachments

        Activity

          People

            sewen Stephan Ewen
            sewen Stephan Ewen
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: