Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-20337

Allow stateful migration from StreamingFileSink to FileSink

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Critical
    • Resolution: Implemented
    • Affects Version/s: 1.12.0
    • Fix Version/s: 1.12.0
    • Component/s: API / DataStream
    • Labels:
      None

      Description

      Flink-1.12 introduces the `FileSink` in FLINK-19510, which can guarantee the exactly once semantics both in the streaming and batch execution mode. We need to provide a way for the user who uses `StreamingFileSink` to migrate from `StreamingFileSink` to `FileSink`.

      For this purpose we propose to let the new sink writer operator could load the previous StreamingFileSink's state and then the `SinkWriter` could have the opertunity to handle the old state. 

       

        Attachments

          Activity

            People

            • Assignee:
              maguowei Guowei Ma
              Reporter:
              maguowei Guowei Ma
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: