Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-9749 Rework Bucketing Sink
  3. FLINK-9750

Create new StreamingFileSink that works on Flink's FileSystem abstraction

    XMLWordPrintableJSON

    Details

      Description

      Using Flink's own file system abstraction means that we can add additional streaming/checkpointing related behavior.

      In addition, the new StreamingFileSink should only rely on internal checkpointed state what files are possibly in progress or need to roll over, never assume enumeration of files in the file system.

        Attachments

          Activity

            People

            • Assignee:
              kkl0u Kostas Kloudas
              Reporter:
              sewen Stephan Ewen
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: