Attach filesAttach ScreenshotVotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      Documentation of compaction on FileSink: https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/datastream/filesystem/#compaction

      Possible scenarios might include

      1. Enable compaction with file-size based compaction strategy.
      2. Enable compaction with number-checkpoints based compaction strategy.
      3. Enable compaction, stop-with-savepoint and restarted with compaction disabled.
      4. Disable compaction, stop-with-savepoint and restarted with compaction enabled.

      For each scenario, it might need to verify that

      1. No repeat and missed records.
      2. The resulted files' size exceeds the specified condition.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            alexanderpreuss Alexander Preuss
            gaoyunhaii Yun Gao
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment