Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-5053 Incremental / lightweight snapshots for checkpoints
  3. FLINK-6364

Implement incremental checkpointing in RocksDBStateBackend

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:
      None

      Description

      RocksDBStateBackend is well suited for incremental checkpointing because RocksDB is base on LSM trees, which record updates in new sst files and all sst files are immutable. By only materializing those new sst files, we can significantly improve the performance of checkpointing.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                shixg Xiaogang Shi
                Reporter:
                shixg Xiaogang Shi
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: