Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-20976

Unify Binary format for Keyed State savepoints

    XMLWordPrintableJSON

    Details

    • Release Note:
      Hide
      Flink’s savepoint binary format is unified across all state backends. That means you can take a savepoint with one state backend and then restore it using another.

      If you want to switch the state backend you should first upgrade your Flink version to 1.13 then take a savepoint with the new version, and only after that, you can restore it with a different state backend.
      Show
      Flink’s savepoint binary format is unified across all state backends. That means you can take a savepoint with one state backend and then restore it using another. If you want to switch the state backend you should first upgrade your Flink version to 1.13 then take a savepoint with the new version, and only after that, you can restore it with a different state backend.

      Description

      The main goal of this proposal is the following:

      • Unify across all state backends a savepoint format for keyed state that is more future-proof and applicable for potential new state backends. Checkpoint formats, by definition, are still allowed to be backend specific.
      • Make it possible to switch a state backend via a savepoint
      • Rework abstractions related to snapshots and restoring, to reduce the overhead and code duplication when attempting to implement a new state backend.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                dwysakowicz Dawid Wysakowicz
                Reporter:
                dwysakowicz Dawid Wysakowicz
              • Votes:
                0 Vote for this issue
                Watchers:
                11 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: