Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-20976

Unify binary format for Keyed State savepoints

    XMLWordPrintableJSON

Details

    • Hide
      Flink’s savepoint binary format is unified across all state backends. That means you can take a savepoint with one state backend and then restore it using another.

      If you want to switch the state backend you should first upgrade your Flink version to 1.13 then take a savepoint with the new version, and only after that, you can restore it with a different state backend.
      Show
      Flink’s savepoint binary format is unified across all state backends. That means you can take a savepoint with one state backend and then restore it using another. If you want to switch the state backend you should first upgrade your Flink version to 1.13 then take a savepoint with the new version, and only after that, you can restore it with a different state backend.

    Description

      The main goal of this proposal is the following:

      • Unify across all state backends a savepoint format for keyed state that is more future-proof and applicable for potential new state backends. Checkpoint formats, by definition, are still allowed to be backend specific.
      • Make it possible to switch a state backend via a savepoint
      • Rework abstractions related to snapshots and restoring, to reduce the overhead and code duplication when attempting to implement a new state backend.

      Attachments

        Issue Links

          Activity

            People

              dwysakowicz Dawid Wysakowicz
              dwysakowicz Dawid Wysakowicz
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: