Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-24868

Use custom serialization for storing checkpoint metadata in CompletedCheckpointStore

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • Runtime / Coordination
    • None

    Description

      We are using a java serialization for storing CompletedCheckpoint in CompletedCheckpointStore. This makes maintaining backwards compatibility of entries stored hard, even between minor versions. Maintaining this kind of backwards compatibility is required for ever considering rolling upgrades.

      In particular, we do have MetadataSerializer for storing checkpoints metadata in a backwards-compatible way.

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. FLINK-24621 JobManager fails to recover 1.13.1 checkpoint due to InflightDataRescalingDescriptor

          • Major - Major loss of function.
          • Closed

          Activity

            People

              Unassigned Unassigned
              dwysakowicz Dawid Wysakowicz
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated: