Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-21352 FLIP-158: Generalized incremental checkpoints
  3. FLINK-23137

State ownership: prevent private state deletion on JM

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: 1.15.0
    • Labels:
      None

      Description

      Inject shared state IDs computed in StateAssignmentOperation (FLINK-23342) into the SharedStateRegistry and CheckpointsCleaner and ignore other states. Should only affect changelog states (both materialized and non-materialized). 

      Injection into SharedStateRegistry is done in FLINK-23342 (or can be done in this ticket).

      Should take "changelog.enabled" and it's possible changes into account.

      Placeholder state handles should still be replaced for both private and shared state eventually - either as part of this or of a new ticket (see also FLINK-23461).
       

      See https://docs.google.com/document/d/1NJJQ30P27BmUvD7oa4FChvkYxMEgjRPTVdO1dHLl_9I/edit#heading=h.uednun2snp4l for more details

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Zakelly Zakelly Lan
                Reporter:
                roman Roman Khachatryan
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated: