Attach filesAttach ScreenshotAdd voteVotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: 1.15.0
    • Labels:
      None

      Description

      ChangelogKeyedStateBackend.getOrCreateKeyedState is currently used during recovery; on 1st user access, it doesn't update metadata nor migrate state (as opposed to other backends).

       

      The proposed solution is to

      1. wrap serializers (and maybe other objects) in getOrCreateKeyedState
      2. store wrapping objects in a new map keyed by state name
      3. pass wrapped objects to delegatedBackend.createInternalState
      4. on 1st user access, lookup wrapper and upgrade its wrapped serializer

      This should be done for both KV/PQ states.

       

      See also https://github.com/apache/flink/pull/15420#discussion_r656934791

       

      cc: Yun Tang

        Attachments

        Issue Links

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              roman Roman Khachatryan

              Dates

              • Created:
                Updated:

                Issue deployment