Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-21027

Add isStateKeyValueSerialized() method to KeyedStateBackend interface

Attach filesAttach ScreenshotAdd voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

      Description

      In Table/SQL operators, we have some optimizations that reuse objects of keys and records. For example, we buffer input records in BytesMultiMap and use the reused object to map to the underlying memory segment to reduce bytes copy.

      However, if we put the reused key and value into Heap statebackend, the result will be wrong, because it is not allowed to mutate keys and values in Heap statebackend.

      Therefore, it would be great if KeyedStateBackend can expose such API, so that Table/SQL can dynamically decide whether to copy the keys and values before putting into state.

        Attachments

          Activity

            People

            • Assignee:
              yunta Yun Tang
              Reporter:
              jark Jark Wu

              Dates

              • Created:
                Updated:

                Issue deployment