Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-21648 FLIP-151: Incremental snapshots for heap-based state backend
  3. FLINK-21650

On heap state restore, skip key groups from other state backends

    XMLWordPrintableJSON

Details

    Description

      In new incremental mode, heap backend wraps KeyGroupsStateHandle
      into IncrementalRemoteKeyedStateHandle. The latter don't compute
      intersection because it is not directly aware of the offsets. So it just
      returns a full keyrange if there is SOME intersection.
      On recovery, unused keyGroups are filtered out by RocksDB state backend.
      With this change, Heap state backend does the same.

      Attachments

        Issue Links

          Activity

            People

              roman Roman Khachatryan
              roman Roman Khachatryan
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: