Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-21648 FLIP-151: Incremental snapshots for heap-based state backend
  3. FLINK-21650

On heap state restore, skip key groups from other state backends

    XMLWordPrintableJSON

    Details

      Description

      In new incremental mode, heap backend wraps KeyGroupsStateHandle
      into IncrementalRemoteKeyedStateHandle. The latter don't compute
      intersection because it is not directly aware of the offsets. So it just
      returns a full keyrange if there is SOME intersection.
      On recovery, unused keyGroups are filtered out by RocksDB state backend.
      With this change, Heap state backend does the same.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                roman_khachatryan Roman Khachatryan
                Reporter:
                roman_khachatryan Roman Khachatryan
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: