[FLINK-8699] Fix concurrency problem in rocksdb full checkpoint

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.5.0
• Fix Version/s: 1.5.0
• Component/s: Runtime / State Backends
• Assignee: Sihua Zhou
• Reporter: Sihua Zhou
• Created: 19/Feb/18 12:19
• Updated: 06/Apr/18 15:31
• Resolved: 06/Apr/18 15:31

Description

In full checkpoint, `kvStateInformation` is not a copied object and it can be changed when writeKVStateMetaData() is invoking ... This can lead to problematic, which is serious.

private void writeKVStateMetaData() throws IOException {
  // ...
        for (Map.Entry<String, Tuple2<ColumnFamilyHandle, RegisteredKeyedBackendStateMetaInfo<?, ?>>> column :
				stateBackend.kvStateInformation.entrySet()) {
        }
  //...
}

Issue Links

• links to: GitHub Pull Request #5525
• links to: GitHub Pull Request #5705