[FLINK-8676] Memory Leak in AbstractKeyedStateBackend.applyToAllKeys() when backend is base on RocksDB

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.5.0
• Fix Version/s: 1.5.0
• Component/s: Runtime / State Backends
• Assignee: Sihua Zhou
• Reporter: Sihua Zhou
• Created: 16/Feb/18 17:25
• Updated: 28/Feb/19 10:45
• Resolved: 16/Feb/18 18:38

Description

`AbstractKeyedStateBackend.applyToAllKeys() ` uses backend's getKeys(stateName, namespace) to get all keys that belong to `namespace`. But, in `RocksDBKeyedStateBackend.getKeys()` if just return a object which wrap a `rocksdb iterator`, that is dangous, because rocksdb will ping the resources that belong to the iterator into memory untill iterator.close() is invoked, but it didn't invoked right now. This will lead to memory leak finally.

Issue Links

• links to: GitHub Pull Request #5513