[FLINK-5942] Harden ZooKeeperStateHandleStore to deal with corrupted data

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.1.4, 1.2.0, 1.3.0
• Fix Version/s: 1.1.5, 1.2.1, 1.3.0
• Component/s: Runtime / State Backends
• Assignee: Till Rohrmann
• Reporter: Till Rohrmann
• Created: 01/Mar/17 17:10
• Updated: 14/Mar/17 08:20
• Resolved: 14/Mar/17 08:20

Description

The ZooKeeperStateHandleStore cannot handle corrupted Znode data. When calling ZooKeeperStateHandleStore.getAll or getAllSortedByName and reading a node with corrupted data, the whole operation will fail. In such a situation, Flink won't be able to recover because it will read over and over again the same corrupted Znodes (in the recovery case). Therefore, I propose to ignore Znodes whose data cannot be read.

Issue Links

• links to: GitHub Pull Request #3447
• links to: GitHub Pull Request #3449
• links to: GitHub Pull Request #3452