[FLINK-7041] Deserialize StateBackend from JobCheckpointingSettings with user classloader

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.3.0, 1.3.1
• Fix Version/s: 1.3.2, 1.4.0
• Component/s: DataStream API, Distributed Coordination, State Backends, Checkpointing
• Assignee: Aljoscha Krettek
• Reporter: Aljoscha Krettek
• Created: 29/Jun/17 16:39
• Updated: 06/Jul/17 08:45
• Resolved: 06/Jul/17 04:31

Description

A user ran into the problem that the SubmitJob message is not (de)serialisable if it contains custom RocksDB options (or a custom state backend): [1]

The problem is that SubmitJob contains a JobGraph which contains JobCheckpointingSettings which contains a StateBackend. This StateBackend potentially has user code and therefore can only be deserialised with the user classloader.

This issue is mostly identical to FLINK-6531.

[1] https://lists.apache.org/thread.html/69bb573787258ab34c3dc56ac155052f099d75e62d805f463bde5621@%3Cuser.flink.apache.org%3E

Issue Links

• links to: GitHub Pull Request #4232