[FLINK-7041] Deserialize StateBackend from JobCheckpointingSettings with user classloader - ASF JIRA

Attach files

Attach Screenshot

Voters

Watch issue

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Bug
Status: Closed
Priority: Blocker
Resolution: Fixed
Affects Version/s: 1.3.0, 1.3.1
Fix Version/s: 1.3.2, 1.4.0
Component/s: API / DataStream, Runtime / Coordination, Runtime / State Backends
Labels:
None

Description

A user ran into the problem that the SubmitJob message is not (de)serialisable if it contains custom RocksDB options (or a custom state backend): [1]

The problem is that SubmitJob contains a JobGraph which contains JobCheckpointingSettings which contains a StateBackend. This StateBackend potentially has user code and therefore can only be deserialised with the user classloader.

This issue is mostly identical to ~~FLINK-6531~~.

[1] https://lists.apache.org/thread.html/69bb573787258ab34c3dc56ac155052f099d75e62d805f463bde5621@%3Cuser.flink.apache.org%3E