[FLINK-14076] 'ClassNotFoundException: KafkaException' on Flink v1.9 w/ checkpointing

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.9.0
• Fix Version/s: 1.9.1, 1.10.0
• Component/s: Connectors / Kafka, Runtime / Checkpointing
• Labels: pull-request-available
• Assignee: Jeffrey Martin
• Reporter: Jeffrey Martin
• Created: 14/Sep/19 21:26
• Updated: 25/Oct/19 05:03
• Resolved: 24/Sep/19 17:21

Description

A Flink job that worked with checkpointing on a Flink v1.8.0 cluster fails on a Flink v1.9.0 cluster with checkpointing. It works on a Flink v1.9.0 cluster without checkpointing. It is specifically enabling checkpointing on v1.9.0 that causes the JM to start throwing ClassNotFoundExceptions. Full stacktrace: error.txt

The job reads from Kafka via FlinkKafkaConsumer and writes to Kafka via FlinkKafkaProducer.

The jobmanagers and taskmanagers are standalone.

The exception is being raised deep in some Flink serialization code, so I'm not sure how to go about stepping through this in a debugger. The issue is happening in an internal repository at my job, but I can try to get a minimal repro on GitHub if it's not obvious from the error message alone what's broken.

Issue Links

• Blocked: FLINK-14519 Fail on invoking declineCheckpoint remotely
• links to: Githb PR #9742
• links to: GitHub Pull Request #9742