[FLINK-22949] java.io.InvalidClassException With Flink Kafka Beam

• Type: Bug
• Status: Open
• Priority: Not a Priority
• Resolution: Unresolved
• Affects Version/s: 1.12.0
• Component/s: Client / Job Submission, Runtime / Network
• Labels: auto-deprioritized-blocker auto-deprioritized-critical auto-deprioritized-major auto-deprioritized-minor
• Assignee: Unassigned
• Reporter: Ravikiran Borse
• Created: 09/Jun/21 17:59
• Updated: 14/Jul/22 10:40

Description

Beam: 2.30.0

Flink: 1.12.0

Kafka: 2.6.0

ERROR:root:java.io.InvalidClassException: org.apache.flink.streaming.api.graph.StreamConfig$NetworkInputConfig; local class incompatible: stream classdesc serialVersionUID = 3698633776553163849, local class serialVersionUID = -3137689219135046939

 

In Flink Logs

KafkaIO.Read.ReadFromKafkaViaSDF/

{ParDo(GenerateKafkaSourceDescriptor), KafkaIO.ReadSourceDescriptors}

(1/1)#0 (b0c31371874208adb0ccaff85b971883) switched from RUNNING to FAILED.

org.apache.flink.streaming.runtime.tasks.StreamTaskException: Could not deserialize inputs

        at org.apache.flink.streaming.api.graph.StreamConfig.getInputs(StreamConfig.java:265) ~[flink-dist_2.12-1.12.0.jar:1.12.0]

        at org.apache.flink.streaming.api.graph.StreamConfig.getTypeSerializerIn(StreamConfig.java:280) ~[flink-dist_2.12-1.12.0.jar:1.12.0]

        at org.apache.flink.streaming.api.graph.StreamConfig.getTypeSerializerIn1(StreamConfig.java:271) ~[flink-dist_2.12-1.12.0.jar:1.12.0]

        at org.apache.flink.streaming.runtime.tasks.OperatorChain.wrapOperatorIntoOutput(OperatorChain.java:639) ~[flink-dist_2.12-1.12.0.jar:1.12.0]

        at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOperatorChain(OperatorChain.java:591) ~[flink-dist_2.12-1.12.0.jar:1.12.0]

        at org.apache.flink.streaming.runtime.tasks.OperatorChain.createOutputCollector(OperatorChain.java:526) ~[flink-dist_2.12-1.12.0.jar:1.12.0]

        at org.apache.flink.streaming.runtime.tasks.OperatorChain.<init>(OperatorChain.java:164) ~[flink-dist_2.12-1.12.0.jar:1.12.0]

        at org.apache.flink.streaming.runtime.tasks.StreamTask.beforeInvoke(StreamTask.java:485) ~[flink-dist_2.12-1.12.0.jar:1.12.0]

        at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:531) ~[flink-dist_2.12-1.12.0.jar:1.12.0]

        at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:722) [flink-dist_2.12-1.12.0.jar:1.12.0]

        at org.apache.flink.runtime.taskmanager.Task.run(Task.java:547) [flink-dist_2.12-1.12.0.jar:1.12.0]

        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_282]

Caused by: java.io.InvalidClassException: org.apache.flink.streaming.api.graph.StreamConfig$NetworkInputConfig; local class incompatible: stream classdesc serialVersionUID = 3698633776553163849, local class serialVersionUID = -3137689219135046939