[FLINK-4760] Kafka 09 Consumer failed to initialize state because of corrupted operator state and not able to recover

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Not A Problem
• Component/s: Connectors / Kafka, Runtime / State Backends
• Assignee: Unassigned
• Reporter: Zhenzhong Xu
• Created: 06/Oct/16 22:46
• Updated: 24/Mar/17 17:06
• Resolved: 24/Mar/17 17:06

Description

java.io.StreamCorruptedException: invalid stream header: 02000078
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:806)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:299)
at org.apache.flink.api.java.typeutils.runtime.JavaSerializer.deserialize(JavaSerializer.java:79)
at org.apache.flink.api.java.typeutils.runtime.JavaSerializer.deserialize(JavaSerializer.java:31)
at org.apache.flink.runtime.state.DefaultOperatorStateBackend.getPartitionableState(DefaultOperatorStateBackend.java:107)
at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase.initializeState(FlinkKafkaConsumerBase.java:323)
at org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:105)
at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:396)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:269)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:608)
at java.lang.Thread.run(Thread.java:745)