[FLINK-13612] StateDescriptor Loading Error NPE at FlinkKafkaProducer011 with High Concurrency Initialization

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: shaded-7.0, 1.6.3, 1.6.4, 1.7.2
• Fix Version/s: 1.9.0
• Component/s: Connectors / Kafka
• Assignee: Unassigned
• Reporter: weiyunqing
• Created: 07/Aug/19 08:51
• Updated: 03/Sep/19 12:52
• Resolved: 03/Sep/19 12:48

Description

org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer011#NEXT_TRANSACTIONAL_ID_HINT_DESCRIPTOR

The NEXT_TRANSACTIONAL_ID_HINT_DESCRIPTOR variable state in FlinkKafkaProducer011 is modified with static

NullPointerException occur in high concurrency when initializeSerializerUnlessSet method is executed

 

java.lang.NullPointerException at org.apache.flink.api.common.state.StateDescriptor.initializeSerializerUnlessSet(StateDescriptor.java:264) at org.apache.flink.runtime.state.DefaultOperatorStateBackend.getListState(DefaultOperatorStateBackend.java:730) at org.apache.flink.runtime.state.DefaultOperatorStateBackend.getUnionListState(DefaultOperatorStateBackend.java:271) at org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer011.initializeState(FlinkKafkaProducer011.java:837) at org.apache.flink.streaming.util.functions.StreamingFunctionUtils.tryRestoreFunction(StreamingFunctionUtils.java:178) at org.apache.flink.streaming.util.functions.StreamingFunctionUtils.restoreFunctionState(StreamingFunctionUtils.java:160) at org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.initializeState(AbstractUdfStreamOperator.java:96) at org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:281) at org.apache.flink.streaming.runtime.tasks.StreamTask.initializeState(StreamTask.java:730) at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:295) at org.apache.flink.runtime.taskmanager.Task.run(Task.java:720) at java.lang.Thread.run(Thread.java:748)

Issue Links

• is duplicated by: FLINK-12688 Make serializer lazy initialization thread safe in StateDescriptor