[FLINK-24970] FlinkKafkaProducerITCase testScaleUpAfterScalingDown Timeout expired after 60000 milliseconds while awaiting InitProducerId

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Duplicate
• Affects Version/s: 1.15.0
• Component/s: Connectors / Kafka
• Labels: stale-assigned test-stability
• Assignee: Fabian Paul
• Reporter: Yun Gao
• Created: 21/Nov/21 11:16
• Updated: 21/Feb/22 16:34
• Resolved: 21/Feb/22 16:34

Description

Nov 20 23:27:52 [ERROR] Tests run: 15, Failures: 10, Errors: 1, Skipped: 0, Time elapsed: 341.449 s <<< FAILURE! - in org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerITCase
Nov 20 23:27:52 [ERROR] testScaleUpAfterScalingDown  Time elapsed: 75.789 s  <<< ERROR!
Nov 20 23:27:52 org.apache.kafka.common.errors.TimeoutException: Timeout expired after 60000 milliseconds while awaiting InitProducerId

After that a lot of tests failed due to 

Nov 20 23:27:52 [ERROR] testScaleUpAfterScalingDown  Time elapsed: 75.789 s  <<< ERROR!
Nov 20 23:27:52 org.apache.kafka.common.errors.TimeoutException: Timeout expired after 60000 milliseconds while awaiting InitProducerId
Nov 20 23:27:52 
Nov 20 23:27:52 [ERROR] testFailAndRecoverSameCheckpointTwice  Time elapsed: 10.031 s  <<< FAILURE!
Nov 20 23:27:52 java.lang.AssertionError: Detected producer leak. Thread name: kafka-producer-network-thread | producer-MockTask-000000000000002a000000000000002c-9
Nov 20 23:27:52 	at org.junit.Assert.fail(Assert.java:89) 

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=26783&view=logs&j=c5612577-f1f7-5977-6ff6-7432788526f7&t=ffa8837a-b445-534e-cdf4-db364cf8235d&l=7047

Issue Links

• duplicates: FLINK-24795 FlinkKafkaProducerITCase.testRunOutOfProducersInThePool times out on AZP
• relates to: FLINK-16908 FlinkKafkaProducerITCase testScaleUpAfterScalingDown Timeout expired while initializing transactional state in 60000ms.
• relates to: FLINK-21214 FlinkKafkaProducerITCase.testScaleDownBeforeFirstCheckpoint Failed