[FLINK-16908] FlinkKafkaProducerITCase testScaleUpAfterScalingDown Timeout expired while initializing transactional state in 60000ms.

• Type: Sub-task
• Status: Closed
• Priority: Minor
• Resolution: Cannot Reproduce
• Affects Version/s: 1.11.0, 1.12.0, 1.13.2, 1.14.3
• Component/s: Connectors / Kafka
• Labels: auto-deprioritized-major stale-assigned test-stability
• Assignee: Fabian Paul
• Reporter: Piotr Nowojski
• Created: 01/Apr/20 08:14
• Updated: 16/Oct/23 07:09
• Resolved: 16/Oct/23 07:09

Description

https://dev.azure.com/rmetzger/Flink/_build/results?buildId=6889&view=logs&j=c5f0071e-1851-543e-9a45-9ac140befc32&t=f66652e3-384e-5b25-be29-abfea69ea8da

[ERROR] testScaleUpAfterScalingDown(org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerITCase)  Time elapsed: 64.353 s  <<< ERROR!
org.apache.kafka.common.errors.TimeoutException: Timeout expired while initializing transactional state in 60000ms.

After this initial error many other tests (I think all following unit tests) failed with errors like:

[ERROR] testFailAndRecoverSameCheckpointTwice(org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerITCase)  Time elapsed: 7.895 s  <<< FAILURE!
java.lang.AssertionError: Detected producer leak. Thread name: kafka-producer-network-thread | producer-196
	at org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerITCase.checkProducerLeak(FlinkKafkaProducerITCase.java:675)
	at org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerITCase.testFailAndRecoverSameCheckpointTwice(FlinkKafkaProducerITCase.java:311)

Issue Links

• depends upon: FLINK-25249 Reimplement KafkaSourceTestEnv with KafkaContainer
• is related to: FLINK-24970 FlinkKafkaProducerITCase testScaleUpAfterScalingDown Timeout expired after 60000 milliseconds while awaiting InitProducerId
• relates to: FLINK-21214 FlinkKafkaProducerITCase.testScaleDownBeforeFirstCheckpoint Failed