[FLINK-31145] Stabilize Kafka-related tests

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Done
• Affects Version/s: 1.17.0, 1.15.3, 1.16.1
• Component/s: Connectors / Kafka
• Labels: test-stability
• Assignee: Unassigned
• Reporter: Matthias Pohl
• Created: 20/Feb/23 17:30
• Updated: 16/Oct/23 07:10
• Resolved: 16/Oct/23 07:10

Description

This is an umbrella ticket that collects all the Kafka infrastructure related test instabilities.

Issue Links

• is related to: FLINK-26115 Multiple Kafka connector tests failed due to The topic metadata failed to propagate to Kafka broker
• relates to: FLINK-32101 FlinkKafkaInternalProducerITCase.testInitTransactionId test failed

Sub-Tasks

• FlinkKafkaProducerITCase.testMigrateFromAtLeastOnceToExactlyOnce fails on Azure because org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition: Closed
• KafkaSinkITCase.testRecoveryWithExactlyOnceGuaranteeAndConcurrentCheckpoints failed on azure: Closed
• KafkaSinkITCase fails in setup and teardown method because the topic couldn't be created/deleted: Closed
• KafkaSinkE2ECase.testStartFromSavepoint fails with TimeoutException because the topic doesn't become available in the meta file: Closed
• KafkaShuffleITCase failed with multiple test failures due to a TimeoutException while creating topics: Closed
• KafkaTableITCase.testStartFromGroupOffsetsNone failed due to timeout: Closed
• KafkaSourceITCase$IntegrationTests.testSavepoint failed with timeout: Closed
• KafkaChangelogTableITCase.testKafkaDebeziumChangelogSource failed due to a topic already exist when creating it: Closed
• KafkaSinkITCase$IntegrationTests.testScaleUp failed on azures due to failed to create topic: Closed
• KafkaProducerExactlyOnceITCase.testMultipleSinkOperators failed due to topic 'exactlyTopicCustomOperator20' already exists: Closed
• UpsertKafkaTableITCase failed due to timeout when creating a topic: Closed
• FlinkKafkaProducerITCase testScaleUpAfterScalingDown Timeout expired while initializing transactional state in 60000ms.: Closed
• KafkaSourceITCase.testMultipleSplits fails due to "Cannot create topic": Closed
• KafkaSourceLegacyITCase.testMultipleSourcesOnePartition fails because of timeout: Closed
• KafkaPartitionSplitReaderTest.testPendingRecordsGauge failed to create topic: Closed
• KafkaSinkITCase$IntegrationTests.testMetrics failed because topic XXX already exists: Closed