[FLINK-25030] Unexpected record in KafkaSourceITCase$IntegrationTests.testMultipleSplits

• Type: Bug
• Status: Open
• Priority: Not a Priority
• Resolution: Unresolved
• Affects Version/s: 1.14.1
• Component/s: Connectors / Kafka
• Labels: auto-deprioritized-major auto-deprioritized-minor test-stability
• Assignee: Unassigned
• Reporter: Matthias Pohl
• Created: 24/Nov/21 08:25
• Updated: 19/Aug/22 22:38

Description

We experienced a test failure in KafkaSourceITCase$IntegrationTests.testMultipleSplits in our Flink fork for 1.14 due to an unexpected record:

[...]
Nov 23 21:10:19 [ERROR] org.apache.flink.connector.kafka.source.KafkaSourceITCase$IntegrationTests.testMultipleSplits{TestEnvironment, ExternalContext}[1]
Nov 23 21:10:19 [ERROR]   Run 1: KafkaSourceITCase$IntegrationTests>SourceTestSuiteBase.testMultipleSplits:160 
Nov 23 21:10:19 Expected: Records consumed by Flink should be identical to test data and preserve the order in multiple splits
Nov 23 21:10:19      but: Unexpected record '2-13N3fae7bfL1iEMF3I0TaWGC57vrflv' at position 367
Nov 23 21:10:19 Current progress of multiple split test data validation:
Nov 23 21:10:19 Split 0 (115/115): 
Nov 23 21:10:19 0-C7bHGoulUrqjQqGM8PiVI6BS9B3Okq2PJdf3EBas3G
Nov 23 21:10:19 0-GRt5T5YYDsgq1t0UBt3cUjvnktIbz
[...]

I verified that we do not touch kafka-related in the Fork (by going through the patches with grep -i 'kafka|source'). I added the pipeline build artifacts to this ticket.

Issue Links

• is related to: FLINK-24261 KafkaSourceITCase.testMultipleSplits fails due to "Cannot create topic"