[FLINK-25101] FlinkKafkaProducerITCase.testMigrateFromAtLeastOnceToExactlyOnce failed due to CorrelationIdMismatchException

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.15.0
• Component/s: Connectors / Kafka
• Labels: stale-assigned test-stability
• Assignee: Fabian Paul
• Reporter: Yun Gao
• Created: 30/Nov/21 05:50
• Updated: 14/Feb/22 08:19

Description

Nov 29 17:19:22 [ERROR] Tests run: 15, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 279.756 s <<< FAILURE! - in org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerITCase
Nov 29 17:19:22 [ERROR] org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerITCase.testMigrateFromAtLeastOnceToExactlyOnce  Time elapsed: 1.265 s  <<< ERROR!
Nov 29 17:19:22 org.apache.kafka.common.requests.CorrelationIdMismatchException: Correlation id for response (1179651) does not match request (1), request header: RequestHeader(apiKey=API_VERSIONS, apiVersion=3, clientId=consumer-flink-tests-8, correlationId=1)
Nov 29 17:19:22 	at org.apache.kafka.common.requests.AbstractResponse.parseResponse(AbstractResponse.java:106)
Nov 29 17:19:22 	at org.apache.kafka.clients.NetworkClient.parseResponse(NetworkClient.java:730)
Nov 29 17:19:22 	at org.apache.kafka.clients.NetworkClient.handleCompletedReceives(NetworkClient.java:875)
Nov 29 17:19:22 	at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:570)
Nov 29 17:19:22 	at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:265)
Nov 29 17:19:22 	at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:236)
Nov 29 17:19:22 	at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:215)
Nov 29 17:19:22 	at org.apache.kafka.clients.consumer.internals.Fetcher.getTopicMetadata(Fetcher.java:374)
Nov 29 17:19:22 	at org.apache.kafka.clients.consumer.KafkaConsumer.partitionsFor(KafkaConsumer.java:1948)
Nov 29 17:19:22 	at org.apache.kafka.clients.consumer.KafkaConsumer.partitionsFor(KafkaConsumer.java:1916)
Nov 29 17:19:22 	at org.apache.flink.connector.kafka.sink.KafkaUtil.getAllPartitions(KafkaUtil.java:170)
Nov 29 17:19:22 	at org.apache.flink.connector.kafka.sink.KafkaUtil.drainAllRecordsFromTopic(KafkaUtil.java:132)
Nov 29 17:19:22 	at org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironmentImpl.getAllRecordsFromTopic(KafkaTestEnvironmentImpl.java:280)
Nov 29 17:19:22 	at org.apache.flink.streaming.connectors.kafka.KafkaTestBase.assertExactlyOnceForTopic(KafkaTestBase.java:317)
Nov 29 17:19:22 	at org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerITCase.testMigrateFromAtLeastOnceToExactlyOnce(FlinkKafkaProducerITCase.java:592)
Nov 29 17:19:22 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
Nov 29 17:19:22 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
Nov 29 17:19:22 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Nov 29 17:19:22 	at java.lang.reflect.Method.invoke(Method.java:498)
Nov 29 17:19:22 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
Nov 29 17:19:22 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
Nov 29 17:19:22 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
Nov 29 17:19:22 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
Nov 29 17:19:22 	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
Nov 29 17:19:22 	at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
Nov 29 17:19:22 	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
Nov 29 17:19:22 	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
Nov 29 17:19:22 	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
Nov 29 17:19:22 	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
Nov 29 17:19:22 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
Nov 29 17:19:22 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
Nov 29 17:19:22 	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
Nov 29 17:19:22 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
Nov 29 17:19:22 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
Nov 29 17:19:22 	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
Nov 29 17:19:22 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)

 

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=27226&view=logs&j=c5f0071e-1851-543e-9a45-9ac140befc32&t=15a22db7-8faa-5b34-3920-d33c9f0ca23c&l=35495

Issue Links

• relates to: FLINK-21214 FlinkKafkaProducerITCase.testScaleDownBeforeFirstCheckpoint Failed