[FLINK-29018] KafkaITCase.testMultipleSourcesOnePartition failed with TopicExistsException

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.16.0
• Fix Version/s: 1.16.0
• Component/s: Connectors / Kafka
• Labels: test-stability
• Assignee: Qingsheng Ren
• Reporter: Huang Xingbo
• Created: 18/Aug/22 02:10
• Updated: 13/Sep/22 02:22
• Resolved: 13/Sep/22 02:22

Description

2022-08-17T22:52:03.5376972Z Aug 17 22:52:03 [ERROR] Tests run: 23, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 133.5 s <<< FAILURE! - in org.apache.flink.streaming.connectors.kafka.KafkaITCase
2022-08-17T22:52:03.5378664Z Aug 17 22:52:03 [ERROR] org.apache.flink.streaming.connectors.kafka.KafkaITCase.testMultipleSourcesOnePartition  Time elapsed: 3.967 s  <<< FAILURE!
2022-08-17T22:52:03.5380231Z Aug 17 22:52:03 java.lang.AssertionError: Create test topic : manyToOneTopic failed, org.apache.kafka.common.errors.TopicExistsException: Topic 'manyToOneTopic' already exists.
2022-08-17T22:52:03.5381136Z Aug 17 22:52:03 	at org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironmentImpl.createTestTopic(KafkaTestEnvironmentImpl.java:207)
2022-08-17T22:52:03.5381983Z Aug 17 22:52:03 	at org.apache.flink.streaming.connectors.kafka.KafkaTestEnvironment.createTestTopic(KafkaTestEnvironment.java:97)
2022-08-17T22:52:03.5382935Z Aug 17 22:52:03 	at org.apache.flink.streaming.connectors.kafka.KafkaTestBase.createTestTopic(KafkaTestBase.java:217)
2022-08-17T22:52:03.5384026Z Aug 17 22:52:03 	at org.apache.flink.streaming.connectors.kafka.KafkaConsumerTestBase.runMultipleSourcesOnePartitionExactlyOnceTest(KafkaConsumerTestBase.java:1053)
2022-08-17T22:52:03.5385057Z Aug 17 22:52:03 	at org.apache.flink.streaming.connectors.kafka.KafkaITCase.testMultipleSourcesOnePartition(KafkaITCase.java:105)
2022-08-17T22:52:03.5385741Z Aug 17 22:52:03 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2022-08-17T22:52:03.5386344Z Aug 17 22:52:03 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2022-08-17T22:52:03.5387038Z Aug 17 22:52:03 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2022-08-17T22:52:03.5387658Z Aug 17 22:52:03 	at java.lang.reflect.Method.invoke(Method.java:498)
2022-08-17T22:52:03.5388350Z Aug 17 22:52:03 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
2022-08-17T22:52:03.5389118Z Aug 17 22:52:03 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
2022-08-17T22:52:03.5389875Z Aug 17 22:52:03 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
2022-08-17T22:52:03.5390556Z Aug 17 22:52:03 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
2022-08-17T22:52:03.5391564Z Aug 17 22:52:03 	at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
2022-08-17T22:52:03.5392325Z Aug 17 22:52:03 	at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
2022-08-17T22:52:03.5392985Z Aug 17 22:52:03 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
2022-08-17T22:52:03.5393687Z Aug 17 22:52:03 	at java.lang.Thread.run(Thread.java:748)

https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=40124&view=logs&j=aa18c3f6-13b8-5f58-86bb-c1cffb239496&t=502fb6c0-30a2-5e49-c5c2-a00fa3acb203&l=37261

Issue Links

• is caused by: FLINK-29153 KafkaConsumerThread should catch WakeupException when committing offsets
• is related to: FLINK-24119 KafkaITCase.testTimestamps fails due to "Topic xxx already exist"