Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-31145 Stabilize Kafka-related tests
  3. FLINK-30822

KafkaSinkITCase fails in setup and teardown method because the topic couldn't be created/deleted

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Cannot Reproduce
    • 1.16.0
    • None
    • Connectors / Kafka

    Description

      We experience build failures in KafkaSinkITCase due to the topic already existing when creating it and failing to delete it because a partition doesn't exist:

      Jan 28 01:45:32 [ERROR] Tests run: 8, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 89.58 s <<< FAILURE! - in org.apache.flink.connector.kafka.sink.KafkaSinkITCase
      Jan 28 01:45:32 [ERROR] org.apache.flink.connector.kafka.sink.KafkaSinkITCase.testWriteRecordsToKafkaWithNoneGuarantee  Time elapsed: 14.387 s  <<< FAILURE!
      Jan 28 01:45:32 org.opentest4j.MultipleFailuresError: 
      Jan 28 01:45:32 Multiple Failures (2 failures)
      Jan 28 01:45:32 	at org.junit.platform.launcher.core.SessionPerRequestLauncher.execute(SessionPerRequestLauncher.java:53)
      Jan 28 01:45:32 	at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.execute(JUnitPlatformProvider.java:188)
      Jan 28 01:45:32 	at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invokeAllTests(JUnitPlatformProvider.java:154)
      Jan 28 01:45:32 	at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invoke(JUnitPlatformProvider.java:124)
      Jan 28 01:45:32 	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:428)
      Jan 28 01:45:32 	at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:162)
      Jan 28 01:45:32 	at org.apache.maven.surefire.booter.ForkedBooter.run(ForkedBooter.java:562)
      Jan 28 01:45:32 	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:548)
      Jan 28 01:45:32 	Suppressed: java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.TopicExistsException: Topic 'b5de1eb2-175c-4b96-96c9-30ff23db2ca7' already exists.
      Jan 28 01:45:32 		at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
      Jan 28 01:45:32 		at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
      Jan 28 01:45:32 		at org.apache.kafka.common.internals.KafkaFutureImpl.get(KafkaFutureImpl.java:165)
      Jan 28 01:45:32 		at org.apache.flink.connector.kafka.sink.KafkaSinkITCase.createTestTopic(KafkaSinkITCase.java:447)
      Jan 28 01:45:32 		at org.apache.flink.connector.kafka.sink.KafkaSinkITCase.setUp(KafkaSinkITCase.java:162)
      Jan 28 01:45:32 		at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      Jan 28 01:45:32 		at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      Jan 28 01:45:32 		at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      Jan 28 01:45:32 		at java.lang.reflect.Method.invoke(Method.java:498)
      Jan 28 01:45:32 		at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
      Jan 28 01:45:32 		at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
      Jan 28 01:45:32 		at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
      Jan 28 01:45:32 		at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33)
      Jan 28 01:45:32 		at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
      Jan 28 01:45:32 		at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
      Jan 28 01:45:32 		at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
      Jan 28 01:45:32 		at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
      Jan 28 01:45:32 		at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
      Jan 28 01:45:32 		at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
      Jan 28 01:45:32 		at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
      Jan 28 01:45:32 		at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
      Jan 28 01:45:32 		at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
      Jan 28 01:45:32 		... 34 more
      Jan 28 01:45:32 	Caused by: org.apache.kafka.common.errors.TopicExistsException: Topic 'b5de1eb2-175c-4b96-96c9-30ff23db2ca7' already exists.
      Jan 28 01:45:32 	Suppressed: java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
      Jan 28 01:45:32 		at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
      Jan 28 01:45:32 		at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
      Jan 28 01:45:32 		at org.apache.kafka.common.internals.KafkaFutureImpl.get(KafkaFutureImpl.java:165)
      Jan 28 01:45:32 		at org.apache.flink.connector.kafka.sink.KafkaSinkITCase.deleteTestTopic(KafkaSinkITCase.java:453)
      Jan 28 01:45:32 		at org.apache.flink.connector.kafka.sink.KafkaSinkITCase.tearDown(KafkaSinkITCase.java:167)
      Jan 28 01:45:32 		at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      Jan 28 01:45:32 		at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      Jan 28 01:45:32 		at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      Jan 28 01:45:32 		at java.lang.reflect.Method.invoke(Method.java:498)
      Jan 28 01:45:32 		at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
      Jan 28 01:45:32 		at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
      Jan 28 01:45:32 		at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
      Jan 28 01:45:32 		at org.junit.internal.runners.statements.RunAfters.invokeMethod(RunAfters.java:46)
      Jan 28 01:45:32 		at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:33)
      Jan 28 01:45:32 		at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
      Jan 28 01:45:32 		at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
      Jan 28 01:45:32 		at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
      Jan 28 01:45:32 		at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
      Jan 28 01:45:32 		at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
      Jan 28 01:45:32 		at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
      Jan 28 01:45:32 		at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
      Jan 28 01:45:32 		... 34 more
      Jan 28 01:45:32 	Caused by: org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition.
      

      https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=45251&view=logs&j=aa18c3f6-13b8-5f58-86bb-c1cffb239496&t=502fb6c0-30a2-5e49-c5c2-a00fa3acb203&l=37261

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              mapohl Matthias Pohl
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: