Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-24131

KafkaSinkITCase "Detected producer leak"

Details

    Description

      https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23383&view=logs&j=c5f0071e-1851-543e-9a45-9ac140befc32&t=15a22db7-8faa-5b34-3920-d33c9f0ca23c&l=7627

      Sep 02 10:35:14 
      Sep 02 10:35:14 [ERROR] testRecoveryWithAtLeastOnceGuarantee  Time elapsed: 4.322 s  <<< FAILURE!
      Sep 02 10:35:14 java.lang.AssertionError: Detected producer leak. Thread name: kafka-producer-network-thread | producer-kafka-sink-2-2
      Sep 02 10:35:14 	at org.junit.Assert.fail(Assert.java:89)
      Sep 02 10:35:14 	at org.apache.flink.connector.kafka.sink.KafkaSinkITCase.checkProducerLeak(KafkaSinkITCase.java:594)
      Sep 02 10:35:14 	at org.apache.flink.connector.kafka.sink.KafkaSinkITCase.testRecoveryWithAssertion(KafkaSinkITCase.java:321)
      Sep 02 10:35:14 	at org.apache.flink.connector.kafka.sink.KafkaSinkITCase.testRecoveryWithAtLeastOnceGuarantee(KafkaSinkITCase.java:190)
      Sep 02 10:35:14 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      Sep 02 10:35:14 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      Sep 02 10:35:14 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      Sep 02 10:35:14 	at java.lang.reflect.Method.invoke(Method.java:498)
      Sep 02 10:35:14 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
      Sep 02 10:35:14 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
      Sep 02 10:35:14 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
      Sep 02 10:35:14 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
      Sep 02 10:35:14 	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
      Sep 02 10:35:14 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
      Sep 02 10:35:14 	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
      Sep 02 10:35:14 	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
      Sep 02 10:35:14 	at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
      Sep 02 10:35:14 	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
      Sep 02 10:35:14 	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
      Sep 02 10:35:14 	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
      Sep 02 10:35:14 	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
      Sep 02 10:35:14 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
      Sep 02 10:35:14 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
      Sep 02 10:35:14 	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
      Sep 02 10:35:14 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
      Sep 02 10:35:14 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
      Sep 02 10:35:14 	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
      Sep 02 10:35:14 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
      Sep 02 10:35:14 	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
      Sep 02 10:35:14 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
      Sep 02 10:35:14 	at org.testcontainers.containers.FailureDetectingExternalResource$1.evaluate(FailureDetectingExternalResource.java:30)
      Sep 02 10:35:14 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
      Sep 02 10:35:14 	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
      Sep 02 10:35:14 	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
      Sep 02 10:35:14 	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
      Sep 02 10:35:14 	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
      Sep 02 10:35:14 	at org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:43)
      Sep 02 10:35:14 	at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183)
      Sep 02 10:35:14 	at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
      Sep 02 10:35:14 	at java.util.Iterator.forEachRemaining(Iterator.java:116)
      Sep 02 10:35:14 	at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
      Sep 02 10:35:14 	at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
      Sep 02 10:35:14 	at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
      Sep 02 10:35:14 	at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150)
      Sep 02 10:35:14 	at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:173)
      Sep 02 10:35:14 	at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
      Sep 02 10:35:14 	at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:485)
      Sep 02 10:35:14 	at org.junit.vintage.engine.VintageTestEngine.executeAllChildren(VintageTestEngine.java:82)
      Sep 02 10:35:14 	at org.junit.vintage.engine.VintageTestEngine.execute(VintageTestEngine.java:73)
      Sep 02 10:35:14 	at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:220)
      Sep 02 10:35:14 	at org.junit.platform.launcher.core.DefaultLauncher.lambda$execute$6(DefaultLauncher.java:188)
      Sep 02 10:35:14 	at org.junit.platform.launcher.core.DefaultLauncher.withInterceptedStreams(DefaultLauncher.java:202)
      Sep 02 10:35:14 	at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:181)
      Sep 02 10:35:14 	at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:128)
      Sep 02 10:35:14 	at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invokeAllTests(JUnitPlatformProvider.java:150)
      Sep 02 10:35:14 	at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invoke(JUnitPlatformProvider.java:120)
      Sep 02 10:35:14 	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
      Sep 02 10:35:14 	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
      Sep 02 10:35:14 	at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
      Sep 02 10:35:14 	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
      
      

      Attachments

        Issue Links

          Activity

            xtsong Xintong Song added a comment - https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23440&view=logs&j=c5612577-f1f7-5977-6ff6-7432788526f7&t=ffa8837a-b445-534e-cdf4-db364cf8235d&l=7369
            dwysakowicz Dawid Wysakowicz added a comment - https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23459&view=logs&j=c5f0071e-1851-543e-9a45-9ac140befc32&t=15a22db7-8faa-5b34-3920-d33c9f0ca23c&l=7662
            dwysakowicz Dawid Wysakowicz added a comment - - edited
            dwysakowicz Dawid Wysakowicz added a comment - - edited cc fpaul arvid
            xtsong Xintong Song added a comment - https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23529&view=logs&j=c5612577-f1f7-5977-6ff6-7432788526f7&t=ffa8837a-b445-534e-cdf4-db364cf8235d&l=7369
            xtsong Xintong Song added a comment - https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23547&view=logs&j=4be4ed2b-549a-533d-aa33-09e28e360cc8&t=f7d83ad5-3324-5307-0eb3-819065cdcb38&l=8405
            xtsong Xintong Song added a comment - https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23559&view=logs&j=1fc6e7bf-633c-5081-c32a-9dea24b05730&t=80a658d1-f7f6-5d93-2758-53ac19fd5b19&l=6635
            arvid Arvid Heise added a comment -

            The last error is coming from a different test. Neither the test nor the code under test is present in release-1.13.

            arvid Arvid Heise added a comment - The last error is coming from a different test. Neither the test nor the code under test is present in release-1.13.
            arvid Arvid Heise added a comment -

            Merged into master as da0e7dd05f486fef8922f6677d25e1fe00ea90a5 .. 85684e4aa91208a7cc06f1425bc5b7d375a48637.
            Merged into 1.14 as 39d303f7a2a865eb6c1dcf3b513dc38b10aff609 .. 510c2fc09ebb9d638d258bb51ddb21ccaddb1a77.

            Also raised FLINK-24182 which caused the leaks in the first place.

            arvid Arvid Heise added a comment - Merged into master as da0e7dd05f486fef8922f6677d25e1fe00ea90a5 .. 85684e4aa91208a7cc06f1425bc5b7d375a48637. Merged into 1.14 as 39d303f7a2a865eb6c1dcf3b513dc38b10aff609 .. 510c2fc09ebb9d638d258bb51ddb21ccaddb1a77. Also raised FLINK-24182 which caused the leaks in the first place.
            dwysakowicz Dawid Wysakowicz added a comment - https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=23710&view=logs&j=c5f0071e-1851-543e-9a45-9ac140befc32&t=15a22db7-8faa-5b34-3920-d33c9f0ca23c&l=7747
            arvid Arvid Heise added a comment -

            Again wrong ticket, probably FLINK-22056 or even FLINK-18634.

            arvid Arvid Heise added a comment - Again wrong ticket, probably FLINK-22056 or even FLINK-18634 .

            People

              arvid Arvid Heise
              dwysakowicz Dawid Wysakowicz
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: