Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-25498

FlinkKafkaProducerITCase. testRestoreToCheckpointAfterExceedingProducersPool failed on azure

    XMLWordPrintableJSON

Details

    Description

      2021-12-31T08:14:15.9176809Z Dec 31 08:14:15 java.lang.AssertionError: Expected elements: <[42]>, but was: elements: <[42, 42, 42, 42]>
      2021-12-31T08:14:15.9177351Z Dec 31 08:14:15 	at org.junit.Assert.fail(Assert.java:89)
      2021-12-31T08:14:15.9177963Z Dec 31 08:14:15 	at org.apache.flink.streaming.connectors.kafka.KafkaTestBase.assertExactlyOnceForTopic(KafkaTestBase.java:331)
      2021-12-31T08:14:15.9183636Z Dec 31 08:14:15 	at org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerITCase.testRestoreToCheckpointAfterExceedingProducersPool(FlinkKafkaProducerITCase.java:159)
      2021-12-31T08:14:15.9184980Z Dec 31 08:14:15 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      2021-12-31T08:14:15.9185908Z Dec 31 08:14:15 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      2021-12-31T08:14:15.9186954Z Dec 31 08:14:15 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      2021-12-31T08:14:15.9187888Z Dec 31 08:14:15 	at java.lang.reflect.Method.invoke(Method.java:498)
      2021-12-31T08:14:15.9188819Z Dec 31 08:14:15 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
      2021-12-31T08:14:15.9189826Z Dec 31 08:14:15 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
      2021-12-31T08:14:15.9191068Z Dec 31 08:14:15 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
      2021-12-31T08:14:15.9191923Z Dec 31 08:14:15 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
      2021-12-31T08:14:15.9193167Z Dec 31 08:14:15 	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
      2021-12-31T08:14:15.9193891Z Dec 31 08:14:15 	at org.apache.flink.testutils.junit.RetryRule$RetryOnFailureStatement.evaluate(RetryRule.java:135)
      2021-12-31T08:14:15.9194516Z Dec 31 08:14:15 	at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
      2021-12-31T08:14:15.9195078Z Dec 31 08:14:15 	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
      2021-12-31T08:14:15.9195616Z Dec 31 08:14:15 	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
      2021-12-31T08:14:15.9196194Z Dec 31 08:14:15 	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
      2021-12-31T08:14:15.9196762Z Dec 31 08:14:15 	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
      2021-12-31T08:14:15.9197389Z Dec 31 08:14:15 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
      2021-12-31T08:14:15.9197988Z Dec 31 08:14:15 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
      2021-12-31T08:14:15.9198818Z Dec 31 08:14:15 	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
      2021-12-31T08:14:15.9199544Z Dec 31 08:14:15 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
      2021-12-31T08:14:15.9200367Z Dec 31 08:14:15 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
      2021-12-31T08:14:15.9200914Z Dec 31 08:14:15 	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
      2021-12-31T08:14:15.9201465Z Dec 31 08:14:15 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
      2021-12-31T08:14:15.9202369Z Dec 31 08:14:15 	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
      2021-12-31T08:14:15.9203399Z Dec 31 08:14:15 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
      2021-12-31T08:14:15.9203973Z Dec 31 08:14:15 	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
      2021-12-31T08:14:15.9204504Z Dec 31 08:14:15 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
      2021-12-31T08:14:15.9205027Z Dec 31 08:14:15 	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
      2021-12-31T08:14:15.9205549Z Dec 31 08:14:15 	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
      2021-12-31T08:14:15.9206053Z Dec 31 08:14:15 	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
      2021-12-31T08:14:15.9206540Z Dec 31 08:14:15 	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
      2021-12-31T08:14:15.9207069Z Dec 31 08:14:15 	at org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:43)
      2021-12-31T08:14:15.9207661Z Dec 31 08:14:15 	at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183)
      2021-12-31T08:14:15.9208412Z Dec 31 08:14:15 	at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
      2021-12-31T08:14:15.9208957Z Dec 31 08:14:15 	at java.util.Iterator.forEachRemaining(Iterator.java:116)
      2021-12-31T08:14:15.9209512Z Dec 31 08:14:15 	at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
      2021-12-31T08:14:15.9210113Z Dec 31 08:14:15 	at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
      2021-12-31T08:14:15.9210688Z Dec 31 08:14:15 	at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
      2021-12-31T08:14:15.9211258Z Dec 31 08:14:15 	at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150)
      2021-12-31T08:14:15.9211861Z Dec 31 08:14:15 	at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:173)
      2021-12-31T08:14:15.9212446Z Dec 31 08:14:15 	at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
      2021-12-31T08:14:15.9213288Z Dec 31 08:14:15 	at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:485)
      2021-12-31T08:14:15.9214004Z Dec 31 08:14:15 	at org.junit.vintage.engine.VintageTestEngine.executeAllChildren(VintageTestEngine.java:82)
      2021-12-31T08:14:15.9214792Z Dec 31 08:14:15 	at org.junit.vintage.engine.VintageTestEngine.execute(VintageTestEngine.java:73)
      2021-12-31T08:14:15.9215739Z Dec 31 08:14:15 	at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:220)
      2021-12-31T08:14:15.9216617Z Dec 31 08:14:15 	at org.junit.platform.launcher.core.DefaultLauncher.lambda$execute$6(DefaultLauncher.java:188)
      2021-12-31T08:14:15.9217412Z Dec 31 08:14:15 	at org.junit.platform.launcher.core.DefaultLauncher.withInterceptedStreams(DefaultLauncher.java:202)
      2021-12-31T08:14:15.9218088Z Dec 31 08:14:15 	at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:181)
      2021-12-31T08:14:15.9218827Z Dec 31 08:14:15 	at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:128)
      2021-12-31T08:14:15.9219507Z Dec 31 08:14:15 	at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invokeAllTests(JUnitPlatformProvider.java:150)
      2021-12-31T08:14:15.9220205Z Dec 31 08:14:15 	at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invoke(JUnitPlatformProvider.java:120)
      2021-12-31T08:14:15.9221047Z Dec 31 08:14:15 	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
      2021-12-31T08:14:15.9221917Z Dec 31 08:14:15 	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
      2021-12-31T08:14:15.9222532Z Dec 31 08:14:15 	at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
      2021-12-31T08:14:15.9223499Z Dec 31 08:14:15 	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
      2021-12-31T08:14:15.9225268Z Dec 31 08:14:15 	Suppressed: org.apache.flink.streaming.connectors.kafka.FlinkKafkaException: Failed to send data to Kafka: Producer attempted an operation with an old epoch. Either there is a newer producer with the same transactionalId, or the producer's transaction has been expired by the broker.
      2021-12-31T08:14:15.9226290Z Dec 31 08:14:15 		at org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.checkErroneous(FlinkKafkaProducer.java:1429)
      2021-12-31T08:14:15.9226969Z Dec 31 08:14:15 		at org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.close(FlinkKafkaProducer.java:977)
      2021-12-31T08:14:15.9227632Z Dec 31 08:14:15 		at org.apache.flink.api.common.functions.util.FunctionUtils.closeFunction(FunctionUtils.java:41)
      2021-12-31T08:14:15.9228314Z Dec 31 08:14:15 		at org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.close(AbstractUdfStreamOperator.java:114)
      2021-12-31T08:14:15.9229035Z Dec 31 08:14:15 		at org.apache.flink.streaming.util.AbstractStreamOperatorTestHarness.close(AbstractStreamOperatorTestHarness.java:726)
      2021-12-31T08:14:15.9229853Z Dec 31 08:14:15 		at org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducerITCase.testRestoreToCheckpointAfterExceedingProducersPool(FlinkKafkaProducerITCase.java:161)
      2021-12-31T08:14:15.9230602Z Dec 31 08:14:15 		... 54 more
      2021-12-31T08:14:15.9231641Z Dec 31 08:14:15 	Caused by: org.apache.kafka.common.errors.ProducerFencedException: Producer attempted an operation with an old epoch. Either there is a newer producer with the same transactionalId, or the producer's transaction has been expired by the broker.
      2021-12-31T08:14:15.9232332Z Dec 31 08:14:15 
      

      https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=28786&view=logs&j=c5f0071e-1851-543e-9a45-9ac140befc32&t=15a22db7-8faa-5b34-3920-d33c9f0ca23c&l=7412

      Attachments

        Activity

          People

            Unassigned Unassigned
            gaoyunhaii Yun Gao
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: