Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-35074

SavepointITCase.testStopWithSavepointWithDrainGlobalFailoverIfSavepointAborted

    XMLWordPrintableJSON

Details

    Description

      AdaptiveScheduler: Test (module: tests) https://github.com/apache/flink/actions/runs/8609297979/job/23593291616#step:10:7708

      Error: 02:38:03 02:38:03.567 [ERROR] org.apache.flink.test.checkpointing.SavepointITCase.testStopWithSavepointWithDrainGlobalFailoverIfSavepointAborted  Time elapsed: 0.62 s  <<< ERROR!
      Apr 09 02:38:03 java.util.concurrent.ExecutionException: org.apache.flink.util.FlinkException: Stop with savepoint operation could not be completed.
      Apr 09 02:38:03 	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
      Apr 09 02:38:03 	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
      Apr 09 02:38:03 	at org.apache.flink.test.checkpointing.SavepointITCase.testStopWithSavepointWithDrainGlobalFailoverIfSavepointAborted(SavepointITCase.java:1072)
      Apr 09 02:38:03 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      Apr 09 02:38:03 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      Apr 09 02:38:03 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      Apr 09 02:38:03 	at java.lang.reflect.Method.invoke(Method.java:498)
      Apr 09 02:38:03 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
      Apr 09 02:38:03 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
      Apr 09 02:38:03 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
      Apr 09 02:38:03 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
      Apr 09 02:38:03 	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
      Apr 09 02:38:03 	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
      Apr 09 02:38:03 	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
      Apr 09 02:38:03 	at org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
      Apr 09 02:38:03 	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
      Apr 09 02:38:03 	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
      Apr 09 02:38:03 	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
      Apr 09 02:38:03 	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
      Apr 09 02:38:03 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
      Apr 09 02:38:03 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
      Apr 09 02:38:03 	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
      Apr 09 02:38:03 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
      Apr 09 02:38:03 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
      Apr 09 02:38:03 	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
      Apr 09 02:38:03 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
      Apr 09 02:38:03 	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
      Apr 09 02:38:03 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
      Apr 09 02:38:03 	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
      Apr 09 02:38:03 	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
      Apr 09 02:38:03 	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
      Apr 09 02:38:03 	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
      Apr 09 02:38:03 	at org.junit.vintage.engine.execution.RunnerExecutor.execute(RunnerExecutor.java:42)
      Apr 09 02:38:03 	at org.junit.vintage.engine.VintageTestEngine.executeAllChildren(VintageTestEngine.java:80)
      Apr 09 02:38:03 	at org.junit.vintage.engine.VintageTestEngine.execute(VintageTestEngine.java:72)
      Apr 09 02:38:03 	at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:147)
      Apr 09 02:38:03 	at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:127)
      Apr 09 02:38:03 	at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:90)
      Apr 09 02:38:03 	at org.junit.platform.launcher.core.EngineExecutionOrchestrator.lambda$execute$0(EngineExecutionOrchestrator.java:55)
      Apr 09 02:38:03 	at org.junit.platform.launcher.core.EngineExecutionOrchestrator.withInterceptedStreams(EngineExecutionOrchestrator.java:102)
      Apr 09 02:38:03 	at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:54)
      Apr 09 02:38:03 	at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:114)
      Apr 09 02:38:03 	at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:86)
      Apr 09 02:38:03 	at org.junit.platform.launcher.core.DefaultLauncherSession$DelegatingLauncher.execute(DefaultLauncherSession.java:86)
      Apr 09 02:38:03 	at org.junit.platform.launcher.core.SessionPerRequestLauncher.execute(SessionPerRequestLauncher.java:53)
      Apr 09 02:38:03 	at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.execute(JUnitPlatformProvider.java:188)
      Apr 09 02:38:03 	at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invokeAllTests(JUnitPlatformProvider.java:154)
      Apr 09 02:38:03 	at org.apache.maven.surefire.junitplatform.JUnitPlatformProvider.invoke(JUnitPlatformProvider.java:124)
      Apr 09 02:38:03 	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:428)
      Apr 09 02:38:03 	at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:162)
      Apr 09 02:38:03 	at org.apache.maven.surefire.booter.ForkedBooter.run(ForkedBooter.java:562)
      Apr 09 02:38:03 	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:548)
      Apr 09 02:38:03 Caused by: org.apache.flink.util.FlinkException: Stop with savepoint operation could not be completed.
      Apr 09 02:38:03 	at org.apache.flink.runtime.scheduler.adaptive.StopWithSavepoint.onLeave(StopWithSavepoint.java:146)
      Apr 09 02:38:03 	at org.apache.flink.runtime.scheduler.adaptive.AdaptiveScheduler.transitionToState(AdaptiveScheduler.java:1294)
      Apr 09 02:38:03 	at org.apache.flink.runtime.scheduler.adaptive.AdaptiveScheduler.goToRestarting(AdaptiveScheduler.java:977)
      Apr 09 02:38:03 	at org.apache.flink.runtime.scheduler.adaptive.FailureResultUtil.restartOrFail(FailureResultUtil.java:28)
      Apr 09 02:38:03 	at org.apache.flink.runtime.scheduler.adaptive.StopWithSavepoint.lambda$onFailure$3(StopWithSavepoint.java:233)
      Apr 09 02:38:03 	at java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:836)
      Apr 09 02:38:03 	at java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:811)
      Apr 09 02:38:03 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
      Apr 09 02:38:03 	at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990)
      Apr 09 02:38:03 	at org.apache.flink.runtime.scheduler.adaptive.StopWithSavepoint.lambda$null$1(StopWithSavepoint.java:134)
      Apr 09 02:38:03 	at org.apache.flink.runtime.scheduler.adaptive.AdaptiveScheduler.runIfState(AdaptiveScheduler.java:1246)
      Apr 09 02:38:03 	at org.apache.flink.runtime.scheduler.adaptive.AdaptiveScheduler.lambda$runIfState$29(AdaptiveScheduler.java:1261)
      Apr 09 02:38:03 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
      Apr 09 02:38:03 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      Apr 09 02:38:03 	at org.apache.flink.runtime.rpc.pekko.PekkoRpcActor.lambda$handleRunAsync$4(PekkoRpcActor.java:451)
      Apr 09 02:38:03 	at org.apache.flink.runtime.concurrent.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68)
      Apr 09 02:38:03 	at org.apache.flink.runtime.rpc.pekko.PekkoRpcActor.handleRunAsync(PekkoRpcActor.java:451)
      Apr 09 02:38:03 	at org.apache.flink.runtime.rpc.pekko.PekkoRpcActor.handleRpcMessage(PekkoRpcActor.java:218)
      Apr 09 02:38:03 	at org.apache.flink.runtime.rpc.pekko.FencedPekkoRpcActor.handleRpcMessage(FencedPekkoRpcActor.java:85)
      Apr 09 02:38:03 	at org.apache.flink.runtime.rpc.pekko.PekkoRpcActor.handleMessage(PekkoRpcActor.java:168)
      Apr 09 02:38:03 	at org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:33)
      Apr 09 02:38:03 	at org.apache.pekko.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:29)
      Apr 09 02:38:03 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:127)
      Apr 09 02:38:03 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:126)
      Apr 09 02:38:03 	at org.apache.pekko.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:29)
      Apr 09 02:38:03 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:175)
      Apr 09 02:38:03 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:176)
      Apr 09 02:38:03 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:176)
      Apr 09 02:38:03 	at org.apache.pekko.actor.Actor.aroundReceive(Actor.scala:547)
      Apr 09 02:38:03 	at org.apache.pekko.actor.Actor.aroundReceive$(Actor.scala:545)
      Apr 09 02:38:03 	at org.apache.pekko.actor.AbstractActor.aroundReceive(AbstractActor.scala:229)
      Apr 09 02:38:03 	at org.apache.pekko.actor.ActorCell.receiveMessage(ActorCell.scala:590)
      Apr 09 02:38:03 	at org.apache.pekko.actor.ActorCell.invoke(ActorCell.scala:557)
      Apr 09 02:38:03 	at org.apache.pekko.dispatch.Mailbox.processMailbox(Mailbox.scala:280)
      Apr 09 02:38:03 	at org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:241)
      Apr 09 02:38:03 	at org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:253)
      Apr 09 02:38:03 	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
      Apr 09 02:38:03 	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
      Apr 09 02:38:03 	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
      Apr 09 02:38:03 	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
      Apr 09 02:38:03 Caused by: org.apache.flink.util.FlinkRuntimeException: Stop-with-savepoint failed.
      Apr 09 02:38:03 	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$notifyCheckpointAbortAsync$18(StreamTask.java:1404)
      Apr 09 02:38:03 	at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$notifyCheckpointOperation$20(StreamTask.java:1429)
      Apr 09 02:38:03 	at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$SynchronizedStreamTaskActionExecutor.runThrowing(StreamTaskActionExecutor.java:93)
      Apr 09 02:38:03 	at org.apache.flink.streaming.runtime.tasks.mailbox.Mail.run(Mail.java:90)
      Apr 09 02:38:03 	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMail(MailboxProcessor.java:398)
      Apr 09 02:38:03 	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.processMailsWhenDefaultActionUnavailable(MailboxProcessor.java:367)
      Apr 09 02:38:03 	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.processMail(MailboxProcessor.java:352)
      Apr 09 02:38:03 	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:229)
      Apr 09 02:38:03 	at org.apache.flink.streaming.runtime.tasks.StreamTask.afterInvoke(StreamTask.java:888)
      Apr 09 02:38:03 	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:813)
      Apr 09 02:38:03 	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:953)
      Apr 09 02:38:03 	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:932)
      Apr 09 02:38:03 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:746)
      Apr 09 02:38:03 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:562)
      Apr 09 02:38:03 	at java.lang.Thread.run(Thread.java:750)
      

      This is awkward to test because we are expecting an ExecutionException (artificially added in this ITCase by failPath), but we are getting a different exception from a different location.

      Attachments

        Activity

          People

            Unassigned Unassigned
            rskraba Ryan Skraba
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: