Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-27832

SplitAggregateITCase tests failed with Could not acquire the minimum required resources

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Duplicate
    • 1.16.0
    • None
    • Table SQL / Planner

    Description

      2022-05-27T17:42:59.4814999Z May 27 17:42:59 [ERROR] Tests run: 64, Failures: 23, Errors: 1, Skipped: 0, Time elapsed: 305.5 s <<< FAILURE! - in org.apache.flink.table.planner.runtime.stream.sql.SplitAggregateITCase
      2022-05-27T17:42:59.4815983Z May 27 17:42:59 [ERROR] SplitAggregateITCase.testAggWithJoin  Time elapsed: 278.742 s  <<< ERROR!
      2022-05-27T17:42:59.4816608Z May 27 17:42:59 org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
      2022-05-27T17:42:59.4819182Z May 27 17:42:59 	at org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:144)
      2022-05-27T17:42:59.4820363Z May 27 17:42:59 	at org.apache.flink.runtime.minicluster.MiniClusterJobClient.lambda$getJobExecutionResult$3(MiniClusterJobClient.java:141)
      2022-05-27T17:42:59.4821463Z May 27 17:42:59 	at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:616)
      2022-05-27T17:42:59.4822292Z May 27 17:42:59 	at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591)
      2022-05-27T17:42:59.4823317Z May 27 17:42:59 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
      2022-05-27T17:42:59.4824210Z May 27 17:42:59 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
      2022-05-27T17:42:59.4825081Z May 27 17:42:59 	at org.apache.flink.runtime.rpc.akka.AkkaInvocationHandler.lambda$invokeRpc$1(AkkaInvocationHandler.java:268)
      2022-05-27T17:42:59.4825927Z May 27 17:42:59 	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
      2022-05-27T17:42:59.4826748Z May 27 17:42:59 	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
      2022-05-27T17:42:59.4827596Z May 27 17:42:59 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
      2022-05-27T17:42:59.4828416Z May 27 17:42:59 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
      2022-05-27T17:42:59.4829284Z May 27 17:42:59 	at org.apache.flink.util.concurrent.FutureUtils.doForward(FutureUtils.java:1277)
      2022-05-27T17:42:59.4830111Z May 27 17:42:59 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$null$1(ClassLoadingUtils.java:93)
      2022-05-27T17:42:59.4831015Z May 27 17:42:59 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68)
      2022-05-27T17:42:59.4832222Z May 27 17:42:59 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$guardCompletionWithContextClassLoader$2(ClassLoadingUtils.java:92)
      2022-05-27T17:42:59.4833162Z May 27 17:42:59 	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
      2022-05-27T17:42:59.4834250Z May 27 17:42:59 	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
      2022-05-27T17:42:59.4835236Z May 27 17:42:59 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
      2022-05-27T17:42:59.4836035Z May 27 17:42:59 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
      2022-05-27T17:42:59.4836872Z May 27 17:42:59 	at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$1.onComplete(AkkaFutureUtils.java:47)
      2022-05-27T17:42:59.4837630Z May 27 17:42:59 	at akka.dispatch.OnComplete.internal(Future.scala:300)
      2022-05-27T17:42:59.4838394Z May 27 17:42:59 	at akka.dispatch.OnComplete.internal(Future.scala:297)
      2022-05-27T17:42:59.4839044Z May 27 17:42:59 	at akka.dispatch.japi$CallbackBridge.apply(Future.scala:224)
      2022-05-27T17:42:59.4839748Z May 27 17:42:59 	at akka.dispatch.japi$CallbackBridge.apply(Future.scala:221)
      2022-05-27T17:42:59.4840463Z May 27 17:42:59 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
      2022-05-27T17:42:59.4841313Z May 27 17:42:59 	at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$DirectExecutionContext.execute(AkkaFutureUtils.java:65)
      2022-05-27T17:42:59.4842335Z May 27 17:42:59 	at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:68)
      2022-05-27T17:42:59.4843300Z May 27 17:42:59 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1(Promise.scala:284)
      2022-05-27T17:42:59.4844146Z May 27 17:42:59 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1$adapted(Promise.scala:284)
      2022-05-27T17:42:59.4844882Z May 27 17:42:59 	at scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:284)
      2022-05-27T17:42:59.4845587Z May 27 17:42:59 	at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:621)
      2022-05-27T17:42:59.4846464Z May 27 17:42:59 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:24)
      2022-05-27T17:42:59.4847407Z May 27 17:42:59 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:23)
      2022-05-27T17:42:59.4848154Z May 27 17:42:59 	at scala.concurrent.Future.$anonfun$andThen$1(Future.scala:532)
      2022-05-27T17:42:59.4848904Z May 27 17:42:59 	at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:29)
      2022-05-27T17:42:59.4849738Z May 27 17:42:59 	at scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:29)
      2022-05-27T17:42:59.4850442Z May 27 17:42:59 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
      2022-05-27T17:42:59.4851309Z May 27 17:42:59 	at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:63)
      2022-05-27T17:42:59.4852242Z May 27 17:42:59 	at akka.dispatch.BatchingExecutor$BlockableBatch.$anonfun$run$1(BatchingExecutor.scala:100)
      2022-05-27T17:42:59.4853209Z May 27 17:42:59 	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:12)
      2022-05-27T17:42:59.4853990Z May 27 17:42:59 	at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:81)
      2022-05-27T17:42:59.4854768Z May 27 17:42:59 	at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:100)
      2022-05-27T17:42:59.4855597Z May 27 17:42:59 	at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:49)
      2022-05-27T17:42:59.4856373Z May 27 17:42:59 	at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:48)
      2022-05-27T17:42:59.4857206Z May 27 17:42:59 	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
      2022-05-27T17:42:59.4857961Z May 27 17:42:59 	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
      2022-05-27T17:42:59.4858708Z May 27 17:42:59 	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
      2022-05-27T17:42:59.4859546Z May 27 17:42:59 	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
      2022-05-27T17:42:59.4860469Z May 27 17:42:59 Caused by: org.apache.flink.runtime.JobException: Recovery is suppressed by FixedDelayRestartBackoffTimeStrategy(maxNumberRestartAttempts=1, backoffTimeMS=0)
      2022-05-27T17:42:59.4861804Z May 27 17:42:59 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138)
      2022-05-27T17:42:59.4863007Z May 27 17:42:59 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82)
      2022-05-27T17:42:59.4864036Z May 27 17:42:59 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:300)
      2022-05-27T17:42:59.4864920Z May 27 17:42:59 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:290)
      2022-05-27T17:42:59.4865941Z May 27 17:42:59 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:281)
      2022-05-27T17:42:59.4866951Z May 27 17:42:59 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:716)
      2022-05-27T17:42:59.4868045Z May 27 17:42:59 	at org.apache.flink.runtime.scheduler.UpdateSchedulerNgOnInternalFailuresListener.notifyTaskFailure(UpdateSchedulerNgOnInternalFailuresListener.java:51)
      2022-05-27T17:42:59.4869224Z May 27 17:42:59 	at org.apache.flink.runtime.executiongraph.DefaultExecutionGraph.notifySchedulerNgAboutInternalTaskFailure(DefaultExecutionGraph.java:1546)
      2022-05-27T17:42:59.4870193Z May 27 17:42:59 	at org.apache.flink.runtime.executiongraph.Execution.processFail(Execution.java:1113)
      2022-05-27T17:42:59.4870983Z May 27 17:42:59 	at org.apache.flink.runtime.executiongraph.Execution.processFail(Execution.java:1053)
      2022-05-27T17:42:59.4871995Z May 27 17:42:59 	at org.apache.flink.runtime.executiongraph.Execution.markFailed(Execution.java:892)
      2022-05-27T17:42:59.4872933Z May 27 17:42:59 	at org.apache.flink.runtime.executiongraph.ExecutionVertex.markFailed(ExecutionVertex.java:463)
      2022-05-27T17:42:59.4873886Z May 27 17:42:59 	at org.apache.flink.runtime.scheduler.DefaultExecutionVertexOperations.markFailed(DefaultExecutionVertexOperations.java:42)
      2022-05-27T17:42:59.4874915Z May 27 17:42:59 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskDeploymentFailure(DefaultScheduler.java:617)
      2022-05-27T17:42:59.4875950Z May 27 17:42:59 	at org.apache.flink.runtime.scheduler.DefaultScheduler.lambda$assignAllResourcesAndRegisterProducedPartitions$6(DefaultScheduler.java:493)
      2022-05-27T17:42:59.4876899Z May 27 17:42:59 	at java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:836)
      2022-05-27T17:42:59.4877762Z May 27 17:42:59 	at java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:811)
      2022-05-27T17:42:59.4878575Z May 27 17:42:59 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
      2022-05-27T17:42:59.4879381Z May 27 17:42:59 	at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990)
      2022-05-27T17:42:59.4880332Z May 27 17:42:59 	at org.apache.flink.runtime.jobmaster.slotpool.PendingRequest.failRequest(PendingRequest.java:88)
      2022-05-27T17:42:59.4881426Z May 27 17:42:59 	at org.apache.flink.runtime.jobmaster.slotpool.DeclarativeSlotPoolBridge.cancelPendingRequests(DeclarativeSlotPoolBridge.java:186)
      2022-05-27T17:42:59.4882487Z May 27 17:42:59 	at org.apache.flink.runtime.jobmaster.slotpool.DeclarativeSlotPoolBridge.failPendingRequests(DeclarativeSlotPoolBridge.java:408)
      2022-05-27T17:42:59.4883670Z May 27 17:42:59 	at org.apache.flink.runtime.jobmaster.slotpool.DeclarativeSlotPoolBridge.notifyNotEnoughResourcesAvailable(DeclarativeSlotPoolBridge.java:397)
      2022-05-27T17:42:59.4884730Z May 27 17:42:59 	at org.apache.flink.runtime.jobmaster.JobMaster.notifyNotEnoughResourcesAvailable(JobMaster.java:853)
      2022-05-27T17:42:59.4885502Z May 27 17:42:59 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      2022-05-27T17:42:59.4886291Z May 27 17:42:59 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      2022-05-27T17:42:59.4887249Z May 27 17:42:59 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      2022-05-27T17:42:59.4888074Z May 27 17:42:59 	at java.lang.reflect.Method.invoke(Method.java:498)
      2022-05-27T17:42:59.4888943Z May 27 17:42:59 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$0(AkkaRpcActor.java:296)
      2022-05-27T17:42:59.4889952Z May 27 17:42:59 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
      2022-05-27T17:42:59.4890846Z May 27 17:42:59 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:295)
      2022-05-27T17:42:59.4891757Z May 27 17:42:59 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
      2022-05-27T17:42:59.4892722Z May 27 17:42:59 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
      2022-05-27T17:42:59.4893763Z May 27 17:42:59 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
      2022-05-27T17:42:59.4894518Z May 27 17:42:59 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
      2022-05-27T17:42:59.4895254Z May 27 17:42:59 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
      2022-05-27T17:42:59.4896054Z May 27 17:42:59 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
      2022-05-27T17:42:59.4896756Z May 27 17:42:59 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
      2022-05-27T17:42:59.4897468Z May 27 17:42:59 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
      2022-05-27T17:42:59.4898203Z May 27 17:42:59 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
      2022-05-27T17:42:59.4898926Z May 27 17:42:59 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
      2022-05-27T17:42:59.4899753Z May 27 17:42:59 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
      2022-05-27T17:42:59.4900454Z May 27 17:42:59 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
      2022-05-27T17:42:59.4901094Z May 27 17:42:59 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
      2022-05-27T17:42:59.4901867Z May 27 17:42:59 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
      2022-05-27T17:42:59.4902572Z May 27 17:42:59 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
      2022-05-27T17:42:59.4903357Z May 27 17:42:59 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
      2022-05-27T17:42:59.4903965Z May 27 17:42:59 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
      2022-05-27T17:42:59.4904701Z May 27 17:42:59 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
      2022-05-27T17:42:59.4905227Z May 27 17:42:59 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
      2022-05-27T17:42:59.4905773Z May 27 17:42:59 	... 4 more
      2022-05-27T17:42:59.4906616Z May 27 17:42:59 Caused by: java.util.concurrent.CompletionException: java.util.concurrent.CompletionException: org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: Could not acquire the minimum required resources.
      2022-05-27T17:42:59.4907811Z May 27 17:42:59 	at org.apache.flink.runtime.scheduler.DefaultScheduler.lambda$assignResource$8(DefaultScheduler.java:551)
      2022-05-27T17:42:59.4908485Z May 27 17:42:59 	... 39 more
      2022-05-27T17:42:59.4909342Z May 27 17:42:59 Caused by: java.util.concurrent.CompletionException: org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: Could not acquire the minimum required resources.
      2022-05-27T17:42:59.4910622Z May 27 17:42:59 	at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292)
      2022-05-27T17:42:59.4911542Z May 27 17:42:59 	at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308)
      2022-05-27T17:42:59.4912324Z May 27 17:42:59 	at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:607)
      2022-05-27T17:42:59.4913248Z May 27 17:42:59 	at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591)
      2022-05-27T17:42:59.4913959Z May 27 17:42:59 	... 37 more
      2022-05-27T17:42:59.4914693Z May 27 17:42:59 Caused by: org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException: Could not acquire the minimum required resources.
      

      https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=36139&view=logs&j=0c940707-2659-5648-cbe6-a1ad63045f0a&t=075c2716-8010-5565-fe08-3c4bb45824a4&l=15404

      Attachments

        Issue Links

          Activity

            People

              godfreyhe godfrey he
              hxbks2ks Huang Xingbo
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: