Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-20173

CoordinatedSourceITCase.testEnumeratorReaderCommunication fails with IllegalStateException

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 1.11.3
    • Fix Version/s: None
    • Component/s: Connectors / Common
    • Labels:

      Description

      https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=9633&view=logs&j=fc5181b0-e452-5c8f-68de-1097947f6483&t=6b04ca5f-0b52-511d-19c9-52bf0d9fbdfa

      2020-11-16T13:03:16.9279059Z [ERROR] Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 2.612 s <<< FAILURE! - in org.apache.flink.connector.base.source.reader.CoordinatedSourceITCase
      2020-11-16T13:03:16.9279932Z [ERROR] testEnumeratorReaderCommunication(org.apache.flink.connector.base.source.reader.CoordinatedSourceITCase)  Time elapsed: 0.067 s  <<< ERROR!
      2020-11-16T13:03:16.9280589Z org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
      2020-11-16T13:03:16.9281391Z 	at org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:147)
      2020-11-16T13:03:16.9282173Z 	at org.apache.flink.runtime.minicluster.MiniCluster.executeJobBlocking(MiniCluster.java:677)
      2020-11-16T13:03:16.9282802Z 	at org.apache.flink.streaming.util.TestStreamEnvironment.execute(TestStreamEnvironment.java:81)
      2020-11-16T13:03:16.9283356Z 	at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1697)
      2020-11-16T13:03:16.9283953Z 	at org.apache.flink.streaming.api.environment.StreamExecutionEnvironment.execute(StreamExecutionEnvironment.java:1679)
      2020-11-16T13:03:16.9284600Z 	at org.apache.flink.connector.base.source.reader.CoordinatedSourceITCase.executeAndVerify(CoordinatedSourceITCase.java:84)
      2020-11-16T13:03:16.9285253Z 	at org.apache.flink.connector.base.source.reader.CoordinatedSourceITCase.testEnumeratorReaderCommunication(CoordinatedSourceITCase.java:52)
      2020-11-16T13:03:16.9285749Z 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      2020-11-16T13:03:16.9286151Z 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      2020-11-16T13:03:16.9286627Z 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      2020-11-16T13:03:16.9287041Z 	at java.lang.reflect.Method.invoke(Method.java:498)
      2020-11-16T13:03:16.9287456Z 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
      2020-11-16T13:03:16.9287932Z 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
      2020-11-16T13:03:16.9288389Z 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
      2020-11-16T13:03:16.9288851Z 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
      2020-11-16T13:03:16.9289280Z 	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
      2020-11-16T13:03:16.9289638Z 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
      2020-11-16T13:03:16.9290071Z 	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
      2020-11-16T13:03:16.9290510Z 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
      2020-11-16T13:03:16.9291178Z 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
      2020-11-16T13:03:16.9291665Z 	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
      2020-11-16T13:03:16.9292059Z 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
      2020-11-16T13:03:16.9292466Z 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
      2020-11-16T13:03:16.9292856Z 	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
      2020-11-16T13:03:16.9293258Z 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
      2020-11-16T13:03:16.9293655Z 	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
      2020-11-16T13:03:16.9294131Z 	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
      2020-11-16T13:03:16.9294517Z 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
      2020-11-16T13:03:16.9294875Z 	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
      2020-11-16T13:03:16.9295298Z 	at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
      2020-11-16T13:03:16.9295788Z 	at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
      2020-11-16T13:03:16.9296265Z 	at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
      2020-11-16T13:03:16.9296739Z 	at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
      2020-11-16T13:03:16.9297241Z 	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
      2020-11-16T13:03:16.9297740Z 	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
      2020-11-16T13:03:16.9298207Z 	at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
      2020-11-16T13:03:16.9298652Z 	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
      2020-11-16T13:03:16.9299212Z Caused by: org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
      2020-11-16T13:03:16.9299907Z 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:116)
      2020-11-16T13:03:16.9301093Z 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:78)
      2020-11-16T13:03:16.9302068Z 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:192)
      2020-11-16T13:03:16.9302897Z 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:185)
      2020-11-16T13:03:16.9303594Z 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:179)
      2020-11-16T13:03:16.9304414Z 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:503)
      2020-11-16T13:03:16.9305221Z 	at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:384)
      2020-11-16T13:03:16.9305908Z 	at sun.reflect.GeneratedMethodAccessor14.invoke(Unknown Source)
      2020-11-16T13:03:16.9306567Z 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      2020-11-16T13:03:16.9307220Z 	at java.lang.reflect.Method.invoke(Method.java:498)
      2020-11-16T13:03:16.9307909Z 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:286)
      2020-11-16T13:03:16.9308708Z 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:201)
      2020-11-16T13:03:16.9309544Z 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:74)
      2020-11-16T13:03:16.9310390Z 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:154)
      2020-11-16T13:03:16.9311404Z 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26)
      2020-11-16T13:03:16.9312075Z 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21)
      2020-11-16T13:03:16.9312712Z 	at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
      2020-11-16T13:03:16.9313331Z 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21)
      2020-11-16T13:03:16.9313899Z 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:170)
      2020-11-16T13:03:16.9314396Z 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
      2020-11-16T13:03:16.9314796Z 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
      2020-11-16T13:03:16.9315188Z 	at akka.actor.Actor$class.aroundReceive(Actor.scala:517)
      2020-11-16T13:03:16.9315584Z 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:225)
      2020-11-16T13:03:16.9315967Z 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592)
      2020-11-16T13:03:16.9316332Z 	at akka.actor.ActorCell.invoke(ActorCell.scala:561)
      2020-11-16T13:03:16.9316713Z 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258)
      2020-11-16T13:03:16.9317063Z 	at akka.dispatch.Mailbox.run(Mailbox.scala:225)
      2020-11-16T13:03:16.9317395Z 	at akka.dispatch.Mailbox.exec(Mailbox.scala:235)
      2020-11-16T13:03:16.9317768Z 	at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
      2020-11-16T13:03:16.9318184Z 	at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
      2020-11-16T13:03:16.9318620Z 	at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
      2020-11-16T13:03:16.9319055Z 	at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
      2020-11-16T13:03:16.9320025Z Caused by: java.lang.IllegalStateException: Called 'finishedOrAvailableLater()' with shut-down fetchers but non-empty queue
      2020-11-16T13:03:16.9320611Z 	at org.apache.flink.connector.base.source.reader.SourceReaderBase.finishedOrAvailableLater(SourceReaderBase.java:271)
      2020-11-16T13:03:16.9321449Z 	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:118)
      2020-11-16T13:03:16.9322205Z 	at org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:142)
      2020-11-16T13:03:16.9322732Z 	at org.apache.flink.streaming.api.operators.SourceOperator.pollNextRecord(SourceOperator.java:219)
      2020-11-16T13:03:16.9323321Z 	at org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:209)
      2020-11-16T13:03:16.9323819Z 	at org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:47)
      2020-11-16T13:03:16.9324421Z 	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:67)
      2020-11-16T13:03:16.9324949Z 	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:351)
      2020-11-16T13:03:16.9325456Z 	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxStep(MailboxProcessor.java:191)
      2020-11-16T13:03:16.9326016Z 	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:181)
      2020-11-16T13:03:16.9326546Z 	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:564)
      2020-11-16T13:03:16.9327008Z 	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:534)
      2020-11-16T13:03:16.9327444Z 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:721)
      2020-11-16T13:03:16.9327835Z 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:546)
      2020-11-16T13:03:16.9328163Z 	at java.lang.Thread.run(Thread.java:748)
      

        Attachments

        Issue Links

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              rmetzger Robert Metzger

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment