Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-19212

Failed to serialize the result for RPC call : requestTaskManagerInfo.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Duplicate
    • 1.11.1
    • 1.11.2
    • Runtime / Coordination
    • None

    Description

      Hi,

      On a Standalone, HA setup with ZK (2 JM instances), I am unable to look at the Web GUI tab Task Managers.

      The pattern I saw was that looking from the leader doesn't throw the exception, but from the followers, the exception is thrown.

      Error log from JobManager:

      2020-09-13 00:35:58,625 ERROR org.apache.flink.runtime.rest.handler.taskmanager.TaskManagersHandler [] - Unhandled exception.
      org.apache.flink.runtime.rpc.akka.exceptions.AkkaRpcException: Failed to serialize the result for RPC call : requestTaskManagerInfo.
              at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.serializeRemoteResultAndVerifySize(AkkaRpcActor.java:368) ~[flink-dist_2.12-1.11.1.jar:1.11.1]
              at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$sendAsyncResponse$0(AkkaRpcActor.java:335) ~[flink-dist_2.12-1.11.1.jar:1.11.1]
              at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:859) ~[?:?]
              at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:883) ~[?:?]
              at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2251) ~[?:?]
              at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.sendAsyncResponse(AkkaRpcActor.java:329) ~[flink-dist_2.12-1.11.1.jar:1.11.1]
              at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:298) ~[flink-dist_2.12-1.11.1.jar:1.11.1]
              at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:199) ~[flink-dist_2.12-1.11.1.jar:1.11.1]
              at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:74) ~[flink-dist_2.12-1.11.1.jar:1.11.1]
              at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:152) ~[flink-dist_2.12-1.11.1.jar:1.11.1]
              at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26) ~[flink-dist_2.12-1.11.1.jar:1.11.1]
              at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21) ~[flink-dist_2.12-1.11.1.jar:1.11.1]
              at scala.PartialFunction.applyOrElse(PartialFunction.scala:123) ~[flink-dist_2.12-1.11.1.jar:1.11.1]
              at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122) ~[flink-dist_2.12-1.11.1.jar:1.11.1]
              at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21) ~[flink-dist_2.12-1.11.1.jar:1.11.1]
              at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) ~[flink-dist_2.12-1.11.1.jar:1.11.1]
              at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) ~[flink-dist_2.12-1.11.1.jar:1.11.1]
              at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) ~[flink-dist_2.12-1.11.1.jar:1.11.1]
              at akka.actor.Actor.aroundReceive(Actor.scala:517) ~[flink-dist_2.12-1.11.1.jar:1.11.1]
              at akka.actor.Actor.aroundReceive$(Actor.scala:515) ~[flink-dist_2.12-1.11.1.jar:1.11.1]
              at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:225) ~[flink-dist_2.12-1.11.1.jar:1.11.1]
              at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592) [flink-dist_2.12-1.11.1.jar:1.11.1]
              at akka.actor.ActorCell.invoke(ActorCell.scala:561) [flink-dist_2.12-1.11.1.jar:1.11.1]
              at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258) [flink-dist_2.12-1.11.1.jar:1.11.1]
              at akka.dispatch.Mailbox.run(Mailbox.scala:225) [flink-dist_2.12-1.11.1.jar:1.11.1]
              at akka.dispatch.Mailbox.exec(Mailbox.scala:235) [flink-dist_2.12-1.11.1.jar:1.11.1]
              at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) [flink-dist_2.12-1.11.1.jar:1.11.1]
              at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) [flink-dist_2.12-1.11.1.jar:1.11.1]
              at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) [flink-dist_2.12-1.11.1.jar:1.11.1]
              at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) [flink-dist_2.12-1.11.1.jar:1.11.1]
      Caused by: java.io.NotSerializableException: org.apache.flink.runtime.rest.messages.ResourceProfileInfo
              at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1185) ~[?:?]
              at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1553) ~[?:?]
              at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1510) ~[?:?]
              at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1433) ~[?:?]
              at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1179) ~[?:?]
              at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:349) ~[?:?]
              at java.util.ArrayList.writeObject(ArrayList.java:896) ~[?:?]
              at jdk.internal.reflect.GeneratedMethodAccessor25.invoke(Unknown Source) ~[?:?]
              at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
              at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
              at java.io.ObjectStreamClass.invokeWriteObject(ObjectStreamClass.java:1130) ~[?:?]
              at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1497) ~[?:?]
              at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1433) ~[?:?]
              at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1179) ~[?:?]
              at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:349) ~[?:?]
              at org.apache.flink.util.InstantiationUtil.serializeObject(InstantiationUtil.java:586) ~[flink-dist_2.12-1.11.1.jar:1.11.1]
              at org.apache.flink.util.SerializedValue.<init>(SerializedValue.java:52) ~[flink-dist_2.12-1.11.1.jar:1.11.1]
              at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.serializeRemoteResultAndVerifySize(AkkaRpcActor.java:357) ~[flink-dist_2.12-1.11.1.jar:1.11.1]
              ... 29 more
      
      

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              klden Kenzyme Le
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: