Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-25358

New File Sink end-to-end test failed due to TM could not connect to RM

    XMLWordPrintableJSON

Details

    Description

      2021-12-16T16:53:21.8386046Z Dec 16 16:53:15 2021-12-16 16:39:16,946 INFO  org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Start job leader service.
      2021-12-16T16:53:21.8386987Z Dec 16 16:53:15 2021-12-16 16:39:16,948 INFO  org.apache.flink.runtime.filecache.FileCache                 [] - User file cache uses directory /tmp/flink-dist-cache-3a780c9f-c395-4355-b496-ade62a0757ad
      2021-12-16T16:53:21.8388219Z Dec 16 16:53:15 2021-12-16 16:39:16,960 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Connecting to ResourceManager akka.ssl.tcp://flink@localhost:6123/user/rpc/resourcemanager_*(00000000000000000000000000000000).
      2021-12-16T16:53:21.8389898Z Dec 16 16:53:15 2021-12-16 16:39:17,485 WARN  akka.remote.EndpointReader                                   [] - Discarding inbound message to [Actor[akka://flink/temp/_user_rpc_resourcemanager_*$a]] in read-only association to [akka.ssl.tcp://flink@localhost:6123]. If this happens often you may consider using akka.remote.use-passive-connections=off or use Artery TCP.
      2021-12-16T16:53:21.8391767Z Dec 16 16:53:15 2021-12-16 16:39:18,851 WARN  akka.remote.EndpointReader                                   [] - Discarding inbound message to [Actor[akka://flink/user/rpc/taskmanager_0#-1901973634]] in read-only association to [akka.ssl.tcp://flink@localhost:6123]. If this happens often you may consider using akka.remote.use-passive-connections=off or use Artery TCP.
      2021-12-16T16:53:21.8393631Z Dec 16 16:53:15 2021-12-16 16:39:20,374 WARN  akka.remote.EndpointReader                                   [] - Discarding inbound message to [Actor[akka://flink/user/rpc/taskmanager_0#-1901973634]] in read-only association to [akka.ssl.tcp://flink@localhost:6123]. If this happens often you may consider using akka.remote.use-passive-connections=off or use Artery TCP.
      2021-12-16T16:53:21.8395509Z Dec 16 16:53:15 2021-12-16 16:39:20,376 WARN  akka.remote.EndpointReader                                   [] - Discarding inbound message to [Actor[akka://flink/user/rpc/taskmanager_0#-1901973634]] in read-only association to [akka.ssl.tcp://flink@localhost:6123]. If this happens often you may consider using akka.remote.use-passive-connections=off or use Artery TCP.
      2021-12-16T16:53:21.8397548Z Dec 16 16:53:15 2021-12-16 16:39:27,018 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Could not resolve ResourceManager address akka.ssl.tcp://flink@localhost:***@localhost:6123/user/rpc/resourcemanager_*.
      2021-12-16T16:53:21.8399173Z Dec 16 16:53:15 2021-12-16 16:39:28,864 WARN  akka.remote.EndpointReader                                   [] - Discarding inbound message to [Actor[akka://flink/user/rpc/taskmanager_0#-1901973634]] in read-only association to [akka.ssl.tcp://flink@localhost:6123]. If this happens often you may consider using akka.remote.use-passive-connections=off or use Artery TCP.
      2021-12-16T16:53:21.8401223Z Dec 16 16:53:15 2021-12-16 16:39:30,357 WARN  akka.remote.EndpointReader                                   [] - Discarding inbound message to [Actor[akka://flink/user/rpc/taskmanager_0#-1901973634]] in read-only association to [akka.ssl.tcp://flink@localhost:6123]. If this happens often you may consider using akka.remote.use-passive-connections=off or use Artery TCP.
      2021-12-16T16:53:21.8403087Z Dec 16 16:53:15 2021-12-16 16:39:37,036 WARN  akka.remote.EndpointReader                                   [] - Discarding inbound message to [Actor[akka://flink/temp/_user_rpc_resourcemanager_*$b]] in read-only association to [akka.ssl.tcp://flink@localhost:6123]. If this happens often you may consider using akka.remote.use-passive-connections=off or use Artery TCP.
      2021-12-16T16:53:21.8404956Z Dec 16 16:53:15 2021-12-16 16:39:38,886 WARN  akka.remote.EndpointReader                                   [] - Discarding inbound message to [Actor[akka://flink/user/rpc/taskmanager_0#-1901973634]] in read-only association to [akka.ssl.tcp://flink@localhost:6123]. If this happens often you may consider using akka.remote.use-passive-connections=off or use Artery TCP.
      2021-12-16T16:53:21.8406801Z Dec 16 16:53:15 2021-12-16 16:39:40,374 WARN  akka.remote.EndpointReader                                   [] - Discarding inbound message to [Actor[akka://flink/user/rpc/taskmanager_0#-1901973634]] in read-only association to [akka.ssl.tcp://flink@localhost:6123]. If this happens often you may consider using akka.remote.use-passive-connections=off or use Artery TCP.
      2021-12-16T16:53:21.8408655Z Dec 16 16:53:15 2021-12-16 16:39:40,410 WARN  akka.remote.EndpointReader                                   [] - Discarding inbound message to [Actor[akka://flink/user/rpc/taskmanager_0#-1901973634]] in read-only association to [akka.ssl.tcp://flink@localhost:6123]. If this happens often you may consider using akka.remote.use-passive-connections=off or use Artery TCP.
      2021-12-16T16:53:21.8410517Z Dec 16 16:53:15 2021-12-16 16:39:47,053 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Could not resolve ResourceManager address akka.ssl.tcp://flink@localhost:***@localhost:6123/user/rpc/resourcemanager_*.
      2021-12-16T16:53:21.8412137Z Dec 16 16:53:15 2021-12-16 16:39:48,915 WARN  akka.remote.EndpointReader                                   [] - Discarding inbound message to [Actor[akka://flink/user/rpc/taskmanager_0#-1901973634]] in read-only association to [akka.ssl.tcp://flink@localhost:6123]. If this happens often you may consider using akka.remote.use-passive-connections=off or use Artery TCP.
      2021-12-16T16:53:21.8414008Z Dec 16 16:53:15 2021-12-16 16:39:50,332 WARN  akka.remote.EndpointReader                                   [] - Discarding inbound message to [Actor[akka://flink/user/rpc/taskmanager_0#-1901973634]] in read-only association to [akka.ssl.tcp://flink@localhost:6123]. If this happens often you may consider using akka.remote.use-passive-connections=off or use Artery TCP.
      2021-12-16T16:53:21.8415859Z Dec 16 16:53:15 2021-12-16 16:39:57,076 WARN  akka.remote.EndpointReader                                   [] - Discarding inbound message to [Actor[akka://flink/temp/_user_rpc_resourcemanager_*$c]] in read-only association to [akka.ssl.tcp://flink@localhost:6123]. If this happens often you may consider using akka.remote.use-passive-connections=off or use Artery TCP.
      2021-12-16T16:53:21.8417798Z Dec 16 16:53:15 2021-12-16 16:39:58,852 WARN  akka.remote.EndpointReader                                   [] - Discarding inbound message to [Actor[akka://flink/user/rpc/taskmanager_0#-1901973634]] in read-only association to [akka.ssl.tcp://flink@localhost:6123]. If this happens often you may consider using akka.remote.use-passive-connections=off or use Artery TCP.
      2021-12-16T16:53:21.8419746Z Dec 16 16:53:15 2021-12-16 16:39:58,852 WARN  akka.remote.EndpointReader                                   [] - Discarding inbound message to [Actor[akka://flink/user/rpc/taskmanager_0#-1901973634]] in read-only association to [akka.ssl.tcp://flink@localhost:6123]. If this happens often you may consider using akka.remote.use-passive-connections=off or use Artery TCP.
      2021-12-16T16:53:21.8421605Z Dec 16 16:53:15 2021-12-16 16:40:07,092 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Could not resolve ResourceManager address akka.ssl.tcp://flink@localhost:***@localhost:6123/user/rpc/resourcemanager_*.
      2021-12-16T16:53:21.8423227Z Dec 16 16:53:15 2021-12-16 16:40:17,117 WARN  akka.remote.EndpointReader                                   [] - Discarding inbound message to [Actor[akka://flink/temp/_user_rpc_resourcemanager_*$d]] in read-only association to [akka.ssl.tcp://flink@localhost:6123]. If this happens often you may consider using akka.remote.use-passive-connections=off or use Artery TCP.
      2021-12-16T16:53:21.8425078Z Dec 16 16:53:15 2021-12-16 16:40:27,132 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Could not resolve ResourceManager address akka.ssl.tcp://flink@localhost:***@localhost:6123/user/rpc/resourcemanager_*.
      2021-12-16T16:53:21.8426694Z Dec 16 16:53:15 2021-12-16 16:40:37,159 WARN  akka.remote.EndpointReader                                   [] - Discarding inbound message to [Actor[akka://flink/temp/_user_rpc_resourcemanager_*$e]] in read-only association to [akka.ssl.tcp://flink@localhost:6123]. If this happens often you may consider using akka.remote.use-passive-connections=off or use Artery TCP.
      2021-12-16T16:53:21.8428571Z Dec 16 16:53:15 2021-12-16 16:40:47,172 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Could not resolve ResourceManager address akka.ssl.tcp://flink@localhost:***@localhost:6123/user/rpc/resourcemanager_*.
      2021-12-16T16:53:21.8430200Z Dec 16 16:53:15 2021-12-16 16:40:57,196 WARN  akka.remote.EndpointReader                                   [] - Discarding inbound message to [Actor[akka://flink/temp/_user_rpc_resourcemanager_*$f]] in read-only association to [akka.ssl.tcp://flink@localhost:6123]. If this happens often you may consider using akka.remote.use-passive-connections=off or use Artery TCP.
      2021-12-16T16:53:21.8432064Z Dec 16 16:53:15 2021-12-16 16:41:07,213 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Could not resolve ResourceManager address akka.ssl.tcp://flink@localhost:***@localhost:6123/user/rpc/resourcemanager_*.
      2021-12-16T16:53:21.8433680Z Dec 16 16:53:15 2021-12-16 16:41:17,236 WARN  akka.remote.EndpointReader                                   [] - Discarding inbound message to [Actor[akka://flink/temp/_user_rpc_resourcemanager_*$g]] in read-only association to [akka.ssl.tcp://flink@localhost:6123]. If this happens often you may consider using akka.remote.use-passive-connections=off or use Artery TCP.
      2021-12-16T16:53:21.8435541Z Dec 16 16:53:15 2021-12-16 16:41:27,252 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Could not resolve ResourceManager address akka.ssl.tcp://flink@localhost:***@localhost:6123/user/rpc/resourcemanager_*.
      2021-12-16T16:53:21.8437170Z Dec 16 16:53:15 2021-12-16 16:41:37,276 WARN  akka.remote.EndpointReader                                   [] - Discarding inbound message to [Actor[akka://flink/temp/_user_rpc_resourcemanager_*$h]] in read-only association to [akka.ssl.tcp://flink@localhost:6123]. If this happens often you may consider using akka.remote.use-passive-connections=off or use Artery TCP.
      2021-12-16T16:53:21.8439086Z Dec 16 16:53:15 2021-12-16 16:41:47,292 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Could not resolve ResourceManager address akka.ssl.tcp://flink@localhost:***@localhost:6123/user/rpc/resourcemanager_*.
      2021-12-16T16:53:21.8440869Z Dec 16 16:53:15 2021-12-16 16:41:57,316 WARN  akka.remote.EndpointReader                                   [] - Discarding inbound message to [Actor[akka://flink/temp/_user_rpc_resourcemanager_*$i]] in read-only association to [akka.ssl.tcp://flink@localhost:6123]. If this happens often you may consider using akka.remote.use-passive-connections=off or use Artery TCP.
      2021-12-16T16:53:21.8442707Z Dec 16 16:53:15 2021-12-16 16:42:07,332 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Could not resolve ResourceManager address akka.ssl.tcp://flink@localhost:***@localhost:6123/user/rpc/resourcemanager_*.
      2021-12-16T16:53:21.8444344Z Dec 16 16:53:15 2021-12-16 16:42:17,356 WARN  akka.remote.EndpointReader                                   [] - Discarding inbound message to [Actor[akka://flink/temp/_user_rpc_resourcemanager_*$j]] in read-only association to [akka.ssl.tcp://flink@localhost:6123]. If this happens often you may consider using akka.remote.use-passive-connections=off or use Artery TCP.
      2021-12-16T16:53:21.8446187Z Dec 16 16:53:15 2021-12-16 16:42:27,373 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Could not resolve ResourceManager address akka.ssl.tcp://flink@localhost:***@localhost:6123/user/rpc/resourcemanager_*.
      2021-12-16T16:53:21.8447801Z Dec 16 16:53:15 2021-12-16 16:42:37,397 WARN  akka.remote.EndpointReader                                   [] - Discarding inbound message to [Actor[akka://flink/temp/_user_rpc_resourcemanager_*$k]] in read-only association to [akka.ssl.tcp://flink@localhost:6123]. If this happens often you may consider using akka.remote.use-passive-connections=off or use Artery TCP.
      2021-12-16T16:53:21.8449655Z Dec 16 16:53:15 2021-12-16 16:42:47,412 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Could not resolve ResourceManager address akka.ssl.tcp://flink@localhost:***@localhost:6123/user/rpc/resourcemanager_*.
      2021-12-16T16:53:21.8451276Z Dec 16 16:53:15 2021-12-16 16:42:57,435 WARN  akka.remote.EndpointReader                                   [] - Discarding inbound message to [Actor[akka://flink/temp/_user_rpc_resourcemanager_*$l]] in read-only association to [akka.ssl.tcp://flink@localhost:6123]. If this happens often you may consider using akka.remote.use-passive-connections=off or use Artery TCP.
      2021-12-16T16:53:21.8453121Z Dec 16 16:53:15 2021-12-16 16:43:07,453 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Could not resolve ResourceManager address akka.ssl.tcp://flink@localhost:***@localhost:6123/user/rpc/resourcemanager_*.
      2021-12-16T16:53:21.8454750Z Dec 16 16:53:15 2021-12-16 16:43:17,477 WARN  akka.remote.EndpointReader                                   [] - Discarding inbound message to [Actor[akka://flink/temp/_user_rpc_resourcemanager_*$m]] in read-only association to [akka.ssl.tcp://flink@localhost:6123]. If this happens often you may consider using akka.remote.use-passive-connections=off or use Artery TCP.
      2021-12-16T16:53:21.8456601Z Dec 16 16:53:15 2021-12-16 16:43:27,492 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Could not resolve ResourceManager address akka.ssl.tcp://flink@localhost:***@localhost:6123/user/rpc/resourcemanager_*.
      2021-12-16T16:53:21.8458228Z Dec 16 16:53:15 2021-12-16 16:43:37,516 WARN  akka.remote.EndpointReader                                   [] - Discarding inbound message to [Actor[akka://flink/temp/_user_rpc_resourcemanager_*$n]] in read-only association to [akka.ssl.tcp://flink@localhost:6123]. If this happens often you may consider using akka.remote.use-passive-connections=off or use Artery TCP.
      2021-12-16T16:53:21.8460053Z Dec 16 16:53:15 2021-12-16 16:43:47,532 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Could not resolve ResourceManager address akka.ssl.tcp://flink@localhost:***@localhost:6123/user/rpc/resourcemanager_*.
      2021-12-16T16:53:21.8461790Z Dec 16 16:53:15 2021-12-16 16:43:57,560 WARN  akka.remote.EndpointReader                                   [] - Discarding inbound message to [Actor[akka://flink/temp/_user_rpc_resourcemanager_*$o]] in read-only association to [akka.ssl.tcp://flink@localhost:6123]. If this happens often you may consider using akka.remote.use-passive-connections=off or use Artery TCP.
      2021-12-16T16:53:21.8463707Z Dec 16 16:53:15 2021-12-16 16:44:07,572 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Could not resolve ResourceManager address akka.ssl.tcp://flink@localhost:***@localhost:6123/user/rpc/resourcemanager_*.
      2021-12-16T16:53:21.8464944Z Dec 16 16:53:15 2021-12-16 16:44:16,982 ERROR org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Fatal error occurred in TaskExecutor akka.ssl.tcp://flink@127.0.0.1:45031/user/rpc/taskmanager_0.
      2021-12-16T16:53:21.8465907Z Dec 16 16:53:15 org.apache.flink.runtime.taskexecutor.exceptions.RegistrationTimeoutException: Could not register at the ResourceManager within the specified maximum registration duration 300000 ms. This indicates a problem with this instance. Terminating now.
      2021-12-16T16:53:21.8467009Z Dec 16 16:53:15 	at org.apache.flink.runtime.taskexecutor.TaskExecutor.registrationTimeout(TaskExecutor.java:1449) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8468041Z Dec 16 16:53:15 	at org.apache.flink.runtime.taskexecutor.TaskExecutor.lambda$startRegistrationTimeout$17(TaskExecutor.java:1434) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8469115Z Dec 16 16:53:15 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRunAsync$4(AkkaRpcActor.java:455) ~[flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8470250Z Dec 16 16:53:15 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68) ~[flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8471370Z Dec 16 16:53:15 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:455) ~[flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8472437Z Dec 16 16:53:15 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:213) ~[flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8473490Z Dec 16 16:53:15 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163) ~[flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8474476Z Dec 16 16:53:15 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8475413Z Dec 16 16:53:15 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8476361Z Dec 16 16:53:15 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8477303Z Dec 16 16:53:15 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8478238Z Dec 16 16:53:15 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8479194Z Dec 16 16:53:15 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8480251Z Dec 16 16:53:15 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8481311Z Dec 16 16:53:15 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8482228Z Dec 16 16:53:15 	at akka.actor.Actor.aroundReceive(Actor.scala:537) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8483202Z Dec 16 16:53:15 	at akka.actor.Actor.aroundReceive$(Actor.scala:535) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8484135Z Dec 16 16:53:15 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8485071Z Dec 16 16:53:15 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8485987Z Dec 16 16:53:15 	at akka.actor.ActorCell.invoke(ActorCell.scala:548) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8486901Z Dec 16 16:53:15 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8487788Z Dec 16 16:53:15 	at akka.dispatch.Mailbox.run(Mailbox.scala:231) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8488678Z Dec 16 16:53:15 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8489281Z Dec 16 16:53:15 	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) [?:1.8.0_292]
      2021-12-16T16:53:21.8489838Z Dec 16 16:53:15 	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) [?:1.8.0_292]
      2021-12-16T16:53:21.8490390Z Dec 16 16:53:15 	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692) [?:1.8.0_292]
      2021-12-16T16:53:21.8490953Z Dec 16 16:53:15 	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) [?:1.8.0_292]
      2021-12-16T16:53:21.8491834Z Dec 16 16:53:15 2021-12-16 16:44:16,990 ERROR org.apache.flink.runtime.taskexecutor.TaskManagerRunner      [] - Fatal error occurred while executing the TaskManager. Shutting it down...
      2021-12-16T16:53:21.8492700Z Dec 16 16:53:15 org.apache.flink.runtime.taskexecutor.exceptions.RegistrationTimeoutException: Could not register at the ResourceManager within the specified maximum registration duration 300000 ms. This indicates a problem with this instance. Terminating now.
      2021-12-16T16:53:21.8493804Z Dec 16 16:53:15 	at org.apache.flink.runtime.taskexecutor.TaskExecutor.registrationTimeout(TaskExecutor.java:1449) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8494833Z Dec 16 16:53:15 	at org.apache.flink.runtime.taskexecutor.TaskExecutor.lambda$startRegistrationTimeout$17(TaskExecutor.java:1434) ~[flink-dist_2.11-1.14-SNAPSHOT.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8495918Z Dec 16 16:53:15 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRunAsync$4(AkkaRpcActor.java:455) ~[flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8497053Z Dec 16 16:53:15 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68) ~[flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8498159Z Dec 16 16:53:15 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:455) ~[flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8499214Z Dec 16 16:53:15 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:213) ~[flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8500274Z Dec 16 16:53:15 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163) ~[flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8501324Z Dec 16 16:53:15 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8502266Z Dec 16 16:53:15 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8503274Z Dec 16 16:53:15 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8504221Z Dec 16 16:53:15 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8505172Z Dec 16 16:53:15 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8506130Z Dec 16 16:53:15 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8507087Z Dec 16 16:53:15 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8508046Z Dec 16 16:53:15 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8508962Z Dec 16 16:53:15 	at akka.actor.Actor.aroundReceive(Actor.scala:537) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8509845Z Dec 16 16:53:15 	at akka.actor.Actor.aroundReceive$(Actor.scala:535) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8510773Z Dec 16 16:53:15 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8511714Z Dec 16 16:53:15 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8512603Z Dec 16 16:53:15 	at akka.actor.ActorCell.invoke(ActorCell.scala:548) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8513506Z Dec 16 16:53:15 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8514384Z Dec 16 16:53:15 	at akka.dispatch.Mailbox.run(Mailbox.scala:231) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8515251Z Dec 16 16:53:15 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243) [flink-rpc-akka_f1863f61-8169-473c-af70-7060e3927564.jar:1.14-SNAPSHOT]
      2021-12-16T16:53:21.8515849Z Dec 16 16:53:15 	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) [?:1.8.0_292]
      2021-12-16T16:53:21.8516394Z Dec 16 16:53:15 	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) [?:1.8.0_292]
      2021-12-16T16:53:21.8516947Z Dec 16 16:53:15 	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692) [?:1.8.0_292]
      2021-12-16T16:53:21.8517500Z Dec 16 16:53:15 	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) [?:1.8.0_292]
      2021-12-16T16:53:21.8518480Z Dec 16 16:53:15 2021-12-16 16:44:16,995 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Stopping TaskExecutor akka.ssl.tcp://flink@127.0.0.1:45031/user/rpc/taskmanager_0.
      2021-12-16T16:53:21.8519780Z Dec 16 16:53:15 2021-12-16 16:44:16,995 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Terminating registration attempts towards ResourceManager akka.ssl.tcp://flink@localhost:6123/user/rpc/resourcemanager_*.
      2021-12-16T16:53:21.8520880Z Dec 16 16:53:15 2021-12-16 16:44:16,995 INFO  org.apache.flink.runtime.state.TaskExecutorStateChangelogStoragesManager [] - Shutting down TaskExecutorStateChangelogStoragesManager.
      2021-12-16T16:53:21.8521815Z Dec 16 16:53:15 2021-12-16 16:44:16,999 INFO  org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Stop job leader service.
      2021-12-16T16:53:21.8522669Z Dec 16 16:53:15 2021-12-16 16:44:17,000 INFO  org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager [] - Shutting down TaskExecutorLocalStateStoresManager.
      2021-12-16T16:53:21.8523748Z Dec 16 16:53:15 2021-12-16 16:44:17,006 INFO  org.apache.flink.runtime.io.disk.FileChannelManagerImpl      [] - FileChannelManager removed spill file directory /tmp/flink-io-356d794f-7c1e-42c7-bb5d-58d5d096f90a
      2021-12-16T16:53:21.8524702Z Dec 16 16:53:15 2021-12-16 16:44:17,007 INFO  org.apache.flink.runtime.io.network.NettyShuffleEnvironment  [] - Shutting down the network environment and its components.
      2021-12-16T16:53:21.8525549Z Dec 16 16:53:15 2021-12-16 16:44:17,007 INFO  org.apache.flink.runtime.io.network.netty.NettyClient        [] - Successful shutdown (took 0 ms).
      2021-12-16T16:53:21.8526370Z Dec 16 16:53:15 2021-12-16 16:44:17,008 INFO  org.apache.flink.runtime.io.network.netty.NettyServer        [] - Successful shutdown (took 0 ms).
      2021-12-16T16:53:21.8527350Z Dec 16 16:53:15 2021-12-16 16:44:17,011 INFO  org.apache.flink.runtime.io.disk.FileChannelManagerImpl      [] - FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-a85e32fc-e7a0-4ceb-8beb-b931a418f85b
      2021-12-16T16:53:21.8528320Z Dec 16 16:53:15 2021-12-16 16:44:17,011 INFO  org.apache.flink.runtime.taskexecutor.KvStateService         [] - Shutting down the kvState service and its components.
      2021-12-16T16:53:21.8529149Z Dec 16 16:53:15 2021-12-16 16:44:17,011 INFO  org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService [] - Stop job leader service.
      2021-12-16T16:53:21.8530093Z Dec 16 16:53:15 2021-12-16 16:44:17,011 INFO  org.apache.flink.runtime.filecache.FileCache                 [] - removed file cache directory /tmp/flink-dist-cache-3a780c9f-c395-4355-b496-ade62a0757ad
      2021-12-16T16:53:21.8531165Z Dec 16 16:53:15 2021-12-16 16:44:17,017 INFO  org.apache.flink.runtime.taskexecutor.TaskExecutor           [] - Stopped TaskExecutor akka.ssl.tcp://flink@127.0.0.1:45031/user/rpc/taskmanager_0.
      2021-12-16T16:53:21.8532096Z Dec 16 16:53:15 2021-12-16 16:44:17,025 INFO  org.apache.flink.runtime.blob.PermanentBlobCache             [] - Shutting down BLOB cache
      2021-12-16T16:53:21.8532875Z Dec 16 16:53:15 2021-12-16 16:44:17,025 INFO  org.apache.flink.runtime.blob.TransientBlobCache             [] - Shutting down BLOB cache
      2021-12-16T16:53:21.8533663Z Dec 16 16:53:15 2021-12-16 16:44:17,031 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcService             [] - Stopping Akka RPC service.
      2021-12-16T16:53:21.8534457Z Dec 16 16:53:15 2021-12-16 16:44:17,036 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcService             [] - Stopping Akka RPC service.
      2021-12-16T16:53:21.8535254Z Dec 16 16:53:15 2021-12-16 16:44:17,094 INFO  akka.remote.RemoteActorRefProvider$RemotingTerminator        [] - Shutting down remote daemon.
      2021-12-16T16:53:21.8536051Z Dec 16 16:53:15 2021-12-16 16:44:17,094 INFO  akka.remote.RemoteActorRefProvider$RemotingTerminator        [] - Shutting down remote daemon.
      2021-12-16T16:53:21.8536925Z Dec 16 16:53:15 2021-12-16 16:44:17,095 INFO  akka.remote.RemoteActorRefProvider$RemotingTerminator        [] - Remote daemon shut down; proceeding with flushing remote transports.
      2021-12-16T16:53:21.8537860Z Dec 16 16:53:15 2021-12-16 16:44:17,101 INFO  akka.remote.RemoteActorRefProvider$RemotingTerminator        [] - Remote daemon shut down; proceeding with flushing remote transports.
      2021-12-16T16:53:21.8538683Z Dec 16 16:53:15 2021-12-16 16:44:17,142 INFO  akka.remote.RemoteActorRefProvider$RemotingTerminator        [] - Remoting shut down.
      2021-12-16T16:53:21.8539446Z Dec 16 16:53:15 2021-12-16 16:44:17,146 INFO  akka.remote.RemoteActorRefProvider$RemotingTerminator        [] - Remoting shut down.
      2021-12-16T16:53:21.8540224Z Dec 16 16:53:15 2021-12-16 16:44:17,163 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcService             [] - Stopped Akka RPC service.
      2021-12-16T16:53:21.8541162Z Dec 16 16:53:15 2021-12-16 16:44:17,163 INFO  org.apache.flink.runtime.taskexecutor.TaskManagerRunner      [] - Terminating TaskManagerRunner with exit code 1.
      2021-12-16T16:53:21.8541976Z Dec 16 16:53:15 2021-12-16 16:44:17,163 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcService             [] - Stopped Akka RPC service.
      2021-12-16T16:53:21.8542956Z Dec 16 16:53:15 2021-12-16 16:39:12,434 INFO  org.apache.flink.runtime.taskexecutor.TaskManagerRunner      [] - --------------------------------------------------------------------------------
      

      https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=28272&view=logs&j=c88eea3b-64a0-564d-0031-9fdcd7b8abee&t=070ff179-953e-5bda-71fa-d6599415701c&l=70781

      Attachments

        Activity

          People

            Unassigned Unassigned
            gaoyunhaii Yun Gao
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: