Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-21654

YARNSessionCapacitySchedulerITCase.testStartYarnSessionClusterInQaTeamQueue fail because of NullPointerException

    XMLWordPrintableJSON

    Details

      Description

      https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=14265&view=logs&j=fc5181b0-e452-5c8f-68de-1097947f6483&t=62110053-334f-5295-a0ab-80dd7e2babbf

      2021-03-07T23:00:44.6390668Z [ERROR] testStartYarnSessionClusterInQaTeamQueue(org.apache.flink.yarn.YARNSessionCapacitySchedulerITCase)  Time elapsed: 7.338 s  <<< ERROR!
      2021-03-07T23:00:44.6391415Z java.lang.NullPointerException: 
      2021-03-07T23:00:44.6403594Z java.lang.NullPointerException
      2021-03-07T23:00:44.6404575Z 	at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptMetrics.getAggregateAppResourceUsage(RMAppAttemptMetrics.java:128)
      2021-03-07T23:00:44.6405710Z 	at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.getApplicationResourceUsageReport(RMAppAttemptImpl.java:900)
      2021-03-07T23:00:44.6406830Z 	at org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl.createAndGetApplicationReport(RMAppImpl.java:660)
      2021-03-07T23:00:44.6407970Z 	at org.apache.hadoop.yarn.server.resourcemanager.ClientRMService.getApplications(ClientRMService.java:930)
      2021-03-07T23:00:44.6409075Z 	at org.apache.hadoop.yarn.api.impl.pb.service.ApplicationClientProtocolPBServiceImpl.getApplications(ApplicationClientProtocolPBServiceImpl.java:273)
      2021-03-07T23:00:44.6412848Z 	at org.apache.hadoop.yarn.proto.ApplicationClientProtocol$ApplicationClientProtocolService$2.callBlockingMethod(ApplicationClientProtocol.java:507)
      2021-03-07T23:00:44.6417313Z 	at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:447)
      2021-03-07T23:00:44.6421872Z 	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:989)
      2021-03-07T23:00:44.6423676Z 	at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:847)
      2021-03-07T23:00:44.6424387Z 	at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:790)
      2021-03-07T23:00:44.6424997Z 	at java.security.AccessController.doPrivileged(Native Method)
      2021-03-07T23:00:44.6425608Z 	at javax.security.auth.Subject.doAs(Subject.java:422)
      2021-03-07T23:00:44.6426513Z 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1836)
      2021-03-07T23:00:44.6427351Z 	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2486)
      2021-03-07T23:00:44.6427767Z 
      2021-03-07T23:00:44.6428196Z 	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
      2021-03-07T23:00:44.6428975Z 	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
      2021-03-07T23:00:44.6429888Z 	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
      2021-03-07T23:00:44.6442419Z 	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
      2021-03-07T23:00:44.6445364Z 	at org.apache.hadoop.yarn.ipc.RPCUtil.instantiateException(RPCUtil.java:53)
      2021-03-07T23:00:44.6644429Z 	at org.apache.hadoop.yarn.ipc.RPCUtil.instantiateRuntimeException(RPCUtil.java:85)
      2021-03-07T23:00:44.6658468Z 	at org.apache.hadoop.yarn.ipc.RPCUtil.unwrapAndThrowException(RPCUtil.java:122)
      2021-03-07T23:00:44.6669171Z 	at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getApplications(ApplicationClientProtocolPBClientImpl.java:291)
      2021-03-07T23:00:44.6680027Z 	at sun.reflect.GeneratedMethodAccessor39.invoke(Unknown Source)
      2021-03-07T23:00:44.6690713Z 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      2021-03-07T23:00:44.6701085Z 	at java.lang.reflect.Method.invoke(Method.java:498)
      2021-03-07T23:00:44.6708626Z 	at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:409)
      2021-03-07T23:00:44.6709488Z 	at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:163)
      2021-03-07T23:00:44.6710261Z 	at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:155)
      2021-03-07T23:00:44.6711051Z 	at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95)
      2021-03-07T23:00:44.6711864Z 	at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:346)
      2021-03-07T23:00:44.6729939Z 	at com.sun.proxy.$Proxy111.getApplications(Unknown Source)
      2021-03-07T23:00:44.6746044Z 	at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getApplications(YarnClientImpl.java:528)
      2021-03-07T23:00:44.6747093Z 	at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getApplications(YarnClientImpl.java:505)
      2021-03-07T23:00:44.6748256Z 	at org.apache.flink.yarn.YarnTestBase$CleanupYarnApplication.close(YarnTestBase.java:293)
      2021-03-07T23:00:44.6749122Z 	at org.apache.flink.yarn.YarnTestBase.runTest(YarnTestBase.java:274)
      2021-03-07T23:00:44.6750975Z 	at org.apache.flink.yarn.YARNSessionCapacitySchedulerITCase.testStartYarnSessionClusterInQaTeamQueue(YARNSessionCapacitySchedulerITCase.java:164)
      2021-03-07T23:00:44.6751907Z 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      2021-03-07T23:00:44.6753574Z 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      2021-03-07T23:00:44.6754504Z 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      2021-03-07T23:00:44.6755270Z 	at java.lang.reflect.Method.invoke(Method.java:498)
      2021-03-07T23:00:44.6757569Z 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
      2021-03-07T23:00:44.6758434Z 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
      2021-03-07T23:00:44.6759463Z 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
      2021-03-07T23:00:44.6760279Z 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
      2021-03-07T23:00:44.6761082Z 	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
      2021-03-07T23:00:44.6762689Z 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
      2021-03-07T23:00:44.6763589Z 	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
      2021-03-07T23:00:44.6764601Z 	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
      2021-03-07T23:00:44.6765295Z 	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:55)
      2021-03-07T23:00:44.6765968Z 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
      2021-03-07T23:00:44.6766601Z 	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
      2021-03-07T23:00:44.6767442Z 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
      2021-03-07T23:00:44.6768248Z 	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
      2021-03-07T23:00:44.6768968Z 	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
      2021-03-07T23:00:44.6769645Z 	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
      2021-03-07T23:00:44.6770337Z 	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
      2021-03-07T23:00:44.6771022Z 	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
      2021-03-07T23:00:44.6771746Z 	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
      2021-03-07T23:00:44.6772483Z 	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
      2021-03-07T23:00:44.6773298Z 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
      2021-03-07T23:00:44.6774046Z 	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
      2021-03-07T23:00:44.6774773Z 	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
      2021-03-07T23:00:44.6775435Z 	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
      2021-03-07T23:00:44.6776067Z 	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
      2021-03-07T23:00:44.6776794Z 	at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
      2021-03-07T23:00:44.6777694Z 	at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
      2021-03-07T23:00:44.6778543Z 	at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
      2021-03-07T23:00:44.6779362Z 	at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
      2021-03-07T23:00:44.6780201Z 	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
      2021-03-07T23:00:44.6781085Z 	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
      2021-03-07T23:00:44.6781878Z 	at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
      2021-03-07T23:00:44.6782634Z 	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
      2021-03-07T23:00:44.6783545Z Caused by: org.apache.hadoop.ipc.RemoteException(java.lang.NullPointerException): java.lang.NullPointerException
      2021-03-07T23:00:44.6784609Z 	at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptMetrics.getAggregateAppResourceUsage(RMAppAttemptMetrics.java:128)
      2021-03-07T23:00:44.6785745Z 	at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl.getApplicationResourceUsageReport(RMAppAttemptImpl.java:900)
      2021-03-07T23:00:44.6786821Z 	at org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl.createAndGetApplicationReport(RMAppImpl.java:660)
      2021-03-07T23:00:44.6787886Z 	at org.apache.hadoop.yarn.server.resourcemanager.ClientRMService.getApplications(ClientRMService.java:930)
      2021-03-07T23:00:44.6794073Z 	at org.apache.hadoop.yarn.api.impl.pb.service.ApplicationClientProtocolPBServiceImpl.getApplications(ApplicationClientProtocolPBServiceImpl.java:273)
      2021-03-07T23:00:44.6796335Z 	at org.apache.hadoop.yarn.proto.ApplicationClientProtocol$ApplicationClientProtocolService$2.callBlockingMethod(ApplicationClientProtocol.java:507)
      2021-03-07T23:00:44.6798877Z 	at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:447)
      2021-03-07T23:00:44.6801068Z 	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:989)
      2021-03-07T23:00:44.6803385Z 	at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:847)
      2021-03-07T23:00:44.6805566Z 	at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:790)
      2021-03-07T23:00:44.6807902Z 	at java.security.AccessController.doPrivileged(Native Method)
      2021-03-07T23:00:44.6810554Z 	at javax.security.auth.Subject.doAs(Subject.java:422)
      2021-03-07T23:00:44.6813030Z 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1836)
      2021-03-07T23:00:44.6815324Z 	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2486)
      2021-03-07T23:00:44.6817630Z 
      2021-03-07T23:00:44.6819989Z 	at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1489)
      2021-03-07T23:00:44.6820646Z 	at org.apache.hadoop.ipc.Client.call(Client.java:1435)
      2021-03-07T23:00:44.6821270Z 	at org.apache.hadoop.ipc.Client.call(Client.java:1345)
      2021-03-07T23:00:44.6822571Z 	at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:227)
      2021-03-07T23:00:44.6823429Z 	at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:116)
      2021-03-07T23:00:44.6825060Z 	at com.sun.proxy.$Proxy110.getApplications(Unknown Source)
      2021-03-07T23:00:44.6827746Z 	at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getApplications(ApplicationClientProtocolPBClientImpl.java:288)
      2021-03-07T23:00:44.6828489Z 	... 50 more
      2021-03-07T23:00:44.6828728Z 
      2021-03-07T23:01:15.2299964Z [INFO] Running org.apache.flink.yarn.YARNITCase
      2021-03-07T23:01:20.5439420Z Mar 07, 2021 11:01:20 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
      2021-03-07T23:01:20.5442231Z INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class
      2021-03-07T23:01:20.5442949Z Mar 07, 2021 11:01:20 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
      2021-03-07T23:01:20.5443688Z INFO: Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class
      2021-03-07T23:01:20.5444176Z Mar 07, 2021 11:01:20 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
      2021-03-07T23:01:20.5444733Z INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class
      2021-03-07T23:01:20.5471230Z Mar 07, 2021 11:01:20 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
      2021-03-07T23:01:20.5473577Z INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
      2021-03-07T23:01:20.6368864Z Mar 07, 2021 11:01:20 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory getC
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                mapohl Matthias
                Reporter:
                maguowei Guowei Ma
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: