Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-6207

Move application across queues should handle delayed event processing

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      Steps to reproduce
      1.Submit application and delay attempt add to Scheduler
      (Simulate using debug at EventDispatcher for SchedulerEventDispatcher)
      2. Call move application to destination queue.

      Caused by: org.apache.hadoop.ipc.RemoteException(java.lang.NullPointerException): java.lang.NullPointerException
      	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.preValidateMoveApplication(CapacityScheduler.java:2086)
      	at org.apache.hadoop.yarn.server.resourcemanager.RMAppManager.moveApplicationAcrossQueue(RMAppManager.java:669)
      	at org.apache.hadoop.yarn.server.resourcemanager.ClientRMService.moveApplicationAcrossQueues(ClientRMService.java:1231)
      	at org.apache.hadoop.yarn.api.impl.pb.service.ApplicationClientProtocolPBServiceImpl.moveApplicationAcrossQueues(ApplicationClientProtocolPBServiceImpl.java:388)
      	at org.apache.hadoop.yarn.proto.ApplicationClientProtocol$ApplicationClientProtocolService$2.callBlockingMethod(ApplicationClientProtocol.java:537)
      	at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:522)
      	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991)
      	at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:867)
      	at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:813)
      	at java.security.AccessController.doPrivileged(Native Method)
      	at javax.security.auth.Subject.doAs(Subject.java:422)
      	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1892)
      	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2659)
      
      	at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1483)
      	at org.apache.hadoop.ipc.Client.call(Client.java:1429)
      	at org.apache.hadoop.ipc.Client.call(Client.java:1339)
      	at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:227)
      	at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:115)
      	at com.sun.proxy.$Proxy7.moveApplicationAcrossQueues(Unknown Source)
      	at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.moveApplicationAcrossQueues(ApplicationClientProtocolPBClientImpl.java:398)
      	... 16 more
      
      

      Attachments

        1. YARN-6207.008.patch
          18 kB
          Bibin Chundatt
        2. YARN-6207.007.patch
          18 kB
          Bibin Chundatt
        3. YARN-6207.006.patch
          18 kB
          Bibin Chundatt
        4. YARN-6207.005.patch
          19 kB
          Bibin Chundatt
        5. YARN-6207.004.patch
          12 kB
          Bibin Chundatt
        6. YARN-6207.003.patch
          10 kB
          Bibin Chundatt
        7. YARN-6207.002.patch
          5 kB
          Bibin Chundatt
        8. YARN-6207.001.patch
          7 kB
          Bibin Chundatt

        Activity

          People

            bibinchundatt Bibin Chundatt
            bibinchundatt Bibin Chundatt
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: