Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9719

Failed to restart yarn-service if it doesn’t exist in RM

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.3.0
    • Component/s: yarn-native-services
    • Labels:
      None

      Description

      Sometimes, restarting a yarn-service is failed as follows.

      {"diagnostics":"Application with id 'application_1562735362534_10461' doesn't exist in RM. Please check that the job submission was successful.\n\tat org.apache.hadoop.yarn.server.resourcemanager.ClientRMService.getApplicationReport(ClientRMService.java:382)\n\tat org.apache.hadoop.yarn.api.impl.pb.service.ApplicationClientProtocolPBServiceImpl.getApplicationReport(ApplicationClientProtocolPBServiceImpl.java:234)\n\tat org.apache.hadoop.yarn.proto.ApplicationClientProtocol$ApplicationClientProtocolService$2.callBlockingMethod(ApplicationClientProtocol.java:561)\n\tat org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523)\n\tat org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991)\n\tat org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872)\n\tat org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818)\n\tat java.security.AccessController.doPrivileged(Native Method)\n\tat javax.security.auth.Subject.doAs(Subject.java:422)\n\tat org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1729)\n\tat org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678)\n"}
      

      It seems like that it occurs when restarting a yarn-service who was stopped long ago.
      by default, RM keeps up to 1000 completed applications (yarn.resourcemanager.max-completed-applications)

        Attachments

        1. YARN-9719.001.patch
          2 kB
          kyungwan nam
        2. YARN-9719.002.patch
          2 kB
          kyungwan nam
        3. YARN-9719.003.patch
          4 kB
          kyungwan nam
        4. YARN-9719.004.patch
          5 kB
          kyungwan nam
        5. YARN-9719.005.patch
          6 kB
          kyungwan nam
        6. YARN-9719.006.patch
          5 kB
          kyungwan nam
        7. YARN-9719.007.patch
          7 kB
          kyungwan nam

          Activity

            People

            • Assignee:
              kyungwan nam kyungwan nam
              Reporter:
              kyungwan nam kyungwan nam
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: