Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7998

RM crashes with NPE during recovering if ACL configuration was changed

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 3.0.0
    • None
    • None

    Description

      RM crashes with NPE during failover because ACL configurations were changed as a result we no longer have a rights to submit an application to a queue.

      Scenario:

      1. Submit an application
      2. Change ACL configuration for a queue that accepted the application so that an owner of the application will no longer have a rights to submit this application.
      3. Restart RM.

      As a result, we get NPE:
      2018-02-27 18:14:00,968 INFO org.apache.hadoop.service.AbstractService: Service ResourceManager failed in state STARTED; cause: java.lang.NullPointerException
      java.lang.NullPointerException
      at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.addApplicationAttempt(FairScheduler.java:738)
      at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.handle(FairScheduler.java:1286)
      at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.handle(FairScheduler.java:116)
      at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$AttemptRecoveredTransition.transition(RMAppAttemptImpl.java:1098)
      at org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl$AttemptRecoveredTransition.transition(RMAppAttemptImpl.java:1044)
      at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385

      Attachments

        1. YARN-7998.003.patch
          7 kB
          Oleksandr Shevchenko
        2. YARN-7998.002.patch
          7 kB
          Oleksandr Shevchenko
        3. YARN-7998.001.patch
          7 kB
          Oleksandr Shevchenko
        4. YARN-7998.000.patch
          3 kB
          Oleksandr Shevchenko

        Issue Links

          Activity

            People

              oshevchenko Oleksandr Shevchenko
              oshevchenko Oleksandr Shevchenko
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: