Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3675

FairScheduler: RM quits when node removal races with continousscheduling on the same node

    Details

    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      With continuous scheduling, scheduling can be done on a node thats just removed causing errors like below.

      12:28:53.782 AM FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager
      
      Error in handling event type APP_ATTEMPT_REMOVED to the scheduler
      java.lang.NullPointerException
      	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FSAppAttempt.unreserve(FSAppAttempt.java:469)
      	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.completedContainer(FairScheduler.java:815)
      	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.removeApplicationAttempt(FairScheduler.java:763)
      	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.handle(FairScheduler.java:1217)
      	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler.handle(FairScheduler.java:111)
      	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher$EventProcessor.run(ResourceManager.java:684)
      	at java.lang.Thread.run(Thread.java:745)
      12:28:53.783 AM	 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager Exiting, bbye..
      

        Attachments

        1. YARN-3675.003.patch
          4 kB
          Anubhav Dhoot
        2. YARN-3675.002.patch
          6 kB
          Anubhav Dhoot
        3. YARN-3675.001.patch
          6 kB
          Anubhav Dhoot

          Issue Links

            Activity

              People

              • Assignee:
                adhoot Anubhav Dhoot
                Reporter:
                adhoot Anubhav Dhoot
              • Votes:
                0 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: