Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1986

In Fifo Scheduler, node heartbeat in between creating app and attempt causes NPE

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 2.4.0
    • 2.4.1
    • None
    • None
    • Reviewed

    Description

      After upgrade from 2.2.0 to 2.4.0, NPE on first job start.

      After RM was restarted, the job runs without a problem.

      19:11:13,441 FATAL ResourceManager:600 - Error in handling event type NODE_UPDATE to the scheduler
      java.lang.NullPointerException
      	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fifo.FifoScheduler.assignContainers(FifoScheduler.java:462)
      	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fifo.FifoScheduler.nodeUpdate(FifoScheduler.java:714)
      	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fifo.FifoScheduler.handle(FifoScheduler.java:743)
      	at org.apache.hadoop.yarn.server.resourcemanager.scheduler.fifo.FifoScheduler.handle(FifoScheduler.java:104)
      	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher$EventProcessor.run(ResourceManager.java:591)
      	at java.lang.Thread.run(Thread.java:744)
      19:11:13,443  INFO ResourceManager:604 - Exiting, bbye..
      

      Attachments

        1. YARN-1986.patch
          2 kB
          Hong Zhiguo
        2. YARN-1986-2.patch
          5 kB
          Hong Zhiguo
        3. YARN-1986-3.patch
          5 kB
          Hong Zhiguo
        4. YARN-1986-testcase.patch
          5 kB
          Hong Zhiguo

        Issue Links

          Activity

            People

              zhiguohong Hong Zhiguo
              jonbringhurst Jon Bringhurst
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: