Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3530

Sometimes NODE_UPDATE to the scheduler throws an NPE causing the scheduling to stop

    Details

    • Target Version/s:
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Fixed an NPE occuring during scheduling in the ResourceManager.

      Description

      Sometimes NODE_UPDATE to the scheduler throws NPE causes scheduling to stop but ResourceManager keeps on running.
      I have been observing intermitently for last 3 weeks.
      But with latest svn code. I tried to run sort twice and both times Job got stuck due to NPE.

      java.lang.NullPointerException
              at org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerApp.containerLaunchedOnNode(SchedulerApp.java:181)
              at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.containerLaunchedOnNode(CapacityScheduler.java:596)
              at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.nodeUpdate(CapacityScheduler.java:539)
              at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.handle(CapacityScheduler.java:617)
              at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.handle(CapacityScheduler.java:77)
              at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher$EventProcessor.run(ResourceManager.java:294)
              at java.lang.Thread.run(Thread.java:619)
      

        Attachments

        1. MAPREDUCE-3530.patch
          12 kB
          Arun C Murthy
        2. MAPREDUCE-3530.patch
          2 kB
          Arun C Murthy
        3. MAPREDUCE-3530-20111214.txt
          9 kB
          Vinod Kumar Vavilapalli

          Activity

            People

            • Assignee:
              acmurthy Arun C Murthy
              Reporter:
              karams Karam Singh
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: