Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3530

Sometimes NODE_UPDATE to the scheduler throws an NPE causing the scheduling to stop

    Details

    • Hadoop Flags:
      Reviewed
    • Release Note:
      Fixed an NPE occuring during scheduling in the ResourceManager.
    • Target Version/s:

      Description

      Sometimes NODE_UPDATE to the scheduler throws NPE causes scheduling to stop but ResourceManager keeps on running.
      I have been observing intermitently for last 3 weeks.
      But with latest svn code. I tried to run sort twice and both times Job got stuck due to NPE.

      java.lang.NullPointerException
              at org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerApp.containerLaunchedOnNode(SchedulerApp.java:181)
              at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.containerLaunchedOnNode(CapacityScheduler.java:596)
              at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.nodeUpdate(CapacityScheduler.java:539)
              at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.handle(CapacityScheduler.java:617)
              at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.handle(CapacityScheduler.java:77)
              at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher$EventProcessor.run(ResourceManager.java:294)
              at java.lang.Thread.run(Thread.java:619)
      
      1. MAPREDUCE-3530.patch
        2 kB
        Arun C Murthy
      2. MAPREDUCE-3530.patch
        12 kB
        Arun C Murthy
      3. MAPREDUCE-3530-20111214.txt
        9 kB
        Vinod Kumar Vavilapalli

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Arun C Murthy
            Reporter:
            Karam Singh
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development