Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1243

ResourceManager: Error in handling event type NODE_UPDATE to the scheduler - NPE at SchedulerApp.java:411

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.23.8
    • 0.23.10
    • capacityscheduler
    • None
    • RHEL - 6.4, Hadoop 0.23.8

    Description

      2013-09-26 03:25:02,262 [ResourceManager Event Processor] FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error in handling event type NODE_UPDATE to the scheduler
      java.lang.NullPointerException
      at org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerApp.unreserve(SchedulerApp.java:411)
      at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.unreserve(LeafQueue.java:1333)
      at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.assignContainer(LeafQueue.java:1261)
      at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.assignOffSwitchContainers(LeafQueue.java:1137)
      at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.assignContainersOnNode(LeafQueue.java:1092)
      at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.assignReservedContainer(LeafQueue.java:887)
      at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue.assignContainers(LeafQueue.java:788)
      at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.nodeUpdate(CapacityScheduler.java:594)
      at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.handle(CapacityScheduler.java:656)
      at org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.handle(CapacityScheduler.java:80)
      at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher$EventProcessor.run(ResourceManager.java:340)
      at java.lang.Thread.run(Thread.java:722)

      Yarn Resource manager exits at this NPE

      Attachments

        1. YARN-1243.branch-0.23.patch
          3 kB
          Jason Darrell Lowe

        Issue Links

          Activity

            Looks like the fix from YARN-845 needs to be backported to 0.23.

            jlowe Jason Darrell Lowe added a comment - Looks like the fix from YARN-845 needs to be backported to 0.23.

            Patch that backports YARN-845 fix to branch-0.23.

            jlowe Jason Darrell Lowe added a comment - Patch that backports YARN-845 fix to branch-0.23.
            hadoopqa Hadoop QA added a comment -

            -1 overall. Here are the results of testing the latest attachment
            http://issues.apache.org/jira/secure/attachment/12605263/YARN-1243.branch-0.23.patch
            against trunk revision .

            -1 patch. The patch command could not apply the patch.

            Console output: https://builds.apache.org/job/PreCommit-YARN-Build/2023//console

            This message is automatically generated.

            hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12605263/YARN-1243.branch-0.23.patch against trunk revision . -1 patch . The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-YARN-Build/2023//console This message is automatically generated.

            Jenkins only handles trunk patches.

            I manually ran the resourcemanager unit tests after this patch was applied and they all passed.

            jlowe Jason Darrell Lowe added a comment - Jenkins only handles trunk patches. I manually ran the resourcemanager unit tests after this patch was applied and they all passed.

            +1. Verified backport to branch-0.23 and ran tests.

            jeagles Jonathan Turner Eagles added a comment - +1. Verified backport to branch-0.23 and ran tests.
            hudson Hudson added a comment -

            FAILURE: Integrated in Hadoop-Hdfs-0.23-Build #743 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/743/)
            YARN-1243. ResourceManager: Error in handling event type NODE_UPDATE to the scheduler - NPE at SchedulerApp.java:411 (Jason Lowe via jeagles) (jeagles: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1526670)

            • /hadoop/common/branches/branch-0.23/hadoop-yarn-project/CHANGES.txt
            • /hadoop/common/branches/branch-0.23/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/SchedulerApp.java
            • /hadoop/common/branches/branch-0.23/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/LeafQueue.java
            hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-0.23-Build #743 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/743/ ) YARN-1243 . ResourceManager: Error in handling event type NODE_UPDATE to the scheduler - NPE at SchedulerApp.java:411 (Jason Lowe via jeagles) (jeagles: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1526670 ) /hadoop/common/branches/branch-0.23/hadoop-yarn-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/SchedulerApp.java /hadoop/common/branches/branch-0.23/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/LeafQueue.java

            People

              jlowe Jason Darrell Lowe
              saneax Sanjay Upadhyay
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: