Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7427

NullPointerException in ResourceInfo when queue has not used label

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Caused by: java.lang.NullPointerException
              at org.apache.hadoop.yarn.server.resourcemanager.webapp.dao.ResourceInfo.toString(ResourceInfo.java:65)
              at org.apache.hadoop.yarn.server.resourcemanager.webapp.CapacitySchedulerPage$LeafQueueInfoBlock.renderQueueCapacityInfo(CapacitySchedulerPage.java:164)
              at org.apache.hadoop.yarn.server.resourcemanager.webapp.CapacitySchedulerPage$LeafQueueInfoBlock.renderLeafQueueInfoWithPartition(CapacitySchedulerPage.java:107)
              at org.apache.hadoop.yarn.server.resourcemanager.webapp.CapacitySchedulerPage$LeafQueueInfoBlock.render(CapacitySchedulerPage.java:96)
              at org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:69)
              at org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:79)
              at org.apache.hadoop.yarn.webapp.View.render(View.java:235)
              at org.apache.hadoop.yarn.webapp.view.HtmlBlock$Block.subView(HtmlBlock.java:43)
              at org.apache.hadoop.yarn.webapp.hamlet2.HamletImpl$EImp._v(HamletImpl.java:117)
              at org.apache.hadoop.yarn.webapp.hamlet2.Hamlet$LI.__(Hamlet.java:7709)
              at org.apache.hadoop.yarn.server.resourcemanager.webapp.CapacitySchedulerPage$QueueBlock.render(CapacitySchedulerPage.java:301)
              at org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:69)
              at org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:79)
              at org.apache.hadoop.yarn.webapp.View.render(View.java:235)
              at org.apache.hadoop.yarn.webapp.view.HtmlBlock$Block.subView(HtmlBlock.java:43)
              at org.apache.hadoop.yarn.webapp.hamlet2.HamletImpl$EImp._v(HamletImpl.java:117)
              at org.apache.hadoop.yarn.webapp.hamlet2.Hamlet$LI.__(Hamlet.java:7709)
              at org.apache.hadoop.yarn.server.resourcemanager.webapp.CapacitySchedulerPage$QueuesBlock.render(CapacitySchedulerPage.java:470)
              at org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:69)
              at org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:79)
              at org.apache.hadoop.yarn.webapp.View.render(View.java:235)
              at org.apache.hadoop.yarn.webapp.view.HtmlPage$Page.subView(HtmlPage.java:49)
              at org.apache.hadoop.yarn.webapp.hamlet2.HamletImpl$EImp._v(HamletImpl.java:117)
              at org.apache.hadoop.yarn.webapp.hamlet2.Hamlet$TD.__(Hamlet.java:848)
              at org.apache.hadoop.yarn.webapp.view.TwoColumnLayout.render(TwoColumnLayout.java:71)
              at org.apache.hadoop.yarn.webapp.view.HtmlPage.render(HtmlPage.java:82)
              at org.apache.hadoop.yarn.webapp.Controller.render(Controller.java:212)
              at org.apache.hadoop.yarn.server.resourcemanager.webapp.RmController.scheduler(RmController.java:86)
              ... 56 more

      For example, configure:

        <property>
          <name>yarn.scheduler.capacity.root.queues</name>
          <value>default,a</value>
        </property>
        <property>
          <name>yarn.scheduler.capacity.root.accessible-node-labels</name>
          <value>x</value>
        </property>
        <property>
          <name>yarn.scheduler.capacity.root.default.accessible-node-labels</name>
          <value>x</value>
        </property>
        <property>
          <name>yarn.scheduler.capacity.root.default.accessible-node-labels.x.maximum-capacity</name>
          <value>100</value>
        </property>
        <property>
          <name>yarn.scheduler.capacity.root.default.accessible-node-labels.x.capacity</name>
          <value>100</value>
        </property>

      , then the above exception is thrown when refreshing the scheduler UI (/cluster/scheduler)

      As a result the queue block dropdowns cannot be minimized.

        Attachments

        1. YARN-7427.001.patch
          0.9 kB
          Jonathan Hung
        2. YARN-7427.002.patch
          2 kB
          Jonathan Hung

          Issue Links

            Activity

              People

              • Assignee:
                jhung Jonathan Hung
                Reporter:
                jhung Jonathan Hung
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: