Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9012

NPE in scheduler UI when min-capacity is not configured

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • 3.1.1
    • None
    • None
    • None

    Description

      I encountered the following while reviewing and testing branch YARN-5881.

      The design document from YARN-5881 says that for max-capacity:

       For any queue: If min-resource not set, it is automatically set to 0. (Same as today) 

      When I try leaving blank yarn.scheduler.capacity.<queue-path>.capacity, the RMUI scheduler page refuses to render. It looks like it's in CapacitySchedulerPage$ LeafQueueInfoBlock:

      at java.lang.Thread.run(Thread.java:748)
      Caused by: java.lang.NullPointerException
       at org.apache.hadoop.yarn.server.resourcemanager.webapp.CapacitySchedulerPage$LeafQueueInfoBlock.renderQueueCapacityInfo(CapacitySchedulerPage.java:163)
       at org.apache.hadoop.yarn.server.resourcemanager.webapp.CapacitySchedulerPage$LeafQueueInfoBlock.renderLeafQueueInfoWithPartition(CapacitySchedulerPage.java:108)
       at org.apache.hadoop.yarn.server.resourcemanager.webapp.CapacitySchedulerPage$LeafQueueInfoBlock.render(CapacitySchedulerPage.java:97)
       at org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:69)
       at org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:79)
       at org.apache.hadoop.yarn.webapp.View.render(View.java:243)
       at org.apache.hadoop.yarn.webapp.view.HtmlBlock$Block.subView(HtmlBlock.java:43)
       at org.apache.hadoop.yarn.webapp.hamlet2.HamletImpl$EImp._v(HamletImpl.java:117)
       at org.apache.hadoop.yarn.webapp.hamlet2.Hamlet$LI.__(Hamlet.java:7709)
       at org.apache.hadoop.yarn.server.resourcemanager.webapp.CapacitySchedulerPage$QueueBlock.render(CapacitySchedulerPage.java:342)

      Attachments

        1. YARN-9012.001.patch
          5 kB
          Craig Condit

        Activity

          People

            Unassigned Unassigned
            jutia Juanjuan Tian
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated: