[YARN-9685] NPE when rendering the info table of leaf queue in non-accessible partitions

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.3.0, 3.2.1, 3.1.3
• Component/s: capacityscheduler
• Hadoop Flags: Reviewed
• Assignee: Tao Yang
• Reporter: Tao Yang
• Created: 19/Jul/19 07:41
• Updated: 14/Oct/19 15:37
• Resolved: 08/Aug/19 13:23

Description

I found incomplete queue info shown on scheduler page and NPE in RM log when rendering the info table of leaf queue in non-accessible partitions.

Caused by: java.lang.NullPointerException
        at org.apache.hadoop.yarn.server.resourcemanager.webapp.CapacitySchedulerPage$LeafQueueInfoBlock.renderQueueCapacityInfo(CapacitySchedulerPage.java:163)
        at org.apache.hadoop.yarn.server.resourcemanager.webapp.CapacitySchedulerPage$LeafQueueInfoBlock.renderLeafQueueInfoWithPartition(CapacitySchedulerPage.java:108)
        at org.apache.hadoop.yarn.server.resourcemanager.webapp.CapacitySchedulerPage$LeafQueueInfoBlock.render(CapacitySchedulerPage.java:97)
        at org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:69)
        at org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:79)
        at org.apache.hadoop.yarn.webapp.View.render(View.java:243)

The direct cause is that PartitionQueueCapacitiesInfo of leaf queues in non-accessible partitions are incomplete(part of fields are null such as configuredMinResource/configuredMaxResource/effectiveMinResource/effectiveMaxResource) but some places in CapacitySchedulerPage don't consider that.

Issue Links

• is duplicated by: YARN-7427 NullPointerException in ResourceInfo when queue has not used label
• is duplicated by: YARN-9803 NPE while accessing Scheduler UI