[YARN-4678] Cluster used capacity is > 100 when container reserved

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Sunil G
• Reporter: Brahma Reddy Battula
• Created: 08/Feb/16 05:02
• Updated: 03/Apr/16 16:18

Description

Scenario:

• Start cluster with Three NM's each having 8GB (cluster memory:24GB).
• Configure queues with elasticity and userlimitfactor=10.
• disable pre-emption.
• run two job with different priority in different queue at the same time
  • yarn jar hadoop-mapreduce-examples-2.7.2.jar pi -Dyarn.app.priority=LOW -Dmapreduce.job.queuename=QueueA -Dmapreduce.map.memory.mb=4096 -Dyarn.app.mapreduce.am.resource.mb=1536 -Dmapreduce.job.reduce.slowstart.completedmaps=1.0 10 1000000000000
  • yarn jar hadoop-mapreduce-examples-2.7.2.jar pi -Dyarn.app.priority=HIGH -Dmapreduce.job.queuename=QueueB -Dmapreduce.map.memory.mb=4096 -Dyarn.app.mapreduce.am.resource.mb=1536 3 1000000000000

• observe the cluster capacity which was used in RM web UI