-
Type:
Bug
-
Status: Closed
-
Priority:
Critical
-
Resolution: Fixed
-
Affects Version/s: 2.7.0
-
Fix Version/s: 2.8.0, 2.7.1, 3.0.0-alpha1
-
Component/s: fairscheduler
-
Labels:None
-
Target Version/s:
-
Hadoop Flags:Reviewed
FairScheduler's headroom calculations consider the fairshare and cluster-available-resources, and the fairshare has maxResources. However, for Fifo and Fairshare policies, the fairshare is used only for memory and not cpu. So, the scheduler ends up showing a higher headroom than is actually available. This could lead to applications waiting for resources far longer than then intend to. e.g. MAPREDUCE-6302.
- is duplicated by
-
YARN-3891 Apps are starved for resource due to default FairSharePolicy in Fair Scheduler
-
- Resolved
-
- relates to
-
MAPREDUCE-6302 Preempt reducers after a configurable timeout irrespective of headroom
-
- Closed
-