[HADOOP-4558] Scheduler fails to reclaim capacity if Jobs are submitted to queue one after the other

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.19.0
• Fix Version/s: 0.20.0

Environment

Cluster Capacity Maps=Reduces =210 each
Two Queues:
Q1: default, GC (%) =40, GC=84 (Maps and Reduces each). Reclaim time = 3 mins.
Q2: test_q1, GC (%) =60, GC=126 (Maps and Reduces each) Reclaim time = 2 mins

• Hadoop Flags: Reviewed
• Assignee: Amar Kamat
• Reporter: Karam Singh
• Created: 31/Oct/08 14:42
• Updated: 02/May/13 02:29
• Resolved: 04/Dec/08 14:01

Description

Scheduler fails to reclaim capacity if Jobs are submitted to queue one after the other.
First job submitted with tasks equal to cluster's M/R Capacity
Second is submitted to different queue when all tasks of First Job are running, scheduler fails to reclaim capacity for second job.

Issue Links

• depends upon: HADOOP-4623 Running tasks are not maintained by JobInProgress if speculation is off