[HADOOP-4471] Capacity Scheduler should maintain the right ordering of jobs in its running queue

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.19.0
• Fix Version/s: 0.19.0
• Hadoop Flags: Reviewed
• Assignee: Amar Kamat
• Reporter: Vivek Ratan
• Created: 21/Oct/08 08:45
• Updated: 08/Jul/09 16:40
• Resolved: 13/Nov/08 14:13

Description

Currently, the Capacity Scheduler maintains a simple linked list of jobs which are running. This implies that running jobs are sorted by when they started running (i.e., when they were added to the queue). The Scheduler should maintain the same ordering among running jobs that it does for waiting jobs. Jobs should be sorted by priority (if the queue supports priorities) and by their submit time.

This sorting would be more fair in deciding which running jobs get access to a free TT. It also does not penalize jobs that have a longer setup task, which affects when they enter the run queue.

Issue Links

• blocks: HADOOP-4428 Job Priorities are not handled properly