[MAPREDUCE-2320] RAID DistBlockFixer should limit pending jobs instead of pending files

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Won't Fix
• Affects Version/s: 0.20.2, 0.20.3
• Component/s: contrib/raid
• Assignee: Ramkumar Vadali
• Reporter: Ramkumar Vadali
• Created: 11/Feb/11 17:57
• Updated: 01/Aug/17 17:10
• Resolved: 01/Aug/17 17:10

Description

DistBlockFixer limits the number of files being fixed simultaneously to avoid an unlimited backlog. This limits the number of parallel jobs though, and if one job has a long running task, it prevents newer jobs being started. Instead, it should have a limit on running jobs. That way, one long running task will not block other jobs.