[MAPREDUCE-6916] History server scheduling tasks at fixed rate can be problematic when those tasks are slow

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.7.4
• Component/s: jobhistoryserver
• Assignee: Unassigned
• Reporter: Jason Darrell Lowe
• Created: 18/Jul/17 20:53
• Updated: 18/Jul/17 20:58

Description

The job history server currently schedules both the task of moving jobs from intermediate to done and the task of cleaning jobs at a fixed rate. If those tasks take longer than the rate period to execute then a backlog of to-be-scheduled tasks can build up and cause a long storm of them to execute later when the blockage clears.